CN113031860B - Performance optimization method of NAS storage in video stream field - Google Patents

Performance optimization method of NAS storage in video stream field Download PDF

Info

Publication number
CN113031860B
CN113031860B CN202110226696.XA CN202110226696A CN113031860B CN 113031860 B CN113031860 B CN 113031860B CN 202110226696 A CN202110226696 A CN 202110226696A CN 113031860 B CN113031860 B CN 113031860B
Authority
CN
China
Prior art keywords
fuse
performance optimization
video
nas storage
optimization method
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110226696.XA
Other languages
Chinese (zh)
Other versions
CN113031860A (en
Inventor
贾如瑞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Unicloud Technology Co Ltd
Original Assignee
Unicloud Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Unicloud Technology Co Ltd filed Critical Unicloud Technology Co Ltd
Priority to CN202110226696.XA priority Critical patent/CN113031860B/en
Publication of CN113031860A publication Critical patent/CN113031860A/en
Application granted granted Critical
Publication of CN113031860B publication Critical patent/CN113031860B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061Improving I/O performance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614Improving the reliability of storage systems
    • G06F3/0619Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • G06F3/0632Configuration or reconfiguration of storage systems by initialisation or re-initialisation of storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/0643Management of files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0652Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/40Transformation of program code
    • G06F8/41Compilation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/60Software deployment
    • G06F8/61Installation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44505Configuring for program initiating, e.g. using registry, configuration files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061Partitioning or combining of resources
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/5011Pool
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/5018Thread allocation

Abstract

The invention provides a performance optimization method of NAS storage in the field of video streaming, which comprises the following steps: firstly, optimizing fuse, acquiring a Linux kernel source code, and installing the kernel source code after rpmbid; then optimizing Linux Fuse parameters to generate new fuse.ko; entering a root/rpmbild/BUILD directory, and finding a kernel directory linux-3.10.0-1127.el7.x86_ 64/fs/fuse; finding out fuse _ i.h and inode.c, respectively modifying the following parts of the two files, and optimizing fuse parameters; the # define FUSE _ MAX _ PAGES _ PER _ REQ 32 is modified to 256. The invention has the beneficial effects that: a performance optimization method of NAS storage in the field of video streaming is characterized in that a client is additionally provided with a camera, and after purple light cloud storage, a stripe relation and an equipment video plan are configured, real-time streaming, video writing and video on demand can be forwarded, videos are deleted when the storage life of the videos is up, and the number of concurrent paths can be increased after optimization.

Description

Performance optimization method of NAS storage in video stream field
Technical Field
The invention belongs to the technical field of public cloud storage, and particularly relates to a performance optimization method of NAS storage in the field of video streaming.
Background
The cloud storage gateway provides a public cloud storage service. An application program of the user local data center accesses the gateway through a standard storage protocol (SMB protocol) and is connected to the purple light cloud, and synchronous management of user local and purple light cloud storage data is achieved. Because the problem of frame loss is caused when the video stream is directly stored in the object cluster, the frame loss can be reduced by using the technology of the NAS method application cache.
Disclosure of Invention
In view of this, the present invention is directed to a performance optimization method for NAS storage in the field of video streaming, which modifies a registry on a Windows side, modifies a kernel fuse write size on a linux side, repacks and compiles the kernel fuse write size, configures related parameters of the kernel fuse write size, modifies the number of open files, and modifies the Windows registry and the size of chunk _ size of object storage. After optimization, frame loss is obviously reduced, and the read-write bandwidth is improved.
In order to achieve the purpose, the technical scheme of the invention is realized as follows:
a performance optimization method of NAS storage in the field of video streaming comprises the following steps:
firstly, optimizing fuse, acquiring a Linux kernel source code, and installing the kernel source code after rpmbid; then optimizing Linux Fuse parameters to generate new fuse.ko; entering a root/rpmbild/BUILD directory, and finding a kernel directory linux-3.10.0-1127.el7.x86_ 64/fs/fuse; finding out fuse _ i.h and inode.c, respectively modifying the following parts of the two files, and optimizing fuse parameters; modify # define FUSE _ MAX _ PAGES _ PER _ REQ 32 to 256; modify # define FUSE _ DEFAULT _ MAX _ backcount 12 to 32 to increase the granularity size; compiling the fuse module to generate fuse.ko after optimizing the parameters of the fuse module, and inserting the generated fuse.ko into the kernel module;
in the same way, the libfuse module downloads and optimizes the buffer size patch part, and KERNEL _ BUF _ PAGES is set to 256 from 32.
Further, a server is preset as an SMS server, a server is preset as an SPS server, 2 servers are preset as simulators, and 2 servers are preset as forwarding and on-demand tools.
Further, VFS _ aio _ pthread is a VFS module of Samba for implementing asynchronous creation of new files using thread pools, and is closed by default.
Further, the vfs _ aio _ pthread module is turned on as follows: and vfs objects, aio _ pthread aio _ pthread, aio open, yes, and writes the configuration in the samb configuration file.
Further, the asynchronous opening is realized by the following steps:
a. the Samba main thread receives an SMB2_ OP _ CREATE request to perform pre-processing, and takes the real file open operation as a jobs to a jobs queue;
b. taking out the jobs from the jobs queue by pthreampool and executing the jobs in one sub thread;
c. after the execution thread finishes the jobs, notifying the Samba main thread, and executing SMB2_ OP _ CREATE request pre-stage preprocessing again by the Samba main thread;
d. and detecting that the open jobs is finished, and continuing to finish the rest opening process.
Further, the pre-processing comprises file name conversion, oplock allocation, authority check, stat and getxatt.
Further, the method also comprises the following steps of optimizing an object storage part: toml _ upload _ min _ chunk _ size and upload _ max _ chunk _ size are set to 64M to improve the read-write bandwidth of its video files.
Further, in the long-term operation of the system, the video files may have a huge amount of information, in this scenario, the number of open files of the Linux system default file will limit the number of files read at the same time, and the number of open files of the Linux system is set to be the maximum: the method comprises the steps of firstly modifying a/etc/security/limits. conf configuration file, setting hardware and software values of a file descriptor limit profile and a process number limit noproc to be 65535, and enabling a machine to take effect after being restarted.
Further, remove FILE _ FLAG _ WRITE _ thread and increase genereric _ READ, and by increasing WRITE _ fifo _ length to 50; and modifying the Windows registry path: HKLM \ System \ Current control set \ Services \ LanmanWorkstation \ Parameters, under the path, a DWORD type key is added, named DisableLargeMtu, the value of the DWORD type key is set to be 0, and the DWORD type key can take effect after being restarted.
Compared with the prior art, the performance optimization method of the NAS storage in the field of video streaming has the following beneficial effects:
(1) the invention relates to a performance optimization method of NAS storage in the field of video streaming, which is characterized in that a client is additionally provided with a camera, and after purple light cloud storage, a stripe relation and an equipment video plan are configured, real-time streaming, video writing and video on demand can be forwarded, and if the storage period of the video is up, the video is deleted, and the number of concurrent paths can be increased after optimization;
(2) according to the performance optimization method of the NAS storage in the field of video streaming, the performance of an integrated management platform in access storage (object storage on a non-cloud) can reach 120-path × 4Mb writing, 60-path 4Mb forwarding and 12-path 4Mb on demand;
(3) the invention relates to a performance optimization method of NAS storage in the field of video streaming, which is characterized in that after the storage time of a video is expired, an SPS starts to delete the expired video, and the service runs for a long time without frame loss under the condition that the expired video is deleted and a new video is written in at the same time;
(4) the performance optimization method of the NAS storage in the field of video streaming supports most mainstream operating systems including Ubuntu, CentOS, SUSE, macOS and the like, and is convenient to deploy and debug;
(5) the performance optimization method of the NAS storage in the field of video streaming can be applied in various scenes: the front-end equipment can be accessed to the public network and stored to the cloud. Or the data can be stored in a cache disk through an intranet and then uploaded to the cloud. The method supports the synchronization of small files in a local or virtual reverse machine to an object for storage;
(6) according to the performance optimization method of the NAS storage in the field of video streaming, under the limit pressure, for example, when the system is fully loaded, the video streaming has no blocking and screen splash conditions, the time consumption of the system is in a reasonable range, and the stability is good;
(7) the performance optimization method of the NAS storage in the field of video streaming, disclosed by the invention, has the advantages that the video is searched in a video playback interface for several minutes after the video is recorded, the checking time is normal, the video playing picture is normal, and the playback response is quicker.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate an embodiment of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic diagram of a network topology of a system according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a system optimization process according to an embodiment of the present invention.
Detailed Description
It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict.
The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.
As shown in fig. 1 and 2, the architecture layout of the whole system is designed: one server is used as an SMS server, one server is used as an SPS server, 2 servers are used as simulators, 2 servers are used as forwarding and ordering tools, and one server is used as a client; the system network topology is shown in fig. 1.
Firstly, fuse is optimized, a Linux kernel source code is obtained through an official website, and the kernel source code can be installed after rpmbid. And then optimizing the Linux Fuse parameter to generate new Fuse. And entering a root/rpmbild/BUILD directory, and finding a kernel directory linux-3.10.0-1127.el7.x86_64/fs/fuse (different environment directory versions). Find fuse _ i.h and inode.c, modify the following parts of the two files, respectively, optimizing fuse parameters. The # define FUSE _ MAX _ PAGES _ PER _ REQ 32 is modified to 256. The # define FUSE _ defiault _ MAX _ backcount 12 is modified to 32 to increase the granularity size. And compiling the fuse module to generate fuse after optimizing the parameters of the fuse module, and inserting the generated fuse. In the same way, the libfuse module downloads and optimizes the buffer size patch part, and KERNEL _ BUF _ PAGES is set to 256 from 32.
VFS _ aio _ pthread is a VFS module for Samba. The functions are as follows: the asynchronous creation of new files is implemented using a thread pool (pthread pool). The vfs _ aio _ pthread module is off by default. The opening mode is as follows: vfs objects aio _ pthred aio _ yes, aio open yes. This configuration is written in the samb configuration file. The asynchronous opening is realized by the following 3 steps:
a. the Samba main thread receives SMB2_ OP _ CREATE request to perform pre-processing (including file name conversion, oplock allocation, authority check, stat, getxattr) and gives the real file open operation as a jobb to the jobs queue
b. pthreampoool fetches a job in the job queue and executes on one of the child threads
c. After the execution thread finishes the job, the execution thread informs the Samba main thread, and the SMB2_ OP _ CREATE is executed again by the Samba main thread to request the early-stage preprocessing (including file name conversion, oplock allocation, authority check, stat, getxattr)
d. And detecting that the open jobs is finished, and continuing to finish the rest opening process.
Optimizing the object storage section: toml _ upload _ min _ chunk _ size and upload _ max _ chunk _ size are set to 64M to improve the read-write bandwidth of its video files.
In the long-term operation of the system, the video files may have a huge amount of situations, and in this scenario, the number of the files that are simultaneously read is limited by the default file opening number of the linux system. Setting the opening number of the Linux file to be maximum: conf configuration file is first modified to set the hardware and software values of the file descriptor limit profile, the process number limit noproc, to 65535. Some systems may also support settings of ulimited. The machine can take effect after being restarted.
Remove FILE _ FLAG _ WRITE _ thread and increase genereric _ READ, and by increasing WRITE _ fifo _ length to 50. And modifying the Windows registry path: HKLM \ System \ Current control set \ Services \ LanmanWorkstation \ Parameters. Under the path, a DWORD type key named DisableLargeMtu is added, the value of the DWORD type key is set to be 0, the DWORD type key can take effect after being restarted, and the optimization process is shown in FIG. 2. The physical machine layer may use the cache disk with the ssd disk.
Those of ordinary skill in the art will appreciate that the elements and method steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described in a functional general in the foregoing description for the purpose of clearly illustrating the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the several embodiments provided in the present application, it should be understood that the disclosed method and system may be implemented in other ways. For example, the above described division of elements is merely a logical division, and other divisions may be realized, for example, multiple elements or components may be combined or integrated into another system, or some features may be omitted, or not executed. The units may or may not be physically separate, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present invention, and they should be construed as being included in the following claims and description.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (9)

1. A performance optimization method of NAS storage in the field of video streaming is characterized by comprising the following steps:
firstly, optimizing fuse, acquiring a Linux kernel source code, and installing the kernel source code after rpmbid; then optimizing Linux Fuse parameters to generate new fuse.ko; entering a root/rpmbild/BUILD directory, and finding a kernel directory linux-3.10.0-1127.el7.x86_ 64/fs/fuse; finding out fuse _ i.h and inode.c, respectively modifying the following parts of the two files, and optimizing fuse parameters; modify # define FUSE _ MAX _ PAGES _ PER _ REQ 32 to 256; modify # define FUSE _ DEFAULT _ MAX _ backcount 12 to 32 to increase the granularity size; compiling the fuse module to generate fuse.ko after optimizing the parameters of the fuse module, and inserting the generated fuse.ko into the kernel module;
in the same way, the libfuse module downloads and optimizes the buffer size patch part, and KERNEL _ BUF _ PAGES is set to 256 from 32.
2. The method according to claim 1, wherein the NAS storage is a performance optimization method in the field of video streaming, and the method comprises: one server is preset as an SMS server, one server is preset as an SPS server, 2 servers are preset as simulators, and 2 servers are preset as forwarding and on-demand tools.
3. The method according to claim 1, wherein the NAS storage is a performance optimization method in the field of video streaming, and the method comprises: VFS _ aio _ pthread is a VFS module of Samba for asynchronously creating new files using thread pools, and is closed by default.
4. The method according to claim 3, wherein the NAS storage is used in a performance optimization method in the video streaming field, and the method comprises the following steps: the vfs _ aio _ pthread module is turned on as follows: and vfs objects, aio _ pthread aio _ pthread, aio open, yes, and writes the configuration in the samb configuration file.
5. The method for optimizing the performance of the NAS storage in the video streaming field according to claim 4, wherein the asynchronous opening is realized by the following steps:
a. the Samba main thread receives an SMB2_ OP _ CREATE request to perform pre-processing, and takes the real file open operation as a jobs to a jobs queue;
b. taking out the jobs from the jobs queue by pthreampool and executing the jobs in one sub thread;
c. after the execution thread finishes the jobs, notifying the Samba main thread, and executing SMB2_ OP _ CREATE request pre-stage preprocessing again by the Samba main thread;
d. and detecting that the open jobs is finished, and continuing to finish the rest opening process.
6. The method according to claim 5, wherein the NAS storage is used in a performance optimization method in the video streaming field, and the method comprises the following steps: the pre-processing comprises file name conversion, oplock allocation, authority check, stat and getxatt.
7. The method according to claim 5, wherein the NAS storage is used in a performance optimization method in the video streaming field, and the method comprises the following steps: further comprising an optimized object storage section: toml _ upload _ min _ chunk _ size and upload _ max _ chunk _ size are set to 64M to improve the read-write bandwidth of its video files.
8. The method according to claim 5, wherein the NAS storage is used in a performance optimization method in the video streaming field, and the method comprises the following steps: in the long-term operation of the system, the video files may have a mass condition, in this scenario, the number of the opened files of the Linux system default file can limit the number of the files read at the same time, and the number of the opened files of the Linux system is set to be the maximum: the method comprises the steps of firstly modifying a/etc/security/limits. conf configuration file, setting hardware and software values of a file descriptor limit profile and a process number limit noproc to be 65535, and enabling a machine to take effect after being restarted.
9. The method according to claim 5, wherein the NAS storage is used in a performance optimization method in the video streaming field, and the method comprises the following steps: remove FILE _ FLAG _ WRITE _ thread and increase genereric _ READ, and by increasing WRITE _ fifo _ length to 50; and modifying the Windows registry path: HKLM \ System \ Current control set \ Services \ LanmanWorkstation \ Parameters, under the path, a DWORD type key is added, named DisableLargeMtu, the value of the DWORD type key is set to be 0, and the DWORD type key can take effect after being restarted.
CN202110226696.XA 2021-02-24 2021-02-24 Performance optimization method of NAS storage in video stream field Active CN113031860B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110226696.XA CN113031860B (en) 2021-02-24 2021-02-24 Performance optimization method of NAS storage in video stream field

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110226696.XA CN113031860B (en) 2021-02-24 2021-02-24 Performance optimization method of NAS storage in video stream field

Publications (2)

Publication Number Publication Date
CN113031860A CN113031860A (en) 2021-06-25
CN113031860B true CN113031860B (en) 2022-04-05

Family

ID=76465215

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110226696.XA Active CN113031860B (en) 2021-02-24 2021-02-24 Performance optimization method of NAS storage in video stream field

Country Status (1)

Country Link
CN (1) CN113031860B (en)

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030079016A1 (en) * 2001-10-23 2003-04-24 Sheng (Ted) Tai Tsao Using NAS appliance to build a non-conventional distributed video server
CN106610967B (en) * 2015-10-21 2020-06-12 杭州海康威视数字技术股份有限公司 Method and device for reading and writing video data in NAS (network attached storage) equipment
US10228860B2 (en) * 2016-11-14 2019-03-12 Open Drives LLC Storage optimization based I/O pattern modeling
CN106708627B (en) * 2016-12-29 2020-08-07 中国科学院计算技术研究所 Kvm-based multi-virtual machine mapping and multi-channel fuse acceleration method and system
CN107749893B (en) * 2017-11-09 2021-03-30 北京精一强远科技有限公司 Method for realizing rapid data receiving and storing in shared file system
US10768917B2 (en) * 2018-12-17 2020-09-08 International Business Machines Corporation Dynamic deployment placement of processing elements in a streaming data system

Also Published As

Publication number Publication date
CN113031860A (en) 2021-06-25

Similar Documents

Publication Publication Date Title
US11604759B2 (en) Retention management for data streams
US11163728B2 (en) Sharing container images utilizing a shared storage system
RU2671049C2 (en) Flushing in file system
US11334686B2 (en) Comprehensive system wide cross-reference mechanism using runtime data collection
US20130117744A1 (en) Methods and apparatus for providing hypervisor-level acceleration and virtualization services
BR112016010555B1 (en) MANAGED SERVICE METHODS AND SYSTEMS FOR ACQUISITION, STORAGE AND CONSUMPTION OF LARGE-SCALE DATA STREAM AND STORAGE MEDIA ACCESSIBLE BY NON-TRANSITORY COMPUTER
CN109271098B (en) Data migration method and device
US9183130B2 (en) Data control system for virtual environment
CN111708738B (en) Method and system for realizing interaction of hadoop file system hdfs and object storage s3 data
US11281509B2 (en) Shared memory management
US11099768B2 (en) Transitioning from an original device to a new device within a data storage array
US20120259900A1 (en) Virtual Disk Utility
US20220358106A1 (en) Proxy-based database scaling
US11150981B2 (en) Fast recovery from failures in a chronologically ordered log-structured key-value storage system
US11853284B2 (en) In-place updates with concurrent reads in a decomposed state
US11768740B2 (en) Restoring operation of data storage systems at disaster recovery sites
CN113031860B (en) Performance optimization method of NAS storage in video stream field
Lim et al. Androtrace: framework for tracing and analyzing IOs on Android
CN109254958A (en) Distributed data reading/writing method, equipment and system
US20160313919A1 (en) Sub-block input/output (i/o) commands for storage device including byte stream buffer
US11086557B2 (en) Continuous asynchronous replication from on-premises storage to cloud object stores
US10242707B1 (en) Timing index writes to a tape medium
US11886439B1 (en) Asynchronous change data capture for direct external transmission
US11341159B2 (en) In-stream data load in a replication environment
US10712952B1 (en) Metadata caches in a reliable distributed computing system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant