CN117112268B - Memory sharing management method and system - Google Patents

Memory sharing management method and system Download PDF

Info

Publication number
CN117112268B
CN117112268B CN202311375032.5A CN202311375032A CN117112268B CN 117112268 B CN117112268 B CN 117112268B CN 202311375032 A CN202311375032 A CN 202311375032A CN 117112268 B CN117112268 B CN 117112268B
Authority
CN
China
Prior art keywords
data
write
queue
virtual memory
read
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202311375032.5A
Other languages
Chinese (zh)
Other versions
CN117112268A (en
Inventor
罗运新
丁雪峰
万山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Colorful Co ltd
Original Assignee
Shenzhen Colorful Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Colorful Co ltd filed Critical Shenzhen Colorful Co ltd
Priority to CN202311375032.5A priority Critical patent/CN117112268B/en
Publication of CN117112268A publication Critical patent/CN117112268A/en
Application granted granted Critical
Publication of CN117112268B publication Critical patent/CN117112268B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/544Buffers; Shared memory; Pipes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5011Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
    • G06F9/5016Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061Partitioning or combining of resources
    • G06F9/5077Logical partitioning of resources; Management or configuration of virtualized resources
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/54Indexing scheme relating to G06F9/54
    • G06F2209/548Queue
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention relates to the technical field of memory sharing and discloses a memory sharing management method and system, wherein the memory sharing management method and system comprises a virtual twin module, a data mapping module, a writing processing module and a mapping record module; through the setting of the related functional modules, memory sharing management based on a virtual memory space is realized, high-heat data in each process or among a plurality of processes is written into a shared memory, so that a plurality of tasks or terminals in the processes can conveniently access the data, static storage can simultaneously respond to more data reading requests, and based on the shared memory, different processes can realize cooperative processing and display of the data by a plurality of tasks or the plurality of terminals at a server side, and the problem of data treading caused by the use of the data in the static storage among the plurality of processes is avoided.

Description

Memory sharing management method and system
Technical Field
The invention relates to the technical field of memory sharing, in particular to a memory sharing management method and system.
Background
In the data service structure of the multi-terminal device, access and uninterrupted data reading and writing of the multi-terminal device to the server side can generate larger data processing pressure on the server side, so that the server is required to provide more processing calculation force and data communication bandwidth, the service life consumption of hardware is increased in long-time frequent communication, and the problem that data safety is affected due to data treading and the like is generated.
In the prior art, the shared memory is adopted to deal with scenes, the shared memory is used for communication among processes very conveniently, data sharing ensures that the data among processes are not transmitted, but directly access the memory, so that the efficiency of a program is accelerated, but the shared memory in the prior art has no data synchronization mechanism, is directly set based on the storage of a server, and does not have the capability of managing and controlling the data optimization.
Disclosure of Invention
The present invention is directed to a memory sharing management method and system, so as to solve the problems set forth in the background art.
In order to achieve the above purpose, the present invention provides the following technical solutions:
a memory sharing management system, comprising:
the virtual twin module is used for creating a virtual memory space of a process when executing the process, wherein the virtual memory space is correspondingly provided with a virtual memory address, the virtual memory address is used for guiding to access a designated data sector of the virtual memory space, and the virtual memory space is commonly accessed by a plurality of execution objects of the process;
the data mapping module is used for monitoring data read-write behaviors of each data block in the static storage and generating a record log, if the record log represents that the read-write frequency of the data block reaches a preset value, a shared memory corresponding to the data block is created, and the shared memory and the stored data thereof are mapped in the virtual memory space;
the writing processing module is used for carrying out queue supervision on the data writing requests in the virtual memory space, establishing twin data of corresponding data modified by the requests based on the data writing requests and responding to the data writing requests, wherein the twin data and the shared memory share the same virtual memory address;
and the mapping record module is used for carrying out data synchronization on the data blocks in the static storage based on the shared memory and deleting the shared memory when the record log represents that the read-write frequency of the corresponding shared memory is lower than a preset value and the queue of the data write request is empty.
As a further aspect of the invention: the static storage space is a total storage space of the server side and can be synchronously accessed by a plurality of processes for data reading and writing, each process is connected with a plurality of user terminals for collaborative operation, and the user terminals are correspondingly executable reading processes and writing processes and are respectively used for executing data reading requests and data writing requests.
As still further aspects of the invention: the write processing module includes:
the system comprises a data writing unit, a data writing unit and a queue, wherein the data writing unit is used for acquiring data writing requests, generating a queue based on the acquisition time of the data writing requests, sequentially responding to and executing the data writing requests in the queue, and the queue comprises a queue ordering control program which is used for responding to a queue ordering control signal of a user terminal and changing the queue order of the data writing requests in the queue;
the twin processing unit is used for establishing twin data of the shared memory corresponding to the data writing request, carrying out replacement modification on the twin data based on the data writing request, and updating and deleting the data of the shared memory based on the twin data after the data writing request is completely executed;
and the real-time output unit is used for responding to the data reading request and correspondingly outputting shared content data, and when the data writing request is synchronously executed, the shared memory and the twin data in modification are synchronously output in real time.
As still further aspects of the invention: the device also comprises a period scheduling module, wherein the period scheduling module specifically comprises:
and the heat evaluation unit is used for recording and evaluating the data reading and writing frequency of the data blocks in one cycle recording period and sequencing a plurality of the data blocks based on the data reading and writing frequency.
And the data scheduling unit is used for judging the sequence of the adjacent data blocks, and if the sequence number difference value of the adjacent data blocks in the sequence is larger than a preset value, replacing the stored data sector of the data block and updating the storage state.
As still further aspects of the invention: the virtual memory space correspondingly comprises maximum data traffic in unit time, the maximum data traffic is used for representing the total data quantity which can pass through the communication between a node at a certain time and the virtual memory space at the same time, and the periodic scheduling module further comprises a memory scheduling unit;
the memory scheduling unit is used for judging the data read-write frequency of a plurality of data blocks in the virtual memory space, and if the total data traffic in unit time based on the corresponding data read-write frequency exceeds the preset percentage of the maximum data amount, the data sector chain with high read-write frequency is replaced by the stored data sector.
The embodiment of the invention aims to provide a memory sharing management method, which comprises the following steps:
when executing a certain process, creating a virtual memory space of the process, wherein the virtual memory space is correspondingly provided with a virtual memory address, the virtual memory address is used for guiding to access a designated data sector of the virtual memory space, and the virtual memory space is commonly accessed by a plurality of execution objects of the process;
monitoring data read-write behaviors of each data block in static storage and generating a record log, if the record log represents that the read-write frequency of the data block reaches a preset value, creating a shared memory corresponding to the data block and mirroring the shared memory and stored data thereof in the virtual memory space;
queue supervision is carried out on the data writing requests in the virtual memory space, twin data of corresponding data modified by the requests are established based on the data writing requests and used for responding to the data writing requests, and the twin data and the shared memory share the same virtual memory address;
and when the record log represents that the read-write frequency of the corresponding shared memory is lower than a preset value and the queue of the data write request is empty, performing data synchronization on the data block in the static storage based on the shared memory, and deleting the shared memory.
As a further aspect of the invention: the static storage space is a total storage space of the server side and can be synchronously accessed by a plurality of processes for data reading and writing, each process is connected with a plurality of user terminals for collaborative operation, and the user terminals are correspondingly executable reading processes and writing processes and are respectively used for executing data reading requests and data writing requests.
As still further aspects of the invention: the step of performing queue supervision on the data write request in the virtual memory space, and establishing twin data of corresponding data based on the data write request for responding to the data write request specifically includes:
acquiring a data writing request, generating a queue based on the acquisition time of the data writing request, and sequentially responding to and executing the data writing request in the queue, wherein the queue comprises a queue ordering control program, and the queue ordering control program is used for responding to a queue ordering control signal of a user terminal and changing the queue order of the data writing request in the queue;
establishing twin data corresponding to a shared memory of a data writing request, carrying out replacement modification on the twin data based on the data writing request, and after the data writing request is completely executed, updating and deleting the data based on the twin data;
and responding to a data read request and correspondingly outputting shared content data, and synchronously outputting the shared memory and the twin data in modification in real time when the data write request is synchronously executed.
As still further aspects of the invention: the method also comprises the steps of:
the heat evaluation unit is used for recording and evaluating the data read-write frequency of the data blocks in a cycle recording period and sequencing a plurality of the data blocks based on the data read-write frequency;
and the data scheduling unit is used for judging the sequence of the adjacent data blocks, and if the sequence number difference value of the adjacent data blocks in the sequence is larger than a preset value, replacing the stored data sector of the data block and updating the storage state.
As still further aspects of the invention: the virtual memory space correspondingly comprises the maximum data traffic of unit time, the maximum data traffic is used for representing the total data quantity which can be passed by a certain time node and the virtual memory space at the same time, and the method further comprises the steps of:
judging the data read-write frequency of a plurality of data blocks in the virtual memory space, and if the total data traffic exceeds the preset percentage of the maximum data traffic based on the unit time of the corresponding data read-write frequency, replacing the data sector of the data zone chain with the high read-write frequency.
Compared with the prior art, the invention has the beneficial effects that: through the setting of the related functional modules, memory sharing management based on a virtual memory space is realized, high-heat data in each process or among a plurality of processes is written into a shared memory, so that a plurality of tasks or terminals in the processes can conveniently access the data, static storage can simultaneously respond to more data reading requests, and based on the shared memory, different processes can realize cooperative processing and display of the data by a plurality of tasks or the plurality of terminals at a server side, and the problem of data treading caused by the use of the data in the static storage among the plurality of processes is avoided.
Drawings
FIG. 1 is a block diagram of a memory sharing management system.
FIG. 2 is a block diagram showing the write processing modules in the memory sharing management system.
FIG. 3 is a block diagram illustrating a periodic scheduling module of a memory sharing management system.
Fig. 4 is a flow chart of a memory sharing management method.
Description of the embodiments
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Specific implementations of the invention are described in detail below in connection with specific embodiments.
As shown in fig. 1, a memory sharing management system according to an embodiment of the present invention includes the following steps:
the virtual twin module 100 is configured to create a virtual memory space of a process when the process is executed, where the virtual memory space is correspondingly provided with a virtual memory address, and the virtual memory address is used for guiding access to a specified data sector of the virtual memory space, and the virtual memory space is commonly accessed by multiple execution objects of the process.
The data mapping module 200 is configured to monitor data read-write behavior of each data block in static storage and generate a log record, and if the log record characterizes that the read-write frequency of the data block reaches a preset value, create a shared memory corresponding to the data block and map the shared memory and the data stored in the shared memory in the virtual memory space.
The write processing module 300 is configured to perform queue supervision on a data write request in a virtual memory space, and establish twin data of corresponding data modified by a request based on the data write request for responding to the data write request, where the twin data and the shared memory share the same virtual memory address.
The mapping record module 400 is configured to perform data synchronization on a data block in static storage based on the shared memory and delete the shared memory when the record log indicates that the read-write frequency of the corresponding shared memory is lower than a preset value and a queue of data write requests is empty.
In this embodiment, a memory sharing management method is provided, through setting related functional modules, memory sharing management based on a virtual memory space is realized, high-heat data in each process or among a plurality of processes is written into a shared memory, so that access of a plurality of tasks or terminals to data in the process can be facilitated, static energy storage can simultaneously respond to more data reading requests, and based on the shared memory, different processes can realize cooperative processing and display of the data by a plurality of tasks or a plurality of terminals at a server side, and the problem of data treading caused by the use of the data in the static storage among the processes is avoided; in particular, the system is applicable to a group cloud service scenario, each process may be understood as a group, and the group cloud service scenario includes a plurality of terminals or a plurality of parallel tasks, where the plurality of terminals or the parallel tasks may access a certain data content at the same time, so that when the process is executed, the bandwidth occupied for statically stored data is large and repeated, and the processing efficiency of the static storage for the plurality of processes may be reduced, so that a shared memory is correspondingly established for different processes, and the shared memory is synchronously copied (corresponding data storage blocks are synchronized to the shared memory) by using the different processes, and when a certain terminal performs a data writing operation on the shared memory, a twin backup is generated by writing the corresponding data by using the same terminal, and when the terminal performs the data writing operation on the shared memory, the twin backup data is modified and replaced by using the twin data and source data to share the same virtual memory address, and when other terminals in the process perform the data writing operation on the data, the source data and the twin backup is synchronously acquired by using the read operation and the modified twin backup, and the parallel contents are compared in real time.
In another preferred embodiment of the present invention, the static storage space is a total storage space of the server side, and can be synchronously accessed by a plurality of processes for data read-write, each process is connected with a plurality of user terminals for collaborative operation, and the user terminals are correspondingly capable of executing a read process and a write process and are respectively used for executing a data read request and a data write request.
As shown in fig. 2, further, the write processing module 300 includes:
the write queue unit 301 is configured to acquire a data write request, generate a queue based on an acquisition time of the data write request, and sequentially respond to and execute the data write request in the queue, where the queue includes a queue ordering control program, and the queue ordering control program is configured to respond to a queue ordering control signal of the user terminal and change a queue order of the data write request in the queue.
The twin processing unit 302 is configured to establish twin data corresponding to a shared memory of a data write request, perform replacement modification on the twin data based on the data write request, and update and delete data based on the twin data after the data write request is completely executed.
And the real-time output unit 303 is configured to respond to a data read request and correspondingly output shared content data, and when the data write request is synchronously executed, the shared memory and the twin data in modification are synchronously output in real time.
In this embodiment, the write processing module 300 is functionally divided, and for a process including multiple terminals or tasks, multiple read-write request tasks for the same data may be generated at the same time, so that queue management needs to be performed on multiple tasks, so that multiple read-write tasks are guaranteed to be performed in sequence, and data treading is avoided; in order to facilitate information data synchronization among a plurality of terminals in a process, when a data writing request is responded, twin backup is carried out on data to be written, and the twin data is used for responding the writing request to carry out modification and replacement.
As shown in fig. 3, as another preferred embodiment of the present invention, the system further includes a periodic scheduling module 500, where the periodic scheduling module 500 specifically includes:
the heat evaluation unit 501 is configured to record and evaluate a data read-write frequency of a data block in a cycle recording period, and order a plurality of the data blocks based on the data read-write frequency.
And the data scheduling unit 502 is configured to determine the ordering of the adjacent data blocks, and if the sequence number difference between the adjacent data blocks in the ordering is greater than a preset value, replace the stored data sector of the data block and update the storage state.
In this embodiment, the sector scheduling management is performed on the data through the data heat condition in one period, so that when the next shared memory is built, a larger data sector can be conveniently used as a unit, and distributed damage caused by distributed high-strength reading and writing of the storage medium can be effectively avoided (that is, if the high-heat data storage is scattered on a complete data surface, after the high-strength reading and writing operation, when the disk surface is damaged due to exceeding the reading and writing service life, the distribution of the data is possibly scattered very, and the rest of the non-contact disk surfaces can not store large data, so that resources are wasted, and the equipment maintenance is inconvenient), thereby facilitating replacement and maintenance.
As shown in fig. 3, as another preferred embodiment of the present invention, the virtual memory space corresponds to a maximum data traffic amount in a unit time, where the maximum data traffic amount is used to characterize a total amount of data that can be passed through by a node and the virtual memory space at the same time, and the periodic scheduling module further includes a memory scheduling unit;
the memory scheduling unit 503 is configured to determine data read/write frequencies of a plurality of data blocks in the virtual memory space, and if the total data traffic per unit time based on the corresponding data read/write frequency exceeds the preset percentage of the maximum data traffic, replace the data sector of the data zone chain with the high read/write frequency.
In this embodiment, for the method for centrally storing high heat data adopted for maintaining the data surface in the previous embodiment, since the same virtual memory space has an upper limit of the data processing rate, the memory scheduling unit 503 is required to perform additional control, so as to avoid that the estimated read-write amount of the unit time of the high heat data stored in the bronze drum block is too high to exceed the upper limit of the maximum data processing rate (a certain percentage is set to ensure a certain margin).
As shown in fig. 4, the present invention further provides a memory sharing management method, which includes the steps of:
s10, when executing a certain process, creating a virtual memory space of the process, wherein the virtual memory space is correspondingly provided with a virtual memory address, the virtual memory address is used for guiding to access a designated data sector of the virtual memory space, and the virtual memory space is commonly accessed by a plurality of execution objects of the process.
And S20, monitoring data read-write behaviors of each data block in static storage and generating a record log, if the record log represents that the read-write frequency of the data block reaches a preset value, creating a shared memory corresponding to the data block and mirroring the shared memory and the stored data thereof in the virtual memory space.
S30, performing queue supervision on the data write requests in the virtual memory space, and establishing twin data of corresponding data modified by the requests based on the data write requests for responding to the data write requests, wherein the twin data and the shared memory share the same virtual memory address.
And S40, when the record log represents that the read-write frequency of the corresponding shared memory is lower than a preset value and the queue of the data write request is empty, performing data synchronization on the data block in the static storage based on the shared memory, and deleting the shared memory.
In another preferred embodiment of the present invention, the static storage space is a total storage space of the server side, and can be synchronously accessed by a plurality of processes for data read-write, each process is connected with a plurality of user terminals for collaborative operation, and the user terminals are correspondingly capable of executing a read process and a write process and are respectively used for executing a data read request and a data write request.
As another preferred embodiment of the present invention, the step of performing queue supervision on the data write request in the virtual memory space, and creating twin data of corresponding data based on the data write request for responding to the data write request specifically includes:
and acquiring the data writing request, generating a queue based on the acquisition time of the data writing request, and sequentially responding to and executing the data writing request in the queue, wherein the queue comprises a queue ordering control program, and the queue ordering control program is used for responding to a queue ordering control signal of the user terminal and changing the queue order of the data writing request in the queue.
And establishing twin data corresponding to the shared memory by the data writing request, carrying out replacement modification on the twin data based on the data writing request, and updating and deleting the data based on the twin data after the data writing request is completely executed.
And responding to a data read request and correspondingly outputting shared content data, and synchronously outputting the shared memory and the twin data in modification in real time when the data write request is synchronously executed.
As another preferred embodiment of the present invention, further comprising the steps of:
and the heat evaluation unit is used for recording and evaluating the data reading and writing frequency of the data blocks in one cycle recording period and sequencing a plurality of the data blocks based on the data reading and writing frequency.
And the data scheduling unit is used for judging the sequence of the adjacent data blocks, and if the sequence number difference value of the adjacent data blocks in the sequence is larger than a preset value, replacing the stored data sector of the data block and updating the storage state.
As another preferred embodiment of the present invention, the virtual memory space includes a maximum data traffic per unit time, where the maximum data traffic is used to characterize a total amount of data that can be passed through by a node and the virtual memory space at the same time, and the method further includes the steps of:
judging the data read-write frequency of a plurality of data blocks in the virtual memory space, and if the total data traffic exceeds the preset percentage of the maximum data traffic based on the unit time of the corresponding data read-write frequency, replacing the data sector of the data zone chain with the high read-write frequency.
Those skilled in the art will appreciate that all or part of the processes in the methods of the above embodiments may be implemented by a computer program for instructing relevant hardware, where the program may be stored in a non-volatile computer readable storage medium, and where the program, when executed, may include processes in the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.
Other embodiments of the present disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (6)

1. A memory sharing management system, comprising:
the virtual twin module is used for creating a virtual memory space of a process when executing the process, wherein the virtual memory space is correspondingly provided with a virtual memory address, the virtual memory address is used for guiding to access a designated data sector of the virtual memory space, and the virtual memory space is commonly accessed by a plurality of execution objects of the process;
the data mapping module is used for monitoring data read-write behaviors of each data block in the static storage and generating a record log, if the record log represents that the read-write frequency of the data block reaches a preset value, a shared memory corresponding to the data block is created, and the shared memory and the stored data thereof are mapped in the virtual memory space;
the writing processing module is used for carrying out queue supervision on the data writing requests in the virtual memory space, establishing twin data of corresponding data modified by the requests based on the data writing requests and responding to the data writing requests, wherein the twin data and the shared memory share the same virtual memory address;
the mapping record module is used for carrying out data synchronization on the data blocks in static storage based on the shared memory and deleting the shared memory when the record log represents that the read-write frequency of the corresponding shared memory is lower than a preset value and the queue of the data write request is empty;
the static storage space is a total storage space of a server end and can be synchronously accessed by a plurality of processes for data read-write, each process is connected with a plurality of user terminals for collaborative operation, and the user terminals are correspondingly executable read processes and write processes and are respectively used for executing data read requests and data write requests;
the write processing module includes:
the system comprises a data writing unit, a data writing unit and a queue, wherein the data writing unit is used for acquiring data writing requests, generating a queue based on the acquisition time of the data writing requests, sequentially responding to and executing the data writing requests in the queue, and the queue comprises a queue ordering control program which is used for responding to a queue ordering control signal of a user terminal and changing the queue order of the data writing requests in the queue;
the twin processing unit is used for establishing twin data of the shared memory corresponding to the data writing request, carrying out replacement modification on the twin data based on the data writing request, and updating and deleting the data of the shared memory based on the twin data after the data writing request is completely executed;
and the real-time output unit is used for responding to the data reading request and correspondingly outputting shared content data, and when the data writing request is synchronously executed, the shared memory and the twin data in modification are synchronously output in real time.
2. The memory sharing management system according to claim 1, further comprising a periodic scheduling module, wherein the periodic scheduling module specifically includes:
the heat evaluation unit is used for recording and evaluating the data read-write frequency of the data blocks in a cycle recording period and sequencing a plurality of the data blocks based on the data read-write frequency;
and the data scheduling unit is used for judging the sequence of the adjacent data blocks, and if the sequence number difference value of the adjacent data blocks in the sequence is larger than a preset value, replacing the stored data sector of the data block and updating the storage state.
3. The memory sharing management system according to claim 2, wherein the virtual memory space corresponds to a maximum data traffic amount including a unit time, the maximum data traffic amount being used to represent a total amount of data that can be passed through by a node and the virtual memory space at the same time, and the periodic scheduling module further includes a memory scheduling unit;
the memory scheduling unit is used for judging the data read-write frequency of a plurality of data blocks in the virtual memory space, and if the total data traffic in unit time based on the corresponding data read-write frequency exceeds the preset percentage of the maximum data amount, the data sector chain with high read-write frequency is replaced by the stored data sector.
4. The memory sharing management method is characterized by comprising the following steps:
when executing a certain process, creating a virtual memory space of the process, wherein the virtual memory space is correspondingly provided with a virtual memory address, the virtual memory address is used for guiding to access a designated data sector of the virtual memory space, and the virtual memory space is commonly accessed by a plurality of execution objects of the process;
monitoring data read-write behaviors of each data block in static storage and generating a record log, if the record log represents that the read-write frequency of the data block reaches a preset value, creating a shared memory corresponding to the data block and mirroring the shared memory and stored data thereof in the virtual memory space;
queue supervision is carried out on the data writing requests in the virtual memory space, twin data of corresponding data modified by the requests are established based on the data writing requests and used for responding to the data writing requests, and the twin data and the shared memory share the same virtual memory address;
when the record log represents that the read-write frequency of the corresponding shared memory is lower than a preset value and a queue of a data write request is empty, carrying out data synchronization on a data block in static storage based on the shared memory, and deleting the shared memory;
the static storage space is a total storage space of a server end and can be synchronously accessed by a plurality of processes for data read-write, each process is connected with a plurality of user terminals for collaborative operation, and the user terminals are correspondingly executable read processes and write processes and are respectively used for executing data read requests and data write requests;
the step of performing queue supervision on the data write request in the virtual memory space, and establishing twin data of corresponding data based on the data write request for responding to the data write request specifically includes:
acquiring a data writing request, generating a queue based on the acquisition time of the data writing request, and sequentially responding to and executing the data writing request in the queue, wherein the queue comprises a queue ordering control program, and the queue ordering control program is used for responding to a queue ordering control signal of a user terminal and changing the queue order of the data writing request in the queue;
establishing twin data corresponding to a shared memory of a data writing request, carrying out replacement modification on the twin data based on the data writing request, and after the data writing request is completely executed, updating and deleting the data based on the twin data;
and responding to a data read request and correspondingly outputting shared content data, and synchronously outputting the shared memory and the twin data in modification in real time when the data write request is synchronously executed.
5. The memory sharing management method according to claim 4, further comprising the step of:
the heat evaluation unit is used for recording and evaluating the data read-write frequency of the data blocks in a cycle recording period and sequencing a plurality of the data blocks based on the data read-write frequency;
and the data scheduling unit is used for judging the sequence of the adjacent data blocks, and if the sequence number difference value of the adjacent data blocks in the sequence is larger than a preset value, replacing the stored data sector of the data block and updating the storage state.
6. The memory sharing management method according to claim 5, wherein the virtual memory space corresponds to a maximum data traffic amount including a unit time, the maximum data traffic amount being used to characterize a total amount of data that can be simultaneously passed by a node and the virtual memory space, further comprising the steps of:
judging the data read-write frequency of a plurality of data blocks in the virtual memory space, and if the total data traffic exceeds the preset percentage of the maximum data traffic based on the unit time of the corresponding data read-write frequency, replacing the data sector of the data zone chain with the high read-write frequency.
CN202311375032.5A 2023-10-23 2023-10-23 Memory sharing management method and system Active CN117112268B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311375032.5A CN117112268B (en) 2023-10-23 2023-10-23 Memory sharing management method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311375032.5A CN117112268B (en) 2023-10-23 2023-10-23 Memory sharing management method and system

Publications (2)

Publication Number Publication Date
CN117112268A CN117112268A (en) 2023-11-24
CN117112268B true CN117112268B (en) 2024-02-13

Family

ID=88805895

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311375032.5A Active CN117112268B (en) 2023-10-23 2023-10-23 Memory sharing management method and system

Country Status (1)

Country Link
CN (1) CN117112268B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117931530B (en) * 2024-03-22 2024-06-07 山东昌禹知商信息技术服务有限公司 Database physical backup recovery processing method and system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103038755A (en) * 2011-08-04 2013-04-10 华为技术有限公司 Method, Device And System For Caching Data In Multi-Node System
CN103902459A (en) * 2012-12-25 2014-07-02 华为技术有限公司 Method and associated equipment for determining management mode of shared virtual memory page
CN112905111A (en) * 2021-02-05 2021-06-04 三星(中国)半导体有限公司 Data caching method and data caching device
CN113535670A (en) * 2021-07-13 2021-10-22 山东省计算中心(国家超级计算济南中心) Virtual resource mirror image storage system and implementation method thereof
CN115766866A (en) * 2022-10-28 2023-03-07 网易(杭州)网络有限公司 Data access method and device and electronic equipment

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7822941B2 (en) * 2006-06-05 2010-10-26 Oracle America, Inc. Function-based virtual-to-physical address translation
US7774556B2 (en) * 2006-11-04 2010-08-10 Virident Systems Inc. Asymmetric memory migration in hybrid main memory
JP5989574B2 (en) * 2013-02-28 2016-09-07 株式会社東芝 Computer, memory management method and program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103038755A (en) * 2011-08-04 2013-04-10 华为技术有限公司 Method, Device And System For Caching Data In Multi-Node System
CN103902459A (en) * 2012-12-25 2014-07-02 华为技术有限公司 Method and associated equipment for determining management mode of shared virtual memory page
CN112905111A (en) * 2021-02-05 2021-06-04 三星(中国)半导体有限公司 Data caching method and data caching device
CN113535670A (en) * 2021-07-13 2021-10-22 山东省计算中心(国家超级计算济南中心) Virtual resource mirror image storage system and implementation method thereof
CN115766866A (en) * 2022-10-28 2023-03-07 网易(杭州)网络有限公司 Data access method and device and electronic equipment

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
A Parallel File System with Application-Aware Data Layout Policies for Massive Remote Sensing Image Processing in Digital Earth;Lizhe Wang et.al;《IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS》;第26卷(第6期);第1497-1508页 *
生产线数字孪生车间管控技术框架;尹海军 等;《设计与研究》(第10期);第1-6页 *

Also Published As

Publication number Publication date
CN117112268A (en) 2023-11-24

Similar Documents

Publication Publication Date Title
CN117112268B (en) Memory sharing management method and system
EP3754515A1 (en) Reshard method and system in distributed storage system
CN104516471B (en) Method and device for managing power supply of storage system
CN109388397B (en) Product page generation method, system, computer device and storage medium
CN103064792A (en) Method and device for writing data
CN113495889B (en) Distributed object storage method and device, electronic equipment and storage medium
CN109992566A (en) A kind of file access method, device, equipment and readable storage medium storing program for executing
CN104503703A (en) Cache processing method and device
CN111930716A (en) Database capacity expansion method, device and system
CN112307263A (en) File storage method, device, equipment and medium
CN113946552A (en) Data processing method and electronic device
US20230385155A1 (en) Data Snapshot Method and Apparatus, Computer Device, and Storage Medium
CN110858122A (en) Method and device for storing data
CN115982101B (en) Machine room data migration method and device based on multi-machine room copy placement strategy
CN105243003A (en) Memory allocation monitoring method and apparatus
CN109189726B (en) Processing method and device for read-write log
CN105264497B (en) File management method and file system
CN111708489B (en) Method and equipment for improving hard disk service quality
CN113438232B (en) Method and device for determining data authorization form, electronic equipment and storage medium
CN102364940B (en) A kind of information processing method and equipment based on RAID array
CN113297324B (en) Data writing optimization method and terminal
CN114706537B (en) Inactive data processing method and processing system of Internet of things equipment
CN110162376A (en) A kind of data read-write method and device
CN115456529B (en) Material inventory early warning method, system, computer equipment and storage medium
CN114489983A (en) SSD task management method and device based on system time information and computer equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant