CN116954518B - Data processing method and device, electronic equipment and storage medium - Google Patents
Data processing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN116954518B CN116954518B CN202311000760.8A CN202311000760A CN116954518B CN 116954518 B CN116954518 B CN 116954518B CN 202311000760 A CN202311000760 A CN 202311000760A CN 116954518 B CN116954518 B CN 116954518B
- Authority
- CN
- China
- Prior art keywords
- data
- stored
- image
- index
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 20
- 238000000034 method Methods 0.000 claims abstract description 27
- 238000013500 data storage Methods 0.000 claims abstract description 18
- 238000012937 correction Methods 0.000 claims abstract description 10
- 238000012545 processing Methods 0.000 claims description 47
- 238000004590 computer program Methods 0.000 claims description 16
- 238000013524 data verification Methods 0.000 claims description 11
- 238000004806 packaging method and process Methods 0.000 claims description 7
- 238000012795 verification Methods 0.000 claims description 6
- 230000004044 response Effects 0.000 claims description 5
- 238000012856 packing Methods 0.000 claims description 3
- 238000013075 data extraction Methods 0.000 abstract description 14
- 238000004891 communication Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 238000007726 management method Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000005538 encapsulation Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 125000004122 cyclic group Chemical group 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a data processing method, a device, equipment and a storage medium. The method comprises the following steps: responding to a data storage request of a user, acquiring data to be stored, and determining index source information of the data to be stored; generating an index image according to index source information of data to be stored, a film type obtained in advance and an image error correction code rate; and storing the data to be stored to the target digital film according to the index image. The technical scheme solves the problem that the data stored in the digital film cannot be randomly accessed, can ensure the accuracy of data extraction, and improves the data extraction efficiency and the space utilization rate of the film.
Description
Technical Field
The present invention relates to the field of data storage technologies, and in particular, to a data processing method, a data processing device, an electronic device, and a storage medium.
Background
The digital film technology can lead the film to be a safe, reliable and stable long-term storage carrier to be regenerated. The digital film technology adopts a new mode of 'number- & gt glue- & gt number' film application, generates a high-density two-dimensional code image after coding the data resources to be saved, prints the high-density two-dimensional code image on the film, reads the coded image on the film through an optical instrument for decoding, and can restore the coded image to the original data resources.
The digital film is used for storing data, so that the storage life of the data is prolonged, the integrity of data resources is ensured, but the writing and reading of the data are operated according to the storage sequence of the data on the film, and the random access of the data cannot be realized.
Disclosure of Invention
The invention provides a data processing method, a device, equipment and a storage medium, which are used for solving the problem that data stored in a digital film cannot be accessed randomly, and improving the data extraction efficiency and the space utilization rate of the film while ensuring the data extraction accuracy.
According to an aspect of the present invention, there is provided a data processing method, the method comprising:
Responding to a data storage request of a user, acquiring data to be stored, and determining index source information of the data to be stored;
Generating an index image according to index source information of data to be stored, a film type obtained in advance and an image error correction code rate;
And storing the data to be stored to the target digital film according to the index image.
According to another aspect of the present invention, there is provided a data processing apparatus comprising:
The index source information determining module is used for responding to a data storage request of a user, acquiring data to be stored and determining index source information of the data to be stored;
the index image generation module is used for generating an index image according to index source information of data to be stored, a film type obtained in advance and an image error correction code rate;
And the data storage module is used for storing the data to be stored to the target digital film according to the index image.
According to another aspect of the present invention, there is provided an electronic apparatus including:
at least one processor; and
A memory communicatively coupled to the at least one processor; wherein,
The memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the data processing method according to any one of the embodiments of the present invention.
According to another aspect of the present invention, there is provided a computer readable storage medium storing computer instructions for causing a processor to execute a data processing method according to any one of the embodiments of the present invention.
According to the technical scheme provided by the embodiment of the invention, the addressing basis is provided for data acquisition by establishing the index image of the data to be stored, so that the efficient management of the data stored in the digital film is realized. The technical scheme solves the problem that the data stored in the digital film cannot be randomly accessed, can ensure the accuracy of data extraction, and improves the data extraction efficiency and the space utilization rate of the film.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a data processing method according to a first embodiment of the present invention;
FIG. 2A is a flow chart of a data processing method according to a second embodiment of the present invention;
fig. 2B is a schematic diagram of a data encapsulation format according to a second embodiment of the present invention;
FIG. 3 is a schematic diagram of a data processing apparatus according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device implementing a data processing method according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. The technical scheme of the application obtains, stores, uses, processes and the like the data, which all meet the relevant regulations of national laws and regulations.
Example 1
Fig. 1 is a flowchart of a data processing method according to an embodiment of the present invention, which is applicable to scenes such as data storage and data acquisition in a digital film. The method may be performed by a data processing apparatus, which may be implemented in hardware and/or software, which may be configured in an electronic device. As shown in fig. 1, the method includes:
s110, responding to a data storage request of a user, acquiring data to be stored, and determining index source information of the data to be stored.
The scheme can be executed by a data processing system, and the data processing system can realize the functions of storing, acquiring, editing and the like of the data on the digital film. The data processing system can provide the user with functional options such as data storage, acquisition and editing through the client, and the client can generate a data processing request corresponding to the functional options through the determining operation of the user on the functional options. For example, the user selects the data to be stored and clicks the data to be stored, and the client generates a data storage request according to the data to be stored.
In response to a data storage request of a user, the data processing system can read data to be stored according to the data storage request, and determine index source information of the data to be stored according to information such as an original storage path and a target storage path of the data to be stored. Specifically, the index source information may include information such as a data identifier, a data name, an original storage path, and a target storage path of the data to be stored.
S120, generating an index image according to index source information of data to be stored, a film type acquired in advance and an image error correction code rate.
It will be appreciated that depending on the film type and the image error correction code rate, the data processing system can calculate a single image loadability value, i.e., the amount of data that a single image can represent. The data processing system may establish data index information of the data to be stored according to index source information of the data to be stored. According to the data index information of the data to be stored and the single image loading capacity value, the data processing system can obtain the image index information of the data to be stored. The data processing system can convert the image index information into an image through the image coding tool to obtain an index image. The index image is saved to digital film by exposure.
And S130, storing the data to be stored into the target digital film according to the index image.
Based on the image index information in the index image, the data processing system can determine a target digital film. The data processing system can convert the data to be stored into a data image by an image encoding tool and store the data image to the target digital film.
According to the technical scheme provided by the embodiment of the invention, the addressing basis is provided for data acquisition by establishing the index image of the data to be stored, so that the efficient management of the data stored in the digital film is realized. The technical scheme solves the problem that the data stored in the digital film cannot be randomly accessed, can ensure the accuracy of data extraction, and improves the data extraction efficiency and the space utilization rate of the film.
Example two
Fig. 2A is a flowchart of a data processing method according to a second embodiment of the present invention, which is based on the above embodiment. As shown in fig. 2A, the method includes:
S201, responding to a data storage request of a user, acquiring data to be stored, and determining index source information of the data to be stored.
S202, generating an index catalog of data to be stored according to the index source information.
In this solution, the data to be stored may include a plurality of files of various types, such as text, picture, audio, and video files. The data processing system may generate an index directory of data to be stored based on index source information of the data to be stored. The index directory may be used to show association relationships of different files in the data to be stored, where the association relationships may include a belonging relationship, a sequential relationship, and the like.
S203, recursively traversing the index directory to determine a data verification result of the data to be stored.
By performing recursive traversal on the index directory, the data processing system can determine whether each file exists in the data to be stored, whether the association relationship of each file is correct, whether the size of each file changes, and the like, so as to obtain a data verification result of the data to be stored, such as a cyclic redundancy check code (Cyclic Redundancy Check, CRC).
S204, if the data to be stored is confirmed to pass the verification according to the data verification result, a data identifier matched with the data to be stored is generated.
If the data to be stored is determined to pass the verification according to the data verification result, the data processing system can generate a data identifier matched with the data to be stored, for example, each file in the data to be stored is matched with a universal unique identification code (Universally Unique Identifier, UUID).
S205, generating a data list to be stored according to the index catalog and the data identification matched with the data to be stored.
The data processing system may generate a list of data to be stored based on the index directory and the data identification of the data match to be stored. The data list to be stored may include information such as a file identifier, a file size, an original storage path of the file, a target storage path, and a data verification result.
S206, determining an index image of the data to be stored according to the data list to be stored and the single image load capacity value calculated in advance.
The single image loading capacity value is calculated based on the type of the digital film and the error correction code rate of the image. In this scheme, optionally, the determining the index image of the data to be stored according to the data list to be stored and the single image load capability value calculated in advance includes:
traversing a data list to be stored, and determining an addressing list of the data to be stored according to the single image load capacity value;
updating an index directory of the data to be stored according to the addressing list of the data to be stored;
and generating an index file according to the updated index directory, and converting the index file into an index image through an image coding tool.
The data processing system may traverse the list of data to be stored and generate an addressing list of data to be stored based on the single image loadability value. The addressing list may include information such as each file identification, each file matching image identification, file reading path, file reading start bit, and the like. The data processing system can update the information in the addressing list to the index directory according to the data identification to be stored, and generate an index file according to the updated index directory. The data processing system can convert the index file into an index image by the image encoding tool and save the index image to the digital film by exposure.
S207, packaging the data to be stored according to a preset packaging format to obtain packaged data.
FIG. 2B is a schematic diagram of a data package format according to a second embodiment of the present invention, where a data processing system may package data to be stored according to the data package format shown in FIG. 2B to obtain packaged data. The Header area (Header) may include information such as a start identifier, a file identifier, a data area length, and an end identifier. The Data area (Data) may include a Data identification and Data content. The Section separator region (Section separator) may include Section information of the data store.
S208, converting the encapsulated data into a data image through an image coding tool, and storing the data image into a target digital film according to the index image.
After packaging the data to be stored, the data processing system can convert the packaged data into a data image by an image encoding tool, and then store the data image onto a target digital film by exposure. Wherein the target digital film may be determined from index information in the index image.
S209, in response to a data acquisition request of a user, determining an index image of the target data.
If the user needs to acquire the data stored in the digital film, a data acquisition request can be initiated by the client. The data acquisition request may include information such as a request time, a request user identification, and a target data identification. The data processing system can respond to the data acquisition request of the user and position the index image according to the target data which the user needs to acquire.
And S210, extracting target data from the target digital film according to the index image.
The data processing system may extract the index file by scanning the index image, decoding the index image. And analyzing the index file, and the data processing system can obtain an index directory, so that the image identification associated with the target data and the associated start and stop information in the image are determined according to the index directory. Based on the image identification and the associated start and stop information in the image, the data processing system can extract target data from the target digital film. Wherein, the image identifier associated with the target data can be an identifier of the image storing the target data; the associated start-stop information in the image may be the start-stop bits of the target data stored in the image.
In one possible implementation, the extracting the target data from the target digital film according to the index image includes:
Scanning the index image, and decoding the index image to obtain an index file;
Analyzing the index file to obtain an index directory;
Determining an image identifier associated with target data and associated start-stop information in the image according to the index catalog;
Determining a target digital film according to the image identification associated with the target data;
And extracting target data from the target digital film according to the associated start and stop information in the image.
It will be readily appreciated that the data processing system can determine the target digital film based on the image identifications associated with the target data, and match the start and stop information based on each image identification, and the data processing system can locate the target data in the target digital film to extract the target data. It should be noted that the target data may be stored in one data image or may be stored in a plurality of data images. The entire data image may represent the target data in its entirety or may represent the target data in its part.
On the basis of the scheme, the method for extracting the target data from the target digital film according to the associated start-stop information in the image comprises the following steps:
Scanning a data image in the target digital film according to the associated start-stop information in the image, and decoding the data image to obtain package data;
and unpacking the packed data according to a preset packing format to obtain target data.
The data processing system can scan the digital images in the target digital film, decode the digital images, and obtain the encapsulated data according to the associated start and stop information in each image. And analyzing the encapsulated data according to the encapsulation format, and obtaining the target data by the data processing system.
In a specific example, the encapsulation format of the data is shown in fig. 2B, where the Header includes a start identifier of 2 bytes, a UUID of 16bytes, a data area length of 8bytes, and an end identifier of 1 byte. The data processing system scans a first data image containing target data and performs color value extraction on the data image to realize image decoding.
The data processing system can perform data matching according to the information of the Section Splitter. When the positions of n (n > =0) Section split are matched, traversing the n Section split to carry out preset condition screening on the subsequent Header of 27 bytes, and obtaining the addresses of m headers representing package data after the screening is successful. The data processing system can extract UUIDs in the Header and match with the UUIDs in the index directory to obtain addresses of the Header of the target data. And extracting a data image corresponding to part of data according to the address of the Header, and storing the data image to the hard disk. The data processing system may extract data image color values for image decoding to obtain partial data. And splicing all the partial data until the processing of all the Section split is completed, and verifying the CRC code to confirm the accuracy of the target data content.
According to the technical scheme provided by the embodiment of the invention, the addressing basis is provided for data acquisition by establishing the index image of the data to be stored, so that the efficient management of the data stored in the digital film is realized. The technical scheme solves the problem that the data stored in the digital film cannot be randomly accessed, can ensure the accuracy of data extraction, and improves the data extraction efficiency and the space utilization rate of the film.
Example III
Fig. 3 is a schematic structural diagram of a data processing apparatus according to a third embodiment of the present invention. As shown in fig. 3, the apparatus includes:
An index source information determining module 310, configured to obtain data to be stored in response to a data storage request of a user, and determine index source information of the data to be stored;
An index image generating module 320, configured to generate an index image according to index source information of data to be stored, a film type obtained in advance, and an image error correction code rate;
and the data storage module 330 is used for storing the data to be stored to the target digital film according to the index image.
In this solution, optionally, the index image generating module 320 includes:
the index catalog generation unit is used for generating an index catalog of data to be stored according to the index source information;
the verification result determining unit is used for recursively traversing the index directory to determine a data verification result of the data to be stored;
the data identifier generating unit is used for generating a data identifier matched with the data to be stored if the data to be stored is confirmed to pass the verification according to the data verification result;
the data list generation unit is used for generating a data list to be stored according to the index catalog and the data identifier matched with the data to be stored;
An index image determining unit for determining an index image of the data to be stored according to the data list to be stored and the single image load capacity value calculated in advance; the single image loading capacity value is calculated based on the type of the digital film and the error correction code rate of the image.
On the basis of the above scheme, the index image determining unit is specifically configured to:
traversing a data list to be stored, and determining an addressing list of the data to be stored according to the single image load capacity value;
updating an index directory of the data to be stored according to the addressing list of the data to be stored;
and generating an index file according to the updated index directory, and converting the index file into an index image through an image coding tool.
In one possible implementation, the data storage module 330 is specifically configured to:
Packaging the data to be stored according to a preset packaging format to obtain packaged data;
the encapsulated data is converted into a data image by an image encoding tool and the data image is stored to a target digital film based on the index image.
In this embodiment, optionally, the apparatus further includes:
The acquisition request response module is used for responding to a data acquisition request of a user and determining an index image of target data;
and the target data extraction module is used for extracting target data from the target digital film according to the index image.
Based on the scheme, the target data extraction module comprises:
the index file determining unit is used for scanning the index image and decoding the index image to obtain an index file;
The index directory determining unit is used for analyzing the index file to obtain an index directory;
The image index information determining unit is used for determining an image identifier associated with the target data and associated start-stop information in the image according to the index catalog;
a digital film determining unit for determining a target digital film according to the image identification associated with the target data;
And the target data extraction unit is used for extracting target data from the target digital film according to the associated start and stop information in the image.
In a preferred embodiment, the target data extraction unit is specifically configured to:
Scanning a data image in the target digital film according to the associated start-stop information in the image, and decoding the data image to obtain package data;
and unpacking the packed data according to a preset packing format to obtain target data.
The data processing device provided by the embodiment of the invention can execute the data processing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example IV
Fig. 4 shows a schematic diagram of an electronic device 410 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 4, the electronic device 410 includes at least one processor 411, and a memory, such as a Read Only Memory (ROM) 412, a Random Access Memory (RAM) 413, etc., communicatively connected to the at least one processor 411, wherein the memory stores computer programs executable by the at least one processor, and the processor 411 may perform various suitable actions and processes according to the computer programs stored in the Read Only Memory (ROM) 412 or the computer programs loaded from the storage unit 418 into the Random Access Memory (RAM) 413. In the RAM 413, various programs and data required for the operation of the electronic device 410 may also be stored. The processor 411, the ROM 412, and the RAM 413 are connected to each other through a bus 414. An input/output (I/O) interface 415 is also connected to bus 414.
Various components in the electronic device 410 are connected to the I/O interface 415, including: an input unit 416 such as a keyboard, a mouse, etc.; an output unit 417 such as various types of displays, speakers, and the like; a storage unit 418, such as a magnetic disk, optical disk, or the like; and a communication unit 419 such as a network card, modem, wireless communication transceiver, etc. The communication unit 419 allows the electronic device 410 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.
The processor 411 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 411 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 411 performs the various methods and processes described above, such as data processing methods.
In some embodiments, the data processing method may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as storage unit 418. In some embodiments, some or all of the computer program may be loaded and/or installed onto the electronic device 410 via the ROM 412 and/or the communication unit 419. When a computer program is loaded into RAM 413 and executed by processor 411, one or more steps of the data processing method described above may be performed. Alternatively, in other embodiments, the processor 411 may be configured to perform the data processing method in any other suitable manner (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.
Claims (9)
1. A method of data processing, the method comprising:
Responding to a data storage request of a user, acquiring data to be stored, and determining index source information of the data to be stored;
generating an index catalog of data to be stored according to the index source information;
performing recursion traversal on the index directory to determine a data verification result of the data to be stored;
if the data to be stored is confirmed to pass the verification according to the data verification result, a data identifier matched with the data to be stored is generated;
Generating a data list to be stored according to the index directory and the data identification matched with the data to be stored;
Determining an index image of the data to be stored according to the data list to be stored and a single image load capacity value calculated in advance; wherein, the single image load capacity value is calculated based on the type of digital film and the error correction code rate of the image;
And storing the data to be stored to the target digital film according to the index image.
2. The method of claim 1, wherein determining the index image of the data to be stored based on the list of data to be stored and the pre-computed single image loadability value comprises:
traversing a data list to be stored, and determining an addressing list of the data to be stored according to the single image load capacity value;
updating an index directory of the data to be stored according to the addressing list of the data to be stored;
and generating an index file according to the updated index directory, and converting the index file into an index image through an image coding tool.
3. The method of claim 2, wherein storing the data to be stored to the target digital film based on the index image comprises:
Packaging the data to be stored according to a preset packaging format to obtain packaged data;
the encapsulated data is converted into a data image by an image encoding tool and the data image is stored to a target digital film based on the index image.
4. The method of claim 1, wherein after storing the data to be stored to the target digital film, the method further comprises:
determining an index image of the target data in response to a data acquisition request of a user;
And extracting target data from the target digital film according to the index image.
5. The method of claim 4, wherein extracting target data from the index image in the target digital film comprises:
Scanning the index image, and decoding the index image to obtain an index file;
Analyzing the index file to obtain an index directory;
Determining an image identifier associated with target data and associated start-stop information in the image according to the index catalog;
Determining a target digital film according to the image identification associated with the target data;
And extracting target data from the target digital film according to the associated start and stop information in the image.
6. The method of claim 5, wherein extracting the target data from the target digital film based on the associated start and stop information in the image comprises:
Scanning a data image in the target digital film according to the associated start-stop information in the image, and decoding the data image to obtain package data;
and unpacking the packed data according to a preset packing format to obtain target data.
7. A data processing apparatus, comprising:
The index source information determining module is used for responding to a data storage request of a user, acquiring data to be stored and determining index source information of the data to be stored;
The index image generation module is used for generating an index catalog of data to be stored according to the index source information; performing recursion traversal on the index directory to determine a data verification result of the data to be stored; if the data to be stored is confirmed to pass the verification according to the data verification result, a data identifier matched with the data to be stored is generated; generating a data list to be stored according to the index directory and the data identification matched with the data to be stored; determining an index image of the data to be stored according to the data list to be stored and a single image load capacity value calculated in advance; wherein, the single image load capacity value is calculated based on the type of digital film and the error correction code rate of the image;
And the data storage module is used for storing the data to be stored to the target digital film according to the index image.
8. An electronic device, the electronic device comprising:
at least one processor; and
A memory communicatively coupled to the at least one processor; wherein,
The memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the data processing method of any one of claims 1-6.
9. A computer-readable storage medium, characterized in that the computer-readable storage medium stores computer instructions for causing a processor to implement the data processing method of any one of claims 1-6 when executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311000760.8A CN116954518B (en) | 2023-08-09 | 2023-08-09 | Data processing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311000760.8A CN116954518B (en) | 2023-08-09 | 2023-08-09 | Data processing method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116954518A CN116954518A (en) | 2023-10-27 |
| CN116954518B true CN116954518B (en) | 2024-06-04 |
Family
ID=88458242
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311000760.8A Active CN116954518B (en) | 2023-08-09 | 2023-08-09 | Data processing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116954518B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1138931A (en) * | 1994-09-21 | 1996-12-25 | 索尼公司 | Still image system |
| CN109448823A (en) * | 2018-10-31 | 2019-03-08 | 武汉联影医疗科技有限公司 | Data processing method, device, server and storage medium |
| CN112052347A (en) * | 2020-10-09 | 2020-12-08 | 北京百度网讯科技有限公司 | Image storage method and device and electronic equipment |
| CN113190384A (en) * | 2021-05-21 | 2021-07-30 | 重庆紫光华山智安科技有限公司 | Data recovery control method, device, equipment and medium based on erasure codes |
| CN114168540A (en) * | 2021-12-13 | 2022-03-11 | 浙江宇视科技有限公司 | File index information processing method and device, electronic equipment and storage medium |
| CN115981563A (en) * | 2022-12-29 | 2023-04-18 | 航天信息股份有限公司 | Method and system for storing traffic image information |
-
2023
- 2023-08-09 CN CN202311000760.8A patent/CN116954518B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1138931A (en) * | 1994-09-21 | 1996-12-25 | 索尼公司 | Still image system |
| CN109448823A (en) * | 2018-10-31 | 2019-03-08 | 武汉联影医疗科技有限公司 | Data processing method, device, server and storage medium |
| CN112052347A (en) * | 2020-10-09 | 2020-12-08 | 北京百度网讯科技有限公司 | Image storage method and device and electronic equipment |
| CN113190384A (en) * | 2021-05-21 | 2021-07-30 | 重庆紫光华山智安科技有限公司 | Data recovery control method, device, equipment and medium based on erasure codes |
| CN114168540A (en) * | 2021-12-13 | 2022-03-11 | 浙江宇视科技有限公司 | File index information processing method and device, electronic equipment and storage medium |
| CN115981563A (en) * | 2022-12-29 | 2023-04-18 | 航天信息股份有限公司 | Method and system for storing traffic image information |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116954518A (en) | 2023-10-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109558525B (en) | Test data set generation method, device, equipment and storage medium | |
| CN109062906B (en) | Translation method and device for program language resources | |
| JP2022159405A (en) | Method and device for appending data, electronic device, storage medium, and computer program | |
| CN108551481B (en) | File uploading method and device, server and storage medium | |
| CN110888791A (en) | Log processing method, device, equipment and storage medium | |
| CN112861033B (en) | Method and device for executing service | |
| CN116954518B (en) | Data processing method and device, electronic equipment and storage medium | |
| CN108989902B (en) | Barrage message processing method and device, terminal and storage medium | |
| CN115904240A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN115617800A (en) | Data reading method and device, electronic equipment and storage medium | |
| CN115132186A (en) | End-to-end speech recognition model training method, speech decoding method and related device | |
| CN114356925A (en) | Identification generation method and device, electronic equipment and storage medium | |
| CN113919310A (en) | Short message content determination method and device, electronic equipment and storage medium | |
| CN114579520B (en) | Mirror image data processing method, mirror image data loading method and device | |
| CN114499759B (en) | Message generation method and device, electronic equipment and storage medium | |
| CN116932626B (en) | Data analysis method, device, equipment and storage medium | |
| CN112925573B (en) | Method, device, equipment and computer readable medium for loading web page | |
| CN112559478B (en) | Log generation method and device, terminal equipment and storage medium | |
| CN113568620B (en) | Code file processing method, device, equipment and medium | |
| CN117056222A (en) | Interface test file generation method and device, electronic equipment and storage medium | |
| CN114546966A (en) | Animation file generation method and device, electronic equipment and storage medium | |
| CN113961229A (en) | Method for generating application program installation package and method for running application program | |
| CN117215560A (en) | Template code importing method, device, equipment and storage medium | |
| CN116366358A (en) | Message verification method and device, electronic equipment and storage medium | |
| CN115878914A (en) | Domain name matching method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |