CN115357358A - Radio data processing method, device, equipment and storage medium - Google Patents
Radio data processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN115357358A CN115357358A CN202210985752.2A CN202210985752A CN115357358A CN 115357358 A CN115357358 A CN 115357358A CN 202210985752 A CN202210985752 A CN 202210985752A CN 115357358 A CN115357358 A CN 115357358A
- Authority
- CN
- China
- Prior art keywords
- processed
- radio data
- data set
- processing
- radio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention discloses a radio data processing method, a radio data processing device, radio data processing equipment and a storage medium. The method comprises the steps of obtaining a radio data set to be processed; the radio frequency data set to be processed is provided with corresponding generation time information, the radio frequency data set to be processed comprises radio frequency data to be processed of a task to be processed, and the task to be processed comprises a plurality of subtasks executed according to a preset sequence; determining a target memory matched with the radio data set to be processed according to the generated time information, the total number of the memories and a pre-established memory management table, and storing the radio data set to be processed into the target memory; and calling a processing thread corresponding to each subtask in the plurality of subtasks in the target memory according to the preset sequence, and processing the radio data to be processed by using the processing thread. The technical scheme of the invention improves the calculation speed of the radio data.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a radio data processing method, apparatus, device, and storage medium.
Background
In the field of radio astronomy, along with the updating and development of radio astronomy equipment, the data volume is huge and the transmission speed is high when radio astronomy data are collected, and the problem that data are lost finally due to the fact that the calculation speed is slower than the transmission speed easily occurs during complex calculation in the process of processing the radio astronomy data in the prior art is solved.
Disclosure of Invention
The invention provides a radio data processing method, a radio data processing device, radio data processing equipment and a radio data processing storage medium, which are used for solving the problem of data loss caused by the fact that the calculation speed is slower than the data transmission speed in the complex calculation process of radio astronomical data in the prior art and improving the calculation speed of the radio data.
According to an aspect of the present invention, there is provided a radio data processing method, the method including:
acquiring a radio data set to be processed; the radio frequency data set to be processed is provided with corresponding generation time information, the radio frequency data set to be processed comprises radio frequency data to be processed of a task to be processed, and the task to be processed comprises a plurality of subtasks executed according to a preset sequence;
determining a target memory matched with the radio data set to be processed according to the generated time information, the total number of the memories and a pre-established memory management table, and storing the radio data set to be processed into the target memory;
and calling a processing thread corresponding to each subtask in the plurality of subtasks in the target memory according to the preset sequence, and processing the radio data to be processed by using the processing thread.
According to another aspect of the present invention, there is provided a radio data processing apparatus comprising:
the device comprises a to-be-processed radio data set acquisition module, a to-be-processed radio data set acquisition module and a to-be-processed radio data set acquisition module, wherein the to-be-processed radio data set acquisition module is used for acquiring a to-be-processed radio data set; the radio frequency data set to be processed is provided with corresponding generation time information, the radio frequency data set to be processed comprises radio frequency data to be processed of a task to be processed, and the task to be processed comprises a plurality of subtasks executed according to a preset sequence;
the to-be-processed radio data set storage module is used for determining a target memory matched with the to-be-processed radio data set according to the generation time information, the total number of the memories and a pre-established memory management table, and storing the to-be-processed radio data set into the target memory;
and the to-be-processed radio data processing module is used for calling a processing thread corresponding to each subtask in the plurality of subtasks in the target memory according to the preset sequence and processing the to-be-processed radio data by using the processing thread.
According to another aspect of the present invention, there is provided an electronic apparatus including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein, the first and the second end of the pipe are connected with each other,
the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the method of processing radio data according to any of the embodiments of the present invention.
According to another aspect of the present invention, there is provided a computer-readable storage medium storing computer instructions for causing a processor to implement the method for processing radio data according to any one of the embodiments of the present invention when the computer instructions are executed.
According to the technical scheme of the embodiment of the invention, the radio data set to be processed is obtained; the to-be-processed radio data set comprises corresponding generation time information, the to-be-processed radio data set comprises to-be-processed radio data of a to-be-processed task, and the to-be-processed task comprises a plurality of subtasks executed according to a preset sequence; determining a target memory matched with the radio data set to be processed according to the generated time information, the total number of the memories and a pre-established memory management table, and storing the radio data set to be processed into the target memory; and calling a processing thread corresponding to each subtask in the plurality of subtasks in the target memory according to the preset sequence, and processing the radio data to be processed by using the processing thread, namely processing the radio data set to be processed stored in the target memory by using the processing thread corresponding to the subtasks, so that the problem of data loss caused by the fact that the calculation speed is slower than the data transmission speed in the complex calculation process of the radio astronomical data in the prior art is solved, and the calculation speed of the radio data is improved.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present invention, nor do they necessarily limit the scope of the invention. Other features of the present invention will become apparent from the following description.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a radio data processing method according to an embodiment of the present invention;
fig. 2a is a flowchart of another radio data processing method according to a second embodiment of the present invention;
fig. 2b is a schematic diagram of a radio data processing method for a single radio data set to be processed according to a second embodiment of the present invention;
fig. 2c is a schematic diagram of a radio data processing method for a plurality of radio data sets to be processed according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a radio data processing apparatus according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device implementing the radio data processing method according to the embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "comprises" and "comprising," and any variations thereof, in the description and claims of the present invention and the above-described drawings, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example one
Fig. 1 is a flowchart of a radio data processing method according to an embodiment of the present invention, where the embodiment is applicable to a case where a large amount of rapidly transmitted data is processed, and the method may be executed by a radio data processing apparatus, which may be implemented in a form of hardware and/or software, and the apparatus may be configured in a server having a data processing function. As shown in fig. 1, the method includes:
s110, acquiring a radio data set to be processed; the to-be-processed radio data set comprises corresponding generation time information, the to-be-processed radio data set comprises to-be-processed radio data of a to-be-processed task, and the to-be-processed task comprises a plurality of subtasks executed according to a preset sequence.
The radio data set to be processed may refer to a radio astronomical data set received by a computer network port at the current time. The radio data to be processed included in the radio data set to be processed may be arranged in a certain order. The radio data to be processed may be a unit data in the radio data set to be processed. The generation time information may refer to a generation time period of the to-be-processed radio data sets, each of the to-be-processed radio data sets may have unique generation time information, and the generation time information may also be periodically increased since the to-be-processed radio data sets are periodically generated by the external system. A pending task may refer to a general process to a set of radio data to be processed. In this embodiment, the processing procedure corresponding to the radio data set to be processed generally is to perform similar operations on each radio data set to be processed, that is, the processing procedures of each part of the radio data set to be processed are basically the same. A subtask may refer to a unit task constituting a task to be processed. The preset order may refer to a processing order of a plurality of subtasks among the to-be-processed tasks.
In this embodiment, a to-be-processed radio data set received by a computer network port at the current time may be obtained.
And S120, determining a target memory matched with the radio data set to be processed according to the generated time information, the total number of the memories and a pre-established memory management table, and storing the radio data set to be processed into the target memory.
The total memory may refer to the total memory in the current computing system. The memory management table may include a correspondence between the data set identifier and the memory identifier. The data set identifier may refer to identification information used for determining a corresponding memory, and the data set identifier may be obtained according to generation time information of the radio data set to be processed. The memory id may refer to identity information used to represent each memory. The target memory may refer to a memory space corresponding to the radio data set to be processed, and the target memory may be a target selected from a plurality of memories.
For example, a pre-established memory management table when a computing system uses 10 memories may be shown in table 1:
TABLE 1
| Data set |
0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 |
| Memory identification | a | b | c | d | e | f | g | h | i | j |
In this embodiment, the target memory matched with the radio data set to be processed may be determined according to the unique generation time information corresponding to the radio data set to be processed, the total amount of the memories in the computing system, and the pre-established memory management table, so that the radio data set to be processed may be stored in the target memory.
In an optional implementation manner of this embodiment, determining, according to the generation time information, the total number of memories, and a pre-established memory management table, a target memory that matches the to-be-processed radio data set may include: determining a target data set identifier corresponding to the radio data set to be processed according to the generation time information and the total memory number; inquiring the pre-established memory management table according to the target data set identifier to determine a target memory identifier matched with the target data set identifier; and taking the memory corresponding to the target memory identification as a target memory matched with the radio data set to be processed.
The target data set identifier may refer to a data set identifier corresponding to a currently processed radio data set to be processed. The target memory identifier may refer to a matching memory identifier found according to the target dataset identifier when querying a pre-established memory management table.
In the previous example, the generation time information of the radio data set to be processed is 52ms,52 takes the remainder of the total number of the memories 10 to obtain 2, that is, the data set identifier of the radio data set to be processed is 2, then the table 1 is looked up, and it can be determined that the memory corresponding to the radio data set to be processed is c, so the memory corresponding to c is the target memory.
S130, calling a processing thread corresponding to each subtask in the plurality of subtasks in the target memory according to the preset sequence, and processing the radio data to be processed by using the processing thread.
Wherein the processing thread may be used to execute the corresponding sub-task.
In this embodiment, in the target memory, a processing thread corresponding to each subtask may be called according to a preset sequence for processing the subtasks, so that the processing thread is used to process the radio data to be processed in the radio data set to be processed.
Optionally, after all the subtasks complete processing of the radio data set to be processed, the radio data set to be processed may be deleted from the target memory.
According to the technical scheme of the embodiment of the invention, the radio data set to be processed is obtained; the to-be-processed radio data set comprises corresponding generation time information, the to-be-processed radio data set comprises to-be-processed radio data of a to-be-processed task, and the to-be-processed task comprises a plurality of subtasks executed according to a preset sequence; determining a target memory matched with the radio data set to be processed according to the generated time information, the total number of the memories and a pre-established memory management table, and storing the radio data set to be processed into the target memory; and calling a processing thread corresponding to each subtask in the plurality of subtasks in the target memory according to the preset sequence, and processing the radio data to be processed by using the processing thread, namely processing the radio data set to be processed stored in the target memory through the processing thread corresponding to the subtask.
Example two
Fig. 2a is a flowchart of another radio data processing method according to a second embodiment of the present invention, where in this embodiment, a processing thread corresponding to each of the multiple subtasks is called in the target memory according to the preset sequence, and an operation of processing the radio data to be processed by using the processing thread is refined on the basis of the foregoing embodiments. As shown in fig. 2a, the method comprises:
s210, acquiring a radio data set to be processed; the to-be-processed radio data set comprises corresponding generation time information, the to-be-processed radio data set comprises to-be-processed radio data of a to-be-processed task, and the to-be-processed task comprises a plurality of subtasks executed according to a preset sequence.
S220, determining a target memory matched with the radio data set to be processed according to the generated time information, the total number of the memories and a pre-established memory management table, and storing the radio data set to be processed into the target memory.
And S230, determining the subtasks which need to be executed currently from the plurality of subtasks according to the preset sequence to obtain the target task.
Wherein the target task may refer to a currently executed sub-task selected from a plurality of sub-tasks.
In this embodiment, the current subtask that needs to be executed may be determined from the plurality of subtasks according to a preset sequence for processing the plurality of subtasks, so as to obtain the target task.
And S240, calling a processing thread corresponding to the target task in the target memory, and processing the radio data to be processed by using the processing thread.
Wherein each of the plurality of subtasks has a corresponding complexity level.
Optionally, invoking a processing thread corresponding to the target task, and processing the radio data to be processed by using the processing thread may include: judging whether the complexity of the target task exceeds a preset complexity threshold; and when the complexity of the target task does not exceed the preset complexity threshold, calling a processing thread corresponding to the target task, and processing the radio data to be processed by using the processing thread.
When the complexity of the target task exceeds the preset complexity threshold, performing shunting processing on the radio data sets to be processed to obtain at least one shunted radio data set; respectively creating corresponding sub-threads for each split radio data set in the at least one split radio data set; and processing the corresponding split radio data set by using the sub-thread.
The preset complexity threshold may refer to a limit value of the complexity of the subtask.
In this embodiment, it may be determined whether the complexity of the target task exceeds a preset complexity threshold, and if not, a processing thread corresponding to the target task may be directly invoked to process the to-be-processed radio data in the to-be-processed radio data set, and if so, it indicates that the complexity of the target task is high and the data processing speed may be slowed down, so that the to-be-processed radio data set may be subjected to split processing to obtain at least one split radio data set, and corresponding sub-threads are respectively created for each split radio data set, so that the corresponding split radio data set may be processed by using the sub-threads, and the pressure of the processing thread corresponding to the target task to directly process the to-be-processed radio data in the to-be-processed radio data set is reduced.
Optionally, the shunting processing on the radio data set to be processed may include: according to the memory identification of the radio data to be processed in the target memory, carrying out shunting processing on the radio data set to be processed; or carrying out shunting processing on the radio data sets to be processed according to a preset quantity.
The memory identifier of the radio data to be processed in the target memory may be, for example, a parity identifier. The preset number may refer to the number of planned slices of the radiodata set to be processed, for example, 2.
For example, the to-be-processed radio data set may be divided into a data set marked as an odd number and a data set marked as an even number according to the parity of the to-be-processed radio data in the target memory. Or shunting the radio data sets to be processed according to the preset 2 numbers to obtain a first half data set and a second half data set. It should be noted that the foregoing two flow dividing methods can also be used in combination, and the foregoing two flow dividing methods are only used for illustration and are not limited.
For example, fig. 2b is a schematic diagram of a radio data processing method for a single radio data set to be processed according to a second embodiment of the present invention, which takes memory tag splitting and half-dividing the radio data set to be processed as an example. As shown in fig. 2b, the task to be processed of the radio data set to be processed is split into a plurality of subtasks. For the complex subtask, distributing the split radio data set to different sub-threads for calculation according to the parity marks of the radio data to be processed, and further dividing the split radio data set into a first half part and a second half part to be distributed to different processing threads.
According to the technical scheme of the embodiment of the invention, the radio data set to be processed is obtained; the radio frequency data set to be processed is provided with corresponding generation time information, the radio frequency data set to be processed comprises radio frequency data to be processed of a task to be processed, and the task to be processed comprises a plurality of subtasks executed according to a preset sequence; determining a target memory matched with the radio data set to be processed according to the generated time information, the total number of the memories and a pre-established memory management table, and storing the radio data set to be processed into the target memory; determining the subtasks which need to be executed currently from the plurality of subtasks according to the preset sequence to obtain target tasks; in the target memory, calling a processing thread corresponding to the target task, and processing the radio data to be processed by using the processing thread, namely processing the radio data set to be processed stored in the target memory through the processing thread corresponding to the subtask.
In one case, a plurality of radio data sets to be processed are obtained, and a corresponding memory can be determined according to the generation time information of each radio data set to be processed, so that memory competition can be avoided, and the time of mutual exclusion processing during parallel computing is reduced. According to the marks of the memories, the radio data to be processed in the radio data sets to be processed can be processed according to the processing thread corresponding to each subtask in the plurality of subtasks in the preset sequence.
For example, fig. 2c is a schematic diagram of a radio data processing method for multiple radio data sets to be processed according to a second embodiment of the present invention, which takes memory tag splitting and half-dividing the radio data sets to be processed as an example. As shown in fig. 2c, after the current processing thread completes the calculation of the current radio data set to be processed and notifies the next processing thread, the current processing thread can calculate the subsequent radio data set to be processed (dotted line portion in fig. 2 c); when the complex processing thread is split, the split radio data sets marked as odd numbers and even numbers can be calculated in parallel; when the split radio data set is further split into a first half and a second half, the first half and the second half of the split radio data set can be computed in parallel (3.1.1 and 3.1.2 in fig. 2 c). The rational splitting of the computational process can reduce the total execution time after stabilization to close to the execution time of the minimum split unit.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a radio data processing apparatus according to a third embodiment of the present invention. As shown in fig. 3, the apparatus includes: a to-be-processed radio data set acquisition module 310, a to-be-processed radio data set storage module 320, and a to-be-processed radio data processing module 330. Wherein:
a to-be-processed radio data set obtaining module 310, configured to obtain a to-be-processed radio data set; the radio frequency data set to be processed is provided with corresponding generation time information, the radio frequency data set to be processed comprises radio frequency data to be processed of a task to be processed, and the task to be processed comprises a plurality of subtasks executed according to a preset sequence;
a to-be-processed radio data set storage module 320, configured to determine, according to the generation time information, the total number of memories, and a pre-established memory management table, a target memory matched with the to-be-processed radio data set, and store the to-be-processed radio data set in the target memory;
and a to-be-processed radio data processing module 330, configured to call, in the target memory, a processing thread corresponding to each of the multiple subtasks according to the preset sequence, and process the to-be-processed radio data by using the processing thread.
According to the technical scheme of the embodiment of the invention, the radio data set to be processed is obtained; the radio frequency data set to be processed is provided with corresponding generation time information, the radio frequency data set to be processed comprises radio frequency data to be processed of a task to be processed, and the task to be processed comprises a plurality of subtasks executed according to a preset sequence; determining a target memory matched with the radio data set to be processed according to the generated time information, the total number of the memories and a pre-established memory management table, and storing the radio data set to be processed into the target memory; and calling a processing thread corresponding to each subtask in the plurality of subtasks in the target memory according to the preset sequence, and processing the radio data to be processed by using the processing thread, namely processing the radio data set to be processed stored in the target memory by using the processing thread corresponding to the subtasks, so that the problem of data loss caused by the fact that the calculation speed is slower than the data transmission speed in the complex calculation process of the radio astronomical data in the prior art is solved, and the calculation speed of the radio data is improved.
Optionally, the memory management table includes a corresponding relationship between a data set identifier and a memory identifier;
accordingly, the pending radio data set storage module 320 includes:
a target data set identifier determining subunit, configured to determine, according to the generation time information and the total number of memories, a target data set identifier corresponding to the radio data set to be processed;
a target memory identifier determining subunit, configured to query the pre-established memory management table according to the target data set identifier, and determine a target memory identifier matching the target data set identifier;
and the target memory determining subunit is used for taking the memory corresponding to the target memory identifier as the target memory matched with the radio data set to be processed.
Optionally, the to-be-processed radio data processing module 330 includes:
the target task obtaining subunit is used for determining a subtask which needs to be executed currently from the plurality of subtasks according to the preset sequence to obtain a target task;
and the to-be-processed radio data processing subunit is used for calling a processing thread corresponding to the target task in the target memory and processing the to-be-processed radio data by using the processing thread.
Optionally, each of the plurality of subtasks has a corresponding complexity level;
correspondingly, the radio data processing subunit to be processed may be specifically configured to:
judging whether the complexity of the target task exceeds a preset complexity threshold;
and when the complexity of the target task does not exceed the preset complexity threshold, calling a processing thread corresponding to the target task, and processing the radio data to be processed by using the processing thread.
Optionally, the radio data processing subunit to be processed may be further configured to:
when the complexity of the target task exceeds the preset complexity threshold, performing shunting processing on the radio data sets to be processed to obtain at least one shunted radio data set;
respectively creating corresponding sub-threads for each split radio data set in the at least one split radio data set; and processing the corresponding split radio data set by using the sub-thread.
Optionally, the radio data processing subunit to be processed may be further configured to:
and according to the memory identification of the radio data to be processed in the target memory, carrying out shunting processing on the radio data set to be processed.
Optionally, the radio data processing subunit to be processed may be further configured to:
and carrying out shunting processing on the radio data sets to be processed according to a preset quantity.
The radio data processing device provided by the embodiment of the invention can execute the radio data processing method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.
Example four
FIG. 4 shows a schematic block diagram of an electronic device 400 that may be used to implement embodiments of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 4, the electronic device 400 includes at least one processor 401, and a memory communicatively connected to the at least one processor 401, such as a Read Only Memory (ROM) 402, a Random Access Memory (RAM) 403, and the like, wherein the memory stores computer programs executable by the at least one processor, and the processor 401 may perform various suitable actions and processes according to the computer programs stored in the Read Only Memory (ROM) 402 or the computer programs loaded from a storage unit 408 into the Random Access Memory (RAM) 403. In the RAM 403, various programs and data required for the operation of the electronic device 400 can also be stored. The processor 401, ROM 402 and RAM 403 are connected to each other by a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.
A number of components in the electronic device 400 are connected to the I/O interface 405, including: an input unit 406 such as a keyboard, a mouse, or the like; an output unit 407 such as various types of displays, speakers, and the like; a storage unit 408 such as a magnetic disk, optical disk, or the like; and a communication unit 409 such as a network card, modem, wireless communication transceiver, etc. The communication unit 409 allows the electronic device 400 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
In some embodiments, the radio data processing method may be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 408. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 400 via the ROM 402 and/or the communication unit 409. When loaded into RAM 403 and executed by processor 401, may perform one or more steps of the method of radio data processing described above. Alternatively, in other embodiments, the processor 401 may be configured to perform the radio data processing method by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be performed. A computer program can execute entirely on a machine, partly on a machine, as a stand-alone software package partly on a machine and partly on a remote machine or entirely on a remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the Internet.
The computing system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present invention may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired results of the technical solution of the present invention can be achieved.
The above-described embodiments should not be construed as limiting the scope of the invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A radio data processing method, comprising:
acquiring a radio data set to be processed; the radio frequency data set to be processed is provided with corresponding generation time information, the radio frequency data set to be processed comprises radio frequency data to be processed of a task to be processed, and the task to be processed comprises a plurality of subtasks executed according to a preset sequence;
determining a target memory matched with the radio data set to be processed according to the generated time information, the total number of the memories and a pre-established memory management table, and storing the radio data set to be processed into the target memory;
and calling a processing thread corresponding to each subtask in the plurality of subtasks in the target memory according to the preset sequence, and processing the radio data to be processed by using the processing thread.
2. The method according to claim 1, wherein the memory management table contains a correspondence between a data set identifier and a memory identifier;
determining a target memory matched with the radio data set to be processed according to the generated time information, the total memory and a pre-established memory management table, wherein the method comprises the following steps:
determining a target data set identifier corresponding to the radio data set to be processed according to the generation time information and the total memory number;
inquiring the pre-established memory management table according to the target data set identifier to determine a target memory identifier matched with the target data set identifier;
and taking the memory corresponding to the target memory identification as a target memory matched with the radio data set to be processed.
3. The method according to claim 1, wherein invoking a processing thread corresponding to each of the plurality of subtasks in the target memory according to the preset sequence, and processing the radio data to be processed using the processing thread, comprises:
determining the subtasks which need to be executed currently from the plurality of subtasks according to the preset sequence to obtain target tasks;
and calling a processing thread corresponding to the target task in the target memory, and processing the radio data to be processed by using the processing thread.
4. The method of claim 3, wherein each of the plurality of subtasks has a corresponding complexity level;
calling a processing thread corresponding to the target task, and processing the radio data to be processed by using the processing thread, wherein the processing thread comprises the following steps:
judging whether the complexity of the target task exceeds a preset complexity threshold;
and when the complexity of the target task does not exceed the preset complexity threshold, calling a processing thread corresponding to the target task, and processing the radio data to be processed by using the processing thread.
5. The method of claim 4, further comprising:
when the complexity of the target task exceeds the preset complexity threshold, performing shunting processing on the radio data sets to be processed to obtain at least one shunted radio data set;
creating a corresponding sub-thread for each split radio data set in the at least one split radio data set;
and processing the corresponding split radio data set by using the sub-thread.
6. The method of claim 5, wherein performing the shunting processing on the radio data set to be processed comprises:
and according to the memory identification of the radio data to be processed in the target memory, carrying out shunting processing on the radio data set to be processed.
7. The method of claim 5, wherein the splitting of the to-be-processed radio data set comprises:
and carrying out shunting processing on the radio data sets to be processed according to a preset quantity.
8. A radio data processing apparatus, comprising:
the device comprises a to-be-processed radio data set acquisition module, a to-be-processed radio data set acquisition module and a to-be-processed radio data set acquisition module, wherein the to-be-processed radio data set acquisition module is used for acquiring a to-be-processed radio data set; the radio frequency data set to be processed is provided with corresponding generation time information, the radio frequency data set to be processed comprises radio frequency data to be processed of a task to be processed, and the task to be processed comprises a plurality of subtasks executed according to a preset sequence;
the to-be-processed radio data set storage module is used for determining a target memory matched with the to-be-processed radio data set according to the generation time information, the total number of the memories and a pre-established memory management table, and storing the to-be-processed radio data set into the target memory;
and the to-be-processed radio data processing module is used for calling a processing thread corresponding to each subtask in the plurality of subtasks in the target memory according to the preset sequence and processing the to-be-processed radio data by using the processing thread.
9. An electronic device, characterized in that the electronic device comprises:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.
10. A computer-readable storage medium storing computer instructions for causing a processor to perform the method of any one of claims 1-7 when executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210985752.2A CN115357358A (en) | 2022-08-17 | 2022-08-17 | Radio data processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210985752.2A CN115357358A (en) | 2022-08-17 | 2022-08-17 | Radio data processing method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115357358A true CN115357358A (en) | 2022-11-18 |
Family
ID=84002036
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210985752.2A Pending CN115357358A (en) | 2022-08-17 | 2022-08-17 | Radio data processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115357358A (en) |
-
2022
- 2022-08-17 CN CN202210985752.2A patent/CN115357358A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115495473A (en) | Database query method and device, electronic equipment and storage medium | |
| CN112860401A (en) | Task scheduling method and device, electronic equipment and storage medium | |
| CN116303524A (en) | Data processing method, device, electronic equipment and storage medium | |
| CN116661960A (en) | Batch task processing method, device, equipment and storage medium | |
| CN113377295B (en) | Data storage and reading method, device and equipment for multi-producer single-consumer | |
| CN114564149B (en) | Data storage method, device, equipment and storage medium | |
| CN115438007A (en) | File merging method and device, electronic equipment and medium | |
| CN115617549A (en) | Thread decoupling method and device, electronic equipment and storage medium | |
| CN115357358A (en) | Radio data processing method, device, equipment and storage medium | |
| CN113556575A (en) | Method, apparatus, device, medium and product for compressing data | |
| CN114090247A (en) | Method, device, equipment and storage medium for processing data | |
| CN113778645A (en) | Task scheduling method, device and equipment based on edge calculation and storage medium | |
| CN115495312B (en) | Service request processing method and device | |
| CN115033823A (en) | Method, apparatus, device, medium and product for processing data | |
| CN115576977A (en) | Data paging query method and device, electronic equipment and storage medium | |
| CN116915868A (en) | Network monitoring task issuing method, device, equipment and storage medium | |
| CN115801718A (en) | Message processing method and device, electronic equipment and message processing system | |
| CN115525659A (en) | Data query method and device, electronic equipment and storage medium | |
| CN118012871A (en) | Data table generation method and device, electronic equipment and readable storage medium | |
| CN115578200A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN115718608A (en) | Parameter updating method and device, electronic equipment and storage medium | |
| CN115202791A (en) | Method and device for determining first screen loading resource, server and storage medium | |
| CN115168407A (en) | Numerical value addressing method and device, electronic equipment and storage medium | |
| CN115309568A (en) | Method, device, equipment and medium for realizing multi-process file sharing | |
| CN114637584A (en) | Method, device, equipment and medium for adjusting parallelism of data processing task |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |