WO2021135763A1 - Data processing method and apparatus, storage medium, and electronic apparatus - Google Patents

Data processing method and apparatus, storage medium, and electronic apparatus Download PDF

Info

Publication number
WO2021135763A1
WO2021135763A1 PCT/CN2020/132164 CN2020132164W WO2021135763A1 WO 2021135763 A1 WO2021135763 A1 WO 2021135763A1 CN 2020132164 W CN2020132164 W CN 2020132164W WO 2021135763 A1 WO2021135763 A1 WO 2021135763A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
processing
channels
channel
designated
Prior art date
Application number
PCT/CN2020/132164
Other languages
French (fr)
Chinese (zh)
Inventor
肖飞育
Original Assignee
深圳市中兴微电子技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市中兴微电子技术有限公司 filed Critical 深圳市中兴微电子技术有限公司
Publication of WO2021135763A1 publication Critical patent/WO2021135763A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38Information transfer, e.g. on bus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Memory System Of A Hierarchy Structure (AREA)

Abstract

A data processing method and apparatus, a storage medium, and an electronic apparatus. The method comprises: after source channels have received data, sending the data to at least one processing channel among multiple designated processing channels to perform data processing, the multiple designated processing channels being processing channels shared by the source channels, and the number of the designated processing channels shared by the source channels being smaller than the number of the source channels (S202).

Description

数据处理方法和装置、存储介质及电子装置Data processing method and device, storage medium and electronic device
本申请要求在2019年12月30日提交中国专利局、申请号为201911399584.3的中国专利申请的优先权,该申请的全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office with an application number of 201911399584.3 on December 30, 2019. The entire content of this application is incorporated into this application by reference.
技术领域Technical field
本公开涉及通信领域,例如,涉及一种数据处理方法和装置、存储介质及电子装置。The present disclosure relates to the field of communications, for example, to a data processing method and device, a storage medium, and an electronic device.
背景技术Background technique
集成电路(Integrated Circuit,IC)设计,是电子工程学和计算机工程学的一个学科,其主要内容是运用专业的逻辑和电路设计技术设计集成电路。现在从事系统级芯片(System-on-a-Chip,SoC)设计的企业越来越多,多功能芯片设计对公司的系统设计能力提出更高要求。Integrated Circuit (IC) design is a discipline of electronic engineering and computer engineering. Its main content is to use professional logic and circuit design techniques to design integrated circuits. Nowadays, more and more companies are engaged in system-on-a-chip (SoC) design. Multi-functional chip design puts forward higher requirements on the company's system design capabilities.
数字IC设计中,经常有多个类似或者重复性通道的存储要求。图1是相关技术中一种通道数据处理的示意图。如图1所示,例如在数字视频广播(Digital Video Broadcast,DVB)系统中的多个包标识符(Packet Identifier,PID)通道,其中每个通道都需要对接收的数据进行处理,比如对接收的数据进行包头检测,关键字过滤,解扰,数据校验和存储等等。这些通道都要耗费大量的物理空间。随着芯片处理性能需求的不断提高,通道数量也会逐渐增加。然而随着通道数量的增加,耗费的资源也会显著提高。因此,在芯片设计时需要考虑增大芯片面积以及提高芯片的功耗,从而影响了芯片的经济效益。In digital IC design, there are often storage requirements for multiple similar or repetitive channels. Figure 1 is a schematic diagram of a channel data processing in the related art. As shown in Figure 1, for example, multiple Packet Identifier (PID) channels in a Digital Video Broadcast (DVB) system, each of which needs to process the received data, such as receiving The data is subject to packet header detection, keyword filtering, descrambling, data verification and storage, etc. These channels consume a lot of physical space. With the continuous improvement of chip processing performance requirements, the number of channels will gradually increase. However, as the number of channels increases, the resources consumed will also increase significantly. Therefore, it is necessary to consider increasing the chip area and increasing the power consumption of the chip during chip design, thereby affecting the economic benefits of the chip.
发明内容Summary of the invention
本发明实施例提供了一种数据处理方法和装置、存储介质及电子装置,以至少解决相关技术中由于通道数量增加所导致的资源耗费提高的问题。The embodiments of the present invention provide a data processing method and device, a storage medium, and an electronic device to at least solve the problem of increased resource consumption caused by an increase in the number of channels in the related art.
提供了一种数据处理方法,包括:源通道接收数据之后,将所述数据发送至多个指定处理通道中的一个或多个处理通道进行数据处理,其中,所述多个指定处理通道为所述源通道所共享的处理通道,所述源通道所共享的所述指定处理通道的数量小于所述源通道的数量。A data processing method is provided, which includes: after a source channel receives data, sending the data to one or more of a plurality of designated processing channels for data processing, wherein the plurality of designated processing channels are the The number of processing channels shared by the source channel, and the number of the designated processing channels shared by the source channel is less than the number of the source channels.
还提供了一种数据处理装置,包括:发送模块,设置为在源通道接收数据之后,将所述数据发送至多个指定处理通道中的一个或多个处理通道进行数据处理,其中,所述多个指定处理通道为所述源通道所共享的处理通道,所述源 通道所共享的所述指定处理通道的数量小于所述源通道的数量。A data processing device is also provided, including: a sending module configured to send the data to one or more of the multiple designated processing channels for data processing after the source channel receives the data, wherein the multiple The number of designated processing channels is a processing channel shared by the source channel, and the number of the designated processing channels shared by the source channel is less than the number of the source channels.
还提供了一种存储介质,所述存储介质中存储有计算机程序,其中,所述计算机程序被设置为运行时执行本公开任一方法实施例中的步骤。A storage medium is also provided, and a computer program is stored in the storage medium, wherein the computer program is configured to execute the steps in any method embodiment of the present disclosure when running.
还提供了一种电子装置,包括存储器和处理器,所述存储器中存储有计算机程序,所述处理器被设置为运行所述计算机程序以执行本公开任一方法实施例中的步骤。An electronic device is also provided, including a memory and a processor, and a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any method embodiment of the present disclosure.
附图说明Description of the drawings
图1是相关技术中一种通道数据处理的示意图;Figure 1 is a schematic diagram of a channel data processing in the related art;
图2是根据本发明实施例的一种数据处理方法的流程图;Fig. 2 is a flowchart of a data processing method according to an embodiment of the present invention;
图3是根据本公开可选实施方式的多通道数据处理方法的流程示意图;3 is a schematic flowchart of a multi-channel data processing method according to an optional embodiment of the present disclosure;
图4是根据本公开可选实施方式的多通道数据的存储器管理方法的流程示意图;FIG. 4 is a schematic flowchart of a method for multi-channel data memory management according to an optional embodiment of the present disclosure;
图5是根据本发明实施例的一种数据处理装置的结构框图。Fig. 5 is a structural block diagram of a data processing device according to an embodiment of the present invention.
具体实施方式Detailed ways
下文中将参考附图并结合实施例来说明本公开。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。Hereinafter, the present disclosure will be described with reference to the drawings and in conjunction with embodiments. It should be noted that the embodiments in the application and the features in the embodiments can be combined with each other if there is no conflict.
需要说明的是,本公开的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。It should be noted that the terms “first”, “second”, etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence.
实施例1Example 1
在本实施例中提供了一种数据处理方法,图2是根据本发明实施例的一种数据处理方法的流程图,如图2所示,该流程包括如下步骤:In this embodiment, a data processing method is provided. FIG. 2 is a flowchart of a data processing method according to an embodiment of the present invention. As shown in FIG. 2, the flow includes the following steps:
步骤S202,源通道接收数据之后,将所述数据发送至多个指定处理通道中的一个或多个处理通道进行数据处理,其中,所述多个指定处理通道为所述源通道所共享的处理通道,所述源通道所共享的所述指定处理通道的数量小于所述源通道的数量。Step S202: After receiving the data, the source channel sends the data to one or more of the multiple designated processing channels for data processing, where the multiple designated processing channels are processing channels shared by the source channel , The number of the designated processing channels shared by the source channels is less than the number of the source channels.
通过上述步骤,由于源通道接收数据之后,将该数据发送至多个指定处理通道中的一个或多个处理通道进行数据处理,其中,该多个指定处理通道为该源通道所共享的处理通道,该源通道所共享的该指定处理通道的数量小于该源通道的数量,通过为源通道配置共享的处理通道,因此可以解决相关技术中由于通道数量增加所导致的资源耗费提高的问题,达到在芯片处理性能需求不断 提高的情况下,能够有效减少资源耗费的效果。Through the above steps, after the source channel receives the data, the data is sent to one or more of the multiple designated processing channels for data processing, where the multiple designated processing channels are processing channels shared by the source channel, The number of designated processing channels shared by the source channel is less than the number of source channels. By configuring shared processing channels for the source channels, the problem of increased resource consumption caused by the increase in the number of channels in the related technology can be solved, and the problem of increased resource consumption can be achieved in the related art. With the continuous improvement of chip processing performance requirements, the effect of resource consumption can be effectively reduced.
可选地,将该数据发送至多个指定处理通道中的一个或多个处理通道进行处理,包括:获取该多个指定处理通道的数据处理状态;在根据该多个指定处理通道的数据处理状态确定该多个处理通道无法满足该数据的数据处理需求的情况下,缓存该数据;或者,在根据该多个指定处理通道的数据处理状态确定该多个处理通道无法满足该数据的数据处理需求的情况下,按照第一预设规则将该数据中的部分数据发送至该多个指定处理通道中的一个或多个处理通道进行数据处理,并缓存该数据中未处理的数据;或者,在根据该多个指定处理通道的数据处理状态确定该多个指定处理通道满足该数据的数据处理需求的情况下,按照第二预设规则将该数据分配至该多个指定处理通道中的一个或多个处理通道进行数据处理。Optionally, sending the data to one or more of the multiple designated processing channels for processing includes: acquiring the data processing status of the multiple designated processing channels; and according to the data processing status of the multiple designated processing channels When it is determined that the multiple processing channels cannot meet the data processing requirements of the data, the data is cached; or, based on the data processing status of the multiple designated processing channels, it is determined that the multiple processing channels cannot meet the data processing requirements of the data In the case of, according to the first preset rule, send part of the data in the data to one or more of the multiple designated processing channels for data processing, and cache the unprocessed data in the data; or If it is determined according to the data processing status of the plurality of designated processing channels that the plurality of designated processing channels meet the data processing requirements of the data, the data is allocated to one or the plurality of designated processing channels according to the second preset rule. Multiple processing channels for data processing.
可选地,第一预设规则可以是用于指示在缓存的数据的处理需求高于当前处理通道的处理能力的情况下,将哪些部分的缓存的数据优先发送至处理通道进行数据处理的规则。第二预设规则可以是用于指示数据如何被分配至处理通道的规则。Optionally, the first preset rule may be a rule for indicating which parts of the cached data are sent to the processing channel for data processing in a case where the processing demand of the cached data is higher than the processing capacity of the current processing channel. . The second preset rule may be a rule for indicating how data is distributed to the processing channel.
可选地,将该数据发送至多个指定处理通道中的一个或多个处理通道进行处理,还包括:在缓存该数据之后,或者,在缓存该数据中的未处理的数据之后,对该多个指定处理通道的数据处理状态进行监测,并在监测到该多个指定处理通道中存在该数据处理状态为空闲状态的处理通道时,按照第三预设规则将缓存的数据分配至该空闲状态的处理通道进行数据处理。Optionally, sending the data to one or more of the multiple designated processing channels for processing, further includes: after the data is cached, or after the unprocessed data in the data is cached, the multiple The data processing state of a designated processing channel is monitored, and when it is detected that there is a processing channel whose data processing state is idle in the multiple designated processing channels, the cached data is allocated to the idle state according to the third preset rule The processing channel for data processing.
可选地,按照第三预设规则将该缓存的数据分配至该空闲状态的处理通道进行数据处理,包括:在根据该多个指定处理通道的数据处理状态确定该空闲状态的处理通道无法满足该缓存的数据的数据处理需求的情况下,再次缓存该缓存的数据;或者,将该缓存的数据中的部分数据发送至该空闲状态的处理通道,并再次缓存该缓存的数据中未处理的数据。Optionally, allocating the buffered data to the processing channel in the idle state for data processing according to a third preset rule includes: determining that the processing channel in the idle state cannot meet the requirements based on the data processing states of the multiple designated processing channels In the case of data processing requirements of the cached data, cache the cached data again; or, send part of the cached data to the processing channel in the idle state, and cache the unprocessed cached data again data.
可选地,第三预设规则可以是用于指示在再次缓存的数据的处理需求高于当前处理通道的处理能力的情况下,将哪些部分的缓存的数据优先发送至处理通道进行数据处理的规则。第三预设规则可以是与第一预设规则相同的规则,也可以是不同的规则。Optionally, the third preset rule may be used to indicate which part of the cached data is to be sent to the processing channel for data processing in a case where the processing demand of the re-cached data is higher than the processing capacity of the current processing channel. rule. The third preset rule may be the same rule as the first preset rule, or may be a different rule.
可选地,通过如下之一的方式确定该多个指定处理通道无法满足该数据的数据处理需求:确定该多个指定处理通道的该数据处理状态均为非空闲态;确定该多个指定处理通道中处于非空闲态的通道数目小于该数据的数目。Optionally, it is determined that the multiple designated processing channels cannot meet the data processing requirements of the data by one of the following methods: determining that the data processing states of the multiple designated processing channels are all in a non-idle state; determining that the multiple designated processing channels The number of channels in the non-idle state is less than the number of data.
可选地,按照该第一预设规则将该数据中的部分数据发送至该多个指定处 理通道中的一个或多个处理通道进行数据处理,包括:按照该数据的优先级将该数据中的部分数据发送至该多个指定处理通道中的一个或多个处理通道进行数据处理。Optionally, sending part of the data in the data to one or more of the multiple designated processing channels for data processing according to the first preset rule includes: adding the data to the data according to the priority of the data Part of the data is sent to one or more of the multiple designated processing channels for data processing.
可选地,按照该数据的优先级将该数据中的部分数据发送至该多个指定处理通道中的一个或多个处理通道进行数据处理,包括:获取该数据中携带的标识信息,其中,该标识信息用于指示处理该数据的优先级;根据该标识信息对该数据进行优先级排序,并按照优先级由高至低的顺序将该数据中的部分数据分别分配至该一个或多个处理通道中进行数据处理;或者,可选地,该按照该数据的优先级将该数据中的部分数据发送至该多个指定处理通道中的一个或多个处理通道进行数据处理,包括:通过该数据的属性信息对该数据进行优先级排序,并按照优先级由高至低的顺序将该数据中的部分数据分别分配至该一个或多个处理通道中进行数据处理,其中,该数据的属性信息至少包括以下之一:该数据的类型信息,该数据的大小信息。Optionally, sending part of the data in the data to one or more of the plurality of designated processing channels for data processing according to the priority of the data includes: obtaining identification information carried in the data, where: The identification information is used to indicate the priority of processing the data; the data is prioritized according to the identification information, and part of the data in the data is allocated to the one or more in order of priority. Data processing in the processing channel; or, optionally, sending part of the data in the data to one or more of the multiple designated processing channels for data processing according to the priority of the data, including: The attribute information of the data prioritizes the data, and assigns part of the data to the one or more processing channels for data processing in descending order of priority. The attribute information includes at least one of the following: type information of the data, and size information of the data.
可选地,该方法还包括:在判断缓存数据中的指定数据的缓存时间大于预先配置的驻留时间的情况下,提高该指定数据的优先级。Optionally, the method further includes: in a case where it is determined that the cache time of the specified data in the cache data is greater than the pre-configured residence time, increasing the priority of the specified data.
可选地,在将该数据发送至多个指定处理通道中的一个或多个处理通道进行数据处理之后,该方法还包括:将数据处理之后的该数据映射到下游的传输通道。Optionally, after sending the data to one or more of the multiple designated processing channels for data processing, the method further includes: mapping the data after the data processing to a downstream transmission channel.
需要指出的是,对于一些用于提醒功能的数据。存在在指定的处理时间处理,但是不是非常紧急的数据。因此,对于这些数据,在未到达允许驻留在缓存当中的驻留时间之前,可以按照原有的优先级顺序进行缓存。然而一旦临近或者到达驻留时间时,则提高这些数据的优先级或者将这些数据的优先级调至最高。It should be pointed out that for some data used for reminding functions. There is data that is processed at the designated processing time, but is not very urgent. Therefore, these data can be cached according to the original priority order before the residence time allowed to reside in the cache has not been reached. However, as soon as it approaches or reaches the residence time, the priority of these data is increased or the priority of these data is adjusted to the highest.
可选实施方式Alternative implementation
本发明实施例提出一种多通道数据处理的复用方法,可以解决在通道数量比较多的时候,每一个通道耗费的资源过多,造成的芯片面积大和功耗高的问题。The embodiment of the present invention provides a multiplexing method for multi-channel data processing, which can solve the problems of large chip area and high power consumption caused by excessive resource consumption by each channel when the number of channels is relatively large.
本实施方式所采用的技术方案是:对于多通道的数据,不再给每一个源通道配置独立的处理通道,而是所有的源通道共享数量较少的处理通道。同时为了避免处理通道数量不够,出现来不及处理源通道数据的情况,在源通道和处理通道之间设置多个缓存以保存来不及处理的源通道数据。The technical solution adopted in this embodiment is that for multi-channel data, each source channel is no longer configured with an independent processing channel, but all source channels share a smaller number of processing channels. At the same time, in order to avoid the insufficient number of processing channels and the situation that it is too late to process the source channel data, multiple buffers are set up between the source channel and the processing channel to save the source channel data that is too late to be processed.
每一个源通道收到数据后,就会申请处理通道进行处理,假如有空闲的处理通道,那么源通道的数据就会进入空闲的处理通道进行处理,假如所有的处 理通道都被占满了,那么源通道数据就会进入缓存先保存起来。直到有空闲的物理通道出现之后,缓存的数据会依据先后顺序进入处理通道进行处理。After each source channel receives the data, it will apply for the processing channel for processing. If there is an idle processing channel, then the data of the source channel will enter the idle processing channel for processing. If all the processing channels are full, Then the source channel data will be stored in the cache first. Until there is an idle physical channel, the buffered data will enter the processing channel for processing according to the sequence.
由于缓存远比每个处理通道耗费的资源小,这样做能够节省大量的资源,这样本实施例可以相应的减少芯片面积以及功耗。本实施例的特点是没有为每个源通道的数据分配独立的处理通道空间,而是所有的源通道数据复用数量较少的处理通道,并且在源通道和处理通道之间设立多个通道缓存。这样就大大减少了需要的处理通道数量。Since the cache consumes much less resources than each processing channel, this can save a lot of resources, so this embodiment can correspondingly reduce the chip area and power consumption. The feature of this embodiment is that no independent processing channel space is allocated for the data of each source channel, but all source channel data is multiplexed with a smaller number of processing channels, and multiple channels are set up between the source channel and the processing channel. Cache. This greatly reduces the number of processing channels required.
为了理解上述实施例中记载的内容,在本实施例中还提供了如下的场景以便理解:In order to understand the content recorded in the above embodiments, the following scenarios are also provided in this embodiment for understanding:
图3是根据本公开可选实施方式的多通道数据处理方法的流程示意图;如图3所示,包括:(1)是n个源通道的输入端;(2)处理通道使用情况判断;(3)缓存;(4)处理通道使用情况判断;(5)处理通道分配,数量为k,k<n;(6)通道映射;(7)是n个源通道的输出端其中,(2)处理通道使用情况判断为根据源通道的数据确定有无空闲处理通道;可选地,可以设置一个处理通道处理一个源通道数据,则在源通道的数据量小于当前空闲的处理通道的数量的情况下,确定此时有空闲处理通道,进而将源通道数据分配至空闲的处理通道中进行数据处理;在源通道的数据量大于当前空闲的处理通道的数量的情况下,可以先缓存全部的源通道数据,等待有足够的空闲处理通道之后再进行处理,也可以按照当前空闲处理通道的数量先处理部分源通道数据,只需缓存剩下的无法处理的源通道数据,待存在空闲的处理通道的情况下,继续给当前已经缓存的源通道数据分配处理通道进行数据处理。Fig. 3 is a schematic flow chart of a multi-channel data processing method according to an alternative embodiment of the present disclosure; as shown in Fig. 3, it includes: (1) input terminals of n source channels; (2) processing channel usage judgment; 3) Cache; (4) Judgment of processing channel usage; (5) Processing channel allocation, the number is k, k<n; (6) Channel mapping; (7) is the output terminal of n source channels, (2) The processing channel usage is judged to determine whether there is an idle processing channel based on the data of the source channel; optionally, one processing channel can be set to process one source channel data, then the data volume of the source channel is less than the number of currently idle processing channels Next, determine that there is an idle processing channel at this time, and then allocate the source channel data to the idle processing channel for data processing; in the case where the data volume of the source channel is greater than the number of currently idle processing channels, all sources can be cached first Channel data, wait for enough free processing channels before processing, or process part of the source channel data according to the current number of free processing channels, just buffer the remaining unprocessable source channel data, and wait for free processing channels to exist In the case of data processing, continue to allocate processing channels to the currently buffered source channel data for data processing.
可选地,在数据处理结束后,可以将通道映射到下游通道,继续进行其他的数据处理过程。Optionally, after the data processing is completed, the channel can be mapped to the downstream channel, and other data processing procedures can be continued.
以下结合应用场景解释本发明实施例。The following explains the embodiments of the present invention in combination with application scenarios.
场景1:scene 1:
假设PID处理通道的数量为10,芯片中的PID处理信道处于初始状态,没有处理任何的数据。同时,接收到的数据的数量为30。Assuming that the number of PID processing channels is 10, the PID processing channels in the chip are in the initial state, and no data is processed. At the same time, the number of received data is 30.
步骤1:由于没有获取到任何数据,因此在初始状态下,确定PID_0至PID_9的处理信道处于空闲状态。Step 1: Since no data has been acquired, in the initial state, it is determined that the processing channels from PID_0 to PID_9 are in an idle state.
步骤2:在接收到30个数据之后,根据数据中的标识信息(例如,在数据中携带用于指示优先级的字段)分析出数据处理的优先级顺序,然后依次分配至PID_0至PID_9处理信道中,同时将PID_0至PID_9处理信道转换为非空闲状态。Step 2: After receiving 30 data, analyze the priority order of data processing according to the identification information in the data (for example, the field used to indicate the priority in the data), and then assign them to the PID_0 to PID_9 processing channels in sequence At the same time, the PID_0 to PID_9 processing channels are converted to non-idle state.
步骤3:在分配到第11个数据时,此时发现当前PID_0至PID_9的处理信道由于还未处理完前10个数据,因此将第11至第30个数据按照优先级顺序依次缓存至缓存buffer_当中。Step 3: When the 11th data is allocated, it is found that the current processing channels of PID_0 to PID_9 have not processed the first 10 data, so the 11th to 30th data are sequentially cached to the buffer buffer in the order of priority _among.
步骤4:对PID_0至PID_9的处理信道的空闲状态进行监测,当PID_0处理信道处理数据完毕后,确定PID_0处理信道转换为空闲状态,因此,将第11个数据分配到PID_0处理信道进行处理,其余数据继续保持缓存状态。Step 4: Monitor the idle state of the processing channels from PID_0 to PID_9. When the PID_0 processing channel processing data is completed, it is determined that the PID_0 processing channel is converted to the idle state. Therefore, the 11th data is allocated to the PID_0 processing channel for processing, and the rest The data continues to remain cached.
步骤5:循环重复步骤4直至30个数据均处理完成后,结束流程。Step 5: Repeat step 4 cyclically until all 30 data are processed, and then the process ends.
场景2:Scene 2:
假设PID处理通道的数量为10,芯片中的PID处理信道中的后5个处理信道处于初始状态,没有处理任何的数据。而另外前5个处理信道正在进行数据处理。Assuming that the number of PID processing channels is 10, the last five processing channels of the PID processing channels in the chip are in the initial state, and no data is processed. In addition, the first 5 processing channels are undergoing data processing.
同时,接收到的数据的数量为30。At the same time, the number of received data is 30.
步骤1:由于PID处理信道中的后5个处理信道处于初始状态,没有处理任何的数据。而另外前5个处理信道正在进行数据处理,因此,确定PID_0至PID_4的处理信道处于非空闲状态,PID_5至PID_9的处理信道处于空闲状态。Step 1: Since the last five processing channels in the PID processing channel are in the initial state, no data is processed. In addition, the first five processing channels are performing data processing. Therefore, it is determined that the processing channels from PID_0 to PID_4 are in a non-idle state, and the processing channels from PID_5 to PID_9 are in an idle state.
步骤2:在接收到30个数据之后,根据数据的属性信息(例如数据的类型,数据的大小)分析出数据处理的优先级顺序,然后依次分配至PID_5至PID_9的处理信道中。同时将PID_5至PID_9处理信道转换为非空闲状态。Step 2: After receiving 30 data, analyze the priority order of data processing according to the attribute information of the data (such as the type of data, the size of the data), and then assign them to the processing channels from PID_5 to PID_9 in sequence. At the same time, the PID_5 to PID_9 processing channels are converted to a non-idle state.
步骤3:在分配到第6个数据时,此时发现当前PID_0至PID_9的处理信道由于还未处理完前10个数据,因此将第6至第30个数据按照优先级顺序依次缓存至缓存buffer_当中。Step 3: When the 6th data is allocated, it is found that the current processing channels of PID_0 to PID_9 have not processed the first 10 data, so the 6th to 30th data are sequentially cached to the buffer buffer in order of priority _among.
步骤4:对PID_0至PID_9的处理信道的空闲状态进行监测,当预测出PID_0处理信道至PID_5处理信道将要完成数据处理后(举例而言,在10ms内将要完成数据处理),预先将第6个至第10个数据从缓存中提取出,并预分配至PID_0处理信道至PID_5处理信道。Step 4: Monitor the idle state of the processing channels from PID_0 to PID_9. When it is predicted that the data processing will be completed from the PID_0 processing channel to the PID_5 processing channel (for example, the data processing will be completed within 10ms), the sixth The tenth data is extracted from the buffer and pre-allocated to PID_0 processing channel to PID_5 processing channel.
步骤5:当发现实际只有PID_0处理信道至PID_4处理信道处理数据完毕后,确定PID_0处理信道至PID_4转换为空闲状态,因此,将第6个至第9个数据分配到PID_0处理信道至PID_4处理信道进行处理,然后再将PID_0处理信道至PID_4转换为非空闲状态。由于PID_5处理信道仍然未处理数据完毕,因此,将对应预分配的第10个数据重新缓存至缓存当中,并将第10个数据的优先级设置为最高。其余数据继续保持缓存状态。Step 5: When it is found that only the PID_0 processing channel to the PID_4 processing channel has processed the data, it is determined that the PID_0 processing channel to PID_4 is converted to an idle state. Therefore, the 6th to 9th data are allocated to the PID_0 processing channel to the PID_4 processing channel Perform processing, and then convert the PID_0 processing channel to PID_4 to a non-idle state. Since the PID_5 processing channel still has not processed the data, the corresponding pre-allocated 10th data is re-buffered into the buffer, and the priority of the 10th data is set to the highest. The remaining data continues to be cached.
步骤6:循环重复步骤4至5直至30个数据均处理完成后,结束流程。Step 6: Repeat steps 4 to 5 cyclically until all 30 data are processed, and then the process ends.
需要指出的是,场景1和场景2只是示例性说明,而非穷举。例如,场景1与场景2可以结合使用。同时对于其他特殊情况,例如在某些特定时间点上需要优先处理的数据,或者根据指示信息将对数据的优先级进行调整,还有中途插入紧急需要处理的数据等场景也在本实施例的保护范围之内,在此不做过多赘述。It should be pointed out that scenario 1 and scenario 2 are only exemplary descriptions, not exhaustive lists. For example, scene 1 and scene 2 can be used in combination. At the same time, for other special situations, such as data that needs to be processed preferentially at certain specific points in time, or the priority of the data will be adjusted according to the instruction information, and the scenes of inserting urgently needed data in the middle are also in this embodiment. Within the scope of protection, I won't repeat them here.
场景3:Scene 3:
假设有96个源通道,每个源通道接收到数据后,会把对应的通道数据传到处理通道使用情况判断模块,该模块判断是否有空闲的处理通道,假设有系统有16个处理通道,现在只使用了8个,那么就是有空闲的处理通道,这样我们就可以直接把数据传到处理通道分配模块进行分配,如果16个通道都在使用之中,那就说明没有空闲的处理通道,那么我们就先把数据缓存起来。当收到任意一个源通道传输请求之后,处理通道分配模块会进行处理通道的分配,如果收到缓存的传输请求,那么需要先进行判断,如果有空闲的使用通道,则将该使用通道分配给缓存的使用通道,如果没有空闲,则暂时不处理缓存的使用通道的请求,隔段时间后继续进行判断。在处理完成之后,再把处理通道的数据映射到下游的传输通道,然后下游通道继续传输到下一个流程或者最终的传输通道。Suppose there are 96 source channels. After each source channel receives data, it will transmit the corresponding channel data to the processing channel usage judgment module. The module judges whether there are free processing channels. Assuming a system has 16 processing channels, Now that only 8 channels are used, there are free processing channels, so we can directly transfer the data to the processing channel distribution module for distribution. If all 16 channels are in use, it means that there are no free processing channels. Then we first cache the data. After receiving any source channel transmission request, the processing channel allocation module will allocate the processing channel. If a buffered transmission request is received, it needs to be judged first. If there is a free channel to use, then the channel to be used is allocated to If the channel used by the cache is not free, the request for the channel used by the cache will not be processed temporarily, and the judgment will continue after a certain period of time. After the processing is completed, the data of the processing channel is mapped to the downstream transmission channel, and then the downstream channel continues to be transmitted to the next process or the final transmission channel.
可选地,图4是根据本公开可选实施方式的多通道数据的存储器管理方法的流程示意图,如图4所示,包括:(1)是n个源通道的输入端;(2)是k个标准流程的串行图;(3)是n个源通道的输出端。可选地,可以把整个的处理流程根据合理性分成多个串联的标准流程,这样在前面的流程完成后,就可以进入下一个流程,前面流程的资源就可以尽快释放处理,从而接收下一个源通道数据,这也意味着可以设置更少的处理流程数量,从而节约更多的资源。Optionally, FIG. 4 is a schematic flow chart of a memory management method for multi-channel data according to an optional embodiment of the present disclosure, as shown in FIG. 4, including: (1) is the input terminal of n source channels; (2) is Serial diagram of k standard processes; (3) is the output terminal of n source channels. Optionally, the entire processing flow can be divided into multiple serial standard flows based on reasonableness, so that after the previous flow is completed, the next flow can be entered, and the resources of the previous flow can be released for processing as soon as possible, so as to receive the next flow. Source channel data, which also means that fewer processing procedures can be set, thereby saving more resources.
通过以上的实施方式的描述,本领域的技术人员可以了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现,也可以通过硬件来实现。本公开可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括多条指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本公开多个实施例所述的方法。Through the description of the foregoing implementation manners, those skilled in the art can understand that the method according to the foregoing embodiment can be implemented by means of software plus a necessary general hardware platform, or can be implemented by hardware. The present disclosure can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), and includes multiple instructions to enable a terminal device (which can be a mobile phone, a computer) , A server, or a network device, etc.) execute the methods described in the multiple embodiments of the present disclosure.
在本实施例中还提供了一种数据处理装置,该装置用于实现上述实施例及可选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。In this embodiment, a data processing device is also provided, and the device is used to implement the above-mentioned embodiments and optional implementation manners, and those that have been described will not be repeated. As used below, the term "module" can implement a combination of software and/or hardware with predetermined functions.
图5是根据本发明实施例的一种数据处理装置的结构框图,如图5所示,该装置包括:发送模块51,设置为在源通道接收数据之后,将所述数据发送至 多个指定处理通道中的一个或多个处理通道进行数据处理,其中,所述多个指定处理通道为所述源通道所共享的处理通道,所述源通道所共享的所述指定处理通道的数量小于所述源通道的数量。Fig. 5 is a structural block diagram of a data processing device according to an embodiment of the present invention. As shown in Fig. 5, the device includes: a sending module 51 configured to send the data to a plurality of designated processes after the source channel receives data One or more processing channels in the channel perform data processing, wherein the multiple designated processing channels are processing channels shared by the source channel, and the number of designated processing channels shared by the source channel is less than the number of the designated processing channels shared by the source channel. The number of source channels.
通过上述模块,由于源通道接收数据之后,将该数据发送至多个指定处理通道中的一个或多个处理通道进行数据处理,其中,该多个指定处理通道为该源通道所共享的处理通道,该源通道所共享的该指定处理通道的数量小于该源通道的数量,通过为源通道配置共享的处理通道,因此可以解决相关技术中由于通道数量增加所导致的资源耗费提高的问题,达到在芯片处理性能需求不断提高的情况下,能够有效减少资源耗费的效果。Through the above module, after the source channel receives the data, the data is sent to one or more of the multiple designated processing channels for data processing, where the multiple designated processing channels are processing channels shared by the source channel, The number of designated processing channels shared by the source channel is less than the number of source channels. By configuring shared processing channels for the source channels, the problem of increased resource consumption caused by the increase in the number of channels in the related technology can be solved, and the problem of increased resource consumption can be achieved in the related art. With the continuous improvement of chip processing performance requirements, the effect of resource consumption can be effectively reduced.
可选地,所述发送模块,包括:获取模块,设置为获取所述多个指定处理通道的数据处理状态;第一缓存模块,设置为在根据所述多个指定处理通道的数据处理状态确定所述多个处理通道无法满足所述数据的数据处理需求的情况下,缓存所述数据;或者,第二缓存模块,设置为在根据所述多个指定处理通道的数据处理状态确定所述多个处理通道无法满足所述数据的数据处理需求的情况下,按照第一预设规则将所述数据中的部分数据发送至所述多个指定处理通道中的一个或多个处理通道进行数据处理,并缓存所述数据中未处理的数据;或者,分配模块,设置为在根据所述多个指定处理通道的数据处理状态确定所述多个指定处理通道满足所述数据的数据处理需求的情况下,按照第二预设规则将所述数据分配至所述多个指定处理通道中的一个或多个处理通道进行数据处理。Optionally, the sending module includes: an acquiring module configured to acquire the data processing status of the multiple designated processing channels; a first buffer module configured to determine the data processing status of the multiple designated processing channels; When the multiple processing channels cannot meet the data processing requirements of the data, the data is cached; or, the second cache module is configured to determine the multiple processing channels according to the data processing status of the multiple designated processing channels. In the case that the two processing channels cannot meet the data processing requirements of the data, according to the first preset rule, part of the data in the data is sent to one or more of the multiple designated processing channels for data processing , And cache the unprocessed data in the data; or, the allocation module is configured to determine the situation in which the multiple specified processing channels meet the data processing requirements of the data according to the data processing status of the multiple specified processing channels Next, according to a second preset rule, the data is allocated to one or more processing channels of the plurality of designated processing channels for data processing.
可选地,所述发送模块,还包括:监测模块,设置为在缓存所述数据之后,或者,在缓存所述数据中的所述未处理的数据之后,对所述多个指定处理通道的数据处理状态进行监测,并在监测到所述多个指定处理通道中存在所述数据处理状态为空闲状态的处理通道时,按照第三预设规则将缓存的数据分配至所述空闲状态的处理通道进行数据处理。Optionally, the sending module further includes: a monitoring module configured to perform processing on the multiple designated processing channels after the data is cached, or after the unprocessed data in the data is cached The data processing state is monitored, and when it is detected that there is a processing channel whose data processing state is idle in the plurality of designated processing channels, the cached data is allocated to the processing in the idle state according to a third preset rule Channel for data processing.
可选地,所述监测模块,包括:第一缓存子模块,设置为在根据所述多个指定处理通道的数据处理状态确定所述空闲状态的处理通道无法满足所述缓存的数据的数据处理需求的情况下,再次缓存所述缓存的数据;或者,第一发送子模块,设置为将所述缓存的数据中的部分数据发送至所述空闲状态的处理通道,并再次缓存所述缓存的数据中未处理的数据。Optionally, the monitoring module includes: a first buffering sub-module configured to determine that the processing channel in the idle state cannot satisfy the data processing of the buffered data according to the data processing state of the multiple designated processing channels If required, cache the cached data again; or, the first sending submodule is configured to send part of the cached data to the processing channel in the idle state, and cache the cached data again Unprocessed data in the data.
可选地,通过如下之一的方式确定所述多个指定处理通道无法满足所述数据的数据处理需求:确定所述多个指定处理通道的所述数据处理状态均为非空闲态;确定所述多个指定处理通道中处于非空闲态的通道数目小于所述数据的数目。Optionally, it is determined that the multiple designated processing channels cannot meet the data processing requirements of the data by one of the following methods: determining that the data processing states of the multiple designated processing channels are all in a non-idle state; The number of channels in the non-idle state among the plurality of designated processing channels is less than the number of data.
可选地,第二缓存模块,包括:第二发送子模块,设置为按照所述数据的优先级将所述数据中的部分数据发送至所述多个指定处理通道中的一个或多个处理通道进行数据处理。Optionally, the second buffer module includes: a second sending submodule, configured to send part of the data to one or more of the multiple designated processing channels according to the priority of the data Channel for data processing.
可选地,所述第二发送子模块,包括:获取单元,设置为获取所述数据中携带的标识信息,其中,所述标识信息用于指示处理所述数据的优先级;第一分配单元,设置为根据所述标识信息对所述数据进行优先级排序,并按照优先级由高至低的顺序将所述数据中的部分数据分别分配至所述处理通道中进行数据处理;或者,可选地,该第二发送子模块,包括:第二分配单元,设置为通过所述数据的属性信息对所述数据进行优先级排序,并按照优先级由高至低的顺序将所述数据中的部分数据分别分配至所述处理通道中进行数据处理,其中,所述数据的属性信息至少包括以下之一:所述数据的类型信息,所述数据的大小信息。Optionally, the second sending submodule includes: an acquiring unit configured to acquire identification information carried in the data, wherein the identification information is used to indicate the priority of processing the data; a first allocation unit , Set to prioritize the data according to the identification information, and assign part of the data in the data to the processing channel for data processing in descending order of priority; or Optionally, the second sending submodule includes: a second allocation unit configured to prioritize the data according to the attribute information of the data, and sort the data in the order of priority from high to low. Part of the data of are respectively allocated to the processing channel for data processing, wherein the attribute information of the data includes at least one of the following: type information of the data, and size information of the data.
可选地,在判断缓存数据中的指定数据的缓存时间大于预先配置的驻留时间的情况下,提高所述指定数据的优先级。Optionally, in a case where it is determined that the cache time of the specified data in the cache data is greater than the pre-configured residence time, the priority of the specified data is increased.
可选地,所述装置还包括:映射模块,设置为在所述将所述数据发送至多个指定处理通道中的一个或多个处理通道进行数据处理之后,将数据处理之后的所述数据映射到下游的传输通道。Optionally, the device further includes: a mapping module configured to map the data after the data processing after the data is sent to one or more of the multiple designated processing channels for data processing To the downstream transmission channel.
需要说明的是,上述多个模块是可以通过软件或硬件来实现的,对于后者,可以通过以下方式实现,但不限于此:上述模块均位于同一处理器中;或者,上述多个模块以任意组合的形式分别位于不同的处理器中。It should be noted that the above-mentioned multiple modules can be implemented by software or hardware. For the latter, it can be implemented in the following way, but not limited to this: the above-mentioned modules are all located in the same processor; or, the above-mentioned multiple modules are implemented by Any combination of forms are located in different processors.
实施例3Example 3
本公开的实施例还提供了一种存储介质,该存储介质中存储有计算机程序,其中,该计算机程序被设置为运行时执行上述任一项方法实施例中的步骤。The embodiment of the present disclosure also provides a storage medium in which a computer program is stored, wherein the computer program is configured to execute the steps in any one of the foregoing method embodiments when running.
可选地,在本实施例中,上述存储介质可以被设置为存储用于执行以下步骤的计算机程序:源通道接收数据之后,将所述数据发送至多个指定处理通道中的一个或多个处理通道进行数据处理,其中,所述多个指定处理通道为所述源通道所共享的处理通道,所述源通道所共享的所述指定处理通道的数量小于所述源通道的数量。Optionally, in this embodiment, the above-mentioned storage medium may be configured to store a computer program for executing the following steps: after the source channel receives the data, it sends the data to one or more of the multiple designated processing channels. The channel performs data processing, wherein the multiple designated processing channels are processing channels shared by the source channel, and the number of the designated processing channels shared by the source channel is less than the number of the source channels.
通过上述步骤,由于源通道接收数据之后,将该数据发送至多个指定处理通道中的一个或多个处理通道进行数据处理,其中,该多个指定处理通道为该源通道所共享的处理通道,该源通道所共享的该指定处理通道的数量小于该源通道的数量,通过为源通道配置共享的处理通道,因此可以解决相关技术中由于通道数量增加所导致的资源耗费提高的问题,达到在芯片处理性能需求不断 提高的情况下,能够有效减少资源耗费的效果。Through the above steps, after the source channel receives the data, the data is sent to one or more of the multiple designated processing channels for data processing, where the multiple designated processing channels are processing channels shared by the source channel, The number of designated processing channels shared by the source channel is less than the number of source channels. By configuring shared processing channels for the source channels, the problem of increased resource consumption caused by the increase in the number of channels in the related technology can be solved, and the problem of increased resource consumption can be achieved in the related art. With the continuous improvement of chip processing performance requirements, the effect of resource consumption can be effectively reduced.
可选地,本实施例中的示例可以参考上述实施例及可选实施方式中所描述的示例,本实施例在此不再赘述。Optionally, for the examples in this embodiment, reference may be made to the examples described in the above-mentioned embodiments and alternative implementations, and this embodiment will not be repeated here.
可选地,在本实施例中,上述存储介质可以包括但不限于:U盘、只读存储器(Read-Only Memory,简称为ROM)、随机存取存储器(Random Access Memory,简称为RAM)、移动硬盘、磁碟或者光盘等多种可以存储计算机程序的介质。Optionally, in this embodiment, the foregoing storage medium may include, but is not limited to: U disk, Read-Only Memory (Read-Only Memory, ROM for short), Random Access Memory (Random Access Memory, RAM for short), A variety of media that can store computer programs, such as mobile hard drives, magnetic disks, or optical disks.
本公开的实施例还提供了一种电子装置,包括存储器和处理器,该存储器中存储有计算机程序,该处理器被设置为运行计算机程序以执行上述任一项方法实施例中的步骤。An embodiment of the present disclosure also provides an electronic device, including a memory and a processor, the memory stores a computer program, and the processor is configured to run the computer program to execute the steps in any of the foregoing method embodiments.
可选地,上述电子装置还可以包括传输设备以及输入输出设备,其中,该传输设备和上述处理器连接,该输入输出设备和上述处理器连接。Optionally, the aforementioned electronic device may further include a transmission device and an input-output device, wherein the transmission device is connected to the aforementioned processor, and the input-output device is connected to the aforementioned processor.
可选地,在本实施例中,上述处理器可以被设置为通过计算机程序执行以下步骤:源通道接收数据之后,将所述数据发送至多个指定处理通道中的一个或多个处理通道进行数据处理,其中,所述多个指定处理通道为所述源通道所共享的处理通道,所述源通道所共享的所述指定处理通道的数量小于所述源通道的数量。Optionally, in this embodiment, the above-mentioned processor may be configured to execute the following steps through a computer program: after the source channel receives the data, it sends the data to one or more of the multiple designated processing channels for data processing. Processing, wherein the plurality of designated processing channels are processing channels shared by the source channel, and the number of the designated processing channels shared by the source channel is less than the number of the source channels.
通过上述步骤,由于源通道接收数据之后,将该数据发送至多个指定处理通道中的一个或多个处理通道进行数据处理,其中,该多个指定处理通道为该源通道所共享的处理通道,该源通道所共享的该指定处理通道的数量小于该源通道的数量,通过为源通道配置共享的处理通道,因此可以解决相关技术中由于通道数量增加所导致的资源耗费提高的问题,达到在芯片处理性能需求不断提高的情况下,能够有效减少资源耗费的效果。Through the above steps, after the source channel receives the data, the data is sent to one or more of the multiple designated processing channels for data processing, where the multiple designated processing channels are processing channels shared by the source channel, The number of designated processing channels shared by the source channel is less than the number of source channels. By configuring shared processing channels for the source channels, the problem of increased resource consumption caused by the increase in the number of channels in the related technology can be solved, and the problem of increased resource consumption can be achieved in the related art. With the continuous improvement of chip processing performance requirements, the effect of resource consumption can be effectively reduced.
可选地,本实施例中的示例可以参考上述实施例及可选实施方式中所描述的示例,本实施例在此不再赘述。Optionally, for the examples in this embodiment, reference may be made to the examples described in the above-mentioned embodiments and alternative implementations, and this embodiment will not be repeated here.
本领域的技术人员应该明白,上述的本公开的多个模块或多个步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,可选地,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成多个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本公开不限制于任何特定的硬件和软件结合。Those skilled in the art should understand that the above-mentioned multiple modules or multiple steps of the present disclosure can be implemented by a general computing device, and they can be concentrated on a single computing device or distributed in a network composed of multiple computing devices. Above, alternatively, they can be implemented with program codes executable by a computing device, so that they can be stored in a storage device for execution by the computing device, and in some cases, they can be executed in a different order than here. Perform the steps shown or described, or fabricate them into multiple integrated circuit modules separately, or fabricate multiple modules or steps of them into a single integrated circuit module for implementation. In this way, the present disclosure is not limited to any specific combination of hardware and software.

Claims (12)

  1. 一种数据处理方法,包括:A data processing method, including:
    源通道接收数据之后,将所述数据发送至多个指定处理通道中的至少一个处理通道进行数据处理,其中,所述多个指定处理通道为所述源通道所共享的处理通道,所述源通道所共享的所述指定处理通道的数量小于所述源通道的数量。After the source channel receives the data, it sends the data to at least one of the multiple designated processing channels for data processing, where the multiple designated processing channels are processing channels shared by the source channel, and the source channel The number of shared designated processing channels is less than the number of source channels.
  2. 根据权利要求1所述的方法,其中,所述将所述数据发送至多个指定处理通道中的至少一个处理通道进行处理,包括:The method according to claim 1, wherein the sending the data to at least one of a plurality of designated processing channels for processing comprises:
    获取所述多个指定处理通道的数据处理状态;Acquiring the data processing status of the multiple designated processing channels;
    在根据所述多个指定处理通道的数据处理状态确定所述多个处理通道无法满足所述数据的数据处理需求的情况下,缓存所述数据;或者,If it is determined based on the data processing status of the multiple designated processing channels that the multiple processing channels cannot meet the data processing requirements of the data, cache the data; or,
    在根据所述多个指定处理通道的数据处理状态确定所述多个处理通道无法满足所述数据的数据处理需求的情况下,按照第一预设规则将所述数据中的部分数据发送至所述多个指定处理通道中的至少一个处理通道进行数据处理,并缓存所述数据中未处理的数据;或者,When it is determined according to the data processing status of the multiple designated processing channels that the multiple processing channels cannot meet the data processing requirements of the data, a part of the data in the data is sent to the all data according to the first preset rule. At least one of the multiple designated processing channels performs data processing, and caches unprocessed data in the data; or,
    在根据所述多个指定处理通道的数据处理状态确定所述多个指定处理通道满足所述数据的数据处理需求的情况下,按照第二预设规则将所述数据分配至所述多个指定处理通道中的至少一个处理通道进行数据处理。In the case where it is determined that the plurality of designated processing channels meet the data processing requirements of the data according to the data processing status of the plurality of designated processing channels, the data is allocated to the plurality of designated processing channels according to a second preset rule At least one of the processing channels performs data processing.
  3. 根据权利要求2所述的方法,其中,所述将所述数据发送至多个指定处理通道中的至少一个处理通道进行处理,还包括:The method according to claim 2, wherein the sending the data to at least one processing channel among a plurality of designated processing channels for processing further comprises:
    在缓存所述数据之后,或者,在缓存所述数据中的所述未处理的数据之后,对所述多个指定处理通道的数据处理状态进行监测,并在监测到所述多个指定处理通道中存在所述数据处理状态为空闲状态的处理通道时,按照第三预设规则将缓存的数据分配至所述空闲状态的处理通道进行数据处理。After the data is cached, or after the unprocessed data in the data is cached, the data processing state of the multiple designated processing channels is monitored, and when the multiple designated processing channels are monitored When there is a processing channel in the idle state in the data processing state, the buffered data is allocated to the processing channel in the idle state for data processing according to a third preset rule.
  4. 根据权利要求3所述的方法,其中,所述按照所述第三预设规则将缓存的数据分配至所述空闲状态的处理通道进行数据处理,包括:The method according to claim 3, wherein the allocating the buffered data to the processing channel in the idle state for data processing according to the third preset rule comprises:
    在根据所述多个指定处理通道的数据处理状态确定所述空闲状态的处理通道无法满足所述缓存的数据的数据处理需求的情况下,再次缓存所述缓存的数据;或者,将所述缓存的数据中的部分数据发送至所述空闲状态的处理通道,并再次缓存所述缓存的数据中未处理的数据。If it is determined according to the data processing status of the multiple designated processing channels that the processing channel in the idle state cannot meet the data processing requirements of the cached data, the cached data is cached again; or, the cached data is cached again; Part of the data in the data is sent to the processing channel in the idle state, and the unprocessed data in the buffered data is cached again.
  5. 根据权利要求2所述的方法,其中,通过如下之一的方式确定所述多个指定处理通道无法满足所述数据的数据处理需求:The method according to claim 2, wherein it is determined by one of the following methods that the multiple designated processing channels cannot meet the data processing requirements of the data:
    确定所述多个指定处理通道的所述数据处理状态均为非空闲态;Determining that the data processing states of the multiple designated processing channels are all non-idle states;
    确定所述多个指定处理通道中处于非空闲态的通道数目小于所述数据的数目。It is determined that the number of channels in the non-idle state among the plurality of designated processing channels is less than the number of data.
  6. 根据权利要求2所述的方法,其中,所述按照所述第一预设规则将所述数据中的部分数据发送至所述多个指定处理通道中的至少一个处理通道进行数据处理,包括:The method according to claim 2, wherein the sending part of the data in the data to at least one of the plurality of designated processing channels for data processing according to the first preset rule comprises:
    按照所述数据的优先级将所述数据中的部分数据发送至所述多个指定处理通道中的至少一个处理通道进行数据处理。According to the priority of the data, part of the data in the data is sent to at least one processing channel of the plurality of designated processing channels for data processing.
  7. 根据权利要求6所述的方法,其中,所述按照所述数据的优先级将所述数据中的部分数据发送至所述多个指定处理通道中的至少一个处理通道进行数据处理,包括:获取所述数据中携带的标识信息,其中,所述标识信息用于指示处理所述数据的优先级;根据所述标识信息对所述数据进行优先级排序,并按照优先级由高至低的顺序将所述数据中的部分数据分别分配至所述至少一个处理通道中进行数据处理;或者,The method according to claim 6, wherein the sending part of the data in the data to at least one of the plurality of designated processing channels for data processing according to the priority of the data comprises: obtaining The identification information carried in the data, wherein the identification information is used to indicate the priority of processing the data; the data is prioritized according to the identification information, and the priority is ordered from high to low Part of the data in the data are respectively allocated to the at least one processing channel for data processing; or,
    所述按照所述数据的优先级将所述数据中的部分数据发送至所述多个指定处理通道中的至少一个处理通道进行数据处理,包括:通过所述数据的属性信息对所述数据进行优先级排序,并按照优先级由高至低的顺序将所述数据中的部分数据分别分配至所述至少一个处理通道中进行数据处理,其中,所述数据的属性信息至少包括以下之一:所述数据的类型信息,所述数据的大小信息。The sending part of the data in the data to at least one of the plurality of designated processing channels for data processing according to the priority of the data includes: performing data processing on the data through attribute information of the data Prioritize, and allocate part of the data in the data to the at least one processing channel for data processing in the order of priority from high to low, wherein the attribute information of the data includes at least one of the following: The type information of the data, and the size information of the data.
  8. 根据权利要求6或7所述的方法,还包括:The method according to claim 6 or 7, further comprising:
    在判断缓存的数据中的指定数据的缓存时间大于预先配置的驻留时间的情况下,提高所述指定数据的优先级。In the case of determining that the cache time of the designated data in the cached data is greater than the pre-configured residence time, the priority of the designated data is increased.
  9. 根据权利要求1所述的方法,,在所述将所述数据发送至多个指定处理通道中的至少一个处理通道进行数据处理之后,还包括:The method according to claim 1, after the sending the data to at least one of a plurality of designated processing channels for data processing, further comprising:
    将数据处理之后的所述数据映射到下游的传输通道。Map the data after data processing to the downstream transmission channel.
  10. 一种数据处理装置,包括:A data processing device includes:
    发送模块,设置为在源通道接收数据之后,将所述数据发送至多个指定处理通道中的至少一个处理通道进行数据处理,其中,所述多个指定处理通道为所述源通道所共享的处理通道,所述源通道所共享的所述指定处理通道的数量小于所述源通道的数量。The sending module is configured to send the data to at least one of the multiple designated processing channels for data processing after the source channel receives the data, wherein the multiple designated processing channels are processing shared by the source channel Channels, the number of the designated processing channels shared by the source channels is less than the number of the source channels.
  11. 一种存储介质,存储有计算机程序,其中,所述计算机程序被设置为运行时执行所述权利要求1至9任一项中所述的方法。A storage medium storing a computer program, wherein the computer program is configured to execute the method described in any one of claims 1 to 9 when the computer program is run.
  12. 一种电子装置,包括存储器和处理器,所述存储器中存储有计算机程序, 所述处理器被设置为运行所述计算机程序以执行所述权利要求1至9任一项中所述的方法。An electronic device comprising a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the method described in any one of claims 1 to 9.
PCT/CN2020/132164 2019-12-30 2020-11-27 Data processing method and apparatus, storage medium, and electronic apparatus WO2021135763A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911399584.3 2019-12-30
CN201911399584.3A CN113126882A (en) 2019-12-30 2019-12-30 Data processing method and device, storage medium and electronic device

Publications (1)

Publication Number Publication Date
WO2021135763A1 true WO2021135763A1 (en) 2021-07-08

Family

ID=76686897

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/132164 WO2021135763A1 (en) 2019-12-30 2020-11-27 Data processing method and apparatus, storage medium, and electronic apparatus

Country Status (2)

Country Link
CN (1) CN113126882A (en)
WO (1) WO2021135763A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102375790A (en) * 2010-08-12 2012-03-14 杭州华三通信技术有限公司 Shared bus transmission system and method
CN102385555A (en) * 2010-08-27 2012-03-21 深圳市朗科科技股份有限公司 Caching system and method of data caching
CN103064807A (en) * 2012-12-17 2013-04-24 福建星网锐捷网络有限公司 Multi-channel direct memory access controller
CN106559698A (en) * 2015-09-28 2017-04-05 深圳市中兴微电子技术有限公司 A kind of data processing method and device
US20180314238A1 (en) * 2017-04-28 2018-11-01 Yokogawa Electric Corporation Data processing apparatus, data processing system, data processing method, and program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102375790A (en) * 2010-08-12 2012-03-14 杭州华三通信技术有限公司 Shared bus transmission system and method
CN102385555A (en) * 2010-08-27 2012-03-21 深圳市朗科科技股份有限公司 Caching system and method of data caching
CN103064807A (en) * 2012-12-17 2013-04-24 福建星网锐捷网络有限公司 Multi-channel direct memory access controller
CN106559698A (en) * 2015-09-28 2017-04-05 深圳市中兴微电子技术有限公司 A kind of data processing method and device
US20180314238A1 (en) * 2017-04-28 2018-11-01 Yokogawa Electric Corporation Data processing apparatus, data processing system, data processing method, and program

Also Published As

Publication number Publication date
CN113126882A (en) 2021-07-16

Similar Documents

Publication Publication Date Title
US8478926B1 (en) Co-processing acceleration method, apparatus, and system
US8155134B2 (en) System-on-chip communication manager
CN107241281B (en) Data processing method and device
CN113485822A (en) Memory management method, system, client, server and storage medium
CN111221638B (en) Concurrent task scheduling processing method, device, equipment and medium
WO2021109767A1 (en) Network device and method for reducing transmission delay therefor
EP1346549B1 (en) Intercommunication preprocessor
CN111597040B (en) Resource allocation method, device, storage medium and electronic equipment
US20160210171A1 (en) Scheduling in job execution
CN112214319A (en) Task scheduling method for sensing computing resources
CN113010297A (en) Database write scheduler based on message queue, write method and storage medium
CN116414534A (en) Task scheduling method, device, integrated circuit, network equipment and storage medium
WO2021164560A1 (en) Multi-core chip and scheduling method therefor
CN103823712A (en) Data flow processing method and device for multi-CPU virtual machine system
WO2021135763A1 (en) Data processing method and apparatus, storage medium, and electronic apparatus
CN116089049B (en) Asynchronous parallel I/O request-based process synchronous scheduling method, device and equipment
CN112214299A (en) Multi-core processor and task scheduling method and device thereof
US20150003250A1 (en) Credit-Based Resource Allocator Circuit
CN109412973B (en) Audio processing method and device and storage medium
CN115878309A (en) Resource allocation method, device, processing core, equipment and computer readable medium
CN110163155B (en) Face data processing method and device, electronic equipment and readable storage medium
WO2017070869A1 (en) Memory configuration method, apparatus and system
CN113703976B (en) FPGA resource allocation method, device, equipment and readable storage medium
CN111865741B (en) Data transmission method and data transmission system
US11240178B2 (en) Data transmission method and data transmission system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20909578

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20909578

Country of ref document: EP

Kind code of ref document: A1