WO2023000831A1 - Structured information extraction method and apparatus, and device, and storage medium - Google Patents

Structured information extraction method and apparatus, and device, and storage medium Download PDF

Info

Publication number
WO2023000831A1
WO2023000831A1 PCT/CN2022/096180 CN2022096180W WO2023000831A1 WO 2023000831 A1 WO2023000831 A1 WO 2023000831A1 CN 2022096180 W CN2022096180 W CN 2022096180W WO 2023000831 A1 WO2023000831 A1 WO 2023000831A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
target
competition
player
structured
Prior art date
Application number
PCT/CN2022/096180
Other languages
French (fr)
Chinese (zh)
Inventor
唐鑫
叶芷
王冠皓
Original Assignee
北京百度网讯科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京百度网讯科技有限公司 filed Critical 北京百度网讯科技有限公司
Publication of WO2023000831A1 publication Critical patent/WO2023000831A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7844Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using original textual content or text extracted from visual content or transcript of audio data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/258Data format conversion from or to a database

Abstract

The present disclosure provides a structured information extraction method and apparatus, a device, a storage medium, and a program product, and relates to the field of artificial intelligence, more particularly to the fields of computer vision and deep learning. A specific implementation comprises: extracting a target sporting event video frame from a sporting event video; performing target detection on the target sporting event video frame to obtain designated target information in the sporting event; and aggregating the designated target information to obtain sporting event structured information. The present disclosure can efficiently extract key information from a sporting event video, form structured data, provide high quality material for sporting event highlights, and aid in completing rapid content creation for sporting events.

Description

结构化信息抽取方法、装置、设备以及存储介质Structured information extraction method, device, equipment and storage medium
本专利申请要求于2021年7月23日提交的、申请号为202110838170.7、发明名称为“结构化信息抽取方法、装置、设备以及存储介质”的中国专利申请的优先权,该申请的全文以引用的方式并入本申请中。This patent application claims the priority of the Chinese patent application filed on July 23, 2021 with the application number 202110838170.7 and the title of the invention is "Structural Information Extraction Method, Device, Equipment and Storage Medium", the full text of which is cited incorporated into this application.
技术领域technical field
本公开涉及人工智能领域,尤其涉及计算机视觉和深度学习领域,具体涉及结构化信息抽取方法、装置、设备以及存储介质。The present disclosure relates to the field of artificial intelligence, in particular to the fields of computer vision and deep learning, and specifically relates to a structured information extraction method, device, device, and storage medium.
背景技术Background technique
随着短视频热潮的兴起,激发了人们对于短而精的视频内容的强烈需求。对于体育比赛视频,相对于完整而冗长的原始体育比赛视频内容,更多人选择通过观看视频集锦完成对视频内容的信息接收。以乒乓球比赛为例,具有回合制、过程重复、运动过程和转播场景规范且具有明显规律,特别适合对其中的回合进行抽取,得到比赛过程的结构化信息,为比赛集锦提供高质量的素材,完成体育赛事的快速内容创作。With the rise of the short video craze, people have a strong demand for short and refined video content. For sports game videos, more people choose to complete the information reception of video content by watching video highlights, compared to the complete and lengthy original sports game video content. Taking the table tennis game as an example, it has a round system, process repetition, sports process and broadcast scene specification and has obvious rules, which is especially suitable for extracting rounds, obtaining structured information of the game process, and providing high-quality materials for game highlights , to complete the rapid content creation of sports events.
目前,乒乓球精彩集锦主要是人工编辑制作,乒乓球赛事的编辑们根据个人经验,标记回合开打和结束时间点,抽取视频片段。At present, table tennis highlights are mainly produced by manual editing. The editors of table tennis events mark the start and end time points of the round and extract video clips based on personal experience.
发明内容Contents of the invention
本公开提供了一种结构化信息抽取方法、装置、设备、存储介质以及程序产品。The disclosure provides a structured information extraction method, device, equipment, storage medium and program product.
根据本公开的第一方面,提供了一种结构化信息抽取方法,包括:从体育赛事视频中抽取目标体育赛事视频帧;对目标体育赛事视频帧进行目标检测,得到体育赛事中的指定目标信息;对指定目标信息进行聚合,得到体育赛事结构化信息。According to the first aspect of the present disclosure, a method for extracting structured information is provided, including: extracting a target sports event video frame from a sports event video; performing target detection on the target sports event video frame to obtain specified target information in the sports event ; Aggregate the specified target information to obtain the structured information of sports events.
根据本公开的第二方面,提供了一种结构化信息抽取装置,包括:抽取模块,被配置成从体育赛事视频中抽取目标体育赛事视频帧;检测模块,被配置成对目标体育赛事视频帧进行目标检测,得到体育赛事中的指定目标信息;聚合模块,被配置成对指定目标信息进行聚合,得到体育赛事结构化信息。According to a second aspect of the present disclosure, a device for extracting structured information is provided, including: an extraction module configured to extract a target sports event video frame from a sports event video; a detection module configured to extract the target sports event video frame Target detection is performed to obtain specified target information in sports events; the aggregation module is configured to aggregate the specified target information to obtain structured information of sports events.
根据本公开的第三方面,提供了一种电子设备,包括:至少一个处理器;以 及与至少一个处理器通信连接的存储器;其中,存储器存储有可被至少一个处理器执行的指令,指令被至少一个处理器执行,以使至少一个处理器能够执行如第一方面中任一实现方式描述的方法。According to a third aspect of the present disclosure, an electronic device is provided, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by Executed by at least one processor, so that at least one processor can execute the method described in any implementation manner of the first aspect.
根据本公开的第四方面,提供了一种存储有计算机指令的非瞬时计算机可读存储介质,其中,计算机指令用于使计算机执行如第一方面中任一实现方式描述的方法。According to a fourth aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute the method described in any implementation manner of the first aspect.
根据本公开的第五方面,提供了一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现如第一方面中任一实现方式描述的方法。According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the method described in any implementation manner of the first aspect is implemented.
应当理解,本部分所描述的内容并非旨在标识本公开的实施例的关键或重要特征,也不用于限制本公开的范围。本公开的其它特征将通过以下的说明书而变得容易理解。It should be understood that what is described in this section is not intended to identify key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will be readily understood through the following description.
附图说明Description of drawings
附图用于更好地理解本方案,不构成对本公开的限定。其中:The accompanying drawings are used to better understand the present solution, and do not constitute a limitation to the present disclosure. in:
图1是根据本公开的结构化信息抽取方法的一个实施例的流程图;FIG. 1 is a flowchart of an embodiment of a method for extracting structured information according to the present disclosure;
图2是根据本公开的结构化信息抽取方法的又一个实施例的流程图;Fig. 2 is a flow chart of another embodiment of the method for extracting structured information according to the present disclosure;
图3是目标检测模型的结构示意图;Fig. 3 is a schematic structural diagram of a target detection model;
图4是可以实现本公开实施例的结构化信息抽取方法的场景图;FIG. 4 is a scene diagram of a structured information extraction method that can implement an embodiment of the present disclosure;
图5是根据本公开的结构化信息抽取装置的一个实施例的结构示意图;Fig. 5 is a schematic structural diagram of an embodiment of a device for extracting structured information according to the present disclosure;
图6是用来实现本公开实施例的结构化信息抽取方法的电子设备的框图。Fig. 6 is a block diagram of an electronic device for implementing the structured information extraction method of the embodiment of the present disclosure.
具体实施方式detailed description
以下结合附图对本公开的示范性实施例做出说明,其中包括本公开实施例的各种细节以助于理解,应当将它们认为仅仅是示范性的。因此,本领域普通技术人员应当认识到,可以对这里描述的实施例做出各种改变和修改,而不会背离本公开的范围和精神。同样,为了清楚和简明,以下的描述中省略了对公知功能和结构的描述。Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
需要说明的是,在不冲突的情况下,本公开中的实施例及实施例中的特征可以相互组合。下面将参考附图并结合实施例来详细说明本公开。It should be noted that, in the case of no conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other. The present disclosure will be described in detail below with reference to the accompanying drawings and embodiments.
图1示出了根据本公开的结构化信息抽取方法的一个实施例的流程100。该结构化信息抽取方法包括以下步骤:Fig. 1 shows a flow 100 of an embodiment of a method for extracting structured information according to the present disclosure. The structured information extraction method includes the following steps:
步骤101,从体育赛事视频中抽取目标体育赛事视频帧。 Step 101, extracting target sports event video frames from the sports event video.
在本实施例中,结构化信息抽取方法的执行主体可以从体育赛事视频中抽取目标体育赛事视频帧。In this embodiment, the executing body of the method for extracting structured information may extract target sports event video frames from the sports event video.
其中,体育赛事一般指比较有规模有级别的正规比赛,因此,体育赛事视频一般比较规范且具有明显规律。例如乒乓球赛事,具有回合制、过程重复、动作过程和转播场景规范且具有明显规律。考虑到每个回合的时间和计算效率,可以从体育赛事视频中抽取部分体育赛事视频帧,作为目标体育赛事视频帧。例如,采用对体育比赛赛事视频每秒抽一帧,得到目标体育赛事视频帧。Among them, sports events generally refer to regular competitions with a relatively large scale and level. Therefore, sports event videos are generally relatively standardized and have obvious rules. For example, a table tennis event has a round system, process repetition, action process and broadcast scene specification and has obvious rules. Considering the time and calculation efficiency of each round, some sports event video frames can be extracted from the sports event video as the target sports event video frame. For example, the video frame of the target sports event is obtained by extracting one frame per second from the video of the sports event.
步骤102,对目标体育赛事视频帧进行目标检测,得到体育赛事中的指定目标信息。 Step 102, performing target detection on the video frame of the target sporting event to obtain specified target information in the sporting event.
在本实施例中,上述执行主体可以对目标体育赛事视频帧进行目标检测,得到体育赛事中的指定目标信息。In this embodiment, the execution subject may perform target detection on the video frame of the target sporting event to obtain specified target information in the sporting event.
其中,体育赛事中的指定目标可以是出现在体育赛事视频中的指定目标。以乒乓球赛事为例,其体育赛事中的指定目标可以包括但不限于:乒乓球台、记分牌、运动员、国旗等等。体育赛事中的指定目标信息可以是体育赛事视频的关键信息,包括但不限于比赛场地信息、记分牌信息、运动员身份信息、中场统计信息和国旗信息等等任意中的一个或多个。Wherein, the specified target in the sports event may be a specified target appearing in the video of the sports event. Taking a table tennis event as an example, the designated targets in the sports event may include but not limited to: table tennis table, scoreboard, athletes, national flag, and so on. The designated target information in the sports event may be the key information of the sports event video, including but not limited to any one or more of field information, scoreboard information, player identity information, midfield statistical information, national flag information, and the like.
步骤103,对指定目标信息进行聚合,得到体育赛事结构化信息。 Step 103, aggregate the designated target information to obtain structured information about sports events.
在本实施例中,上述执行主体可以对指定目标信息进行聚合,得到体育赛事结构化信息。In this embodiment, the above-mentioned executive body may aggregate the designated target information to obtain structured information about sports events.
其中,体育赛事结构化信息是指体育赛事中的指定目标信息经过分析后可分解成多个互相关联的组成部分,各组成部分间有明确的层次结构。通常,体育赛事中的至少一种指定目标信息可以聚合成一种体育赛事结构化信息。例如,体育赛事中的一种指定目标信息可以聚合成一种体育赛事结构化信息。又例如,体育赛事中的多种指定目标信息也可以聚合成一种体育赛事结构化信息。Among them, the structured information of sports events means that the specified target information in sports events can be decomposed into multiple interrelated components after analysis, and each component has a clear hierarchical structure. Usually, at least one type of specified target information in the sports event can be aggregated into one type of structured information about the sports event. For example, a kind of designated target information in sports events can be aggregated into a kind of structured information of sports events. For another example, multiple types of specified target information in sports events may also be aggregated into a type of structured information on sports events.
本公开可以高效地提取出体育赛事视频中的关键信息,形成结构化数据,为体育赛事锦集提供高质量的素材,有助于完成体育赛事的快速内容创作。The disclosure can efficiently extract key information in sports event videos, form structured data, provide high-quality materials for sports event collections, and help complete rapid content creation of sports events.
继续参考图2,其示出了根据本公开的结构化信息抽取方法的又一个实施例的流程200。该结构化信息抽取方法包括以下步骤:Continue to refer to FIG. 2 , which shows a flow 200 of another embodiment of the method for extracting structured information according to the present disclosure. The structured information extraction method includes the following steps:
步骤201,从体育赛事视频中抽取目标体育赛事视频帧。 Step 201, extract target sports event video frames from the sports event video.
在本实施例中,步骤201具体操作已在图1所示的实施例中步骤101进行了详细的介绍,在此不再赘述。In this embodiment, the specific operation of step 201 has been introduced in detail in step 101 in the embodiment shown in FIG. 1 , and will not be repeated here.
步骤202,将目标体育赛事视频帧输入至预先训练的目标检测模型,得到体育赛事中的指定目标信息。Step 202: Input the video frame of the target sports event into the pre-trained target detection model to obtain the specified target information in the sports event.
在本实施例中,结构化信息抽取方法的执行主体可以将目标体育赛事视频帧输入至预先训练的目标检测模型,得到体育赛事中的指定目标信息。In this embodiment, the executive body of the structured information extraction method may input the target sports event video frame into the pre-trained target detection model to obtain the specified target information in the sports event.
其中,目标检测模型可以用于检测体育赛事中的指定目标信息。体育赛事中的指定目标信息可以包括体育赛事中的指定目标的类别和/或指定目标的位置。目标检测模型可以是深度学习模型,对体育赛事视频中的有效信息进行检测。通常,目标检测模型可以包括多个串联的类别-位置子网(class+box subnets),类别-位置子网可以包括类别子网分支(class subnet)和位置子网分支(box subnet),类别子网分支可以用于检测体育赛事中的指定目标的类别,位置子网分支可以用于检测体育赛事中的指定目标的位置。Among them, the target detection model can be used to detect specified target information in sports events. The designated goal information in the sporting event may include the category of the designated goal in the sporting event and/or the location of the designated goal. The target detection model can be a deep learning model to detect effective information in sports event videos. Usually, a target detection model can include multiple concatenated class-position subnets (class+box subnets), a class-position subnet can include a class subnet branch (class subnet) and a position subnet branch (box subnet), and a class subnet The net branch can be used to detect the category of the specified target in the sporting event, and the location subnet branch can be used to detect the location of the specified target in the sporting event.
为了便于理解图3示出了目标检测模型的结构示意图。如图3所示,目标检测模型包括3个串联的class+box subnets。每个class+box subnets包括一个class subnet和一个box subnet。class subnet可以将输入处理成特征图,最后输出体育赛事中的指定目标的类别。box subnet可以将输出处理成特征图,最后输出体育赛事中的指定目标的位置。其中,W是宽度,H是高度,K是类别数,4是位置坐标的维度。For ease of understanding, FIG. 3 shows a schematic structural diagram of a target detection model. As shown in Figure 3, the object detection model consists of 3 class+box subnets connected in series. Each class+box subnets includes a class subnet and a box subnet. The class subnet can process the input into a feature map, and finally output the category of the specified target in the sports event. The box subnet can process the output into a feature map, and finally output the position of the specified target in the sports event. where W is the width, H is the height, K is the number of categories, and 4 is the dimension of the position coordinates.
步骤203,对指定目标信息按照时间信息进行聚类,得到体育赛事中指定目标信息对应的信息时间序列。 Step 203, clustering the designated target information according to time information to obtain information time series corresponding to the designated target information in sports events.
在本实施例中,上述执行主体可以对指定目标信息按照时间信息进行聚类,得到体育赛事中指定目标信息对应的信息时间序列。其中,每种指定目标信息分别进行时间聚类,得到每种指定目标的信息时间序列。In this embodiment, the execution subject may cluster the designated target information according to time information to obtain information time series corresponding to the designated target information in sports events. Wherein, time clustering is performed on each designated target information respectively, and the information time series of each designated target is obtained.
步骤204,基于信息时间序列,得到体育赛事结构化信息。 Step 204, based on the information time series, obtain the structured information of sports events.
在本实施例中,上述执行主体可以基于信息时间序列,得到体育赛事结构化信息。In this embodiment, the execution subject may obtain the structured information of the sports event based on the information time series.
在指定目标信息包括比赛场地信息、记分牌信息、运动员身份信息、中场统计信息和国旗信息的情况下,具体如下:Where the designated target information includes field information, scoreboard information, player identity information, midfield statistics, and national flag information, the details are as follows:
1、基于国旗信息对应的信息时间序列和运动员身份信息对应的信息时间序列,获取比赛运动员信息。1. Based on the information time series corresponding to the national flag information and the information time series corresponding to the athlete's identity information, obtain the information of the athletes in the competition.
此外,预设知识图谱可以用于存储大量运动员的预存信息。若比赛运动员信息存 在于预设知识图谱中,则在预设知识图谱中获取比赛运动员信息对应的运动员的其他预存信息,用于对比赛运动员信息进行扩充。In addition, the preset knowledge graph can be used to store a large number of athletes' pre-stored information. If the competition athlete information exists in the preset knowledge graph, other pre-stored information of the athletes corresponding to the competition athlete information is obtained in the preset knowledge graph, so as to expand the competition athlete information.
2、基于中场统计信息对应的信息时间序列,获得比赛局分信息。2. Obtain game score information based on the information time series corresponding to the midfield statistical information.
3、利用图像差分算法,对记分牌信息对应的信息时间序列进行处理,获得比赛比分信息。3. Use the image difference algorithm to process the information time series corresponding to the scoreboard information to obtain the game score information.
4、基于比赛场地信息对应的信息时间序列,获得初步比赛对打片段,并利用比赛局分信息和记分牌信息对初步比赛对打片段进行过滤,得到比赛对打回合时间信息。4. Based on the information time series corresponding to the information of the competition venue, the preliminary match fragments are obtained, and the preliminary match fragments are filtered using the match score information and the scoreboard information to obtain the match round time information.
通常,利用比赛局分信息可以过滤非比赛过程中的对打片段,如赛前热身、赛后回顾等。利用记分牌信息可以过滤比赛过程中的非对打回合,如重新发球、精彩球回放等。Usually, using game score information can filter non-game sparring clips, such as pre-match warm-up, post-match review, and so on. The scoreboard information can be used to filter non-fighting rounds during the game, such as re-serve, highlight ball playback, etc.
最后,基于比赛运动员信息、比赛局分信息、比赛比分信息和比赛对打回合时间信息,即可获取体育赛事结构化信息。此外,在基于预设知识图谱对比赛运动员信息进行扩充的情况下,基于比赛运动员信息、其他预存信息、比赛局分信息、比赛比分信息和比赛对打回合时间信息,获取体育赛事结构化信息。Finally, the structured information of sports events can be obtained based on the player information, game score information, game score information, and match sparring round time information. In addition, in the case of expanding the player information based on the preset knowledge graph, based on the player information, other pre-stored information, game score information, game score information, and game sparring round time information, the structured information of sports events is obtained.
从图2中可以看出,与图1对应的实施例相比,本实施例中的结构化信息抽取方法突出了检测步骤和聚合步骤。由此,本实施例描述的方案利用目标检测模型,能够对体育赛事视频中的有效信息进行检测。先对体育赛事中的指定目标信息进行时间聚类,再对聚类结果进行整合,使得体育赛事结构化信息更加全面。It can be seen from FIG. 2 that, compared with the embodiment corresponding to FIG. 1 , the structured information extraction method in this embodiment highlights the detection step and the aggregation step. Therefore, the solution described in this embodiment can detect effective information in the sports event video by using the target detection model. Time clustering is first performed on the specified target information in sports events, and then the clustering results are integrated to make the structured information of sports events more comprehensive.
进一步参考图4,其示出了可以实现本公开实施例的结构化信息抽取方法的场景图。如图4所示,结构化信息抽取方法包括:数据准备、比赛关键信息检测和比赛关键信息聚合策略等步骤,具体内容如下:Further referring to FIG. 4 , it shows a scene diagram that can implement the structured information extraction method of the embodiment of the present disclosure. As shown in Figure 4, the structured information extraction method includes steps such as data preparation, game key information detection, and game key information aggregation strategy. The specific content is as follows:
1、数据准备:从乒乓球赛事视频中抽取视频帧,得到视频序列。1. Data preparation: Extract video frames from the table tennis video to obtain a video sequence.
2、比赛关键信息检测:将视频序列输入至目标检测模型,得到乒乓球比赛关键信息。2. Detection of key information of the game: Input the video sequence into the target detection model to obtain the key information of the table tennis game.
3、比赛关键信息聚合策略:首先,对乒乓球比赛关键信息进行时间聚合,得到国旗信息、运动员名信息、中场统计信息、记分牌信息和比赛场地信息。然后,基于国旗信息和运动员名信息可以生成运动员信息,并基于KG(Knowledge Graph,知识图谱)进行填充;中场统计信息可以生成局分信息;记分牌信息利用图像差分获得比分变化可以生成比分信息;比赛场地信息可以生成初步对打回合信息,以及利用局分信息和记分牌信息对初步对打回合信息进行过滤,得到回合时间信息。最后,基 于运动员信息、局分信息、比分信息和回合时间信息,即可得到乒乓球比赛的结构化信息。3. Aggregation strategy for key information of the game: firstly, time-aggregate the key information of the table tennis game to obtain national flag information, athlete name information, midfield statistical information, scoreboard information and competition venue information. Then, player information can be generated based on national flag information and player name information, and filled based on KG (Knowledge Graph, knowledge map); midfield statistics can generate game score information; scoreboard information can generate score information by using image difference to obtain score changes ; The competition field information can generate preliminary sparring round information, and use the round score information and scoreboard information to filter the preliminary sparring round information to obtain round time information. Finally, based on player information, game score information, score information and round time information, the structured information of the table tennis game can be obtained.
进一步参考图5,作为对上述各图所示方法的实现,本公开提供了一种结构化信息抽取装置的一个实施例,该装置实施例与图1所示的方法实施例相对应,该装置具体可以应用于各种电子设备中。Further referring to FIG. 5 , as an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a device for extracting structured information. This device embodiment corresponds to the method embodiment shown in FIG. 1 , and the device Specifically, it can be applied to various electronic devices.
如图5所示,本实施例的结构化信息抽取装置500可以包括:抽取模块501、检测模块502和聚合模块503。其中,抽取模块501,被配置成从体育赛事视频中抽取目标体育赛事视频帧;检测模块502,被配置成对目标体育赛事视频帧进行目标检测,得到体育赛事中的指定目标信息;聚合模块503,被配置成对指定目标信息进行聚合,得到体育赛事结构化信息。As shown in FIG. 5 , the structured information extraction apparatus 500 of this embodiment may include: an extraction module 501 , a detection module 502 and an aggregation module 503 . Wherein, the extraction module 501 is configured to extract the target sports event video frame from the sports event video; the detection module 502 is configured to perform target detection on the target sports event video frame to obtain specified target information in the sports event; the aggregation module 503 , configured to aggregate the specified target information to obtain structured information about sports events.
在本实施例中,结构化信息抽取装置500中:抽取模块501、检测模块502和聚合模块503的具体处理及其所带来的技术效果可分别参考图1对应实施例中的步骤101-103的相关说明,在此不再赘述。In this embodiment, in the structured information extraction device 500: the specific processing of the extraction module 501, the detection module 502 and the aggregation module 503 and the technical effects brought about by them can refer to the steps 101-103 in the corresponding embodiment in Fig. 1 respectively Relevant descriptions will not be repeated here.
在本实施例的一些可选的实现方式中,检测模块502进一步被配置成:将目标体育赛事视频帧输入至预先训练的目标检测模型,得到体育赛事中的指定目标信息。In some optional implementations of this embodiment, the detection module 502 is further configured to: input the video frame of the target sports event into a pre-trained target detection model to obtain specified target information in the sports event.
在本实施例的一些可选的实现方式中,体育赛事中的指定目标信息包括体育赛事中指定目标的类别和/或指定目标的位置。In some optional implementation manners of this embodiment, the designated target information in the sports event includes a category of the designated target and/or a position of the designated target in the sports event.
在本实施例的一些可选的实现方式中,目标检测模型包括多个串联的类别-位置子网,类别-位置子网包括类别子网分支和位置子网分支,类别子网分支用于检测体育赛事中指定目标的类别,位置子网分支用于检测体育赛事中指定目标的位置。In some optional implementations of this embodiment, the target detection model includes a plurality of class-position subnets in series, the class-position subnet includes a class subnet branch and a position subnet branch, and the class subnet branch is used to detect The category of the specified object in the sporting event, and the location subnetwork branch is used to detect the location of the specified object in the sporting event.
在本实施例的一些可选的实现方式中,聚合模块503包括:聚类子模块,被配置成对指定目标信息按照时间信息进行聚类,得到体育赛事中指定目标信息对应的信息时间序列;获取子模块,被配置成基于信息时间序列,得到体育赛事结构化信息。In some optional implementations of this embodiment, the aggregation module 503 includes: a clustering submodule configured to cluster the specified target information according to time information to obtain information time series corresponding to the specified target information in sports events; The obtaining sub-module is configured to obtain structured information of sports events based on information time series.
在本实施例的一些可选的实现方式中,指定目标信息包括以下至少一项:比赛场地信息、记分牌信息、运动员身份信息、中场统计信息、国旗信息。In some optional implementation manners of this embodiment, the specified target information includes at least one of the following: playing field information, scoreboard information, athlete identity information, midfield statistical information, and national flag information.
在本实施例的一些可选的实现方式中,在指定目标信息包括比赛场地信息、记分牌信息、运动员身份信息、中场统计信息和国旗信息的情况下,获取子模块包括:第一获取单元,被配置成基于国旗信息对应的信息时间序列和运动员身份信息对应的信息时间序列,获取比赛运动员信息;第二获取单元,被配置成基于中场统计信息对应的信息时间序列,获得比赛局分信息;第三获取单元,被配置成利用图像差分算法, 对记分牌信息对应的信息时间序列进行处理,获得比赛比分信息;第四获取单元,被配置成基于比赛场地信息对应的信息时间序列,获得初步比赛对打片段,并利用比赛局分信息和记分牌信息对初步比赛对打片段进行过滤,得到比赛对打回合时间信息;第五获取单元,被配置成基于比赛运动员信息、比赛局分信息、比赛比分信息和比赛对打回合时间信息,获取体育赛事结构化信息。In some optional implementations of this embodiment, when the designated target information includes information about the playing field, scoreboard information, player identity information, midfield statistical information, and national flag information, the acquisition submodule includes: a first acquisition unit , is configured to obtain player information based on the information time series corresponding to the national flag information and the information time series corresponding to the player identity information; the second acquisition unit is configured to obtain game points based on the information time series corresponding to the midfield statistical information Information; the third acquisition unit is configured to use the image difference algorithm to process the information time series corresponding to the scoreboard information to obtain the game score information; the fourth acquisition unit is configured to be based on the information time series corresponding to the game venue information, Obtain the preliminary game sparring segment, and use the game score information and scoreboard information to filter the preliminary game sparring segment to obtain the game sparring round time information; the fifth acquisition unit is configured to Information, game score information and match round time information, to obtain structured information on sports events.
在本实施例的一些可选的实现方式中,获取子模块还包括:检测单元,被配置成检测比赛运动员信息是否存在于预设知识图谱中;第六获取单元,被配置成若比赛运动员信息存在于预设知识图谱中,则在预设知识图谱中获取比赛运动员信息对应的运动员的其他预存信息;第五获取单元进一步被配置成:基于比赛运动员信息、其他预存信息、比赛局分信息、比赛比分信息和比赛对打回合时间信息,获取体育赛事结构化信息。In some optional implementations of this embodiment, the acquisition submodule further includes: a detection unit configured to detect whether the player information exists in the preset knowledge map; the sixth acquisition unit is configured to if the player information exists in the preset knowledge map, then obtain other pre-stored information of the players corresponding to the player information in the preset knowledge map; the fifth acquisition unit is further configured to: based on the player information, other pre-stored information, game score information, Match score information and match round time information to obtain structured information about sports events.
本公开的技术方案中,所涉及的用户个人信息的获取,存储和应用等,均符合相关法律法规的规定,且不违背公序良俗。In the technical solution of the present disclosure, the acquisition, storage and application of the user's personal information involved are in compliance with relevant laws and regulations, and do not violate public order and good customs.
根据本公开的实施例,本公开还提供了一种电子设备、一种可读存储介质和一种计算机程序产品。According to the embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.
图6示出了可以用来实施本公开的实施例的示例电子设备600的示意性框图。电子设备旨在表示各种形式的数字计算机,诸如,膝上型计算机、台式计算机、工作台、个人数字助理、服务器、刀片式服务器、大型计算机、和其它适合的计算机。电子设备还可以表示各种形式的移动装置,诸如,个人数字处理、蜂窝电话、智能电话、可穿戴设备和其它类似的计算装置。本文所示的部件、它们的连接和关系、以及它们的功能仅仅作为示例,并且不意在限制本文中描述的和/或者要求的本公开的实现。FIG. 6 shows a schematic block diagram of an example electronic device 600 that may be used to implement embodiments of the present disclosure. Electronic device is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.
如图6所示,设备600包括计算单元601,其可以根据存储在只读存储器(ROM)602中的计算机程序或者从存储单元608加载到随机访问存储器(RAM)603中的计算机程序,来执行各种适当的动作和处理。在RAM 603中,还可存储设备600操作所需的各种程序和数据。计算单元601、ROM 602以及RAM 603通过总线604彼此相连。输入/输出(I/O)接口605也连接至总线604。As shown in FIG. 6, the device 600 includes a computing unit 601 that can execute according to a computer program stored in a read-only memory (ROM) 602 or loaded from a storage unit 608 into a random-access memory (RAM) 603. Various appropriate actions and treatments. In the RAM 603, various programs and data necessary for the operation of the device 600 can also be stored. The computing unit 601, ROM 602, and RAM 603 are connected to each other through a bus 604. An input/output (I/O) interface 605 is also connected to the bus 604 .
设备600中的多个部件连接至I/O接口605,包括:输入单元606,例如键盘、鼠标等;输出单元607,例如各种类型的显示器、扬声器等;存储单元608,例如磁盘、光盘等;以及通信单元609,例如网卡、调制解调器、无线通信收发 机等。通信单元609允许设备600通过诸如因特网的计算机网络和/或各种电信网络与其他设备交换信息/数据。Multiple components in the device 600 are connected to the I/O interface 605, including: an input unit 606, such as a keyboard, a mouse, etc.; an output unit 607, such as various types of displays, speakers, etc.; a storage unit 608, such as a magnetic disk, an optical disk, etc. ; and a communication unit 609, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 609 allows the device 600 to exchange information/data with other devices over a computer network such as the Internet and/or various telecommunication networks.
计算单元601可以是各种具有处理和计算能力的通用和/或专用处理组件。计算单元601的一些示例包括但不限于中央处理单元(CPU)、图形处理单元(GPU)、各种专用的人工智能(AI)计算芯片、各种运行机器学习模型算法的计算单元、数字信号处理器(DSP)、以及任何适当的处理器、控制器、微控制器等。计算单元601执行上文所描述的各个方法和处理,例如结构化信息抽取方法。例如,在一些实施例中,结构化信息抽取方法可被实现为计算机软件程序,其被有形地包含于机器可读介质,例如存储单元608。在一些实施例中,计算机程序的部分或者全部可以经由ROM 602和/或通信单元609而被载入和/或安装到设备600上。当计算机程序加载到RAM 603并由计算单元601执行时,可以执行上文描述的结构化信息抽取方法的一个或多个步骤。备选地,在其他实施例中,计算单元601可以通过其他任何适当的方式(例如,借助于固件)而被配置为执行结构化信息抽取方法。The computing unit 601 may be various general-purpose and/or special-purpose processing components having processing and computing capabilities. Some examples of computing units 601 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 601 executes various methods and processes described above, such as the structured information extraction method. For example, in some embodiments, the structured information extraction method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 608 . In some embodiments, part or all of the computer program may be loaded and/or installed on the device 600 via the ROM 602 and/or the communication unit 609. When the computer program is loaded into RAM 603 and executed by computing unit 601, one or more steps of the structured information extraction method described above can be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to execute the structured information extraction method in any other suitable manner (for example, by means of firmware).
本文中以上描述的系统和技术的各种实施方式可以在数字电子电路系统、集成电路系统、场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、芯片上系统的系统(SOC)、负载可编程逻辑设备(CPLD)、计算机硬件、固件、软件、和/或它们的组合中实现。这些各种实施方式可以包括:实施在一个或者多个计算机程序中,该一个或者多个计算机程序可在包括至少一个可编程处理器的可编程系统上执行和/或解释,该可编程处理器可以是专用或者通用可编程处理器,可以从存储系统、至少一个输入装置、和至少一个输出装置接收数据和指令,并且将数据和指令传输至该存储系统、该至少一个输入装置、和该至少一个输出装置。Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips Implemented in a system of systems (SOC), load programmable logic device (CPLD), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpreted on a programmable system including at least one programmable processor, the programmable processor Can be special-purpose or general-purpose programmable processor, can receive data and instruction from storage system, at least one input device, and at least one output device, and transmit data and instruction to this storage system, this at least one input device, and this at least one output device an output device.
用于实施本公开的方法的程序代码可以采用一个或多个编程语言的任何组合来编写。这些程序代码可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器或控制器,使得程序代码当由处理器或控制器执行时使流程图和/或框图中所规定的功能/操作被实施。程序代码可以完全在机器上执行、部分地在机器上执行,作为独立软件包部分地在机器上执行且部分地在远程机器上执行或完全在远程机器或服务器上执行。Program codes for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special purpose computer, or other programmable data processing devices, so that the program codes, when executed by the processor or controller, make the functions/functions specified in the flow diagrams and/or block diagrams Action is implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
在本公开的上下文中,机器可读介质可以是有形的介质,其可以包含或存储 以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备,或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.
为了提供与用户的交互,可以在计算机上实施此处描述的系统和技术,该计算机具有:用于向用户显示信息的显示装置(例如,CRT(阴极射线管)或者LCD(液晶显示器)监视器);以及键盘和指向装置(例如,鼠标或者轨迹球),用户可以通过该键盘和该指向装置来将输入提供给计算机。其它种类的装置还可以用于提供与用户的交互;例如,提供给用户的反馈可以是任何形式的传感反馈(例如,视觉反馈、听觉反馈、或者触觉反馈);并且可以用任何形式(包括声输入、语音输入或者、触觉输入)来接收来自用户的输入。To provide for interaction with the user, the systems and techniques described herein can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user. ); and a keyboard and pointing device (eg, a mouse or a trackball) through which a user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and can be in any form (including Acoustic input, speech input or, tactile input) to receive input from the user.
可以将此处描述的系统和技术实施在包括后台部件的计算系统(例如,作为数据服务器)、或者包括中间件部件的计算系统(例如,应用服务器)、或者包括前端部件的计算系统(例如,具有图形用户界面或者网络浏览器的用户计算机,用户可以通过该图形用户界面或者该网络浏览器来与此处描述的系统和技术的实施方式交互)、或者包括这种后台部件、中间件部件、或者前端部件的任何组合的计算系统中。可以通过任何形式或者介质的数字数据通信(例如,通信网络)来将系统的部件相互连接。通信网络的示例包括:局域网(LAN)、广域网(WAN)和互联网。The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., as a a user computer having a graphical user interface or web browser through which a user can interact with embodiments of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system can be interconnected by any form or medium of digital data communication, eg, a communication network. Examples of communication networks include: Local Area Network (LAN), Wide Area Network (WAN) and the Internet.
计算机系统可以包括客户端和服务器。客户端和服务器一般远离彼此并且通常通过通信网络进行交互。通过在相应的计算机上运行并且彼此具有客户端-服务器关系的计算机程序来产生客户端和服务器的关系。服务器可以是云服务器,也可以为分布式系统的服务器,或者是结合了区块链的服务器。A computer system may include clients and servers. Clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, a server of a distributed system, or a server combined with a blockchain.
应该理解,可以使用上面所示的各种形式的流程,重新排序、增加或删除步骤。例如,本发公开中记载的各步骤可以并行地执行也可以顺序地执行也可以不同的次序执行,只要能够实现本公开公开的技术方案所期望的结果,本文在此不 进行限制。It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, each step described in the present disclosure may be executed in parallel, sequentially, or in a different order, as long as the desired result of the technical solution disclosed in the present disclosure can be achieved, no limitation is imposed herein.
上述具体实施方式,并不构成对本公开保护范围的限制。本领域技术人员应该明白的是,根据设计要求和其他因素,可以进行各种修改、组合、子组合和替代。任何在本公开的精神和原则之内所作的修改、等同替换和改进等,均应包含在本公开保护范围之内。The specific implementation manners described above do not limit the protection scope of the present disclosure. It should be apparent to those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made depending on design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present disclosure shall be included within the protection scope of the present disclosure.

Claims (19)

  1. 一种结构化信息抽取方法,包括:A method for extracting structured information, comprising:
    从体育赛事视频中抽取目标体育赛事视频帧;Extract the target sports event video frame from the sports event video;
    对所述目标体育赛事视频帧进行目标检测,得到体育赛事中的指定目标信息;Carrying out target detection on the video frame of the target sporting event to obtain specified target information in the sporting event;
    对所述指定目标信息进行聚合,得到体育赛事结构化信息。The specified target information is aggregated to obtain structured information about sports events.
  2. 根据权利要求1所述的方法,其中,所述对所述目标体育赛事视频帧进行目标检测,得到体育赛事中的指定目标信息,包括:The method according to claim 1, wherein said performing target detection on said target sports event video frame to obtain specified target information in the sport event, comprising:
    将所述目标体育赛事视频帧输入至预先训练的目标检测模型,得到所述体育赛事中的指定目标信息。The video frame of the target sporting event is input to a pre-trained target detection model to obtain specified target information in the sporting event.
  3. 根据权利要求2所述的方法,其中,所述体育赛事中的指定目标信息包括所述体育赛事中指定目标的类别和/或所述指定目标的位置。The method according to claim 2, wherein the designated target information in the sporting event includes a category of the designated target in the sporting event and/or a position of the designated target.
  4. 根据权利要求3所述的方法,其中,所述目标检测模型包括多个串联的类别-位置子网,所述类别-位置子网包括类别子网分支和位置子网分支,所述类别子网分支用于检测所述体育赛事中指定目标的类别,所述位置子网分支用于检测所述体育赛事中指定目标的位置。The method according to claim 3, wherein the object detection model comprises a plurality of class-position subnetworks connected in series, the class-position subnetwork includes a class subnetwork branch and a position subnetwork branch, and the class subnetwork The branch is used to detect the category of the designated target in the sporting event, and the position subnetwork branch is used to detect the position of the designated target in the sporting event.
  5. 根据权利要求1所述的方法,其中,所述对所述指定目标信息进行聚合,得到体育赛事结构化信息,包括:The method according to claim 1, wherein said aggregating said designated target information to obtain structured information of sports events comprises:
    对所述指定目标信息按照时间信息进行聚类,得到所述体育赛事中指定目标信息对应的信息时间序列;clustering the designated target information according to time information to obtain information time series corresponding to the designated target information in the sports event;
    基于所述信息时间序列,得到所述体育赛事结构化信息。Based on the information time series, the sports event structured information is obtained.
  6. 根据权利要求1-5中任一项所述的方法,其中,所述指定目标信息包括以下至少一项:比赛场地信息、记分牌信息、运动员身份信息、中场统计信息、国旗信息。The method according to any one of claims 1-5, wherein the designated target information includes at least one of the following: playing field information, scoreboard information, player identity information, midfield statistical information, national flag information.
  7. 根据权利要求6所述的方法,在所述指定目标信息包括比赛场地信息、记分牌信息、运动员身份信息、中场统计信息和国旗信息的情况下,According to the method according to claim 6, in the case where the specified target information includes field information, scoreboard information, player identity information, midfield statistical information and national flag information,
    所述基于所述信息时间序列,得到所述体育赛事结构化信息,包括:The obtaining of the sports event structured information based on the information time series includes:
    基于所述国旗信息对应的信息时间序列和所述运动员身份信息对应的信息时间序列,获取比赛运动员信息;Based on the information time series corresponding to the national flag information and the information time series corresponding to the athlete identity information, obtain the information of the athletes in the competition;
    基于所述中场统计信息对应的信息时间序列,获得比赛局分信息;Obtain game score information based on the information time series corresponding to the midfield statistical information;
    利用图像差分算法,对所述记分牌信息对应的信息时间序列进行处理,获得比赛 比分信息;Using the image difference algorithm, the information time series corresponding to the scoreboard information is processed to obtain the game score information;
    基于所述比赛场地信息对应的信息时间序列,获得初步比赛对打片段,并利用所述比赛局分信息和所述记分牌信息对所述初步比赛对打片段进行过滤,得到比赛对打回合时间信息;Based on the information time series corresponding to the competition venue information, obtain the preliminary match sparring segment, and use the game round score information and the scoreboard information to filter the preliminary match sparring segment, and obtain the match sparring round time information;
    基于所述比赛运动员信息、所述比赛局分信息、所述比赛比分信息和所述比赛对打回合时间信息,获取所述体育赛事结构化信息。The sports event structured information is acquired based on the competition player information, the competition round score information, the competition score information and the competition round time information.
  8. 根据权利要求7所述的方法,所述方法还包括:The method according to claim 7, said method further comprising:
    检测所述比赛运动员信息是否存在于预设知识图谱中;Detect whether the player information of the competition exists in the preset knowledge map;
    若所述比赛运动员信息存在于所述预设知识图谱中,则在所述预设知识图谱中获取所述比赛运动员信息对应的运动员的其他预存信息;If the competition player information exists in the preset knowledge graph, then obtain other pre-stored information of the player corresponding to the competition player information in the preset knowledge graph;
    所述基于所述比赛运动员信息、所述比赛局分信息、所述比赛比分信息和所述比赛对打回合时间信息,获取所述体育赛事结构化信息,包括:The acquisition of the sports event structured information based on the competition player information, the competition score information, the competition score information and the competition round time information includes:
    基于所述比赛运动员信息、所述其他预存信息、所述比赛局分信息、所述比赛比分信息和所述比赛对打回合时间信息,获取所述体育赛事结构化信息。The sports event structured information is acquired based on the competition player information, the other pre-stored information, the game score information, the game score information and the competition round time information.
  9. 一种结构化信息抽取装置,包括:A structured information extraction device, comprising:
    抽取模块,被配置成从体育赛事视频中抽取目标体育赛事视频帧;The extraction module is configured to extract a target sports event video frame from the sports event video;
    检测模块,被配置成对所述目标体育赛事视频帧进行目标检测,得到体育赛事中的指定目标信息;The detection module is configured to perform target detection on the target sports event video frame to obtain specified target information in the sports event;
    聚合模块,被配置成对所述指定目标信息进行聚合,得到体育赛事结构化信息。The aggregation module is configured to aggregate the specified target information to obtain structured information about sports events.
  10. 根据权利要求9所述的装置,其中,所述检测模块进一步被配置成:The apparatus according to claim 9, wherein the detection module is further configured to:
    将所述目标体育赛事视频帧输入至预先训练的目标检测模型,得到所述体育赛事中的指定目标信息。The video frame of the target sporting event is input to a pre-trained target detection model to obtain specified target information in the sporting event.
  11. 根据权利要求10所述的装置,其中,所述体育赛事中的指定目标信息包括所述体育赛事中指定目标的类别和/或所述指定目标的位置。The apparatus according to claim 10, wherein the designated target information in the sporting event includes a category of the designated target in the sporting event and/or a position of the designated target.
  12. 根据权利要求11所述的装置,其中,所述目标检测模型包括多个串联的类别-位置子网,所述类别-位置子网包括类别子网分支和位置子网分支,所述类别子网分支用于检测所述体育赛事中指定目标的类别,所述位置子网分支用于检测所述体育赛事中指定目标的位置。The apparatus according to claim 11, wherein the object detection model comprises a plurality of class-position subnetworks connected in series, the class-position subnetwork includes a class subnetwork branch and a position subnetwork branch, and the class subnetwork The branch is used to detect the category of the designated target in the sporting event, and the position subnetwork branch is used to detect the position of the designated target in the sporting event.
  13. 根据权利要求9所述的装置,其中,所述聚合模块包括:The device according to claim 9, wherein the aggregation module comprises:
    聚类子模块,被配置成对所述指定目标信息按照时间信息进行聚类,得到所述体 育赛事中指定目标信息对应的信息时间序列;The clustering submodule is configured to cluster the specified target information according to time information, and obtain the information time series corresponding to the specified target information in the sports event;
    获取子模块,被配置成基于所述信息时间序列,得到所述体育赛事结构化信息。The obtaining submodule is configured to obtain the structured information of the sports event based on the information time series.
  14. 根据权利要求9-13中任一项所述的装置,其中,所述指定目标信息包括以下至少一项:比赛场地信息、记分牌信息、运动员身份信息、中场统计信息、国旗信息。The device according to any one of claims 9-13, wherein the designated target information includes at least one of the following: playing field information, scoreboard information, player identity information, midfield statistical information, national flag information.
  15. 根据权利要求14所述的装置,在所述指定目标信息包括比赛场地信息、记分牌信息、运动员身份信息、中场统计信息和国旗信息的情况下,The device according to claim 14, in the case where the designated target information includes field information, scoreboard information, player identity information, midfield statistical information and national flag information,
    所述获取子模块包括:The acquisition submodule includes:
    第一获取单元,被配置成基于所述国旗信息对应的信息时间序列和所述运动员身份信息对应的信息时间序列,获取比赛运动员信息;The first acquisition unit is configured to acquire player information based on the information time series corresponding to the national flag information and the information time series corresponding to the athlete identity information;
    第二获取单元,被配置成基于所述中场统计信息对应的信息时间序列,获得比赛局分信息;The second obtaining unit is configured to obtain game score information based on the information time series corresponding to the midfield statistical information;
    第三获取单元,被配置成利用图像差分算法,对所述记分牌信息对应的信息时间序列进行处理,获得比赛比分信息;The third acquisition unit is configured to use an image difference algorithm to process the information time series corresponding to the scoreboard information to obtain game score information;
    第四获取单元,被配置成基于所述比赛场地信息对应的信息时间序列,获得初步比赛对打片段,并利用所述比赛局分信息和所述记分牌信息对所述初步比赛对打片段进行过滤,得到比赛对打回合时间信息;The fourth acquisition unit is configured to obtain a preliminary game sparring segment based on the information time series corresponding to the playing field information, and use the game game score information and the scoreboard information to perform the preliminary game sparring segment Filter to get the time information of the sparring round;
    第五获取单元,被配置成基于所述比赛运动员信息、所述比赛局分信息、所述比赛比分信息和所述比赛对打回合时间信息,获取所述体育赛事结构化信息。The fifth acquiring unit is configured to acquire the sports event structured information based on the player information, the match score information, the match score information and the match sparring round time information.
  16. 根据权利要求15所述的装置,所述获取子模块还包括:The device according to claim 15, the acquiring submodule further comprising:
    检测单元,被配置成检测所述比赛运动员信息是否存在于预设知识图谱中;A detection unit configured to detect whether the player information exists in the preset knowledge map;
    第六获取单元,被配置成若所述比赛运动员信息存在于所述预设知识图谱中,则在所述预设知识图谱中获取所述比赛运动员信息对应的运动员的其他预存信息;The sixth acquisition unit is configured to acquire other pre-stored information of the player corresponding to the player information in the preset knowledge graph if the player information exists in the preset knowledge graph;
    所述第五获取单元进一步被配置成:The fifth acquisition unit is further configured to:
    基于所述比赛运动员信息、所述其他预存信息、所述比赛局分信息、所述比赛比分信息和所述比赛对打回合时间信息,获取所述体育赛事结构化信息。Based on the competition player information, the other pre-stored information, the competition score information, the competition score information and the competition round time information, the sports event structured information is acquired.
  17. 一种电子设备,包括:An electronic device comprising:
    至少一个处理器;以及at least one processor; and
    与所述至少一个处理器通信连接的存储器;其中,a memory communicatively coupled to the at least one processor; wherein,
    所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一 个处理器执行,以使所述至少一个处理器能够执行权利要求1-8中任一项所述的方法。The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can perform any one of claims 1-8. Methods.
  18. 一种存储有计算机指令的非瞬时计算机可读存储介质,其中,所述计算机指令用于使所述计算机执行根据权利要求1-8中任一项所述的方法。A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to execute the method according to any one of claims 1-8.
  19. 一种计算机程序产品,包括计算机程序,所述计算机程序在被处理器执行时实现根据权利要求1-8中任一项所述的方法。A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-8.
PCT/CN2022/096180 2021-07-23 2022-05-31 Structured information extraction method and apparatus, and device, and storage medium WO2023000831A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110838170.7A CN113569095A (en) 2021-07-23 2021-07-23 Structured information extraction method, device, equipment and storage medium
CN202110838170.7 2021-07-23

Publications (1)

Publication Number Publication Date
WO2023000831A1 true WO2023000831A1 (en) 2023-01-26

Family

ID=78166851

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/096180 WO2023000831A1 (en) 2021-07-23 2022-05-31 Structured information extraction method and apparatus, and device, and storage medium

Country Status (2)

Country Link
CN (1) CN113569095A (en)
WO (1) WO2023000831A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113569095A (en) * 2021-07-23 2021-10-29 北京百度网讯科技有限公司 Structured information extraction method, device, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140161354A1 (en) * 2012-12-06 2014-06-12 Nokia Corporation Method and apparatus for semantic extraction and video remix creation
CN107423274A (en) * 2017-06-07 2017-12-01 北京百度网讯科技有限公司 Commentary content generating method, device and storage medium based on artificial intelligence
CN110381366A (en) * 2019-07-09 2019-10-25 新华智云科技有限公司 Race automates report method, system, server and storage medium
CN111444890A (en) * 2020-04-30 2020-07-24 汕头市同行网络科技有限公司 Sports data analysis system and method based on machine learning
CN113569095A (en) * 2021-07-23 2021-10-29 北京百度网讯科技有限公司 Structured information extraction method, device, equipment and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110267116A (en) * 2019-05-22 2019-09-20 北京奇艺世纪科技有限公司 Video generation method, device, electronic equipment and computer-readable medium
CN110324728B (en) * 2019-06-28 2021-11-23 浙江传媒学院 Sports event full-field review short video generation method based on deep reinforcement learning
CN111757147B (en) * 2020-06-03 2022-06-24 苏宁云计算有限公司 Method, device and system for event video structuring
CN112215171B (en) * 2020-10-15 2024-01-26 腾讯科技(深圳)有限公司 Target detection method, device, equipment and computer readable storage medium
CN113032631A (en) * 2021-02-24 2021-06-25 北京工业大学 Team sports video key frame extraction method based on global motion statistical characteristics

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140161354A1 (en) * 2012-12-06 2014-06-12 Nokia Corporation Method and apparatus for semantic extraction and video remix creation
CN107423274A (en) * 2017-06-07 2017-12-01 北京百度网讯科技有限公司 Commentary content generating method, device and storage medium based on artificial intelligence
CN110381366A (en) * 2019-07-09 2019-10-25 新华智云科技有限公司 Race automates report method, system, server and storage medium
CN111444890A (en) * 2020-04-30 2020-07-24 汕头市同行网络科技有限公司 Sports data analysis system and method based on machine learning
CN113569095A (en) * 2021-07-23 2021-10-29 北京百度网讯科技有限公司 Structured information extraction method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN113569095A (en) 2021-10-29

Similar Documents

Publication Publication Date Title
CN110602554B (en) Cover image determining method, device and equipment
WO2020253766A1 (en) Picture generation method and apparatus, electronic device, and storage medium
US11475666B2 (en) Method of obtaining mask frame data, computing device, and readable storage medium
US11871086B2 (en) Method of displaying comment information, computing device, and readable storage medium
US10645391B2 (en) Graphical instruction data processing method and apparatus, and system
CN109640112B (en) Video processing method, device, equipment and storage medium
WO2023000831A1 (en) Structured information extraction method and apparatus, and device, and storage medium
CN111954060A (en) Barrage mask rendering method, computer device and readable storage medium
CN111372116B (en) Video playing prompt information processing method and device, electronic equipment and storage medium
US20230044146A1 (en) Video processing method, video searching method, terminal device, and computer-readable storage medium
CN111429341B (en) Video processing method, device and computer readable storage medium
US20170171621A1 (en) Method and Electronic Device for Information Processing
WO2023000972A1 (en) Structured information extraction method and apparatus, and device and storage medium
CN110677718B (en) Video identification method and device
CN114095742A (en) Video recommendation method and device, computer equipment and storage medium
CN113254712A (en) Video matching method, video processing device, electronic equipment and medium
CN111008287B (en) Audio and video processing method and device, server and storage medium
CN116403285A (en) Action recognition method, device, electronic equipment and storage medium
CN111954081B (en) Method for acquiring mask data, computer device and readable storage medium
CN111954082B (en) Mask file structure, mask file reading method, computer device and readable storage medium
CN109376298B (en) Data processing method and device, terminal equipment and computer storage medium
CN109729413B (en) Method and terminal for sending bullet screen
CN113537052B (en) Video clip extraction method, device, equipment and storage medium
CN112446237A (en) Video classification method, device, equipment and computer readable storage medium
CN115484465B (en) Bullet screen generation method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE