WO2021042909A1 - Scene switching detection method and apparatus, electronic device, and storage medium - Google Patents

Scene switching detection method and apparatus, electronic device, and storage medium Download PDF

Info

Publication number
WO2021042909A1
WO2021042909A1 PCT/CN2020/104840 CN2020104840W WO2021042909A1 WO 2021042909 A1 WO2021042909 A1 WO 2021042909A1 CN 2020104840 W CN2020104840 W CN 2020104840W WO 2021042909 A1 WO2021042909 A1 WO 2021042909A1
Authority
WO
WIPO (PCT)
Prior art keywords
value
image
video
images
target
Prior art date
Application number
PCT/CN2020/104840
Other languages
French (fr)
Chinese (zh)
Inventor
宁小东
郑云飞
宋玉岩
章佳杰
李马丁
于冰
Original Assignee
北京达佳互联信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to CN201910836850.8A priority Critical patent/CN110675371A/en
Priority to CN201910836850.8 priority
Application filed by 北京达佳互联信息技术有限公司 filed Critical 北京达佳互联信息技术有限公司
Publication of WO2021042909A1 publication Critical patent/WO2021042909A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence

Abstract

The present application relates to the technical field of computer visions, and relates to a scene switching detection method and apparatus, an electronic device, and a storage medium, for use in solving the problems of the complex computing process and the low efficiency in the current scene switching detection method for a video. The method comprises: determining a target image corresponding to an original image in a video to be tested; determining, according to gray scale values of pixel points in target images respectively corresponding to two adjacent frames of original images, a reference value indicating the degree of difference between gray scale values of pixel points in two target images; and if the reference value is greater than a preset threshold, determining that the scene switching occurs to said video between the two adjacent frames of original images. In this way, the scene switching detection is carried out by calculating a reference value indicating the degree of difference between gray scale values of pixel points in two target images, and comparing the reference value with a preset threshold, which reduces the complexity of data to be acquired during scene switching detection, and thus, the detection speed and the detection efficiency of the scene switching can be improved.

Description

一种场景切换的检测方法、装置、电子设备及存储介质Detection method, device, electronic equipment and storage medium for scene switching
本申请要求在2019年09月05日提交中国专利局、申请号为201910836850.8、申请名称为“一种场景切换的检测方法、装置、电子设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 201910836850.8, and the application name is "a detection method, device, electronic equipment and storage medium for scene switching" on September 5, 2019, all of which The content is incorporated in this application by reference.
技术领域Technical field
本申请涉及计算机视觉技术领域,尤其涉及一种场景切换的检测方法、装置、电子设备及存储介质。This application relates to the field of computer vision technology, and in particular to a detection method, device, electronic device, and storage medium for scene switching.
背景技术Background technique
一般地,一个视频由多个场景组成,一个场景由多个视频帧组成,视频场景检测是指从一个视频中找出发生场景切换的视频帧位置,根据视频中发生场景切换的视频帧位置能够快速且精确地对视频进行剪辑。Generally, a video is composed of multiple scenes, and a scene is composed of multiple video frames. Video scene detection refers to finding out the position of the video frame where the scene is switched from a video. According to the position of the video frame where the scene is switched in the video, Edit videos quickly and accurately.
目前,常用的视频场景切换检测方法为分别获得目标视频序列中第一视频帧和第二视频帧的分块顺序测度特征向量,计算所获得的分块顺序测度特征向量之间的距离,若该距离满足预设的距离要求,则判定这两个视频帧之间发生了场景切换。但发明人发现,通过分块计算特征向量,再根据特征向量的距离来判断场景是否切换的方法需要提取较多的特征向量,计算过程复杂,且计算周期长。At present, the commonly used video scene switching detection method is to obtain the block order measurement feature vectors of the first video frame and the second video frame in the target video sequence respectively, and calculate the distance between the obtained block order measurement feature vectors. If the distance meets the preset distance requirement, it is determined that a scene switch has occurred between the two video frames. However, the inventor found that the method of calculating the feature vector by block and then judging whether the scene is switched according to the distance of the feature vector needs to extract more feature vectors, the calculation process is complicated, and the calculation cycle is long.
综上所述,目前视频的场景切换检测方法计算过程复杂且效率较低。In summary, the current video scene switching detection method has a complicated calculation process and low efficiency.
发明内容Summary of the invention
本申请涉及计算机视觉技术领域,尤其涉及一种场景切换的检测方法、装置、电子设备及存储介质。以解决目前视频的场景切换检测方法计算过程复杂且效率较低的问题。本申请的技术方案如下:This application relates to the field of computer vision technology, and in particular to a detection method, device, electronic device, and storage medium for scene switching. In order to solve the problem of complex calculation process and low efficiency of the current video scene switching detection method. The technical solution of this application is as follows:
根据本申请实施例的第一方面,提供一种场景切换的检测的方法,包括:According to the first aspect of the embodiments of the present application, a method for detecting scene switching is provided, including:
确定待检测视频中原始图像对应的目标图像;Determine the target image corresponding to the original image in the video to be detected;
根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值;According to the gray values of the pixels in the target images corresponding to two adjacent original images, determine the reference value used to indicate the degree of gray value difference between the pixels of the two target images;
若所述参考值大于预设阈值,则确定所述待检测视频在所述相邻两帧原始图像之间发生场景切换。If the reference value is greater than the preset threshold, it is determined that the scene to be detected is switched between the two adjacent original images.
根据本申请实施例的第二方面,提供一种场景切换的检测装置,包括:According to a second aspect of the embodiments of the present application, there is provided a scene switching detection device, including:
确定模块,被配置为执行确定待检测视频中原始图像对应的目标图像;The determining module is configured to determine the target image corresponding to the original image in the video to be detected;
计算模块,被配置为执行根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值;The calculation module is configured to determine the reference value used to indicate the degree of gray value difference between the pixels of the two target images according to the gray values of the pixels in the target images corresponding to the two adjacent original images;
判断模块,被配置执行为若所述参考值大于预设阈值,则确定所述待检测视频在所述相邻两帧原始图像之间发生场景切换。The judging module is configured to execute that if the reference value is greater than a preset threshold, it is determined that the scene to be detected is switched between the two adjacent original images.
根据本申请实施例的第三方面,提供一种电子设备,包括:According to a third aspect of the embodiments of the present application, an electronic device is provided, including:
处理器;processor;
用于存储所述处理器可执行指令的存储器;A memory for storing executable instructions of the processor;
其中,所述处理器被配置为执行确定待检测视频中原始图像对应的目标图像;根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值;若所述参考值大于预设阈值,则确定所述待检测视频在所述相邻两帧原始图像之间发生场景切换。Wherein, the processor is configured to determine the target image corresponding to the original image in the video to be detected; according to the gray value of the pixel in the target image corresponding to each of the two adjacent original images, determine to represent the two target images If the reference value is greater than the preset threshold value, it is determined that the scene switching of the video to be detected occurs between the two adjacent original images of the frame.
根据本申请实施例的第四方面,提供一种非易失性存储介质,当所述存储介质中的指令由场景切换的检测装置的处理器执行时,使得场景切换的检测装置能够执行上述场景切换的检测方法。According to a fourth aspect of the embodiments of the present application, a non-volatile storage medium is provided. When the instructions in the storage medium are executed by the processor of the scene switching detection device, the scene switching detection device can execute the above scenes. Switching detection method.
根据本申请实施例的第五方面,提供一种计算机程序产品,当所述计算机程序产品在电子设备上运行时,使得所述电子设备执行实现上述场景切换的检测方法。According to the fifth aspect of the embodiments of the present application, a computer program product is provided, which when the computer program product runs on an electronic device, causes the electronic device to execute the detection method for realizing the above-mentioned scene switching.
本申请实施例提供的技术方案至少带来以下有益效果:The technical solutions provided by the embodiments of the present application at least bring the following beneficial effects:
相比现有计算测度特征向量间的距离的检测方法,本申请实施例中,在确定待检测视频中原始图像对应的目标图像后,根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值,当参考值大于预设阈值时,确定待检测视频在相邻两帧原始图像之间发生场景切换。这样,通过计算表示两个目标图像的像素点之间的灰度值差异程度的参考值,将该参考值与预设阈值比较大小来进行场景切换检测,降低了场景切换检测时所要采集的数据的复杂度,因此,可提升场景切换的检测速度和检测效率。Compared with the existing detection method for calculating and measuring the distance between feature vectors, in the embodiment of the present application, after determining the target image corresponding to the original image in the video to be detected, the pixel points in the target image corresponding to each of the two adjacent original images are determined. The gray value of, determines the reference value used to indicate the degree of gray value difference between the pixels of the two target images. When the reference value is greater than the preset threshold, it is determined that the video to be detected occurs between two adjacent original images Scene switching. In this way, by calculating a reference value indicating the degree of gray value difference between the pixel points of the two target images, and comparing the reference value with a preset threshold value for scene switching detection, the data to be collected during scene switching detection is reduced. Therefore, the detection speed and detection efficiency of scene switching can be improved.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本申请。It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the application.
附图说明Description of the drawings
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本申请实施例,并与说明书一起用于解释本申请的原理,并不构成对本申请的不当限定。The drawings here are incorporated into the specification and constitute a part of the specification, showing the embodiments in accordance with the application, and together with the specification are used to explain the principle of the application, and do not constitute an improper limitation of the application.
图1是根据一示例性实施例示出的一种场景切换的检测方法的流程图;Fig. 1 is a flow chart showing a method for detecting scene switching according to an exemplary embodiment;
图2是根据一示例性实施例示出的对原始图像进行下采样的流程图;Fig. 2 is a flow chart of down-sampling an original image according to an exemplary embodiment;
图3是根据一示例性实施例示出的第一种原始图像示意图;Fig. 3 is a schematic diagram showing a first original image according to an exemplary embodiment;
图4是根据一示例性实施例示出的第一种目标图像示意图;Fig. 4 is a schematic diagram showing a first target image according to an exemplary embodiment;
图5a是根据一示例性实施例示出的第一种第一目标图像示意图;Fig. 5a is a schematic diagram showing a first target image of a first type according to an exemplary embodiment;
图5b是根据一示例性实施例示出的第一种第二目标图像示意图;Fig. 5b is a schematic diagram showing a first type of second target image according to an exemplary embodiment;
图6是根据一示例性实施例示出的以原始图像的格式为不含灰度通道的图像格式,将原始图像直接作为目标图像为例的场景切换检测的完整流程图;FIG. 6 is a complete flow chart of scene switching detection in which the format of the original image is an image format without a gray channel, and the original image is directly used as a target image as an example, according to an exemplary embodiment;
图7a是根据一示例性实施例示出的第一种第一原始图像各像素点对应的灰度值示意图;Fig. 7a is a schematic diagram showing the gray value corresponding to each pixel of the first original image of the first type according to an exemplary embodiment;
图7b是根据一示例性实施例示出的第一种第二原始图像各像素点对应的灰度值示意图;Fig. 7b is a schematic diagram showing the gray value corresponding to each pixel of the first second original image according to an exemplary embodiment;
图8是根据一示例性实施例示出的以对原始图像进行下采样获得目标图像,且目标图像为含有灰度通道的图像格式为例的场景切换检测的完整流程图;FIG. 8 is a complete flow chart of scene switching detection in which a target image is obtained by down-sampling an original image, and the target image is an image format containing a grayscale channel as an example, according to an exemplary embodiment;
图9是根据一示例性实施例示出的第一种第一原始图像与第二原始图像的原分辨率示意图;Fig. 9 is a schematic diagram showing the original resolution of a first original image and a second original image of the first type according to an exemplary embodiment;
图10是根据一示例性实施例示出的第一种目标图像分辨率示意图;Fig. 10 is a schematic diagram showing a first target image resolution according to an exemplary embodiment;
图11a是根据一示例性实施例示出的第一种第一目标图像各像素点对应的灰度值示意图;Fig. 11a is a schematic diagram showing the gray value corresponding to each pixel of the first target image of the first type according to an exemplary embodiment;
图11b是根据一示例性实施例示出的第一种第二目标图像各像素点对应的灰度值示意图;Fig. 11b is a schematic diagram showing the gray value corresponding to each pixel of the second target image of the first type according to an exemplary embodiment;
图12是根据一示例性实施例示出的以对原始图像进行下采样获得目标图像,且目标图像为不含灰度通道的图像格式为例的场景切换检测的完整流程图;FIG. 12 is a complete flow chart of scene switching detection in which a target image is obtained by down-sampling an original image, and the target image is an image format without a grayscale channel as an example, according to an exemplary embodiment;
图13是根据一示例性实施例示出的第二种第一原始图像与第二原始图像的原分辨率示意图;Fig. 13 is a schematic diagram showing the original resolution of a second type of first original image and a second original image according to an exemplary embodiment;
图14是根据一示例性实施例示出的第二种目标图像分辨率示意图;Fig. 14 is a schematic diagram showing a second target image resolution according to an exemplary embodiment;
图15a是根据一示例性实施例示出的第二种第一目标图像各像素点对应的灰度值示意图;Fig. 15a is a schematic diagram showing the gray value corresponding to each pixel of the second first target image according to an exemplary embodiment;
图15b是根据一示例性实施例示出的第二种第二目标图像各像素点对应的灰度值示意图;Fig. 15b is a schematic diagram showing the gray value corresponding to each pixel of the second target image of the second type according to an exemplary embodiment;
图16是根据一示例性实施例示出的一种场景切换的检测装置框图;Fig. 16 is a block diagram showing a device for detecting scene switching according to an exemplary embodiment;
图17是根据一示例性实施例示出的一种用于场景切换检测的电子设备的框图。Fig. 17 is a block diagram showing an electronic device for scene switching detection according to an exemplary embodiment.
具体实施方式detailed description
为了使本领域普通人员更好地理解本申请的技术方案,下面将结合附图,对本申请实施例的技术方案进行清楚、完整地描述。In order to enable those of ordinary skill in the art to better understand the technical solutions of the present application, the technical solutions of the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings.
需要说明的是,本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本申请实施例能够以除了在这里图示或描述的那些以外的顺序实施。以下示例性实施例中所描述的实施方式并不代表与本申请相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本申请的一些方面相一致的装置和方法的例子。It should be noted that the terms "first" and "second" in the specification and claims of the application and the above-mentioned drawings are used to distinguish similar objects, and not necessarily used to describe a specific sequence or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in a sequence other than those illustrated or described herein. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the application as detailed in the appended claims.
下面对文中出现的一些词语进行解释:The following explains some of the words that appear in the text:
1、本申请实施例中术语“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。1. The term "and/or" in the embodiments of the present application describes the association relationship of the associated objects, indicating that there can be three types of relationships, for example, A and/or B, which can mean that there is A alone, and both A and B exist. There are three cases of B. The character "/" generally indicates that the associated objects before and after are in an "or" relationship.
2、本申请实施例中术语“帧”,是指影像动画中最小单位的单幅影像画面,一帧就是一副静止的画面,连续的帧就形成了视频。2. The term "frame" in the embodiments of this application refers to a single image frame in the smallest unit of an image animation. A frame is a still image, and consecutive frames form a video.
3、本申请实施例中术语“灰度值”,是指单个像素点的亮度。灰度是表明图像明暗的数值,即黑白图像中点的颜色深度,范围一般从0到255,白色为255,黑色为0,故黑白图像也称灰度图像。像素点的灰度值越大则像素点越亮。3. The term "gray value" in the embodiments of this application refers to the brightness of a single pixel. Grayscale is the value indicating the brightness of the image, that is, the color depth of the point in the black and white image. The range is generally from 0 to 255, with white being 255 and black being 0, so black and white images are also called grayscale images. The larger the gray value of the pixel, the brighter the pixel.
4、本申请实施例中术语“像素”,是指整个图像中不可分割的单位或者是元素,其中,不可分割的意思是指其不能够再切割成更小单位抑或是元素,它是以一个单一颜色的小格存在。每一个点阵图像包含了一定数量的像素,这些像素决定图像在屏幕上所呈现的大小。4. The term "pixel" in the embodiments of this application refers to an indivisible unit or element in the entire image. Indivisible means that it cannot be cut into smaller units or elements. A single color cell exists. Each bitmap image contains a certain number of pixels, which determine the size of the image on the screen.
本申请实施例描述的应用场景是为了更加清楚的说明本申请实施例的技术方案,并不构成对本申请实施例提供的技术方案的限定,本领域普通技术人员可知,随着新应用场景的出现,本申请实施例提供的技术方案对于类似的技术问题,同样适用。The application scenarios described in the embodiments of this application are intended to more clearly illustrate the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided by the embodiments of this application. Those of ordinary skill in the art will know that as new application scenarios emerge The technical solutions provided in the embodiments of this application are equally applicable to similar technical problems.
场景切换的检测主要应用在视频剪辑中,根据视频中发生场景切换的视频帧位置能够快速且精确地对视频进行剪辑。The detection of scene switching is mainly used in video editing, and the video can be edited quickly and accurately according to the position of the video frame where the scene switching occurs in the video.
针对现有技术中视频的场景切换检测方法计算过程复杂且效率较低的问题,本申请实施例提供一种场景切换的检测方法。In view of the problem that the calculation process of the scene switching detection method of the video in the prior art is complicated and the efficiency is low, an embodiment of the present application provides a scene switching detection method.
本申请提供的一种场景切换的检测方法可以使用一种图像处理应用程序实现,该图像处理应用程序中存储有执行本申请实施例提供的场景检测方法的代码,用户将需要检测的视频输入到该图像处理应用程序中,该图像处理应用程序自动提取相邻两帧图像进行场景 切换检测,具体地,计算相邻两帧图像对应的用于表示两个图像的像素点之间灰度值差异程度的参考值,若参考值大于预设阈值,则确定待检测视频在相邻两帧图像之间发生场景切换,图像处理应用程序在对用户输入的视频的每相邻两帧均检测完毕后,输出视频中发生视频场景切换的两帧的位置,由于场景检测的过程均由图像处理程序完成,且本申请提供的场景检测的计算过程简单迅速,因此,用户的等待时间比较短。The scene switching detection method provided by this application can be implemented by using an image processing application program. The image processing application program stores the code for executing the scene detection method provided in the embodiments of this application, and the user inputs the video to be detected into In the image processing application program, the image processing application program automatically extracts two adjacent frames of images for scene switching detection, specifically, calculates the gray value difference between the pixels of the two adjacent frames corresponding to the two images The reference value of the degree. If the reference value is greater than the preset threshold, it is determined that the scene to be detected is switched between two adjacent frames of images. The image processing application will detect every two adjacent frames of the video input by the user. , The position of the two frames in the output video where the video scene switch occurs, since the scene detection process is completed by the image processing program, and the calculation process of the scene detection provided by this application is simple and rapid, the waiting time of the user is relatively short.
本申请提供的一种场景切换的检测方法还可以使用一种图像处理应用程序与服务器配合的方式实现,用户将需要检测的视频输入到图像处理应用程序中,该图像处理应用程序将每相邻两帧图像传给服务器,服务器计算相邻两帧图像对应的用于表示两个图像的像素点之间灰度值差异程度的参考值,若参考值大于预设阈值,则确定待检测视频在相邻两帧图像之间发生场景切换,然后,服务器将检测结果返回给图像处理应用程序,图像处理应用程序将检测视频中发生场景切换的视频帧位置展示给用户,由于该方式使用图像处理应用程序与服务器配合的方式,检测场景的速度更快,且节约系统资源。The scene switching detection method provided by this application can also be implemented by using an image processing application in cooperation with a server. The user inputs the video that needs to be detected into the image processing application, and the image processing application will The two frames of images are sent to the server, and the server calculates the reference value corresponding to the two adjacent frames of the image to indicate the degree of gray value difference between the pixels of the two images. If the reference value is greater than the preset threshold, it is determined that the video to be detected is in Scene switching occurs between two adjacent frames of images, and then the server returns the detection result to the image processing application, and the image processing application displays the position of the video frame in the detected video where the scene switching occurs to the user, because this method uses the image processing application The way the program cooperates with the server can detect scenes faster and save system resources.
可选的,图像处理程序可以为视频剪辑应用程序,用户输入待检测视频后,视频剪辑程序向用户展示检测到发生场景切换的两帧图像的位置,用户可以决定是否要在该位置对视频进行剪辑。用户使用该视频剪辑应用程序可以快速准确地确定待检测视频中相邻两帧是否发生场景切换。Optionally, the image processing program can be a video editing application. After the user enters the video to be detected, the video editing program shows the user the location of the two images where the scene switch is detected, and the user can decide whether to perform the video at that location. Clip. The user can use the video editing application to quickly and accurately determine whether scene switching occurs between two adjacent frames in the video to be detected.
图1为根据一示例性实施例示出的一种场景切换的检测方法的流程图,包括以下步骤:Fig. 1 is a flow chart showing a method for detecting scene switching according to an exemplary embodiment, including the following steps:
在步骤S11中,确定待检测视频中原始图像对应的目标图像。In step S11, the target image corresponding to the original image in the video to be detected is determined.
在步骤S12中,根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值。In step S12, according to the gray values of the pixels in the target images corresponding to the two adjacent original images, a reference value used to indicate the degree of gray value difference between the pixels of the two target images is determined.
在步骤S13中,若所述参考值大于预设阈值,则确定所述待检测视频在所述相邻两帧原始图像之间发生场景切换。In step S13, if the reference value is greater than a preset threshold, it is determined that the scene to be detected is switched between the two adjacent original images.
相比现有计算测度特征向量间的距离的检测方法,本申请实施例中,在确定待检测视频中原始图像对应的目标图像后,根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值,当参考值大于预设阈值时,确定待检测视频在相邻两帧原始图像之间发生场景切换。这样,通过计算表示两个目标图像的像素点之间的灰度值差异程度的参考值,将该参考值与预设阈值比较大小来进行场景切换检测,降低了场景切换检测时所要采集的数据的复杂度,因此,可加快场景切换的检测速度和检测效率。Compared with the existing detection method for calculating and measuring the distance between feature vectors, in the embodiment of the present application, after determining the target image corresponding to the original image in the video to be detected, the pixel points in the target image corresponding to each of the two adjacent original images are determined. The gray value of, determines the reference value used to indicate the degree of gray value difference between the pixels of the two target images. When the reference value is greater than the preset threshold, it is determined that the video to be detected occurs between two adjacent original images Scene switching. In this way, by calculating a reference value indicating the degree of gray value difference between the pixel points of the two target images, and comparing the reference value with a preset threshold value for scene switching detection, the data to be collected during scene switching detection is reduced. Therefore, the detection speed and detection efficiency of scene switching can be accelerated.
本申请实施例中,确定待检测视频中原始图像对应的目标图像;其中,两帧原始图像为待检测视频中相邻的两帧图像。In the embodiment of the present application, the target image corresponding to the original image in the video to be detected is determined; wherein the two original images are two adjacent frames of the image in the video to be detected.
需要说明的是,本申请实施例针对待检测视频中任意相邻两帧原始图像,判断该相邻两帧原始图像之间是否发生场景切换。It should be noted that, in this embodiment of the present application, for any two adjacent original images in the video to be detected, it is determined whether a scene switch occurs between the two adjacent original images.
本申请实施例可以根据以下方式确定待检测视频中原始图像对应的目标图像:In this embodiment of the application, the target image corresponding to the original image in the video to be detected may be determined according to the following methods:
1、将待检测视频中的原始图像作为目标图像。1. Use the original image in the video to be detected as the target image.
一种可选的实施方式为,在从待检测视频中获取相邻两帧原始图像后,不做任何处理,直接将获取到的原始图像作为目标图像。An optional implementation manner is to directly use the acquired original image as the target image without any processing after acquiring two adjacent original images from the video to be detected.
2、对待检测视频中的原始图像进行下采样,将下采样得到的图像作为原始图像对应的目标图像。2. Perform down-sampling on the original image in the video to be detected, and use the down-sampled image as the target image corresponding to the original image.
一种可能的实施方式,如图2所示,根据下列步骤对原始图像进行下采样:A possible implementation manner, as shown in Figure 2, down-sampling the original image according to the following steps:
在步骤S201中,确定对待检测视频中的原始图像进行下采样时使用的倍率。In step S201, the magnification used when down-sampling the original image in the video to be detected is determined.
在步骤S202中,对下采样得到的目标图像进行填充处理。In step S202, filling processing is performed on the target image obtained by down-sampling.
本申请实施例中,可以根据下列式确定对待检测视频中的原始图像进行下采样时使用的倍率:In the embodiment of the present application, the magnification used when down-sampling the original image in the video to be detected can be determined according to the following formula:
1、将预设的倍率作为对待检测视频中的原始图像进行下采样时使用的倍率。1. Use the preset magnification as the magnification used when down-sampling the original image in the video to be detected.
预设的倍率是预先设置的数值,在对原始图像进行下采样时,使用预设的倍率对图像下采样,即对原始图像的高和宽均使用该预设的倍率进行下采样。The preset magnification is a preset value. When the original image is downsampled, the image is downsampled using the preset magnification, that is, the height and width of the original image are both downsampled using the preset magnification.
例如,原始图像I0的分辨率为h0*w0,预设的倍率为S,则下采样后得到的目标图像I的分辨率为h*w,其中,h=h0/S,w=w0/S。For example, the resolution of the original image I0 is h0*w0, and the preset magnification is S, then the resolution of the target image I obtained after downsampling is h*w, where h=h0/S, w=w0/S .
2、根据预设的目标图像的分辨率以及待检测视频中原始图像的分辨率,确定对待检测视频中的原始图像进行下采样时使用的倍率。2. Determine the magnification used when down-sampling the original image in the video to be detected according to the preset resolution of the target image and the resolution of the original image in the video to be detected.
预设的目标图像分辨率是预先设置的具体数值,在对原始图像下采样之前,根据预先设置的目标图像分辨率以及原始图像的分辨率确定倍率。The preset target image resolution is a specific value set in advance. Before down-sampling the original image, the magnification is determined according to the preset target image resolution and the resolution of the original image.
具体的,可以根据原始图像中像素的行数以及预先设置的目标图像中像素的行数,确定对待检测视频中原始图像进行下采样时使用的倍率;或者可以根据原始图像中像素的列数以及预先设置的目标图像中像素的列数,确定对待检测视频中原始图像进行下采样时使用的倍率。Specifically, the magnification used when down-sampling the original image in the video to be detected can be determined according to the number of rows of pixels in the original image and the preset number of rows of pixels in the target image; or it can be based on the number of columns and columns of pixels in the original image. The preset number of columns of pixels in the target image determines the magnification used when down-sampling the original image in the video to be detected.
例如,原始图像I0的分辨率为h0*w0,预设的目标图像I的分辨率为h*w,则计算得到对待检测视频中的原始图像进行下采样时使用的倍率
Figure PCTCN2020104840-appb-000001
或者,计算得到对待检测视频中的原始图像进行下采样时使用的倍率
Figure PCTCN2020104840-appb-000002
For example, if the resolution of the original image I0 is h0*w0 and the preset resolution of the target image I is h*w, then the magnification used when down-sampling the original image in the video to be detected is calculated
Figure PCTCN2020104840-appb-000001
Or, calculate the magnification used when down-sampling the original image in the video to be detected
Figure PCTCN2020104840-appb-000002
在确定出对原始图像进行下采样时使用的倍率之后,即可使用确定出的倍率对原始图像进行下采样。After determining the magnification used when down-sampling the original image, the determined magnification can be used to down-sample the original image.
本申请实施例使用确定出的倍率,从原始图像中采样部分像素点组成采样后的目标图像。The embodiment of the present application uses the determined magnification to sample some pixels from the original image to form the sampled target image.
一种可能的实施方式,针对目标图像中的任一个像素点,若其位置坐标为(i,j),(i∈[0,h-1],j∈[0,w-1]),则该像素点的像素值可以使用如下公式确定:A possible implementation manner, for any pixel in the target image, if its position coordinates are (i, j), (i ∈ [0, h-1], j ∈ [0, w-1]), Then the pixel value of the pixel can be determined using the following formula:
i'=ceil(i*S);i'=ceil(i*S);
j'=ceil(j*S);j'=ceil(j*S);
I(i,j)=I0(i',j');I(i,j)=I0(i',j');
其中,S是对原始图像下采样时使用的倍率,(i',j')是原始图像中像素点坐标,(i,j)是目标图像中像素点坐标,I0(i',j')为坐标为(i',j')的像素点在原始图像中的像素值,I(i,j)为坐标为(i,j)的像素点在目标图像中的像素值。Among them, S is the magnification used when down-sampling the original image, (i', j') is the coordinate of the pixel in the original image, (i, j) is the coordinate of the pixel in the target image, I0 (i', j') Is the pixel value of the pixel with coordinates (i',j') in the original image, and I(i,j) is the pixel value of the pixel with coordinates (i,j) in the target image.
例如,对如图3所示的原始图像进行下采样,假设原始图像的分辨率为16*16,预设的倍率为4,则对原始图像以预设的倍率下采样后得到如图4所示的目标图像,该目标图像的分辨率为4*4;对下采样得到的目标图像进行填充处理,将原始图像中坐标为(0,0)的像素点的像素值赋给目标图像坐标为(0,0)的像素点,将原始图像中坐标为(0,4)的像素点的像素值赋给目标图像坐标为(0,1)的像素点,将原始图像中坐标为(0,8)的像素点的像素值赋给目标图像坐标为(0,2)的像素点……由此,即可得到对原始图像进行下采样后的目标图像。For example, the original image shown in Figure 3 is down-sampled, assuming that the resolution of the original image is 16*16, and the preset magnification is 4, then the original image is down-sampled at the preset magnification to obtain the result as shown in Figure 4. The target image shown in the figure, the resolution of the target image is 4*4; fill in the target image obtained by downsampling, and assign the pixel value of the pixel with the coordinates (0, 0) in the original image to the target image. The coordinates are (0,0), assign the pixel value of the pixel with coordinates (0,4) in the original image to the pixel with coordinates (0,1) in the target image, and set the coordinates in the original image to (0, The pixel value of the pixel point in 8) is assigned to the pixel point of the target image with coordinates (0, 2)... Thus, the target image after down-sampling the original image can be obtained.
需要说明的是,对两帧原始图像下采样时需要使用相同的倍率。It should be noted that the same magnification needs to be used when down-sampling the two original images.
本申请实施例中,在确定待检测视频中原始图像对应的目标图像后,目标图像中像素点的灰度值可根据以下方式确定:In the embodiment of the present application, after determining the target image corresponding to the original image in the video to be detected, the gray value of the pixel in the target image can be determined according to the following method:
方式1、从目标图像对应的灰度通道中获取每个像素点的灰度值。Method 1. Obtain the gray value of each pixel from the gray channel corresponding to the target image.
实施中,在目标图像的格式为包含灰度通道的图像格式时,则根据目标图像对应的灰度通道直接获取每个像素点的灰度值。In implementation, when the format of the target image is an image format that includes a grayscale channel, the grayscale value of each pixel is directly obtained according to the grayscale channel corresponding to the target image.
例如,目标图像格式为YUV格式,可以直接通过提取Y通道的灰度值来获取每个像素点的灰度值。For example, if the target image format is YUV format, the gray value of each pixel can be obtained directly by extracting the gray value of the Y channel.
方式2、根据目标图像对应的颜色通道的数值确定每个像素点的灰度值。Manner 2: Determine the gray value of each pixel according to the value of the color channel corresponding to the target image.
实施中,在目标图像的格式为不包含灰度通道的图像格式时,则根据目标图像对应的颜色通道的数值确定每个像素点的灰度值。In implementation, when the format of the target image is an image format that does not include a gray channel, the gray value of each pixel is determined according to the value of the color channel corresponding to the target image.
例如,目标图像的格式为RGB格式,则在确定目标图像中每个像素点的灰度值时, 根据R通道、G通道以及B通道的数值计算像素点的灰度值。For example, if the format of the target image is an RGB format, when determining the gray value of each pixel in the target image, the gray value of the pixel is calculated according to the values of the R channel, the G channel, and the B channel.
一种可能的实施方式,像素点的灰度值I可根据下列公式计算:In a possible implementation manner, the gray value I of a pixel can be calculated according to the following formula:
I=R*0.299+G*0.587+B*0.114;I=R*0.299+G*0.587+B*0.114;
其中,I表示每个像素点的灰度值,R表示红色通道的亮度值,G表示绿色通道的亮度值,B表示蓝色通道的亮度值。Among them, I represents the gray value of each pixel, R represents the brightness value of the red channel, G represents the brightness value of the green channel, and B represents the brightness value of the blue channel.
本申请实施例中,在确定出相邻两帧原始图像各自对应的目标图像中像素点的灰度值之后,确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值。In the embodiment of the present application, after determining the gray value of the pixel in the target image corresponding to each of the two adjacent original images, determine the reference value used to indicate the degree of gray value difference between the pixels of the two target images .
实施中,在确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值之前,根据两个目标图像的像素点的灰度值,确定两个目标图像中相同位置的两个像素点的灰度值的差值。In the implementation, before determining the reference value used to indicate the degree of gray value difference between the pixels of the two target images, according to the gray values of the pixels of the two target images, determine the two target images at the same position. The difference between the gray values of each pixel.
例如,如图5a所示的第一目标图像和如图5b所示的第二目标图像,且假设第一目标图像和第二目标图像的分辨率为h*w。使用I(i,j)表示第一目标图像中第i行第j列的像素点对应的灰度值,I 0(i,j)表示第二目标图像中第i行第j列的像素点对应的灰度值;其中,0≤i≤h-1,0≤j≤w-1。 For example, the first target image as shown in FIG. 5a and the second target image as shown in FIG. 5b, and it is assumed that the resolution of the first target image and the second target image is h*w. Use I(i,j) to represent the gray value corresponding to the pixel in the i-th row and j-th column in the first target image, and I 0 (i,j) to represent the pixel in the i-th row and j-th column in the second target image Corresponding gray value; among them, 0≤i≤h-1, 0≤j≤w-1.
计算第一目标图像和第二目标图像中相同位置的两个像素点的灰度值的差值ΔI=I(i,j)-I 0(i,j)。 Calculate the difference ΔI=I(i,j)-I 0 (i,j) between the gray values of the two pixels at the same position in the first target image and the second target image.
在本申请实施例中,可以根据以下方式确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值。In the embodiment of the present application, the reference value used to indicate the degree of gray value difference between the pixel points of the two target images may be determined according to the following manner.
1、根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定两个目标图像中相同位置的像素点之间灰度值差值的平均值,将平均值作为参考值。1. Determine the average value of the gray value difference between the pixels in the same position in the two target images according to the gray values of the pixels in the target image corresponding to the two adjacent original images, and use the average as the reference value .
一种可能的实施方式,根据下列公式确定两个目标图像中相同位置的像素点之间灰度值差值的平均值:In a possible implementation manner, the average value of the gray value difference between the pixels at the same position in the two target images is determined according to the following formula:
Figure PCTCN2020104840-appb-000003
Figure PCTCN2020104840-appb-000003
其中,D表示两个目标图像中相同位置的像素点之间灰度值差值的平均值,w表示目标图像的宽,h表示目标图像的高,I(i,j)表示第一目标图像中第i行第j列的像素点对应的灰度值,I 0(i,j)表示第二目标图像中第i行第j列的像素点对应的灰度值。 Among them, D represents the average value of the gray value difference between the pixels at the same position in the two target images, w represents the width of the target image, h represents the height of the target image, and I(i,j) represents the first target image The gray value corresponding to the pixel in the i-th row and the j-th column, I 0 (i, j) represents the gray value corresponding to the pixel in the i-th row and j-th column in the second target image.
计算后得到两个目标图像中相同位置的像素点之间灰度值差值的平均值,并将该平均值作为参考值。After calculation, the average value of the gray value difference between the pixels at the same position in the two target images is obtained, and the average value is used as the reference value.
例如,计算如图5a所示的第一目标图像和如图5b所示的第二目标图像中相同位置的像素点之间的灰度值差值的平均值为:For example, calculating the average value of the gray value difference between the pixel points at the same position in the first target image shown in FIG. 5a and the second target image shown in FIG. 5b is:
Figure PCTCN2020104840-appb-000004
Figure PCTCN2020104840-appb-000004
则用于表示第一目标图像和第二目标图像的像素点之间灰度值差异程度的参考值为54.13。The reference value used to indicate the degree of gray value difference between the pixels of the first target image and the second target image is 54.13.
2、根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定两个目标图像中相同位置的像素点之间灰度值差值;对确定出的灰度值差值进行排序,将位于预设位置的灰度值差值作为参考值。2. Determine the gray value difference between the pixels in the same position in the two target images according to the gray values of the pixels in the target image corresponding to the two adjacent original images; the determined gray value difference For sorting, the gray value difference at the preset position is used as the reference value.
实施中,在计算出两个目标图像中相同位置的像素点灰度值差值之后,可以按照灰度值差值从大到小或者从小到大的顺序对确定出的灰度值差值进行排序,将排序得到的序列中位于预设位置的灰度值差值作为参考值。In implementation, after calculating the gray value difference of the pixels at the same position in the two target images, the determined gray value difference can be calculated in the order of the gray value difference from large to small or from small to large. For sorting, the gray value difference at a preset position in the sequence obtained by sorting is used as a reference value.
可选的,该预设位置可以为排序后得到的序列的中间区域中一个位置,例如,参考值为确定出的多个灰度值差值的中位数。Optionally, the preset position may be a position in the middle region of the sequence obtained after sorting, for example, the reference value is the median of multiple determined gray value differences.
假设,以参考值为确定出的多个灰度值差值的中位数为例,如图5a所示第一目标图像和如图5b所示的第二目标图像对应的参考值为44.5。Suppose, taking the reference value as an example of the determined median of the multiple gray value differences, the reference value corresponding to the first target image shown in FIG. 5a and the second target image shown in FIG. 5b is 44.5.
本申请实施例在确定两个目标图像对应的参考值后,比较参考值与预设阈值的大小,若参考值大于预设阈值,则确定待检测视频在相邻两帧原始图像之间发生了场景切换。In the embodiment of the application, after determining the reference values corresponding to the two target images, the size of the reference value and the preset threshold is compared. If the reference value is greater than the preset threshold, it is determined that the video to be detected occurs between two adjacent original images. Scene switching.
其中,预设阈值为技术人员根据实际场景检测总结出来的常用的判断场景切换的经验数值。Among them, the preset threshold is a commonly used empirical value for judging scene switching summarized by technicians based on actual scene detection.
将参考值与预设阈值比较大小,若参考值大于预设阈值,则认为两个目标图像之间的像素值已发生了明显变化,表示此时检测的两帧原始图像已经发生了场景变化。The reference value is compared with the preset threshold value. If the reference value is greater than the preset threshold value, it is considered that the pixel value between the two target images has changed significantly, indicating that scene changes have occurred in the two original images detected at this time.
下面以几个具体例子说明场景切换的检测方法。Here are a few specific examples to illustrate the detection method of scene switching.
一、以原始图像的格式为不含灰度通道的图像格式,将原始图像直接作为目标图像为例,如图6所示,本申请实施例场景切换的检测方法包含以下步骤:1. Taking the format of the original image as an image format without a grayscale channel, and taking the original image directly as the target image as an example, as shown in FIG. 6, the method for detecting scene switching in the embodiment of the present application includes the following steps:
在步骤S601中,获取待检测视频中相邻两帧原始图像。In step S601, two adjacent original images in the video to be detected are acquired.
在步骤S602中,分别获取两帧原始图像的颜色通道的数值,计算得到原始图像每个像素点的灰度值。In step S602, the values of the color channels of the two original images are obtained respectively, and the gray value of each pixel of the original image is calculated.
具体计算方式可以为:The specific calculation method can be:
I=R*0.299+G*0.587+B*0.114;I=R*0.299+G*0.587+B*0.114;
其中,I表示每个像素点的灰度值,R表示红色通道的亮度值,G表示绿色通道的亮度值,B表示蓝色通道的亮度值。Among them, I represents the gray value of each pixel, R represents the brightness value of the red channel, G represents the brightness value of the green channel, and B represents the brightness value of the blue channel.
在步骤S603中,根据两个原始图像中像素点的灰度值,确定两个原始图像相同位置 的像素点之间灰度值差值的平均值作为参考值。In step S603, according to the gray values of the pixels in the two original images, the average value of the gray value differences between the pixels at the same position in the two original images is determined as a reference value.
在步骤S604中,判断参考值是否大于预设阈值;若是,执行步骤S605,若否,执行步骤S606。In step S604, it is determined whether the reference value is greater than the preset threshold; if yes, step S605 is executed, and if not, step S606 is executed.
在步骤S605中,确定待检测视频在相邻两帧原始图像之间发生了场景切换。In step S605, it is determined that the scene to be detected is switched between two adjacent original images of the video.
在步骤S606中,确定待检测视频在相邻两帧原始图像之间没有发生场景切换。In step S606, it is determined that the scene to be detected does not switch between two adjacent original images of the video.
例如,第一原始图像的灰度值如图7a所示,第二原始图像的灰度值如图7b所示。在获取到每个像素点的灰度值后,根据以下方式计算图7a和图7b中两个原始图像相同位置的像素点之间的差值的平均值:For example, the gray value of the first original image is shown in FIG. 7a, and the gray value of the second original image is shown in FIG. 7b. After the gray value of each pixel is obtained, the average value of the difference between the pixels at the same position in the two original images in Figure 7a and Figure 7b is calculated according to the following method:
Figure PCTCN2020104840-appb-000005
Figure PCTCN2020104840-appb-000005
其中,D表示两个原始图像中相同位置的像素点之间灰度值差值的平均值,原始图像的分辨率为w*h,I(i,j)表示第一目标图像中第i行第j列的像素点对应的灰度值,I 0(i,j)表示第二目标图像中第i行第j列的像素点对应的灰度值; Among them, D represents the average value of the gray value difference between the pixels at the same position in the two original images, the resolution of the original image is w*h, and I(i,j) represents the i-th row in the first target image The gray value corresponding to the pixel in the j-th column, and I 0 (i,j) represents the gray value corresponding to the pixel in the i-th row and the j-th column in the second target image;
得到两个目标图像相同位置的像素点之间的差值的平均值D后,将该平均值D作为参考值,即参考值为1.7。After the average value D of the difference between the pixel points at the same position of the two target images is obtained, the average value D is used as the reference value, that is, the reference value is 1.7.
假设使用的预设阈值为20,参考值1.7小于预设阈值20,则确定待检测视频在这两帧原始图像处没有发生场景切换。Assuming that the used preset threshold value is 20, and the reference value 1.7 is less than the preset threshold value 20, it is determined that no scene switching occurs in the two original images of the video to be detected.
二、以对原始图像进行下采样获得目标图像,且目标图像为含有灰度通道的图像格式为例,如图8所示,包含以下步骤:2. Take the original image down-sampling to obtain the target image, and the target image is an image format containing grayscale channels as an example, as shown in Figure 8, including the following steps:
在步骤S801中,对两帧原始图像进行下采样,将下采样后得到的图像作为目标图像。In step S801, the two frames of original images are down-sampled, and the image obtained after the down-sampling is used as the target image.
在步骤S802中,分别提取两个目标图像中灰度通道的数值,得到目标图像每个像素点的灰度值。In step S802, the values of the gray-scale channels in the two target images are respectively extracted to obtain the gray-scale value of each pixel of the target image.
在步骤S803中,根据两个目标图像中像素点的灰度值,确定两个目标图像相同位置的像素点之间灰度值差值的中位数作为参考值。In step S803, according to the gray values of the pixels in the two target images, the median of the gray value differences between the pixels in the same position of the two target images is determined as a reference value.
在步骤S804中,判断参考值是否大于预设阈值;若是,执行步骤S805,若否,执行步骤S806。In step S804, it is determined whether the reference value is greater than a preset threshold; if yes, step S805 is executed, and if not, step S806 is executed.
在步骤S805中,确定待检测视频在相邻两帧原始图像之间发生了场景切换。In step S805, it is determined that the scene to be detected is switched between two adjacent original images of the video.
在步骤S806中,确定待检测视频在相邻两帧原始图像之间没有发生场景切换。In step S806, it is determined that no scene switching occurs between two adjacent original images of the video to be detected.
例如,第一原始图像与第二原始图像的原分辨率如图9所示,原始图像的分辨率为12*15;经过预设数值为3的倍率对原始图像进行下采样,获得如图10所示的目标图像,目标图像的分辨率为4*5;其中,图9和图10中的每个方格表示一个像素点。For example, the original resolutions of the first original image and the second original image are shown in Figure 9, and the resolution of the original image is 12*15; the original image is down-sampled with a preset value of 3 at a magnification ratio, and the result is shown in Figure 10. In the target image shown, the resolution of the target image is 4*5; among them, each square in Figure 9 and Figure 10 represents a pixel.
提取图像灰度通道中的灰度值,第一目标图像的灰度值如图11a所示,第二目标图像的灰度值如图11b所示。The gray value in the gray channel of the image is extracted. The gray value of the first target image is shown in Fig. 11a, and the gray value of the second target image is shown in Fig. 11b.
获得两个目标图像中像素点的灰度值后,计算两个目标图像相同位置的像素点之间灰度值的差值,对确定出的灰度值差值进行排序,将位于预设位置的灰度值差值作为参考值。After obtaining the gray value of the pixels in the two target images, calculate the gray value difference between the pixels in the same position of the two target images, and sort the determined gray value differences, which will be located in the preset position The gray value difference of is used as a reference value.
假设使用中位数作为参考值,可根据下列方式获取灰度值差值的中位数:Assuming that the median is used as the reference value, the median of the gray value difference can be obtained according to the following methods:
将计算得到的各灰度值差值以从小到大的顺序排列,假设有N个灰度值差值,当N为奇数时,中位数为排在第(N+1)/2个的灰度值差值;当N为偶数时,中位数为排在第N/2与第N/2+1的两个灰度值差值的平均数。Arrange the calculated gray value differences in ascending order. Suppose there are N gray value differences. When N is an odd number, the median is the (N+1)/2th Gray value difference; when N is an even number, the median is the average of the two gray value differences ranked N/2 and N/2+1.
如图11a所示的第一目标图像和如图11b所示的第二目标图像,计算后可得中位数为28,将获取得到的中位数作为参考值,即参考值为28。For the first target image shown in FIG. 11a and the second target image shown in FIG. 11b, the median is 28 after calculation, and the obtained median is used as the reference value, that is, the reference value is 28.
假设使用的预设阈值为20,则参考值28大于预设阈值20,则确定待检测视频在这两帧原始图像处发生了场景切换。Assuming that the used preset threshold value is 20, and the reference value 28 is greater than the preset threshold value 20, it is determined that the scene switching of the two original images of the video to be detected has occurred.
三、以对原始图像进行下采样获得目标图像,且目标图像为不含灰度通道的图像格式为例,如图12所示,包含以下步骤:3. Taking the original image down-sampling to obtain the target image, and the target image is an image format without a grayscale channel as an example, as shown in Figure 12, it includes the following steps:
在步骤S1201中,对两帧原始图像进行下采样,将下采样后得到的图像作为目标图像。In step S1201, the two frames of original images are down-sampled, and the image obtained after the down-sampling is used as the target image.
在步骤S1202中,分别获取目标图像的颜色通道的数值,计算得到目标图像每个像素点的灰度值。In step S1202, the numerical values of the color channels of the target image are respectively obtained, and the gray value of each pixel of the target image is calculated.
具体计算方式可以为:The specific calculation method can be:
I=R*0.299+G*0.587+B*0.114;I=R*0.299+G*0.587+B*0.114;
其中,I表示每个像素点的灰度值,R表示红色通道的亮度值,G表示绿色通道的亮度值,B表示蓝色通道的亮度值;Among them, I represents the gray value of each pixel, R represents the brightness value of the red channel, G represents the brightness value of the green channel, and B represents the brightness value of the blue channel;
在步骤S1203中,根据两个目标图像中像素点的灰度值,确定两个目标图像相同位置的像素点之间灰度值差值的平均值作为参考值。In step S1203, according to the gray values of the pixels in the two target images, the average value of the gray value differences between the pixels in the same position of the two target images is determined as a reference value.
在步骤S1204中,判断参考值是否大于预设阈值;若是,执行步骤S1205,若否,执行步骤S1206。In step S1204, it is determined whether the reference value is greater than the preset threshold; if yes, step S1205 is executed, and if not, step S1206 is executed.
在步骤S1205中,确定待检测视频在相邻两帧原始图像之间发生了场景切换。In step S1205, it is determined that the scene to be detected is switched between two adjacent original images of the video.
在步骤S1206中,确定待检测视频在相邻两帧原始图像之间没有发生场景切换。In step S1206, it is determined that no scene switching has occurred between two adjacent original images of the video to be detected.
例如,第一原始图像与第二原始图像的原分辨率如图13所示,原始图像的分辨率为16*20;经过预设数值为4的倍率对原始图像进行下采样,获得如图14所示的目标图像,目标图像的分辨率为4*5;其中,图13和图14中的每个方格表示一个像素点。For example, the original resolutions of the first original image and the second original image are as shown in Figure 13, and the resolution of the original image is 16*20; the original image is down-sampled with a preset value of 4 magnification, and the result is shown in Figure 14. In the target image shown, the resolution of the target image is 4*5; among them, each square in Figure 13 and Figure 14 represents a pixel.
在对两帧原始图像下采样获得两帧目标图像后,分别提取两帧目标图像的颜色通道的 数值,计算得到每个像素点对应的灰度值,假设计算后第一目标图像的灰度值如图15a所示,第二目标图像的灰度值如图15b所示。After down-sampling the two original images to obtain two target images, extract the color channel values of the two target images respectively, and calculate the gray value corresponding to each pixel. Assuming the gray value of the first target image after calculation As shown in Fig. 15a, the gray value of the second target image is as shown in Fig. 15b.
在获取到每个像素点的灰度值后,根据以下方式计算图15a所示的第一目标图像与图15b所示的第二目标图像中两个目标图像相同位置的像素点之间的差值的平均值:After obtaining the gray value of each pixel, calculate the difference between the pixels at the same position of the two target images in the first target image shown in FIG. 15a and the second target image shown in FIG. 15b according to the following method Average of values:
Figure PCTCN2020104840-appb-000006
Figure PCTCN2020104840-appb-000006
其中,D表示两个目标图像中相同位置的像素点之间灰度值差值的平均值,w表示目标图像的宽,h表示目标图像的高,I(i,j)表示第一目标图像中第i行第j列的像素点对应的灰度值,I 0(i,j)表示第二目标图像中第i行第j列的像素点对应的灰度值; Among them, D represents the average value of the gray value difference between the pixels at the same position in the two target images, w represents the width of the target image, h represents the height of the target image, and I(i,j) represents the first target image The gray value corresponding to the pixel in the i-th row and the j-th column, I 0 (i, j) represents the gray value corresponding to the pixel in the i-th row and j-th column in the second target image;
得到两个目标图像相同位置的像素点之间的差值的平均值D后,将该平均值D作为参考值,即参考值为24.5。After the average value D of the difference between the pixel points at the same position of the two target images is obtained, the average value D is used as the reference value, that is, the reference value is 24.5.
假设使用的预设阈值为20,参考值24.5大于预设阈值20,则确定待检测视频在这两帧原始图像处发生了场景切换。Assuming that the used preset threshold value is 20, and the reference value 24.5 is greater than the preset threshold value 20, it is determined that the scene switching of the two original images of the video to be detected has occurred.
图16是根据一示例性实施例示出的一种场景切换的检测装置框图,该装置包括确定模块1601,计算模块1602,判断模块1603。Fig. 16 is a block diagram showing a device for detecting scene switching according to an exemplary embodiment. The device includes a determination module 1601, a calculation module 1602, and a judgment module 1603.
确定模块1601,被配置为执行确定待检测视频中原始图像对应的目标图像;The determining module 1601 is configured to determine the target image corresponding to the original image in the video to be detected;
计算模块1602,被配置为执行根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值;The calculation module 1602 is configured to determine the reference value used to indicate the degree of gray value difference between the pixels of the two target images according to the gray values of the pixels in the target images corresponding to the two adjacent original images;
判断模块1603,被配置执行为若所述参考值大于预设阈值,则确定所述待检测视频在所述相邻两帧原始图像之间发生场景切换。The judging module 1603 is configured to execute if the reference value is greater than a preset threshold value, it is determined that the to-be-detected video has a scene switch between the two adjacent original images.
在一种可能的实现方式中,所述确定模块1601被配置为执行将所述待检测视频中的原始图像作为目标图像;或对所述待检测视频中的原始图像进行下采样,将下采样得到的图像作为所述原始图像对应的目标图像。In a possible implementation manner, the determining module 1601 is configured to execute the original image in the to-be-detected video as a target image; or to down-sample the original image in the to-be-detected video, and to down-sample the original image in the video to be detected. The obtained image is used as the target image corresponding to the original image.
在一种可能的实现方式中,所述确定模块1601被配置为执行将预设的倍率作为对所述待检测视频中的原始图像进行下采样时使用的倍率;或根据预设的目标图像的分辨率以及所述待检测视频中原始图像的分辨率,确定对所述待检测视频中的原始图像进行下采样时使用的倍率。In a possible implementation manner, the determining module 1601 is configured to perform a preset magnification as the magnification used when down-sampling the original image in the video to be detected; or according to the preset target image The resolution and the resolution of the original image in the to-be-detected video determine the magnification used when down-sampling the original image in the to-be-detected video.
在一种可能的实现方式中,所述计算模块1602被配置为执行根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定两个目标图像中相同位置的像素点之间灰度值差值的平均值,将所述平均值作为所述参考值;或,根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定两个目标图像中相同位置的像素点之间灰度值差值;将 确定出的灰度值差值进行排序,将位于预设位置的灰度值差值作为所述参考值。In a possible implementation manner, the calculation module 1602 is configured to perform determination of one of the pixels at the same position in the two target images according to the gray values of the pixels in the target image corresponding to each of the two adjacent original images. The average value of the difference between the gray values, the average value is used as the reference value; or, according to the gray value of the pixel points in the target image corresponding to each of the two adjacent original images, it is determined that the two target images are the same The gray value difference between the pixel points of the position; the determined gray value difference is sorted, and the gray value difference at the preset position is used as the reference value.
在一种可能的实现方式中,所述计算模块1602被配置为执行从所述目标图像对应的灰度通道中获取每个像素点的灰度值;或根据所述目标图像对应的颜色通道的数值确定每个像素点的灰度值。In a possible implementation, the calculation module 1602 is configured to obtain the gray value of each pixel from the gray channel corresponding to the target image; or to obtain the gray value of each pixel according to the color channel corresponding to the target image. The value determines the gray value of each pixel.
关于上述实施例中的装置,其中各个模块执行请求的具体方式已经在有关该方法的实施例中进行了详细描述,此处将不做详细阐述说明。Regarding the device in the foregoing embodiment, the specific manner in which each module executes the request has been described in detail in the embodiment of the method, and detailed description will not be given here.
图17是根据一示例性实施例示出的一种用于场景切换检测的电子设备1700的框图,包括:Fig. 17 is a block diagram showing an electronic device 1700 for scene switching detection according to an exemplary embodiment, including:
处理器1710;Processor 1710;
用于存储所述处理器1710可执行指令的存储器1720;A memory 1720 for storing executable instructions of the processor 1710;
其中,所述处理器1710被配置为执行所述指令,以实现上述任一场景切换的检测方法。Wherein, the processor 1710 is configured to execute the instruction, so as to implement any of the foregoing scene switching detection methods.
在示例性实施例中,还提供了一种包括指令的非易失性存储介质,例如包括指令的存储器1720,上述指令可由电子设备1700的处理器1710执行以完成上述任一场景切换的检测方法。可选地,存储介质可以是非临时性计算机可读存储介质,例如,所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。In an exemplary embodiment, there is also provided a non-volatile storage medium including instructions, such as a memory 1720 including instructions, which can be executed by the processor 1710 of the electronic device 1700 to complete any of the foregoing detection methods for scene switching. . Alternatively, the storage medium may be a non-transitory computer-readable storage medium, for example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage Equipment, etc.
本申请实施例还提供一种计算机程序产品,当所述计算机程序产品在电子设备上运行时,使得所述电子设备执行实现上述任一场景切换的检测方法。The embodiments of the present application also provide a computer program product, which when the computer program product runs on an electronic device, causes the electronic device to execute the detection method for realizing any of the above-mentioned scene switching.
本领域技术人员在考虑说明书及实践这里公开的内容后,将容易想到本申请的其它实施方案。本申请旨在涵盖本申请的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本申请的一般性原理并包括本申请未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本申请的真正范围和精神由下面的权利要求指出。Those skilled in the art will easily think of other embodiments of the present application after considering the specification and practicing the content disclosed herein. This application is intended to cover any variations, uses, or adaptive changes of this application. These variations, uses, or adaptive changes follow the general principles of this application and include common knowledge or customary technical means in the technical field that are not disclosed in this application. . The description and embodiments are only regarded as exemplary, and the true scope and spirit of the application are pointed out by the following claims.
应当理解的是,本申请并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本申请的范围仅由所附的权利要求来限制。It should be understood that the present application is not limited to the precise structure that has been described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the application is only limited by the appended claims.

Claims (16)

  1. 一种场景切换的检测方法,该方法包括:A method for detecting scene switching, the method includes:
    确定待检测视频中原始图像对应的目标图像;Determine the target image corresponding to the original image in the video to be detected;
    根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值;According to the gray values of the pixels in the target images corresponding to two adjacent original images, determine the reference value used to indicate the degree of gray value difference between the pixels of the two target images;
    若所述参考值大于预设阈值,则确定所述待检测视频在所述相邻两帧原始图像之间发生场景切换。If the reference value is greater than the preset threshold, it is determined that the scene to be detected is switched between the two adjacent original images.
  2. 如权利要求1所述的方法,所述确定待检测视频中原始图像对应的目标图像,包括:The method of claim 1, wherein the determining the target image corresponding to the original image in the video to be detected includes:
    将所述待检测视频中的原始图像作为目标图像;或Use the original image in the video to be detected as the target image; or
    对所述待检测视频中的原始图像进行下采样,将下采样得到的图像作为所述原始图像对应的目标图像。The original image in the video to be detected is down-sampled, and the image obtained by the down-sampling is used as the target image corresponding to the original image.
  3. 如权利要求2所述的方法,根据下列方式确定对所述待检测视频中的原始图像进行下采样时使用的倍率:The method according to claim 2, determining the magnification used when down-sampling the original image in the video to be detected according to the following manner:
    将预设的倍率作为对所述待检测视频中的原始图像进行下采样时使用的倍率;或Use the preset magnification as the magnification used when down-sampling the original image in the video to be detected; or
    根据预设的目标图像的分辨率以及所述待检测视频中原始图像的分辨率,确定对所述待检测视频中的原始图像进行下采样时使用的倍率。According to the preset resolution of the target image and the resolution of the original image in the video to be detected, the magnification used when down-sampling the original image in the video to be detected is determined.
  4. 如权利要求1所述的方法,所述根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值,包括:The method according to claim 1, wherein said determining the degree of gray value difference between the pixels of the two target images according to the gray values of the pixels in the target images corresponding to the two adjacent original images. Reference values, including:
    根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定两个目标图像中相同位置的像素点之间灰度值差值的平均值,将所述平均值作为所述参考值;或Determine the average value of the gray value difference between the pixels at the same position in the two target images according to the gray values of the pixels in the target image corresponding to the two adjacent original images, and use the average value as the Reference value; or
    根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定两个目标图像中相同位置的像素点之间灰度值差值;对确定出的灰度值差值进行排序,将位于预设位置的灰度值差值作为所述参考值。Determine the gray value difference between the pixels at the same position in the two target images according to the gray values of the pixels in the target image corresponding to the two adjacent original images; sort the determined gray value differences , Taking the gray value difference at the preset position as the reference value.
  5. 如权利要求1所述的方法,根据下列方式确定所述目标图像中每个像素点的灰度值:The method according to claim 1, determining the gray value of each pixel in the target image according to the following method:
    从所述目标图像对应的灰度通道中获取每个像素点的灰度值;或Obtain the gray value of each pixel from the gray channel corresponding to the target image; or
    根据所述目标图像对应的颜色通道的数值确定每个像素点的灰度值。The gray value of each pixel is determined according to the value of the color channel corresponding to the target image.
  6. 一种场景切换的检测装置,包括:A detection device for scene switching includes:
    确定模块,被配置为执行确定待检测视频中原始图像对应的目标图像;The determining module is configured to determine the target image corresponding to the original image in the video to be detected;
    计算模块,被配置为执行根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值;The calculation module is configured to determine the reference value used to indicate the degree of gray value difference between the pixels of the two target images according to the gray values of the pixels in the target images corresponding to the two adjacent original images;
    判断模块,被配置执行为若所述参考值大于预设阈值,则确定所述待检测视频在所述相邻两帧原始图像之间发生场景切换。The judging module is configured to execute that if the reference value is greater than a preset threshold, it is determined that the scene to be detected is switched between the two adjacent original images.
  7. 如权利要求6所述的装置,所述确定模块被配置为执行将所述待检测视频中的原始 图像作为目标图像;或对所述待检测视频中的原始图像进行下采样,将下采样得到的图像作为所述原始图像对应的目标图像。The device according to claim 6, wherein the determining module is configured to execute the original image in the to-be-detected video as a target image; or down-sampling the original image in the to-be-detected video to obtain As the target image corresponding to the original image.
  8. 如权利要求7所述的装置,所述确定模块被配置为执行将预设的倍率作为对所述待检测视频中的原始图像进行下采样时使用的倍率;或根据预设的目标图像的分辨率以及所述待检测视频中原始图像的分辨率,确定对所述待检测视频中的原始图像进行下采样时使用的倍率。7. The device according to claim 7, wherein the determining module is configured to execute the preset magnification as the magnification used when down-sampling the original image in the video to be detected; or according to the preset resolution of the target image And the resolution of the original image in the video to be detected, determine the magnification used when down-sampling the original image in the video to be detected.
  9. 如权利要求6所述的装置,所述计算模块被配置为执行根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定两个目标图像中相同位置的像素点之间灰度值差值的平均值,将所述平均值作为所述参考值;或根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定两个目标图像中相同位置的像素点之间灰度值差值;对确定出的灰度值差值进行排序,将位于预设位置的灰度值差值作为所述参考值。7. The device according to claim 6, wherein the calculation module is configured to determine the distance between the pixels at the same position in the two target images according to the gray values of the pixels in the target image corresponding to each of the two adjacent original images. The average value of the gray value difference, the average value is used as the reference value; or the gray value of the pixel in the target image corresponding to each of the two adjacent original images is determined to determine the same position in the two target images The gray value difference between the pixels; the determined gray value difference is sorted, and the gray value difference at the preset position is used as the reference value.
  10. 如权利要求6所述的装置,所述计算模块被配置为执行从所述目标图像对应的灰度通道中获取每个像素点的灰度值;或根据所述目标图像对应的颜色通道的数值确定每个像素点的灰度值。7. The device of claim 6, wherein the calculation module is configured to obtain the gray value of each pixel from the gray channel corresponding to the target image; or according to the value of the color channel corresponding to the target image Determine the gray value of each pixel.
  11. 一种电子设备,包括:An electronic device including:
    处理器;processor;
    用于存储所述处理器可执行指令的存储器;A memory for storing executable instructions of the processor;
    其中,所述处理器被配置为执行确定待检测视频中原始图像对应的目标图像;根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定用于表示两个目标图像的像素点之间灰度值差异程度的参考值;若所述参考值大于预设阈值,则确定所述待检测视频在所述相邻两帧原始图像之间发生场景切换。Wherein, the processor is configured to determine the target image corresponding to the original image in the video to be detected; according to the gray value of the pixel in the target image corresponding to each of the two adjacent original images, determine to represent the two target images If the reference value is greater than the preset threshold value, it is determined that the scene switching of the video to be detected occurs between the two adjacent original images of the frame.
  12. 如权利要求11所述的电子设备,所述处理器被配置为执行将所述待检测视频中的原始图像作为目标图像;或对所述待检测视频中的原始图像进行下采样,将下采样得到的图像作为所述原始图像对应的目标图像。The electronic device according to claim 11, wherein the processor is configured to execute using the original image in the video to be detected as a target image; or down-sampling the original image in the video to be detected, and then down-sampling the original image in the video to be detected. The obtained image is used as the target image corresponding to the original image.
  13. 如权利要求12所述的电子设备,所述处理器被配置为执行将预设的倍率作为对所述待检测视频中的原始图像进行下采样时使用的倍率;或根据预设的目标图像的分辨率以及所述待检测视频中原始图像的分辨率,确定对所述待检测视频中的原始图像进行下采样时使用的倍率。The electronic device according to claim 12, wherein the processor is configured to execute a preset magnification as the magnification used when down-sampling the original image in the video to be detected; or according to the preset target image The resolution and the resolution of the original image in the to-be-detected video determine the magnification used when down-sampling the original image in the to-be-detected video.
  14. 如权利要求11所述的电子设备,所述处理器被配置为执行根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定两个目标图像中相同位置的像素点之间灰度值差值的平均值,将所述平均值作为所述参考值;或根据相邻两帧原始图像各自对应的目标图像中像素点的灰度值,确定两个目标图像中相同位置的像素点之间灰度值差值;对确定出的灰度值差值进行排序,将位于预设位置的灰度值差值作为所述参考值。The electronic device according to claim 11, wherein the processor is configured to perform determining one of the pixels at the same position in the two target images according to the gray values of the pixels in the target image corresponding to each of the two adjacent original images. The average value of the difference between the gray values, using the average value as the reference value; or determining the same position in the two target images according to the gray values of the pixels in the target image corresponding to each of the two adjacent original images The gray value difference between the pixel points; sort the determined gray value difference, and use the gray value difference at the preset position as the reference value.
  15. 如权利要求11所述的电子设备,所述处理器被配置为执行从所述目标图像对应的灰度通道中获取每个像素点的灰度值;或根据所述目标图像对应的颜色通道的数值确定每个像素点的灰度值。The electronic device according to claim 11, the processor is configured to execute obtaining the gray value of each pixel from the gray channel corresponding to the target image; or according to the color channel corresponding to the target image The value determines the gray value of each pixel.
  16. 一种存储介质,当所述存储介质中的指令由场景切换的检测电子设备的处理器执行时,使得场景切换的检测电子设备能够执行权利要求1至5中任一项所述的场景切换的检测方法。A storage medium, when the instructions in the storage medium are executed by the processor of the scene switching detection electronic device, so that the scene switching detection electronic device can execute the scene switching operation according to any one of claims 1 to 5 Detection method.
PCT/CN2020/104840 2019-09-05 2020-07-27 Scene switching detection method and apparatus, electronic device, and storage medium WO2021042909A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910836850.8A CN110675371A (en) 2019-09-05 2019-09-05 Scene switching detection method and device, electronic equipment and storage medium
CN201910836850.8 2019-09-05

Publications (1)

Publication Number Publication Date
WO2021042909A1 true WO2021042909A1 (en) 2021-03-11

Family

ID=69076013

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/104840 WO2021042909A1 (en) 2019-09-05 2020-07-27 Scene switching detection method and apparatus, electronic device, and storage medium

Country Status (2)

Country Link
CN (1) CN110675371A (en)
WO (1) WO2021042909A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110675371A (en) * 2019-09-05 2020-01-10 北京达佳互联信息技术有限公司 Scene switching detection method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030112874A1 (en) * 2001-12-19 2003-06-19 Moonlight Cordless Ltd. Apparatus and method for detection of scene changes in motion video
CN101909511A (en) * 2008-01-09 2010-12-08 奥林巴斯株式会社 Scene change detection device and scene change detection program
CN102685509A (en) * 2012-04-26 2012-09-19 中山大学 Video error control method based on scene change
CN108804980A (en) * 2017-04-28 2018-11-13 合信息技术(北京)有限公司 Switching detection method of video scene and device
CN110675371A (en) * 2019-09-05 2020-01-10 北京达佳互联信息技术有限公司 Scene switching detection method and device, electronic equipment and storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8379911B2 (en) * 2010-12-10 2013-02-19 Infosys Technologies Limited Method and system for efficient watermarking of video content
CN106210767B (en) * 2016-08-11 2020-01-07 上海交通大学 Video frame rate up-conversion method and system for intelligently improving motion fluency
CN106851049B (en) * 2017-03-06 2019-07-02 济南中维世纪科技有限公司 A kind of scene alteration detection method and device based on video analysis

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030112874A1 (en) * 2001-12-19 2003-06-19 Moonlight Cordless Ltd. Apparatus and method for detection of scene changes in motion video
CN101909511A (en) * 2008-01-09 2010-12-08 奥林巴斯株式会社 Scene change detection device and scene change detection program
CN102685509A (en) * 2012-04-26 2012-09-19 中山大学 Video error control method based on scene change
CN108804980A (en) * 2017-04-28 2018-11-13 合信息技术(北京)有限公司 Switching detection method of video scene and device
CN110675371A (en) * 2019-09-05 2020-01-10 北京达佳互联信息技术有限公司 Scene switching detection method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN110675371A (en) 2020-01-10

Similar Documents

Publication Publication Date Title
US10438361B2 (en) Image processing apparatus and image processing method for finding background regions in an image
CN104685513B (en) According to the high-resolution estimation of the feature based of the low-resolution image caught using array source
EP2864933B1 (en) Method, apparatus and computer program product for human-face features extraction
CN105938622B (en) Method and apparatus for detecting object in moving image
US9740967B2 (en) Method and apparatus of determining air quality
US8396302B2 (en) Method of detecting logos, titles, or sub-titles in video frames
CN106254933B (en) Subtitle extraction method and device
US8611728B2 (en) Video matting based on foreground-background constraint propagation
JP4664432B2 (en) SHOT SIZE IDENTIFICATION DEVICE AND METHOD, ELECTRONIC DEVICE, AND COMPUTER PROGRAM
US7403656B2 (en) Method and apparatus for recognition of character string in scene image
US10452893B2 (en) Method, terminal, and storage medium for tracking facial critical area
EP2811423B1 (en) Method and apparatus for detecting target
JP5284048B2 (en) Image processing apparatus, imaging apparatus, and image processing method
TWI438729B (en) Method and system for lane departure warning
CN108288075A (en) A kind of lightweight small target detecting method improving SSD
CN101453575B (en) Video subtitle information extracting method
EP2523165A2 (en) Image processing method and image processing device
KR100860988B1 (en) Method and apparatus for object detection in sequences
US8280106B2 (en) Shadow and highlight detection system and method of the same in surveillance camera and recording medium thereof
US8452047B2 (en) Method and apparatus for recognizing a plural number of faces, and method and apparatus for registering face, and an image capturing method and system
US8953900B2 (en) Increased quality of image objects based on depth in scene
TWI254891B (en) Face image detection method, face image detection system, and face image detection program
US20160210507A1 (en) Image processing system with layout analysis and method of operation thereof
KR20100095465A (en) Segmentation of image data
US8633999B2 (en) Methods and apparatuses for foreground, top-of-the-head separation from background

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20860327

Country of ref document: EP

Kind code of ref document: A1