KR101793653B1 - Method for recognition of scene change and server implementing the same - Google Patents

Abstract

The present invention provides a method capable of accurately recognizing whether a screen transition actually occurs by verifying a difference of color information between frames as well as a pixel pattern between the frames. Disclosed are a method for recognizing a screen transition of image content, and an operating server for the same. According to embodiments of the present invention, the method recognizing a screen transition of image content in a server comprises the following steps: checking a change value of the color information between a first frame among the frames included in the image content and a second frame, the next frame of the first frame; and recognizing whether the screen transition occurs by verifying the pixel pattern between the first and second frames when the checked change value of the color information is more than or equal to a predetermined value.

Description

TECHNICAL FIELD [0001] The present invention relates to a method for recognizing a screen transition of a video content and a server for operating the same,

Various embodiments of the present invention are directed to a method of recognizing screen transition of video content, more specifically, a technique of automatically distinguishing successive frames from video content such as moving images based on scene change.

Recently, various techniques have been introduced to distinguish screen switching scenes from video contents such as moving pictures. For example, an algorithm has been proposed that calculates the moving speed of an object included in a moving image and judges that a screen switching occurs when the moving speed exceeds a preset reference speed.

In addition, a technique of analyzing a color histogram between frames and detecting a screen switching based on a color change value of the analyzed histogram is proposed, and a technique of classifying a moving picture into a plurality of intervals has been proposed.

Korean Patent Registration No. 10-0411347

There is a problem in that it is difficult to accurately recognize whether or not the screen is switched because the conventional screen switching recognition method recognizes whether or not the scene is switched based on the color change such as color simply between frames.

For example, since the change to the color histogram is performed by being sensitive to changes in illumination and brightness, the server does not actually change the scene, Errors that are recognized as differences often occur.

Various embodiments of the present invention have been devised to solve the above problems and provide a method of accurately recognizing whether a scene change has actually occurred by verifying a pixel pattern between frames as well as a difference of color information between frames It has its purpose.

A method of recognizing screen transition of video content according to various embodiments of the present invention is a method of recognizing a screen transition of video content in a server, the method comprising: receiving a first frame of frames included in the video content and a next frame of the first frame Confirming a change value of color information between the second frame; And a step of verifying the presence or absence of the screen change by verifying the pixel pattern between the first frame and the second frame when the change value of the identified color information is equal to or greater than a predetermined value.

In the method of recognizing the screen transition according to various embodiments of the present invention, the step of verifying the pixel pattern and recognizing the presence or absence of the screen switching may include the steps of: dividing each of the first frame and the second frame into a plurality of pixel pattern areas Step to block; Identifying a number of pixel pattern areas of the first frame matching a predetermined deviation from the pixel pattern areas of the second frame; And determining whether to switch the screen based on the number of the windows that are matched with the predetermined deviation.

In the method of recognizing screen transition of image content according to various embodiments of the present invention, the step of determining whether or not to switch the screen based on the number of matches matched with the predetermined deviation may include determining whether the number of matches matched to the predetermined deviation is equal to or greater than a set threshold value Recognizing that the screen switching has not been performed; And recognizing that the screen switching has been performed when the number of matches with the predetermined deviation is less than the preset threshold value.

In the method of recognizing the change of the color information, the step of identifying the change value of the color information may include: dividing each of the first frame and the second frame into a plurality of color regions; Identifying color regions that match between the first frame and the second frame; And confirming a change value of the color information corresponding to each color region in the identified color region.

According to another aspect of the present invention, there is provided a method of recognizing a screen transition of image content, the method comprising: decreasing a number of colors of each of the plurality of color regions when a change value of the color information corresponding to each color region is equal to or greater than a predetermined value; And checking the change value of the color information corresponding to each color area based on the reduced number of colors.

According to another aspect of the present invention, there is provided a method of recognizing a scene change of video content, the method comprising: performing a change value check of the color information and a verify pixel pattern for all the frames of the image content; Confirming a screen switching time point of the image content based on the result; And dividing the image content into a plurality of intervals based on the confirmed screen switching points.

A server according to various embodiments of the present invention is a server that recognizes screen transition of image content, and is a server that changes a color information between a first frame of frames included in the image content and a second frame that is a next frame of the first frame A color information confirmation unit for confirming a value; And a screen transition recognizing unit that verifies the pixel pattern between the first frame and the second frame and recognizes whether or not the screen is switched when the change value of the identified color information is equal to or larger than a predetermined value.

In the server according to various embodiments of the present invention, the screen transition recognizing unit may divide each of the first frame and the second frame into a plurality of pixel pattern areas, and the second one of the pixel pattern areas of the first frame, And recognizing that the screen switching is not performed when the number of matched pixels matches a predetermined threshold value, and if the number of matched pixels is greater than a predetermined threshold, If it is less than the set threshold value, it can be recognized that the screen switching is performed.

In the server according to various embodiments of the present invention, the color information verifying unit may divide each of the first frame and the second frame into a plurality of color regions, and may further include a color matching unit for color matching between the first frame and the second frame, And the change value of the color information corresponding to each color region can be confirmed in the identified color region.

In the server according to various embodiments of the present invention, the screen change recognition unit may perform a change value check of the color information and a verify pixel pattern for all the frames of the image content, And may further include a section dividing unit for dividing the image content into a plurality of sections based on the confirmed screen switching point of time.

The server according to various embodiments of the present invention can recognize not only the change value of color information between frames but also the inter-frame pixel pattern to recognize the presence or absence of the screen change, thereby more accurately recognizing the scene change of the image content.

Also, when the inter-frame pixel pattern is verified, the server may concretely implement the detailed screen switching recognition according to the pixel pattern by dividing the frame into a plurality of pixel pattern regions and determining the number of pixel patterns to be matched between frames.

In addition, the server according to various embodiments of the present invention is capable of minimizing the recognition error of the scene change by recognizing the change value of the inter-frame color information step by step.

1 is a configuration diagram of a server according to various embodiments of the present invention.
2 is a flowchart illustrating an operation of recognizing screen transition of image contents in a server according to various embodiments of the present invention.
FIG. 3 is a flowchart illustrating a specific operation for checking a change value of color information in a server according to various embodiments of the present invention.
FIGS. 4A and 4B are diagrams illustrating an example of an operation for stepwise confirming a change value of color information. FIG.
5 is a flowchart illustrating a concrete operation for verifying a pixel pattern in a server according to various embodiments of the present invention.
6 is an exemplary diagram illustrating a matching operation of a pixel pattern region according to various embodiments of the present invention.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described in detail below. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs. In addition, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

Hereinafter, a method of recognizing screen transition of image contents and a server 100 for operating the same will be described with reference to the accompanying drawings.

1 is a configuration diagram of a server 100 according to various embodiments of the present invention.

According to various embodiments, the server 100 includes a communication unit 110, a control unit 120, a content receiving unit 121, a color information checking unit 123, a screen switching recognizing unit 125, a section dividing unit 127, And a storage unit 130. As a non-limiting embodiment, the server 100 may omit at least some of the components of FIG. 1 or may further comprise additional components.

The communication unit 110 can communicate with an external device. For example, the communication unit 110 may be connected to a network through wireless communication or wired communication, and may connect the server 100 with an external device (e.g., a broadcasting company server).

The communication unit 110 may transmit the image contents partitioned according to the screen switching interval to an external device (e.g., an OTT provider server, a web server, or the like) under the control of the control unit 120. [

The control unit 120 may perform a data processing function for controlling the signal flow between the overall operation such as the power supply control of the server 100 and the internal configuration of the server 100 and processing the data. The control unit 120 may include at least one processor and may be a central processing unit (CPU), an application processor (AP), or a communication processor (CP) ≪ / RTI >

The content receiving unit 121 may communicate with an external device through the communication unit 110 to receive at least one image content. For example, the content receiving unit 121 may receive image content to perform screen transition period recognition from an external device such as a broadcasting company server.

Here, the image content may be moving image data composed of a plurality of frames.

The color information confirmation unit 123 can check the change value of the color information between consecutive frames included in the image content. The color information confirming unit 123 receives information on whether the change value of the identified color information or the change value of the identified color information is equal to or greater than a predetermined value, and outputs the information to the control unit 120, the screen change recognition unit 125, (130).

According to various embodiments, the color information confirmation unit 123 can stepwise check the change value of color information between frames. For example, the color information confirmation unit 123 may firstly divide or divide a frame into a plurality of color regions to check the change value of the color information corresponding to the color region of each frame. When the change value of the identified color information is equal to or larger than a preset value, the color information confirmation unit 123 may secondarily reduce the number of colors of each color region to measure a change value of the color information in a wider range.

The screen change recognition unit 125 may recognize whether the screen is switched based on the color information between the frames confirmed by the color information confirmation unit 123. [ Then, the screen switching recognition unit 125 can determine whether to switch the screen by considering the pixel pattern between the frames.

According to various embodiments, the screen switch recognizing unit 125 may divide each of the consecutive frames into a plurality of pixel pattern areas. Then, the number of pixel pattern regions corresponding to a certain deviation between consecutive frames can be confirmed, and it is possible to determine the screen switching based on the confirmed number.

When the screen switching recognition unit 125 recognizes that screen switching has been performed, the section dividing unit 127 can divide the image content into a plurality of sections based on the recognized screen switching point.

The storage unit 130 may store data received or generated from the control unit 220 or other components of the server 100. The storage unit 130 may include, for example, a memory, a cache, a buffer, and the like, and may be configured by software, firmware, hardware, or a combination of at least two of them.

According to various embodiments, the storage unit 130 may include a content DB 131 and an information DB 133. Although the content DB 131 and the information DB 133 are shown as being separated on the storage unit 130, the content DB 131 and the information DB 133 may be configured as one module.

The content DB 131 may include image content and information related to the image content (e.g., image content metadata). The information related to the image content and the image content may be added or updated periodically or at any time.

The information DB 133 may include color information, pixel information, and screen switching time information confirmed in the image contents. In addition, the information DB 133 may store a preset value for verifying a preset value and a pixel pattern for comparison with a change value of the color information.

The content receiving unit 121, the color information identifying unit 123, the screen switching recognizing unit 125 and the interval dividing unit 127 logically or functionally classify each function of the control unit 120 of the server 100 . Accordingly, the content receiving unit 121, the color information identifying unit 123, the screen switching recognizing unit 125, the section dividing unit 127, and the control unit 120 may be configured as a single module.

The functions of the content receiving unit 121, the color information confirming unit 123, the screen switching recognizing unit 125, the interval dividing unit 127 and the control unit 120 are the same as the functions of the routines stored in the storage unit 130 , An instruction, or a program.

In addition, such routines, instructions or programs may also be stored on a computer readable storage medium. Such a storage medium includes all kinds of storage media in which programs and data are stored so that they can be read by a computer system. Examples include ROMs (Read Only Memory), Random Access Memory, CD (Compact Disk), DVD (Digital Video Disk) -ROM, magnetic tape, floppy disk, optical data storage device, . Such storage medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner.

FIG. 2 is a flowchart illustrating an operation of recognizing screen switching of image contents in the server 100 according to various embodiments of the present invention.

First, in step S210, the server 100 may load image content. For example, the server 100 can load image content by calling image content stored in the content DB 131 or receiving image content from an external device through the communication unit 110. [

Next, in step S230, the server 100 can confirm the change value of the color information between consecutive frames (e.g., the first frame and the second frame). Specifically, the server 100 can check the color information of the first frame and the second frame, which are consecutive frames of the image content, and can detect the change value of the confirmed color information. More specific contents related to the detection of the change value of the color information will be described later with reference to FIG. 3 to FIG. 4B.

Next, when the change value of the color information satisfies a predetermined condition (e.g., a predetermined change value), the server 100 can verify the pixel pattern between consecutive frames in step S250. Details related to the verification of the pixel pattern will be described later with reference to FIG. 5 to FIG.

Based on the verification result of the pixel pattern, the server 100 can recognize whether or not the screen is switched in step S270. In step S290, the server 100 may divide the image content into a plurality of sections based on the recognized screen switching points.

FIG. 3 is a flowchart illustrating a specific operation for checking a change value of color information in the server 100 according to various embodiments of the present invention. The contents of FIG. 3 may be a specific example of step S230 of FIG. For the detailed explanation of FIG. 3, description will be made with reference to FIGS. 4A and 4B. FIGS. 4A and 4B are diagrams illustrating an example of an operation for stepwise confirming a change value of color information. FIG.

First, in step S310, the server 100 may divide a frame into a plurality of color areas, and in step S320, color areas matching between consecutive frames (e.g., a first frame and a second frame) may be identified , The change value of the color information corresponding to the color area can be confirmed in step S330.

Specifically, the server 100 can divide the first frame and the second frame, which are continuous frames, into a plurality of color regions, and can confirm the color information of the color regions corresponding to each other on each frame. For example, the server 100 may check the change value of the color information using various color recognition techniques or algorithms.

For example, referring to FIG. 4A, a first frame (frame A_1) and a second frame (frame B_1), which are consecutive frames, are shown. The first frame (frame A_1) and the second frame (frame B_1) may be frames included in a section constituting the image content.

Although not specifically shown in FIG. 4A, the server 100 may divide the first frame (frame A_1) and the second frame (frame B_1) into virtual blocks having a plurality of M * N sizes, Each of the M * N blocks can be recognized as respective color regions. 4A, the server 100 may determine that the difference between the color regions of the first frame (frame A_1) and the color regions of the second frame (frame B_1) is changed by a predetermined value or more .

Referring back to FIG. 3, in step S340, the server 100 can check whether the change value of the color information corresponding to the color region is equal to or greater than a predetermined value. Here, the predetermined value may be a value different from the previously set value in FIG. As a non-limiting example, the predetermined value in FIG. 3 may mean a change value that is lower than a predetermined value in FIG. 2, and the predetermined value may be a value set to stepwise check the change value of the color information.

According to various embodiments, the server 100 may calculate the average value of the change values corresponding to the respective color regions of the frame, and may determine the change value of the frame for comparing the calculated average value with a preset value. The change value thus determined may be compared with a value stored in the storage unit 130 in advance.

If the change value of the color information is less than the predetermined value, the server 100 can end the operation of FIG. On the contrary, if the change value of the color information is less than the predetermined value, the server 100 may branch each of the frames so as to reduce the number of hues of the color regions of each frame.

For example, since the change value between the frames in FIG. 4A is equal to or greater than a preset value due to the above-described assumption, the server 100 decreases the number of colors of the color regions of each frame, And the second frame (frame B_1) into the first frame (frame A_2) and the second frame (frame B_2) of FIG. 4B.

Referring back to FIG. 3, in step S360, the server 100 can confirm the change value of the color information based on the reduced number of colors. For example, the server 100 checks the color areas of the first frame (frame A_2) and the second frame (frame B_2) processed to reduce the number of colors as shown in FIG. 4B, The change value can be confirmed again. As a non-limiting example, the change value determined for comparison may be calculated as an average value of the change value of each color region as described above.

By checking the change value of the inter-frame color information in a wider range as described above, it is possible to prevent the scene change error phenomenon due to the sudden change in the color information in the specific partial area even though the scene change is not performed .

FIG. 5 is a flowchart illustrating a concrete operation of verifying a pixel pattern in the server 100 according to various embodiments of the present invention. The contents of FIG. 5 may be a concrete example of step S250 of FIG. For the specific description of Fig. 5, description will be given with reference to Fig. 6 is an exemplary diagram illustrating a matching operation of a pixel pattern region according to various embodiments of the present invention.

First, in step S510, the server 100 may divide a frame into a plurality of pixel pattern regions. For example, the server 100 may divide at least some frames of the image content into virtual blocks having a plurality of M * N sizes, and divide each of the divided M * N blocks into respective pixel pattern areas Can be recognized.

For example, referring to FIG. 6, the server 100 may divide the first frame 601 into 20 pixel pattern regions. And, since the divided pixel pattern regions have virtual identifiers 1 to 20, the server 100 can identify each pixel pattern region of the first frame 601 through the identifier. In FIG. 6, although the identifiers of the 20 pixel pattern regions are displayed on the frame, the specific image may be partitioned into a virtual divided form on the actual image contents as shown in FIG. 4A or FIG. 4B. In addition, the number of such pixel pattern regions is not limited to a certain number in the present invention.

According to various embodiments, the server 100 may partition such pixel pattern regions into a larger size than the above-described color regions.

Next, in step S520, the server 100 may match the pixel pattern area with a predetermined deviation of consecutive frames (e.g., the first frame and the second frame), and in step S530, The number of areas can be checked.

As a specific example, referring to FIG. 6, a second frame 603 is shown. The second frame 603 is a frame that is continuously reproduced following the first frame 601, and may be divided into a plurality of pixel pattern regions and partitioned by the server 100.

When the first pixel pattern area to the 20th pixel pattern area of the first frame 601 is referred to as a subject (e.g., a portrait close-up screen), the scene is not switched, Can be moved in a specific direction. In this case, a new subject or background image may be exposed in the place where the existing subject exists. That is, the 21st pixel pattern region to the 28th pixel pattern region corresponding to the new subject or background screen are exposed on the second frame 603.

Then, in step S540, the server 100 can check the number of overlapping (e.g., matched) pixel pattern areas included in the first frame 601 and pixel pattern areas included in the second frame 603 . In this case, the server 100 can identify the pixel pattern regions overlapping with a certain deviation. For example, the server 100 determines that the pixel pattern areas of the second frame 603 of FIG. 6 have moved from the pixel pattern areas of the first frame 601 to a certain pattern (e.g., one lower right corner) Can be confirmed. If the number of matches with a predetermined deviation is less than a preset threshold value (e.g., a predetermined number), the server can recognize that the screen has been switched in step S550. In this case, the server 100 can check the contact point of time between consecutive frames as a screen switching point, and store information related to the checked screen switching point in the storage unit 130.

On the other hand, if the number of matches with a predetermined deviation is equal to or greater than a predetermined number, the server 200 can recognize that the screen is not switched in step S560. Then, the server 100 can repeat the process of recognizing the screen transition between the currently confirmed last frame and the next consecutive frame.

6, in a first frame 601 and a second frame 603, a total of 14 pixel regions ranging from the first pixel region to the 14th pixel region have a predetermined deviation (for example, one lower right corner) . ≪ / RTI > If the preset number is seven, the server 100 can recognize that the scene between the first frame 601 and the second frame 603 has not been switched since the number of matches with a predetermined deviation is equal to or greater than a predetermined number .

Such a constant deviation can be confirmed based on a predetermined angle, a coordinate on a frame, or the like. In FIG. 6, all of the pixel regions are shown to be shifted by a predetermined deviation, but a pixel region that moves with a non-uniform variation may occur according to the actual screen configuration. The embodiment of the present invention provides an embodiment of the screen switching recognition method for determining such unevenness as noise.

In consideration of the feature that the screen switching recognition process is acted sensitively according to the illuminance and brightness change on the frame in the prior art, by sensing the pixel pattern shifted with a certain deviation as described above, the same subject or background is displayed on the consecutive frame It is still possible to determine whether or not an existing image exists. Thus, even if the screen switching is not performed, the error process recognized as the screen switching can be minimized.

The term " module " or " part " as used in various embodiments of the present invention may mean a unit comprising one or a combination of two or more of, for example, hardware, software or firmware . &Quot; Module " or " to " may be used interchangeably with terms such as, for example, unit, logic, logical block, component or circuit, . The term " module " or " part " may be a minimum unit or a part of an integrally constructed part, or may be a minimum unit or a part thereof performing one or more functions. &Quot; Modules " or " parts " may be implemented mechanically or electronically. For example, a " module " or " part " in accordance with various embodiments of the present invention may be implemented as an application-specific integrated circuit (ASIC) chip, FPGAs (field- ) Or a programmable-logic device.

Modules or programming modules according to various embodiments of the present invention may include at least one or more of the elements described above, some of which may be omitted, or may further include other additional elements. Operations performed by modules, programming modules, or other components in accordance with various embodiments of the invention may be performed in a sequential, parallel, iterative, or heuristic manner. Also, some operations may be performed in a different order, omitted, or other operations may be added.

100: Server

Claims (10)

A method for recognizing screen transition of video content in a server,
Checking a change value of color information between a first frame of frames included in the image content and a second frame that is a next frame of the first frame; And
And verifying the pixel pattern between the first frame and the second frame and recognizing the presence or absence of the screen change if the change value of the identified color information is equal to or greater than a predetermined value,
Wherein the step of verifying the change value of the color information comprises:
Dividing each of the first frame and the second frame into a plurality of color regions;
Identifying color regions that match between the first frame and the second frame;
Confirming a change value of color information corresponding to each color region in the identified color region;
Decreasing the number of colors of each of the color regions when the change value of the color information corresponding to each color region is equal to or greater than a predetermined value; And
And redetermining a change value of the color information corresponding to each color area based on the reduced number of colors,
Wherein the step of verifying the pixel pattern and recognizing the presence or absence of the screen switching comprises:
Dividing each of the first frame and the second frame into a plurality of pixel pattern regions;
Identifying a number of pixel pattern regions of the first frame matching a predetermined deviation from the pixel pattern regions of the second frame; And
And determining whether or not to switch the screen based on the number matched with the predetermined deviation. delete The method according to claim 1,
Wherein the step of determining whether or not to switch the screen based on the number matched with the predetermined deviation comprises:
Recognizing that the screen switching is not performed when the number of matched with the predetermined deviation is equal to or greater than a preset threshold value; And
And recognizing that the screen switching has been performed when the number of matching is less than the set threshold value. delete delete The method according to claim 1,
Performing a verification of a change value of the color information and a verification of a pixel pattern for all the frames of the image content;
Confirming a screen switching time point of the image content based on the result; And
And dividing the image content into a plurality of intervals based on the confirmed screen switching points. A server for recognizing a screen transition of a video content,
A color information verifying unit for verifying a change value of color information between a first frame of frames included in the image content and a second frame that is a next frame of the first frame; And
And a screen switching recognition unit for recognizing whether or not the screen is switched by verifying the pixel pattern between the first frame and the second frame when the change value of the identified color information is equal to or larger than a preset value,
The color-
Wherein each of the first frame and the second frame is divided into a plurality of color regions, color regions matching between the first frame and the second frame are identified, and a color corresponding to each color region in the identified color region And when the change value of the color information corresponding to each color area is equal to or greater than a predetermined value, the number of colors of each of the color areas is reduced, and the number of colors corresponding to each color area The change value of the color information is re-
Wherein the screen change recognition unit comprises:
Wherein each of the first frame and the second frame is divided into a plurality of pixel pattern regions and a number of the pixel pattern regions of the first frame is matched with a predetermined deviation from the pixel pattern regions of the second frame, And determines whether or not to switch the screen based on the number matched with the predetermined deviation. delete delete 8. The method of claim 7,
Wherein the screen change recognition unit comprises:
Performing a verification of a change value of the color information and a verification of a pixel pattern for all the frames of the image content,
The server further includes a section dividing section for dividing the image content into a plurality of sections based on the screen switching point of time of the image contents based on the result of the screen switching recognition section, The server is one.

Images