KR101945243B1 - Method and Apparatus For Providing Multiple-Speed Reproduction of Video - Google Patents

Method and Apparatus For Providing Multiple-Speed Reproduction of Video Download PDF

Info

Publication number
KR101945243B1
KR101945243B1 KR1020160002313A KR20160002313A KR101945243B1 KR 101945243 B1 KR101945243 B1 KR 101945243B1 KR 1020160002313 A KR1020160002313 A KR 1020160002313A KR 20160002313 A KR20160002313 A KR 20160002313A KR 101945243 B1 KR101945243 B1 KR 101945243B1
Authority
KR
South Korea
Prior art keywords
frame
frames
correlation
image
matrix
Prior art date
Application number
KR1020160002313A
Other languages
Korean (ko)
Other versions
KR20170082944A (en
Inventor
김봉모
Original Assignee
에스케이 텔레콤주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 에스케이 텔레콤주식회사 filed Critical 에스케이 텔레콤주식회사
Priority to KR1020160002313A priority Critical patent/KR101945243B1/en
Publication of KR20170082944A publication Critical patent/KR20170082944A/en
Application granted granted Critical
Publication of KR101945243B1 publication Critical patent/KR101945243B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00007—Time or data compression or expansion
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00086—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
    • G11B20/00166—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving measures which result in a restriction to authorised contents recorded on or reproduced from a record carrier, e.g. music or software
    • G11B20/00181—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving measures which result in a restriction to authorised contents recorded on or reproduced from a record carrier, e.g. music or software using a content identifier, e.g. an international standard recording code [ISRC] or a digital object identifier [DOI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/915—Television signal processing therefor for field- or frame-skip recording or reproducing

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

Disclosed is a method and an apparatus for reproducing an image at a double speed.
Provided are a method and an apparatus for speedily reproducing an image, which is capable of reproducing a smooth and stabilized image at various speeds by using a variation amount analysis between frames, in an image taken without a stabilizing device in a general photographing apparatus other than a fixed type camera.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001]

The present embodiment relates to a method and an apparatus for reproducing an image at double speed.

The contents described below merely provide background information related to the present embodiment and do not constitute the prior art.

Generally, "Time Lapse" is an imaging method in which still image data is continuously shot with an interval and recorded as one moving image data. For example, "time-lapse" is a photographing method in which a process of growing a plant or a change in weather is photographed at a predetermined time interval (interval) and then stored as one moving image data.

In recent years, as general imaging equipment such as 'sports' / 'action' / 'life' camcorders such as a handheld camera or GoPro HERO, a 'wearable camera' It is a tendency to frequently record, store and share everyday life, extreme situations, and non-shootable sports. However, images taken with a general shooting device (such as a 'sports' / 'action' / 'life' camcorder or a 'smart phone') have a problem that the image is too long or complicated and monotonous for the user to watch later.

Conventional techniques for solving the above-mentioned problems include a technique of applying a time-lapse image to an image photographed by general photography equipment ('sports' / 'action' / 'living' camcorder or 'smart phone' A technique of sampling only a frame corresponding to a set speed (for example, " 10 times speed ") has been used. In other words, the vast majority of videos that have not been edited and edited by professionals are long-lived and monotonous, providing a time-lapse feature that reduces video length for certain vendors.

However, when a frame corresponding to a predetermined speed is simply sampled and played back (image playback speed), the image may appear shaky or shaky. In other words, the time-lapse skips the frame according to the user-specified speed. In the case of the image taken while the photographer moves without the professional equipment for stabilizing the photographing equipment, it is inconvenient to view the camera because the camera has an unstable camera path there is a problem. Especially, in the case of playing back an image captured in a moving state rather than a fixed camera at a speed of 2x, the image corresponding to the final result applied with time-lapse may be largely shaken.

The present embodiment is directed to a method and an apparatus for performing a double speed reproduction of an image which enables a smooth and stabilized image to be reproduced at various speeds by using a variation amount analysis between frames, In order to solve the problem.

According to an aspect of the present invention, there is provided an operation method of a video double speed playback apparatus, comprising: an input step of inputting an original video; A frame matching step of calculating a correlation matrix by matching feature points of each frame of the original image with each other; Calculating a cost matrix comparing a correlation between frames based on the correlation matrix and selecting only a path frame having the highest correlation among frames based on the cost matrix; And a rendering step of rendering an image for double speed reproduction based on the path frame.

According to another aspect of the present invention, there is provided an image processing method comprising: inputting an original image in combination with hardware; A frame matching step of calculating correlation matrices by matching minutiae points of each frame of the original image with each other; Calculating a cost matrix for comparing associations between frames based on the correlation matrix and selecting only a path frame having the highest correlation among frames based on the cost matrix; And a rendering process of rendering an image for double speed playback based on the path frame.

According to another aspect of the present invention, there is provided an image processing apparatus including an input unit for inputting an original image; A frame matching unit for calculating correlation matrices by matching feature points of each frame of the original image with each other; A frame selector for calculating a cost matrix comparing the associativity between frames based on the correlation matrix and selecting only a path frame having the highest correlation among frames based on the cost matrix; And a rendering unit for rendering an image for double speed reproduction based on the path frame.

As described above, according to the present embodiment, it is possible to reproduce a smooth and stabilized image at various speeds by using a variation amount analysis between frames, in an image taken without a stabilizing device in a general photographing device, .

According to the present embodiment, when a frame corresponding to a predetermined speed is sampled, the image looks shaky or unstable. On the other hand, a cost matrix comparing the associativity between frames based on the correlation matrix is calculated, The path can be determined, and the data processing amount of computation can be reduced to increase the execution speed.

According to this embodiment, not only the cost matrix is calculated for all the frames, but the correlation matrix is compared only with the route frame selected by the greedy method, and the cost matrix is calculated, thereby reducing the amount of calculation.

FIGS. 1A and 1B are block diagrams schematically showing a video double speed playback apparatus according to the present embodiment.
FIG. 2 is a flowchart for explaining the video double speed playback process according to the present embodiment.
FIGS. 3A to 3C are diagrams for explaining a comparison between a general camera path and a stabilized camera path according to image double speed playback.
FIG. 4 is a flowchart for explaining a frame matching process according to the present embodiment.
5 is a flowchart illustrating a frame selection process according to the present embodiment.
6 is an exemplary diagram for explaining a cost matrix according to the present embodiment.
FIGS. 7A and 7B are diagrams for explaining a comparison between frame selection during normal speed reproduction and frame selection according to the present embodiment.

Hereinafter, the present embodiment will be described in detail with reference to the accompanying drawings.

The 'double speed reproduction' described in the present embodiment basically means a video which operates not only in a speed up video but also in a stable camera motion. In other words, the 'speed reproduction' described in this embodiment means a fast image (stable and fast reproduced image) moving in a stable camera path.

The 'stable image' described in this embodiment means that an image matching the camera path photographed by the expert is output. Normally, a specialist shoots a moving camera path that does not shake the image by using an imaging assistant when shooting while moving.

'Correlation matrix (homography)' described in this embodiment means a matrix including variation parameter between adjacent frames. "Correlation matrix" is x-axis shift amount (t x) parameters, y-axis movement amount (t y) parameters, the rotational angle (Angle) (θ) parameters, the size (Scale) parameter, the aspect ratio (Aspect Ratio) parameters, the front end (Shear ) ≪ / RTI > parameter and a perspective parameter. The 'correlation matrix' may be a 3 × 3 matrix. The 'correlation matrix' does not need to be recalculated once it is calculated and saved.

The 'Cost Matrix' described in this embodiment means a kind of scalar value obtained by comparing correlation matrices between frames. The 'cost matrix' is newly calculated using the pre-stored 'correlation matrix' according to the speed that the user inputs. A chain rule may be applied to a correlation matrix between neighboring frames in order to speed up the processing speed in calculating the 'cost matrix'.

FIGS. 1A and 1B are block diagrams schematically showing a video double speed playback apparatus according to the present embodiment.

The video double speed playback apparatus 100 according to the present embodiment includes an input unit 110, a frame matching unit 120, a frame selecting unit 130, a path stabilizing unit 140, and a rendering unit 150. The constituent elements included in the image data playback device 100 are not limited thereto.

Each component included in the image data playback device 100 may be connected to a communication path connecting a software module or a hardware module in the device so as to operate organically with each other. These components communicate using one or more communication buses, signal lines, or wireless communications.

Each component of the video playback device 100 shown in FIG. 1 refers to a unit for processing at least one function or operation, and may be implemented as a software module, a hardware module, or a combination of software and hardware.

The video double speed playback apparatus 100 according to the present embodiment basically means a device that not only provides speed up video but also outputs a video (a video that is stably and quickly reproduced) in a stable camera path.

The video image playback apparatus 100 is provided with (i) a communication device such as a communication modem for performing communication with various devices or wired / wireless networks, (ii) a memory for storing various programs and data, (iii) And a microprocessor for controlling the microprocessor and the like. According to at least one embodiment, the memory may be a computer such as a random access memory (RAM), a read only memory (ROM), a flash memory, an optical disk, a magnetic disk, or a solid state disk Readable recording / storage medium. According to at least one embodiment, a microprocessor can be programmed to selectively perform one or more of the operations and functions described in the specification. In accordance with at least one embodiment, the microprocessor may be implemented in hardware, such as an Application Specific Integrated Circuit (ASIC), in wholly or partially of a particular configuration. If the components of the image-speed playback apparatus 100 are implemented as software modules, they can be stored in the memory.

The input unit 110 receives the original image.

The frame matching unit 120 calculates a correlation matrix by matching feature points of each frame of the original image with each other. The frame matching unit 120 includes a feature point extracting unit 122, a descriptor checking unit 124, and a correlation calculating unit 126.

The feature point extracting unit 122 extracts feature points for all the frames included in the original image. The descriptor confirmation unit 124 confirms a descriptor for each minutiae of each frame.

The correlation calculation unit 126 calculates correlation matrices between frames by matching descriptors among neighboring frames among all frames. Correlation matrix is a 3 × 3 matrix, a change amount parameter between adjacent frames, x-axis movement amount (t x) parameters, y-axis movement amount (t y) parameters, the angle of rotation (θ) parameters, size parameters, and the aspect ratio parameter, shear parameters And a projection parameter. The correlation calculation unit 126 may selectively remove an outlier using an algorithm for selecting a model having a maximum consensus in random sample data when matching the descriptors between neighboring frames. .

The frame selector 130 calculates a cost matrix comparing the associativity between frames based on the correlation matrix, and selects only the path frame having the highest correlation among the frames based on the cost matrix. The frame selection unit 130 includes a relevance calculation unit 132, a weight calculation unit 134, and a cost calculation unit 136. [

The relevancy calculator 132 calculates inter-frame associations based on the correlation matrix of the first frame and the correlation values of the correlation matrix up to the frame in which the frame is twice as large as the playback speed. The relevancy calculator 132 calculates inter-frame associations by multiplying the correlation matrix of the frame by the correlation matrix of the subsequent frames.

The weight calculation unit 134 calculates a value for satisfying the speed set by the user for each frame. The weight calculation section 134 to on the basis of the i-th frame index (i), j-th frame index (j), the user sets playback speed value (v), the threshold value (τ s) satisfy the speed the user has preset (C s ) for the first time.

The cost calculation unit 136 calculates the cost matrix by combining the inter-frame relevance and the values for satisfying the speed set by the user, and repeats the process of selecting the frame having the minimum value among the cost matrices as the path frame to the last frame . The cost calculation unit 136 calculates the amount of image movement and the amount of overlapping (C m ) for the amount of overlapping, the weight (? S ) for the value for keeping the speed, and the double speed satisfaction value (C s ) for satisfying the speed set by the user Based on the cost matrix is calculated.

The path stabilizing unit 140 optimizes and stabilizes the camera path based on the path frame received from the frame selecting unit 130. The rendering unit 150 renders an image for double speed playback based on the stabilized camera path. The rendering unit 150 can communicate with the frame selection unit 130 without rendering the path stabilization unit 140 and render an image for double speed playback based on the path frame.

FIG. 2 is a flowchart for explaining the video double speed playback process according to the present embodiment.

The video-image playback device 100 receives the original video (captured video) (S210). For example, the image double speed playback apparatus 100 receives an original image (1,800 frames) of one minute of video having 30 frames per second (FPS) per second. In step S210, the original image refers to an image photographed by a general photographing apparatus, not a fixed type camera, without a separate stabilizing apparatus.

The image-speed playback apparatus 100 extracts feature points of each of the frames (1,800 frames) included in the original image. The image data playback device 100 performs matching between adjacent frames using the minutiae of each frame (S220). For example, the image double speed playback apparatus 100 may be configured to select one of the adjacent frames ('first to second frame', 'second to third frame', 'third to fourth frame' Frame '). The image quality playback apparatus 100 calculates a correlation matrix between adjacent frames (first to second frame, second to third frame, third to fourth frame, ..., 1,799 to 1,800 th frame) . Correlation matrices between adjacent frames need not be recalculated once calculated. In step S220, the image quality doubling playback apparatus 100 calculates correlation matrices by matching feature points of each frame of the original image with each other. A concrete operation method of calculating the correlation matrix will be described below with reference to FIG.

The image data playback device 100 selects a frame having the highest relevance among the matched frames as a path frame (S230). In step S230, the image quality playback apparatus 100 calculates a cost matrix in which associations among frames are compared based on a correlation matrix. The image-quality playback apparatus 100 selects a frame having the highest correlation among frames as a path frame by using a cost matrix. For example, when the double-speed reproduction is set to 16-times speed, the image-type double-speed playback apparatus 100 compares the first frame (reference frame) with the second through the 32nd frame (double speed x 2) The highest frame is selected as the route frame.

The video image playback device 100 calculates a cost matrix to check the association between the first frame (reference frame) and the second to 32 < th > frame (double speed x 2). For example, when the double speed reproduction is set to the 16x speed, the image double speed playback apparatus 100 calculates a cost matrix for comparing the first frame (reference frame) to the second to the 32nd frame (twice the speed).

First, the image data playback device 100 checks the amount of change between the 'first frame' and the 'second frame', checks the amount of change of the 'first frame' and the 'third frame' Check the amount of change of the 'fourth frame', and check the amount of change of the 'first frame' and the '32nd frame'. Then, the image data playback device 100 selects the frame having the minimum value among the variation amounts as the path frame having the highest correlation with the 'first frame'. A specific method of calculating the cost matrix will be described below with reference to FIG.

Since the image multiplier 100 calculates all of the correlation matrices between adjacent frames in step S220, only the cost matrix corresponding to the speed selected by the user is calculated in step S230, and the optimum path made of the frames having high relevance is easily Can be confirmed.

The image quality playback apparatus 100 may apply the chain rule to the correlation matrix between neighboring frames to increase the computation processing speed. For example, when it is desired to check how much the '1 st frame' and the '10 th frame' are different from each other, the image data playback apparatus 100 may calculate the correlation matrix of the 1 st and 2 nd frames, 1 < th > frame and the 10 < th > frame by applying a 'chaining principle' which multiplies all of the 'correlation matrix' of ' 'Can be calculated quickly.

Since the correlation matrix between neighboring frames does not need to be recalculated once calculated, only the cost matrix is re-calculated according to the speed set by the user, and the computation processing can be performed quickly each time the user controls the speed.

The image data rate reproduction apparatus 100 stabilizes the calculated optimal path based on the basic frame and the path frame (S240).

The image double speed playback apparatus 100 renders an image based on the stabilized path (S250). In step S250, the image-double-speed playback apparatus 100 may render an image for double-speed playback based on the path frame without passing through step S240.

Although it is described in Fig. 2 that steps S210 to S250 are sequentially executed, the present invention is not limited thereto. In other words, Fig. 2 is not limited to the time-series order, as it would be applicable to changing and executing the steps described in Fig. 2 or executing one or more steps in parallel.

As described above, the overall operation of the image double speed playback according to the embodiment described in FIG. 2 can be implemented by a program and recorded on a computer-readable recording medium. The program for realizing the overall operation of the image double speed reproduction according to the present embodiment is recorded, and the computer readable recording medium includes all kinds of recording devices for storing data that can be read by the computer system.

FIGS. 3A to 3C are diagrams for explaining a comparison between a general camera path and a stabilized camera path according to image double speed playback.

3A is a diagram showing a camera path when an image is photographed by a general photographing method. In the case of shooting everyday life, extreme situations, sports which can not be photographed, and the like, with a photographing device such as a handheld camera or a kohf hero, the image is too long, complex, and monotonous. In other words, a video shot with a common imaging device without professional assistant equipment has a shaky camera path, as shown in FIG. 3A, because there is no professional editing.

FIG. 3B is a view showing a camera path photographed in a general photographing mode by a single smooth camera path (Smooth Camera Path). Generally, when stabilizing an unstable camera path as shown in FIG. 3A, a smooth camera path is generated as shown in FIG. 3B.

3C is a diagram showing an example in which the shaky path is changed to have a stabilized hardness. The image double speed playback apparatus 100 according to the present embodiment does not simply sample a frame corresponding to a preset speed and reproduce it (image double speed playback), but performs matching by matching feature points of each frame of the original image with each other After calculating the correlation matrix and calculating the cost matrix in which the associations among the frames are compared based on the correlation matrix, only the path frame with the highest correlation among the frames is selected based on the cost matrix, , A smooth camera path is changed. For example, in general, it is possible to perform time stabilization (e.g., 10 times speed) after performing video stabilization on an image or perform image stabilization after rapidly reproducing an image at a predetermined speed. However, since unstable camera paths are largely stabilized Do not. However, in the present embodiment, instead of sampling only the frame corresponding to the user's input data, the cost matrix is calculated using the calculated correlation matrix, and then the cost matrix is calculated by considering the playback speed and the frame- Since the frame is selected at intervals, unstable camera paths are largely stabilized. In the case of this embodiment, the image double speed playback apparatus 100 does not need to perform a separate calibration to stabilize the unstable camera path or to check the focal length or the like of the camera.

FIG. 4 is a flowchart for explaining a frame matching process according to the present embodiment.

The image double speed playback apparatus 100 extracts minutiae for each of all the frames (1,800 frames) included in the original image (S410). For example, in step S410, the image double speed playback apparatus 100 can extract '500' feature points in the first frame, extract '495 feature points' in the second frame, The feature points of '497' can be extracted, and the feature points of '490' can be extracted from the 1,800th frame.

The image data playback device 100 confirms a descriptor for each minutiae of each frame (S420). The descriptor includes a kind of attribute information or feature information for the feature point. For example, in step S420, the image double-speed playback apparatus 100 confirms 500 descriptors of '500' feature points extracted from the first frame and extracts '500' descriptors of '495' feature points extracted from the second frame 497 descriptors of 497 feature points extracted from the third frame, and 497 feature descriptors of 490 feature points extracted from the 1,800th frame. Identify the 490 descriptors.

The video image playback apparatus 100 calculates a correlation matrix between neighboring frames by matching the descriptors among neighboring frames of all the frames in a method of comparing them (S430). For example, in step S430, the video playback apparatus 100 transmits the first frame and the second frame, which are adjacent frames, the second through third frames, the third through fourth frames, And '1,799 ~ 1,800th frame', and calculates and stores a correlation matrix for each frame. The image-quality playback apparatus 100 calculates and stores '1, 799' correlation matrices as a result of performing Step S430 for '1,800 frames'.

In step S430, the image-wattening reproduction apparatus 100 performs an algorithm (RANSAC (RANdom SAmple Consensu) algorithm) for selecting a model having the maximum consensus from the random sample data when matching the descriptors between adjacent frames in a matching manner And selectively removes an outlier from the image.

The correlation matrix is a 3x3 matrix and includes up to eight change value parameters excluding one in a 3x3 matrix. Correlation matrix is a 3 × 3 matrix, a change amount parameter between adjacent frames, x-axis movement amount (t x) parameters, y-axis movement amount (t y) parameters, the angle of rotation (θ) parameters, size parameters, and the aspect ratio parameter, shear parameters And a projection parameter.

Hereinafter, the correlation matrix H (t) will be described.

When the correlation matrix H (t) is composed of a translation motion model including 2 DOF (Degree of Freedom), the x-axis movement amount (t x ) parameter and the y-axis movement amount (t y ) .

Figure 112016001888781-pat00001

When the correlation matrix H (t) is composed of an Euclidean Motion Model including 3 DOF, the x-axis movement amount (t x ) parameter, the y-axis movement amount (t y ) &thetas;) parameter.

Figure 112016001888781-pat00002

Correlation matrix (H (t)) is the similarity motion model comprising a 4 DOF (Similarity Motion Model), x-axis movement amount (t x) parameters, y-axis movement amount (t y) parameters, the rotational angle (θ) have been made to Parameters, and size parameters.

Figure 112016001888781-pat00003

If made of a correlation matrix (H (t)) the affine motion model including a 6 DOF (Affine Motion Model), x-axis movement amount (t x) parameters, y-axis movement amount (t y) parameters, the rotation angle (θ ) Parameters, size parameters, aspect ratio parameters, and shear parameters. Parallel lines are preserved for affine motion models.

Figure 112016001888781-pat00004

Correlation matrix (H (t)) is the projection motion model (Perspective Motion Model), x-axis movement amount (t x) parameters, y-axis movement amount (t y) parameters, the rotational angle (θ) have been made by including a 8 DOF Parameters, size parameters, aspect ratio parameters, shear parameters, and projective parameters. Parallel lines are not preserved for the projective motion model.

Figure 112016001888781-pat00005

4, steps S410 to S430 are sequentially executed. However, the present invention is not limited to this. In other words, Fig. 4 is not limited to the time-series order, since it would be applicable to changing or executing the steps described in Fig. 4 or executing one or more steps in parallel.

As described above, the frame matching process according to the present embodiment described in FIG. 4 can be implemented as a program and recorded in a computer-readable recording medium. A program for implementing the frame matching process according to the present embodiment is recorded, and a computer-readable recording medium includes all kinds of recording devices for storing data that can be read by a computer system.

5 is a flowchart illustrating a frame selection process according to the present embodiment.

The image-quality playback apparatus 100 calculates associations (C m ) between frames using a correlation matrix between frames based on the correlation matrix (S510). In step S510, the image-wise playback apparatus 100 compares the correlation matrix between the first frame based on the inter-frame correlation matrix and the correlation matrix up to twice the maximum playback speed in the subsequent frame, (C m ). In general, the maximum reproduction speed has a value of 16 or 32. [

The relation between the frames is calculated by comparing the 'first frame' and the 'second to 32nd frame' when the image double speed playback apparatus 100 reproduces an image at 16 × speed.

In order to confirm the association between the 'first frame' and the 'tenth frame' in general, it is necessary to combine all the feature points and descriptor combinations extracted from the 'tenth frame' The matrices must be matched to calculate the matrices in a comparative manner.

However, in this embodiment, the cost matrix corresponding to the speed input by the user can be quickly calculated by using the correlation matrix of '1,799' previously calculated by performing step S430.

In step S510, the video double-speed playback apparatus 100 may apply the chain rule to the correlation matrix between neighboring frames to increase the processing speed. For example, when it is desired to check how much the '1 st frame' and the '10 th frame' are different from each other, the image data playback apparatus 100 may calculate the correlation matrix of the 1 st and 2 nd frames, The correlation matrix for multiplying the correlation matrix of the ninth to tenth frames by the correlation law of the correlation matrix of the third to fourth frames, The difference can be calculated quickly. Since the correlation matrix between neighboring frames does not need to be recalculated once calculated, only the cost matrix is re-calculated according to the speed set by the user, and the computation processing can be performed quickly each time the user controls the speed.

In the case of calculation using a general frame comparison method, a correlation matrix is calculated by a method of comparing 'first to second frame', and a correlation matrix is calculated by matching the 'first to third frame' . In the case of calculating the correlation matrix in the above-described manner, the calculation amount becomes large. Therefore, the correlation matrix of '57, 568' should be calculated instead of calculating the correlation matrix of '1,799' as in the present embodiment. The image quality playback apparatus 100 may calculate the cost matrix of each frame by multiplying the correlation matrix of the first frame by the correlation matrix of the subsequent frame.

In step S510, a method for calculating the correlation (C m ) between frames in the image-by-picture playback apparatus 100 is as shown in the following equation (1).

Figure 112016001888781-pat00006

C r: i image shift amount between the first frame and the j th frame, T: i-th frame and the correlation between the j-th frame related functions, i: i-th frame index (Index), j: j-th frame index, C 0: x 0 is the center x coordinate value of the image, y 0 is the center y coordinate value of the image, C m is the correlation between the frames, and the amount of overlap between the image and the moving image is A value that determines the total movement level in terms of the amount, and Γ is the maximum threshold. For example, when the value of C r (i, j) is larger than τ c , the value of Γ is used as the maximum value. τ c : Threshold

Generally, frames that have a high correlation between frames must be computed for all feature points in order to use the average value of geometric re-projection errors, and a chain rule for fast operations is applied can not do. Since the image double speed playback apparatus 100 according to the present embodiment uses the geometric dx and dy magnitude of the motion matrix as feature values, it is possible to perform fast operation by the 'chain rule'.

Double-speed video player 100 calculates a speed satisfying value (C s) to satisfy the speed the user has preset for each frame (S520). In step S520, based on the i-th frame index i, the j-th frame index j, the user-preset double speed playback value v, and the threshold value? S , (C s ) for satisfying the preset speed. More specifically, the image double speed playback apparatus 100 calculates a double speed satisfaction value (C s ) for satisfying the speed set by the user using the formula (2).

In step S520, when the image is reproduced at the 16x speed, the image quality doubling playback apparatus 100 calculates a double speed satisfaction value ( Cs ) for satisfying the 16x speed. For example, if only the degree of similarity in the degree of skipping between frames is considered, it is difficult to satisfy the user's desired speed. The combined cost function of the cost matrix computed by the image-speed-double playback apparatus 100 is expressed by Equation (2).

Figure 112016001888781-pat00007

i: i-th frame index, j: j-th frame index, v: user-defined double speed playback value. For example, values of 2, 4, 8, and 16 are input. C m is a value for determining the total movement level between the i-th image and the j-th image in terms of the amount of image movement and the amount of overlapping, and λ s is a weight for keeping the speed, and a value between 0.0 and 1.0 is mainly used . C s : Speed correction value to satisfy the speed set by the user. For example, when the user's desired speed is 8, the value of C s is the smallest value when the difference between i and j is 8. The reason why the value of C s is required is that the matching degree of the images is the highest in the nearest frame, and the user can not satisfy the desired speed if only the nearest frame is selected. C (i, j, v): The value used in the final cost matrix. The value of C (i, j, v) is a value including the degree of matching of the image and the frame jump (skip) level. The value of C (i, j, v) is used to find the value of i, j so as to minimize the value of C (i, j, v) τ s is a threshold value, which is a preset upper limit value because it affects the determination of the frame if the weight value of the frame playback speed is too large. τ s can generally be a value of 200, but specific values can be changed depending on the setting.

Video speed reproduction apparatus 100 is a combination of the speed values calculated at the correlation satisfies (C m) and step S520 between the frames calculated at step S510 (C s) and calculates the cost matrix. The image-speed-playback apparatus 100 calculates an optimal path consisting only of the path frame by repeating the process of selecting the frame having the minimum value among the cost matrix as the path frame until the last frame (S530). Double-speed image reproducing apparatus 100 in step S530 is a combination of a speed calculated from a value satisfying relationship (C m), step S520 between the frames calculated at step S510 (C s) and calculates the cost matrix. More specifically, the image-speed-double playback apparatus 100 calculates the cost matrix C ( i, j, v ) using the equation (2).

The image data playback device 100 selects a frame having the minimum value among the cost matrices calculated in step S530 as a path frame. The image-speed-double playback apparatus 100 calculates an optimal path only with the path frame. For example, when the double speed reproduction is set to 16x speed, the image double speed playback apparatus 100 sets the frame inter-frame relevance (i.e., the frame rate of the first frame to the second frame to the 32nd frame C m ).

First, the image data playback device 100 checks the amount of change between the 'first frame' and the 'second frame', checks the amount of change of the 'first frame' and the 'third frame' Check the amount of change of the 'fourth frame', and check the amount of change of the 'first frame' and the '32nd frame'.

The video-image playback device 100 calculates a double-speed satisfaction value (C s ) for satisfying the speed set by the user for each frame. Then, the image-speed-increase playback apparatus 100 calculates inter-frame relevance (C m ) for comparing the first frame with the second to the 32nd frame (twice the speed), the weight (λ s ) And calculates a cost matrix based on a doubling satisfaction value (C s ) for satisfying a predetermined double speed.

The image-quality playback apparatus 100 selects the frame having the minimum value in the cost matrix in which the first frame is compared with the second through the 32nd frames as the route frame having the highest correlation with the 'first frame'.

The image-speed playback apparatus 100 programs the optimal path calculated in operation 530 (Greedy Programming). A programming example is as follows.

Figure 112016001888781-pat00008

The image double speed playback apparatus 100 proceeds to the optimization path calculation based on the cost matrix calculated by using Equation (2).

The image quality playback apparatus 100 finds an optimization path in a greedy manner unlike the DTW (Dynamic Time Warping) scheme. Due to the nature of greedy algorithms, it is not possible to calculate the perfect optimization value, but it is possible to find a value close to the optimization with high probability.

Although it is described in Fig. 5 that steps S510 to S530 are sequentially executed, the present invention is not limited thereto. In other words, Fig. 5 is not limited to a time series order, since it would be applicable to changing and executing the steps described in Fig. 5 or executing one or more steps in parallel.

As described above, the frame selection process according to the present embodiment described in FIG. 5 can be implemented as a program and recorded in a computer-readable recording medium. A program for implementing the frame selection process according to the present embodiment is recorded, and a computer-readable recording medium includes all kinds of recording devices for storing data that can be read by a computer system.

6 is an exemplary diagram for explaining a cost matrix according to the present embodiment.

The image-aspect-ratio playback apparatus 100 calculates motion information of all frames in the input original image. The general motion information calculation method is a method of calculating motion information using the RANSAC algorithm in the HARRIS + BRIEF method, but in the present embodiment, the motion information is calculated using the RANSAC algorithm in the ORB (Oriented FAST and Rotated BRIEF) + ORB Method.

The image-speed-double playback apparatus 100 calculates a cost matrix based on the calculated motion information. The image quality doubling reproduction apparatus 100 performs calculation only on a frame required in a greedy scheme rather than a conventional dynamic programming scheme in cost matrix calculation. The image-speed-playback device 100 generates a stabilized result image based on the obtained path information.

The video image playback device 100 receives an original image (1,800 frames) of one minute of video having 30 frames per second (FPS) per second. The image-speed-increase playback apparatus 100 extracts feature points for all the frames (1,800 frames) included in the original image. The video image reproducing apparatus 100 can extract '500' feature points from the first frame, extract '495 feature points from the second frame, extract' 497 'images from the third frame, , And extracts feature points of '490' from the 1,800th frame.

The image data playback device 100 confirms the descriptors for each of the minutiae for each frame. The image double speed playback apparatus 100 confirms 500 descriptors for the 500 feature points extracted in the first frame and 495 descriptors for the 495 feature points extracted in the second frame 497 pieces of descriptors were extracted from the 497 pieces of feature points extracted from the 3rd frame and ... 490 pieces of descriptors were extracted from the 490 pieces of feature points extracted from the 1,800th frame Check.

The image data playback apparatus 100 matches the descriptors among neighboring frames of all the frames in a manner of comparing the neighboring frames, and outputs the neighboring frames ('1 st to 2 nd frame', '2 nd to 3 rd frame', '3 rd to 4 th frame' '1,799 to 1,800 th frame'). The image quality playback apparatus 100 calculates and stores '1, 799' correlation matrices by matching descriptors among adjacent frames among 1,800 frames. Correlation matrices do not need to be recalculated once they are calculated and stored. Then, according to the speed set by the user, the cost matrix can be immediately calculated according to the speed, and the image can be rendered. In the general scheme, the entire cost matrix for all the frames has to be calculated, but the present invention does not need to calculate the entire cost matrix.

Hereinafter, the cost matrix calculation method will be described.

As shown in FIG. 6, the image double-speed playback apparatus 100 determines a correlation (hereinafter, referred to as " first frame ") from a correlation matrix of a first frame to a frame The correlation between the frames (cost matrix) is calculated by the change values comparing the relation matrix.

As shown in FIG. 6, the image-rearrangement playback apparatus 100 may apply a chaining rule to a correlation matrix between neighboring frames to quickly process a computation amount. For example, when it is desired to check how much the '1 st frame' and the '15 th frame' are different from each other, the image-wise playback apparatus 100 may calculate the correlation matrix of the 1 st and 2 nd frames, The correlation matrix for multiplying the correlation matrix of the 14th to the 15th frame is applied to calculate the correlation matrix of the first frame and the 15th frame The difference can be calculated quickly.

The image double speed playback apparatus 100 determines whether or not the correlation matrix of the '1 st frame' is used as a reference and the correlation matrix of the frame whose frame is twice the playback speed ('2 to 32 th frame' The frame having the minimum value ('15th frame') is recognized as a frame having the highest correlation with the '1 st frame', and is selected as a path frame.

As shown in FIG. 6, the image double-speed playback apparatus 100 determines a frame whose frame rate is twice the playback speed ('16th to 47th frame') based on the correlation matrix of the path frame ') Are calculated as cost matrices.

As shown in FIG. 6, the image-wise playback apparatus 100 may apply the chain rule to the correlation matrix between neighboring frames in order to increase the computation processing speed. For example, when it is desired to check how much the '15th frame' and the '23rd frame' are different from each other, the image-rearrangement playback apparatus 100 may calculate the correlation matrix of the 15th to 16th frames, The correlation matrix for multiplying the correlation matrix of the 23rd to the 24th frame is applied to calculate the correlation matrix of the 15th frame and the 23rd frame The difference can be calculated quickly.

The image data playback apparatus 100 compares a correlation matrix from a correlation matrix of a path frame ('15th frame') to a frame ('16th to 47th frame') in which the frame is twice the playback speed ('23rd frame') having the minimum value of one change value is recognized as a frame having the highest correlation with the first selected route frame ('15th frame') in the cost matrix, and is selected as the second route frame.

The image double speed playback apparatus 100 according to the present embodiment is not a method of calculating a cost matrix for all frames but a method of calculating a cost matrix by comparing correlation matrices twice as fast as a selected frame from a selected frame. In the general method, when the 16-times speed is assumed, the process of comparing the 'second frame' and the 'third to 32nd frame' after comparing the 'first frame' and the ' Should be. That is, all comparisons must be performed. However, the image double-speed playback apparatus 100 according to the present embodiment compares the 'first frame' with the 'second to 32nd frame' (twice the speed) to calculate a cost matrix. Thereafter, the video playback apparatus 100 selects a frame having a high correlation with the 'first frame' as a path frame, and thereafter, there is a difference in that the computation amount can be greatly reduced in calculating the cost matrix of the selected path frame and the remaining frames do. For example, even if it is assumed that 1 MS (Milli-Second) is required to compare the amount of change between frames, performing 32 times requires 32 MSs, so that a large amount of resources are consumed for calculating the cost matrix, .

FIGS. 7A and 7B are diagrams for explaining a comparison between frame selection during normal speed reproduction and frame selection according to the present embodiment.

FIG. 7A is a diagram for explaining comparison of selected frames during double speed reproduction of an image. FIG. The dotted line shown in FIG. 7A is a graph reconstructed based on a value obtained by observing how much the camera moved in the 'y-axis' direction when an actual person is running. Since the actual person is running, the 'y axis' shows motion in the pixel range of '-100 to 100' within '50 frames'. In other words, it can be seen that the image is greatly shaken by the dotted line graph.

The circular point (O) shown in FIG. 7A is a graph showing a case where a frame is selected at a normal speed. For example, in the case of time-lapse of '8x speed', in the case of selecting '16 frames', '24 frames', '32 frames' or the like, even if the frame is stabilized with a selected circle as shown in FIG. , The stabilization result is not good.

The star point (*) shown in FIG. 7A is a graph showing a case where a frame is selected in a manner according to the present embodiment. When selecting a frame for double speed playback as in the star point (*) shown in FIG. 7A, even if the frame is selected as '8x', one frame is selected as '15 frames' and one frame is selected as '30 frames' So that a high frame is selected. That is, it is possible to select a frame positioned after the '8x speed', or to select a frame with a high correlation among frames by selecting a frame before the '8x speed'. In other words, when the frame is skipped, the video double-speed playback apparatus 100 according to the present embodiment does not select the frames at regular speed intervals, but selects frames variably.

The circular point (O) on the solid line graph shown in FIG. 7B is a result of selecting the frame at the normal speed, and the star point (*) on the solid line graph is the result of selecting the frame at a variable interval.

In the case of comparing the graph shown with the circular dots shown in FIG. 7B and the graph showing the star point, stability is high when a frame is selected at a variable interval. When estimating a three-dimensional camera path, accuracy can be improved, but the speed is too slow due to too much computation. In this embodiment, double speed reproduction is implemented in a two-dimensional manner, but the calculation amount can be reduced to enable quick calculation.

In the present embodiment, the video double speed playback apparatus 100 calculates a cost matrix as shown in FIG. 7B in order to select a frame having a high correlation among frames. For example, in the case of a 16-times speed, the image-speed-doubling playback apparatus 100 compares the first frame with the second to the 32-th frame (twice the speed). The image-speed-up playback apparatus 100 calculates the amount of change with the frame up to twice the double speed based on the correlation matrix between adjacent frames calculated in advance as a cost matrix. Then, the image data playback device 100 confirms the amount of change of the 'first frame' and the 'second frame' using the cost matrix, checks the amount of change of the 'first frame' and the 'third frame' 1 " and " 4th frame ", and confirms the amount of change of the 'first frame' and the '32nd frame'. At this time, the amount of change of each frame is already calculated by a correlation matrix between adjacent frames. That is, as a result of checking the first frame and the second through the 32nd frames of the image data playback apparatus 100, the frame having the smallest change amount is selected as the frame having the highest correlation.

As shown in FIG. 7B, when comparing a circular point graph when a frame is selected at a normal speed and a star point graph selected at a variable interval, the hatched line graph is' 16 when a frame is selected for double speed reproduction Quot ;, it is possible to select a frame located before the " 16x speed ", or to select a frame after a longer time.

It can be confirmed that a stable result with little change in the y-axis movement amount is generated even through the optimum frame selection as shown by the dotted line in FIG. 7A. That is, when selecting a frame for double speed reproduction, a frame having a high correlation can be selected by selecting a frame at a variable interval, and as a result, a stable result can be output at the time of double speed reproduction.

The foregoing description is merely illustrative of the technical idea of the present embodiment, and various modifications and changes may be made to those skilled in the art without departing from the essential characteristics of the embodiments. Therefore, the present embodiments are to be construed as illustrative rather than restrictive, and the scope of the technical idea of the present embodiment is not limited by these embodiments. The scope of protection of the present embodiment should be construed according to the following claims, and all technical ideas within the scope of equivalents thereof should be construed as being included in the scope of the present invention.

As described above, the present embodiment is applied to the field of scene analysis in the field of computer graphics, so that a smooth and stabilized image can be obtained at various speeds by using a variation amount analysis between frames, It is a useful invention that produces an effect that can be reproduced.

100:
110: input unit 120: frame matching unit
130: frame selecting unit 140: path stabilizing unit
150:
122: feature point extraction unit 124: descriptor verification unit
126: Correlation Calculator
132: cost calculation unit 134: frame check unit
136: Optimum path calculation unit

Claims (10)

delete An operation method of a video double speed playback apparatus,
An input process for inputting an original image;
A frame matching step of calculating a correlation matrix by matching feature points of each frame of the original image with each other;
Calculating a cost matrix comparing a correlation between frames based on the correlation matrix and selecting only a path frame having the highest correlation among frames based on the cost matrix; And
And rendering the image for double speed playback based on the path frame,
Wherein the frame matching process includes: extracting feature points of all the frames included in the original image; A confirming step of confirming a descriptor for each minutiae of each of the frames; And calculating the correlation matrix between frames by matching the descriptors with each other among neighboring frames of all the frames. 3. The method of claim 2,
Wherein the correlation matrix comprises:
As the amount of change parameters between the adjacent frames, x-axis movement amount (t x) parameters, y-axis movement amount (t y) parameters, the rotational angle (Angle) (θ) parameters, the size (Scale) parameter, the aspect ratio (Aspect Ratio) parameters, the front end A Shear parameter, and a Perspective parameter. The method of claim 1, 3. The method of claim 2,
Wherein the correlation matrix calculation step comprises:
And selectively removing an outlier by using an algorithm for selecting a model having a maximum consensus in the random sample data when matching the descriptors of the neighboring frames by a method of comparing the descriptors with each other. A method for reproducing an image at a double speed. An operation method of a video double speed playback apparatus,
An input process for inputting an original image;
A frame matching step of calculating a correlation matrix by matching feature points of each frame of the original image with each other;
Calculating a cost matrix comparing a correlation between frames based on the correlation matrix and selecting only a path frame having the highest correlation among frames based on the cost matrix; And
A rendering process of rendering an image for double speed playback based on the path frame,
Wherein the frame selection step compares the values of up to a predetermined multiple of the playback speed with respect to the value of the first frame in the correlation matrix to select a first path frame having a minimum change value process; Selecting a second path frame having a minimum change value by comparing values of the correlation matrix up to a frame having a predetermined multiple from the frame having the minimum change value; And selecting a path frame having a minimum change value until the last frame of the correlation matrix. An operation method of a video double speed playback apparatus,
An input process for inputting an original image;
A frame matching step of calculating a correlation matrix by matching feature points of each frame of the original image with each other;
Calculating a cost matrix comparing a correlation between frames based on the correlation matrix and selecting only a path frame having the highest correlation among frames based on the cost matrix; And
A rendering process of rendering an image for double speed playback based on the path frame,
Wherein the frame selection process comprises: calculating an inter-frame correlation with a change value obtained by comparing a correlation matrix up to a frame in which a frame is twice as much as a playback speed based on a correlation matrix of an initial frame; Calculating a doubling satisfaction value for satisfying a speed set by the user for each frame; And calculating the cost matrix by combining the inter-frame correlation with a value for satisfying the speed set by the user, and repeating the process of selecting a frame having the minimum value among the cost matrices as the path frame to the last frame And reproducing the video at a rate of two times. The method according to claim 6,
In calculating the double speed satisfaction value, the double speed satisfaction value is calculated on the basis of the i-th frame index (i), the j-th frame index (j), the user set speed playback value v and the threshold value τ s ,
Wherein the cost matrix is calculated on the basis of a quantity (C m ) of the image movement amount and degree of overlap in the repeating process, a weight (λ s ) of a value for keeping the speed, How to play. The method according to claim 6,
In the process of calculating the association,
Wherein the inter-frame correlation is calculated by multiplying a correlation matrix of a reference frame by a correlation matrix of the following frames. Combined with hardware
An input process for inputting an original image;
A frame matching step of calculating correlation matrices by matching minutiae points of each frame of the original image with each other;
Calculating a cost matrix for comparing associations between frames based on the correlation matrix and selecting only a path frame having the highest correlation among frames based on the cost matrix; And
A rendering process of rendering an image for double speed reproduction based on the path frame
Wherein the frame matching process includes: extracting feature points of all the frames included in the original image; A confirming step of confirming a descriptor for each minutiae of each of the frames; And calculating the correlation matrix between frames by matching the descriptors among neighboring frames of all the frames in a manner of comparing the descriptors with each other. An input unit for receiving an original image;
A frame matching unit for calculating correlation matrices by matching feature points of each frame of the original image with each other;
A frame selector for calculating a cost matrix comparing the associativity between frames based on the correlation matrix and selecting only a path frame having the highest correlation among frames based on the cost matrix; And
A rendering unit for rendering an image for double speed playback based on the path frame,
Wherein the frame matching unit extracts feature points of all the frames included in the original image, identifies a descriptor for each feature point of each of the frames, and identifies the descriptors among neighboring frames of all the frames, And the correlation matrix between the frames is calculated by matching with each other in a manner of comparing them.
KR1020160002313A 2016-01-07 2016-01-07 Method and Apparatus For Providing Multiple-Speed Reproduction of Video KR101945243B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020160002313A KR101945243B1 (en) 2016-01-07 2016-01-07 Method and Apparatus For Providing Multiple-Speed Reproduction of Video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020160002313A KR101945243B1 (en) 2016-01-07 2016-01-07 Method and Apparatus For Providing Multiple-Speed Reproduction of Video

Publications (2)

Publication Number Publication Date
KR20170082944A KR20170082944A (en) 2017-07-17
KR101945243B1 true KR101945243B1 (en) 2019-04-17

Family

ID=59442998

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020160002313A KR101945243B1 (en) 2016-01-07 2016-01-07 Method and Apparatus For Providing Multiple-Speed Reproduction of Video

Country Status (1)

Country Link
KR (1) KR101945243B1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111314604B (en) * 2020-02-19 2021-08-31 Oppo广东移动通信有限公司 Video anti-shake method and apparatus, electronic device, computer-readable storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101883481B1 (en) * 2013-07-12 2018-07-31 한화에어로스페이스 주식회사 Apparatus and method for stabilizing image

Also Published As

Publication number Publication date
KR20170082944A (en) 2017-07-17

Similar Documents

Publication Publication Date Title
US8014566B2 (en) Image processing apparatus
CN103428460B (en) The video recording method and recording device of output video signal sequence are recorded for image capture module
AU2011216119B2 (en) Generic platform video image stabilization
US7548256B2 (en) Image processing scheme
US8126207B2 (en) Subject tracking method, subject tracking device, and computer program product
CN108886584A (en) Method and apparatus for generating high-fidelity scaling for mobile video
US8013913B2 (en) Image recording method, image recording device, and storage medium
US20100188511A1 (en) Imaging apparatus, subject tracking method and storage medium
US20160094801A1 (en) Time-Lapse Video Capture With Optimal Image Stabilization
US8509543B2 (en) Subject tracking device and camera
JP5158409B2 (en) Imaging apparatus and program thereof
CN105450911A (en) Image processing apparatus and image processing method
US8928768B2 (en) Image processing device and computer-readable computer program product containing image processing program
CN103577520A (en) Object searching apparatus, object searching method and computer-readable recording medium
CN114390201A (en) Focusing method and device thereof
KR101945233B1 (en) Method and Apparatus for Stabilizing Video
KR20170101532A (en) Method for image fusion, Computer program for the same, and Recording medium storing computer program for the same
KR101945243B1 (en) Method and Apparatus For Providing Multiple-Speed Reproduction of Video
JP7340720B1 (en) Electronics
CN102209199A (en) Imaging apparatus
US8629925B2 (en) Image processing apparatus, image processing method, and computer program
CN108206920A (en) Picture pick-up device and its control method and computer readable storage medium
KR102066857B1 (en) object image tracking streaming system and method using the same
JP2003241071A (en) Image pickup device and automatic focusing method for the same
JP2014134898A (en) Image search apparatus

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant