KR20190063173A - The apparatus and method for providing image and script information from video - Google Patents

Abstract

The present invention relates to an apparatus for providing video and script information, which provide a video and a script of a specific point of time through simple button operation while watching a moving picture such as a cinema, a drama, a music video, and the like, and a method thereof. According to the present invention, the apparatus for providing a video and a script comprises: user input recognition unit recognizing selection operation of a user when the user selects a specific point of time in a watching video; a feature information acquisition unit acquiring feature information of the video related to the selected point of time when the selection information of the user is recognized through the user input recognition unit; and a script information acquisition unit using the feature information to acquire script information of the video corresponding to the point of time selected by the user from a server or Internet.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an apparatus and method for providing image and metabolism information,

The present invention relates to an apparatus and method for providing image and metabolism information, and more particularly, to a method and apparatus for providing image and metabolism information by acquiring video and script information at a specific point of time through a simple button operation while viewing a movie, To a device and method for providing and reproducing image and metabolism information at a desired point in time.

As personal video viewing devices such as mobile phones, PCs, and handheld terminals are becoming widespread, many people are learning English while watching videos of foreign films and dramas. The best thing for learning English is to study real life English used by actual actors in foreign movies and dramas. However, devices and methods for capturing and capturing scenes such as movies and dramas have been developed variously, And it is not widely used because it is inconvenient to use.

Korean Patent Laid-Open No. 10-1999-0064823 (Aug. 5, 1999) discloses a caption control method and a recording medium for learning foreign language ambassadors included in a moving picture on a personal computer, and relates to a movie mode for watching a movie, A caption control method for learning a foreign language metabolism by distinguishing a study mode for executing only a video image and a recording mode for recording and listening to each sentence by sentence is disclosed. However, in consideration of the convenience of the user, The apparatus and method for acquiring image and metabolism information for foreign language learning have not been disclosed even with the operation of the apparatus, and the complicated functions that the user does not actually use are variously added.

Korean Patent Laid-Open Publication No. 10-2015-0064785 (May 2015.06.12) relates to a content reproducing method, a data providing method, and a moving image content reproducing apparatus, wherein when a video or audio content is reproduced, A user can select a specific point in time by watching a movie or a drama and store the image and the metabolism information with only one or two button operations to utilize it for studying a foreign language There is a problem in that the methods are not disclosed and the user has to play back to an undesired portion.

1. Korean Published Patent Application No. 10-1999-0064823 (Aug. 5, 1999) 2. Korean Patent Publication No. 10-2015-0064785 (June 5, 2015)

An object of an embodiment of the present invention is to provide a method and an apparatus for conveniently acquiring and reproducing image and metabolism information through one or two button operations at a specific point in time when a user views an image such as a movie or a drama have.

An object of an embodiment of the present invention is to acquire feature information of an image when a user selects an image at a specific point in time and acquire metabolism information matching the image using the feature information, And a method and an apparatus for providing and reproducing the metabolism information obtained at a desired point in time.

An object of an embodiment of the present invention is to provide a method and apparatus for translating meta information acquired by a user into a desired language and providing the meta information together with the meta information to the user for reproduction, .

According to an aspect of the present invention, there is provided an image processing apparatus including a user input recognizing unit recognizing a selection operation of a user when selecting a specific time point of an image viewed by a user; A feature information acquiring unit for acquiring feature information of the image related to the selected point of time when the user selection information is recognized through the user input recognizing unit; And a metabolic information obtaining unit for obtaining the metabolic information of the image corresponding to the time selected by the user through the server or the Internet using the feature information.

Wherein the feature information includes at least one of (a) the selection time point information, (b) the video information at the selection time point, the still image information or the audio information, and (c) the fingerprint information extracted from each of the video, still image, And one of them.

The fingerprint information includes histogram information, edge information, and frequency information.

The moving image information is image information including the period from the time point at which the user selects the user to the end point to the time point at which the user selects the meta information.

The image and meta information providing apparatus further includes a translation and metabolism acquisition unit for acquiring the metabolism information translated into the language desired by the user, and the translation metabolism acquisition unit may directly translate the metabolism information, The translator to be performed is used, or the translated information obtained from the server is fetched.

And a meta information reproducing unit for providing the meta information obtained by the meta information acquiring unit to the user and reproducing the meta information, wherein the meta information reproducing unit reproduces the image information, the still image information And at least one of voice information and translation information of the meta information is provided to the user and reproduced.

According to another aspect of the present invention, there is provided a method for controlling an image processing apparatus, the method comprising: recognizing a selection operation of a user when selecting a specific time point of an image to be viewed by a user; Acquiring feature information of the image related to the selected time point when the selection operation of the user is recognized; And acquiring metabolism information of the image corresponding to a time point selected by the user via the server or the Internet using the feature information, wherein the feature information includes: (a) the selection time point information; (b) And (c) fingerprint information extracted from each of the video, still image, and voice at the selected time point. The method according to claim 1, further comprising: do.

The method of providing image and meta information may further include providing the meta information to the user and reproducing the meta information.

The technique disclosed in accordance with the present invention can have the following effects. It is to be understood, however, that the scope of the disclosed technology is not to be construed as limited thereby, as it is not meant to imply that a particular embodiment should include all of the following effects or only the following effects.

The apparatus and method for providing image and metabolism information according to an embodiment of the present invention can store and reproduce image and metabolism information at a desired point in time with only one or two button operations while a user watches an image such as a movie or a drama, It is possible to watch a foreign language dialogue which the user can not understand, at a desired time, and thus it is possible to study a foreign language efficiently.

An apparatus and method for providing image and metabolism information according to an exemplary embodiment of the present invention includes acquiring characteristic information of an image when a user selects an image at a specific point in time and outputting metabolism information And provides the user with the metabase information obtained at a desired point of time to reproduce the foreign language by easily searching for a desired portion of the foreign language.

The apparatus and method for providing image and metabolism information according to an embodiment of the present invention can efficiently translate foreign language learning by translating the metabolism information acquired by the user into a language desired by the user and providing the same to the user along with the metabolism information There is an effect that can be.

1 is a diagram illustrating a system in which a user acquires image and metabolism information at a specific time during a video viewing according to an embodiment of the present invention.
2 is a view for explaining a capture button for acquiring image and metabolism information at a specific time point in the apparatus for providing image and metabolism information according to an embodiment of the present invention.
3 is a structural diagram of an image and metabolism information providing apparatus for acquiring image and metabolism information at a time point when a user selects a specific time point during image viewing and providing the obtained image and metabolism information to a user according to an embodiment of the present invention.
4 is a diagram illustrating a method of acquiring image and metabolism information at a specific time point selected by the user according to an embodiment of the present invention.
5 is a flowchart illustrating a method of providing image and metabolism information to a user by acquiring image and metabolism information at a time point when a user selects a specific time point during image viewing according to an embodiment of the present invention.

The description of the present invention is merely an example for structural or functional explanation, and the scope of the present invention should not be construed as being limited by the embodiments described in the text. That is, the embodiments are to be construed as being variously embodied and having various forms, so that the scope of the present invention should be understood to include equivalents capable of realizing technical ideas. Also, the purpose or effect of the present invention should not be construed as limiting the scope of the present invention, since it does not mean that a specific embodiment should include all or only such effect.

Meanwhile, the meaning of the terms described in the present application should be understood as follows.

The terms "first "," second ", and the like are intended to distinguish one element from another, and the scope of the right should not be limited by these terms. For example, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

It is to be understood that when an element is referred to as being "connected" to another element, it may be directly connected to the other element, but there may be other elements in between. On the other hand, when an element is referred to as being "directly connected" to another element, it should be understood that there are no other elements in between. On the other hand, other expressions that describe the relationship between components, such as "between" and "between" or "neighboring to" and "directly adjacent to" should be interpreted as well.

It is to be understood that the singular " include " or "have" are to be construed as including the stated feature, number, step, operation, It is to be understood that the combination is intended to specify that it does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

In each step, the identification code (e.g., a, b, c, etc.) is used for convenience of explanation, the identification code does not describe the order of each step, Unless otherwise stated, it may occur differently from the stated order. That is, each step may occur in the same order as described, may be performed substantially concurrently, or may be performed in reverse order.

The present invention can be embodied as computer-readable code on a computer-readable recording medium, and the computer-readable recording medium includes all kinds of recording devices for storing data that can be read by a computer system . Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like. In addition, the computer-readable recording medium may be distributed over network-connected computer systems so that computer readable codes can be stored and executed in a distributed manner.

All terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. Commonly used predefined terms should be interpreted to be consistent with the meanings in the context of the related art and can not be interpreted as having ideal or overly formal meaning unless explicitly defined in the present application.

1 is a diagram illustrating a system in which a user acquires image and metabolism information at a specific time during a video viewing according to an embodiment of the present invention.

1, the image and metabolism information providing system according to the present invention includes a server or the Internet 100 and an image and meta information providing apparatus 200, The image and metabolic information obtaining apparatus 200 and the image and metabolic information reproducing apparatus 300 may be divided as shown in FIG. The user watches videos such as movies and dramas in order to study a foreign language such as English, Chinese, Japanese, etc., and then uses the image and metabolism information providing device 200 to understand the expression, When the expression is displayed, select the point in time. The image and meta information providing apparatus 200 acquires the feature information on the image at the time point selected by the user and searches the server or the Internet 100 using the feature information to acquire the metabolism information related to the image at the specific point in time can do. The user can study the foreign language while reproducing the acquired feature information and the metabolism information at the desired time and place at the desired image and the metabolic information providing apparatus 200. In the present invention, the image information includes a moving image, a still image, and audio information related to the image.

2 is a view for explaining a capture button for acquiring image and metabolism information at a specific time point in the apparatus for providing image and metabolism information according to an embodiment of the present invention.

Referring to FIG. 2, when a user performs a capture function for acquiring image and metabolism information according to the present invention while watching or watching a movie such as a movie or a drama using the image and meta information providing apparatus 200 A capture button 210 appears on a video screen of a movie or a drama being watched. If the user wants to study while viewing the image, the user presses the capture button 210 to select the corresponding point in time. The image and meta information providing apparatus 200 extracts feature information on an image at a time point selected by the user. Wherein the feature information includes at least one of (a) the selection time point information, (b) the video information at the selection time point, the still image information or the audio information, and (c) the fingerprint information extracted from each of the video, still image, One can be included. The fingerprint information may include histogram information, edge information, and frequency information. The image and meta information providing apparatus 200 may search the server or the Internet 100 using the feature information and search for related metabolic information.

The capture button 210 may appear at a time when the capture button 210 appears to be always displayed on the video screen viewed by the user, or may disappear after a predetermined time, and may be displayed at the moment of touching the video screen viewed by the user.

3 is a structural diagram of an image and metabolism information providing apparatus for acquiring image and metabolism information at a time point when a user selects a specific time point during image viewing and providing the obtained image and metabolism information to a user according to an embodiment of the present invention.

3, the apparatus 200 for providing image and metabolism information according to the present invention includes a user input recognition unit 220, a control unit 230, a transmission / reception unit 240, and a display unit 250, The control unit 230 includes a feature information acquisition unit 231, a metabolism information acquisition unit 233, a translation metabolism acquisition unit 235, and a metabolism information reproduction unit 237. In order to allow a user to study a foreign language such as English, Japanese, and Chinese, the user presses the capture button 210 to store the metabolism information desired to be studied while watching a movie, a drama, or the like. The user input recognizing unit 220 recognizes the user pressing the capture button 210 and transmits the recognized operation to the control unit 230. The user input recognizing unit 220 may be configured or divided into the same device as the capture button 210. [

When the user recognizes the operation of pressing the capture button 210, the feature information obtaining unit 231 of the controller 230 obtains the feature information on the image at the specific time point input by the user. As described above, the feature information includes at least one of (a) the selection time point information, (b) the video information at the selection time point, still image information or audio information, and (c) And / or information. The fingerprint information may include histogram information, edge information, and frequency information. The metabolic information acquisition unit 233 searches the server or the Internet 100 using the feature information acquired by the feature information acquisition unit 231 and acquires and acquires the metabolic information at that point in time.

Specifically, the feature information includes the time information selected by the user, so that the metabolism information obtaining unit 233 can obtain the metabolism information corresponding to the image at the time point selected by the user via the Internet or the server 100 ) So that they can be found. In addition, in the present invention, the feature information includes fingerprint information extracted from each of images, still images, and voices at a time point selected by the user, so that the metabolism information obtaining unit 233 can detect the Internet or the server 100 So that the user can find the metabolism information corresponding to the corresponding point in time. Here, the fingerprint information may include histogram information, edge information, and frequency information. The feature information may include not only information for searching for such metabolic information but also image (moving image, still image) information at a time point selected by the user. The image information is provided to the user along with the metabolism information and reproduced, so that the user can utilize not only the metabolism information but also the image information for foreign language study together.

The translation ambassador acquisition unit 235 directly translates the metabolism information at a time point selected by the user into a language desired by the user or acquires a translated ambassador using a translator provided on the Internet such as a Google translator, The translated metabolism can be retrieved and obtained.

The metabolism information reproducing unit 237 can provide the metabolism information obtained by the metabolism information obtaining unit 233 to the user through the display unit 25 and reproduce it. At this time, the metabolism information reproducing unit 237 may display at least one of the image information, the still image information, and the voice information of the image related to the metabolism information and the translation information of the metabolism information in addition to the metabolism information, It can be provided to the user and reproduced.

The metabolism information regeneration unit 237 may include a study record storage unit (not shown). The study record storage unit stores the study record after the user has studied the foreign language by utilizing the image and the metabolism information. For example, when the user has studied up to which part of the image and the metabolism information, The study information such as degree of matching with the pronunciation, newly learned words, and the like can be stored. The user can view the stored study record information and then know from which part of the image and metabolism information to study again.

4 is a diagram illustrating a method of acquiring image and metabolism information at a specific time point selected by the user according to an embodiment of the present invention.

Referring to FIG. 4, when a user views a movie, a drama, or the like and presses the caption button 210 at a specific point in time, the apparatus for providing image and metabolism information according to the present invention recognizes a touch point pressed by the user And an interval 420 in which text information related to the specific time point exists. Then, the image section 430 of the interval 420 in which the metabolism information is present is recognized and stored in the corresponding interval. The specific time is preferably about 0.1 to 1 second before and after the interval in which the metabolic information exists, and the user can select and use an appropriate value. If the user keeps pressing the caption button 210, the first pressed point and the last pressed point are grasped to identify the section in which the metabolism information exists in the entire section, and the video section before and after the specific time in the section is stored. By storing the image information before and after the section where the metabolism information exists, the user can grasp the accurate pronunciation and meaning by watching the image of the entire section in which the metabolism exists.

5 is a flowchart illustrating a method of providing image and metabolism information to a user by acquiring image and metabolism information at a time point when a user selects a specific time point during image viewing according to an embodiment of the present invention.

Referring to FIG. 5, if a user views a movie, a drama, or the like, and if the user does not know a word, expresses important words in learning, expresses frequently used in real life, or the like, a caption button 210 is used to select a specific time, The apparatus for providing image and metabolism information according to the present invention recognizes a selection operation of a user (S510). When the user makes a selection, the feature information obtaining unit 231 obtains the feature information on the image at the specific time point selected by the user (S520), and the metabolism information obtaining unit 233 matches the image information using the feature information The server 100 or the Internet 100 is acquired and acquired (S530). Wherein the feature information includes at least one of (a) the selection time point information, (b) the video information at the selection time point, the still image information or the audio information, and (c) the fingerprint information extracted from each of the video, still image, One can be included. The fingerprint information may include histogram information, edge information, and frequency information.

Then, the translation metabolism acquisition unit 235 obtains the metabolism information translated into the language desired by the user (S540). The acquired feature information, the metabolism information, and the translation metabolism information may be provided and reproduced at a time desired by the user (S550). The user performs the foreign language study using the feature information, the metabolism information, and the translation metabolism information, and if the user finishes studying the foreign language, the study record storage unit can store the study record of the user (not shown).

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the present invention as defined by the following claims It can be understood that

100: server or Internet 200: image and metabolism information providing device
210: Caption button 220: User input recognition unit
230: control unit 231:
233: Metabolic information acquisition unit 235: Translation ambassador acquisition unit
237: Meta information reproduction unit 250:

Claims (9)

An apparatus for providing image and metabolism information,
A user input recognizing unit for recognizing a selection operation of the user when selecting a specific time point of an image viewed by the user;
A feature information acquiring unit for acquiring feature information of the image related to the selected point of time when the user selection information is recognized through the user input recognizing unit; And
And a metabolic information obtaining unit for obtaining the metabolic information of the image corresponding to the time selected by the user through the server or the Internet using the feature information.
The method according to claim 1,
Wherein the feature information includes at least one of (a) the selection time point information, (b) the video information at the selection time point, the still image information or the audio information, and (c) the fingerprint information extracted from each of the video, still image, Wherein the image and meta information providing apparatus comprises:
3. The method of claim 2,
Wherein the fingerprint information includes histogram information, edge information, and frequency information.
3. The method of claim 2,
Wherein the image information at the selection time point is image information including a section from a time point at which the metabolism information at the time point selected by the user exists to an end point.
The method according to claim 1,
The image and meta information providing apparatus further includes a translation and metabolism acquisition unit for acquiring the metabolism information translated into the language desired by the user, and the translation metabolism acquisition unit may directly translate the metabolism information, Wherein the translator to be performed is used or the translated information obtained from the server is fetched.
The method according to claim 1,
Wherein the image and meta information providing apparatus further comprises a meta information reproducing unit for providing the meta information acquired by the meta information acquiring unit to the user and reproducing the meta information.
The method according to claim 6,
Wherein the metabolic information reproducing unit reproduces at least one of the image information, still image information and audio information of the image and the translation information of the metabolism information together with the user.
A method for providing image and metabolic information,
Recognizing a selection operation of the user when selecting a specific time point of an image to be viewed by the user;
Acquiring feature information of the image related to the selected time point when the selection operation of the user is recognized; And
And acquiring the metabolic information of the image corresponding to the time selected by the user through the server or the Internet using the feature information, wherein the feature information includes: (a) the selection time point information; (b) And (c) fingerprint information extracted from each of the video, still image, and voice at the selected time point.
9. The method of claim 8,
Wherein the image and meta information providing method further comprises providing the meta information to the user and reproducing the meta information.

Images