KR101137091B1 - Method and system for offering search result using caption information - Google Patents

Abstract

A method and system for providing search results according to search terms. The image data matching with the caption information related to the received search word may be extracted from the database and the extracted image data and the caption information may be provided as a search result of the received search term.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and system for providing search results using subtitle information,

The present invention relates to a method and system for providing a search result corresponding to a received search word, and a method and system for providing a detailed search result on a received search word.

In general, most language learners search for words using an electronic dictionary or the like. In recent years, as the portable Internet has developed, most people access the portal site using the portable Internet in their daily lives, and search for words using an Internet dictionary provided on a portal site connected thereto. In particular, examples of words searched to assist in the use of words and meanings of words in daily life are provided at the time of word search.

However, conventional electronic dictionaries and Internet dictionaries provide textual examples. Accordingly, it is difficult for the user to understand the situation represented by the illustrative sentence, that is, the nuance included in the word, only by the illustrative sentence provided as the search result. Furthermore, if the example sentence provided as a result of the search includes a new word that needs to be searched, the example sentence may interfere with the user's understanding.

Accordingly, there is a need for a method that can help users understand search results in providing search results for search terms entered by the user.

An object of the present invention is to provide a search result providing method and system that can help a user understand a search result by providing a search result of a search term input by a user using caption information.

The present invention also provides a method and system for providing search results that can help a user understand the utilization of a search term by providing video data matched with the caption information as a search result of the search term.

The present invention also provides a method and system for improving the accuracy of a sentence provided as a search result of a search term by providing image data matching the subtitle information and the caption information as an example sentence of the search term.

A method for providing a search result according to an embodiment of the present invention includes receiving a search word, extracting image data matching with caption information related to the search term from a database, and providing the caption information and the image data . ≪ / RTI >

The extracting step may extract image data matching the caption information including the search word or the synonym of the search term.

The extracting may extract image data matching the caption information determined using the audio information of the image data.

The extracting may extract a current frame matching the caption information among a plurality of frames constituting the image data, a previous frame contiguous to the current frame, or a next frame.

In addition, if the search term is a language of a first country, the extracting step may extract image data matching with caption information expressed in a language of a second country.

In addition, the providing step may provide the caption information and the display information for reproducing the video data.

In addition, the providing step may provide the image data corresponding to the caption information and the caption information as an example sentence of the search result of the search term when receiving the search term according to the dictionary search request.

According to another aspect of the present invention, there is provided a search result providing system including: a receiver for receiving a search word; an extracting unit for extracting image data matching with caption information related to the search term from a database; And the like.

The extracting unit may extract image data matching the caption information including the search word or the synonym of the search term.

The extracting unit may extract image data matching the caption information determined using the audio information of the image data.

The extraction unit may extract a current frame matching the caption information among a plurality of frames constituting the image data, a previous frame contiguous to the current frame, or a next frame.

The extracting unit may extract image data matching the caption information expressed in the language of the second country when the search term is a language of the first country.

Also, the providing unit may provide the caption information and the display information for reproducing the video data together.

In addition, when the search word is received according to the dictionary search request, the providing unit may provide the image data corresponding to the caption information and the caption information as an example sentence of the search result of the search term.

According to an embodiment of the present invention, it is possible to help a user understand a search result by providing a search result of a search term input by a user using subtitle information.

In addition, by providing video data matched with the caption information as a search result of the search term, it is possible to help the user understand the utilization of the search term.

In addition, by providing video data matched with caption information and caption information as an example sentence of a search term, it is possible to improve the accuracy of a sentence provided as a search result of a search term.

1 is a diagram illustrating an overall configuration for providing search results according to an embodiment of the present invention.
2 is a block diagram showing a configuration of a search result providing system according to an embodiment of the present invention.
3 and 4 are diagrams for explaining a configuration for providing image data matching with caption information related to a search term according to an embodiment of the present invention.
5 is a flowchart illustrating an operation of a search result providing system according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to or limited by the embodiments. Like reference symbols in the drawings denote like elements.

1 is a diagram illustrating an overall configuration for providing search results according to an embodiment of the present invention.

Referring to FIG. 1, the search result providing system 20 can extract a search result of the received search term 10 from a database (DB) 30. At this time, the search result providing system 20 can extract the caption information and the image data related to the search term in the DB 30 as a search result of the search term 10. Here, the extracted image data may be image data that matches the caption information related to the search term.

For example, in the case of searching a word in the Internet dictionary, the search result providing system 20 receives the search term 10 input from the user, matches the subtitle information related to the search word received from the DB 30, It is possible to extract the image data. As described above, the subtitle information and the video data can be matched and stored in the DB 30. At this time, when the movie is used as an image, the subtitle of the movie can be used as the subtitle information.

As another example, the search result providing system 20 may be used in a dictionary search and an electronic dictionary search provided from a mobile terminal such as a smart phone, in addition to a web-based dictionary search. That is, when the search word is received through the mobile terminal or the electronic dictionary, the search result providing system 20 may extract the caption information related to the received search word and the video data matching the caption information, .

Hereinafter, a process of extracting and providing image data matching with caption information and caption information related to a received search term will be described in detail with reference to FIG. 2 to FIG.

2 is a block diagram showing a configuration of a search result providing system according to an embodiment of the present invention.

Referring to FIG. 2, the search result providing system 200 may include a receiving unit 210, an extracting unit 220, and a providing unit 230.

At this time, the DB 100 may be located outside the search result providing system 200 or may be included in the search result providing system 200. When the DB 100 is located outside the search result providing system 200, the search result providing system 200 matches the caption information and the caption information related to the search term from the DB 100 communicatively connected through the wired or wireless network, It is possible to extract the image data. For example, the video data may include moving pictures such as a movie, an animation, an advertisement image, a drama, and a training image.

First, the receiving unit 210 can receive a search word through a user input. For example, the receiving unit 210 may receive a search word input through a search window provided by a portal site. Then, the extracting unit 220 can extract the search result of the received search word from the database (DB) 100. At this time, the extracting unit 220 can extract, as a search result, image data matching the caption information related to the received search word.

For example, the extracting unit 220 can determine the caption information including the received search term among the caption information stored in the DB 100. The extracting unit 220 can extract image data matching the caption information including the search word from the DB 100. [

At this time, the extracting unit 220 may extract a current frame matching with caption information including a search word among a plurality of frames constituting the video data. If the current frame is not the start frame or the last frame constituting the video data, the extracting unit 220 may extract the previous frame and the next frame continuous to the current frame. Next, the extracting unit 220 may generate a clip image by connecting the extracted previous frame, current frame, and next frame. For example, the previous frame may be a frame of the previous n seconds (n is a natural number) consecutive to the current frame, and the next frame may be a frame of n seconds subsequent to the current frame. In this case, the user can know the fore and aft situation for a predetermined time in the scene corresponding to the inputted search word, thereby preventing confusion about the scene.

On the other hand, if the current frame is the start frame, the extracting unit 220 can extract the next frame continuous with the current frame. The extracting unit 220 may generate a clip image by connecting the extracted current frame and the next frame. On the other hand, if the current frame is the last frame, the extracting unit 220 can extract a previous frame contiguous to the current frame. The extracting unit 220 may generate a clip image by connecting the extracted previous frame and the current frame.

As another example, when there is no caption information including the received search term among the caption information stored in the DB 100, the extracting unit 220 extracts the caption information including the synonym of the search term from the caption information stored in the DB 100 You can decide. The extracting unit 220 may extract image data matching the caption information including the synonym.

At this time, the extracting unit 220 can extract a current frame matching with caption information including a synonym of the search word among a plurality of frames constituting the image data. The extractor 220 may extract at least one of a previous frame and a next frame contiguous to the current frame according to whether the current frame is a start frame, a last frame, or a frame located between a start frame and a last frame have. The extracting unit 220 may generate a clip image by connecting at least one of a previous frame and a next frame with a current frame.

As another example, when caption information is not stored in the DB 100, the extractor 220 can generate caption information for each frame using the audio information of the image data stored in the DB 100. [ Then, the extracting unit 220 can determine the subtitle information including the synonym of the search word or the search word among the generated frame-by-frame subtitle information. Then, the extracting unit 220 may extract, from the DB 100, image data matching the caption information including the search word or the synonym of the search word. At this time, the extracting unit 220 can extract a current frame matching with the subtitle information determined through the audio information among a plurality of frames constituting the video data. The extractor 220 may extract at least one of a previous frame and a next frame contiguous to the current frame according to whether the current frame is a start frame, a last frame, or a frame located between a start frame and a last frame have. Then, the extracting unit 220 may generate a clip image by connecting at least one of the frames following the previous frame value with the current frame.

The providing unit 230 may provide the extracted image data and the caption information as a search result of the search term. At this time, the providing unit 230 may provide a clip image as a search result of the search word on the web page.

3, when the AAA is inputted as a search term, the providing unit 230 transmits the search word AAA 310, the caption information 330 related to the search term, and the image data 320 matching the caption information It can be displayed on a web page. At this time, the caption information 330 and the video data 320 related to the search term can be used as an example sentence of the search term AAA 310. As described above, the caption information 330 is used as an example sentence of the search term AAA 310 and the image data 320 matching with the caption information 330 is provided, so that the user can easily understand the situation represented by the example sentence .

As another example, the providing unit 230 may separately display the video data including the caption information related to the search term AAA and the caption information around the video data on the web page. 3, the providing unit 230 reproduces the video data including both the video and the subtitles and displays the caption information 330 on one of the top, bottom, left, and right of the video data to prevent user confusion. Can be additionally displayed.

As another example, the providing unit 230 may provide the caption information related to the search term and the display information for reproducing the video data. Referring to FIG. 4, the providing unit 230 may display the search word 410, the pronunciation symbol 420, the display information 430, and the caption information 440 related to the search word on the web page. Then, when the display information 430 is selected by the user, the providing unit 230 can display the image data 320 on the web page as shown in Fig.

When the searcher 230 receives the search word according to the search request, the searcher 230 may provide the image data corresponding to the caption information and the caption information as an example sentence of the search result of the search term. Then, when the user inputs a search word for the pre-search, the user receives an example of the actual use of the search word through the caption information, and the video data corresponding to the caption information is also displayed together with the caption information Can be provided.

In the above description, as the search result of the received search word, the image data matching with the caption information related to the search term is extracted and provided. At this time, the search term and the caption information may be a language of the same country or a different country. For example, when the received search term is a language of a first country such as Korean, Japanese, German, French, etc., the extracting unit 220 extracts image data matching with the caption information expressed in the language of the first country, can do.

When the received search term is a language of a first country such as Korean, Japanese, Chinese, German, French, etc., the extracting unit 220 extracts subtitle information expressed in a language of a second country such as English, Spanish, It is possible to extract the image data. Here, the language of the second country may mean a language different from the language of the first country.

5 is a flowchart illustrating an operation of a search result providing system according to an embodiment of the present invention.

Referring to FIG. 5, the receiving unit 210 may receive a search word input from a user (S510).

Then, the extracting unit 220 may search for the existence of the caption information related to the search word received from the DB 100 (S520). At this time, the DB 100 may be included in the search result providing system 200 or may be located outside the search result providing system 200 and communicate with the search result providing system 200 through the network.

If there is the caption information related to the search term (S520: YES), the extracting unit 220 determines the caption information related to the search term and extracts the image data matching the determined caption information (S530). For example, the extracting unit 220 may determine the caption information including the received search term among the caption information stored in the DB 100 as the caption information related to the search term. As another example, the extracting unit 220 may determine the subtitle information including the synonym of the received search term among the subtitle information stored in the DB 100 as the subtitle information related to the search term.

At this time, if there is no caption information related to the search term in the DB 100 (S520: NO), the extracting unit 220 may generate caption information using the audio information of the video data (S540). For example, the extracting unit 220 may generate the caption information for each frame.

The extraction unit 220 determines the caption information related to the search term from the generated caption information, and extracts image data matching the determined caption information from the DB 100 (S550).

At this time, the extracting unit 220 may extract a current frame matching the determined caption information from a plurality of frames constituting the image data, from the DB 100 (S560).

The extracting unit 220 may extract at least one of a previous frame and a next frame continuous with the current frame from the DB 100 (S570).

For example, if the current frame is the start frame, the extracting unit 220 may extract the next frame following the current frame. As another example, if the current frame is the last frame, the extracting unit 220 may extract a previous frame contiguous to the current frame. As another example, if the current frame is located between the start frame and the last frame, the extracting unit 220 can extract the previous frame and the next frame contiguous to the current frame.

The extraction unit 220 may generate a clip image by connecting the extracted current frame and at least one of the previous frame and the next frame (S580). At this time, the extracting unit 220 may generate a clip image so that the caption information is not included in the image, and may generate the clip image so that the caption information is included in the image.

Then, the providing unit 230 may provide image data matching the caption information and the caption information related to the search term. At this time, the provider 230 may provide the clip image generated as the search result of the search word on the web page.

Referring to FIG. 3, the providing unit 230 may include caption information 330 including a search word AAA 310, a clip image 320, and a search word AAA, for example, It can be displayed on a web page. At this time, when the clip image includes the caption information, the clip image 320 of FIG. 3 includes the caption information 330 including the search word AAA and may be displayed on the web page.

Then, the providing unit 230 may provide the caption information and the display information for reproducing the video data together (S590). At this time, when the searcher 230 receives a search word according to the dictionary search request, the searcher 230 may provide the image data corresponding to the caption information and the caption information as an example sentence of the search result of the search term.

For example, referring to FIG. 4, the providing unit 230 may display the display information 430 for reproducing the generated clip image on the web page. At this time, the providing unit 230 may display the caption information 440 and the display information 430 related to the search term together with the search result of the search term 410. Then, when the display information 430 is selected by the user, the providing unit 230 can display the caption information 440 and the clip image on the web page together. At this time, when caption information is included in the clip image, the providing unit 230 may display only the clip image without separately displaying the caption information 440 on the web page.

If the received search term is the language of the first country, the extracting unit 220 may extract image data matching the caption information expressed in the language of the first country, as in the case of the search term, It is also possible to extract image data matching the subtitle information expressed in the language of the second country. Here, the language of the second country may mean a language different from the language of the first country.

2 to 5, description has been given of separately providing video data and caption information as a search result of a search word, but the caption information may be included in the video data. In other words, the providing unit 230 may not provide caption information separately, but may provide the caption information together with the video data after reproducing the video data after synchronizing the caption information. At this time, the providing unit 230 may change the color of the subtitle information displayed corresponding to the conversation contents of the video based on the synchronization information between the video data and the caption information, and display the changed caption information on the web page. For example, when the caption information is displayed in white, the providing unit 230 may change the caption information from white to yellow as time elapses. Subsequently, the subtitle information corresponding to the video data already reproduced on the web page is displayed in yellow, and the subtitle information corresponding to the video data to be reproduced can be displayed in white.

Also, in the above description, as the search result of the search term, description has been given for providing the image data matching with the caption information and the caption information related to the search term, the provider 230 may provide a description of the search term. For example, the extracting unit 220 may extract a description matching the search word AAA received from the DB 100. Then, the provider 230 can display the extracted description of the AAA and the search word AAA together on the web page. Here, the description may be displayed on the web page in the form of a text as a dictionary meaning of the search word AAA.

The methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software.

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

200: Search result providing system
210:
220:
230: Offering
100: DB

Claims (15)

Receiving a search term;
Extracting image data matching with caption information related to the search term from a database; And
Providing the caption information and the video data
Lt; / RTI >
Wherein the extracting comprises:
Wherein the extracting unit extracts a current frame matching the caption information among a plurality of frames constituting the image data, a previous frame or a next frame continuous with the current frame. The method according to claim 1,
Wherein the extracting comprises:
And extracting image data matching the caption information or the caption information including a synonym of the search term. Receiving a search term;
Extracting image data matching with caption information related to the search term from a database; And
Providing the caption information and the video data
Lt; / RTI >
Wherein the extracting comprises:
And extracting image data matching the caption information determined using the audio information of the image data. delete Receiving a search term;
Extracting image data matching with caption information related to the search term from a database; And
Providing the caption information and the video data
Lt; / RTI >
Wherein the extracting comprises:
If the search term is a language of a first country, extracting image data matching with caption information expressed in a language of a second country. The method according to claim 1,
Wherein the providing step comprises:
And providing the subtitle information and the display information for reproducing the video data together. Receiving a search term;
Extracting image data matching with caption information related to the search term from a database; And
Providing the caption information and the video data
Lt; / RTI >
Wherein the providing of the caption information and the image data comprises:
And providing the caption information and the image data corresponding to the caption information as an example sentence of the search result of the search term when the search term is received according to the dictionary search request. A computer-readable recording medium on which a program for executing the method of any one of claims 1 to 3 and 5 to 7 is recorded. A receiving unit for receiving a search word;
An extracting unit for extracting image data matching with caption information related to the search word from a database; And
And providing the caption information and the video data,
Lt; / RTI >
The extracting unit extracts,
Wherein the extracting unit extracts a current frame matching the caption information among a plurality of frames constituting the image data, a previous frame continuing to the current frame, or a subsequent frame. 10. The method of claim 9,
The extracting unit extracts,
And extracts image data matching with the caption information or the caption information including a synonym of the search term. A receiving unit for receiving a search word;
An extracting unit for extracting image data matching with caption information related to the search word from a database; And
And providing the caption information and the video data,
Lt; / RTI >
The extracting unit extracts,
And extracts image data matching with the subtitle information determined using the audio information of the image data. delete A receiving unit for receiving a search word;
An extracting unit for extracting image data matching with caption information related to the search word from a database; And
And providing the caption information and the video data,
Lt; / RTI >
The extracting unit extracts,
If the search term is a language of a first country, extracting image data matching with caption information expressed in a language of a second country. 10. The method of claim 9,
Wherein the providing unit comprises:
And providing display information for reproducing the caption information and the image data. A receiving unit for receiving a search word;
An extracting unit for extracting image data matching with caption information related to the search word from a database; And
And providing the caption information and the video data,
Lt; / RTI >
Wherein the providing unit comprises:
And provides the caption information and the image data corresponding to the caption information as an example sentence of the search result of the search term when the search term is received according to the dictionary search request.

Images