JP7297266B2 - SEARCH SUPPORT SERVER, SEARCH SUPPORT METHOD, AND COMPUTER PROGRAM - Google Patents

Description

According to the present invention, it is possible to reliably display a specific scene of video content desired by a user, who is the subject of a search, from a large number of video content provided by a content provider on a website by speaking. Search support server, search support method and computer program.

Various information exists on the website. Currently, it is possible to find the content that the user desires by clicking on the icon on the top page of the website, using a description using words that can be clicked, or using a search window using a search engine such as Google (R) or Yahoo (R). An address to a Web page or video content itself is extracted and reproduced on a display device that is visible to the user.

Also, when receiving a search key input by user's utterance, a speech recognition engine provided by Google (R), Microsoft (R), etc. is used to recognize the user's utterance. These commercial speech recognition engines are provided as general-purpose speech recognition engines generated by extensively collecting speech data and machine learning or deep learning.

Therefore, when recognizing the user's utterance by voice, there is a possibility that the search key that the content provider intends to provide to the user cannot be correctly recognized. Therefore, for example, Patent Document 1 discloses a speech understanding device that uses a plurality of language models to improve speech recognition accuracy.

Further, Japanese Patent Laid-Open No. 2002-200000 discloses a digital broadcast receiver that displays key information for a user to search for a program or scene on a screen and accepts a user's selection. In Patent Literature 2, a content holder creates and stores metadata including search information, and displays a list of scene information of moving images searched by the search information to the user. can be selected and played.

JP 2010-170137 A JP 2009-055643 A

In Patent Document 1, processing is performed in parallel using a plurality of speech recognition engines, and the processing results of the language understanding engine based on the obtained plurality of recognition results are integrated. However, the process of integrating multiple recognition results and language understanding process results not only takes a considerable amount of time, but also cannot guarantee the accuracy of the recognition results after the integration process, which is not realistic. Therefore, there is a problem that there is no guarantee that the correct search key can be acquired in a short time by the user's utterance.

Further, in Patent Document 2, a list of metadata including search information created by a content holder is displayed. However, in Patent Document 2, it is necessary to select from displayed metadata, but the number of metadata that can be displayed is limited due to physical restrictions on the display area of metadata. . Therefore, it is conceivable that the metadata associated with the scene desired by the user may not be displayed, and in order for the user to reproduce the desired scene, it is necessary to search for the desired scene while reproducing the desired scene. There was a problem of requiring In addition, it takes a considerable amount of time and effort to create metadata to be displayed as a list, and a sufficient number of metadata cannot be displayed. There is also no guarantee that you are playing the desired scene.

The present invention has been made in view of the above circumstances, and includes a signage window that selectively displays guide data that guides speech for selecting tag information that indicates a specific portion (scene) of moving image content; By using a speech window that can display guide data narrowed down by utterance, as long as the user speaks or selects according to the guide data narrowed down according to his/her purpose, video content that the content provider wants to provide to the user. It is an object of the present invention to provide a search support server, a search support method, and a computer program that can reliably guide users to a specific part of the.

In order to achieve the above object, a search support server according to the present invention is a search support server that supports a search for video content published on a website, and selects tag information indicating a specific portion of video content. Data communication is possible between a signage window that selectively displays guide data that induces the user's utterance and a speech window that can narrow down the guide data to be displayed from among the guide data according to the user's utterance. Displaying the tag information on the connected terminal device, receiving speech by the user of the tag information displayed on the signage window and/or the speech window, narrowing down the tag information to be displayed, and narrowing down the tag information By receiving a selection, a specific portion of the video content corresponding to the tag information for which the selection has been received is reproduced on the terminal device.

Further, in the search support server according to the present invention, the tag information includes at least a tag name that identifies a specific part of the video content, text data consisting of a simple sentence or a group of words describing the contents of the tag name, and tag name It is preferable that it is composed of attribute information indicating an attribute.

Further, the search support server according to the present invention comprises search data generation means for generating search data that is the basis of guide data to be displayed on the signage window and/or the speech window, and the search data generation means extracting/reproducing means for extracting a simple sentence or a group of words indicating the content based on the contents of the content, and reproducing the video content corresponding to the selection of the extracted simple sentence or the group of words; tag input receiving means for receiving an input of the tag name and a simple sentence or a group of words indicating the content of the tag name based on the video content; and reproducing a specific portion of the video content based on the video content to be reproduced. Pointer searching means for searching for pointer information including start time and reproduction end time; pointer allocation receiving means for receiving allocation of the searched pointer information for each tag name whose input is received; and tag whose input is received. It is preferable to provide attribute information receiving means for receiving input of the attribute information that can be spoken at the time of searching for each name.

Further, in the search support server according to the present invention, the extracting/reproducing means scrutinizes the moving image content, recognizes the contained voice as a simple sentence or a group of words, and outputs it as text data. and content reproducing means for reproducing the video content corresponding to the selected text data when the selection of the output text data is received.

Further, in the search support server according to the present invention, the pointer allocation reception means reproduces the moving image content with respect to the reproduction start time and the reproduction end time of the specific portion of the moving image content included in the searched pointer information. It is preferable to provide a pointer update receiving means for receiving an update while updating the pointer.

Further, in the search support server according to the present invention, it is preferable that the guide data is generated by associating the tag information included in the search data with search data identification information for identifying the search data.

Further, the search support server according to the present invention further includes speech accepting means for accepting input of voice data uttered by the user in order to narrow down the tag names displayed in the speech window and capable of accepting selection by the user. , converts the received voice data into text data, calculates the degree of matching of the converted text data with the tag name of the guide data and a simple sentence or word group indicating the content of the tag name, and calculates the calculated degree of matching Meta tag speech recognition means for identifying the tag name with the maximum value and displaying the specific part of the video content corresponding to the tag name when the degree of matching is greater than a predetermined value; extracts tag information that matches the attribute information from among the tag information of the guide data, narrows down the guide data by logical AND of one or more pieces of attribute information that match, and extracts the guide data that has been narrowed down It is preferable that the apparatus further comprises narrowed-down speech recognition means for outputting the tag name and the attribute information, and that the meta-tag speech recognition means and the narrowed-down speech recognition means are executed in parallel.

Further, in the search support server according to the present invention, the metatag speech recognition means converts the text data, all the tag names and the first data formed of simple sentences or word groups indicating the contents of the tag names The degree of matching with the set is calculated, and the narrowing-down speech recognition means extracts the second data set formed by the attribute information associated with all the tag names as the recognition result using the second data set as a speech recognition filter. Preferably, the guide data are narrowed down by logical product of the attribute information.

Further, in the search support server according to the present invention, it is preferable that the narrowed-down speech recognition means updates the second data set with the attribute information of the narrowed-down guide data.

Next, in order to achieve the above object, a search support method according to the present invention is a search support method that can be executed by a search support server that supports searches for video content published on a website, comprising: The search support server comprises a signage window for selectively displaying guide data for guiding speech for selecting tag information indicating a specific part of video content, and a user selecting guide data to be displayed from among the guide data. a step of displaying a speech window that can be narrowed down by an utterance on a terminal device connected to be capable of data communication; By receiving an utterance, narrowing down the tag information to be displayed, and receiving selection of the narrowed-down tag information, a specific part of the video content corresponding to the selected tag information is reproduced on the terminal device. It is characterized by performing the steps.

Further, in the search support method according to the present invention, the tag information includes at least a tag name that identifies a specific part of the moving image content, text data consisting of a simple sentence or a group of words describing the contents of the tag name, and the tag name. It is preferable that it is composed of attribute information indicating an attribute.

Further, in the search support method according to the present invention, the search support server extracts a simple sentence or word group indicating the content based on the content of the video content, and accepts selection of the extracted simple sentence or word group. a step of reproducing the video content corresponding to the case; a step of accepting input of the tag name and a simple sentence or word group indicating the content of the tag name based on the video content to be played; and a step of receiving the video to be played. A step of searching for pointer information including a reproduction start time and a reproduction end time of a specific portion of the video content based on the content, and a step of receiving allocation of the searched pointer information for each of the received tag names. and a step of receiving an input of the attribute information that can be spoken at the time of searching for each of the tag names whose input has been received, and search data serving as a basis for guide data displayed in the signage window and/or the speech window. is preferably generated.

Further, in the search support method according to the present invention, the search support server closely examines the video content, recognizes the included speech as a simple sentence or word group, and outputs it as text data; When the selection of text data is accepted, it is preferable to perform the step of reproducing the moving image content corresponding to the text data for which the selection is accepted.

Further, in the search support method according to the present invention, the search support server, while reproducing the video content, determines the reproduction start time and the reproduction end time of the specific portion of the video content, which are included in the searched pointer information. Preferably, a step of accepting updates is performed.

Further, in the search support method according to the present invention, it is preferable that the guide data is generated by associating the tag information included in the search data with search data identification information for identifying the search data.

Further, in the search support method according to the present invention, in order to narrow down the tag names which are displayed in the speech window and which can be selected by the user, the search support server inputs voice data uttered by the user. a simple sentence or a group of words indicating the tag name of the guide data of the converted text data and the content of the tag name, wherein the search support server converts the received voice data into text data, and executes the receiving step; a step of calculating the degree of matching with respect to the tag name, identifying the tag name with the highest degree of matching calculated, and displaying a specific portion of the video content corresponding to the tag name when the degree of matching is greater than a predetermined value; and extracting the tag information that matches the attribute information from among the tag information of the guide data based on the received voice data, and narrowing down the guide data by logical AND of one or more pieces of attribute information that match. It is preferable that the step of outputting the tag name and the attribute information of the narrowed down guide data is executed in parallel.

Further, in the search support method according to the present invention, the search support server provides a first data set formed of converted text data, simple sentences or word groups indicating all the tag names and the contents of the tag names. and the logic of the attribute information extracted as a recognition result using a second data set formed of the attribute information associated with all tag names as a speech recognition filter and narrowing down the guide data by product.

Further, in the search support method according to the present invention, it is preferable that the search support server updates the second data set with the attribute information of the narrowed down guide data.

Next, in order to achieve the above object, a computer program according to the present invention is a computer program that can be executed by a search support server for supporting search of video content published on a website, the computer program comprising: A support server is provided with a signage window for selectively displaying guide data for guiding an utterance for selecting tag information indicating a specific portion of video content, and a user uttering the guide data to be displayed from among the guide data. means for displaying on a terminal device connected to a terminal device capable of data communication a speech window that can be narrowed down by a user; As a means for narrowing down the tag information to be received and displayed, and receiving selection of the narrowed-down tag information so that the terminal device reproduces a specific portion of the video content corresponding to the selected tag information. It is characterized by functioning.

Further, in the computer program according to the present invention, the tag information includes at least a tag name that identifies a specific part of the video content, text data consisting of a simple sentence or a group of words describing the contents of the tag name, and attributes of the tag name. is preferably configured with attribute information indicating

Further, the computer program according to the present invention causes the search support server to function as search data generating means for generating search data serving as a basis for guide data displayed in the signage window and/or the speech window, and Extraction/playback for extracting a simple sentence or a group of words indicating content based on the content of the moving image content, and reproducing the corresponding moving image content when selection of the extracted simple sentence or group of words is accepted. means, tag input receiving means for receiving input of the tag name and simple sentences or word groups indicating the contents of the tag name based on the reproduced video content, and input of the video content based on the reproduced video content. Pointer searching means for searching for pointer information including reproduction start time and reproduction end time of a specific portion, pointer allocation receiving means for receiving allocation of the searched pointer information for each tag name whose input is received, and input reception. It is preferable to function as attribute information receiving means for receiving input of the attribute information that can be spoken at the time of searching for each of the tag names.

Further, the computer program according to the present invention is a speech transcription means for examining the moving image content, recognizing the included speech as a simple sentence or a group of words, and outputting it as text data. And, when receiving the selection of the output text data, it is preferable to function as content reproducing means for reproducing the moving image content corresponding to the selected text data.

Further, the computer program according to the present invention causes the pointer allocation reception means to obtain the reproduction start time and the reproduction end time of the specific portion of the moving image content, which are included in the searched pointer information, while reproducing the moving image content. It is preferable to function as pointer update receiving means for receiving updates.

Further, in the computer program according to the present invention, it is preferable that the guide data is generated by associating the tag information included in the search data with search data identification information for identifying the search data.

Further, the computer program according to the present invention causes the search support server to input voice data uttered by the user in order to narrow down the tag names displayed in the speech window and capable of accepting selection by the user. Functioning as an utterance accepting means for accepting input, the search support server converts the input accepted voice data into text data, and a simple sentence or word indicating the tag name of the guide data of the converted text data and the content of the tag name A metatag for calculating a degree of matching with a group, identifying a tag name with the highest degree of matching calculated, and displaying a specific portion of the video content corresponding to the tag name when the degree of matching is greater than a predetermined value. extracting tag information matching the attribute information from among the tag information of the guide data based on the voice recognition means and the voice data received as an input; It is preferable to function in parallel as narrowed-down speech recognition means for narrowing down data and outputting the tag name and attribute information of the narrowed-down guide data.

Further, the computer program according to the present invention provides a first data set formed of converted text data, simple sentences or word groups indicating all of the tag names and the content of the tag names. The second data set formed by the attribute information associated with all the tag names is functioned as a means for calculating the degree of matching, and the second data set formed by the attribute information associated with all tag names is used as a speech recognition result. It is preferable to function as means for narrowing down the guide data by logical product of the attribute information extracted as .

Also, the computer program according to the present invention preferably causes the narrowed-down speech recognition means to function as means for updating the second data set with the attribute information of the narrowed-down guide data.

According to the present invention, a content provider who provides moving image content from among a large number of moving image contents published on a website can display guide data that easily guides a user to the provided moving image content in a speech window or a signage window. In addition, the user can narrow down the guide data to be selected at his or her own will, so that each user can speak or select according to the displayed guide data, easily and quickly. It is possible to display/reproduce video content provided by a content provider in accordance with the user's intention.

1 is a block diagram schematically showing the configuration of a voice search system according to an embodiment of the present invention; FIG. 1 is a block diagram schematically showing the configuration of a search support server according to an embodiment of the present invention; FIG. 1 is a block diagram schematically showing the configuration of a terminal device according to an embodiment of the present invention; FIG. 4 is a functional block diagram of search data generation processing of the search support server according to the embodiment of the present invention; FIG. FIG. 4 is an exemplary view of an input reception screen displayed on a terminal device used by a content provider by the search support server according to the embodiment of the present invention; FIG. 4 is an exemplary diagram of search data and guide data generated by the search support server according to the embodiment of the present invention; FIG. 4 is an exemplary diagram of search data and guide data of the search support server according to the embodiment of the present invention; FIG. 8 is another exemplary diagram of search data and guide data of the search support server according to the embodiment of the present invention; FIG. 4 is an exemplary diagram of an input acceptance screen displayed on a terminal device used by a user by the search support server according to the embodiment of the present invention; FIG. 4 is an exemplary diagram of a speech window displayed on a terminal device used by a user by the search support server according to the embodiment of the present invention; 9 is a flow chart showing a content provider setting processing procedure of the CPU of the search support server according to the embodiment of the present invention; FIG. 4 is a functional block diagram of speech recognition processing of an utterance by a user of the search support server according to the embodiment of the present invention; 4 is a flow chart showing the procedure of speech recognition processing of the CPU of the search support server according to the embodiment of the present invention;

A search support server according to an embodiment of the present invention will be described below with reference to the drawings. The following embodiments do not limit the invention described in the claims, and all combinations of characteristic items described in the embodiments are essential items for the solution. It goes without saying that there is no limit.

Moreover, the present invention can be implemented in many different modes and should not be construed as being limited to the description of the embodiments. The same reference numerals are given to the same elements throughout the embodiments.

In the following embodiments, a voice search system in which a computer program is installed in a computer system will be described. can be implemented. Therefore, the present invention can provide a signage window that selectively displays guide data that guides utterances for selecting tag information that indicates a specific portion of video content, and all guide data that can be narrowed down by utterances and displayed. By using such a speech window, as long as the user speaks or selects according to the guide data narrowed down according to the user's purpose, it is possible to reliably guide the user to a specific part of the video content that the content provider wants to provide to the user. The search support server can be implemented as hardware, as software, or as a combination of software and hardware. The computer program can be recorded on any computer-readable recording medium such as a hard disk, DVD, CD, optical storage device, or magnetic storage device.

According to the embodiment of the present invention, a content provider who provides moving image content out of a large number of moving image contents published on a website speeches out guide data that easily guides a user to the provided moving image content. It can be displayed on a window or a signage window, and the guide data to be selected can be narrowed down by the user's own intention. Moreover, it is possible to quickly display and reproduce the moving image content provided by the content provider in accordance with the user's intention.

FIG. 1 is a block diagram schematically showing the configuration of a voice search system according to an embodiment of the invention. The voice search system according to the present embodiment can perform data communication with a terminal device 1a used by a content provider, a terminal device 1b used by a user searching for content or video content, and the terminal devices 1a and 1b. and a search support server 3 connected via a network 2 such as the Internet. The terminal devices 1a and 1b are not limited to stationary PCs to which microphones and speakers are connected, but may be portable terminals such as smart phones and tablets that have built-in microphones and speakers.

FIG. 2 is a block diagram schematically showing the configuration of the search support server 3 according to the embodiment of the invention. The search support server 3 according to this embodiment includes at least a CPU (Central Processing Unit) 31, a memory 32, a storage device 33, an I/O interface 34, a video interface 35, a portable memory drive 36, a communication interface 37, and the above-described It consists of an internal bus 38 that connects hardware.

The CPU 31 is connected to the above-described hardware units of the search support server 3 via the internal bus 38, controls the operation of the above-described hardware units, and executes the computer program 100 stored in the storage device 33. perform various software-like functions according to The memory 32 is composed of a volatile memory such as SRAM, SDRAM, etc. A load module is expanded when the computer program 100 is executed, and temporary data generated when the computer program 100 is executed is stored.

The storage device 33 is composed of a built-in fixed storage device (hard disk), ROM, and the like. The computer program 100 stored in the storage device 33 is downloaded by the portable memory drive 36 from a portable recording medium 90 such as a DVD, CD-ROM, USB memory, SD card, etc. that records information such as programs and data, When executed, it is expanded from the storage device 33 to the memory 32 and executed. Of course, it may be a computer program downloaded from an external computer connected via the communication interface 37 .

The storage device 33 has a search data storage section 331 and a guide data storage section 332 . The search data storage unit 331 stores search data (tag names that identify specific parts of the content, simple sentences or word groups that describe the content of the tag names) that can be accessed by users for content provided by content providers. attribute information indicating attributes of data and tag names) is stored in association with pointer information (and time stamp information in the case of video content). Note that the pointer information broadly means information indicating the location of content that can be accessed. If the content is a web page, the URL corresponds to the pointer information, and if the content is video content, not only the reproducible URL, but also time stamp information to start playing the video content and time stamp to end the playing. information is also included in the pointer information.

The guide data storage unit 332 stores guide data generated based on the search data in order to prompt the user to make an utterance for searching or a selection operation such as a click or a touch. The guide data extracts from the search data a tag name that identifies a specific part of the content, text data consisting of simple sentences or word groups that describe the content of the tag name, and attribute information that indicates the attribute of the tag name, It is generated in association with the identification information of the search data to be searched. The guide data to be displayed is narrowed down by the user's utterance while the list is displayed in the speech window displaying the guide data. When the user selects one of the tag names from the guide data that has been narrowed down and displayed, the content (including video content) specified by the search data associated with the selected tag name is displayed ( or playback).

The communication interface 37 is connected to an internal bus 38, and by connecting to an external network 2 such as the Internet, LAN, WAN, etc., it is possible to transmit and receive data to and from an external computer or the like.

The I/O interface 34 is connected to a keyboard 41 and a mouse 42, which are input devices, to input data. In the present embodiment, it is the terminal device 1a, 1b (smartphone, tablet, etc.) used by the content provider or the user that actually inputs the voice, and the input voice data is transmitted via the communication interface 37. to receive. Of course, the search support server 3 may be directly connected with a microphone, a speaker, or the like.

The video interface 35 is connected to a display device 43 such as a CRT display or liquid crystal display. In the present embodiment, it is the terminal devices 1a and 1b (smartphones, tablets, etc.) used by the content provider or the user that actually output and display the images. 1b via the communication interface 37, such as image data (including audio data).

FIG. 3 is a block diagram schematically showing the configuration of the terminal device 1 (common to 1a and 1b) according to the embodiment of the present invention. The terminal device 1 according to the present embodiment includes at least a CPU (Central Processing Unit) 11, a memory 12, a storage device 13, an I/O interface 14, a video interface 15, a portable memory drive 16, a communication interface 17, and the hardware described above. It consists of an internal bus 18 that connects hardware.

The CPU 11 is connected to the above-described hardware units of the terminal device 1 via the internal bus 18 , controls the operation of the above-described hardware units, and executes computer programs 101 stored in the storage device 13 . , which performs various software-like functions. The memory 12 is composed of a volatile memory such as SRAM, SDRAM, etc. A load module is expanded when the computer program 101 is executed, and temporary data generated when the computer program 101 is executed is stored.

The storage device 13 is composed of a built-in fixed storage device (hard disk), ROM, and the like. A computer program 101 stored in the storage device 13 is downloaded from an external computer connected via the communication interface 17, and expanded from the storage device 13 to the memory 12 at the time of execution. Of course, it may be a computer program downloaded via the portable memory drive 16 from a portable recording medium 91 such as an SD card recording information such as programs and data.

The communication interface 17 is connected to an internal bus 18, and by connecting to an external network 2 such as the Internet, LAN, WAN, etc., it is possible to transmit and receive data to and from an external computer or the like.

The I/O interface 14 is connected to an input device such as the keyboard 203 and mouse 204, as well as an audio input device such as the microphone 201 and an audio output device such as the speaker 202, and inputs and outputs data. A smart phone or the like may be connected via the communication interface 17 to substitute the voice input device and the voice output device.

The video interface 15 is connected to the display device 205 and displays images for input/output transmitted from the search support server 3 on a browser or the like. The retrieved content and moving image content may be displayed on the display device 205, or may be displayed on an external computer that is separately connected to enable data communication via a network.

The operation of the search support server 3 configured as described above will be described below.

FIG. 4 is a functional block diagram of search data generation processing of the search support server 3 according to the embodiment of the present invention. FIG. 4 describes a procedure in which a content provider generates search data, generates guide data, and displays them on a signage window and/or a speech window.

In FIG. 4, a search data generation unit 401 generates search data that serves as a basis for guide data displayed in a signage window and/or a speech window. The search data generation unit 401 includes an extraction/reproduction unit 402 , a tag input reception unit 403 , a pointer search unit 404 , a pointer allocation reception unit 405 and an attribute information reception unit 406 .

The extracting/reproducing unit 402 extracts a simple sentence or word group indicating the content based on the content of the moving image content, and reproduces the corresponding moving image content when selection of the extracted simple sentence or word group is accepted. More specifically, the extraction/playback unit 402 includes a voice transcription unit 4021 and a video content display unit 4022 .

The voice transcription unit 4021 extracts and transcribes the voice portion of the target moving image content, and outputs it as text data associated with appropriate time stamp information for each phrase. The output text data can be used as a reference for generating tag names based on the audio included in the video content.

When the selection of the output text data is received, the moving image content reproducing unit 4022 reproduces a specific part of the moving image content corresponding to the selected text data. When the selection of a tag name candidate is accepted, it is reproduced to check whether the video content is correct and to update the time stamp information.

Note that the selected text data, the guide data, and the externally acquired text data may be learned as teacher data, and a language model for speech recognition used in the speech transcription unit 4021 may be output. The learning method includes so-called AI, and is not particularly limited as long as it is a well-known learning method.

Input of tag information associated with a specific portion of video content is then accepted. In the present embodiment, the tag information includes at least a tag name that identifies a specific part of video content, text data consisting of simple sentences or word groups that describe the content of the tag name, and attribute information that indicates the attribute of the tag name. ing.

The tag input reception unit 403 receives input of a tag name and a simple sentence or word group indicating the content of the tag name based on the displayed text data or a specific portion of the video content being reproduced.

A pointer search unit 404 searches for pointer information indicating a specific portion of the moving image content based on the specific portion of the moving image content being reproduced. As pointer information to be searched, not only already associated URLs but also time stamp information relating to reproduction start timing and reproduction end timing are searched.

In the case of video content, the automatically allocated specific portion is not necessarily the portion that the content provider really wants to provide. There is a possibility that unnecessary parts are included, or necessary parts are divided. Therefore, the pointer information can be updated by operating the screen to be described later. As a result, it is possible to provide the desired moving image content in just the right amount.

The pointer allocation reception unit 405 receives allocation of searched pointer information for each tag name whose input is received. Accordingly, by accepting the selection of the tag name, it is possible to reproduce a specific portion of the moving image content according to the allocated pointer information.

The attribute information reception unit 406 receives input of attribute information that can be spoken at the time of searching for each tag name whose input is received. The tag names can be narrowed down by the user uttering the attribute information as will be described later.

Here, the attribute information is information useful for narrowing down the video contents, such as "new", "movie", "how to use", "price", "medical", etc., and if it is an easy-to-utter word, It is not limited.

In this way, input of a tag name, a simple sentence or a group of words indicating the contents of the tag name, and attribute information is received, and search data is generated in association with pointer information as tag information. The guide data generation unit 407 generates guide data by associating the tag information included in the generated search data with the search data identification information for identifying the search data.

FIG. 5 is an exemplary diagram of an input reception screen displayed on the terminal device 1a used by the content provider by the search support server 3 according to the embodiment of the present invention. An initial screen 50 shown in FIG. 5 is popped up on the terminal device 1a used by the content provider. The content provider can allocate the scene of the moving image content to the tag information by selecting the "Assign" button 52 while reproducing the moving image content to be provided to the user in the reproduction area 51 .

When the selection of the "assignment" button 52 by the content provider is accepted, the audio portion of the video content for which the selection has been accepted is transcribed by voice recognition, extracted as simple sentences or word groups, and the playback start point is set for each phrase. Create a transcription with the timestamp information shown. The created transcriptions are listed in the table of contents display area 53, or if they cannot be displayed, they are displayed in the shared window 60 used as the search data creation area in FIG. If it cannot be displayed, all the transcriptions can be displayed by scrolling operation or the like.

As a result, when selection of a tag name candidate for each scene in the video content displayed as a transcription in the common window 60 is accepted, the associated scene of the video content is reproduced.

The content provider selects the "mark input" button 61 at a desired reproduction start timing while reproducing the moving image content. When the selection of the "input mark" button 61 is accepted, provisional tag information is created with the reproduction start time stamp as pointer information. Temporary tag information can be generated and stored at any time during playback of video content.

Next, selection of the "input tag" button 54 by the content provider is accepted. When the selection of the "input tag" button 54 is accepted, the search data creation area including the tag name input area 55, the meta tag input area 56, etc. is displayed in the shared window 60 by accepting the selection of the provisional tag information displayed in the list. 60 is displayed to accept input of tag information.

A list of provisional tag information is displayed by accepting selection of the "end tag input" button 59. FIG. By accepting selection of temporary tag information and inputting tag information, search data can be generated for all temporary tag information. Although the attribute information input area is not shown in FIG. 5, an input area for key-in or selection buttons may be arranged and displayed to accept input.

The characteristic features of this embodiment are that the input of tag information is accepted by the content provider's speech, and the existence of the "time meter". For example, when the content provider utters "time meter", the time meter 57 is provided with pointer update reception means capable of updating a specific portion of the video content associated with the tag information.

Specifically, when a screen for creating tag information to be updated is displayed in the search data creation area displayed in the common window 60, and an utterance of "time meter" is accepted, the slider of the time meter corresponds to the tag information. It is positioned and displayed at the reproduction start time stamp of the attached pointer information and can be moved. When the slider is moved while the playback start time stamp is displayed in the playback time display area 58, the time stamp at the time of playback corresponding to the position of the slider is displayed in the playback time display area 58, and the video content in the playback area 51 is displayed. changes.

The playback start time stamp and playback end time stamp (hereinafter referred to as time stamp information) may also be set by the content provider's selection of the "mark input" button 61 or utterance of "mark". For example, the content provider can set the time stamp information by selecting the "mark input" button 61 or by speaking "mark" at the scene where the time stamp information is to be set while reproducing the moving image content. can be done.

When the tag information, playback start time stamp and playback end time stamp have been set, the content provider selects the "input tag" button 54 . When the "input tag" button 54 is selected, the search support server 3 searches for the URL of the video content displayed on the browser of the terminal device 1a as pointer information, and along with the set time stamp information, The search data is stored in the search data storage unit 331 as search data in association with the tag name.

Guide data is generated by associating identification information for identifying search data with the tag information portion of search data. FIG. 6 is an exemplary diagram of search data and guide data generated by the search support server 3 according to the embodiment of the present invention. FIG. 6(a) is an exemplary diagram of generated guide data, and FIG. 6(b) is an exemplary diagram of search data that is the basis of the generated guide data.

As shown in FIG. 6(a), the guide data are associated with a "number" indicating the order of the tag name of the search data, and common search data that is identification information for identifying a website. It has an ID (search data ID=XXXXXX in FIG. 6). The generated guide data is stored in the guide data storage unit 332 .

Only the search data is stored in association with the URL as the "pointer information" and the reproduction "start" time and the reproduction "end" time as the time stamp information in association with the tag name. Therefore, by accepting the selection of the "guide data" button 62 in FIG. 5, the tag information of the search data is copied, and the search data ID (XXXXXXX) and the "number" indicating the number of the tag name of the search data. ” are associated with each other to generate guide data. The fact that the "search data ID" column of the guide data shown in FIG. 6(a) is blank means that the guide data is generated based on only one search data, and is generated based on other search data. If the guide data is the guide data that has been written, the search data ID of the other search data is described.

The shared window 60 of the signage window shown in FIG. 5 preferably displays the tag name of the guide data selected by the content provider as the data that the content provider wants to display to the user from among the generated guide data. In this case, when the selection of the "guide data" button 62 is accepted, an "edit" button and an "expand" button (not shown) are displayed. When the selection of the "edit" button is accepted, by keying in the common window 60, the tag name to be displayed in the common window 60 of the signage window can be set. When the selection of the "expand" button is accepted, guide data generated from other search data can be added. The table of contents data can be displayed in the table of contents display area 53 by extracting the table of contents data from the added guide data.

That is, in the present embodiment, search data may be generated for each content provider, or search data may be generated for each of multiple websites launched by the same content provider. For example, even if it is a website of the same company, there is a rapid increase in the number of opportunities to set up a website for each business division or product/service, and the amount of content is increasing day by day. Being able to find this content quickly and reliably is also important for customer service.

In the present embodiment, all guide data are generated based on basic search data. Therefore, if only guide data generated based on other search data is added to one guide data, content (including video content) associated with other search data, that is, content of another website can be obtained. can be quickly and reliably displayed and reproduced.

FIG. 7 is an exemplary diagram of search data and guide data of the search support server 3 according to the embodiment of the present invention. FIG. 7(a) is an exemplary diagram of guide data based on search data of one content provider, and FIG. 7(b) is an exemplary diagram of search data of another content provider who provides video content. .

The difference between the search data and the guide data shown in FIG. 6 is that guide data having different search data IDs are included instead of the common search data ID. That is, when the search data and the guide data are generated, the search data ID is common. In this embodiment, the two-stage structure of search data and guide data makes it possible to set guide data with different search data IDs. As a result, it is possible to read out search data that is the basis of guide data with different search data IDs, and to reproduce search data with different search data IDs, that is, specific portions of video content provided by different content providers. Become.

For example, let the common search data ID be "YYYYYY". Guide data based on other search data IDs can be added as needed to the guide data generated based on the common search data ID "YYYYYY". In the example of FIG. 7A, guide data with a search data ID of "TTTTTT" is added. That is, it becomes possible to read out the search data that is the basis of the guide data whose search data ID is "TTTTTT", and to reproduce the video content associated with the search data.

That is, it is possible to refer to the search data whose search data ID is "TTTTTT" shown in FIG. 7B, and to obtain the pointer information of the desired content. Therefore, by simply adding guide data, desired content can be displayed regardless of the content of any website. In FIG. 7B, blanks in the "search data ID" column of the guide data indicate that the guide data is not the added guide data but the guide data whose search data ID is the common search data ID "YYYYYY". means.

FIG. 8 is another exemplary diagram of search data and guide data of the search support server 3 according to the embodiment of the present invention. FIG. 8(a) is an exemplary diagram of guide data based on search data of one content provider, and FIG. 8(b) is an exemplary diagram of search data of another content provider.

For example, let the common search data ID be "YYYYYY". Guide data of contents based on other search data IDs can be added to the guide data generated based on the search data with the search data ID of "YYYYYY" at any time. In FIG. 8A, guide data whose search data ID is "PPPPPP" is added. That is, it becomes possible to read the search data that is the basis of the guide data whose search data ID is "PPPPPP", and to display the content associated with the search data.

That is, it is possible to refer to the search data whose search data ID is "PPPPPP" shown in FIG. 8(b), and to obtain pointer information and time stamp information of desired content. Therefore, by simply adding guide data, only desired scenes of desired moving image content can be reproduced regardless of the moving image content of any website. Note that in FIG. 8B, blanks in the "search data ID" column of the guide data mean that the guide data is not added guide data but guide data whose search data ID is "YYYYYY".

Returning to FIG. 4, the signage window display unit 408 causes the content provider to select the tag name and the like of the generated guide data and display it on the signage window on the terminal device 1b used by the user. As a result, the user can be guided to utter an utterance for selecting the tag information indicating the specific portion of the video content.

FIG. 9 is an exemplary diagram of an input reception screen 900 displayed on the terminal device 1b used by the user by the search support server 3 according to the embodiment of the present invention. As shown in FIG. 9, a signage window 902 is displayed together with a content window 901 capable of displaying video content. It is preferable that the signage window 902 is displayed in such a manner that the character string is displayed in a flowing manner.

Specifically, the signage window 902 displays the tag name of the selected guide data. In FIG. 9, an arrow means that the character string is displayed while flowing in that direction. The user who sees the display of the signage window 902 can know what kind of information the content provider intends to provide, and can devise the contents of the utterance. The content provider displays, on the signage window 902, a tag name indicating a scene in the video content to be provided to the user or a character string to guide the selection by the user, thereby allowing the user to view the scene in the video content to be provided. can be induced.

The input acceptance screen 900 also includes a table of contents display area 903 in which tag names for each scene in the video content are listed as a table of contents. A scene in the video content can be played in the content window 901 by directly selecting the table of contents. An explanation of the tag name can also be displayed by selecting the "i" button next to the tag name displayed in the table of contents display area 903 .

Returning to FIG. 4, the speech window display unit 409 displays all tag names of the generated guide data in a speech window on the terminal device 1b used by the user. Tag names of guide data that cannot be displayed in the table of contents display area 903 can also be displayed in the speech window. The user can speak to narrow down the tag names of the guide data. By narrowing down, it is possible to display the tag name in the speech window without performing operations such as scrolling. can be displayed.

FIG. 10 is an exemplary diagram of a speech window displayed on the terminal device 1b used by the user by the search support server 3 according to the embodiment of the present invention. As shown in FIG. 10, all tag names of generated guide data are displayed in a guide data display area 1002 in a selectable state on a speech window 1001 .

Even if all the tag names cannot be displayed in the guide data display area 1002, the tag names of all the guide data can be browsed by operating the scroll button 1003. FIG. A selection of one tag name from the tag names of the guide data displayed in the guide data display area 1002 is accepted. As a result, it is possible to specify the search data that is the basis of the guide data of the tag name whose selection has been accepted, so that the specified part of the video content associated with the search data can be reproduced.

In the example of FIG. 10, when the selection of the tag name displayed in the speech window 1001 is accepted, the specific part of the corresponding content is displayed on the terminal device 1b so that the user can check it. The terminal device 1b used by the user may be a desktop type as shown in FIG. 10, or may be a mobile terminal such as a smartphone or a tablet.

FIG. 11 is a flow chart showing a content provider setting processing procedure of the CPU 31 of the search support server 3 according to the embodiment of the present invention. In FIG. 11, the CPU 31 of the search support server 3 extracts a simple sentence or a word group indicating the content based on the content of the video content (step S1101), and when the selection of the extracted simple sentence or word group is accepted, The corresponding video content is reproduced (step S1102).

The CPU 31 accepts input of a tag name and a simple sentence or word group indicating the content of the tag name based on the displayed text data or a specific portion of the video content being reproduced (step S1103).

CPU 31 searches for pointer information indicating a specific portion of the moving image content based on the specific portion of the moving image content being reproduced (step S1104). The CPU 31 accepts allocation of searched pointer information for each tag name whose input is accepted (step S1105). Accordingly, by accepting the selection of the tag name, it is possible to reproduce a specific portion of the moving image content according to the assigned pointer information.

The CPU 31 receives input of attribute information that can be spoken at the time of searching for each tag name whose input is received (step S1106). As will be described later, the tag names can be narrowed down by the user uttering the attribute information.

The CPU 31 associates the input tag name, simple sentence or word group indicating the content of the tag name, and attribute information with the pointer information to generate search data (step S1107). CPU 31 associates the tag information included in the generated search data with the search data identification information for identifying the search data to generate guide data (step S1108).

The CPU 31 causes the content provider to select the tag name and the like of the generated guide data and displays it on the signage window on the terminal device 1b used by the user (step S1109), and displays the tag name of the generated guide data. All are displayed in the speech window on the terminal device 1b used by the user (step S1110).

A procedure for a user to execute search processing will be described below. This embodiment is characterized in that the content provider displays a signage window and a speech window for guiding the user's search. However, in addition to this, as a device for quickly and reliably searching and displaying desired content for the user, the user can speak the tag name of the displayed guide data to narrow down the search system, which is different from the conventional search system. This is a big difference.

FIG. 12 is a functional block diagram of speech recognition processing of an utterance by the user of the search support server 3 according to the embodiment of the present invention. In FIG. 12, a procedure for accepting a user's utterance as an input while the signage window shown in FIG. 9 and the speech window shown in FIG. 10 are displayed on the terminal device 1b used by the user and correctly recognizing the voice will be described.

As shown in FIG. 12, an utterance accepting unit 1201 accepts an input of voice data uttered by a user. Specifically, the voice data is obtained by receiving the voice data uttered by the user in the terminal device 1b.

The preprocessing unit 1202 performs noise removal, speech period detection, and the like on the received voice data. The preprocessed speech data is passed to the metatag speech recognition unit 1203 and the narrowed speech recognition unit 1208, and the metatag speech recognition unit 1203 and the narrowed speech recognition unit 1208 are executed in parallel.

The metatag speech recognition unit 1203 recognizes the preprocessed speech data and converts it into text data, and based on the converted text data, matches the tag name of the guide data and a simple sentence or word group indicating the content of the tag name. The degree of matching is calculated, the tag name with the highest calculated degree of matching is identified, and when the degree of matching is greater than a predetermined value, a specific portion of the content corresponding to the tag name is displayed. In other words, if the metatag speech recognition unit 1203 can correctly recognize the speech, the recognition result can be immediately output without executing extra processing such as integration with other speech recognition processing.

That is, the metatag speech recognition unit 1203 includes a text data conversion unit 1204 , a match calculation unit 1205 , a tag name specification unit 1206 and a content display/playback unit 1207 . A text data conversion unit 1204 recognizes the preprocessed voice data based on a so-called dictation grammar and converts it into text data.

The degree-of-match calculation unit 1205 refers to the first data set formed of simple sentences or word groups indicating all tag names and the content of the tag names, and calculates the degree of match with the received voice data.

The tag name identification unit 1206 identifies the tag name with the highest calculated degree of matching. This is because the tag name with the highest degree of matching is the most probable recognition result. However, if the degree of matching is equal to or less than a predetermined threshold, there is a high possibility of erroneous recognition.

Content display/playback unit 1207 determines whether or not the calculated degree of matching is greater than a predetermined threshold. If it is determined that the value is equal to or less than the predetermined threshold value, it is determined that the recognition accuracy is insufficient, and the system waits for another utterance. When it is determined that the value is larger than the predetermined threshold, it is possible to display or reproduce the specific portion of the content associated with the specified tag name and determine whether or not the recognition result is correct.

Based on the preprocessed speech data, the narrowed-down speech recognition unit 1208 uses a so-called rule grammar to extract tag information of the guide data that matches the attribute information, and extracts one or more pieces of attribute information that match. The guide data is narrowed down by the logical product of , and the tag name and attribute information of the narrowed down guide data are output. As a result, even if the metatag speech recognition unit 1103 cannot obtain an appropriate recognition result, it is possible to further narrow down what the user will say next, so that the success rate of speech recognition can be increased. As a result, correct recognition results can be obtained in a short time. Specifically, the narrowed-down speech recognition unit 1208 includes an attribute extraction unit 1209 and a narrowing-down unit 1210 .

The attribute extraction unit 1209 extracts attribute information as a recognition result using the second data set formed of attribute information associated with all tag information as a speech recognition filter. The narrowing down unit 1210 narrows down the tag name (guide data) as a logical product of the extracted attribute information.

The narrowed-down speech recognition unit 1208 preferably includes an updating unit 1210 that updates the second data set, which is the speech recognition filter, according to the attribute information of the narrowed-down guide data. Since the second data set is updated each time the guide data is narrowed down by the attribute information, the user's next utterance is further restricted, and the degree of certainty that correct recognition results are obtained can be increased, and the recognition result can be obtained more quickly. A correct recognition result can be obtained.

FIG. 13 is a flow chart showing the procedure of speech recognition processing of the CPU 31 of the search support server 3 according to the embodiment of the present invention. The CPU 31 of the search support server 3 receives input of voice data uttered by the user (step S1301). Specifically, the voice data is obtained by receiving the voice data uttered by the user in the terminal device 1b.

CPU 31 performs noise removal, detection of a speech period, and the like on the received voice data (step S1302). Based on the preprocessed audio data, the following two processes are performed in parallel.

First, the CPU 31 recognizes the preprocessed voice data based on the so-called dictation grammar and converts it into text data (step S1303). The CPU 31 refers to all tag names and the first data set formed of simple sentences or word groups indicating the contents of the tag names, and calculates the degree of matching with the received voice data (step S1304). The CPU 31 identifies the tag name with the highest calculated degree of matching (step S1305).

CPU 31 determines whether or not the calculated degree of matching is greater than a predetermined threshold (step S1306). When the CPU 31 determines that it is equal to or less than the predetermined threshold (step S1306: NO), the CPU 31 returns the process to step S1301 and waits for another utterance.

When the CPU 31 determines that the value is greater than the predetermined threshold (step S1306: YES), the CPU 31 displays or reproduces the specified portion of the content associated with the specified tag name (step S1307).

On the other hand, based on the preprocessed voice data, the CPU 31 extracts the attribute information of the recognition result using the second data set formed of attribute information associated with all tag names as a voice recognition filter. (step S1308). The CPU 31 narrows down the tag name (guide data) as a logical product of the extracted attribute information (step S1309). The CPU 31 updates the second data set, which is the voice recognition filter, using the narrowed-down tag name and attribute information of the guide data (step S1310), returns the process to step S1301, and waits for another utterance. .

As described above, according to the present embodiment, a content provider who provides video content from among a large number of video content published on a website can easily guide a user to its own video content. can be displayed in the speech window or signage window, and the guide data to be selected can be narrowed down by the user's own intention. , it is possible to quickly and reliably display a specific portion of video content provided by a content provider to a user.

Further, according to the present embodiment, by executing the metatag speech recognition process and the narrowing down speech recognition process in parallel, when the metatag speech recognition is correct, the recognition result can be output as it is. If the certainty of the recognition result is insufficient, the tag name based on the narrowed-down guide data can be displayed in the speech window. Therefore, the user can display or reproduce desired content in a relatively short period of time.

The present invention is not limited to the above embodiments, and various modifications and improvements are possible within the scope of the present invention. For example, the method of inputting tag information including attribute information is not limited to the method described above, and is not particularly limited as long as it is possible to input a character string that can narrow down the tag name.

Further, when recognizing a user's utterance, the recognition processing that executes processing in parallel with the metatag speech recognition unit 1203 is not limited to the narrowed-down speech recognition unit 1208, and may limit the next utterance by the user. It is not particularly limited as long as it can be processed.

Also, in the above embodiment, the speech window 81 is displayed on the terminal device 1b used by the user, but the present invention is not limited to this. Alternatively, remote operation may be performed on an external portable terminal device such as a tablet.

Also, the dictation grammar and rule grammar used for speech recognition are desirably generated by learning text data, guide data, and externally acquired text data as teacher data. As a learning method, AI such as so-called machine learning or deep learning may be used, or a conventional method such as expanding a correspondence table may be used, and is not particularly limited.

Reference Signs List 1, 1a, 1b terminal device 2 network network 3 search support server 208
11, 31 CPU
12, 32 memory 13, 33 storage device 14, 34 I/O interface 15, 35 video interface 16, 36 portable disk drive 17, 37 communication interface 18, 38 internal bus 90, 91 storage medium 100, 101 computer program 331 search Data storage unit 332 Guide data storage unit

Claims (11)

A search support server for supporting search of video content published on a website,
a signage window for selectively displaying guide data for guiding speech for selecting tag information indicating a specific part of video content;
causing a terminal device connected to be capable of data communication to display a speech window capable of narrowing down the guide data to be displayed from among the guide data according to the user's utterance;
Accepting the selection by accepting the user's speech of the tag information displayed in the signage window and/or the speech window, narrowing down the displayed tag information, and accepting the selection of the narrowed down tag information. A search support server that causes the terminal device to reproduce a specific portion of the video content corresponding to the tag information. The tag information is composed of at least a tag name identifying a specific part of the video content, text data consisting of a simple sentence or a group of words describing the content of the tag name, and attribute information indicating attributes of the tag name. 2. The search support server according to claim 1, characterized by: Search data generation means for generating search data that is the basis of guide data to be displayed in the signage window and/or the speech window;
The search data generation means is
extracting/reproducing means for extracting a simple sentence or word group indicating content based on the content of the moving image content, and reproducing the corresponding moving image content when selection of the extracted simple sentence or word group is accepted;
tag input receiving means for receiving input of the tag name and simple sentences or word groups indicating the content of the tag name based on the reproduced video content;
pointer search means for searching for pointer information including a reproduction start time and a reproduction end time of a specific portion of the moving image content based on the moving image content being reproduced;
Pointer allocation receiving means for receiving allocation of the searched pointer information for each tag name whose input is received;
3. The search support server according to claim 2, further comprising attribute information receiving means for receiving an input of said attribute information that can be spoken at the time of searching for each said tag name whose input has been received. The extraction/regeneration means is
a speech transcription means for scrutinizing the video content, recognizing the included speech as a simple sentence or word group and outputting it as text data;
4. The search support server according to claim 3, further comprising content reproduction means for, when receiving a selection of output text data, reproducing the video content corresponding to the selected text data. The pointer allocation receiving means includes pointer update receiving means for receiving updates of the reproduction start time and the reproduction end time of the specific portion of the moving image content, which are included in the searched pointer information, while reproducing the moving image content. 4. The search support server according to claim 3, characterized by: 6. The guide data according to any one of claims 3 to 5, wherein the guide data is generated by associating the tag information included in the search data with search data identification information for identifying the search data. search support server. To narrow down the tag names that are displayed in the speech window and that can be selected by a user,
an utterance receiving means for receiving an input of voice data uttered by a user;
Converting voice data received as input into text data, calculating the degree of matching of the converted text data with the tag name of the guide data and a simple sentence or word group indicating the content of the tag name, and calculating the degree of matching Meta tag speech recognition means for identifying the maximum tag name and displaying a specific portion of the video content corresponding to the tag name when the degree of matching is greater than a predetermined value;
Based on the received voice data, the tag information of the guide data that matches the attribute information is extracted, and the guide data is narrowed down by logical product of one or more pieces of attribute information that match. and narrowing-down speech recognition means for outputting said tag name and said attribute information of said guide data narrowed down, wherein said meta-tag speech recognition means and said narrowing-down speech recognition means are executed in parallel. 7. The search support server according to any one of 3 to 6. The metatag speech recognition means calculates the degree of matching between the converted text data and a first data set formed of simple sentences or word groups indicating all the tag names and the contents of the tag names,
The narrowed-down speech recognition means uses a logical product of the attribute information extracted as a recognition result using a second data set formed of the attribute information associated with all tag names as a speech recognition filter to perform the 8. The search support server according to claim 7, wherein the guide data is narrowed down. 9. The search support server according to claim 8, wherein said narrowed-down speech recognition means updates said second data set with said attribute information of the narrowed-down guide data. A search support method that can be executed by a search support server that supports searches for video content published on a website, comprising:
The search support server
a signage window for selectively displaying guide data for guiding speech for selecting tag information indicating a specific part of video content;
a step of displaying a speech window capable of narrowing down guide data to be displayed from among the guide data by user's utterance on a terminal device connected so as to be capable of data communication;
Accepting the selection by accepting the user's speech of the tag information displayed in the signage window and/or the speech window, narrowing down the displayed tag information, and accepting the selection of the narrowed down tag information. and causing the terminal device to reproduce a specific portion of the video content corresponding to the tag information. A computer program that can be executed by a search support server that supports searches for video content published on a website,
the search support server,
a signage window for selectively displaying guide data for guiding speech for selecting tag information indicating a specific part of video content;
means for displaying a speech window capable of narrowing down the guide data to be displayed from the guide data by user's utterance on a terminal device connected to data communication, and the signage window and/or Alternatively, receiving speech by the user of the tag information displayed in the speech window, narrowing down the displayed tag information, and receiving selection of the narrowed-down tag information, thereby corresponding to the selected tag information. A computer program functioning as a means for reproducing a specific portion of said moving image content on said terminal device.

Images