JP2010124155A - Information processing apparatus, information processing method, program, and information processing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processing apparatus, an information processing method, a program, and an information processing system for communicating information included in content data to a user and supporting playback of the content data from a specific playback start position. <P>SOLUTION: The information processing apparatus 100 includes: a storage part 102 for storing content data; an index item generation part 120 for detecting a telop, contained in the content data, on the basis of the content data and generates index item information which records information about the detected telop in association with information on a playback start position of the content data corresponding to the detected telop; and an index list content managing part 122 for generating an index list content which can playback the content data from the playback start position of the corresponding content data, when the content data include an index selectable by the user, on the basis of the index item information and the index is selected. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an information processing apparatus, an information processing method, a program, and an information processing system.

  In recent years, video recording / playback apparatuses capable of recording and playing back content data including video and audio transmitted from a broadcasting station, such as a DVD recorder and a Blu-ray (registered trademark) recorder, have spread. It is out. Also, in recent years, with the widening of the network, users can acquire content data from an external device such as a server via a network such as the Internet using a computer such as a PC (Personal Computer). Further, in recent years, the capacity of storage media capable of storing content data has increased, and information processing devices such as video recording / playback devices and computers owned by users can store more content data. It has become.

  Under such circumstances, a technique has been developed that assists the reproduction of content data from a specific reproduction start position by presenting information included in the content data selected by the user to the user. As a technology for generating keywords based on subtitles and audio, video program data (EPG) data, and telop included in video data, and managing the generated keywords and the playback start positions of video data corresponding to the keywords in association with each other Is, for example, Patent Document 1.

JP 2008-148077 A

  A conventional technique for assisting reproduction of content data from a specific reproduction start position by presenting information included in content data selected by the user to the user (hereinafter referred to as “conventional technique”) is a keyword. When a certain keyword is selected, the content data is reproduced from the reproduction start position corresponding to the selected keyword. Therefore, there is a possibility that an information processing device using conventional technology (hereinafter referred to as “conventional information processing device”) can assist the user to reproduce content data from a specific reproduction start position to some extent. However, since the conventional information processing apparatus merely presents the keyword to the user, the information included in the content data cannot always be transmitted to the user. More specifically, for example, when the content data is data corresponding to a news program, the conventional information processing apparatus includes “weather forecast”, “exchange”, “stock price”, “sports”, “major league”, etc. Only keywords such as can be presented to the user. Therefore, a user who uses a conventional information processing apparatus cannot obtain even information, for example, whether the stock price has increased or decreased from the conventional information processing apparatus. Therefore, even if the conventional technique is used, it is difficult to transmit the information included in the content data to the user, and the conventional information processing apparatus reproduces the content data from the reproduction start position desired by the user. It is not always possible. Therefore, even if the conventional technique is used, an effect of assisting the reproduction of content data from a specific reproduction start position by a user operation cannot be expected.

  The present invention has been made in view of the above problems, and an object of the present invention is to transmit information included in content data to a user and assist the reproduction of content data from a specific reproduction start position. It is an object of the present invention to provide a new and improved information processing apparatus, information processing method, program, and information processing system.

  In order to achieve the above object, according to a first aspect of the present invention, a storage unit capable of storing content data and a telop included in the content data are detected based on the content data stored in the storage unit An index item generating unit for generating index item information recorded in association with information on the detected telop and information on the reproduction start position of the content data corresponding to the detected telop; Index list content management that includes an index that can be selected by a user based on the content list, and that generates an index list content that can be played back from the playback start position of the corresponding content data when the index is selected And an information processing apparatus comprising That.

  With this configuration, it is possible to transmit information included in the content data to the user and assist the reproduction of the content data from a specific reproduction start position.

  Further, the index item generation unit detects a telop area of a frame including the telop based on video data constituting the content data stored in the storage unit, and selectively selects characters from the detected telop area. You may provide the telop detection part which detects information, and the item generation part which produces | generates the said index item information based on the detection result of the said telop detection part.

  With this configuration, it is possible to detect a telop included in content data based on the content data and generate index item information corresponding to the detection result.

  In addition, the telop detection unit may detect the detected character information or image data of a telop area corresponding to the character information, and information on a reproduction start position of content data in which the character information is detected, as the detection result. May be transmitted to the item generator.

  With this configuration, it is possible to detect a telop included in content data based on the content data and generate index item information corresponding to the detection result.

  The item generation unit may generate index item information for hierarchizing the detected telops based on the character information included in the detection result of the telop detection unit.

  With this configuration, it is possible to realize a display method according to a hierarchical structure defined by hierarchization.

  In addition, the index item generation unit detects a change in a silent period that is equal to or greater than a predetermined threshold and a voiceprint that is equal to or greater than a predetermined threshold based on audio data that constitutes the content data, and a reproduction start position of the detected content data Is further provided with an audio analysis unit that transmits the information to the item generation unit, and the item generation unit includes a detection result of the telop detection unit and information on a reproduction start position of the content data transmitted from the audio analysis unit. Based on this, the index item information may be generated.

  With this configuration, it is possible to more accurately determine the reproduction start position of the content data corresponding to the selected index.

  In addition, the index list content management unit is a data management unit that manages the index item information generated by the index item generation unit and content data corresponding to the index item information in association with each other. An index list content generation unit that generates the index list content based on an operation signal may be provided.

  With this configuration, it is possible to generate an index list content that can reproduce content data from the reproduction start position of the content data corresponding to the selected index.

  Moreover, you may further provide the operation part which produces | generates the said operation signal based on the direct operation of a user, or reception of the external operation signal transmitted from the external apparatus which a user can operate.

  With this configuration, it is possible to perform processing according to a user operation.

  In order to achieve the above object, according to a second aspect of the present invention, a step of detecting a telop included in the content data based on content data stored in a storage unit capable of storing the content data, Generating index item information recorded by associating information on the telop detected in the detecting step and information on the reproduction start position of the content data corresponding to the detected telop; Based on an index that can be selected by the user, and generating an index list content that can cause the content data to be reproduced from the reproduction start position of the corresponding content data when the index is selected. A processing method is provided.

  By using such a method, information included in the content data can be transmitted to the user, and the reproduction of the content data from a specific reproduction start position can be assisted.

  In order to achieve the above object, according to a third aspect of the present invention, a step of detecting a telop included in the content data based on content data stored in a storage unit capable of storing the content data, the detection Generating index item information recorded by associating information on the telop detected in the step and information on the reproduction start position of the content data corresponding to the detected telop, based on the index item information In order to cause a computer to execute an index list content that includes an index that can be selected by a user and that can reproduce content data from the reproduction start position of the corresponding content data when the index is selected Provided by It is.

  By using such a program, information included in the content data can be transmitted to the user, and the reproduction of the content data from a specific reproduction start position can be assisted.

  In order to achieve the above object, according to a fourth aspect of the present invention, there is provided a management server and one or more information processing devices capable of communicating with the management server. Detecting a telop included in the content data based on the content data stored in the server-side storage unit, a server-side storage unit capable of storing content data, and the server-side storage unit, which can communicate with each processing device; An index item generator for generating index item information recorded in association with information on the detected telop and information on the reproduction start position of the content data corresponding to the detected telop; and the server-side communication unit includes: The information acquisition generated by the index item generation unit based on the received information acquisition request transmitted from the information processing apparatus A communication control unit that transmits the index item information corresponding to the request to the information processing apparatus that has transmitted the information acquisition request. Each of the information processing apparatuses includes a storage unit capable of storing content data, the management server, A communicable communication unit, an information request unit for transmitting an information acquisition request for acquiring index item information corresponding to content data stored in the storage unit to the management server via the communication unit, and Based on the index item information corresponding to the information acquisition request received by the communication unit, the index includes information that can be selected by the user. When an index is selected, the content data is reproduced from the corresponding content data reproduction start position. Index list content that generates index list content that can be The information processing system comprising a management unit is provided.

  With this configuration, an information processing system that can transmit information included in content data to a user and assist the reproduction of content data from a specific reproduction start position is realized.

  According to the present invention, it is possible to transmit information included in content data to a user and assist the reproduction of content data from a specific reproduction start position.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

(User assistance approach according to an embodiment of the present invention)
Before describing the configuration of the information processing apparatus (first embodiment) or the information processing system (second embodiment) according to the embodiment of the present invention, first, a specific reproduction start position according to the embodiment of the present invention is described. A user assistance approach for assisting the reproduction of content data from will be described. Hereinafter, the user assistance approach according to the embodiment of the present invention will be described as being performed by the information processing apparatus (hereinafter referred to as “information processing apparatus 100”) according to the first embodiment of the present invention. Note that the following user assistance approach can also be applied to an information processing system (hereinafter referred to as “information processing system 1000”) according to a second embodiment to be described later.

  Here, the content data according to the embodiment of the present invention is data including, for example, an image (moving image / still image. Sometimes referred to as a video. The same shall apply hereinafter), audio, and the like. Hereinafter, content data representing a news program will be described as an example of content data according to the embodiment of the present invention. However, it goes without saying that the content data according to the embodiment of the present invention is not limited to the above. . For example, the user assistance approach according to the embodiment of the present invention can be applied to various content data such as content data representing an information program.

[Outline of accessibility approach]
1 and 2 are explanatory diagrams showing examples of content data according to the embodiment of the present invention. Here, FIG. 1 shows an example of content data representing a news program, and represents a news program composed of four news items of News-A to News-D. FIG. 2 selectively shows frames F1 to F8 in which telops are displayed among the frames constituting the content data shown in FIG.

  As shown in FIG. 2, the content data may include a frame in which a telop in which an outline of each news is represented by character information is displayed. Therefore, the information processing apparatus 100 detects a telop from the content data and generates an index list content based on the detection result. Then, the information processing apparatus 100 presents the generated index list content to the user. Here, the index list content according to the embodiment of the present invention is data for presenting an index (index) of information included in content data to a user. The index list content according to the embodiment of the present invention allows the user to select an index. When an index is selected, the content data is reproduced from the reproduction start position of the content data corresponding to the selected index. This is data that can be The information processing apparatus 100 generates the index list content using a markup language such as html (HyperText Markup Language) or xml (eXtensible Markup Language), but is not limited thereto.

  FIG. 3 is an explanatory diagram showing an example of the index list content according to the embodiment of the present invention, and shows a display example in which the index list content is displayed on the display screen. For example, as illustrated in FIG. 3, the information processing apparatus 100 generates index list content in which character information included in each telop illustrated in FIG. 2 is displayed in a list format.

  4 and 5 are explanatory diagrams for explaining an example of an operation when an index represented in the index list content according to the embodiment of the present invention is selected by a user operation. Here, FIG. 4 shows an example in which an index is selected by a user operation (direct user operation / indirect user operation). FIG. 5 shows an example of the reproduction start position where the content data is reproduced as a result of the selection in FIG.

  A user operates an operation device included in the information processing apparatus 100 such as operation keys and buttons (direct user operation), or operates an external device such as a remote controller (indirect user operation). Thus, for example, the index as a selection candidate is clearly indicated on the display screen as in selection A or selection B in FIG.

  When the user determines the selection candidate as a selection target by operating the operation device or the like, the information processing apparatus 100 reproduces the content data from the reproduction start position corresponding to the selected index. For example, when the index indicated by selection A in FIG. 4 is determined, the information processing apparatus 100 reproduces content data from the reproduction start position A shown in FIG. 4 is determined, the information processing apparatus 100 reproduces content data from the reproduction start position B shown in FIG. When the indexes shown in selection A in FIG. 4 and selection B in FIG. 4 are determined, the information processing apparatus 100 plays content data from the playback start position A shown in FIG. After the news has been reproduced, the content data is reproduced from the reproduction start position B shown in FIG.

  Based on the content data, the information processing apparatus 100 generates index list content in which information about telops included in the content data is displayed on the display screen in a list format as shown in FIG. 3, for example. Here, since the index list content generated by the information processing apparatus 100 can indicate, for example, character information constituting the telop to the user, more information (when the keyword related to the conventional technology is shown to the user) ( Information having a larger amount of information) can be transmitted to the user. That is, by viewing the data shown in FIG. 3 displayed on the display screen, the user can more easily recognize what information is included in the content data than when using a conventional information processing apparatus. be able to. For example, as illustrated in FIGS. 4 and 5, when the user selects an index indicated by the index list content, the information processing apparatus 100 receives content data from a reproduction start position corresponding to the selected index. Let it play. Therefore, the information processing apparatus 100 can transmit information included in the content data to the user and assist the reproduction of the content data from a specific reproduction start position.

[Another example of index list content according to an embodiment of the present invention]
As described above, the information processing apparatus 100 transmits the information included in the content data to the user, for example, by generating index list content for displaying data as shown in FIG. 3 on the display screen, and starts a specific reproduction. Assists playback of content data from a location. However, the index list content according to the embodiment of the present invention is not limited to the example shown in FIG.

[1] First Example FIG. 6 is an explanatory diagram showing an example of index list content according to the embodiment of the present invention. As illustrated in FIG. 6, the information processing apparatus 100 can represent, as an index, information about time allocated to news corresponding to each telop, in addition to character information based on the telop included in the content data. In addition, as illustrated in FIG. 6, the information processing apparatus 100 can further indicate to which position in the entire program the news corresponding to the index selected by the user. By looking at the data shown in FIG. 6 displayed on the display screen, the user can determine not only what news is included in the content data, but also how much time each news has been spent. You can visually recognize if there is. Here, the information processing apparatus 100 can generate index list content including information related to time based on, for example, PSI (Program Specific Information) included in content data, but is not limited thereto.

[2] Second Example FIGS. 3 and 6 show an example in which the information processing apparatus 100 generates index list content that presents information included in one content data to a user. However, the index list content generated by the information processing apparatus 100 is not limited to the above. For example, the information processing apparatus 100 can generate index list content based on information included in a plurality of content data.

  FIG. 7 is an explanatory diagram for explaining index list content based on a plurality of content data. Here, FIG. 7 shows an example of a display screen on which data for generating an index list content based on a plurality of content data corresponding to four news programs is displayed by the information processing apparatus 100.

  When the user selects selection C shown in FIG. 7, the information processing apparatus 100 corresponds to each of the four news programs shown in FIG. 7, for example, and content data created on the day to which the selection belongs (for example, at the time of selection) The content data recorded on the day to which the data belongs, etc.) is extracted from the storage unit (described later). Here, the information processing apparatus 100 can extract the content data based on the date information at the time of selection, the time stamp set in the content data, and the PSI included in the content data. Not limited to. Then, the information processing apparatus 100 generates index list content based on the extracted content data.

  FIG. 8 is an explanatory diagram showing an example of the index list content according to the embodiment of the present invention. Here, FIG. 8 shows an example of a display screen on which the index list content generated by the information processing apparatus 100 when the user selects the selection C shown in FIG. 7 is displayed.

  As illustrated in FIG. 8, when the user selects the selection C illustrated in FIG. 7, the information processing apparatus 100 displays information included in the plurality of content data in the same manner as the index list content illustrated in FIG. 6, for example. Generate index list contents to be displayed in a list with selectable indexes. Further, as shown in FIG. 8, the information processing apparatus 100 can also provide items selectable by the user such as “society”, “international”, “politics”,. When each of the above items is selected by the user, the information processing apparatus 100 selectively displays a list of information corresponding to the selected item from the information included in the extracted content data. Here, the information processing apparatus 100 classifies the character information included in the telop detected from each content data by language analysis using, for example, morphological analysis or a thesaurus dictionary, for each item as shown in FIG. Index list content that can be displayed in a list according to the selected item can be generated, but is not limited thereto.

  Further, when the user selects the selection D shown in FIG. 7, the information processing apparatus 100 is created within a predetermined period including, for example, the days to which the selection belongs, corresponding to each of the four news programs shown in FIG. 7. Content data (for example, content data recorded within a predetermined period from the date of selection) is extracted from a storage unit (described later). Here, the information processing apparatus 100 extracts the content data based on, for example, the date information at the time of selection, the extraction period information, the time stamp set in the content data, and the PSI included in the content data. However, it is not limited to the above. Then, the information processing apparatus 100 generates index list content based on the extracted content data.

  FIG. 9 is an explanatory diagram showing an example of index list content according to the embodiment of the present invention. Here, FIG. 9 shows an example of a display screen on which the index list content generated by the information processing apparatus 100 when the user selects the selection D shown in FIG. 7 is displayed.

  As illustrated in FIG. 9, when the user selects the selection D illustrated in FIG. 7, the information processing apparatus 100 displays information included in a plurality of content data, for example, similarly to the index list content illustrated in FIG. 8. Generate index list contents to be displayed in a list with selectable indexes. Here, the number of associations shown in FIG. 9 represents, for example, the number of pieces of information for which the similarity according to language analysis for character information corresponding to each index is equal to or greater than a predetermined threshold. For example, when the user selects an item of the number of associations, the information processing apparatus 100 uses the selectable index as in the index list content shown in FIG. Display a list (not shown). Further, the information processing apparatus 100 can also provide items selectable by the user such as “society”, “international”, “politics”,..., Similarly to the index list content shown in FIG.

  For example, the information processing apparatus 100 generates index list content in which data as illustrated in FIGS. 3, 6, 8, and 9 is displayed on the display screen. The information processing apparatus 100 visually transmits the information included in the content data to the user by displaying data corresponding to the generated index list content on the display screen. Therefore, as described above, the information processing apparatus 100 can transmit information included in the content data to the user and assist the reproduction of the content data from a specific reproduction start position. Needless to say, the index list content according to the embodiment of the present invention is not limited to the data displayed on the display screen as shown in FIGS. 3, 6, 8, and 9. For example, the information processing apparatus 100 is assigned a priority according to the order of telops detected in the content data (for example, a higher priority is set for the top news) or news corresponding to the detected telops. The size and color of the index can also be changed based on the priority according to time (for example, the higher the priority is the news that has been spent for a longer time).

[Example of processing for realizing the user-assistant approach]
Next, the process for realizing the user assistance approach according to the above-described embodiment of the present invention will be described more specifically. Hereinafter, an example in which the information processing apparatus 100 generates an index content list that displays data including an index as illustrated in FIG. 3 on the display screen based on one content data and presents the information to the user will be described as an example. I will explain.

  FIG. 10 is a flowchart showing an example of a process for realizing the user assistance approach in the information processing apparatus 100 according to the embodiment of the present invention. Here, FIG. 10 shows an example of a process in which the information processing apparatus 100 generates an index content list for displaying data including an index as shown in FIG. 3 on a display screen from one content data, and presents information to the user. Show.

  The information processing apparatus 100 detects a telop from the content data (S100). Here, the information processing apparatus 100 performs the telop detection process for each frame, for example, but is not limited thereto. For example, the information processing apparatus 100 can perform the telop detection process every predetermined frame such as every 10 frames or every 30 frames.

<Example of telop detection processing>
The information processing apparatus 100 detects a telop from each frame of video data constituting the content data, for example, by the following processes (a) to (c).

(A) Character Area Detection Processing The information processing apparatus 100 compares a plurality of consecutive frames (for example, a detection target frame and a frame before and after the frame) for each pixel, and is stationary without luminance variation. A character area is detected by detecting a pixel.

(B) Luminance distribution estimation process The information processing apparatus 100 estimates the luminance distribution constituting the character based on the luminance histogram of the character area detected by the process (a). Here, since it is not known what kind of background the telop in the content data appears in each frame, the information processing apparatus 100 performs a character recognition process to be described later on the character area detected by the process (a). Even if it does not, it is not always possible to recognize the character. Therefore, the information processing apparatus 100 performs the process (b) in order to detect the character information constituting the telop more reliably.

(C) Character recognition processing The information processing apparatus 100 recognizes a character by using OCR (Optical Character Recognition) for the character portion estimated in (b) (that is, the character portion separated from the background). .

  The information processing apparatus 100 can detect a telop from each frame and acquire character information constituting the telop, for example, by the processes (a) to (c). Needless to say, the telop detection process according to the embodiment of the present invention is not limited to the processes (a) to (c). For example, the information processing apparatus 100 can further assist the detection of telops by analyzing audio data constituting the content data. Here, for example, the information processing apparatus 100 detects a change in a silent section that is equal to or greater than a predetermined threshold and a voiceprint that is equal to or greater than the predetermined threshold based on audio data, and a reproduction start position (for example, a reproduction start time) according to the detection result. ). For example, the information processing apparatus 100 combines the playback start position based on the audio data and the detection result of the telop based on the video data constituting the content data to correspond to each news break as shown in FIG. The playback start position can be determined more accurately.

Further, the information processing apparatus 100 sets the following conditions, for example, and determines whether or not the conditions are satisfied for the telops detected by the processes (a) to (c). The character information constituting the telop can be selectively acquired.
-Exclude telop display for less than the specified time-Exclude colloquial character strings-Exclude performer names included in information related to content data such as EPG-Display time when multiple telops are detected in one frame Are excluded (for example, if telop 1 is displayed in the period from 5 seconds to 20 seconds of the program start and telop 2 is displayed in the period of 10 seconds to 12 seconds from the start of the program, the telop 2 is excluded. .)

  By setting predetermined conditions as described above and excluding telop information that satisfies the conditions, the information processing apparatus 100 can further improve the quality of information presented to the user. Needless to say, the predetermined condition according to the embodiment of the present invention is not limited to the above.

  When the telop detection process is performed in step S100, the information processing apparatus 100 determines whether a telop is detected (S102). If it is not determined in step S102 that a telop has been detected, the information processing apparatus 100 performs a process in step S106 described later.

  When it is determined in step S102 that a telop has been detected, the information processing apparatus 100 performs index item information generation / update processing (S104). Here, the index item information according to the embodiment of the present invention is information recorded by associating information about the detected telop and information on the reproduction start position of the content data corresponding to the detected telop ( Data).

<Index item information generation / update processing>
FIG. 11 is a flowchart showing an example of index item information generation / update processing in the information processing apparatus 100 according to the embodiment of the present invention.

  The information processing apparatus 100 determines whether content information has been generated (S200). Here, the content information is information (data) in which information about content data is recorded.

  FIG. 12 is an explanatory diagram showing an example of content information according to the embodiment of the present invention. Referring to FIG. 12, the content information includes, for example, information of “broadcast date / time”, “broadcast time”, “program name”, “genre”, and “index item information storage destination”. By recording the “index item information storage destination” information in the content information, the information processing apparatus 100 can uniquely identify the index item information for each content data. Needless to say, the configuration of the content information according to the embodiment of the present invention and the information included in the content information are not limited to the example shown in FIG.

  With reference to FIG. 11 again, an example of index item information generation / update processing according to the embodiment of the present invention will be described. If it is determined in step S200 that content information has been generated, the information processing apparatus 100 performs a process of step S204 described later.

  If it is not determined in step S200 that content information has been generated, the information processing apparatus 100 generates content information (S202). Here, the information processing apparatus 100 can generate content information based on, for example, EPG information, but is not limited thereto.

  If it is determined in step S200 that content information has been generated, or if content information has been generated in step S202, the information processing apparatus 100 determines whether index item information has been generated (S204). . If it is not determined in step S204 that the index item information has been generated, the information processing apparatus 100 newly generates index item information (S206). When it is determined in step S204 that index item information has been generated, the information processing apparatus 100 updates the index item information (S208).

  FIG. 13 is an explanatory diagram showing an example of index item information according to the embodiment of the present invention. Referring to FIG. 13, the index item information includes, for example, information of “No”, “index information”, “classification”, “parent No”, “child No”, and “video start time”. Here, for example, the information of “classification”, “parent No.”, and “child No.” shown in FIG. 13 corresponds to information about the telop, and the information of “video start time” shown in FIG. 13 is content data. Corresponds to the information of the reproduction start position. Needless to say, the information on the telop and the information on the reproduction start position of the content data according to the embodiment of the present invention are not limited to the above.

  Here, “No” is a number for identifying a telop included in the content data detected by the information processing apparatus 100 (that is, a number for identifying an index displayed on the display screen). In addition, in “index information”, the storage address of the index character string is recorded. By recording the storage address of the index character string in the “index information”, for example, memory management when coding a program becomes easy.

  In the “classification”, classification information of news corresponding to each index is recorded. The information processing apparatus 100 can present only the information corresponding to a specific classification to the user by referring to the classification information recorded in the “classification”, for example.

  FIG. 14 is an explanatory diagram showing an example of index classification based on the telop according to the embodiment of the present invention. The information processing apparatus 100 performs, for example, a morphological analysis, a thesaurus dictionary, and a language analysis using a dictionary unique to the information processing apparatus 100 on an index character string (an example of character information), as illustrated in FIG. Classification can be performed, but is not limited to the above. The classification according to the embodiment of the present invention is not limited to the example shown in FIG. For example, the information processing apparatus 100 can be classified into a genre other than that shown in FIG. 14, and “International: 50%, Economy: 50%” or “International: 25%, Society: 25%, Economy: 50”. It is also possible to classify by classifying a plurality of genres such as “%”.

  “Parent No.” and “Child No.” define the hierarchical structure of each index (that is, the detected telop is hierarchized). By defining a hierarchical structure for each index, the information processing apparatus 100 can realize a display method according to the hierarchical structure (for example, a display method for changing the size of the index as shown in FIG. 3). . Here, the information processing apparatus 100 can set the hierarchical structure of each index by, for example, the following processes (i) and (ii).

(I) Similarity Derivation Processing Information processing apparatus 100 is similar to a character string (telop character string) corresponding to one index to be determined and a character string corresponding to another index having a smaller “No” than the index. Deriving degrees. Here, the information processing apparatus 100 can derive the similarity by using, for example, a thesaurus dictionary, but is not limited thereto.

(Ii) Determination Processing The information processing apparatus 100 determines that, for example, when the similarity is equal to or higher than a predetermined threshold, the other index is “parent” and the determination target index is “child” of the other index. judge. The information processing apparatus 100 sets the values of “parent No” and “child No” in the index item information according to the determination result. Further, for example, when the similarity is smaller than a predetermined threshold, the information processing apparatus 100 does not set the values of “parent No” and “child No” in the index item information.

  For example, the information processing apparatus 100 sets the hierarchical structure of each index by the process (i) and the process (ii). Needless to say, the hierarchical structure setting method according to the embodiment of the present invention is not limited to the above.

  In the “video start time”, information on the start time indicating the reproduction start position of the telop is recorded. When the index is selected by the user, the information processing apparatus 100 refers to the “video start time”, for example, and reproduces the content data from the reproduction start position corresponding to the selected index.

  If it is determined in step S204 that the index item information has not been generated, the information processing apparatus 100 newly creates index item information as shown in FIG. If the information processing apparatus 100 determines that the index item information has been generated in step S204, the information processing apparatus 100 updates the index item information (adding a new index, values of “parent No” and “child No”). Update).

  The information processing apparatus 100 can generate or update index item information, for example, by the process shown in FIG. The index item information according to the embodiment of the present invention is not limited to the example shown in FIG. 12, and the index item information generation / update process according to the embodiment of the present invention is not limited to the example shown in FIG. Needless to say.

  Further, the information processing apparatus 100 manages content data and index item information (data) by using a file system as shown in (A) or (B) below, for example.

<Example of File System in Information Processing Apparatus 100>
(A) First Example FIG. 15 is an explanatory diagram showing a first example of a file system in the information processing apparatus 100 according to the embodiment of the present invention. Here, FIG. 15 shows the content data (mov file shown in FIG. 15) and index item information (info shown in FIG. 15) for each date when the content data was generated (content data was recorded). File) is stored.

(B) First Example FIG. 16 is an explanatory diagram showing a second example of the file system in the information processing apparatus 100 according to the embodiment of the present invention. Here, FIG. 16 shows the date when the information processing apparatus 100 divides the content data (mov file shown in FIG. 16) and the index item information (info file shown in FIG. 16), respectively, and the content data is generated. An example is shown in FIG.

  The information processing apparatus 100 manages content data and index item information using, for example, a file system as shown in FIGS. 15 and 16. Needless to say, the management unit for content data and index item information according to the embodiment of the present invention is not limited to using the file system as shown in FIGS.

  With reference to FIG. 10 again, an example of a process for realizing the user assistance approach in the information processing apparatus 100 will be described. When the index item information generation / update process is performed in step S104, the information processing apparatus 100 determines whether or not the detection of the telop has been completed (S106). Here, the information processing apparatus 100 can perform the determination in step S106 by determining whether or not the processing has been performed up to the final frame of the content data to be processed, but is not limited thereto. If it is not determined in step S106 that the telop detection has been completed, the information processing apparatus 100 repeats the processing from step S100.

  If it is determined in step S106 that telop detection has been completed, the information processing apparatus 100 determines whether to generate an index content list (S108). Here, the information processing apparatus 100 performs the determination in step S108 based on, for example, an operation signal corresponding to a user operation (direct user operation / indirect user operation), but is not limited thereto.

  If it is not determined in step S108 to generate an index content list, the information processing apparatus 100 does not proceed with processing until it is determined to generate an index content list.

  If it is determined in step S108 that an index content list is to be generated, the information processing apparatus 100 generates an index content list (S110), and displays the generated index content list on the display screen (S112). Here, the information processing apparatus 100 generates an index content list as shown in FIG. 3 based on the index item information. In addition, the information processing apparatus 100 can display the generated index content list on a display unit (not shown) that functions as a display screen included in the own apparatus, but is not limited thereto. For example, the information processing apparatus 100 functions as a display screen included in the external device by transmitting the generated index content list (or data obtained by decoding the index content list; hereinafter the same) to the external device. The generated index content list can be displayed on the display unit.

  When the index content list is displayed on the display screen in step S112, the information processing apparatus 100 determines whether the index indicated by the index content list is selected (S114). Here, the information processing apparatus 100 performs the determination in step S114 based on, for example, an operation signal corresponding to a user operation (direct user operation / indirect user operation), but is not limited thereto.

  If it is not determined in step S114 that an index has been selected, the information processing apparatus 100 does not proceed with processing until it is determined that an index has been selected. Note that the information processing apparatus 100 can end the process when, for example, the user performs an operation of transitioning from the display screen as illustrated in FIG. 3 based on the index content list to another display screen.

  If it is determined in step S114 that an index has been selected, the information processing apparatus 100 reproduces content data from the reproduction start position corresponding to the selected index (S116).

<Example of Reproduction Processing in Information Processing Device 100>
FIG. 17 is an explanatory diagram for explaining an example of content data reproduction processing in the information processing apparatus 100 according to the embodiment of the present invention. Based on the index selection result by the user, for example, the information processing apparatus 100 reproduces reproduction information as illustrated in FIG. 17A and reproduction detailed information as illustrated in FIG. 17B associated with the reproduction information. And generate Here, the detailed reproduction information shown in FIG. 17B includes information on the storage destination address of the content information, the reproduction start time (corresponding to the reproduction start position), and the reproduction end time (corresponding to the reproduction end position). , Recorded for each selected index. Therefore, the information processing apparatus 100 can reproduce the content data from the reproduction start position based on the index selection result by the user by generating reproduction information and reproduction detailed information as shown in FIG.

  Needless to say, the content data reproduction processing in the information processing apparatus 100 is not limited to the above. In the following description, it is assumed that the information processing apparatus 100 reproduces content data by generating reproduction information and reproduction detailed information as shown in FIG. Hereinafter, the reproduction information and the reproduction detailed information as shown in FIG. 17 may be collectively referred to as “reproduction request”.

  The information processing apparatus 100 detects a telop from content data, for example, by the process shown in FIG. 10, generates an index content list based on the detection result, and presents it to the user. Therefore, the information processing apparatus 100 can realize the user assistance approach according to the above-described embodiment of the present invention by the processing illustrated in FIG. Needless to say, the process for realizing the user assistance approach according to the embodiment of the present invention is not limited to the example shown in FIG.

(First embodiment)
Next, a configuration capable of performing processing for realizing the user assistance approach according to the embodiment of the present invention described above will be described. FIG. 18 is an explanatory diagram for explaining an example of the configuration of the information processing apparatus 100 according to the embodiment of the present invention. Here, FIG. 18 also shows a display device 200 that is connected to the information processing device 100 and can display images (still images / moving images) based on content data, index list content data, and the like on a display screen.

  The information processing apparatus 100 includes a storage unit 102, a content signal receiving unit 104, a content data recording unit 106, a content data reproducing unit 108, an external connection unit 110, a control unit 112, an operation unit 114, and a communication unit. 116.

  Further, the information processing apparatus 100 may include a ROM (Read Only Memory; not shown), a RAM (Random Access Memory; not shown), a display unit (not shown), and the like. For example, the information processing apparatus 100 can connect each component by a bus as a data transmission path.

  Here, the ROM stores control data such as programs and calculation parameters used by the control unit 112. The RAM primarily stores programs executed by the control unit 112. The display unit (not shown) is a display unit included in the information processing apparatus 100 and displays various information on the display screen. As a screen displayed on the display screen of the display unit, for example, an operation screen for causing the information processing apparatus 100 to perform a desired operation, or a screen on which data based on content data, index list content data, or the like is displayed. Etc. Here, examples of the display unit include an LCD (Liquid Crystal Display), an organic EL display (Organic Light Emitting Diode display), and the like. Not limited to.

[Hardware Configuration Example of Information Processing Apparatus 100]
FIG. 19 is an explanatory diagram illustrating an example of a hardware configuration of the information processing apparatus 100 according to the embodiment of the present invention. 19, the information processing apparatus 100 includes, for example, a CPU 150 (Central Processing Unit), a ROM 152, a RAM 154, a recording medium 156, a video signal processing circuit 158, a video input interface 160, and a video output interface 162. An input / output interface 164, an operation device 166, and a communication interface 168. In addition, the information processing apparatus 100 connects each component with a bus 170 as a data transmission path, for example.

  The CPU 150 functions as a control unit 112 that controls the entire information processing apparatus 100. Further, the CPU 150 can also serve as an index item generation unit 120, an index list content management unit 122, a reproduction control unit 124, and a user operation learning unit 126, which will be described later, in the information processing apparatus 100.

  The ROM 152 stores control data such as programs and calculation parameters used by the CPU 150, and the RAM 154 primarily stores programs executed by the CPU 150.

  The recording medium 156 functions as the storage unit 102. The recording medium 156 includes, for example, content data, a language analysis dictionary used for language analysis, a user preference database (hereinafter referred to as “user preference DB”) used by the user operation learning unit 126 for learning user operations, and a generated index. Item information, applications, etc. are stored. Here, as the recording medium 156, for example, a magnetic recording medium such as a hard disk, a nonvolatile memory such as an EEPROM (Electrically Erasable and Programmable Read Only Memory), a flash memory, or the like is used. Although it is mentioned, it is not restricted to the above.

  The video signal processing circuit 158 processes the content signal transmitted from the video input interface 160 functioning as the content signal receiving unit 104 and records the content signal in the recording medium 156 as content data. The video signal processing circuit 158 performs various processes such as decoding on the content data stored in the recording medium 156 and outputs the processed content data from the video output interface 162 functioning as the external connection unit 110. Here, as the external connection unit 110, for example, a communication interface capable of transmitting both a video signal and an audio signal such as HDMI (High-Definition Multimedia Interface), a communication interface using a D terminal, and an optical digital audio terminal are used. A communication interface that transmits a video signal and an audio signal, such as a communication interface that has been used. Therefore, the video signal processing circuit 158 functions as the content data recording unit 106 and the content data reproducing unit 108.

  The input / output interface 164 connects, for example, an operation device 166 that functions as an operation unit (not shown). Here, examples of the input / output interface 164 include a USB (Universal Serial Bus) terminal and a controller, but are not limited thereto. Further, examples of the operation device 166 include a button, a direction key, or a combination thereof, but are not limited thereto.

  The communication interface 168 is a communication unit included in the information processing apparatus 100 and functions as the communication unit 116 that communicates with an external apparatus directly or indirectly via a network or the like. As the communication interface 168, for example, an infrared communication port and a reception circuit for wirelessly receiving a signal transmitted from an external device such as a remote controller that can be operated by the user, or communication with an external device such as a server via a network is performed. Examples include a LAN terminal and a transmission / reception circuit, but are not limited thereto. As the network, for example, a wired network such as a LAN (Local Area Network), a wireless network such as a wireless MAN (WMAN; Wireless Metropolitan Area Network), or a communication such as TCP / IP (Transmission Control Protocol / Internet Protocol). Examples include, but are not limited to, the Internet using protocols.

  The information processing apparatus 100 performs processing for realizing the above-described user assistance approach according to the embodiment of the present invention, for example, with a hardware configuration as illustrated in FIG. 19. Needless to say, the hardware configuration of the information processing apparatus 100 according to the embodiment of the present invention is not limited to the configuration shown in FIG. For example, the information processing apparatus 100 can further include a display device configured by an LCD, an organic EL display, or the like.

  With reference to FIG. 18 again, the components of the information processing apparatus 100 will be described. The storage unit 102 is a storage unit included in the information processing apparatus 100. Here, examples of the storage unit 102 include a magnetic recording medium such as a hard disk and a nonvolatile memory such as a flash memory, but are not limited thereto.

  The storage unit 102 stores, for example, content data, a language analysis dictionary, a user preference DB, index item information, an application, and the like. 18, content data A138, content data B140,..., Language analysis dictionary 142, user preference DB 144, index item information A146 corresponding to content data A138, and index item information B148 corresponding to content data B140 are stored in the storage unit. Although the example memorize | stored in 102 is shown, it is not restricted above.

<Example of user preference DB 144>
[1] First Example FIG. 20 is an explanatory diagram showing a first example of the user preference DB 144 according to the embodiment of the present invention. Here, FIG. 20 shows an example of the user preference DB 144 when the information processing apparatus 100 stores the history of the index selected by the user for each news program and for each category shown in FIG.

  For example, when the user selects an index in the index list content corresponding to the content data as shown in FIG. 3, the information processing apparatus 100 has a classification corresponding to the selected index of the program corresponding to the content data. Count up the value. Here, FIG. 20 shows an example in which the value of “Sport” of “◯ × NEWS” is counted up.

  As illustrated in FIG. 20, by storing the history of the index selected by the user, the information processing apparatus 100 can generate, for example, index list content based on the user preference DB 144. As the index list content based on the user preference DB 144, for example, index list content in which an index corresponding to a category with a larger value is more conspicuous (for example, a change in the size or color of characters, a recommendation mark, etc.). Generated index list contents), but is not limited to the above. For example, the information processing apparatus 100 changes the order of news genres as shown in FIGS. 8 and 9 by referring to the information in the user preference DB 144 (for example, a genre corresponding to a category with a larger value). Etc.).

[2] Second Example FIG. 21 is an explanatory diagram showing a second example of the user preference DB 144 according to the embodiment of the present invention. Here, FIG. 21 shows a case where the information processing apparatus 100 hierarchically stores the history of the index selected by the user for each news program with a plurality of data (FIGS. 21A and 21B). An example of the preference DB 144 is shown. Although not shown in FIG. 21, the user preference DB 144 according to the second example stores the same data as in FIG. 21B for each storage destination address shown in FIG.

  By storing the history of the index selected by the user as shown in FIG. 21, the information processing apparatus 100 generates index list content based on the user preference DB 144, for example, as in the first example shown in FIG. be able to.

  Needless to say, the user preference DB 144 according to the embodiment of the present invention is not limited to the examples shown in FIGS. For example, the information processing apparatus 100 further stores information on a keyword specified by the user, and attaches index list content (for example, a change in character size or color, or a recommendation mark) that makes an index including the keyword more noticeable. Index list content) can be generated.

  With reference to FIG. 18 again, the components of the information processing apparatus 100 will be described. For example, the content signal receiving unit 104 receives a content signal transmitted from a broadcasting station or an external device. The content data recording unit 106 records content data in the storage unit 102 based on the content signal received by the content signal receiving unit 104.

  The content data reproduction unit 108 is controlled by the control unit 112, for example, and selectively reads content data stored in the storage unit 102. Then, the content data reproduction unit 108 reproduces the content data by performing various processes such as decoding on the read content data, and transmits the reproduced content data to the display device 200 via the external connection unit 110. Let

  The control unit 112 is configured by, for example, a CPU and plays a role of controlling the entire information processing apparatus 100. The control unit 112 includes an index item generation unit 120, an index list content management unit 122, a reproduction control unit 124, and a user operation learning unit 126. The user according to the embodiment of the present invention as shown in FIG. It plays the role of performing the process to realize the auxiliary approach.

  The index item generation unit 120 detects a telop included in the content data based on the content data stored in the storage unit 102, and generates index item information. That is, the index item generation unit 120 plays a role of performing the processing of steps S100 to S106 illustrated in FIG. 10 described above, for example.

  More specifically, the index item generation unit 120 includes a telop detection unit 128, a voice analysis unit 130, and an item generation unit 132.

  The telop detection unit 128 detects a telop based on video data constituting the content data. The telop detection unit 128 detects the telop from the content data by the above-described telop detection process, but is not limited thereto. In addition, the telop detection unit 128 uses the detected character information or the image data of the telop area corresponding to the character information and the information on the reproduction start position of the content data from which the character information is detected as an item generation unit. 132.

  The audio analysis unit 130 detects a reproduction start position where a telop may appear based on audio data constituting the content data. More specifically, the voice analysis unit 130 detects, for example, a silence interval that is equal to or greater than a predetermined threshold and a change in a voiceprint that is equal to or greater than the predetermined threshold based on the voice data, and a reproduction start position (for example, (Reproduction start time) is recorded in a RAM or the like.

  The item generation unit 132 generates index item information as shown in FIG. 13 based on the detection result of the telop detection unit 128 and the detection result of the voice analysis unit 130.

  The index item generation unit 120 includes, for example, a telop detection unit 128, a voice analysis unit 130, and an item generation unit 132, thereby generating index item information as shown in FIG. In addition, the structure of the index item generation part which concerns on embodiment of this invention is not restricted to the said structure shown in FIG. For example, the index item generation unit according to the embodiment of the present invention may be configured not to include the voice analysis unit 130. Even with the above configuration, the information processing apparatus 100 can detect telops based on content data and generate index item information.

  The index list content management unit 122 generates index list content based on the index item information generated by the index item generation unit 120 and an operation signal corresponding to a user operation. That is, the index list content management unit 122 mainly serves to perform the process of step S110 shown in FIG. 10 described above, for example.

  More specifically, the index list content management unit 122 includes a data management unit 134 and an index list content generation unit 136.

  The data management unit 134 manages the content data and the index item information generated by the index item generation unit 120 using, for example, a file system as shown in FIGS. When the data management unit 134 manages the content data and the index item information, the information processing apparatus 100 can access the content data from the index item information through a unique path.

  The index list content generation unit 136 receives an operation signal transmitted from the operation unit 114 (an operation signal based on a direct user operation) or an external operation signal transmitted from an external device such as a remote controller. Based on the transmitted operation signal (operation signal based on an indirect user operation), the index list content is generated. Further, the index list content generation unit 136 can also generate the index list content based on the user operation history by further using the user preference DB 144 stored in the storage unit 102. Then, the index list content generation unit 136 displays the generated index content list on the display screen of the display device 200, for example.

  The index list content management unit 122 includes, for example, a data management unit 134 and an index list content generation unit 136, and can manage content data and index item information and generate index list content.

  The reproduction control unit 124 causes the content data reproduction unit 108 to reproduce the content data from the reproduction start position corresponding to the selected index based on the index selection result by the user in the index list content displayed on the display screen. Here, the reproduction control unit 124 reproduces the content data from the reproduction start position corresponding to the selected index by generating a reproduction request based on the index selection result by the user, for example, but is not limited thereto. .

  The user operation learning unit 126 updates (including newly created) the user preference DB 144 stored in the storage unit 102 based on the index selection result by the user.

  The control unit 112 includes, for example, an index item generation unit 120, an index list content management unit 122, a playback control unit 124, and a user operation learning unit 126. Therefore, the information processing apparatus 100 can implement the process for realizing the user assistance approach according to the embodiment of the present invention as shown in FIG.

  The operation unit 114 is an operation unit included in the information processing apparatus 100 that enables an operation by a user. The information processing apparatus 100 includes the operation unit 114, so that, for example, processing desired by the user of the information processing apparatus 100 (user operation, such as generation of index list content, selection of an index displayed on the display screen, reproduction of content data) The processing based on the operation signal according to the above can be performed. Here, examples of the operation unit 114 include operation devices such as a keyboard and a mouse, buttons, direction keys, and combinations thereof, but are not limited thereto. For example, the operation unit 114 can include an infrared communication port and a receiving circuit. When the operation unit 114 includes, for example, an infrared communication port and a reception circuit, the operation unit 114 generates an operation signal based on reception of an external operation signal transmitted from a remote controller or the like. Therefore, even in the above case, the information processing apparatus 100 can perform the process desired by the user (process based on the operation signal corresponding to the user operation) by including the operation unit 114.

  The communication unit 116 is a communication unit included in the information processing apparatus 100 and serves to communicate with an external device directly or indirectly via a network or the like. By providing the communication unit 116, the information processing apparatus 100 receives an external operation signal corresponding to a user operation transmitted from an external device capable of user operation, such as a remote controller, and the received external operation signal is an operation signal. Can be transmitted to the control unit 112. Further, by providing the communication unit 116, the information processing apparatus 100 can acquire various data such as an application for performing processing from an external apparatus such as a server. Here, examples of the communication unit 116 include, but are not limited to, an infrared communication port and a reception circuit, a LAN terminal, and a transmission / reception circuit. As shown in the operation unit 114, the communication unit 116 and the operation unit 114 may be integrated.

  The information processing apparatus 100 detects the telop from the content data, for example, with the configuration shown in FIG. 18, generates an index content list based on the detection result, and presents it to the user. Therefore, the information processing apparatus 100 can perform processing for realizing the user assistance approach according to the embodiment of the present invention as illustrated in FIG. 10 described above, for example, with the configuration illustrated in FIG.

  As described above, the information processing apparatus 100 according to the first embodiment of the present invention detects a telop from content data, includes an index that can be selected by the user based on the detection result, and the index is selected. In some cases, an index list content capable of reproducing content data from the reproduction start position of the corresponding content data is generated. Further, the information processing apparatus 100 displays the generated index list content on the display screen, and reproduces the content data from the reproduction start position corresponding to the index selected based on the user operation. Here, since the index list content generated by the information processing apparatus 100 can show, for example, character information constituting the telop to the user, more information than when the keyword related to the conventional technology is shown to the user. (Information with a larger amount of information) can be transmitted to the user. That is, for example, by viewing the index list content displayed on the display screen as shown in FIG. 3, the user can determine what information is included in the content data as compared with the case of using a conventional information processing apparatus. It can be recognized more easily. Further, when the user selects an index indicated by the index list content, the information processing apparatus 100 causes the content data to be reproduced from the reproduction start position corresponding to the selected index. Therefore, the information processing apparatus 100 can transmit information included in the content data to the user and assist the reproduction of the content data from a specific reproduction start position.

  As described above, the information processing apparatus 100 has been described as the first embodiment of the present invention, but the embodiment of the present invention is not limited to such a form. The first embodiment of the present invention is, for example, a video recording / reproducing device such as a hard disk recorder, a DVD recorder, a Blu-ray (registered trademark) recorder, a computer such as a PC, an LCD, an organic EL display, or the like. The present invention can be applied to various devices such as a display device and a portable communication device such as a mobile phone.

(Program related to the information processing apparatus 100 according to the first embodiment of the present invention)
A program for causing a computer to function as the information processing apparatus 100 according to the first embodiment of the present invention transmits information included in content data to the user and assists in reproducing the content data from a specific reproduction start position. can do.

(Second Embodiment)
In the above, the case where one apparatus (information processing apparatus 100) performs the process for implement | achieving the user assistance approach which concerns on embodiment of this invention as shown in FIG. 10 mentioned above as 1st Embodiment is demonstrated. did. However, the embodiment of the present invention is not limited to the above. Therefore, next, as a second embodiment, when the processing for realizing the user assistance approach according to the embodiment of the present invention as shown in FIG. 10 described above is performed in the information processing system 1000 having a plurality of devices. Will be described.

[Outline of Information Processing System 1000]
FIG. 22 is an explanatory diagram for explaining an overview of the information processing system 1000 according to the second embodiment of the present invention.

  The information processing system 1000 includes a management server 300 and information processing apparatuses 400A, 400B,..., And may be referred to as the management server 300 and each information processing apparatus (hereinafter collectively referred to as “information processing apparatus 400”). Are connected via the network 600. Here, in FIG. 22, a video recording / reproducing apparatus such as a DVD recorder is shown as the information processing apparatus 400A, and a display apparatus such as an LCD is shown as the information processing apparatus 400B, but according to the second embodiment of the present invention. The information processing apparatus 400 is not limited to the above. FIG. 22 also shows a display device 200 that can display content data and index list content that the information processing device 400A reproduces. Note that FIG. 22 illustrates an example in which the management server 300 is connected to a plurality of information processing apparatuses 400, but the present invention is not limited to the above. For example, the information processing system 1000 according to the embodiment of the present invention may be configured by the management server 300 and one information processing apparatus 400.

  The management server 300 generates index item information for each content data. In addition, based on the reception of the information acquisition request transmitted from the information processing apparatus 400, the management server 300 transmits index item information corresponding to the information acquisition request to the information processing apparatus 400 that transmitted the information acquisition request. .

  Each of the information processing apparatuses 400 transmits an information acquisition request for acquiring index item information to the management server 300, and acquires index item information corresponding to the information acquisition request from the management server 300. And the information processing apparatus 400 produces | generates an index list content based on index item information and user operation similarly to the information processing apparatus 100 which concerns on 1st Embodiment, and displays an index list content on a display screen.

  Therefore, the user of the information processing apparatus 400 selects the index displayed on the display screen, as in the case of using the information processing apparatus 100 according to the first embodiment, and thereby the reproduction start position corresponding to the selected index. Content data can be reproduced by the information processing apparatus 400.

  As described above, the information processing system 1000 realizes the user-assistant approach according to the embodiment of the present invention as shown in FIG. 10 described above by performing the processing in a shared manner between the management server 300 and the information processing apparatus 400. To achieve the process. Therefore, as with the information processing apparatus 100 according to the first embodiment, the information processing system 1000 transmits information included in the content data to the user, and assists the reproduction of the content data from a specific reproduction start position. Can do.

[Configuration Example of Information Processing System 1000]
Next, the configuration of the management server 300 and the information processing apparatus 400 constituting the information processing system 1000 will be described. Hereinafter, an information processing apparatus 400A illustrated in FIG. 22 will be described as an example of the information processing apparatus 400 according to the second embodiment. Further, since the other information processing apparatus 400 can basically have the same configuration as the information processing apparatus 400A, description thereof is omitted.

[Management Server 300]
FIG. 23 is an explanatory diagram illustrating an example of the configuration of the management server 300 included in the information processing system 1000 according to the second embodiment of the present invention.

  The management server 300 includes a communication unit 302 (server side communication unit), a storage unit 304 (server side storage unit), a content signal reception unit 306, a content data recording unit 308, and a control unit 310.

  The management server 300 may include a ROM (not shown), a RAM (not shown), an operation unit (not shown) that can be operated by the user, a display unit (not shown), and the like. For example, the management server 300 can connect each component by a bus as a data transmission path. Here, examples of the operation unit (not shown) include an operation input device such as a keyboard and a mouse, buttons, direction keys, or a combination thereof, but are not limited thereto. In addition, examples of the display unit (not shown) include an LCD and an organic EL display, but are not limited thereto.

<Example of Hardware Configuration of Management Server 300>
FIG. 24 is an explanatory diagram illustrating an example of a hardware configuration of the management server 300 included in the information processing system 1000 according to the second embodiment of the present invention.

  The management server 300 includes, for example, a CPU 150, a ROM 152, a RAM 154, a recording medium 156, a video signal processing circuit 158, a video input interface 160, an input / output interface 164, an operation device 166, a display device 350, A communication interface 168. In addition, the management server 300 connects each component with a bus 170 as a data transmission path, for example. As shown in FIG. 24, the management server 300 is different in that it does not include a video output interface, but can be configured by hardware basically similar to the information processing apparatus 100 shown in FIG.

  The CPU 150 has the same configuration as the CPU 150 illustrated in FIG. 19 and functions as a control unit 310 that controls the entire management server 300. Further, the CPU 150 can also serve as an index item generation unit 312, a communication control unit 314, and a data management unit 316 described later in the management server 300.

  The recording medium 156 functions as the storage unit 304 and stores various data such as content data, language analysis dictionary, generated index item information, and applications.

  The communication interface 168 is a communication unit included in the management server 300, and serves as a communication unit 302 for performing wireless / wired communication with an external apparatus such as the information processing apparatus 400 via the network 600 (or directly). Function.

  The management server 300 generates, for example, index item information with a hardware configuration as illustrated in FIG. 24, and an index corresponding to the information acquisition request based on reception of the information acquisition request transmitted from the information processing apparatus 400. Item information can be transmitted.

  With reference to FIG. 23 again, the components of the management server 300 will be described. The communication unit 302 is a communication unit included in the management server 300 and serves to perform wired / wireless communication with an external apparatus such as the information processing apparatus 400 via the network 600 (or directly). Here, the communication of the communication unit 302 is controlled by the control unit 310, for example.

  The storage unit 304 is a storage unit included in the management server 300. Here, examples of the storage unit 304 include a magnetic recording medium such as a hard disk and a nonvolatile memory such as a flash memory, but are not limited thereto.

  In addition, the storage unit 304 stores content data, a language analysis dictionary, an application, and the like, for example. 23, the content data A138, content data B140,..., Language analysis dictionary 142, index item information A146 corresponding to the content data A138, and index item information B148 corresponding to the content data B140 are stored in the storage unit 102. However, the present invention is not limited to the above.

  The content signal receiving unit 306 receives a content signal transmitted from, for example, a broadcasting station or an external device, similarly to the content signal receiving unit 104 illustrated in FIG. Similarly to the content data recording unit 106 shown in FIG. 18, the content data recording unit 308 records content data in the storage unit 304 based on the content signal received by the content signal receiving unit 306.

  The control unit 310 is composed of, for example, a CPU and plays a role of controlling the entire management server 300. The control unit 310 includes an index item generation unit 312, a communication control unit 314, and a data management unit 316.

  The index item generation unit 312 includes a telop detection unit 320, a voice analysis unit 322, and an item generation unit 324 having the same functions as the telop detection unit 128, the voice analysis unit 130, and the item generation unit 132 shown in FIG. Is provided. Therefore, the index item generation unit 312 detects the telop included in the content data based on the content data stored in the storage unit 304 and generates index item information, similarly to the index item generation unit 120 illustrated in FIG. can do.

  The communication control unit 314 controls communication using the communication unit 302. More specifically, for example, the communication control unit 314 reads index item information corresponding to the information acquisition request received by the communication unit 302 from the storage unit 304, and acquires the read index item information via the communication unit 302. The request is transmitted to the information processing apparatus 400 that has transmitted the request. Here, the communication control unit 314 transmits the index item information to the information processing apparatus 400 that has transmitted the information acquisition request, for example, based on the device identification information such as an IP address (Internet Protocol address) included in the information acquisition request. However, it is not limited to the above.

  The data management unit 316 manages data stored in the storage unit 304. Here, as the data management performed by the data management unit 316, for example, the index item information generated by the index item generation unit 312 is recorded in the storage unit 304, the content data stored in the storage unit 304, and the content data. For example, deletion of index item information corresponding to is not limited to the above.

  For example, the control unit 310 generates index item information with the above-described configuration, and based on reception of the information acquisition request, the information processing apparatus that transmits the information acquisition request to the index item information corresponding to the information acquisition request 400 can be transmitted.

  The management server 300 generates index item information for each content data with the configuration shown in FIG. 23, for example. Also, the management server 300 transmits the information acquisition request for index item information corresponding to the information acquisition request based on the reception of the information acquisition request transmitted from the information processing apparatus 400 with the configuration illustrated in FIG. 23, for example. It can be transmitted to the information processing apparatus 400.

[Information processing apparatus 400A]
Next, the configuration of the information processing apparatus 400A will be described. FIG. 25 is an explanatory diagram illustrating an example of the configuration of the information processing apparatus 400A that configures the information processing system 1000 according to the second embodiment of the present invention.

  The information processing apparatus 400A includes a storage unit 102, a content signal receiving unit 104, a content data recording unit 106, a content data reproducing unit 108, an external connection unit 110, a control unit 402, an operation unit 114, and a communication unit. 116.

  As shown in FIG. 25, the information processing apparatus 400A has basically the same configuration as the information processing apparatus 100 according to the first embodiment shown in FIG. Further, the information processing apparatus 400A can be configured by, for example, the hardware illustrated in FIG. 19, similarly to the information processing apparatus 100 according to the first embodiment.

  The storage unit 102 is a storage unit included in the information processing apparatus 400A, and stores, for example, content data, a language analysis dictionary, index item information acquired from the management server 300, an application, and the like. FIG. 25 shows an example in which index data B148 corresponding to the content data A138, content data B140,..., Language analysis dictionary 142, and content data B140 is stored in the storage unit 102. Not limited.

  The content signal receiving unit 104 receives a content signal transmitted from, for example, a broadcasting station or an external device, similarly to the content signal receiving unit 104 illustrated in FIG. Similarly to the content data recording unit 106 shown in FIG. 18, the content data recording unit 106 records content data in the storage unit 102 based on the content signal received by the content signal receiving unit 104.

  The content data reproducing unit 108 is controlled by the control unit 402, for example, and selectively reads content data stored in the storage unit 102. Then, the content data reproduction unit 108 reproduces the read content data, and transmits the reproduced content data to the display device 200 via the external connection unit 110, similarly to the content data reproduction unit 108 illustrated in FIG. .

  The control unit 402 includes, for example, a CPU and plays a role of controlling the entire information processing apparatus 400A. The control unit 402 includes an information request unit 404, an index list content management unit 122, a reproduction control unit 124, and a user operation learning unit 126.

  The information request unit 404 generates an information acquisition request for requesting acquisition of index item information corresponding to index list content that the user desires to generate based on a user operation. Then, the information request unit 404 transmits the generated information acquisition request to the management server 300 via the communication unit 116. Here, the information request unit 404 generates an information acquisition request including, for example, data identification information for identifying content data and device identification information for identifying the information processing device 400A, but is not limited thereto.

  The index list content management unit 122 includes a data management unit 134 having the same functions as the data management unit 134 and the index list content generation unit 136 shown in FIG. 18 and an index list content generation unit 136. Therefore, the index list content management unit 122 manages content data and index item information transmitted from the management server 300 received by the communication unit 116, and is transmitted from the management server 300 received by the communication unit 116. Index list content can be generated based on the index item information and an operation signal corresponding to a user operation.

  The reproduction control unit 124 causes the content data reproduction unit 108 to reproduce content data from the reproduction start position corresponding to the index selected based on the index selection result by the user, similarly to the reproduction control unit 124 illustrated in FIG.

  Similarly to the user operation learning unit 126 illustrated in FIG. 18, the user operation learning unit 126 updates the user preference DB 144 stored in the storage unit 102 based on the index selection result by the user.

  The control unit 402 includes, for example, an information request unit 404, an index list content management unit 122, a playback control unit 124, and a user operation learning unit 126. Therefore, the information processing apparatus 400 </ b> A includes the control unit 402, can acquire index item information from the management server 300, and can generate index list content based on the acquired index item information and user operation.

  The operation unit 114 is an operation unit included in the information processing apparatus 400A that enables an operation by a user. The communication unit 116 is a communication unit included in the information processing apparatus 400A and serves to communicate with an external device directly or indirectly via a network.

  The information processing apparatus 400 </ b> A can transmit an information acquisition request to the management server 300 and acquire index item information corresponding to the information acquisition request from the management server 300 with the configuration illustrated in FIG. 25, for example. In addition, the information processing apparatus 400A can generate an index content list and present it to the user in the same manner as the information processing apparatus 100 according to the first embodiment illustrated in FIG. 18 with the configuration illustrated in FIG. 25, for example.

  As described above, the information processing system 1000 according to the second embodiment includes the management server 300 and one or more information processing apparatuses 400 that can communicate with the management server 300, respectively. Here, the management server 300 generates index item information based on the content data, and sends index item information corresponding to the information acquisition request to the information processing device 400 based on the information acquisition request transmitted from the information processing device 400. Send. Further, each information processing apparatus 400 transmits an information acquisition request to the management server 300 to acquire index item information. Each information processing apparatus 400 generates index list content based on the acquired index item information and user operation, and presents the index list content to the user. Therefore, similarly to the information processing apparatus 100 according to the first embodiment, the information processing system 1000 can realize processing for realizing the user assistance approach according to the embodiment of the present invention as illustrated in FIG. it can. Therefore, the information processing system 1000 can achieve the same effects as the information processing apparatus 100 according to the first embodiment.

  As described above, the management server 300 is described as an element constituting the information processing system 1000 according to the second embodiment of the present invention, but the embodiment of the present invention is not limited to such a form. The second embodiment of the present invention can be applied to various devices such as a computer such as a PC or a server.

  Moreover, although the information processing apparatus 400 has been described as an element constituting the information processing system 1000 according to the second embodiment of the present invention, the embodiment of the present invention is not limited to such a form. The second embodiment of the present invention includes various video recording / playback devices such as hard disk recorders, computers such as PCs, display devices such as LCDs, and portable communication devices such as mobile phones. It can be applied to various devices.

(Program related to the information processing system 1000 according to the second embodiment of this invention)
[Program related to the management server 300]
The index item information corresponding to the received information acquisition request is generated based on the content data by the program for causing the computer to function as the management server 300 according to the second embodiment of the present invention. The information acquisition request can be transmitted to the device that transmitted the information acquisition request.

[Program for Information Processing Device 400]
A program for causing a computer to function as the information processing apparatus 400 according to the second embodiment of the present invention transmits information included in content data to the user and assists in reproducing the content data from a specific reproduction start position. can do.

  As mentioned above, although preferred embodiment of this invention was described referring an accompanying drawing, it cannot be overemphasized that this invention is not limited to the example which concerns. It will be apparent to those skilled in the art that various changes and modifications can be made within the scope of the claims, and these are naturally within the technical scope of the present invention. Understood.

It is explanatory drawing which shows an example of the content data which concern on embodiment of this invention. It is explanatory drawing which shows an example of the content data which concern on embodiment of this invention. It is explanatory drawing which shows an example of the index list content which concerns on embodiment of this invention. It is explanatory drawing for demonstrating an example of operation | movement when the index represented by the index list content which concerns on embodiment of this invention is selected by user operation. It is explanatory drawing for demonstrating an example of operation | movement when the index represented by the index list content which concerns on embodiment of this invention is selected by user operation. It is explanatory drawing which shows an example of the index list content which concerns on embodiment of this invention. It is explanatory drawing for demonstrating the index list content based on several content data. It is explanatory drawing which shows an example of the index list content which concerns on embodiment of this invention. It is explanatory drawing which shows an example of the index list content which concerns on embodiment of this invention. It is a flowchart which shows an example of the process for implement | achieving the user assistance approach in the information processing apparatus which concerns on embodiment of this invention. It is a flowchart which shows an example of the index item information production | generation / update process in the information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing which shows an example of the content information which concerns on embodiment of this invention. It is explanatory drawing which shows an example of the index item information which concerns on embodiment of this invention. It is explanatory drawing which shows an example of the classification | category of the index based on the telop which concerns on embodiment of this invention. It is explanatory drawing which shows the 1st example of the file system in the information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing which shows the 2nd example of the file system in the information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing for demonstrating an example of the reproduction | regeneration processing of the content data in the information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing for demonstrating an example of a structure of the information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing which shows an example of the hardware constitutions of the information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing which shows the 1st example of user preference DB which concerns on embodiment of this invention. It is explanatory drawing which shows the 2nd example of user preference DB which concerns on embodiment of this invention. It is explanatory drawing for demonstrating the outline | summary of the information processing system which concerns on the 2nd Embodiment of this invention. It is explanatory drawing which shows an example of a structure of the management server which comprises the information processing system which concerns on the 2nd Embodiment of this invention. It is explanatory drawing which shows an example of the hardware constitutions of the management server which comprises the information processing system which concerns on the 2nd Embodiment of this invention. It is explanatory drawing which shows an example of a structure of the information processing apparatus which comprises the information processing system which concerns on the 2nd Embodiment of this invention.

Explanation of symbols

100, 400A Information processing apparatus 102 Storage unit 112, 402 Control unit 114 Operation unit 116, 302 Communication unit 120, 312 Index item generation unit 122 Index list content management unit 128, 320 Telop detection unit 130, 322 Audio analysis unit 132, 324 Item generation unit 134 Data management unit 136 Index list content generation unit 300 Management server 314 Communication control unit 404 Information request unit 1000 Information processing system

Claims (10)

A storage unit capable of storing content data;
A telop included in the content data is detected based on the content data stored in the storage unit, and information on the detected telop is associated with information on a reproduction start position of content data corresponding to the detected telop An index item generating unit for generating index item information recorded and recorded,
Based on the index item information, an index list content that includes an index that can be selected by the user and that can reproduce content data from the reproduction start position of the corresponding content data when the index is selected is generated. An index list content management unit;
An information processing apparatus comprising: The index item generation unit includes:
A telop detection unit that detects a telop area of a frame including a telop based on video data constituting the content data stored in the storage unit, and selectively detects character information from the detected telop area;
An item generation unit that generates the index item information based on a detection result of the telop detection unit;
The information processing apparatus according to claim 1, comprising:   The telop detection unit uses the detected character information or the image data of the telop area corresponding to the character information and the information on the reproduction start position of the content data where the character information is detected as the detection result. The information processing apparatus according to claim 2, wherein the information processing apparatus transmits the information to an item generation unit.   The item generation unit generates index item information for hierarchizing the detected telop based on the character information included in the detection result of the telop detection unit. Information processing device. The index item generation unit detects a silence interval greater than or equal to a predetermined threshold and a change in a voiceprint greater than or equal to a predetermined threshold based on audio data constituting the content data, and information on the reproduction start position of the detected content data Further comprising a voice analysis unit that transmits the item to the item generation unit,
The item generation unit generates the index item information based on a detection result of the telop detection unit and information on a reproduction start position of content data transmitted from the audio analysis unit. Item 5. The information processing apparatus according to items 2 to 4. The index list content management unit
A data management unit that manages the index item information generated by the index item generation unit in association with content data corresponding to the index item information;
An index list content generation unit that generates the index list content based on an operation signal corresponding to a user operation;
The information processing apparatus according to claim 1, further comprising:   The information according to claim 6, further comprising an operation unit that generates the operation signal based on a direct operation of a user or an external operation signal transmitted from an external device operable by the user. Processing equipment. Detecting a telop included in the content data based on content data stored in a storage unit capable of storing content data;
Generating index item information recorded by associating information on the telop detected in the detecting step with information on a reproduction start position of content data corresponding to the detected telop;
Based on the index item information, an index list content that includes an index that can be selected by the user and that can reproduce content data from the reproduction start position of the corresponding content data when the index is selected is generated. Steps,
An information processing method characterized by comprising: Detecting a telop included in the content data based on content data stored in a storage unit capable of storing content data;
Generating index item information recorded by associating information on the telop detected in the detecting step with information on a reproduction start position of content data corresponding to the detected telop;
Based on the index item information, an index list content that includes an index that can be selected by the user and that can reproduce content data from the reproduction start position of the corresponding content data when the index is selected is generated. Step,
A program that causes a computer to execute. A management server and one or more information processing devices capable of communicating with the management server;
The management server
A server side communication unit capable of communicating with each of the information processing devices;
A server-side storage unit capable of storing content data;
Based on the content data stored in the server-side storage unit, a telop included in the content data is detected, information on the detected telop, and information on a reproduction start position of content data corresponding to the detected telop An index item generation unit that generates index item information recorded in association with each other;
Based on the information acquisition request transmitted from the information processing apparatus received by the server side communication unit, the index item information corresponding to the information acquisition request generated by the index item generation unit is transmitted to the information acquisition request. A communication control unit for transmitting to the information processing device;
With
Each of the information processing devices
A storage unit capable of storing content data;
A communication unit capable of communicating with the management server;
An information requesting unit for transmitting an information acquisition request for acquiring index item information corresponding to the content data stored in the storage unit to the management server via the communication unit;
Based on the index item information corresponding to the information acquisition request received by the communication unit, the index includes information that can be selected by the user. When an index is selected, the content data is obtained from the reproduction start position of the corresponding content data. An index list content management unit for generating index list content that can be reproduced;
An information processing system comprising:

Images