JP2004328188A - Contents reproducing apparatus, computer program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a contents display apparatus capable of setting a continuous link among a plurality of contents and displaying the plurality of contents in synchronism with each other. <P>SOLUTION: A contents reproducing apparatus includes: a link generating section 114 that employs a common time axis that is defined in common to a plurality of contents to generate a link among the plurality of contents; and a contents reproducing section 110 for using the link established among the plurality of contents to reproduce the plurality of contents. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a device for viewing content, and more particularly, to a content reproducing device for viewing a plurality of contents in association with each other.
[0002]
[Prior art]
With the development of computer hardware, image and audio processing technology, and communication technology, various contents can be linked to each other and played. For example, connected to the so-called Internet, a browser program that operates on a computer equipped with various storage devices, or a hard disk recording / playback device that includes a hard disk device and can play back while recording a broadcast program, This is a typical device having such a function.
[0003]
For example, a stream broadcast can be viewed by pressing a button displayed on a certain web page on the Internet, and another stream broadcast can be viewed by pressing another button displayed on the screen of the stream broadcast. Can be played.
[0004]
In the following description, so-called programs stored in package media such as programs broadcast by terrestrial broadcasting and satellite broadcasting, streams distributed through the Internet, CD-ROMs (Compact Disc-Read Only Memory) and DVDs (Digital Versatile Discs) will be described. Content data and the like are called “contents” regardless of their formats such as video and audio.
[0005]
In a conventional technique for enabling reproduction of such content, when trying to link from one content to another content, for example, a link destination address (Uniform Resource Locator) is written in the data of the link source page in a script format. : Generally represented by a URL). This address can be used as tag data to move from content to another content. A typical example is a browser using SMIL (Synchronized Multimedia Integration Language).
[0006]
SMIL is a tag language conforming to XML (Extended Markup Language) for creating an interactive presentation that combines multimedia data such as audio, video, still images, text, and animation. If the relationship between a plurality of contents is described in SMIL, it is possible to link from one content to another content, and switch from displaying the first content to displaying the linked content.
[0007]
When such a plurality of contents are reproduced, in particular, when they are moving images or music, there is a technique for synchronizing and reproducing them. A conventional example of a method for synchronously reproducing a plurality of contents using a script file has been proposed in Japanese Patent Application Laid-Open No. H11-163,976. In Patent Literature 1, a scenario for reproducing a plurality of contents is created in advance as a script file. In this scenario, information on what content is to be played from when to when is described. By playing back the content in accordance with this scenario, a plurality of contents can be played back in synchronization.
[0008]
As a method of synchronizing contents, Patent Document 2 proposes a method of arranging contents in time by operating a graphical user interface (GUI) in video non-linear editing software and synchronizing those contents. . In short, this method is to create what is equivalent to the “scenario” described in Patent Document 1 using a GUI.
[0009]
Further, Patent Document 3 proposes a device for synchronizing a plurality of videos using a universal time code (UTC) provided from a GPS (Global Positioning System) receiver. This device is, for example, a video tape recorder with a camera, which receives UTC from a GPS receiver at the time of shooting and adds it to a video as a time stamp. It is said that by adding UTC, which can be called absolute time, to an image, there is an effect that editing of a video shot by a similar device becomes easy.
[0010]
[Patent Document 1]
JP-A-2002-125214, "Method and System for Synchronous Playback of Multiple Contents"
[Patent Document 2]
JP-A-10-31661, "Method and System for Multimedia Application Development Sequence Editor"
[Patent Document 3]
JP-A-2002-32978, "Imaging apparatus, video data processing apparatus, and non-linear editing apparatus"
[Problems to be solved by the invention]
However, for a link using SMIL, it is necessary to define a tag language in a script format in order to specify a link destination of the content. In addition, it is not possible to reproduce a plurality of contents in synchronization by itself.
[0011]
In the method described in Patent Literature 1, a scenario is required to synchronize contents, and for that purpose, a relative time between a plurality of contents needs to be defined. In addition, a scenario can be defined so that it can be moved from a certain point of the content to a certain point of another content along the scenario, but only the reproduction according to the scenario can be performed. It is not possible to play content while synchronizing it differently from the scenario.
[0012]
The system described in Patent Document 2 is also essentially the same as that described in Patent Document 1. That is, in the technique described in Patent Document 2, a user arranges contents on a time axis provided by the system and defines synchronization between the contents. Therefore, it is possible to reproduce a plurality of contents in accordance with the “scenario” created in this way, but it is not possible to reproduce in other formats.
[0013]
Further, in the system described in Patent Literature 2, the editing software needs to manage the plurality of contents in order to specify synchronization. Therefore, a user who wants to define synchronization has to keep all content in the system. Therefore, it is difficult in principle to synchronize separately prepared contents and reproduce them.
[0014]
Using the technology described in Patent Literature 1 or Patent Literature 2, if a third party describes a relationship between contents as a scenario and provides it to a user including its tag information and the like, the user will be able to use the multiple Content can be synchronized and played. However, when such a scenario is not prepared, even if a general user independently obtains a plurality of contents, a reproduction method of synchronizing and reproducing them cannot be easily realized.
[0015]
In the technique described in Patent Document 3, a global time stamp obtained from GPS is added when a video is created. Although this is certainly convenient when editing between a plurality of contents, it is not easy for the user to use. Also, Patent Document 3 does not describe a method for synchronizing and reproducing a plurality of contents by using this.
[0016]
For example, suppose that a user records a television broadcast of a soccer World Cup game with commentary in English and Japanese on a hard disk recording and reproducing apparatus owned by the user. It is assumed that a commentary in French is broadcasted separately for the same game, and data on the broadcast content is prepared on the Internet. In this case, it is convenient if it is easy to attach a commentary in French prepared on the Internet to the recorded video of the television broadcast and synchronize and view them. However, it is impossible to reproduce such a plurality of contents in synchronization with the techniques described in Patent Documents 1 to 3.
[0017]
In short, in the related art, a link format that moves from a predetermined point of a certain content to another predetermined point of another content can be formed, but from an arbitrary point of a certain content, A link that moves to a point in another content that corresponds to any point in it (which can be referred to as a "continuous link" as opposed to a discrete link in the prior art) is not possible. Was. If such a continuous link becomes possible, a plurality of contents can be synchronized and freely switched at any point to be displayed backward, or a plurality of contents can be synchronized and displayed simultaneously. .
[0018]
Therefore, an object of the present invention is to provide a content display device capable of setting a continuous link between a plurality of contents and synchronizing and displaying the plurality of contents, and a program therefor.
[0019]
Another object of the present invention is to provide a content display device capable of setting a continuous link between a plurality of contents and synchronizing and displaying a plurality of contents prepared independently of each other, and a program therefor. It is to be.
[0020]
Still another object of the present invention is to provide a content display device capable of setting a continuous link between a plurality of contents and switching and displaying the plurality of contents at any point while synchronizing the plurality of contents, and a program therefor. To provide.
[0021]
Another object of the present invention is to provide a content display device capable of setting a continuous link between a plurality of contents and synchronizing and displaying a plurality of contents prepared independently of each other in a desired format. It is to provide a program for that.
[0022]
[Means for Solving the Problems]
A content reproducing apparatus according to the present invention uses a common time axis commonly defined for a plurality of contents to generate a link between the plurality of contents, and a link generation unit for generating a link between the plurality of contents. And a reproducing unit for reproducing a plurality of contents using the link.
[0023]
A link between contents is generated using a common time axis defined in common for a plurality of contents. By introducing a common time axis, links between contents can be defined discretely or continuously. These definitions can be made as discrete or continuous functions. In addition, a certain part of a certain content can be dynamically linked to a corresponding part of another content via a common time axis.
[0024]
Preferably, the link generation unit includes a unit for dynamically determining a link between a plurality of contents using a common time axis.
[0025]
More preferably, the reproducing unit includes a unit for reproducing a plurality of contents by synchronizing the contents with each other by using a link generated using a common time axis. The common time axis may be a time axis defined by a predetermined absolute time.
[0026]
A plurality of contents are reproduced in a time-synchronized manner using a link generated using a common time axis. Even if the contents are prepared separately, they can be synchronized with each other by defining the common time axis.
[0027]
Preferably, for each of the plurality of contents, a playback time axis for playback is further defined separately from the common time axis. A reproducing unit configured to reproduce the selected one of the plurality of contents in accordance with a reproduction time axis defined in relation to the selected one of the plurality of contents; Among the different contents different from the selected one content, a second content for reproducing a location linked to a reproduction location by the first content reproducing means in association with the reproduction of the first content. Playback means.
[0028]
More preferably, for each of the plurality of contents, a relationship between the playback time axis and the common time axis is defined, and the link generation unit includes a plurality of content items each of which has a playback time axis and a common time axis. Means for generating a link between a point on the playback time axis of the first content and a point on the playback axis of the second content using the relationship between
[0029]
The relationship between the common time axis and the playback time axis may be defined independently for each of the plurality of contents.
[0030]
Preferably, the second content reproduction means includes means for reproducing a portion of another content linked to a reproduction position by the first content reproduction device in parallel with the reproduction of the first content. More preferably, the first content reproducing means selects a content having a first time as a time on a common time axis from among the plurality of contents, and sets a reproduction time defined in relation to the selected content. Including means for playing along the axis.
[0031]
More preferably, the reproducing unit further includes a selecting unit for selecting a content to be reproduced by the first content reproducing unit from the plurality of contents.
[0032]
The content reproduction device may further include a content registration unit for registering a plurality of contents. The selection means may select an arbitrary content from the plurality of contents registered by the content registration means.
[0033]
Preferably, the content reproducing apparatus further includes a unit for selecting another content as a target of reproduction by the first content reproducing unit instead of the selected content in response to a predetermined content switching signal.
[0034]
More preferably, the content reproducing apparatus further includes a means for controlling the second content reproducing means to reproduce the selected one content in response to the content switching signal. The content reproduction device may further include a unit for generating a content switching signal.
[0035]
Preferably, the content registration means includes means for registering a plurality of contents in a predetermined order, and the selection means, in response to a user operation, means for generating a predetermined content switching signal, Means for selecting, in response to the content switching signal, the content registered by the content registration means in place of the selected content, the content being registered next to the selected content.
[0036]
The selecting means further includes means for generating a predetermined return signal in response to a user operation, and in response to the return signal, the content registering means replacing the selected content with the selected content. May be included for selecting the content registered before. The playback time of the previous content may be calculated based on the link from the playback time of the selected content at the time when the return signal is generated.
[0037]
Preferably, the content reproduction device further includes a unit for setting a reproduction time axis for the content. The content reproduction device may further include means for setting a common time axis for the content.
[0038]
Preferably, the playback means further includes means for indicating a playback direction, and the first content playback means includes a playback time axis defined along the selected one content. Includes means for playing according to direction.
[0039]
Preferably, the content reproducing apparatus further includes an operation signal generating unit for generating a predetermined operation signal, and the reproducing unit responds to the operation signal by switching a plurality of contents in accordance with a link and reproducing the same. Including. The content reproduction device further includes means for recording the operation signal generated by the operation signal generation means and a time point on the common time axis of the content being reproduced by the reproduction means when the operation signal is generated. In response to a predetermined operation reproduction signal, an operation signal recorded in the recording means is generated at a time point on a common time axis when each operation signal is generated and is given to the reproduction means. Operation signal reproducing means. Thereby, the reproduction of the content according to the operation of the operator is reproduced by the reproduction means.
[0040]
Preferably, the operation signal reproducing means follows the common time axis in a direction opposite to the recording by the recording means, and generates the operation signal at a time corresponding to each operation signal on the common time axis, and Including means for providing Thereby, the reproduction of the content in accordance with the operation of the operator is reproduced by the reproducing means in a temporally reverse order.
[0041]
The content reproduction apparatus may further include a unit for designating an arbitrary point of the content being reproduced as a reproduction point by the reproduction unit.
[0042]
A computer program according to another aspect of the present invention, when executed by a computer, causes the computer to operate as any of the above-described content reproducing apparatuses.
[0043]
A recording medium according to still another aspect of the present invention has the above-described computer program recorded thereon.
[0044]
BEST MODE FOR CARRYING OUT THE INVENTION
The content is supplied as a digital signal and an analog signal in a wired or wireless manner from a broadcast medium or from a storage device connected to a network such as the Internet. Content exists continuously and discontinuously in time, and a reproduction time can be assumed. For example, in the case of a moving image, a time axis for reproduction can be considered. The same applies to music. A still image can be considered to be the same as a moving image displaying the same image at any time along the time axis.
[0045]
In the same manner as the reproduction time can be assumed for each content, it is possible to specify a link time separately from the reproduction time. The link time has a predetermined relationship with the reproduction time, but as will be described below, the link time is a concept not found in the conventional technology.
[0046]
Link time is a concept introduced to establish a "continuous link" between certain content and other content. The link time is a time axis commonly set among a plurality of contents. Each content is set with a chronological link time.
[0047]
The link time can be determined based on an absolute time such as UTC, or can be determined based on a time system based on another time point. Further, a link time may be defined in each content in a form different from the time that can be considered in a normal sense.
[0048]
The link time makes it possible to establish a correspondence between a certain point in one content and a certain point in another content. For example, if the reproduction speeds of a plurality of contents are adjusted so that the link times of the plurality of contents are always equal, the plurality of contents can be reproduced simultaneously in synchronization. Typically, one content may be selected, and the other content may be played based on the link time while the content is played at a normal playback speed.
[0049]
In addition, even when a plurality of contents are exclusively reproduced, when switching from one content to another content, the link time in the former content is known, and the content after the switching is compared with the link time at the time of switching. Can be played. By doing so, it is possible to realize a reproducing method in which one sight is viewed while switching from two or more viewpoints while actually switching two contents recorded at the same time.
[0050]
Furthermore, by defining the link time to be a special way of progressing, which is different from the one that progressively progresses at a fixed rate like the usual idea of time, it is possible to format multiple contents in a unique format. You can also play with the relationship.
[0051]
The concept regarding the link time will be described with reference to FIGS. For example, referring to FIG. 1, consider the link time between the first content and the second content. In the first content, a link time indicated by the link time 52 of the first content is defined, and it is assumed that the content is normally reproduced at a speed indicated by the reproduction time axis 50. Similarly, it is assumed that a link time 54 of the second content is defined in the second content, and the content is normally reproduced at a speed indicated by a reproduction time axis 56. The reproduction time axes 54 and 56 indicate the elapsed time during reproduction.
[0052]
In the example shown in FIG. 1, the link time of the first content is equal to the link time of the second content. Therefore, if the first content is played back at normal speed and the second content is played back in synchronization with it, the second content will be played back at normal speed. Become.
[0053]
On the other hand, with reference to FIG. 2, consider a case where the link time 74 defined for the second content is different from the link time 72 in the first content. With reference to FIG. 2, for example, the content of link time t0 to t3 of the second content is normally reproduced over reproduction time T0 to T6 as indicated by reproduction time 76. On the other hand, it is assumed that the reproduction of the first content is the same as that shown in FIG.
[0054]
In this case, if both are simultaneously and independently reproduced, at the reproduction time T6, the first content is reproduced until the link time t6, and the second content is reproduced only until the link time t3. This is not a synchronization.
[0055]
In this embodiment, in the case described above, the reproduction speeds of the two contents are adjusted so that the link times of the two contents are always equal to each other. “Synchronous playback” in the present embodiment refers to playing a plurality of contents at such a speed that the link times of the plurality of contents become equal in such a manner.
[0056]
In the example shown in FIG. 2, for example, if the first content is the main playback content, the content of the second content t0 to t6 is played during the playback time T0 to T3. In this case, the second content is reproduced at twice the speed of the case where the second content is reproduced alone. Conversely, if the second content is the main playback content, the content of the first content from t0 to t3 is played during the playback time T0 to T6. In this case, the first content is reproduced at half the speed as compared with the case where the first content is reproduced alone.
[0057]
The link time may be automatically generated from the link start time and the reproduction time. In addition, as one expression method of the link time, it is conceivable to use the absolute time such as UTC and Coordinated Universal Time as described above. By using the link time specified in the reproduction of the content as an argument, it is possible to reproduce a specific portion of another content corresponding to the link time. In this way, a continuous link can be established between a plurality of contents by continuously defining or calculating the correspondence between link times.
[0058]
FIG. 3 shows a functional block diagram of the content reproduction device according to the present embodiment. This content playback device is for playing back content existing in the content database 104. The content database 104 is a concept including all sources of various contents.
[0059]
Referring to FIG. 3, the content reproduction device 90 controls an input / output device (not shown), and sends a signal to each unit according to the type and input / output mode when a trigger is received from the input device; When there is a command from the user interface unit 100 to select a specific content in the content database 104, when there is a command to register the content from the user interface unit 100, and when there is a command to register a certain content from the user interface unit 100, the content data And a content registration unit 106 for registering information related to the content such as a reproduction time of the content data and a link time as a content record.
[0060]
Further, when the content reproducing device 90 receives a command to reproduce one or a plurality of contents registered in the content registration unit 106 from the user interface unit 100, the content reproduction device 90 transmits the command via the user interface unit 100 according to the information stored in the content registration unit 106. When a command for defining a link of a specific content is received from the content reproduction unit 110 for displaying the content on a display device (not shown) and the content registration unit 106, the link information such as the link start time and the link end time of the content is displayed. When the content playback unit 110 receives a command to play back content from the user interface unit 100, the link definition unit 108 for defining and registering the content in the content storage unit 112 generates a link time at the time of playback according to a method described later. Content registration And a link generation unit 114 for registering the parts 106.
[0061]
The content reproduction device 90 also has a function of recording a user operation and reproducing the operation in accordance with an instruction. Recording and reproduction are instructed to the content reproduction apparatus 90 by a recording / reproduction signal 116. In the present embodiment, the recording / reproducing signal 116 is set by a switch (not shown).
[0062]
Therefore, when the recording / reproducing signal 116 is a value indicating recording, the content reproducing device 90 further stores each event from the user interface unit 100 and the link time at the time of occurrence as a pair, and Is a value indicating reproduction, an operation storage / reproduction unit 112 for giving these events to the same destination according to the link time when the events occurred is included. To perform this switching, a selector 118 is provided for input from the user interface unit 100 to the content selection unit 102, the content registration unit 106, and the content reproduction unit 110. The selector 118 is configured to supply an event from the user interface unit 100 to each unit when the recording / reproduction signal 118 is on the recording side, and to provide an event from the operation storage / reproduction unit 112 to each unit when the recording / reproduction signal 118 is on the reproduction side.
[0063]
The content reproduction device 90 is substantially composed of a computer as described later. The program described for each of the above-described units and the data and program of the content registered in the content registration unit 106 are stored in the memory unit. Loaded and processed by the arithmetic unit. The user interface unit 100 generates input / output data between the input device and the display device, and controls the input device and the display device. The user interface unit 100 generates a signal in response to a trigger received from the input / output device and sends the signal to each functional unit, and each functional unit performs data processing according to the signal.
[0064]
FIG. 4 shows a structure of a content record stored in the content storage unit 112. The record 130 of each content includes a playback time 140 that defines the length of the content, a playback time 142 that indicates the time at which playback is performed, and the start of a period for setting synchronous playback / switching between other content. A link start time 144 that defines the time, a link end time 146 that also defines the end time of the period, a link time 148 that indicates the link time of the content that changes with the playback, and whether the content should be played back simultaneously. A simultaneous display flag 150 indicating whether or not the content is to be reproduced, a pointer 152 to a record of a content next to the content in a series of contents set for synchronous reproduction, and a reproduction for storing a program for calculating a reproduction time of the content. A time calculating unit 154 and a link time calculating unit 156 for storing a program for calculating a link time , Of the contents of the content data (this is referred to as "content data".) And a 158. The playback time and the link start time are usually already given.
[0065]
The content reproduction device 90 is substantially composed of a computer as described above. FIG. 5 shows the hardware configuration in block diagram form. Referring to FIG. 5, the hardware of content reproduction device 90 is connected to input device 172, display device 174, content storage device 170 including a hard disk, and content storage device 170, input device 172, and display device 174. And a control device 176 for controlling these in accordance with a predetermined program described later. The content storage device 170, the input device 172, the display device 174, and the control device 176 can exchange data with each other.
[0066]
The control device 176 includes an arithmetic unit 192 having a function of performing arithmetic processing, including a CPU (Central Processing Unit), a memory unit 194 mainly composed of a semiconductor memory, and a nonvolatile secondary storage device 196 composed of a hard disk or the like. And a bus 198 connecting these components to each other, and an input device 172, a display device 174, and a bus 198. The input device 172 controls the input device 172 and the display device 174 to input and output data between them and the control device 176. And an input / output unit 190 for performing the operation.
[0067]
Generally, the user uses the input device 172 to perform a content selection function, a content registration function, a user interface function (a link function, a return function, a time designation function, a simultaneous display function, a character input function) and the like by the content reproduction device 90. It can be operated interactively.
[0068]
FIG. 6 shows the appearance of a remote control device (hereinafter simply referred to as “remote control input device”) 210 which is the input device 172 in the device of the present embodiment. Referring to FIG. 6, remote control input device 210 includes a display device 232 made of liquid crystal. The display area of the display device 232 displays information that assists the operation or all or part of the content to be reproduced.
[0069]
The remote control input device 210 further includes a selection button 212 operated by the user when selecting content, a registration button 214 operated by the user when registering the content in the content registration unit 106, and switching of playback content. A link button 216 used by the user when instructing switching of reproduction by a content link in the form of the above, a jog dial 218 operated by the user to specify a reproduction time, and the like, used for returning to the display of the immediately previous content. A return button 220 for performing registration, a simultaneous display button 222 used for instructing whether or not to reproduce a certain content simultaneously with another content at the time of content registration, and a home button 224 for displaying a predetermined home screen. , Alphabets and numbers The character buttons 228, and a power button 230.
[0070]
Referring to FIG. 5 again, control device 176 includes content selection unit 102, content registration unit 106, link definition unit 108, user interface unit 100, content reproduction unit 110, operation storage / reproduction unit 112, and A function corresponding to each of the link generation units 114 is realized by executing a program.
[0071]
The display device 174 has a function of displaying data such as characters, images, moving images, graphics, and sound provided from the control device 176. Note that, in this specification, “display” is a concept including not only output of visual information such as images, videos, and characters, but also output of auditory information such as sound, or olfactory information such as smell. .
[0072]
Using the input device 172, the user retrieves arbitrary content from the content database 104, which is a set of content existing in an arbitrary location such as the Internet or an external storage device, into the secondary storage device 196 shown in FIG. Can be displayed on the display device 174. This is a function realized by the content selection unit 102 and the content reproduction unit 110 shown in FIG. The user determines whether to register the displayed content in the content registration unit 106, and if so, registers the content in the content registration unit 106 using the function of the input device 172.
[0073]
If it is necessary to add link information to the content to be registered, the user manually defines the link start time and the link end time and registers the same in the record in the content registration unit 106. When the user finishes the registration of the content, selects the content to be reproduced from the registered content, and executes the reproduction, the registered content and the plurality of contents are transmitted by the content reproduction unit 110 according to the content information and the state of the device. It is reproduced and displayed on the display device 174.
[0074]
The content is supplied to the content reproduction device 90 as a digital signal and an analog signal from a storage medium connected to a network such as a broadcast medium or the Internet in a wired and wireless manner, and is input to the content selection unit 102 as digital data and analog data. You. The content selection unit 102 has a function of accepting a plurality of inputs simultaneously, just like a television receiver having a function of receiving signals from a plurality of broadcast stations. For example, a case where a plurality of input terminals exist in the content selection unit 102 and different contents are supplied to each terminal may be assumed. When the user presses a button corresponding to the content selection function, an instruction to select the content is sent to the content selection unit 102 via the user interface unit 100. When the content selection unit 102 receives the content switching data, the content input terminal is switched, and the content supplied to the switched input terminal is selected. This is just like switching channels in television broadcasting.
[0075]
Alternatively, the character button 228 shown in FIG. 6 may be used to input a broadcast channel or a URL (Uniform Resource Locator) of the content, and the content selection unit 102 may select the content specified thereby.
[0076]
The selected content is reproduced through the function of the content reproduction unit 110 of the control device 176, and is displayed on the display device 174 as characters, images, moving images, or graphics, reproduced as audio, or displayed. Output in both.
[0077]
Hereinafter, a control structure of a program for realizing the content reproduction device 90 of this embodiment will be described.
[0078]
FIG. 7 shows an overall flowchart of a program for realizing this apparatus. Referring to FIG. 7, the program includes a step 240 for selecting and registering a content, a step 242 for setting a content to be reproduced first (reproduced content) and a link time to start reproduction from a plurality of contents, In step 244, a link time is generated, and it is determined whether or not the link time generated in step 244 is incorrect in relation to the link time set in the content. If the link time is incorrect, control is returned to step 242 Otherwise, step S246 is advanced to the next step S246.
[0079]
In step 246, the content selected in steps 240 and 242 is reproduced. If any event occurs during the execution of the reproduction, the process of step 248 is interrupted, and the control proceeds to step 250.
[0080]
In step 250, it is determined whether or not the detected event is a link event. The link event occurs when the user operates the link button 216. If it is a link event, control proceeds to step 252; otherwise, control proceeds to step 254.
[0081]
In step 252, the reproduction of the content next to the content being reproduced in the series of contents selected in step 240 is started, and the control returns to step 244.
[0082]
On the other hand, in step 254, it is determined whether or not the detected event is a return event. The return event occurs when the user operates the return button 220. If the event is a return event, control proceeds to step 258; otherwise, control returns to step S242.
[0083]
In step 258, of the series of contents selected in step 240, the reproduction of the content before the event being reproduced is started, and the control returns to step 244.
[0084]
The process of content selection and registration performed in step 240 of FIG. 7 will be described with reference to FIG. Referring to FIG. 8, the process includes a step 270 of receiving a content selection by the user and a step 272 of determining whether or not the registration of the received content has been specified by the user. The method of selecting the content is as described above. The instruction to register the content is generated by operating the registration button 214 shown in FIG.
[0085]
If registration is instructed, control proceeds to step 274. Otherwise, this process ends. In step 274, a process of registering all or a part of the selected content or information for identifying the content in the content registration unit 106 is performed. Subsequently, in step 276, processing for updating the registered content list is executed. The registered content list refers to data in the format shown in FIG. 4 recorded in the content registration unit 106 in a list format by the pointer 152. In the data of the last content in the list, NIL is stored in the pointer 152.
[0086]
Subsequently, in step 278, link registration for setting the link time and the reproduction time of the content registered in step 274 is performed. The details are shown in FIG. 9, which will be described later.
[0087]
After step 278, step 280 further receives information regarding whether the user is about to enter the next content. When the next content is input, the control returns to step 270. Otherwise, the process ends.
[0088]
With reference to FIG. 9, a description will be given of a control flow of a program for realizing the link registration process performed in step 278 of FIG. First, in step 300, a link start time of the content to be processed is set. The link start time refers to the beginning of a period for setting to perform synchronized playback with another content.
[0089]
Next, in step 302, the reproduction time of the content is set. The reproduction time is the time required to reproduce the entire content. This setting is performed using the character button 228.
[0090]
Further, in step 304, a process of setting a simultaneous display flag is performed. This setting is toggled by pressing the simultaneous display button 222 in FIG. The simultaneous display flag is a flag indicating whether or not to display the content simultaneously when the content is switched to another content. When this flag is on, the display of this content is continued when the content is switched to another content. That is, a plurality of contents are displayed simultaneously. If this flag is off, the display of this content is interrupted when there is a switch.
[0091]
Next, in step 306, a process of loading a program for calculating a playback time when the content is played back into the memory is performed. This program is a program stored in the reproduction time calculation unit 154 of FIG. For normal playback, use the default program. An example of this program will be described later.
[0092]
In step 308, a process of similarly loading a program for calculating a link time for reproducing the content into the memory is performed. This memory is a program stored in the link time calculation unit 156 of FIG. The link time is calculated by a predetermined calculation method in relation to a link start time, a reproduction time, and the like between a plurality of contents to be reproduced. Normally, when the link start time and the reproduction time of a plurality of contents are the same, the link time calculation program uses a default program. However, depending on the content, you may need to use something other than the default. An example of this program will be described later.
[0093]
In step 310, a link end time is set. For this processing, the link time calculation program loaded in step 308 is used.
[0094]
FIG. 10 shows a flowchart of the default program among the reproduction time calculation programs loaded into the memory in step 306 of FIG. Referring to FIG. 10, the default program operates with the link time as an argument, and calculates the reproduction time by subtracting the link start time from the link time as shown in step 430. The link start time is the link start time 144 in FIG. The program ends with the calculated playback time as a return value.
[0095]
FIG. 11 shows a flowchart of the default program among the link time calculation programs loaded into the memory in step 308 of FIG. Referring to FIG. 11, the default program is a program that is called with a reproduction time as an argument and ends with a link time as a return value. In step 440, the link time is calculated by subtracting the reproduction time from the link start time. The link start time is the link start time 144 in FIG. After step 440, the program ends.
[0096]
The link end time of the content calculated in step 310 of FIG. 9 is set using a program for calculating the link time.
[0097]
When the processing up to step 310 ends, the registration processing for this content ends.
[0098]
In step 242 of FIG. 7, the user specifies the content to be reproduced first and starts reproduction. At this time, the user specifies which content is to be reproduced from where. If the user has not specified the link start time, the link start time and the content to start reproduction are specified by the processing shown in FIG.
[0099]
Referring to FIG. 12, in this process, the link time is first set to 0 (step 330). Subsequently, the processing of steps 334 to 338 is repeated for all registered contents. In the following description, the “start link time” refers to a link time assigned to the head of each content.
[0100]
That is, in step 334, it is determined whether the link time is after the start link time of the content to be processed. If the result of the determination is YES, control proceeds to step 336. Otherwise, control transfers to the process for the next content.
[0101]
In step 336, the start link time of the content to be processed is substituted for the link time. Subsequently, in step 338, the reproduction content is set as the content to be currently processed.
[0102]
When the processing of steps 334 to 338 is completed for all the registered contents, the content having the earliest start link time is selected as the reproduction content, and the start link time is set as the link time. . In step 340, the process ends with the playback content and the link time determined in this way as arguments.
[0103]
Subsequently, a link generation process is executed in step 244 of FIG. This processing corresponds to the function of the link generation unit 114 in FIG. FIG. 13 shows the details of step 244 in FIG.
[0104]
Referring to FIG. 13, first, in step 360, it is determined whether or not a link time to start reproduction is designated. If a link time has been specified, control proceeds to step 362; otherwise, control proceeds to step 368.
[0105]
In step 362, the link start time of the content designated as the first to be reproduced is set as the link time. Thereafter, in step 364, the reproduction time is set to 0, and the processing is terminated with the reproduction time as a return value.
[0106]
In step 368, it is determined whether the specified link time is after the link start time and before the link end time. If the result of this determination is YES, control proceeds to step 370, otherwise the process ends with an error as return value.
[0107]
In step 370, a link is generated based on the data of the content designated to be reproduced first. That is, the reproduction time is calculated by the reproduction time calculation program using the designated link time. Thereafter, in step 372, the reproduction time is set as a return value, and the process ends.
[0108]
Referring again to FIG. 7, as described above, if the processing in step 244 is an error, the control returns to step 242. If there is no error, the content is reproduced in step 246. FIG. 14 shows the contents of the process of step 246.
[0109]
Referring to FIG. 14, first, in step 390, content data corresponding to the reproduction time is displayed. Further, the processing from step 394 to step 398 is repeatedly executed in step 392 for all other registered contents.
[0110]
First, in step 394, it is determined whether or not the simultaneous display flag of the next content data among the registered contents is on. If it is on, control proceeds to step 396, otherwise it proceeds to the next content.
[0111]
In step 396, a link is generated using the link time as an argument for the content for which the simultaneous display flag is determined to be on in step 394. Subsequently, in step 398, a process of displaying this content simultaneously with the first content from the reproduction time is performed. Thereafter, the processing of step 394 is executed for the next content. By the processing in steps 396 and 398, the display of the same link time as the link time of the currently reproduced content is performed for other contents (limited to those for which the simultaneous display flag is ON).
[0112]
When the processing of steps 394 to 398 is completed for all the registered contents, the control proceeds to step 400. In step 400, a process of updating the reproduction time is performed. For this processing, a reproduction time calculation program for the reproduced content is used. The fluctuation of the reproduction time depends on the content and the display processing capability of the device. In this example, it is assumed that an image of 30 frames per second can be entirely displayed within that time. Then, the updated playback time is obtained by adding 1/30 seconds to the current playback time, and that time is set as the playback time. Next, when the process of step 360 is executed, the display of the content data is performed using the reproduction time. Further, in step 402, the link time is calculated by the link time calculation program based on the updated reproduction time.
[0113]
After step 402, it is determined in step 404 whether any event has occurred. If there is any event, the control proceeds to step 406, where the reproduction is temporarily stopped, and the processing is terminated with the link time at this time as a return value. If there is no event, control returns to step 390. Hereinafter, the reproduction and display of the content are repeated until an event such as a link is input.
[0114]
If any event is detected in step 404 and the event is a link event, after this processing is ended, the processing moves from step 250 to step 252 in FIG. 7 to play the next content in the registered event. Become. At this time, the content subsequent to the content that has been reproduced up to that point is extracted from the pointer 152 of the record (see FIG. 4) relating to the content that has been reproduced.
[0115]
The above is the hardware configuration, functional block configuration, and program configuration of the content reproduction device 90 according to the present embodiment.
[0116]
The programs stored in the reproduction time calculation unit 154 and the link time calculation unit 156 shown in FIG. 4 are not limited to the default programs described in FIG. 10 and FIG. Things are conceivable. For example, if a portion of the content includes a portion that behaves differently from normal time progression (ie, if such a link time is defined for this content), the playback The relationship between the time and the link time cannot be defined by the default programs shown in FIGS. 10 and 11, respectively. In this case, it is necessary to create a program for calculating the reproduction time and the link time according to the reproduction speed of the content, and store the program in the reproduction time calculation unit 154 and the link time calculation unit 156 in FIG. An actual example will be described later.
Hereinafter, the operation of the above device will be described with reference to an example. Except for the operation example 6, the recording / reproducing signal 116 is a value indicating recording.
[0117]
-Operation example 1-
The first operation example is an example of a case where a user views a baseball game while switching two video contents shot from two different angles. These will be referred to as first content and second content. The first content is a video of a batter, and the second content is a video of the entire ground taken from above the stadium. By watching the second content, it is possible to follow the movement of a fielder on the ground.
[0118]
In this case, for example, the user watches the movement of the batter by mainly viewing the first content, and switches the displayed content from the first content to the second content when the batter hits. be able to. With such a viewing method, it is possible to check the whereabouts of the hit ball and the movement of the fielder when hitting, while usually closely watching the movement of the batter.
[0119]
Referring to FIG. 7, when the user intends to perform such a viewing method, the first content and the second content are selected and registered (step 240 in FIG. 7). Regarding the processing at this time, a specific operation of the apparatus will be described with reference to FIG.
[0120]
FIG. 17 shows the reproduction of the first and second contents and the outline of the contents. Referring to FIG. 17, the first content is a video of a batter, and the second content is a video from above the stadium. The reproduction time of the first content is 300.00 seconds, and was produced at 20:20:00 on September 14, 1998. The same applies to the second content. Also, in the following description, it is assumed that the reproduction starts from the first content as shown in FIG. Then, as shown by the arrow 510, the user operates the link button 216 to move to the reproduction of the second content at 60 seconds from the start of the reproduction, and further, as shown by the arrow 512 at 120 seconds after the start of the reproduction. Then, the link button 216 is operated again to return to the display of the first content.
[0121]
Referring to FIG. 8, first, the user selects the first content by a selection operation using remote control input device 210 shown in FIG. 6 (step 270 in FIG. 8). By pressing registration button 214 of remote control input device 210 (step 272 in FIG. 8), the content is registered in content registration unit 106 shown in FIG. 3 (step 274 in FIG. 8). Here, for the first content, the content record 130 shown in FIG. This record is referred to as record 130A.
[0122]
Next, the registered content list is updated (step 276 in FIG. 8). At this point, since the registered content is only the first content, the pointer 152 to the content next to the first content is NIL.
[0123]
Next, link registration for setting the link of the first content and the reproduction time is performed (step 278 in FIG. 8). Referring to FIG. 9, the link start time of the first content is set to 20:20:00 on September 14, 1998 (step 300 in FIG. 9). Next, the reproduction time of the first content is set to 300.00 seconds (Step 302 in FIG. 9). In this example, if there is a link operation, the display is always switched between the first content and the second content, so the simultaneous display flag is set to off (step 304 in FIG. 9).
[0124]
In this example, the reproduction time and the link start time of the first content are equal to the reproduction time and the link start time of the second content, respectively. Therefore, the default program shown in FIG. 10 is used as the program for calculating the playback time of the first content (step 306 in FIG. 9). For the same reason, a default program shown in FIG. 11 is used as a program for calculating the link time of the first content (step 308 in FIG. 9).
[0125]
The link end time of the first content is set using the program for calculating the link time (step 310 in FIG. 9). In this case, the link end time is set to 20:25:00 on September 14, 1998. This completes the registration of the first content.
[0126]
Since there is more content to be registered (YES in step 280 of FIG. 8), the second content is selected and registered. That is, the second content is selected in the same manner as the first content (step 270 in FIG. 8). When the user presses registration button 214 of remote control input device 210 (YES in step 272 in FIG. 8), the second content is registered in content registration unit 106 (step 274 in FIG. 8). The content registration unit 106 creates a record 130 (FIG. 4) of the second content. This is record 130B.
[0127]
Next, the registered content list is updated (step 276 in FIG. 8). At this time, the registered contents are the first content and the second content. Therefore, the pointer 152 of the data of the first content (FIG. 4) is set to the second content, and the pointer 152 of the data of the second content is set to the first content.
[0128]
Next, link registration of the second content is performed (step 278 in FIG. 8).
[0129]
Referring to FIG. 9, here, the link start time of the second content is set to 20:20:00 on September 14, 1998 (step 300 in FIG. 9). Next, the reproduction time of the second content is set to 300.00 seconds (Step 302 in FIG. 9). The simultaneous display flag is set to OFF as in the case of the first content (step 304 in FIG. 9). As the program for calculating the reproduction time and the link time, the default programs (FIGS. 10 and 11) are used similarly to the first content (steps 306 and 308 in FIG. 9).
[0130]
In step 310 of FIG. 9, the link end time of the second content is set using the program for calculating the link time loaded in step 308 (step 310 of FIG. 9). In this case, the link end time is set to 20:25:00 on September 14, 1998. This completes the registration of the second content.
[0131]
FIG. 18 shows the structure and value of each of the records 130A and 130B at the time when the registration of the first content and the second content is completed. Each of the records 130A and 130B has the same structure as the record 130 of the content shown in FIG. In FIG. 18, the same reference numerals as those shown in FIG. 4 are used for each item, and "A" is added to the end of each code for the first content and "A" for the second content. B "is attached to each of them.
[0132]
As shown in FIG. 18, at this time, the reproduction time, the link start time, and the link end time of the record 130A of the first content are set, and the simultaneous display negative flag 150A is set to off. The same applies to the record 130B of the second content.
[0133]
Returning to FIG. 8 again, in step 280, since there is no content to be added after this, the processing in FIG.
[0134]
Referring to FIG. 7, in step 242, the user specifies which content is to be reproduced from where. In this example, the user sets the playback content as the first content, and specifies the playback start time from the beginning of the first content. As a result, the link time is set to 20:20:00 on September 14, 1998, which is the first time point of the first content, and the reproduction of the first content starts.
[0135]
Here, the user may not specify the link start time. In that case, the link start time is set by the processing shown in FIG.
[0136]
Subsequently, the link start time of the first content is set to the link time (step 244 in FIG. 7). Referring to FIG. 13, here, the link time is specified as 20:20:00 on September 14, 1998, so control proceeds from step 360 to step 368. Since the link time is within the range of the link start time (20:25:00 on September 14, 1998) and the link end time (20:25:00 on September 14, 1998), the control further proceeds to step 368. Then, the process proceeds to step 370. In step 372, the reproduction time is calculated from the link time by the default reproduction time calculation program. The reproduction time in this case is 0 second. The processing ends with the playback time calculated in this way as a return value.
[0137]
Referring again to FIG. 7, since no error has been returned in the link generation processing in step 244, control proceeds to step 248 from step 246. In step 248, the content of the first content is reproduced.
[0138]
Referring to FIG. 14, content data of the first content at playback time 0 second is loaded from content registration unit 106 to memory unit 194, processed by input / output unit 190, and displayed on display device 174 (FIG. 14). Step 390). Note that the content data may be recorded in advance in the memory unit as a cache.
[0139]
In the repetition processing in step 392, it is determined whether or not the simultaneous display flag is turned on for the second content (step 394 in FIG. 14). Since the simultaneous display flag of the second content is off, the display of the second content is not performed. Since there is no registered content other than the first content and the second content, the control proceeds to step 400.
[0140]
In step 400, the reproduction time of the first content is updated. In this example, the video is 30 frames per second, and the display of all the first contents is completed within that time. In step 400, the reproduction time is updated with a value obtained by adding 1/30 second to the current reproduction time of 0 second, that is, 1/30.
[0141]
Next, in step 402, the link time is calculated by the link calculation program for the first content using the reproduction time (1/30 second). In this example, the link time is set to 20: 20: 1/30 seconds on September 14, 1998. Then, the processing from step 390 to step 402 is repeated until an event is input.
[0142]
In this example, as shown in FIG. 17, a link trigger is activated one minute after the reproduction and display of the content is started. Therefore, the first content is displayed on the display device for one minute.
[0143]
The data structure and values of the content before the link trigger is activated after one minute are as shown in FIG. As shown in FIG. 19, the reproduction time of the record 130A of the first content is 60.00 seconds, and the link time is 20: 21: 00.00 seconds on September 14, 1998. The record 130B of the second content is the same as the original.
[0144]
When a link trigger is applied, control proceeds to step 406 in the determination of step 404, and control proceeds to step 250 of FIG. The link time at that time (20:21:00 on September 14, 1998) is returned from step 246. Subsequently, at step 250, it is determined that this event is a link event, and control proceeds to step 252.
[0145]
In step 252, a pointer to the content next to the first content, that is, the second content is extracted from the pointer 152A of the first content.
[0146]
Subsequently, in step 244, a link is generated based on the data of the second content. The current link time is 20:21:00 on September 14, 1998. Accordingly, in this process, control proceeds from step 360 to 368 in FIG.
[0147]
The link time (20:21:00 on September 14, 1998) is the link start time (20:20:00 on September 14, 1998) and the link end time (20:25:00 on September 14, 1998). Seconds). Accordingly, control proceeds to step 370, where the reproduction time is calculated by the reproduction time calculation program based on the link time. The reproduction time in this case is 60 seconds. Control is returned to step 246 in FIG. 7 using this value as the reproduction time as a return value. The data structure and values of the content at this time are as shown in FIG.
[0148]
Referring to FIG. 20, here, the reproduction time 142B and the link time 148B of the record 130B of the second content are updated.
[0149]
Referring to FIG. 7, in step 246, since no error was returned in the link generation processing, control proceeds to step 248. In step 248, content reproduction of the second content is performed.
[0150]
Referring to FIG. 14, the content data of the second content at the reproduction time of 60 seconds is loaded from content registration section 106 to memory section 194, processed by input / output section 190, and displayed on display device 174 (step 390). . Subsequently, it is determined whether the simultaneous display flag of the first content is on (step 394). Since the simultaneous display flag of the first content is off, the first content is not displayed. Since there is no registered content other than the first content and the second content, the control proceeds from step 394 to step 400.
[0151]
In step 246, the reproduction time of the second content is updated. The video of the second content is also assumed to be 30 frames per second. Then, the reproduction time is updated to a value obtained by adding 1/30 seconds to the current reproduction time of 60 seconds, and the time is set as the reproduction time 142B shown in FIG. 20 and the like. Next, the link time is calculated by the link calculation program for the second content using the reproduction time (60 + 1/30 seconds) (step 402 in FIG. 14). In this example, the link time is set to 20: 21: 1/30 seconds on September 14, 1998. The display of the second content is repeated until an event such as a link is input.
[0152]
In this example, as shown in FIG. 17, it is assumed that a link is triggered two minutes after the reproduction and display of the second content is started. Therefore, the second content is displayed for two minutes up to that time. The data structure and values of the content before the trigger is applied are as shown in FIG.
[0153]
When a link trigger is applied, an event occurs in content reproduction, and control branches from step 404 in FIG. 14 to step 406, and further proceeds to step 250 in FIG. At step 406, the link time at that time, 20:23:00 on September 14, 1998 is returned.
[0154]
At step 250 in FIG. 7, the event proceeds to a link 252 because the event is a link. In step 252, the content next to the second content is extracted from the pointer of the content next to the second content. The content next to the second content is the first content.
[0155]
Control again proceeds to step 244 in FIG. 7, and a link is generated based on the data of the first content. The link time at this time is 20:23:00 on September 14, 1998. Accordingly, the control at this time proceeds from step 360 shown in FIG. 13 to step 368. The link time (20:23:00 on September 14, 1998) includes a link start time (20:25:00 on September 14, 1998) and a link end time (20:25:00 on September 14, 1998). Seconds). Accordingly, control proceeds from step 368 to step 370.
[0156]
In step 370, the reproduction time is calculated by the reproduction time calculation program using the link time. The reproduction time in this case is 180 seconds. With the reproduction time as a return value, the processing shown in FIG. 13 ends, and the control proceeds to step 246 in FIG. The data structure and values of the content at this time are as shown in FIG.
[0157]
The reproduction and display of the first content is performed in the same manner as the above processing. Since the playback time of the first content is 300 seconds (5 minutes), in this example, as shown in FIG. 17, the first content is played back and displayed for another 2 minutes, and the process ends. When the regeneration ends, an event of termination occurs. From FIG. 14, control proceeds to step 406, and control returns to step 250 in FIG. The data structure and value of the content at this time are as shown in FIG.
[0158]
The end event is neither a link event nor a return event. Accordingly, in FIG. 7, the control returns to step 242 via steps 250 and 252. Thus, the reproduction of the first content and the second content in this example ends. In step 242, the next playback content and its start time are set.
[0159]
Of course, the user can start a new process from the start time of FIG. 7 at any time in the process.
[0160]
As shown in this example, the user can switch and display a plurality of contents at any time. Moreover, in that case, the switching is performed such that the progress of the two different contents is synchronized. After viewing a scene with the first content, the continuation of the scene can be viewed with the second content. When viewing multiple video content shot from different angles with multiple cameras in this way, the user is watching a video and viewing a video at a camera angle suitable for the scene in real time while watching the video. Similarly, it is possible to view while switching the screen freely.
[0161]
-Operation example 2-
As a second operation example, a case in which a soccer game is to be viewed in two languages will be described. The content to be used is one video content and two audio contents related to the same soccer match. The video is a video of a soccer match. One of the audio contents is in Spanish and the other is in French. These contents are created by independent creators. For example, a case may be considered in which a video is recorded from what was broadcast in Japanese, and all audio contents are downloaded from the Internet and used.
[0162]
In this example, the user can simultaneously watch the commentary in Spanish or French while watching the video of soccer. As described below, the language is switched using a link operation and a return operation. The commentary can be switched from Spanish to French by link operation and from French to Spanish by return operation. Make sure the video is always displayed. Hereinafter, these contents will be referred to as third, fourth, and fifth contents, respectively, in order to prevent confusion with the above-described operation example 1.
[0163]
The first content is a content of a soccer match, and is a two-hour and ten-minute video medium produced at 12:50 on June 10, 2002. The link start time is set to the production date and time, 12:50 on June 10, 2002. In this example, it is assumed that the actual soccer game started at 13:00 on June 10, 2002. The fourth content is a Spanish commentary recorded based on the video content, and is a two-hour content that has been commented on at the start of a soccer game. The link start time is set to a soccer match start time, 13:00 on June 10, 2002. The fifth content, like the fourth content, is a French commentary recorded based on the video content, and is a two-hour content whose commentary has been started at the start of a soccer game. The link start time is set to a soccer match start time, 13:00 on June 10, 2002.
[0164]
FIG. 24 shows an example of reproduction of these contents by the user.
[0165]
When performing the above-described display, the user first selects and registers these contents in the content registration unit according to the processing flow of FIG. 8 (Step 240 in FIG. 7). FIG. 25 shows the data structure of these three contents at the end of registration. Although the details are not described here, it should be noted that the simultaneous display flag is on since the first content is always displayed. The simultaneous display flag of the other two contents is off. In the following description, reference numerals of respective records and items are denoted by C, D, and E, respectively (for example, “record 130C”).
[0166]
Next, the user sets the reproduction content and the link time (step 242 in FIG. 7) and starts viewing the content. In this example, since the user wants to start reproduction from the oldest registered content, it is assumed that the reproduction content and the link time are not specified. In this case, the process shown in FIG. 12 is executed in step 242, and the reproduction content is set to the third content, and the link start time is set to the link time of the third content.
[0167]
As shown in FIG. 24, since there is no audio content until 13:00 on June 10, 2002, the video is displayed silently for 10 minutes until then. After a lapse of 10 minutes, if the user presses the link button, the video of the soccer and the commentary in Spanish can be viewed simultaneously. In this case, the reproduced content is switched to the fourth content. However, since the simultaneous display flag is turned on for the third content, the third content is changed to the third content by the loop process of steps P394 to 398 of the content reproducing process of FIG. The content is displayed on the display device in synchronization with the fourth content.
[0168]
Further, in this example, it is assumed that the user switches to the commentary in French (fifth content) 20 minutes after the start of the reproduction of the third content. In this case, as shown in FIG. 24, the link button 216 is pressed at that point to view the commentary in French with the video. FIGS. 26 and 27 show the state of each content before and after the link.
[0169]
FIG. 28 shows the state of the content 30 minutes after the start of the reproduction of the third content. The user can return to the Spanish commentary by pressing the return button.
[0170]
-Operation example 3-
The device of the present embodiment is not only capable of synchronously displaying only normal contents. Content with a special time lapse can be displayed in synchronization with other normal content. For example, consider video content including a goal scene of soccer and audio content that describes the scene and is prepared independently of the video content. The commentary on the audio was made while watching the video of soccer, but it is assumed that the commentary was recorded while playing back part of the video in slow motion on the way.
[0171]
FIG. 29 shows data of each content. Hereinafter, for the purpose of avoiding confusion with other content, video content including a goal scene of soccer is referred to as sixth content, and audio content is referred to as seventh content. The seventh content is an audio-only description. These records are similar to those shown in FIG. Hereinafter, those records and items having the reference numerals shown in FIG.
[0172]
As shown in FIG. 29, for the scene from 60 seconds to 180 seconds after the start of the reproduction of the sixth content, the seventh content explains in synchronization with the slow motion video of the video at that time. I have. In other words, the seventh content describes the video of the normal content sixth content at 120 seconds, twice as long as 240 seconds.
[0173]
In the device of the present embodiment, even in such a case, it is possible to simultaneously display both the sixth content and the seventh content while synchronizing them. That is, video and audio are always reproduced in synchronization with the link time.
[0174]
FIG. 30 shows data values at the time of content registration. For the record 130F of the sixth content, the playback time calculation program stored in the playback time calculation unit 154F and the link time calculation program stored in the link time calculation unit 156F are shown in FIGS. 10 and 11, respectively. This is the default program. On the other hand, the playback time calculation program stored in the playback time calculation unit 154G of the record 130G relating to the seventh content and the link time calculation program stored in the link time calculation unit 156G are as shown in FIGS. 15 and 16, respectively. Program.
[0175]
Referring to FIG. 15, the reproduction time calculation program in this case is a program that calls the link time as an argument and returns the reproduction time. First, in step 460, it is determined whether or not this link time is before 15:21:00 on August 10, 2002. If the judgment result is YES, in step 462, the link time-link start time is set as the reproduction time, and the process ends. If the decision result is NO, the control proceeds to step 464.
[0176]
In step 464, it is determined whether or not the link time is before 15:23:00 on August 10, 2002. If the determination result is YES, the reproduction time is set to “1 minute + 2 * (link time—15: 21: 00 on August 10, 2002)” in step 466, and the process ends. If the determination result is NO, the reproduction time is set to “5 minutes + (link time−15: 23: 00 on Aug. 10, 2002)” in step 468, and the process ends.
[0177]
Referring to FIG. 16, the link time calculation program is a program that is called with the reproduction time as an argument and returns the link time. First, it is determined in step 490 whether or not the reproduction time is before one minute. If the determination result is YES, the control proceeds to step 492; otherwise, the control proceeds to step 494.
[0178]
In step 492, the link time is calculated according to a calculation formula of “link time = link start time−reproduction time”, and the process ends.
[0179]
In step 494, it is determined whether or not the reproduction time is before five minutes. If the judgment result is YES, the link time is calculated in step 496 according to a calculation formula of "link time = 15: 21: 00 seconds on August 10, 2002+ (reproduction time-1 minute) / 2", and the process ends. I do. If the decision result in the step 494 is NO, a link time is calculated in a step 498 according to a formula of “link time = 15: 23: 00 seconds on August 10, 2002+ (reproduction time−5 minutes)”. Then, the process ends.
[0180]
This is because if the reproduction time of the sixth content is equal to the link time, the slow motion commentary section of the seventh content is displayed in synchronization with the corresponding video. Here, the link time is used for synchronization between the two. As described below, in this example, the explanation of the seventh content is that a video of 2 minutes (reproduction time of the sixth content) is described in 4 minutes (reproduction time of the seventh content).
[0181]
In this example, first, it is assumed that the user particularly wants to listen to the soccer commentary of the seventh content. The user selects the seventh content as the reproduction content. As shown in FIG. 29, the sixth content and the seventh content start at the same time because the link start time is the same, and the sixth content is reproduced simultaneously while being synchronized with the reproduction speed of the seventh content. At this time, video playback and audio playback are performed at normal speed until 60 seconds later, but after 60 seconds, video is played back in slow motion and audio is played back at normal speed. This is because the main playback content here is the seventh content, and the playback speed of the sixth content is adjusted so that its link time is equal to the link time of the seventh content.
[0182]
The data values after 60 seconds are shown in FIG. FIG. 32 shows the data values 120 seconds after the description of the slow motion is started (180 seconds after the total reproduction). The link time at this time is 15:22:00 on August 10, 20002. The description of the slow motion lasts for 4 minutes, which corresponds to 2 minutes of the video of the sixth content (see FIG. 29). When the explanation of the slow motion is over, the seventh content is explained again in synchronization with the normal speed of the video. FIG. 33 shows data values at the end of the slow motion.
[0183]
As described above, according to the present invention, by synchronizing a plurality of contents as a correspondence between a link time and a reproduction time using a program as shown in FIG. 15 and FIG. It is also possible to control while continuously changing the link.
[0184]
-Operation example 4-
As described above, the content also includes still image data such as a photograph. For example, it is possible to simultaneously display a photograph and a video taken by oneself at the link time at the same time. It is possible to simultaneously watch a photograph taken by oneself in a baseball game and a recorded video of a baseball broadcast at an appropriate timing. In this case, the simultaneous display flag of the photo content is turned on, and the video is reproduced. Then, the pictures are displayed one after another in synchronization with the link time according to the video reproduction. In this case, the display time of each photo is set as the reproduction time of each photo.
[0185]
In the case of a photograph, the photographing date and time can be set as the link start time. In a digital camera or the like, the shooting date and time are often automatically added to data, but there are cases where such data is not added. Thus, in the apparatus of the present embodiment, the user can manually input the reproduction time using the character buttons 228 of the remote control input device 210 shown in FIG. 6 (Step 302 in FIG. 9).
[0186]
-Operation example 5-
Using the jog dial 218 of the remote control input device 210 or the like, it is possible to reproduce the reproduction time in the reverse direction. In the reproduction time update (step 400 in FIG. 14) of the content reproduction process (FIG. 14), if the reproduction time is decreased instead of being increased, the content is reproduced in the reverse direction. Accordingly, the link time is also calculated, so that the registered contents are synchronized by the link time.
[0187]
-Operation example 6-
Normally, the user uses this apparatus to switch and reproduce a plurality of contents in synchronization by a link operation, a return operation, or the like. In this apparatus, the history of the link operation and the return operation is stored by using the operation storage / reproduction unit 112 shown in FIG. 3, and the operation is reproduced later to repeat the same operation as the first reproduction operation. It is possible.
[0188]
That is, by setting the recording / playback signal 116 on the recording side, an event such as a link operation or a return operation is given to each unit in FIG. 3 via the user interface unit 100. When the recording / reproducing signal is a recording-side value, the operation storage / reproducing unit 112 sequentially stores pairs of these events and the link time at which the event occurred.
[0189]
When the recording / playback signal 116 has a value indicating playback, the selector 118 gives an event from the operation storage / playback unit 112 to a predetermined destination. Thus, the pair of the event and the link time stored in the operation storage / playback unit 112 can be used as a series of playback macro programs. Also, by using this history, it is possible to play back the content in the opposite direction from the first recording. At this time, the reproduction is performed in the reverse direction including the link operation and the return operation.
[0190]
For example, two contents (for example, an eighth content and a ninth content) are registered, and during reproduction of the eighth content, the user presses a link button 10 minutes after the reproduction is started, and the ninth content is reproduced according to the link time. Is reproduced for 5 minutes. Using the history, the user can play back the eighth content and the ninth content in the same manner as when recording. Since the operation of the link button or the like during reproduction is reproduced from the history, the same reproduction can be automatically performed without requiring such operation.
[0191]
It is easily understood that the event can be automatically reproduced in the reverse direction by generating the event by tracing the history in reverse. In this case, the ninth content is reproduced for 5 minutes in the reverse direction from the end of the display of the ninth content, and the eighth content is reproduced in the reverse direction for 10 minutes using the link time.
[0192]
The above-described series of operations can be performed by using the jog dial 218 of the remote control input device 210 shown in FIG. In this case, the update of the reproduction time may be manually input from the input device. Therefore, the reproduction is performed in the same order, but the reproduction time may not always be equal.
[0193]
The embodiment disclosed this time is merely an example, and the present invention is not limited to the above-described embodiment. The scope of the present invention is indicated by each claim of the claims after considering the description of the detailed description of the invention, and all changes within the meaning and range equivalent to the wording described therein are described. Including.
[0194]
【The invention's effect】
As described above, according to the present invention, a link between a plurality of contents is generated using a common time axis, and a location of one content can be associated with a corresponding location of another content using the link. By using this link, a plurality of contents can be reproduced in synchronization with each other. In addition, it is possible to realize a reproduction in which a plurality of contents are switched with each other and the reproduced contents are temporally continuous.
[Brief description of the drawings]
FIG. 1 is a diagram for explaining a concept of link time adopted in an apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram for explaining the concept of link time.
FIG. 3 is a functional block diagram of an apparatus according to an embodiment of the present invention.
FIG. 4 is a diagram showing a configuration of a content record.
FIG. 5 is a hardware configuration diagram of an apparatus according to an embodiment of the present invention.
FIG. 6 is a block diagram of a remote control input device of the device according to the embodiment of the present invention.
FIG. 7 is a flowchart illustrating an overall control structure of software when the device according to the embodiment of the present invention is implemented by a computer.
FIG. 8 is a flowchart of content selection and registration processing.
FIG. 9 is a flowchart of a process for registering content in a content registration unit.
FIG. 10 is a flowchart of a default reproduction time calculation program.
FIG. 11 is a flowchart of a default link time calculation program.
FIG. 12 is a flowchart of a process of selecting a content having the earliest start link time as a playback content.
FIG. 13 is a flowchart of a link generation process.
FIG. 14 is a flowchart of a content reproduction process.
FIG. 15 is a flowchart of another example of a reproduction time calculation program.
FIG. 16 is a flowchart of another example of the link time calculation program.
FIG. 17 is a diagram showing an example of content reproduction in a first operation example.
FIG. 18 is a diagram showing a configuration of a content record in the first operation example.
FIG. 19 is a diagram showing a configuration of a content record in the first operation example.
FIG. 20 is a diagram showing a configuration of a content record in the first operation example.
FIG. 21 is a diagram showing a configuration of a content record in the first operation example.
FIG. 22 is a diagram showing a configuration of a content record in the first operation example.
FIG. 23 is a diagram showing a configuration of a content record in the first operation example.
FIG. 24 is a diagram illustrating an example of content reproduction in a second operation example.
FIG. 25 is a diagram showing a configuration of a content record in a second operation example.
FIG. 26 is a diagram showing a configuration of a content record in a second operation example.
FIG. 27 is a diagram showing a configuration of a content record in a second operation example.
FIG. 28 is a diagram showing a configuration of a content record in a second operation example.
FIG. 29 is a diagram illustrating an example of content reproduction in a third operation example.
FIG. 30 is a diagram showing a configuration of a content record in a third operation example.
FIG. 31 is a diagram showing a configuration of a content record in a third operation example.
FIG. 32 is a diagram showing a configuration of a content record in a third operation example.
FIG. 33 is a diagram showing a configuration of a content record in a third operation example.
[Explanation of symbols]
90 content playback device, 100 user interface unit, 102 content selection unit, 104 content database, 106 content registration unit, 108 link definition unit, 110 content playback unit, 112 operation storage / playback unit, 114 link generation unit, 116 recording / playback Signal, 118 selector, 170 content storage device, 172 input device, 174 display device, 176 control device, 190 input / output unit, 192 arithmetic unit, 194 memory unit, 196 secondary storage device, 198 bus 198, 210 remote control input device, 212 selection button, 214 registration button, 216 link button, 220 return button, 222 simultaneous display button, 224 home button 224

Claims (26)

Link generation means for generating a link between the plurality of contents, using a common time axis commonly defined for a plurality of contents;
A content reproducing apparatus, comprising: reproducing means for reproducing the plurality of contents by using a link generated between the plurality of contents. The content reproduction device according to claim 1, wherein the link generation unit includes a unit for dynamically determining a link between the plurality of contents using the common time axis. 2. The content reproducing apparatus according to claim 1, wherein the reproducing unit includes a unit configured to reproduce the plurality of contents in time synchronization between the contents using a link generated using the common time axis. 3. . The content reproduction device according to claim 1, wherein the common time axis is a time axis defined by a predetermined absolute time. In each of the plurality of contents, apart from the common time axis, a playback time axis for playback is further defined,
The reproducing means,
First content reproducing means for reproducing a selected one of the plurality of contents according to a reproduction time axis defined in relation to the selected one content;
Of the plurality of contents, a portion different from the selected one content and linked to a portion to be reproduced by the first content reproducing unit is reproduced in association with reproduction of the first content. The content reproducing apparatus according to claim 4, further comprising: a second content reproducing unit for performing the operation. For each of the plurality of contents, a relationship between the playback time axis and the common time axis is defined,
The link generation unit uses a relationship between the reproduction time axis of each of the plurality of contents and the common time axis to determine a point on the reproduction time axis of the first content and a point of the second content. The content reproducing apparatus according to claim 5, further comprising means for generating a link to a point on the reproduction axis. The content reproduction device according to claim 6, wherein a relationship between the common time axis and the reproduction time axis can be independently defined for each of the plurality of contents. The second content playback unit includes a unit for playing back a portion of the other content linked to a playback location of the first content playback unit in parallel with the playback of the first content. The content reproducing apparatus according to claim 5, wherein The first content playback unit selects a content having a first time as a time on the common time axis from among the plurality of contents, and determines a playback time axis defined in relation to the selected content. The content reproducing apparatus according to claim 5, further comprising means for reproducing according to the following. The content reproduction device according to claim 5, wherein the reproduction means further includes a selection means for selecting, from the plurality of contents, a content to be reproduced by the first content reproduction means. The content reproduction device according to claim 10, further comprising a content registration unit for registering the plurality of contents. 12. The content reproduction device according to claim 11, wherein the selection unit includes a unit for selecting an arbitrary content from the plurality of contents registered by the content registration unit. 6. The apparatus according to claim 5, further comprising: means for selecting the other content as an object to be reproduced by the first content reproducing means in place of the selected content in response to a predetermined content switching signal. Content playback device. 14. The content reproducing apparatus according to claim 13, further comprising: means for controlling said second content reproducing means to reproduce said selected one content in response to said content switching signal. 14. The content reproduction device according to claim 13, further comprising: means for generating the content switching signal. The content registration unit includes a unit for registering the plurality of contents in a predetermined order,
The selecting means,
Means for generating a predetermined content switching signal in response to a user operation;
12. The content registration device according to claim 11, further comprising a unit for selecting a content registered next to the selected content in the content registration unit in place of the selected content in response to the content switching signal. The content reproducing apparatus according to any one of the preceding claims. The selecting means further includes:
Means for generating a predetermined return signal in response to a user's operation; and in response to the return signal, the content registration means replaces the selected content with 17. The content reproducing apparatus according to claim 16, further comprising means for selecting previously registered content. The content reproduction device according to claim 17, wherein the reproduction time of the previous content is calculated based on the link from a reproduction time of the selected content at the time when the return signal is generated. The content reproducing apparatus according to claim 5, further comprising: means for setting the reproduction time axis for the content. The content reproducing apparatus according to claim 1, further comprising: means for setting the common time axis for the content. The playback means further includes means for indicating a direction of playback,
6. The content according to claim 5, wherein the first content playback means includes means for playing along the playback direction along a playback time axis defined in association with the selected one content. Playback device. Further comprising an operation signal generating means for generating a predetermined operation signal,
In response to the operation signal, the playback means includes means for switching and playing back the plurality of contents according to the link,
The content reproduction device further records an operation signal generated by the operation signal generation unit and a time point on the common time axis of the content being reproduced by the reproduction unit when the operation signal is generated. Means for
In response to a predetermined operation reproduction signal, an operation signal recorded in the recording means is generated at a time point on the common time axis when each of the operation signals is generated, and given to the reproduction means. Operation signal reproducing means for
2. The content reproducing apparatus according to claim 1, wherein the reproducing means reproduces the reproduction of the content according to the operation of the operator. The operation signal reproducing means follows the common time axis in a direction opposite to the recording by the recording means, and generates an operation signal at a time corresponding to each operation signal on the common time axis. 23. The content reproducing apparatus according to claim 22, further comprising means for providing to the reproducing means, whereby the reproduction of the content according to the operation of the operator is reproduced by the reproducing means in a temporally reverse order. 2. The content reproducing apparatus according to claim 1, further comprising means for designating an arbitrary point of the content being reproduced as a reproduction point by said reproducing means. A computer program which, when executed by a computer, causes the computer to operate as the content reproduction device according to any one of claims 1 to 24. A computer-readable recording medium on which the computer program according to claim 25 is recorded.

Images