JP4378295B2 - Image reproducing apparatus and image reproducing method - Google Patents

Description

  The present invention relates to an image reproduction device and an information display device, and more particularly to an image reproduction device and an information display device that display auxiliary information related to image data together with image data.

  As in the case of a telop displayed in television broadcasting, it has been conventionally performed to combine captions with video and display them in one screen. These display the subtitles corresponding to the video in real time, but when such a composite video is recorded and played back, the playback speed of the subtitles increases as the playback speed increases, making it difficult to read the characters. There was a problem that.

  In order to solve such a problem, an apparatus that prevents the display time per character from being shortened by changing the amount of subtitles displayed on one screen according to the playback speed has been proposed (Patent Document 1). reference). This is a video playback device that displays video and subtitles at the same time. For example, when normal playback, one subtitle per predetermined time is displayed, and quadruple speed playback displays four subtitles within a predetermined time. It is. In this way, when the playback speed is increased, such as quadruple speed, by increasing the amount of subtitles displayed on one screen, the subtitle display time is set to be the same as during normal playback, so that subtitles can be displayed even during high-speed playback. The display time is prevented from being shortened.

In addition, an information display method that partially enlarges and displays subtitles during high-speed playback has been proposed (see Patent Document 2). This makes it easy to check the contents of characters by displaying the subtitles in an enlarged manner when the playback speed is increased.
JP 2002-033993 A JP 2000-180887 A

  However, in the invention described in Patent Document 1, the display time for individual subtitles can be maintained at the same time as normal playback even during high-speed playback, but the amount of subtitles displayed per unit time also increases. In addition, it becomes difficult to read all subtitles as the playback speed increases. Also, as the playback speed increases, more subtitles are displayed. As a result, the range in which the video is displayed is narrowed and the visibility of the video information is deteriorated.

  In the method described in Patent Document 2, characters are enlarged and displayed when the reproduction speed is increased. However, since the character display time does not change, the subtitle display time is extremely short during high-speed reproduction, and the visibility is maintained. It is difficult.

  The present invention has been made in view of such a situation, and an object thereof is to provide an image reproducing apparatus and an information reproducing apparatus capable of maintaining the visibility of auxiliary information such as subtitles during high-speed video reproduction. .

In order to solve the above-described problem, an image reproducing apparatus according to the present invention has image data and a hierarchical structure having two or more hierarchies. Corresponding subtitle data, and a reproducing means for reproducing the image data and reproducing any one of the subtitle data corresponding to the image data being reproduced. However, according to the playback speed of the image data, the higher the playback speed, the higher the hierarchy of the caption data is played back .

  Other features of the present invention will become more apparent from the accompanying drawings and the following description of the best mode for carrying out the invention.

  With the above configuration, according to the image reproduction apparatus and the information reproduction apparatus of the present invention, it is possible to maintain the visibility of auxiliary information such as subtitles during high-speed video reproduction.

  Preferred embodiments of the present invention will be described below with reference to the accompanying drawings.

<First Embodiment>
In the first embodiment of the present invention, a digital video camera 1000 will be described as an example of an image playback device.

  FIG. 1 is a block diagram showing the configuration of the digital video camera 1000.

  The digital video camera 1000 includes an image capturing unit 1100, and the image capturing unit 1100 includes an optical system 1001 including a lens and the like, an image sensor 1002 such as a CCD, and an image processing circuit 1003.

  The digital video camera 1000 also includes a CPU 1004 that controls the operation of the entire digital video camera 1000 by executing a control program, a memory 1005 that temporarily stores captured images and auxiliary information that is recorded with the captured images, a personal computer, and the like. An external interface 1006 connected to the external device, a display device 1007 such as a liquid crystal display, an operation unit 1008, an interface 1009, a storage medium 1010, a GPS antenna 1011, a timer 1012, and a system bus 1013.

  The auxiliary information in the present specification may be any information as long as it is information associated with the image. Specifically, it may be information about the shooting location, text, voice, etc., including information such as camera parameters (shutter speed, aperture, shooting mode, flash on / off, etc.) and date / time information at the time of shooting. Therefore, the information is not necessarily limited to information recorded at the time of shooting. In this embodiment, a digital video camera having a function of recording information related to a shooting position as auxiliary information in addition to information recorded in a general digital video camera such as a time code will be described.

  When an image of the subject enters through the optical system 1001, image data is generated by the image sensor 1002. The generated image data is input to the image processing circuit 1003 and subjected to predetermined image processing (for example, MPEG compression). The image processing circuit 1003 includes a camera signal processing unit, an image compression / decompression unit, and the like. The CPU 1004 performs processing for inputting image data and attached information to the display device 1007, and the display device 1007 displays them. The storage medium 1010 is detachably provided in the digital video camera 1000 (may be built in), and is a medium such as a disk for recording using light or magnetism, a memory card using a flash memory, or the like. Further, data such as an image is read from and written to the storage medium 1010 via the interface 1009. If information necessary for recording auxiliary information such as place name information is recorded in advance in the storage medium, the information is read from the storage medium and used. The operation unit 1008 is used by a user to give an instruction to the digital video camera 1000. By giving an instruction from the operation unit 1008, the user can use various functions of the digital video camera 1000 such as recording start. it can. The GPS antenna 1011 receives and analyzes radio waves from GPS satellites and acquires data on its own location.

  When a predetermined recording start operation is performed on the operation unit 1008 of the digital video camera 1000, captured image data of the subject is generated by the imaging unit 1100 and stored in the memory 1005. When a recording start operation is performed, the GPS antenna 1011 receives radio waves from the satellite, and current position (ie, shooting position) information is taken into the memory 1005. The CPU 1004 converts the shooting position information into the place name information, for example, using data that associates the shooting position (latitude / longitude) and the place name stored in advance in the storage medium 1010. Next, the captured image data and place name information are associated with each other and stored in the storage medium 1010 via the interface 1009. The place name information is text information of the place name, and is hierarchical information such as “region”-“prefecture”-“city, ward”-“town”. Although the place name information has been described as being stored in the storage medium 1010 in advance, the place name information acquisition method is not limited to this. For example, the place name information is acquired from outside the digital video camera 1000 via the external interface 1006. It doesn't matter if you do.

  FIG. 2 is a diagram showing the correspondence between the image data recorded in the storage medium 1010 and the place name data. Each image data in the image data group 2000 indicates one cut of shooting in the case of a moving image and one still image in the case of a still image. Reference numerals 2001 to 2004 denote place name data of each layer associated with each image data. For example, the image data (1) in FIG. 2 indicates that it is associated with the hierarchical place name data of “Kanto district”-“Tokyo”-“Ota-ku”-“A town”. Different image data may be associated with the same place name data, such as image data (5) and image data (6). Further, it may be associated with a plurality of place name data (in this case, “I town”, “J town”) as in the image data (10). This is a case where the place name data corresponding to the shooting position changes in one cut due to movement of the shooting position during shooting.

  Next, a case where the captured image data and corresponding place name data are reproduced will be described. When a reproduction instruction is given by the operation unit 1008, the CPU 1004 acquires image data to be reproduced and corresponding place name data from the storage medium 1010.

  Here, a case will be described in which all the image data recorded in the storage medium 1010 (image data (1) to image data (13) in FIG. 2) are reproduced in order. For example, when the reproduction of the image data (7) is started, the information “Kanto region”-“Tokyo”-“Shinagawa-ku”-“F town”, which is the place name data corresponding to the image data, is stored from the storage medium 1010. get. Further, the place name data corresponding to the image data reproduced before and after the image data (7) is acquired in the same manner. In addition, the place name data corresponding to the image data reproduced before and after is acquired as much as necessary for displaying the place name data described later.

  Next, the CPU 1004 mainly determines the hierarchy of the place name data to be displayed based on the reproduction speed of the image data. In other words, it decides which hierarchy is to be displayed as the center from among the "region"-"prefecture"-"city / ward"-"town" hierarchy. Hereinafter, the hierarchy of auxiliary information to be displayed (in this embodiment, the hierarchy of place name data) is expressed as a “display hierarchy”.

  FIG. 3 is a graph showing the relationship between the playback speed and the display hierarchy of place names. In FIG. 3, the vertical axis represents the display hierarchy of place names, with L1 corresponding to the “town” hierarchy, L2 corresponding to the “city / district” hierarchy, and L3 corresponding to the “prefecture” hierarchy. The horizontal axis indicates the reproduction speed (magnification). “× 1” is a normal speed (ie, normal) playback speed.

  As shown in FIG. 3, in this embodiment, when the reproduction speed magnification is slower than a predetermined threshold value a1 (here, a1> 1), the display hierarchy is L1. In the present embodiment, the display hierarchy is expressed by the hierarchy of the most detailed (lowest) place name data to be displayed. However, not only the hierarchy is displayed but also the hierarchy higher than the display hierarchy is displayed. For example, when the display layer is L1, place name data of the layer of L1 and its upper layers L2 and L3 are displayed. A specific display form will be described later.

  Next, when the reproduction speed is a1 or higher, the display hierarchy is L2, and the place name data of the L2 and L3 hierarchy is displayed. Furthermore, when the playback speed is a2 (> a1) or higher, the display hierarchy is switched to L3.

  In the present embodiment, the hierarchy higher than the display hierarchy is also displayed. However, as long as the place name data of the display hierarchy is mainly displayed, other methods such as displaying only the display hierarchy may be used.

  The CPU 1004 combines the place name data determined as described above with the associated image data and displays it on the display device 1007. FIG. 4 shows an example of this display state. FIG. 4A shows a display image at a normal reproduction speed, and FIG. 4B shows a display image when high-speed reproduction is performed at a speed corresponding to a1 in FIG. There is a place name data display frame 4001 on the right side of the image display screen 4000, and 4002 to 4005 therein indicate place name data displayed during normal reproduction. Reference numerals 4006 to 4009 denote place name data displayed during high-speed playback.

  When the playback is performed at the normal playback speed (equal speed), the playback speed is less than a1, so the display hierarchy is L1 from the characteristics of the graph of FIG. That is, as shown in FIG. 4A, place name data in the L1, L2, and L3 levels are displayed in the place name data display frame 4001. The displayed place name data is arranged in the order of reproduction of the image data, and here, since reproduction is performed in the order shown in FIG. 2, the “F town” corresponding to the currently reproduced image data (7) is the center. “E town” corresponding to the image data (6) reproduced before is displayed above, and “G town” corresponding to the image data (8) scheduled to be reproduced next is displayed below. Further, the place name data (here, “F town”) corresponding to the image data being reproduced is highlighted by a method such as being surrounded by a thick frame. As shown in FIG. 2, “E town”, “F town”, and “G town” in the L1 hierarchy are the same as the Shinagawa ward in the L2 hierarchy, but the place name data in the L2 hierarchy is changed to “ As in “Shinagawa Ward” and “Minato Ward”, the L2 hierarchy place name data is displayed. Although not shown in the drawing, similarly, the L3 hierarchy place name data is displayed at the break where the L3 hierarchy place name data changes. As described above, the place name data is successively switched while the place name data corresponding to the image data being reproduced is highlighted.

  For example, if there are many image data belonging to “Shinagawa Ward”, if the display of “Shinagawa Ward” is no longer displayed in the place name data display frame 4001, the current place name exists in which ward. There is a problem that it becomes difficult to understand. Therefore, for example, while the image data relating to “Shinagawa Ward” is being displayed, the display of “Shinagawa Ward” may not be scrolled, and may always be displayed at the top of the place name data display frame 4001.

  Next, when the playback speed is switched to a1 in accordance with an instruction from the operation unit 1008, the display hierarchy is switched to L2 based on the characteristics of the graph of FIG. That is, as shown in FIG. 4B, the place name data display frame 4001 displays place name data of the L2 and L3 layers. In this case as well, the displayed place name data are arranged in the order of reproduction of the image data, indicating that they are reproduced in the order of “Ota Ward”, “Shinagawa Ward”, and “Minato Ward”. In addition, the place name data (here “Shinagawa Ward”) corresponding to the image data being reproduced is highlighted. Further, the place name data in the L3 hierarchy is displayed at the breaks where the place name data in the L3 hierarchy changes, such as “Tokyo” and “Kanagawa Prefecture”.

  The reason why the hierarchy to be displayed is mainly switched according to the reproduction speed is that, when the reproduction speed is increased, the place name data in the lower hierarchy is changed quickly, the display time is shortened, and the visibility of the place name data is deteriorated. In the present embodiment, when the display speed is increased, the display hierarchy is switched to the upper level, so that the speed at which the place name data is switched can be reduced and the visibility can be maintained.

  Next, a method for determining a playback speed threshold value (here, a1, a2) for switching the display hierarchy of place name data will be described with reference to FIG. FIG. 5 is a graph showing the relationship between the determined playback speed (magnification) threshold and the place name change amount (number of switching times) per unit time. The place name change amount per unit time indicates the speed of change of the place name data during reproduction. Here, it should be noted that the speed of change of the place name data is not constant even when the playback speed is the same. For example, if recording is performed for a long time in the same district (for example, F town), the place name data displayed during that time remains F town, and the change in the place name data per unit time becomes small. On the other hand, if a plurality of districts are moved in a short time, the change in the place name data per unit time becomes large. The CPU 1004 determines the playback speed threshold in consideration of the above points. That is, the threshold value is determined so that the display hierarchy is increased at a lower reproduction magnification as the place name change amount per unit recording time is larger. When a plurality of threshold values are used as shown in FIG. 3, the difference between the threshold values is set smaller as the place name change amount per unit recording time is larger. Further, the relationship between the place name change amount per unit time and the reproduction speed threshold shown in FIG. 5 is stored in advance as a table. When new image data is recorded on the recording medium 1010, a place name change amount per unit recording time in the image data recorded on the storage medium 1010 is calculated. With reference to the place name change amount of all the image data recorded on the recording medium 1010 and collating with the table, the threshold value of the reproduction speed is determined.

  Further, instead of changing the display hierarchy using the playback speed as a threshold value, for example, the place name change amount is detected during playback, and if it is larger than the threshold value (t1), the display hierarchy is raised, and the threshold value (t2: t2 <t1) It is also possible to perform display control based on a place name change amount threshold value, such as lowering the display hierarchy when the place name change amount is smaller than that.

  As a result, when moving between a plurality of districts in a short time, the display hierarchy is set at a higher level even with relatively low speed reproduction, and the visibility of the place name data can be maintained.

  In the present embodiment, it has been described that L1 is always the display layer during normal playback, in other words, a1 is not slower than the normal playback speed. Actually, when moving between districts very frequently, for example, when shooting from a high-speed moving body such as an airplane or a bullet train, a1 is higher than the normal playback speed according to the graph of FIG. It can also be slow (a1 <1). Therefore, the display hierarchy at the time of normal reproduction is not limited to L1, and when the place name change amount per unit time is large, the display hierarchy may be L2 or more.

  FIG. 6 is a graph showing temporal changes in the display hierarchy when the playback speed is changed. The horizontal axis of the graph indicates time, and the vertical axis indicates the display hierarchy. If the playback speed is changed from the normal playback speed to the playback speed of a2 at time t1, the display hierarchy changes from L1 to L2 to L3 according to the characteristics of the graph of FIG. 3, but it does not immediately change to the L3 hierarchy. In this embodiment, a time constant is provided, and a predetermined time L2 hierarchy is set as the display hierarchy, and then changed to the L3 hierarchy. Also, when the playback speed is changed from a2 to the normal playback speed at time t2, the predetermined time L2 layer is set as the display layer and then changed to the L1 layer according to the time constant.

  In this way, even when the playback speed changes greatly, the display hierarchy is switched in stages, thereby preventing the display of the place name data from changing suddenly and improving the visibility.

  In the present embodiment, the place name data has three hierarchies. However, the number of hierarchies is not limited to this. For example, in FIG. 2, when there is image data taken in “region” other than “Kanto region”, the “region” layer is controlled as the L4 layer. On the other hand, when all the image data recorded in the storage medium 1010 is included in the L3 hierarchy (for example, “Tokyo”), the highest hierarchy may be controlled as L2. Further, a more detailed L0 hierarchy “building name, intersection name” and the like may be provided as a lower hierarchy than the L1 hierarchy “town”. The same applies to the case where a part of data is reproduced instead of the entire storage medium 1010.

  Moreover, you may display the information regarding the whole hierarchy and the present display hierarchy collectively. FIG. 7A shows an example of the display at this time. The entire hierarchy display frame 7001 displays all the hierarchies that can be displayed (here, “region”, “prefecture”, “ward”, “town”), and the current display hierarchy is indicated by shading, for example. Highlighted.

  Further, when paused (that is, when the playback speed is zero), the L1 hierarchy may be used as the display hierarchy according to the graph of FIG. 3, or a more detailed lower hierarchy may be prepared for pause and used as the display hierarchy. Alternatively, as shown in FIG. 7 (b), place name data of all layers may be combined with video data and displayed. The place name data at the pause position is highlighted by, for example, reversing black and white.

  These place name data displays can be switched between display / non-display by operating the operation unit 1008. Further, the place name data may not be displayed in the case of the normal reproduction speed, and the place name data may be displayed when the reproduction speed exceeds a predetermined value.

  Further, the place name data may be recorded directly in the header of the image data or the like, or may be recorded separately and the correspondence with the image data may be recorded.

  In the present embodiment, the place name data corresponding to the shooting position is displayed. However, the auxiliary information to be displayed is not limited to the place name data. For example, the auxiliary information related to the shooting position is a map image. It does not matter.

  As described above, according to this embodiment, the digital video camera 1000 acquires place name data together with image data at the time of shooting, and displays the place name data on the display device 1007 as auxiliary information at the time of reproduction. The place name data to be displayed determines which hierarchy (for example, the prefecture level or the municipality level) is mainly displayed according to the reproduction speed.

  This makes it possible to know detailed place names as auxiliary information during normal playback, while lowering the speed at which place name data is switched by raising the display hierarchy even during high-speed playback, thereby improving the visibility of auxiliary information. It becomes possible to keep.

<Second Embodiment>
In the first embodiment, a case where information relating to a shooting point such as place name data is displayed as auxiliary information has been described. In the second embodiment, a case where caption information is combined with image data and displayed is described. In the present embodiment, the configuration of the digital video camera 1000 (FIG. 1), the display hierarchy determination method during playback (FIG. 3), and the playback speed threshold determination method for switching the display hierarchy (FIG. 5, where the horizontal axis Is read as “amount of change in subtitles per unit time”), temporal changes in the display layer when the playback speed is changed (FIG. 6), the display layer is not limited to three layers, Since the six points of the recording location may be the same as those in the first embodiment, detailed description thereof is omitted.

  In the first embodiment, the position information is acquired by the GPS antenna 1011 simultaneously with the recording of the image data, and the corresponding place name data is recorded. However, in this embodiment, after the image data is recorded, the user creates and records the caption data. . The subtitle data may be configured to be input from the operation unit 1008 or may be configured to be input from an external device connected to the external interface 1006. The subtitle data may be anything such as data describing the subject or text using conversation. Subtitle data is created according to a plurality of playback speeds, such as subtitles for normal playback, subtitles for medium speed playback, and subtitles for high speed playback, and managed hierarchically in association with image data. FIG. 8 shows the hierarchical structure of the caption data. Corresponding to each image data of the image data group 2000, subtitle data of each layer is recorded. Here, the L1 layer is caption data at the normal playback speed. The L2 layer is subtitle data for medium-speed playback, and for example subtitle data summarized from the L1 layer is recorded. The L3 layer is subtitle data for high-speed playback, and subtitle data further summarized than the L2 layer is recorded.

  In the first embodiment, in addition to the display hierarchy, place name data in the upper hierarchy is also displayed, but in this embodiment, only subtitles in the display hierarchy are displayed at a predetermined timing. FIG. 9 is a diagram illustrating a subtitle display during image reproduction. Subtitle A is the contents of all subtitles displayed during normal playback, and subtitles corresponding to the display hierarchy are displayed in a subtitle data display frame 9001 in the image display screen 4000.

  When the playback is performed at the normal playback speed (same speed), the playback speed is less than a1, so the display hierarchy is L1 from the characteristics of the graph of FIG. Therefore, the subtitle data of the L1 layer is displayed on the display device 1007. The state of the image displayed at this time is shown in FIG. The subtitles displayed here are all the subtitle data in the L1 layer and the portion that can be displayed in one line in subtitle A. That is, the subtitle data is displayed in the subtitle data display frame 9001 while switching one line at a time in the subtitle A at a predetermined timing.

  When the reproduction speed is a2 or higher, the display layer is L2 from the characteristics of the graph of FIG. 3, and the subtitle data of the L2 layer is displayed. The state of the image displayed at this time is shown in FIG. As described above, the subtitle data in the L3 layer is a summary of the subtitle data in the L1 layer, and here, the subtitle A is summarized in one line. For this reason, while the image data is being reproduced, the subtitles are displayed without being switched, and the visibility of the subtitles can be maintained even during high-speed reproduction.

  In this embodiment, the user inputs subtitles of all layers. However, the CPU 1004 summarizes subtitles input by the user using a predetermined algorithm to generate subtitle data of each layer. Also good.

  In this embodiment, subtitle data is used as an example of auxiliary information that is combined with image data and displayed. However, the subtitle data is not limited to subtitle data as long as it can be summarized, and may be audio data, for example. In the case of audio data, it is not displayed on the display device 1007 but is notified using a speaker (not shown).

  As described above, according to the present embodiment, the digital video camera 1000 holds the caption data associated with the captured image data, and displays the caption data as auxiliary information on the display device 1007 during reproduction. The subtitle data to be displayed is determined according to the playback speed, whether it is displayed in the preamble or how much it is summarized.

  As a result, detailed subtitles can be read as auxiliary information during normal playback, while subtitle data switching speed is slowed down by making the display hierarchy higher-level summary display even during high-speed playback. Visibility can be maintained.

<Third Embodiment>
In the third embodiment, a case where auxiliary information displayed together with image data is a file name or a directory name will be described. In the present embodiment, the configuration of the digital video camera 1000 (FIG. 1), the display hierarchy determination method during playback (FIG. 3), and the playback speed threshold determination method for switching the display hierarchy (FIG. 5, where the horizontal axis Is read as “amount of change in directory name and file name per unit time”), temporal change of display hierarchy when the playback speed is changed (FIG. 6), display hierarchy is not limited to 3 hierarchy Since these five points may be the same as those in the first embodiment, detailed description thereof will be omitted.

  When recording photographed image data, the CPU 1004 gives a file name based on a predetermined rule. Then, the information is recorded in the storage medium 1010 according to the directory structure created based on the shooting location and date. In this embodiment, a case where a date based on information of the timer 1012 is used will be described as an example.

  FIG. 10 is a diagram showing a hierarchical structure of files and directories recorded in the storage medium 1010. 10001 is a root directory, 10002 is a directory hierarchy based on “month”, 10003 is a directory hierarchy based on “date”, and each image data in the image data group 2000 is recorded under the directory hierarchy. Yes.

  For example, a case where the first image data is taken on October 9 will be described. Since it is the first image data, the file name is, for example, “image data 1.mpg” (“mpg” means an image in MPEG format). Next, information on the shooting date of “October” and “October 9” is acquired from the timer 1012, and the file name “image data 1.mpg” is stored in the “October 9” directory in the “October” directory. Record. If the corresponding directory does not exist, a new directory is created and recorded. When the shooting date spans two or more days, the recording destination directory is determined by an arbitrary method, for example, based on the shooting start date or the shooting end date.

  Next, a case where image data is reproduced will be described. When an instruction to start reproduction is given by the operation unit 1008, the CPU 1004 acquires the file name of the image data to be reproduced and the recorded directory name.

  The CPU 1004 determines the display hierarchy according to the characteristics of the graph of FIG. Here, the L1 hierarchy is a file name hierarchy, the L2 hierarchy is a directory name (date) hierarchy, and the L3 hierarchy is a directory name (month) hierarchy. In the present embodiment, as in the first embodiment, information on the hierarchy above the display hierarchy is also displayed.

  That is, when the playback speed is less than a1, the file name that is the L1 hierarchy is mainly displayed, and the directory name of the L2 hierarchy or the L3 hierarchy is displayed at the change of date or month. When the playback speed is greater than or equal to a1 and less than a2, the directory name of “date” which is the L2 hierarchy is mainly displayed, and the directory name of the L3 hierarchy is displayed at the change of the month. When the playback speed is a2 or higher, the directory name of “Month” which is the L3 hierarchy is mainly displayed.

  FIG. 11 is a diagram showing an example of display during image reproduction in the present embodiment. Since the information to be displayed is the same as that of the first embodiment except for the file name and the directory name, detailed description is omitted (see FIG. 4). Further, since the entire hierarchy display frame 7001 may be provided and the display method at the time of pause is the same as in the first embodiment, detailed description thereof is omitted (see FIG. 7).

  In this embodiment, the hierarchical structure is a directory structure based on “month” and “date”. However, other structures such as a directory structure based on position information received by the GPS antenna 1011 may be used. Further, instead of automatically determining the image data recording directory according to the information obtained from the timer 1012 by the CPU 1004, a configuration may be adopted in which a directory for recording image data taken by the user after shooting is designated. Further, any configuration can be used as long as the user can display the directory name and file name of the image data recorded in the storage medium 1010 as auxiliary information, such as a directory configuration and a directory / file name designation. It does not matter.

  In this embodiment, the digital video camera 1000 is used as an example. However, any device that displays the file name and directory name together with the image data recorded in a hierarchical structure on the storage medium can be used. I do not care.

  In the above example, the directory name or file name is displayed as text. However, a hierarchical diagram as shown in FIG. 7B may be displayed. Further, in the case where the pause is performed, the file name of the L1 hierarchy is displayed as in the normal playback speed, but the entire hierarchy diagram as shown in FIG. 10 or a diagram in which a part of the hierarchy diagram is expanded is displayed. It may be a method.

  As described above, according to the present embodiment, the digital video camera 1000 acquires date data together with image data at the time of shooting, configures a directory hierarchy based on the date data, and stores it in a corresponding directory. During reproduction, the directory name and file name are displayed on the display device 1007 as auxiliary information. The directory name and file name to be displayed are determined according to the playback speed, which hierarchy (for example, the directory name level indicating the month or the file name level) is mainly displayed.

  This makes it possible to know the detailed directory structure as auxiliary information during normal playback, while slowing down the directory name and file name switching speed by raising the display hierarchy even during high-speed playback. It becomes possible to maintain the visibility.

<Fourth Embodiment>
In the fourth embodiment, a case where a representative image is displayed in time series as auxiliary information of image data will be described. In the present embodiment, the configuration of the digital video camera 1000 (FIG. 1), the display hierarchy determination method during playback (FIG. 3), and the playback speed threshold determination method for switching the display hierarchy (FIG. 5, where the horizontal axis Is read as “change amount of representative image per unit time”), temporal change of display layer when the playback speed is changed (FIG. 6), display layer is not limited to three layers, representative image Since the six points of data recording locations may be the same as those in the first embodiment, detailed description thereof is omitted.

  FIG. 12 is a diagram showing a display hierarchy when image data is reproduced in the present embodiment. The photographed image data is recorded as one file for each cut, and when the image data group 2000 is continuously reproduced, it indicates that the image data is reproduced later in time as it goes to the right.

  Next, a representative image displayed as auxiliary information will be described. The representative image is one still image at a predetermined time interval (for example, every 10 seconds) of image data. In the L1 hierarchy in FIG. 12, the image data is divided at intervals of 10 seconds, and a representative image is generated from the divided image data. The representative image generation method includes, for example, a method in which the head image data of each divided image data is used as a representative image, a method in which each image data divided by the CPU 1004 is analyzed, and a representative image is selected according to a predetermined condition. Can take. In addition, a representative image is generated at intervals of 10 seconds, but when the image data is switched to the next file in less than 10 seconds (for example, switching from image data (1) to image data (2)) A representative image for 10 seconds from the top of the image data is generated. The L2 layer is a representative image for each cut, and the L3 layer is a representative image for every two cuts, and can be generated by the same method as the L1 layer.

  FIG. 13 is a diagram showing a display state of the image display screen 4000 in the present embodiment. The representative image of the image data to be reproduced is displayed in time series in the representative image display frame 13001, and the representative image corresponding to the currently reproduced image is highlighted by enclosing it with a thick frame, for example. FIG. 13B shows the flow of representative images during normal playback (L1 layer), and FIG. 13C shows the flow of representative images during high-speed playback (L2 layer).

  Thus, by switching the representative image to be displayed depending on the reproduction speed, the visibility of the representative image is maintained even during high-speed reproduction, and the image data can be easily searched.

  The method for determining the threshold value of the playback speed for changing the display hierarchy is the same as in the first embodiment except that the horizontal axis in the graph of FIG. 5 is “the amount of change in the representative image per unit time”. Description is omitted.

  In the present embodiment, the interval for generating the representative image of each layer has been described as 10 seconds, 1 cut, and 2 cuts, but the present invention is not limited to this, and any interval may be set. Also, the hierarchy is not limited to three, and any number of hierarchies may be used as long as there are two or more hierarchies.

  In this embodiment, the representative image is displayed as auxiliary information of the image data being reproduced. However, a method of displaying and reproducing only the representative image can be used. FIG. 14 is a diagram showing the display on the image display screen 4000 at this time. Only the representative image display frame 13001 is displayed in the image display screen 4000, and still images are displayed at regular time intervals in time series. When the reproduction speed changes according to an instruction from the operation unit 1008, the time interval of the image data to be displayed is changed accordingly (see FIGS. 14B and 14C).

  In the first to fourth embodiments, the digital video camera 1000 having an imaging function has been described as an example. However, if the device displays hierarchical information recorded on a storage medium, the imaging function is not limited. It may be a playback device that does not have a playback function and performs only playback. The storage medium may be connected to the playback device via a network. Furthermore, it may be designed such that auxiliary information display / non-display can be switched by an instruction from the operation unit 1008.

  As described above, according to the present embodiment, the digital video camera 1000 displays the representative image on the display device 1007 as auxiliary information when reproducing the captured image. The representative image to be displayed is generated at a predetermined time interval according to the reproduction speed.

  As a result, the representative image can be viewed at short intervals as auxiliary information during normal playback, while the time interval for generating the representative image is lengthened even during high-speed playback, that is, the display hierarchy is set higher. It is possible to slow down the image switching speed, maintain the visibility of auxiliary information, and facilitate inspection of target image data.

<Fifth Embodiment>
In the above-described embodiment, an example in which the present invention is applied to reproduction display of image data has been described. In the fifth embodiment, an example in which the present invention is applied to display in a computer application will be described. Here, as an example of a computer application, a case where a display is changed in accordance with a scroll speed in a text editor will be described. In this embodiment, a method for determining a threshold value of the playback speed for switching the display hierarchy (FIG. 5, where the horizontal axis is read as “amount of change in display text per unit time”), when the playback speed is changed. Since the three points of the temporal change of the display hierarchy (FIG. 6) and the display hierarchy is not limited to the three hierarchy may be the same as those in the first embodiment, the detailed description is omitted.

  FIG. 15 is a block diagram showing a configuration of a personal computer 15000 that executes the text editor in the present embodiment. The personal computer 15000 includes an output device 15001 such as a liquid crystal display, a CPU 15002 that controls the operation of the personal computer 15000 as a whole, a memory 15003, an interface 15004, a storage medium 15005, an input device 15006 such as a keyboard and a mouse.

  When text data is input by the input device 15006, the CPU 15002 takes the input content into the memory 15003 and outputs it to the output device 15001. FIG. 16 shows an example of the text editor display screen at this time. When the scroll bar 16001 is dragged with the mouse or the like of the input device 15006 while the text data is displayed, the CPU 15002 scrolls the text and displays it on the output device 15001.

  In addition, when inputting text, it is possible to set a hierarchy for the input text. For example, the hierarchy is set as “large heading”-“small heading”-“text”. In FIG. 16, 16002, 16007, and 16609 indicate “large headline”, 16003, 16008 indicate “small headline”, and 16004 indicate “text”.

  In the present embodiment, the display hierarchy is determined according to the scroll speed. FIG. 17 is a graph showing the relationship between the scroll speed and the display hierarchy. Since the determination method is the same as that in the first embodiment, detailed description thereof is omitted. Further, in the present embodiment, as in the first embodiment, in addition to the display hierarchy, text in a higher hierarchy is also displayed.

  Returning to FIG. 16, when the scroll speed is slow, the L1 hierarchy “text” or higher, that is, the entire sentence is displayed and scrolled. When the scroll speed is fast (here, a1 or more and less than a2), only the text data of the L2 layer “small headline” and the L3 layer “large headline” are displayed and scrolled. Further, the line displayed at the center during scrolling is highlighted by surrounding it with a thick frame. This makes it easy to understand the current position in the entire text data even when scrolling at high speed. Further, by limiting the data to be displayed, scrolling on the actual screen is reduced, and visibility can be maintained. When the scrolling is stopped, the entire text is displayed centering on the highlighted headline, so that it becomes easy to see the entire configuration during high-speed scrolling and details as the scrolling slows down.

  In the present embodiment, the text data itself is displayed in a hierarchy, but the screen is divided into a plurality of parts, one of them (auxiliary screen) is displayed with the text data hierarchized, and the scroll speed is displayed on a screen that is not an auxiliary screen. Regardless of the case, text data that is not hierarchized may be displayed. Further, when all text can be displayed with a small number of screens such as one screen or two screens, the entire text may be displayed even during high-speed scrolling.

  In this embodiment, a text editor is used as an example. However, the information to be displayed is not limited to text data. The information is displayed on the screen, the information can be hierarchized, and the screen is scrolled. For example, an image viewer may be used as long as it can be displayed.

  As described above, according to the present embodiment, when displaying the text editor on the output device 15001, the personal computer 15000 determines the hierarchy of text data to be displayed according to the scroll speed.

  As a result, while scrolling at low speed, it is possible to scroll while looking at the whole sentence, while at the time of high speed scrolling, only the heading above a specific level is displayed, thereby reducing the scroll speed on the display in the output device 15001, and Visibility can be maintained.

<Other embodiments>
The processing of each embodiment described above provides a system or apparatus with a storage medium storing software program codes embodying each function, and the system or apparatus computer (or CPU or MPU) stores the storage medium. It can also be realized by reading and executing the program code stored in the. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. As a storage medium for supplying such a program code, for example, a floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, nonvolatile memory card, ROM Etc. can be used.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (Operating System) running on the computer based on the instruction of the program code. Includes the case where the functions of the respective embodiments described above are realized by performing part or all of the actual processing.

  Furthermore, after the program code read from the storage medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function is based on the instruction of the program code. This includes the case where the CPU or the like provided in the expansion board or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

It is a block diagram which shows the structure of the digital video camera in this invention. It is a figure which shows matching with the image data and the place name data in the 1st Embodiment of this invention. It is a graph which shows the relationship between the reproduction speed in this invention, and the display hierarchy of data. It is a figure which shows the output image in the 1st Embodiment of this invention. It is a graph which shows the relationship between the threshold value of the reproduction | regeneration speed in 1st Embodiment of this invention, and the place name change amount per unit time. It is a graph which shows the time change of the display hierarchy when the reproduction speed in this invention is changed. It is a figure which shows the output image in the 1st Embodiment of this invention. It is a figure which shows the hierarchical structure of the caption data in the 2nd Embodiment of this invention. It is a figure which shows the output image in the 2nd Embodiment of this invention. It is a figure which shows the hierarchical structure of the file and directory in the 3rd Embodiment of this invention. It is a figure which shows the output image in the 3rd Embodiment of this invention. It is the figure which showed the space | interval for every hierarchy which produces | generates the display hierarchy in the 4th Embodiment of this invention, and a representative image. It is a figure which shows the output image in the 4th Embodiment of this invention. It is a figure which shows the output image in the 4th Embodiment of this invention. It is a block diagram which shows the structure of the personal computer in the 5th Embodiment of this invention. It is a figure which shows the display screen of the text editor in the 5th Embodiment of this invention. It is a figure which shows the relationship between the scroll speed and the display hierarchy of text data in the 5th Embodiment of this invention.

Claims (9)

Acquisition means for acquiring image data and subtitle data corresponding to the image data, which has a hierarchical structure having two or more hierarchies and is summarized so that the number of characters decreases in the upper hierarchy ;
Reproducing means for reproducing the image data and reproducing any hierarchy of the caption data corresponding to the image data being reproduced;
With
The image reproduction apparatus, wherein the reproduction unit reproduces a higher hierarchy of the caption data as the reproduction speed is higher in accordance with a reproduction speed of the image data.   Acquisition means for acquiring image data and subtitle data corresponding to the image data, which has a hierarchical structure having two or more hierarchies, and represents a place name indicating a geographically wide range in the upper hierarchy;
  Reproducing means for reproducing the image data and reproducing any hierarchy of the caption data corresponding to the image data being reproduced;
  With
  The image reproduction apparatus, wherein the reproduction unit reproduces a higher hierarchy of the caption data as the reproduction speed is higher in accordance with a reproduction speed of the image data. The reproduction means, when the reproduction speed changes more rapidly than a predetermined degree, changes the hierarchy to be reproduced step by step after a predetermined time has elapsed. The image reproducing device according to 1 or 2 . When the playback speed of the image data is equal to or greater than a predetermined threshold value, characterized in that it further comprises switching means for switching so as to reproduce the subtitle data to the reproduction means, any one of claims 1 to 3 The image reproducing device described in 1. It said reproducing means, characterized in that it comprises a hierarchical information display means for indicating a hierarchy of the subtitle data being reproduced, an image reproduction apparatus according to any one of claims 1 to 4. Imaging means for imaging the image data;
Image recording means for recording the captured image data in a storage medium;
The time of imaging of the image data by the imaging unit, and subtitle data obtaining unit that obtains the subtitle data of the image data,
And subtitle data recording means for recording the subtitle data in the storage medium,
Characterized in that it comprises an image reproducing apparatus according to any one of claims 1 to 5. Accepting an input of information from a user, characterized in that it comprises a closed caption data input means for generating or updating the subtitle data based on the received information, images according to any one of claims 1 to 6 Playback device. An acquisition step of acquiring image data and subtitle data corresponding to the image data, which has a hierarchical structure having two or more hierarchies and is summarized so that the number of characters decreases in the upper hierarchy ,
A reproduction step of reproducing the image data and reproducing any hierarchy of the caption data corresponding to the image data being reproduced;
With
The image reproduction method according to claim 1, wherein the reproduction step reproduces a higher hierarchy of the subtitle data as the reproduction speed is higher in accordance with a reproduction speed of the image data.   An acquisition step of acquiring image data and subtitle data corresponding to the image data, which has a hierarchical structure having two or more hierarchies, and represents a place name indicating a geographically wide range in the upper hierarchy,
  A reproduction step of reproducing the image data and reproducing any hierarchy of the caption data corresponding to the image data being reproduced;
  With
  The image reproduction method according to claim 1, wherein the reproduction step reproduces a higher hierarchy of the subtitle data as the reproduction speed is higher in accordance with a reproduction speed of the image data.