JP2006180232A - Device and method for video reproduction - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display information at the time of photographing in combination with a reproduced image without deteriorating the quality of the reproduced image when normally reproducing the photographed video and appreciating the video with a monitor. <P>SOLUTION: A controller 5 generates additional information related to the photographing on the basis of basic information using a moving image or a still image stored in a bit map image database 7 by a sub-code block 2 in the video reproduction device. The additional information, which is generated on the basis of the basic information using the moving image or the still image, is synthesized with the video reproduced by a video/voice control block 1 at the point in time of being related to the photographing. The composition is executed by an image processing block 8. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a video playback apparatus and a video playback method for playing back a video shot with a camera and recorded on a recording medium, for example.

  In recent years, various functions are incorporated in electronic devices such as video cameras and digital still cameras, and the number of functions tends to increase year by year. As the recording medium increases in the variety of magnetic tapes, optical / magneto-optical disks, hard disks, memory cards, and the like, functions for recording and reproducing moving images and sounds for a long time have increased.

  As a user's usage, when using a single recording medium, for example, a magnetic tape capable of recording for 60 minutes, the entire length of the tape could not be shot in one day, and shooting was sometimes performed across multiple dates. For example, it is often used to record sequentially on a single tape during a seven-day trip. A user who shoots for about 5 minutes once every two weeks will continue to use one tape for half a year.

  When a tape shot in such a shooting mode is played back and viewed after shooting, it is often difficult to know when a certain video scene is shot in one tape. In particular, even when it is clear that the shooting date has clearly changed due to changes in the playback video, there are many cases where the specific date and time cannot be remembered, and the user feels stress. Therefore, from the viewpoint of user convenience, it has been desired that the date and time can be confirmed on the playback screen.

  Therefore, conventionally, as a recording format, a data area such as a subcode is secured separately from the video / audio data area, and date and date / time data is recorded therein.

  For example, as shown in FIG. 6, since the date and time are not basically displayed on the playback screen V11, even if the date is changed, that is, the playback location is moved to a recording portion with a different shooting date. The user did not see the date change. However, the date and time data recorded in the sub-code area and the like are called and always superimposed on a part of the playback screen as a character display, so that the playback date and time are displayed on the playback screen V11 as shown in FIG. The information 71 can be displayed. Further, as shown in FIG. 8, reproduction date and time information 84 and 85 are displayed on the reproduction screens V21 and V22 up to the 27th date indicated by the number 82, and the 28th date indicated by the number 83 after the date change point 81. By displaying the reproduction date / time information 86, 87, 88 on the reproduction screens V23, V24, V25, a mechanism is realized in which the user knows the date / time information while reproducing.

In addition, a technique has also been proposed in which the date is displayed for one second when the search is completed and deleted again when the date search mode is executed (see, for example, Patent Document 1). The technique disclosed in Patent Document 1 can display a date even during a date search (see [0080]), thereby aiming to simplify the search operation of videos recorded around the tape. Yes (see [0086]).
Japanese Patent Laid-Open No. 11-339444

  However, in the conventional techniques shown in FIGS. 6, 7, and 8 described above, the date displayed once unless the date / time display on / off switch of the video camera that captures the image is operated. And time information are always displayed. For this reason, in the above-described conventional technology, it is necessary to always display the date and time on the reproduction screen at the time of reproduction. As a result, the reproduction image that the user originally wants to appreciate is made dirty. That is, there is a problem that the quality of the reproduced image is deteriorated and another stress may be generated on the user.

  In addition, the method of displaying character data / character data constantly has a drawback that it is difficult to notice the change of date when a similar image continues before and after the date changes.

In addition, the one described in Patent Document 1 displays characters for improving searchability, but the additional image is character data, that is, character data, so that the expression is poor from the viewpoint of design. There is.
In such a situation, there is a request to know the date and time when the image was taken, a request not to be displayed at all times, a request to clearly know the date change, and a more expressive display. It has been regarded as important to satisfy various requirements such as

  Therefore, the present invention normally reproduces a recording medium on which a photographed video is recorded and views the video on the monitor, and reduces the quality of the reproduced image without reducing the quality of the reproduced image. It is intended to display in combination.

  In order to solve the above problems and achieve the object of the present invention, the video reproduction apparatus of the present invention includes basic information storage means for storing basic information using a moving image or a still image in order to generate additional information, Additional information related to photographing by the photographing means is generated based on the basic information using the moving image or still image stored in the basic information storage means, and the moving information or still image is generated by the additional information generating means. And a synthesizing unit that synthesizes the additional information generated based on the basic information using the synthesizer with the video reproduced by the reproducing unit at a time point related to photographing.

  The additional information generating means generates additional information on the shooting date and time recorded on the recording medium based on the basic information using the moving image or the still image stored in the basic information storage means. The synthesizing unit displays the additional information generated based on the basic information using the moving image or the still image in combination with the video reproduced by the reproducing unit. As a result, for example, the date can be displayed in combination with the replayed image by the template image / animation stored in the database in the scene where the date has changed, and the date change can be easily notified to the user who is playing the video. it can.

  In addition, the video reproduction method of the present invention includes a basic information storage step for storing basic information using a moving image or a still image, and additional information related to shooting in the basic information storage step to generate additional information. The additional information generation step that is generated based on the basic information that uses the stored moving image or still image, and the additional information that is generated based on the basic information that uses the moving image or still image by the additional information generation step is reproduced. A synthesizing step for synthesizing the video to be recorded at a time point related to photographing.

  In the additional information generation step described above, additional information on the shooting date and time recorded on the recording medium is generated based on the basic information using the moving image or the still image accumulated in the basic information storage step, and the moving image or The additional information generated based on the basic information using the still image is combined with the reproduced video in the synthesizing step and displayed in combination with the reproduced video by the reproducing means. This makes it possible to easily notify the user of information such as the shooting date and date when playing back the video, and not only as simple additional information, but also by combining the date with the playback image using a template image / animation, etc. It is possible to produce rich notifications. At this time, it is possible to easily notify the user of the date change, and to make it possible for the user to select an animation image or the like to be used according to his / her preference, thereby satisfying the various requirements of the user described above.

  According to the present invention, the recording medium on which the captured video is recorded is normally reproduced over the entire length, and the information at the time of photographing is reproduced without degrading the quality of the reproduced image when the video is viewed on the monitor. It can be displayed in combination with an image. For example, during playback of captured images, information such as the shooting date and time is not simply text-based additional information, but using bitmap still images, animations, etc. Notification can be made in the form.

In particular, it is possible to automatically and easily notify a user of a change in date of a captured video using a bitmap still image, animation, or the like.
Further, after the specified time has elapsed, the calendar image is deleted to minimize the time for smearing the original reproduced image.

  In the embodiment of the present invention, in addition to using date and time data recorded in an area such as a subcode at the time of shooting at the time of reproduction, combining the image information of a separately stored calendar, The change is beautifully and effectively notified to the user, and after the above-mentioned display is displayed for a certain period of time, it is automatically turned off so as not to disturb the reproduced image.

As the calendar image information, a bitmap still image, a plane (2D), a three-dimensional (3D) animation, or the like can be used to make the information rich.
The embodiments of the present invention are useful not only for portable devices such as video cameras and digital still cameras, but also for stationary video playback devices such as video decks, DVD players, DVD recorders, hard disk recorders / players in general. It is.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings as appropriate.
First, the hardware configuration will be described.
FIG. 1 is a block diagram showing the hardware configuration of the video playback apparatus of this example.
In FIG. 1, the user can select and set the type of function and the on / off of the function using various item setting switches 3. For example, the date / time display function can be turned on / off. As the various item setting switches 3, a touch panel attached to the display block 9 can be used.

The video / audio control block 1 controls the operation of reproducing the captured video and audio recorded on the recording medium. Here, for example, decompression processing of the video that has been compressed and recorded on the recording medium is performed. Further, the subcode block 2 is a block for controlling the operation of reproducing and using the date / date / time information of the captured video recorded on the recording medium. In this block, for example, the camera control value and the video The number of frames is also detected.
The calendar / clock control block 4 has a function of counting calendars, hours, minutes and seconds.
The controller 5 performs integrated control of each block and a database to be described later. The controller 5 can also include memory functions such as ROM and RAM, for example.

In addition, a character database 6 and a bitmap image database are provided as the database of this example.
The character database 6 is a database in which character information such as a calendar and hour / minute / second to be superimposed on a reproduced video is stored as a still image or a moving image, and the bitmap image database 7 is a calendar or date / time data. This is a database storing still image and moving image image data to be superimposed on the playback screen in combination. By making the still image or moving image data form of the bitmap image database 7 into an animation of a bitmap still image or moving image by an image processing block 8 to be described later, a date change rich in expressiveness is shown to the user. be able to. For example, a daily calendar with a large display of a day and an animation operation, or by displaying only one month at a time and making it stand out by blinking only the relevant date, various variations according to the user's request Can be realized.
Further, the bitmap image database 7 may be directly stored in the form of moving image data of animation. In this case, the processing load in the image processing block 8 is reduced, but it is necessary to secure a sufficient capacity of the bitmap image database 7.

In the image processing block 8, the reproduction image is combined with the bitmap image data from the bitmap image database 7 and the character data from the character database 6.
The display block 9 includes a display element such as a liquid crystal panel, a CRT (Cathode Lay Tube), or an EL (Electro Luminescence), and can display a synthesized image. In contrast, the output block 11 indicates an external output cable or an access point to the network. In addition, the memory block 10 is configured by, for example, a flash memory that is detachable from the video playback device, and externally stores character information stored in the character database 6 and bitmap still images and animations stored in the bitmap image database 7. The image is stored.

  Here, the controller 5 is a control device that controls the entire blocks of the present invention, and has various functions as described below. That is, in order to generate additional information related to photographing obtained by the subcode block 2, a function for storing basic information using moving images or still images in the character database 6 and the bitmap image database 7, and photographing by photographing means A function for generating additional information related to the image based on basic information using moving images or still images stored in the character database 6 and the bitmap image database 7, and further, basic information using moving images or still images The image processing block 8 has a function to synthesize the additional information generated on the basis of the above-mentioned information with the video reproduced by the video / audio control block 1 at the time related to photographing.

  The controller 5 also has a function of generating additional information from the date / time information used for the video / audio control block 1 based on the basic information using the moving image or the still image related to shooting, and the video / audio control. It also has a function of generating additional information based on the basic information using the moving image or the still image related to photographing from the break information of the video scene used in block 1.

The character database 6 connected to the image processing block 8 has a character information storage unit for storing character information. Similarly, the bitmap image database 7 connected to the image processing block 8 is an image information storage for storing image information. Has a part. In the character database 6 and / or the bitmap image database 7, character information and / or image information is stored as basic information using moving images or still images.
In other words, the controller 5 performs a plurality of operations based on basic information using moving images or still images stored in the character database 6 and the bitmap image database 7 under the control of the controller 5 via the image processing block 8. It has a function of generating additional information as a moving image by sequentially moving or flipping an image superimposed on the layer from the top layer. Then, the image processing block 8 uses the additional information generated based on the basic information using the moving image or the still image for the video to be reproduced for a predetermined period from the time point related to the shooting. I am trying to synthesize.
In addition, the controller 5 does not store a moving image to be combined with a video to be reproduced in advance in the character database 6 and the bitmap image database 7 for the processing on the image processing block 8, but the character database 6 and the bitmap image. Using the images stored in the database 7, additional information is generated by synthesizing still images, intermittent still images, and moving images in real time. It is also possible to select a process to be combined for a certain period.

  In addition, in the image processing block 8, when the process of combining the additional information generated based on the basic information using the moving image or the still image with the video to be reproduced is selected in advance, the controller 5 A control operation for synthesizing the image through the image processing block 8 is performed.

FIG. 5 is a diagram illustrating a configuration example of a drawing plane in the image processing block. The image processing block 8 described above is configured to include a CPU for controlling and a RAM for temporarily storing information, and a drawing plane for generating additional information is present in the information temporarily storing place. RAM. The RAM as a temporary storage location of this information is composed of, for example, three planes in which a plurality of image layers are stacked as shown below.
As shown in FIG. 5, the RAM as a temporary storage location for information including a drawing plane in the image processing block 8 includes a background image data area 51 serving as a temporary storage location (RAM 1) for data such as a frame and a pattern. The plain 1 data area 52, which is a temporary storage location (RAM 2) for still image and video data such as the calendar for January, and the daily still image and video data for the day flashes temporarily. A plane 2 data area 53 serving as a storage location (RAM 3).
For example, the image processing block 8 draws a frame, a pattern, or the like in the background image data area 51 that is a background plane based on a plurality of still images read from the bitmap image database 7 under the control of the controller 5. .
In addition, the image processing block 8 synthesizes an animation in real time based on a plurality of still images and moving images read from the bitmap image database 7 and the character database 6 under the control of the controller 5, and generates a plane 1 data area. 52 and the plane 2 data area 53 are drawn. Under the control of the controller 5, the image processing block 8 stacks a plurality of image layers in the plane 1 data area 52 and the plane 2 data area 53, and sequentially superimposes the images superimposed on the plurality of layers from the top layer. It may be drawn as a moving image by moving continuously or turning.
Of course, the image processing block 8 can directly draw the still image or moving image that has been read out in the plane 1 data area 52 or the plane 2 data area 53 under the control of the controller 5.

Next, the flow of control will be described with reference to the flowchart showing the operation of the video reproduction apparatus in FIG. FIG. 2 is a flowchart for explaining the operation of the controller 5 shown in FIG.
2, first, the controller 5 shown in FIG. 1 determines whether or not the date / date / time information display function is selected by the user using the various item setting switches 3 (step S1).

  Next, during playback of video / audio recorded on a recording medium such as a magnetic tape by the video / audio control block 1, data such as subcodes, particularly date / time information, is always read from the recording medium by the subcode block 2. Recover and detect, and prepare for display on the display block 9 according to the display instruction (step S2).

  Subsequently, the controller 5 determines whether or not a position where the date has changed is detected in the date information being detected by the subcode block 2 (step S3). In this determination step S3, when it is determined that the date change of the subcode is detected, the calendar image stored in advance in the bitmap image database 7 is read into the image processing block 8 (step S4).

  Next, the controller 5 causes the image processing block 8 to read information such as year, month, day, hour, minute, second, etc. sent from the calendar / clock control block 4, and causes the image processing block 8 to read the calendar image. And information such as year, month, day, etc. is synthesized. At this time, the image processing block 8 adds a calendar animation or the like by synthesizing still images, intermittent still images, or moving images in real time from calendar images stored in advance in the character database 6 or the bitmap image database 7 as necessary. Information is created (step S5).

  Next, the controller 5 outputs the video recorded on the recording medium such as a magnetic tape reproduced by the video / audio control block 1 and the additional information such as the animation generated in the image processing block 8 to the image processing block. 8 is combined (step S6). Then, the image synthesized in the image processing block 8 is displayed on the display block 9 (step S7).

  Here, the controller 5 controls the animation to be started so that the animation of the calendar image starts at the time when the shooting date / time changes with respect to the reproduced video (step S8), and a predetermined time, for example, 3 It is determined whether it has been detected that the second has passed (step S9). If it is determined that the specified time of 3 seconds has elapsed, the animation operation is terminated (step S10), and the composition of the reproduced image and animation in the image processing block 8 is terminated (step S11).

Next, an example of a video reproduced by the above-described configuration and operation will be described.
FIG. 3 is a diagram showing an example of a video of a date change during continuous reproduction when the date / time display mode is off by the various item setting switches 3 shown in FIG. 1 according to the present invention.
In FIG. 3, when images V1, V2, V3, V4, and V5 are being played back, the date indicated by the number 33 beyond the date change point 31 from the images V1 and V2 for the image taken on October 27 indicated by the number 32 is shown. Even if the images V3, V4, and V5 for the 28th day are entered, the calendar image is not displayed as indicated by numeral 34, and only the reproduction screen is displayed.

FIG. 4 is a diagram showing an example of a video of a date change during continuous reproduction when the various item setting switch 3 selects date clock display mode ON.
As shown in FIG. 4, when images V1, V2, V3, V4, and V5 are being reproduced, the image changes from the images V1 and V2 for the image taken on October 27 indicated by the number 32 to the number 33 beyond the date change point 31. When the images V3, V4, and V5 for the image taken on October 28 are entered, a calendar image display 41 in which an appropriate date is combined with calendar image information based on the calendar data is displayed superimposed on the reproduction screen V3. Here, the calendar image display 41 displays, for example, a plurality of image layers stacked, and an image superimposed on the plurality of layers is sequentially moved or flipped from the top layer as a moving image. Is done.

The calendar image display 41 disappears from the reproduction screens V4 and V5 after a predetermined time, for example, 3 seconds elapses.
In addition, when the date / time display function is turned off using the various item setting switches 3, the calendar display can be hidden even in a scene where the date changes as shown in FIG. Can be prevented.

In addition, the calendar image data can be used by appropriately selecting the design and movement according to the user's preference by using the memory block 10 that is detachable from the video reproduction device, for example, configured by a flash memory. It is.
In addition, a synthesized image obtained by synthesizing a calendar display with a reproduced image can be used by being output to an external reproducing apparatus via an output block 11 which is an external output cable or a network access point.

The present invention is not limited to the embodiment of the present invention described above, and can be appropriately modified without departing from the gist of the present invention described in the claims. Hereafter, the modification of embodiment of this invention is shown.
In the above-described embodiment of the present invention, an example in which video recorded on a recording medium by the video / audio control block 1 is played back is shown. However, not only during continuous playback of moving images, but also during intermittent playback or continuous playback of still images. Even during playback (generally referred to as slide show playback), it is possible to provide more beautiful and effective date information on the screen by displaying a calendar image animation, etc. at the same time when the date changes. is there.

Further, the present invention can be similarly applied to a recording medium on which a video in which a still image and a moving image are mixed is recorded.
In addition to recording / reproducing a recording medium having a physically determined capacity such as a tape or a disk by the video / audio control block 1 attached to the main body, the output block 11 can be used to connect a network etc. The present invention can be similarly applied to the case where the data is recorded elsewhere and is input again by the video / audio control block 1 and reproduced.

  In addition, by preparing various patterns as calendar image data stored in the bitmap image database 7, the user can use a calendar with an expression suitable for his / her preference. At this time, it is possible to display, for example, a Japanese era name, a Western calendar, or a calendar in a form adapted to other cultural circumstances in cooperation with the calendar / clock control block 4.

  In addition to the year, month, date, hour, minute, and second, the target to be combined with the calendar image data synthesized in the image processing block 8 is not limited to the year, month, day, hour, minute, and second, but refers to data such as other product destinations, It is also possible to select a focal length, an aperture value, other set values, numerical values, terms, and the like.

  Further, the calendar image data pattern stored in the bitmap image database 7 can be used by the user by registering it in the main body from the outside, for example, via a memory card or a network, using the memory block 10, for example. is there.

  In addition, if the time difference information on the earth divided by the time difference correction zone that is included in the clock of the main body from the calendar / clock control block 4 is utilized, it is stored in the bitmap image database 7 corresponding to the time difference correction area on the earth. It is also possible to automatically determine and use the calendar type. In this case, a calendar background corresponding to the country may be selected.

Even when the calendar image data synthesized in the image processing block 8 is not displayed on the display block 9 after a predetermined time, the user can request display by operating the function selection switch using the various item setting switches 3. Thus, it is possible to display the display at any time for a certain period of time. The user can also display data such as date and time of the prior art on the playback screen by operating the function selection switch using the various item setting switches 3.
Further, as an output target, not only the display block 9 display unit built in the device but also the output block 11 can include analog and digital transmission to other devices by wired connection and wireless connection.

It is a block diagram which shows the hardware constitutions of the video reproduction apparatus by this invention. It is a figure which shows the example of the flowchart which shows operation | movement of the video reproduction apparatus of this invention. It is a figure which shows the example of the image | video of the change of the date during continuous reproduction | regeneration at the time of the date clock display mode off selection by this invention. It is a figure which shows the example of the image | video of the change of the date during continuous reproduction | regeneration at the time of the date clock display mode ON selection by this invention. It is a figure which shows the structural example of the drawing plane in the image processing block used by this invention. It is a figure which shows the example of the image | video at the time of the conventional date clock display OFF selection. It is a figure which shows the example of the image | video at the time of the conventional date clock display ON selection. It is a figure which shows the example of the image | video of the change of the date during the continuous reproduction | regeneration at the time of the conventional date clock display ON selection.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Video | audio control block, 2 ... Subcode block, 3 ... Various item setting switch, 4 ... Calendar / clock control block, 5 ... Controller, 6 ... Character database, 7 ... Bitmap image database, 8 ... Image processing block , 9 ... Display block, 10 ... Memory block, 11 ... Output block

Claims (16)

In a video playback apparatus capable of playing back video taken by the shooting means by the playback means and outputting the video together with additional information.
Basic information storage means for storing basic information using a moving image or a still image in order to generate the additional information;
Additional information generating means for generating additional information related to photographing by the photographing means based on basic information using moving images or still images stored in the basic information storage means;
Synthesizing means for synthesizing the additional information generated by the additional information generating means based on the basic information using the moving image or the still image with the video reproduced by the reproducing means at a time point related to the photographing; A video reproducing apparatus comprising: The video playback device according to claim 1,
The video reproduction apparatus characterized in that the additional information generating means generates additional information based on basic information using a moving image or a still image related to the shooting from date / time information used for the reproducing means. The video playback device according to claim 1,
The additional information generating unit generates additional information based on basic information using a moving image or a still image related to the photographing from the break information of a video scene used for the reproducing unit. . The video playback device according to claim 1,
The basic information storage means includes a character information storage unit that stores character information and an image information storage unit that stores image information, and stores the character information and / or image information as a moving image or a still image. A video playback device. The video playback device according to claim 1,
The video reproduction apparatus characterized in that the additional information generating means generates additional information as a moving image by sequentially moving or flipping images superimposed on a plurality of layers from the top layer. The video playback device according to claim 1,
The video reproducing apparatus characterized in that the synthesizing unit synthesizes the additional information using the moving image with the reproduced video for a predetermined period from a time point related to the shooting. The video playback device according to claim 1,
The additional information generating means uses a character information and / or image information from the information stored in the character information storage section and the image information recording section provided in the basic information storage means, in real time, as a still image or an intermittent still image. And a moving image are stacked to generate additional information, and the synthesizing unit synthesizes the reproduced video for a predetermined period from a time point related to the shooting. . The video playback device according to claim 1,
The synthesizing unit performs the synthesis process only when a process for synthesizing the additional information generated based on the basic information using the moving image or the still image with the reproduced video is selected in advance. A video reproducing apparatus characterized by: In a video playback method capable of playing back a captured video and outputting it with additional information,
A basic information storage step for storing basic information using a moving image or a still image in order to generate the additional information;
An additional information generation step for generating additional information related to the photographing based on the basic information using the moving image or the still image stored in the basic information storage step;
And a synthesis step of synthesizing the additional information generated based on the basic information using the moving image or the still image in the additional information generation step with the reproduced video at a time point related to the shooting. A video reproduction method characterized by the above. The video playback method according to claim 9, wherein
The video reproduction method according to claim 1, wherein the additional information generation step generates the additional information based on basic information using a moving image or a still image related to the shooting from the date / time information used for the reproduction. The video playback method according to claim 9, wherein
In the additional information generation step, the additional information is generated based on the basic information using the moving image or the still image related to the shooting from the date / time information or the break information of the scene of the video used for the reproduction. Video playback method. The video playback method according to claim 9, wherein
The basic information storing step stores character information and stores character information and / or image information as a moving image or a still image when storing image information. The video playback method according to claim 9, wherein
The additional information generating step generates the additional information as a moving image by sequentially moving or flipping images superimposed on a plurality of layers from the uppermost layer. The video playback method according to claim 8, wherein
The video synthesizing step, wherein the synthesizing step synthesizes the additional information using the moving image with the video to be reproduced only for a predetermined period from a time point related to the shooting. The video playback method according to claim 9, wherein
In the additional information generation step, additional information is obtained by stacking still images, intermittent still images, and moving images in real time using character information and / or image information from the character information and image information stored in the basic information storage step. And the synthesizing step synthesizes the reproduced video only for a predetermined period from a time point related to the photographing. The video playback method according to claim 9, wherein
The synthesizing step is performed only when the process of synthesizing the additional information generated based on the basic information using the moving image or the still image with the reproduced video is selected in advance. A video playback method characterized by:

Images