JP2009302734A - Moving picture reproducing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving picture reproducing device capable of improving intelligibility about audio visual video by displaying still video of a photographing place or the like on a slave screen even in the case of using a medium to which only sequential access is possible. <P>SOLUTION: The moving picture reproducing device includes a video analyzing part 104 for detecting a still state of a moving image on a master screen, a slave screen image creating part 105 for creating a slave screen image from still video in the detected still state, and a video combining part 106 for combining the created slave screen image with a master screen. When a still state is continuously detected for a prescribed time or more while reproducing the moving image on the master screen, a slave screen image is created from the still video in the still state, and displayed on the slave screen. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a moving image playback apparatus having a picture-in-picture function for displaying a plurality of moving images simultaneously by superimposing a child screen on a parent screen.

  In recent years, picture-in-picture display that allows two video sources to be viewed simultaneously is generally performed due to an increase in the screen size of a digital television or the like. For example, it is possible to enjoy simultaneous viewing by displaying a DVD movie content on the parent screen and a broadcast TV program on the child screen.

  Also, in the package content of Blu-ray discs and HD DVD discs, which are next-generation large-capacity recording media, content information, performer information, and the like are displayed in a small screen in the main content display area. By doing so, it has become possible to enjoy interactive viewing.

  Due to such a background, a multi-screen viewing function that could not be enjoyed on a small screen can also be enjoyed by the enlargement of the television screen. However, a plurality of screens displayed at the same time are displayed by independent playback means, that is, a playback device for a plurality of videos is necessary and operated by user selection.

On the other hand, Patent Document 1 detects a still image that is recorded during or during the recording of a moving image while the moving image is being reproduced, with the moving image and the still image recorded on the same medium that can be randomly accessed. A technique for displaying a still image on the screen has been proposed. As a result, it is possible to increase the level of understanding of the viewed video.
JP 09-284492 A

  In the method of Patent Document 1, since it is necessary to simultaneously display still images and moving images recorded in different places, a randomly accessible recording medium (DVD or HDD) is indispensable. For this reason, a user who uses a recording medium (tape medium) that can still have many sequential accesses cannot enjoy the functions of the above-mentioned patent document.

  In addition, by providing another second recording means in the recorder, it is possible to realize the function of the above-mentioned patent document at the time of reproduction. However, an increase in the number of parts for providing the second recording means and the second This causes an increase in power consumption when data is written to the recording means. Therefore, the cost of the recorder increases and the recording time is shortened.

  Furthermore, since the relationship between still images and moving images is ambiguous, there is a possibility that still images that are not related to moving images will be displayed on the sub-screen, and it is not always possible to improve the level of understanding of viewing videos. It was.

  An object of the present invention is to provide a moving image reproducing apparatus capable of displaying a still image such as a shooting location on a sub-screen and improving understanding of a viewed image even when a medium that can only be accessed sequentially is used. is there.

  The present invention provides a moving image playback apparatus that displays a plurality of screens simultaneously by superimposing a child screen on a parent screen, a detection unit that detects a stationary state of a moving image of the parent screen, and a detection state of the detected stationary state. A creation unit that creates a sub-screen image from a still image, and a synthesis unit that synthesizes the created sub-screen image with the parent screen, and continues for a predetermined time or more during reproduction of the moving image of the parent screen. If a still state is detected, a small-screen image is created from the still-state still image and displayed on the small screen.

  According to the present invention, a still picture is displayed on a sub-screen when it remains stationary for a predetermined time or more during reproduction of a moving picture on the main screen. Therefore, even when using a recording medium that allows only sequential access, additional information regarding the captured video that is being viewed, for example, by simultaneously displaying while viewing the playback video of the shooting location, etc. taken on a trip Can improve the level of understanding.

  In addition, since it is not necessary to provide a new recording means in the recorder for taking a still image, it is possible to prevent an increase in cost due to an increase in the number of parts of the recorder or a reduction in recording time due to an increase in power consumption. . Furthermore, since the relevance between the video on the main screen and the video on the sub-screen is taken into account, the relevance between the main screen video and the sub-screen video is ensured, and it is possible to accurately increase the understanding level of the viewing video.

  Next, the best mode for carrying out the invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a first embodiment of a moving picture reproducing apparatus according to the present invention. In the figure, reference numeral 101 denotes a video input unit to which a video source is input. The video source is input from a video storage means (not shown) in the video playback device or a video storage means connected to the outside. Reference numeral 102 denotes a setting value input unit for the user to set a continuous still video time when displaying a sub-screen as will be described later.

  FIG. 10 shows an example of a setting screen for setting the continuous still video time. This set value is input using an input device (such as a remote controller or a keyboard) 108 while the user looks at the display screen. Reference numeral 103 denotes a set value storage unit for storing values set by the set value input unit 102. The set value storage unit 103 is an internal memory, and the stored value is updated every time the user inputs a set value from the set value input unit 102.

  Reference numeral 104 denotes a video analysis unit. The video analysis unit 104 detects a stationary state that continues for a predetermined time or more during reproduction of a moving picture on the main screen. In order to determine whether the video is still or not, for example, the input video is decoded, the motion of the video scene is analyzed, and when the sum of the absolute values of the motion vectors is equal to or less than a certain value, the video is determined to be still.

  When the video analysis unit 104 determines that the video is still, the time is measured by an internal time measurement unit (not shown). Then, when a predetermined time stored in the set value storage unit 103 has elapsed since the start of the still image, the video analysis unit 104 detects that the video is continuous for a predetermined time or more.

  The sub-screen image creation unit 105 creates a sub-screen image to be displayed on the sub-screen when it is detected by the video analysis unit 104 that the still image is continuous for a predetermined time or more. At that time, the created image has the same ratio as the aspect ratio of the sub-screen to be displayed. A small-screen image temporary storage unit 109 uses a cache memory. The created small screen image is temporarily stored in the small screen image temporary storage unit 109.

  An image composition unit 106 synthesizes the sub-screen image created by the sub-screen image creation unit 105 with the parent screen. In order to realize a picture-in-picture, the small-screen image created by the small-screen image creation unit 105 is superimposed on a position defined on the parent screen and output. The input video as the parent screen is output from the video analysis unit 104 via the video synthesis unit 106 directly.

  Reference numeral 107 denotes an operation instruction unit that issues a sub-screen display stop command when the user wants to stop the sub-screen display intentionally. An input device 108 is used by the user to perform an input operation on the setting value input unit 102 and the operation instruction unit 107. As a form of the input device 108, a remote controller, a keyboard, etc. are common.

  FIG. 2 is a flowchart for explaining the operation of this embodiment. First, in step S201, the video input unit 101 reads input video data. In step S202, the video analysis unit 104 decodes the read video data and determines whether the input video is a still video. As a method of discriminating still images, for example, there is a method of discriminating from still images when the sum of absolute values of motion vectors of the video is a certain value or less.

  If the determination result in step S202 is a still image, it is determined in step S203 whether or not the image is still for a predetermined time. That is, it is determined whether or not the elapsed time from the start of the still video is in a stationary state for a predetermined time or longer (determining whether the stationary state is continuous for a predetermined time or more set in the set value storage unit 103).

  Next, in step S204, it is determined whether the next frame is not a still image, that is, whether the still image is the last frame. This is a process for creating and displaying a small-screen image at a timing immediately before the input video is switched from the stationary state. If step S204 is omitted, there is a possibility that the same still image is displayed on the sub-screen on the displayed still image as shown in FIG.

  Next, in step S205, the sub-screen image creation unit 105 creates a sub-screen image for displaying the sub-screen when it is determined that the image is still in a continuous state for a predetermined time or more until step S204 and is the final frame of the still video. . At this time, the image to be created is created at the same ratio as the aspect ratio of the child screen. The created small screen image is stored in the small screen image temporary storage unit 109. Every time a small-screen image is generated, the image in the small-screen image temporary storage unit 109 is updated.

  On the other hand, if it is determined in step S202 that the video data read in step S201 is not a still video, or if it is determined in step S203 that the still video is not continuous for a predetermined time or longer, the process proceeds to step S206. If it is not the final still video frame in step S204, the process proceeds to step S206 in the same manner.

  In step S206, it is confirmed whether or not a sub-screen image to be displayed has been created, that is, whether or not there is a video to be displayed on the sub-screen in the sub-screen image temporary storage unit 109. If there is a small-screen image in S206, it is determined in step S207 whether there is a small-screen display stop instruction from the user.

  If there is no stop instruction from the user in step S207, the small-screen image is synthesized with the input video read in step S201 in step S208, and the video is output in step S209. The stop instruction by the user is always accepted as an interrupt process, and is executed after the determination in step S207 is completed.

  If there is a small-screen image to be displayed in step S206 and there is a stop instruction from the user in step S207, the input video is output as it is in step S209 without synthesizing the small screens.

  Here, the processing from step S201 to step S205 is performed, and the video output in step S209 is the video itself read in step S201. On the other hand, the video output from step S201 through step S208 in step 209 is a video obtained by combining a sub-screen image in which a still video is displayed on the video read in step S201. After the process of step S209, the end of the video data is determined in step S210, and when the video data ends, all the processes are ended.

  FIG. 3 is a diagram showing a screen image when performing picture-in-picture display. Reference numeral 301 denotes a display screen of the display device. In the display screen 301, a parent screen 302 and a child screen 303 are displayed. In the picture-in-picture display, a plurality of screens are displayed simultaneously by superimposing a child screen on the parent screen.

  Next, features of the present invention will be described in more detail using the video stream of FIG. 4 and the flowchart of FIG. Assume that the set value storage unit 103 is set to a predetermined continuous time of 3 seconds in a stationary state as shown in FIG.

  FIG. 4 shows an example of a video stream. 401 and 402 are scene 1 and scene 2 photographed by the user. FIG. 4 shows, as an example, a video in which the user goes to “Ox Zoo” and photographs the memories.

  FIG. 5 shows the contents of the scene 401. In order to record that the user has come to “XX Zoo”, it is assumed that a signboard “XX Zoo” is photographed for 5 seconds at the beginning. FIG. 6 shows the contents of the scene 402. The action in the zoo is photographed.

  First, a scene 401 is read into the apparatus of FIG. 1 (step S201), and is determined to be a still image in step S202. Of the 401 scenes determined to be still images, the first 3 seconds are determined to be within a predetermined time in step S203, and the process proceeds to step S206. In step S206, since there is no small-screen image, it is directly output as a video without a small screen in step S209.

  From the beginning of the scene 401 for 3 seconds or more to immediately before the last frame of the still image, it is determined as a continuous still image for a predetermined time or more in S202 to S203, but since it is not the last frame of the still image, the process proceeds from step S204 to step S206. To do. In step S206, since there is no small-screen image, the image is output as it is without a small-screen in step S209.

  Next, when the final frame of the still image of the scene 401 is input, the process proceeds from step S204 to step S205. In step S205, the small-screen image creation unit 105 creates a small-screen image, and then, in step S209, the final frame of the input still image is output.

  Here, the screen displayed from the start of video reading to immediately before the final frame of the still video is the same as the video in FIG. Subsequently, 402 is read in step S201, and it is determined in step S202 that it is not a still image.

  Next, in step S206, since a still image small-screen image has been created first, the process proceeds to step 207 to determine whether or not there is a user stop command. Thereafter, in step S208, the small-screen image previously created in step S205 is synthesized with the video of the scene 402, and output in step S209.

  FIG. 7 shows an example of a screen displayed when 5 seconds or more have elapsed from the start of video reading. Reference numeral 701 denotes a display screen. A main screen 702 and a sub screen 703 are displayed in the display screen 701. The parent screen 702 displays 402 images, and the child screen 703 displays 401 still images.

  In this embodiment, when still images are detected continuously for a predetermined time or more during moving image reproduction, the still images are displayed on the child screen. Therefore, even when using a recording medium that allows only sequential access, it is possible to display additional information regarding the captured video that is being viewed, for example, while simultaneously viewing the playback video of the shooting location taken while traveling, etc. It is possible to improve the level of understanding. For example, the current shooting position and the like can be known by displaying the location information as shown in FIG.

  Further, since it is not necessary to provide a new recording means in the apparatus for taking a still image, it is possible to prevent an increase in cost due to an increase in the number of parts of the recorder or a reduction in recording time due to an increase in power consumption. . Furthermore, as can be seen from FIG. 7, the relationship between the parent screen image and the child screen image is taken into consideration, so that the relationship between the parent screen image and the child screen image is ensured, and the understanding level of the viewing image can be improved accurately. It becomes possible.

(Second Embodiment)
In the first embodiment, a small-screen image is created from a still image that continues for a predetermined time or longer and displayed on the small screen. In the present embodiment, character recognition means is provided in the configuration of FIG. 1 to display only still images with characters on the sub-screen, thereby further improving the understanding level of the viewing image.

  Character recognition means is provided in the video analysis unit 104 of FIG. FIG. 8 shows a flowchart of the present embodiment. In FIG. 8, the same steps as those in FIG. Other configurations and operations are the same as those in the first embodiment.

  8 is different from FIG. 2 in that a character recognition process is added as step S801 between step S204 and step S205 in FIG. Other processes are the same as those in the flowchart of FIG.

  In step S801, it is determined whether or not characters are included in a still image continuous for a predetermined time. As the character recognition method, for example, there are a method of performing character recognition from an entire distribution of characters and a method of performing character recognition by vector analysis of character characteristics. Further, there is a method of performing character recognition by performing smoothing using an n × n mask and extracting a contour line. Further, as a method for recognizing a collapsed character, there is a method for dividing a character peripheral region into small regions, correcting each feature amount, and then recognizing the character.

  If it is determined in step S801 that there is a character in the still image, a small-screen image is generated and stored in the small-screen image temporary storage unit 109 in step S205. On the other hand, if it is determined in step S801 that there is no character, the presence of a small screen image and the user's stop command are determined in step S206, and the process proceeds to step S208 or step S209 to output a video.

  In this embodiment, a still picture that continues for a predetermined time or more during video playback on the main screen is detected and displayed on the sub-screen only when characters are present in the still picture, thereby further improving the understanding of the viewing video. It becomes possible.

It is a block diagram which shows one Embodiment of the moving image reproducing device which concerns on this invention. It is a flowchart figure which shows the operation | movement of FIG. It is a figure explaining a picture in picture. It is a figure which shows an example of a video stream. It is a figure which shows the scene 1 of the video stream of FIG. It is a figure which shows the scene 2 of the video stream of FIG. It is a figure which shows an example which displays the character string of a child screen on the parent screen of this invention. It is a flowchart explaining the operation | movement of the 2nd Embodiment of this invention. It is a figure explaining the role of step S204 of FIG. It is a figure of the static input screen set to the setting value memory | storage part.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Image | video input part 102 Setting value input part 103 Setting value memory | storage part 104 Image | video analysis part 105 Subscreen image preparation part 106 Image | video synthetic | combination part 107 Operation instruction part 108 Input device 109 Subscreen image temporary storage part 301 Display screen 302 Parent screen 303 Child Screen 401 Stream Scene 1
402 Scene 2 of the stream
701 Display screen 702 Parent screen 703 Child screen

Claims (5)

In a video playback device that displays a plurality of screens simultaneously by superimposing a child screen on the parent screen
Detection means for detecting a stationary state of the moving image of the parent screen, creation means for creating a child screen image from the detected still image of the stationary state, and combining the created child screen image with the parent screen Combining means,
When a still state is detected continuously for a predetermined time or longer during playback of the moving image on the main screen, a sub-screen image is created from the still image in the still state and displayed on the sub-screen. To play video. The moving image reproducing apparatus according to claim 1, wherein the predetermined time is set from outside. The moving image reproducing apparatus according to claim 1, wherein the creating unit creates a sub-screen image of the still image when the moving image of the main screen is continuously stationary for a predetermined time or longer. The still picture displayed on the sub-screen is stopped when the instruction from the outside or a new image to be displayed on the sub-screen is detected. The moving image reproducing device according to item. The said creating means creates the said small-screen image when the moving image of the said main screen is stationary still more than predetermined time, and the character is contained in the said still image. 5. The moving image reproducing device according to any one of 4 above.