JP2005284563A - Area designation of moving image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To facilitate designation of an attention area in a moving image under playback. <P>SOLUTION: An attention area designation unit for designating the attention area, a portion of a moving image under playback, includes a moving image playback section 200 for displaying the moving image on a moving image display area. The above moving image playback section 200 has an area designation mode, which displays an area frame representing the attention area, and an ordinary playback mode, which does not display the area frame. The area designation mode is executed when a pointing device 160 is operated, while the ordinary playback mode is executed when the pointing device 160 is not operated. In the area designation mode, the moving image playback section 200 displays on the moving image the area frame corresponding to a position and a magnification designated by the pointing device 160. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a technique for designating a partial area of a moving image during reproduction of the moving image.

  When processing such as image enlargement by an image processing system or the like, in order to designate a region of interest of an image to be enlarged, two diagonal points of the region of interest are designated by a pointing device (for example, Patent Document 1).

Japanese Patent Laid-Open No. 9-98961

  However, if the image to be processed is a moving image being played back, the region to be enlarged moves while designating the two diagonal points of the region of interest, and a region different from the region the user wants to enlarge and reproduce is designated There was a case.

  The present invention has been made to solve the above-described conventional problems, and an object of the present invention is to provide a technique for facilitating designation of an attention area of a moving image being reproduced.

  In order to achieve at least a part of the above object, an attention area specifying device of the present invention is an attention area specifying device for specifying an attention area having a predetermined shape, which is a part of a moving image, during reproduction of the moving image. A pointing device having a position specifying mechanism for specifying a two-dimensional position and a magnification specifying mechanism for specifying a magnification, and specifying the position of the region of interest in the moving image from the position specifying mechanism. An area instruction acquisition unit that acquires a position parameter, acquires a magnification parameter that specifies a size of the region of interest in the moving image from the magnification specifying mechanism, and a moving image playback unit that displays the moving image in a moving image display region The moving image reproduction unit displays a region frame having a predetermined shape representing the region of interest on the moving image displayed in the moving image display region; A normal reproduction mode that does not display, and executes the area designation mode when the position designation mechanism is operated by the user, and executes the normal reproduction mode when the position designation mechanism is not operated by the user, In the region designation mode, the region frame is displayed on the moving image at a position corresponding to the position parameter and a magnification corresponding to the magnification parameter.

  According to this configuration, the attention area can be quickly specified, so that the attention area of the moving image being reproduced can be easily specified.

  The pointing device further includes an attention area determination mechanism for determining the designation of the attention area, and the predetermined shape is a rectangle having the same aspect ratio as the moving image display area, and the moving image The reproduction unit may enlarge and display the image of the attention area on the moving image display area in accordance with the operation of the attention area determination mechanism by a user operation.

  According to this configuration, it is easy to enlarge and display an arbitrary place of the moving image being reproduced.

  The moving image display area may be an area in which at least one of a size and a shape is variable.

  According to this configuration, the moving image display area can be brought into a state more suitable for specifying the attention area, so that the attention area can be specified more easily.

  The moving image display area is an area having a variable aspect ratio, and the moving image playback unit changes the aspect ratio of the area frame to the aspect ratio of the moving image display area when the aspect ratio of the moving image display area changes. It may be a thing.

  According to this configuration, it is easy to enlarge and display an arbitrary area of the moving image being reproduced.

  The moving image display area is at least a part of a moving image display window displayed on a display screen, and the moving image reproduction unit has a pointer that indicates a position in the display screen that moves according to the movement of the pointing device. When the moving image display window is entered from outside the moving image display window, the area frame may be displayed at a predetermined position and size.

  According to this configuration, it is possible to prevent the region frame from being displayed when the attention region designation is unnecessary.

  The present invention can be realized in various modes, for example, a moving image processing method and a moving image processing device, a moving image display method and a moving image display device, and a computer program for realizing the functions of these methods or devices. The present invention can be realized in the form of a recording medium on which the computer program is recorded.

Next, the best mode for carrying out the present invention will be described in the following order based on examples.
A. Example:
B. Variation:

A. Example:
FIG. 1 is an explanatory diagram showing a configuration of a moving image display system 100 as an embodiment of the present invention. The moving image display system 100 includes a computer 110, a display 120 as a device for displaying an image, a keyboard 150 and a mouse 160 as devices for inputting information to the computer 110, and a DVD as a device for inputting moving image data to the computer 110. A drive 130 and a digital video camera 140. The mouse 160 is a well-known mouse having a position sensor that detects a two-dimensional position, a button that can be turned on / off, and a mechanism (wheel) that enables continuous parameter input.

  A video playback unit 200 incorporated in the computer 110 includes an original video acquisition unit 220 that acquires an original video GD from video data input from the digital video camera 140 and the like, and a playback video generation that generates a playback video MD from the original video GD. Unit 240 and a display control unit 260 that displays the reproduced moving image MD in a moving image display area on the display 120. The function of each component of the moving image reproducing unit 200 is realized by the computer 110 executing an application program.

  FIG. 2 is an explanatory diagram showing the configuration of the playback video generation unit 240. The playback video generation unit 240 includes a video processing unit 242, a region frame superimposing unit 250, a playback control unit 244, a region frame control unit 246, and a region instruction acquisition unit 248. The playback video generation unit 240 is a normal playback mode in which the original video GD is output as it is as the playback video MD, and a playback video in which an image representing an area (attention area) having the same aspect ratio as the video display area is superimposed on the original video GD. An area designation mode for outputting MD and an enlarged reproduction mode for outputting a reproduced moving picture MD in which a portion corresponding to the attention area in the original moving picture GD is enlarged are provided.

The area instruction acquisition unit 248, according to a user operation input input using the mouse 160 (FIG. 1), a position parameter PI that represents the center position of the attention area in the moving image display area, and a moving image display area for the size of the attention area. A magnification parameter MI representing the ratio of the size of the region and a region confirmation instruction RD representing the designation of the region of interest are acquired. Specifically, the area instruction acquisition unit 248 changes the position parameter PI according to the movement amount of the mouse 160 supplied from the mouse 160. Similarly, the region instruction acquisition unit 248 changes the magnification parameter MI according to the amount of rotation of the wheel supplied from the mouse 160. The region determination instruction RD is acquired when a signal indicating that a specific button of the mouse 160 is clicked is supplied. Information PI, MI, and RD acquired in this way are supplied from the region instruction acquisition unit 248 to the region frame control unit 246. The position parameter PI is represented by xy coordinates (p _x , p _y ) in the moving image display area.

The region frame control unit 246 acquires region designation information RI representing the position of the region of interest in the moving image display region from the position parameter PI and the magnification parameter MI. The region designation information RI is supplied to the reproduction control unit 244 together with the region confirmation instruction RD acquired by the region instruction acquisition unit 248. The region designation information RI is a point at the upper left corner of the region of interest calculated by the following equations (1) to (4) using the size (X, Y) of the moving image display region and the value m of the magnification parameter MI ( x ₁ , y ₁ ) and the coordinate values of the lower right point (x ₂ , y ₂ ). The size (X, Y) of the moving image display area can be acquired from the display control unit 260 (FIG. 1).

_{x 1 = (p x -X /} 2) -X / 2m ... (1)
_{y 1 = (p y -Y /} 2) -Y / 2m ... (2)
x ₂ = (p _x −X / 2) + X / 2m (3)
_{y 2 = (p y -Y /} 2) + Y / 2m ... (4)

  By calculating the coordinates of the upper left corner point and the lower right corner point of the attention area using the above equations (1) to (4), the center point of the attention area becomes the position represented by the position parameter PI. The size of the area is 1 / m times the moving image display area.

  The playback control unit 244 determines the operation mode of the playback video generation unit 240 based on the region designation information RI and the region determination instruction RD supplied from the region frame control unit 246. The mode information PM indicating the operation mode is supplied to the video processing unit 242 together with the region designation information RI acquired by the region frame control unit 246. In addition, the reproduction control unit 244 supplies the mode information PM to the area frame control unit 246. The region frame control unit 246 supplies the mode information PM and the region designation information RI to the region frame superimposing unit 250. The determination of the operation mode by the playback control unit 244 will be described later.

  The video processing unit 242 performs processing of the original moving image GD supplied from the original moving image acquisition unit 220 (FIG. 1) based on the region designation information RI and the mode information PM supplied from the reproduction control unit 244, and performs the intermediate moving image XD. Is output. This intermediate video XD is supplied to the region frame superimposing unit 250.

  When the playback video generation unit 240 is in the normal playback mode or the area designation mode, the video processing unit 242 outputs the original video GD as it is as the intermediate video XD. On the other hand, when the playback video generation unit 240 is in the enlarged playback mode, the video processing unit 242 generates an image having the same resolution as that of the original video GD from an image in a range corresponding to the region of interest in the original video GD. Enlargement processing for outputting a moving image as an intermediate moving image XD is performed. When performing the enlargement process, the video processing unit 242 calculates a range (cutout range) of the original moving image GD corresponding to the attention area by appropriate coordinate conversion from the area designation information RI. Then, an image having the same resolution as that of the original moving image GD is generated by performing a known resolution conversion process on the image within the cut-out range of the original moving image GD. The generated image is output as an intermediate video XD.

  Based on the region designation information RI and mode information PM supplied from the region frame control unit 246, the region frame superimposing unit 250 superimposes an image representing a region of interest on the intermediate video XD and generates a playback video MD. The generated reproduced moving image MD is supplied to the display control unit 260 (FIG. 1), and the reproduced moving image MD is displayed in the moving image display area on the display 120 (FIG. 1).

  When the playback video generation unit 240 is in the normal playback mode or the enlarged playback mode, the region frame superimposing unit 250 outputs the intermediate video XD as it is as the playback video MD. On the other hand, when the reproduction moving image generating unit 240 is in the region designation mode, the region frame superimposing unit 250 generates a white rectangular image (region frame) representing the outer peripheral portion of the attention region. The generated area frame is synthesized with the intermediate video XD and output as a playback video MD.

  FIG. 3 is an explanatory diagram showing an example of enlarged reproduction of a moving image by the moving image reproducing unit 200 (FIG. 1). In the example of FIG. 3, the moving image reproducing unit 200 performs moving image reproduction in the full screen mode in which the entire surface of the display 120 (FIG. 1) is the moving image display area MDA. The original moving image GD supplied to the moving image reproducing unit 200 is a moving image representing a video IRN in which a person having the same aspect ratio as the moving image display area MDA is running on the lower center side of the screen.

  When the playback video generation unit 240 (FIG. 1) is in the normal playback mode, the playback video MD output from the playback video generation unit 240 is the original video GD. Therefore, the video IRN is displayed in the moving image display area MDA as shown in FIG.

  Switching from the normal reproduction mode shown in FIG. 3A to the area designation mode shown in FIG. 3B is performed by a movement operation of the mouse 160 (FIG. 1) by the user. When region designation information RI is supplied to the reproduction control unit 244 by the user moving the mouse 160 in either direction, the reproduction control unit 244 switches the operation mode of the reproduction moving image generation unit 240 to the region designation mode. If the mouse 160 is not operated for a predetermined time (for example, 5 seconds) after switching to the area designation mode, the playback control unit 244 sets the operation mode of the playback moving image generation unit 240 to the normal playback mode (FIG. 3A). Switch to.

  In the area designation mode, the video processing unit 242 outputs the original moving image GD as it is as the intermediate moving image XD. Therefore, in the moving image display area MDA, as shown in FIG. 3B, the same video IRN as in the normal playback mode (FIG. 3A) is displayed. In the area designation mode, the area frame superimposing unit 250 (FIG. 2) superimposes the area frame on the intermediate moving image XD and outputs it as a reproduced moving image MD. Therefore, in the moving image display area MDA, as shown in FIG. 3B, the area frame IFM is displayed superimposed on the video IRN.

  In FIG. 3B, the position parameter PI when switching to the area designation mode is a value representing the center of the moving image display area MDA, and the magnification parameter MI is a value representing twice the magnification. . Therefore, the area frame IFM is located at the center of the moving image display area MDA, and the size thereof is ½ of the moving image display area MDA. As the initial values of these parameters PI and MI, for example, the values of the parameters PI and MI at the time when the previous area designation mode ends can be used.

  The position of the area frame IFM is changed by a movement operation of the mouse 160 by the user. When the user moves the mouse 160, the position parameter PI is changed. Then, the area designation information RI is changed with the change of the position parameter PI. The area frame superimposing unit 250 generates an area frame based on the area designation information RI changed in this way, and synthesizes it with the intermediate moving image XD. In the example of FIG. 3, when the user moves the mouse 160 downward, the position of the area frame represented by the position parameter PI and the area designation information RI moves downward. Then, the area frame IFM shown in FIG. 3B moves downward to become the area frame IFMa shown in FIG.

  Switching from the area designation mode shown in FIG. 3C to the enlarged reproduction mode shown in FIG. 3D is performed by a user's button operation of the mouse 160. When the user clicks the left button MLB of the mouse 160, the region instruction acquisition unit 248 acquires the region determination instruction RD. When the acquired area determination instruction RD is supplied to the playback control unit 244, the playback control unit 244 switches the operation mode of the playback video generation unit 240 to the enlarged playback mode. Note that the operation mode of the playback video generation unit 240 is switched from the enlarged playback mode to the normal playback mode by a button operation of the mouse 160 by the user (for example, clicking the left button MLB).

  In the enlarged playback mode, the video processing unit 242 outputs an intermediate moving image XD obtained by enlarging the range specified by the area specifying information RI in the original moving image GD. Therefore, as shown in FIG. 3D, the video IRNa of the attention area indicated by the area frame IFMa in FIG. 3C is displayed in the moving image display area MDA. Further, the region frame superimposing unit 250 outputs the intermediate moving image XD as it is as the reproduced moving image MD. Therefore, no area frame is displayed in the moving image display area MDA.

  FIG. 4 is an explanatory diagram showing another example of the enlarged reproduction of the moving image by the moving image reproducing unit 200 (FIG. 1). 4 (a) and 4 (b) are the same as FIGS. 3 (a) and 3 (b).

  As shown in FIGS. 4B and 4C, the size of the area frame IFM is changed by the wheel MWL operation of the mouse 160 by the user. When the user rotates the wheel MWL, the magnification parameter MI is changed. Then, the area designation information RI is changed with the change of the magnification parameter MI. The area frame superimposing unit 250 generates an area frame based on the area designation information RI changed in this way, and synthesizes it with the intermediate moving image XD. In the example of FIG. 4, when the user rotates the wheel MWL downward, the value m of the magnification parameter MI increases and the attention area represented by the area designation information RI decreases. For this reason, the area frame IFM shown in FIG. 4B becomes smaller and becomes the area frame IFMb shown in FIG.

  Switching from the area designation mode shown in FIG. 4C to the enlarged playback mode shown in FIG. 4D is performed by the user operating the mouse 160 with a button. When the user switches to the enlarged playback mode by clicking the left button MLB of the mouse 160, as shown in FIG. 4D, the attention indicated by the area frame IFMb in FIG. The image IRNb of the area is displayed.

  FIG. 5 is an explanatory diagram showing a state in which the original moving image GD is enlarged and reproduced in the moving image display area MDAa in the moving image display window MDW. In the example of FIG. 3, the moving image display area MDA is the entire display screen of the display 120 (FIG. 1), but in the example of FIG. 5, the moving image display area MDAa is in the moving image display window MDW displayed on the display screen. It is a part of. In the example of FIG. 5, unlike the example of FIG. 3, the aspect ratios of the original moving image GD and the moving image display area MDAa are different. The aspect ratio of the moving image display area MDAa changes, for example, when the user changes the shape or size of the moving image display window MDW by dragging the lower right of the moving image display window MDW. When the shape of the moving image display window MDW is set to an appropriate shape, the aspect ratio of the original moving image GD and the moving image display area MDAa becomes the same as in the example of FIG. The other points are almost the same as the example of FIG.

  FIG. 5A shows a state in which the mouse pointer MPT that moves with the movement of the mouse 160 (FIG. 1) enters the moving image display window MDW from outside the moving image display window MDW. When the mouse pointer MPT enters the moving image display window MDW, the reproduction moving image generating unit 240 (FIG. 1) enters the region designation mode, and the region frame IFMc superimposed on the video IMT represented by the original moving image GD is displayed in the moving image display region MDAa. Is displayed. In the example of FIG. 5A, since the aspect ratio of the moving image display area MDAa is longer than that of the original moving image GD, the black background IBK is displayed on the left and right of the video IMT. Since the area frame IFMc is generated so that the aspect ratio is the same as that of the moving image display area MDAa, the area frame IFMc is also horizontally longer than the video IMT. When the aspect ratio of the moving image display area MDAa is changed by changing the shape or size of the moving image display window MDW in the area designation mode, the aspect ratio of the area frame IFMc is the same as that of the moving image display area MDAa. To be changed.

  The area frame IFMc is displayed at a predetermined position in the moving image display area MDAa. In the example of FIG. 5A, since the mouse pointer MPT enters the moving image display window MDW from the lower part of the moving image display window MDW, the area frame IFMc is displayed on the lower center side of the moving image display area MDAa. When the mouse pointer MPT enters the moving image display window MDW, the mouse pointer MPT is moved to a position closest to the outer periphery of the moving image display area MDAa. The predetermined position at which the moving image display area MDAa is displayed may be, for example, the center of the moving image display area MDAa as in the example of FIG. 3 or the position at the time when the previous area designation mode ends. In this case, the mouse pointer MPT is preferably moved to a predetermined position inside the area frame IFMc (for example, the center of the area frame IFMc).

  When the user moves the mouse 160 with the mouse pointer MPT on the moving image display window MDW, the area frame IFMc moves with the mouse pointer MPT to become an area frame IFMd as shown in FIG. When the user moves the area frame IFMd to an appropriate position and then performs a button operation on the mouse 160, the operation mode of the playback video generation unit 240 changes from the area designation mode shown in FIG. 5B to FIG. 5C. Is switched to the enlarged playback mode indicated by. In the enlarged reproduction mode, as shown in FIG. 5C, the video IMTa of the attention area indicated by the area frame IFMd in FIG. 5B is displayed in the moving image display area MDAa.

  As described above, in this embodiment, the attention area can be quickly specified by moving the mouse 160 and operating the wheel MWL, so that the user can easily specify the area desired to be enlarged during reproduction of the original moving image GD. be able to. The area to be enlarged and reproduced is indicated by area frames IFM, IFMa, IFMb and IFFM superimposed on the original moving image GD, and the user can confirm the area to be enlarged and reproduced. It is possible to make the specification of the area where the user wants more accurate.

  In this embodiment, the mouse 160 is used as an input device for the user to specify a region of interest. However, a two-dimensional position specification, a button that can be turned on / off, and a continuous button are used. Any device (generally referred to as a “pointing device”) having a mechanism that allows parameter input can be used as an input device for designating a region of interest. As such an input device, for example, a trackball with a wheel can be used.

B. Variation:
In addition, this invention is not restricted to the said Example and embodiment, It can implement in a various aspect in the range which does not deviate from the summary, For example, the following deformation | transformation is also possible.

B1. Modification 1:
In the above embodiment, the attention area is designated in order to enlarge and reproduce a part of the original moving image GD on the moving image display area. However, the attention area designation can be applied to other uses. For example, the image of the designated attention area may be displayed in a different area from the moving image display area. in this case,
It is possible to display the entire original moving picture GD in the moving picture display area and at the same time to enlarge and display the image of the attention area in another area.

B2. Modification 2:
The attention area can be specified for other purposes. For example, it can be used for moving image editing in which an image of a designated region of interest is combined with another image. In this case, the shape of the attention area can be an arbitrary shape such as a circle or a triangle.

BRIEF DESCRIPTION OF THE DRAWINGS Explanatory drawing which shows the structure of the moving image display system as one Example of this invention. Explanatory drawing which shows the structure of a reproduction | regeneration animation production | generation part. Explanatory drawing which shows an example of the expansion reproduction of the moving image by a moving image reproduction part. Explanatory drawing which shows another example of the expansion reproduction of the moving image by a moving image reproduction part. Explanatory drawing which shows a mode that an original moving image is expanded and reproduced to the moving image display area in a moving image display window.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Moving image display system 110 ... Computer 120 ... Display 130 ... DVD drive 140 ... Digital video camera 150 ... Keyboard 160 ... Mouse 200 ... Moving image reproducing part 220 ... Original moving image acquisition part 240 ... Reproduction moving image generation part 242 ... Video processing part 244 ... Reproduction control unit 246 ... region frame control unit 248 ... region instruction acquisition unit 250 ... region frame superimposition unit 260 ... display control unit MLB ... left button MWL ... wheel

Claims (7)

An attention area designating device for designating an attention area of a predetermined shape that is a part of a moving image during reproduction of the moving image,
A pointing device having a position specifying mechanism for specifying a two-dimensional position and a magnification specifying mechanism for specifying a magnification;
An area instruction acquisition unit that acquires a position parameter that specifies a position of the region of interest in the moving image from the position specifying mechanism, and acquires a magnification parameter that specifies a size of the region of interest in the moving image from the magnification specifying mechanism; ,
A video playback unit for displaying the video in a video display area;
With
The moving image reproduction unit has an area designation mode for displaying an area frame having a predetermined shape representing the attention area on the moving image displayed in the moving image display area, and a normal reproduction mode for not displaying the area frame. The area designation mode is executed when the position designation mechanism is operated by a user, and the normal playback mode is executed when the position designation mechanism is not operated by the user. In the area designation mode, the area frame is An attention area designation device that displays on the moving image at a position according to the position parameter and a magnification according to the magnification parameter. The attention area specifying device according to claim 1,
The pointing device further includes an attention area confirmation mechanism for confirming designation of the attention area,
The predetermined shape is a rectangle having the same aspect ratio as the moving image display area,
The attention area designation device that enlarges and displays the image of the attention area on the moving image display area in response to the operation of the attention area determination mechanism by a user operation. The attention area designation device according to claim 1 or 2,
The attention area designation device, wherein the moving image display area is an area in which at least one of a size and a shape is variable. The attention area specifying device according to claim 2,
The moving image display area is an area having a variable aspect ratio,
The attention area designating device, wherein the moving picture reproduction unit changes the aspect ratio of the area frame to the aspect ratio of the moving picture display area when the aspect ratio of the moving picture display area changes. The attention area designation device according to claim 3 or 4,
The moving image display area is at least a part of a moving image display window displayed on a display screen,
The moving image reproduction unit determines the region frame in advance when a pointer that indicates a position in the display screen that moves according to the movement of the pointing device enters the moving image display window from outside the moving image display window. Attention area designation device that displays the position and size. Using a pointing device having a position designating mechanism for performing two-dimensional position designation and a magnification designating mechanism for designating a magnification, the attention area having a predetermined shape that is a part of the video is reproduced. A region of interest specification method specified in
(A) obtaining a position parameter for designating a position of the region of interest in the moving image from the position designation mechanism;
(B) obtaining a magnification parameter for designating a size of the region of interest in the moving image from the magnification designating mechanism;
(C) displaying the moving image in a moving image display area;
(D) a step of displaying a region frame having a predetermined shape representing the region of interest on the moving image displayed in the moving image display region when the position specifying mechanism is operated by a user;
(E) stopping the display of the area frame when the user does not operate the position specifying mechanism for a predetermined time;
With
The step (d) includes a region of interest designation method including a step of displaying the region frame on the moving image at a position according to the position parameter and a magnification according to the magnification parameter. Using a pointing device having a position designating mechanism for performing two-dimensional position designation and a magnification designating mechanism for designating a magnification, the attention area having a predetermined shape that is a part of the video is reproduced. A computer program specified in the
A position parameter acquisition function for acquiring a position parameter for specifying the position of the region of interest in the moving image from the position specifying mechanism;
A magnification parameter obtaining function for obtaining a magnification parameter for designating a size of the region of interest in the moving image from the magnification designation mechanism;
A video display function for displaying the video in a video display area;
An area frame display function for displaying an area frame having a predetermined shape representing the attention area on the moving image displayed in the moving image display area when the position specifying mechanism is operated by a user;
A function of stopping the display of the area frame when the user does not operate the position specifying mechanism for a predetermined time;
A computer program for causing a computer to
The area frame display function has a function of displaying the area frame on the moving image at a position corresponding to the position parameter and a magnification corresponding to the magnification parameter.

Images