JP2013012036A - Image reproduction control device, image reproduction control method and image reproduction control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce a load of operation for seeking multiple images.SOLUTION: An image reproduction control device comprises: a seeking object selection part 12 for selecting an image, which is a target of seeking operation, by selecting a thumb nail; a head position retrieval part 14 for retrieving a head position of the image to be operated; a locus acquisition part 15 for acquiring coordinates and time, with respect to start and ending of movement of a cursor in a display area of the image; an operation method selection part 19 for selecting a linear locus method or a circular locus method as an image operation method; and a seeking part 18 for using a seeking amount calculated on the basis of linear loci of the cursor to seek the image with coarse time granularity from the head position when the linear locus method is selected, or using the seeking amount calculated on the basis of circular loci of the cursor to seek the image with fine time granularity from the head position when the circular locus method is selected.

Description

  The present invention relates to a video playback control apparatus, a video playback control method, and a video playback control program that control playback of a plurality of videos.

  In order to search for necessary information from a video on a computer or to reproduce it from a target position, it is necessary to seek the video. Seek means changing the playback speed (frame unit → slow motion → constant speed playback → double speed playback →...) Or changing the playback direction (playback and reverse playback). Hereinafter, changing the playback speed and the playback direction of the video is referred to as a seek operation. As a seek operation method for such an image, there is a method using a GUI. Many conventional video software uses a mouse as a GUI seek operation. For example, there are a method of dragging the playback head of the time slider, a method of clicking a playback control button prepared in advance such as fast forward and rewind.

  There are two processes in the seek operation in which the user searches for the target position from the video. One is a process in which the head position is largely moved around the target position, and the other is a process in which the head position is accurately moved small to the target position. Thus, in the seek operation, it is necessary to be able to change the head position according to the time granularity required by the user. Conventionally, seek operations have been realized by assigning different operation methods to each of these operation processes. For example, a method is known in which a time slider is used for the process of moving the head position greatly, and a control button or keyboard input is used for the process of moving the head position small.

  Patent Document 1 discloses a seek operation focusing on the locus of a mouse. When the mouse is moved on the video instead of using the time slider drag and control buttons, the position of the reproducing head corresponding to the mouse trajectory is changed to enable a seek operation. In this way, it is important for viewing the video that the user can seek the video interactively and intuitively.

JP 2000-231431 A

  Here, in patent document 1, the case where the image | video used as operation object is single is assumed. As shown in FIG. 11, if the video to be operated is a single image, the video display area 51 and the seek operation area 52 are close to each other, so the seek operation is not complicated. However, when there are a plurality of images and scenes to be operated, an operation for selecting the images and scenes to be operated from the plurality of images and scenes is required. In the following description, a plurality of scenes including one video are referred to as “a plurality of videos”.

  In particular, when a plurality of videos are displayed in a list and the video to be operated is separated from the seek operation area, the seek operation becomes complicated. That is, as shown in FIG. 12, when the video display area 51 and the seek operation area 52 are separated from each other, it is necessary to move the cursor to the seek operation area after selecting the video.

  In order to solve such a complicated operation, it is desirable that when a plurality of videos are displayed in a list, a seek operation can be continuously performed from selection of videos to be operated. In addition, when moving from the video selection to the seek operation, it is also an important requirement that the seek operation can be performed while visually maintaining the relationship between a plurality of videos. In other words, even if the seek operation is continuous from the video selection, if only the selected video is focused, it becomes difficult to compare with other video, and there is a restriction on listability that makes it impossible to grasp the relationship. .

  As one of the solutions, when the videos are displayed in a list, it is conceivable to arrange a seek operation area 52 for each video as shown in FIG. However, according to this method, the seek operation area 52 for each image becomes small, and it is difficult to make a small change in the head position, resulting in operability restrictions. In addition, by setting the seek operation area 52 for each video, there is a screen restriction that the number of videos that can be displayed in a list on the screen is reduced.

  The present invention has been made to solve the above-described problems, and provides a video playback control device, a video playback control method, and a video playback control program that can reduce a load when a seek operation is performed on a plurality of videos. The purpose is to do.

  In order to achieve the above object, the invention according to the first aspect is a video playback control device that controls playback of a plurality of videos, and a seek target selection unit that selects a video subject to a seek operation by selecting a thumbnail. A head position reading unit that reads out the head position of the video to be operated, a trajectory acquisition unit that acquires coordinates and time of cursor movement start and end in the video display area, and a linear trajectory as the video operation method An operation method selection unit for selecting a method or a circular trajectory method, and when the linear trajectory method is selected, the video is displayed with coarse time granularity from the head position with a seek amount calculated based on the linear trajectory of the cursor. When seeking and when the circular trajectory method is selected, a fine time from the head position is calculated by the seek amount calculated based on the circular trajectory of the cursor. And summarized in that and a seek unit seeking the image in degrees.

  In order to achieve the above object, the invention according to the second aspect is a video playback control method for controlling playback of a plurality of videos, wherein a seek target for selecting a target video for a seek operation by selecting a thumbnail is provided. As a selection step, a head position reading step for reading a head position of an image to be operated, a trajectory acquisition step for acquiring coordinates and time of cursor movement start and end in the image display area, and an operation method for the image An operation method selection step for selecting a linear trajectory method or a circular trajectory method, and the seek amount calculated based on the linear trajectory of the cursor when the linear trajectory method is selected, with a coarse time granularity from the head position. Seek amount calculated based on the circular trajectory of the cursor when the video is seeked and the circular trajectory method is selected And summarized in that and a seek step of seeking the image in fine time granularity from the head position.

  In order to achieve the above object, the invention according to the third aspect is a video playback control program for playback control of a plurality of videos, and selects a video to be a seek operation by selecting a thumbnail. A seek target selection step, a head position reading step for reading the head position of the video to be operated, a trajectory acquisition step for acquiring the coordinates and time of the movement start and end of the cursor in the video display area, and the video operation An operation method selection step for selecting a linear trajectory method or a circular trajectory method as a method, and a coarse time granularity from the head position with a seek amount calculated based on the linear trajectory of the cursor when the linear trajectory method is selected. To seek the image, and if the circular trajectory method is selected, calculate based on the circular trajectory of the cursor Was the subject matter that a fine time granularity from the head position in the seek amount to execute a seek step of seeking the image to the computer.

  According to the present invention, it is possible to provide a video playback control device, a video playback control method, and a video playback control program that can reduce the load when performing a seek operation on a plurality of videos.

It is a block diagram of the video reproduction control apparatus in the embodiment of the present invention. It is a flowchart which shows operation | movement of the locus | trajectory acquisition part in embodiment of this invention. It is a flowchart which shows operation | movement of the seek target selection part in embodiment of this invention. It is explanatory drawing of the center point coordinate and head position in embodiment of this invention. It is a flowchart which shows operation | movement of the seek part in embodiment of this invention. It is a figure which shows the variation | change_quantity of the head position by the cursor position in embodiment of this invention. It is a figure which shows the acquisition example of the cursor coordinate in embodiment of this invention. It is a figure which shows the example of calculation of the variation | change_quantity of the head position in embodiment of this invention. It is a figure which shows the example of a display at the time of selecting the linear locus | trajectory system in embodiment of this invention. It is a figure which shows the example of a display at the time of selecting the circular locus | trajectory system in embodiment of this invention. It is explanatory drawing in case the image | video used as operation object is single. It is explanatory drawing in case the image | video used as operation object is multiple. It is a figure which shows a mode that the seek operation area | region has been arrange | positioned with respect to each image | video.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a configuration diagram of a video reproduction control apparatus according to an embodiment of the present invention. This video playback control device is a PC or the like that displays thumbnail images and controls playback of a plurality of videos. As shown in FIG. 1, the thumbnail information storage unit 11, seek target selection unit 12, head position storage unit 13, a head position reading unit 14, a trajectory acquisition unit 15, a coordinate storage unit 16, a seek unit 18, and an operation method selection unit 19. The input unit 20 inputs a user operation to the video reproduction control device. As the input unit 20, a mouse, a stylus, a tablet pen, a touch panel, or the like can be employed. The trajectory acquisition unit 15 acquires the coordinates of the cursor based on information from the input unit 20 and stores them in the coordinate storage unit 16. The thumbnail information storage unit 11 stores in advance the thumbnail number and the center point coordinates of the thumbnail area. The seek target selection unit 12 reads out the selected thumbnail area based on the information stored in the thumbnail information storage unit 11 and gives the thumbnail number to the head position reading unit 14. The head position storage unit 13 stores the playback head position (hereinafter simply referred to as “head position”) of the displayed thumbnail, the video ID, the start time and the end time of the video section for which the thumbnail is responsible, together with the thumbnail number. To do. When storing the playback head positions of a plurality of videos, the video ID and the elapsed time from the beginning of each video are stored, or the plurality of videos are combined into one and the elapsed time from the top is stored. It is possible. The head position reading unit 14 reads the head position corresponding to the thumbnail number from the seek target selection unit 12 from the head position storage unit 13 and gives this head position to the seek unit 18. The operation method selection unit 19 selects a linear trajectory method or a circular trajectory method as an image operation method, and gives the selection result to the seek unit 18. When the linear trajectory method is selected, the seek unit 18 seeks the video with a coarse time granularity from the head position with the seek amount calculated based on the linear trajectory of the cursor. On the other hand, when the circular locus method is selected, the image is sought with a fine time granularity from the head position with the seek amount calculated based on the circular locus of the cursor. The display unit 30 is a display that displays information from the seek unit 18 and the operation method selection unit 19.

  FIG. 2 is a flowchart showing the operation of the trajectory acquisition unit 15. Hereinafter, the operation of the trajectory acquisition unit 15 will be described in detail with reference to FIG. First, the trajectory acquisition unit 15 determines whether or not the cursor is moving within the selected thumbnail area (step S1 → S2). Then, the coordinates at which the cursor starts moving are acquired as the operation start point, and the coordinates of the operation start point and the operation start time are stored in the coordinate storage unit 16 (step S3). When the cursor stops, the coordinates are acquired as an operation end point, and the coordinates of the operation end point and the operation end time are stored in the coordinate storage unit 16 (steps S4 to S6). If the cursor is off the selected thumbnail area, the coordinates immediately before the thumbnail area are acquired as the operation end point (steps S5 to S6).

  FIG. 3 is a flowchart showing the operation of the seek target selection unit 12. Hereinafter, the operation of the seek target selection unit 12 will be described in detail with reference to FIG. First, the seek target selection unit 12 reads the center point coordinates of the selected thumbnail from the thumbnail information storage unit 11 (steps S11 → S12). Then, the position of the thumbnail area on the screen is determined from the center point coordinates of the thumbnail area and the preset width and height of the thumbnail (step S13). The trajectory acquisition unit 15 described above determines whether the cursor is moving in the thumbnail area based on the position information of the thumbnail area.

  FIG. 4 is an explanatory diagram of the center point coordinates of the thumbnail area and the head position. That is, as shown in FIG. 4A, the center point coordinates of the thumbnail area are represented by the X coordinate and the Y coordinate on the screen of the display unit 30. Such center point coordinates are stored in advance in the thumbnail information storage unit 11 together with the thumbnail number, as shown in FIG. In addition, the head positions H1, H2, H3,... Of the displayed thumbnail, the ID of the video in which the thumbnail was generated, the section start times St1, St2, St3,. The section end times Et1, Et2, Et3,... Of the video in charge are stored in the head position storage unit 13 together with the thumbnail numbers as shown in FIG.

  FIG. 5 is a flowchart showing the operation of the seek unit 18. Hereinafter, the operation of the seek unit 18 will be described in detail with reference to FIG. First, the seek unit 18 determines the selected operation method based on the information from the operation method selection unit 19 (step S21). Next, a change amount of the head position is determined based on information from the head position reading unit 14 and the coordinate storage unit 16, and the head position is changed based on the change amount (steps S22 → S24, steps S23 → S24). Hereinafter, the operation for determining the amount of change in head position will be described in more detail.

  First, when the linear locus method is selected, the amount of change is determined by projecting the locus of the cursor onto the reference axis (reference axis) on the thumbnail area. That is, the head position is changed in accordance with the movement distance, movement speed, and movement direction when the locus of the cursor is drawn linearly along the reference axis. For example, when the head position is changed in accordance with the movement distance, the head position is greatly changed when the cursor is largely moved linearly along the reference axis. On the other hand, when the cursor is moved obliquely with respect to the reference axis, the amount of change does not correspond to the moving distance, but changes according to the moving distance in the reference axis direction. When the head position is changed in accordance with the moving speed, the head position changes greatly when the cursor is moved quickly. Further, when considering the moving direction, the head position changes in the normal reproduction direction when the cursor is moved to the right, and the head position changes in the reverse reproduction direction when the cursor is moved to the left.

  On the other hand, when the circular trajectory method is selected, the head position is changed in accordance with the angular velocity, moving distance, rotation speed, and rotation direction of the cursor moved in a circle on the thumbnail area. For example, when the head position is changed in accordance with the angular velocity, the head position changes greatly when the cursor is moved quickly, and the head position changes slightly when the cursor is moved slowly. When the head position is changed according to the movement distance, the head position is changed based on the arc length. That is, if the angle change amount is the same, if the circle is drawn small with the cursor, the change in the head position is small. When the head position is changed in accordance with the rotational speed, the change in the head position is larger as the rotational speed is larger, and the change in the head position is smaller as the rotational speed is smaller. Further, when considering the rotation direction, the head position changes in the normal reproduction direction when the cursor is moved clockwise, and the head position changes in the reverse reproduction direction when the cursor is moved counterclockwise.

  FIG. 6 is a diagram illustrating the amount of change in the head position depending on the cursor position. (A) and (b) show the case where the linear locus method is selected, and (c) and (d) show the case where the circular locus method is selected. In (a) and (c), the locus of the cursor is complete on the thumbnail. On the other hand, in (b) and (d), the locus of the cursor has gone out of the thumbnail. When the cursor locus goes out of the thumbnail, it is determined that the movement of the cursor is finished. Therefore, even when the moving distance and moving speed of the cursor are the same, there is a difference in the change amount of the head position.

  FIG. 7 is a diagram illustrating an example of acquiring cursor coordinates. Here, a case where the cursor moves on the thumbnail and a case where the cursor goes out of the thumbnail are illustrated by the linear trajectory method. In FIG. 7A, since the movement of the cursor is completed on the thumbnail, the coordinates (x1, y1) of the point p are stored as the start point coordinates, and the coordinates (x2, y2) of the point q are stored as the end point coordinates. y2) is stored. At the same time, the time t1 when the cursor is at the point p and the time t2 when the cursor is at the point q are also stored. On the other hand, in FIG. 7B, since the cursor moves out of the thumbnail, the coordinates (x1, y1) of the point p are stored in the start point coordinates, but the point s (x4) is stored in the end point coordinates. , Y4), not the coordinates (x3, y3) of the point r. At the same time, the time t1 when the cursor is at the point p and the time t3 when the cursor is at the point r are also stored.

  FIG. 8 is a diagram illustrating a calculation example of the change amount of the head position.

First, a calculation example of the linear trajectory method will be described. Here, the amount of change in head position is determined by the movement distance in the left-right direction. That is, as shown in FIG. 8A, when the cursor is moved linearly, the movement distance l in the left-right direction of the cursor is the x coordinate of the point p (x1, y1) and the point q (x2, y2). When used, the following equation is obtained.

The change amount H of the head position is H = αl. α is a proportional coefficient of the change amount of the head position per moving distance. Therefore, the changed head position H _after is H _after = H2 + H.

Next, a calculation example of the circular locus method will be described. Here, the change amount of the head position is determined by the angular velocity. That is, as shown in FIG. 8B, in order to obtain the angular velocity ω when the cursor is moved in a circle, the center point o (tx3, ty3), the point p (x1, y1), and the point q (x2, y2) ) Is required to be obtained as follows.

Thereby, the angular velocity ω is obtained as follows.

The change amount H of the head position is H = βω. β is a proportional coefficient of the change amount of the head position per angular velocity. Therefore, the changed head position H _after is H _after = H3 + H.

Next, another calculation example of the circular locus method will be described. Here, it is assumed that the amount of change in the head position is determined by the number of rotations. That is, as shown in FIG. 8C, the number of rotations of the locus drawn by the cursor is calculated from the point p as a starting point. In order to calculate the rotation speed of the locus drawn by the cursor, a reference angle φ when the point p becomes the start point is obtained. The head position is changed every time ± 2π from this reference angle. The angle φ between the center point O and the point p is obtained as follows.

The angle ψ between the center point O and the point q while the cursor is moving is obtained as follows.

From this, it can be said that the locus of the cursor is rotating when the difference between φ and ψ is a multiple of 2π. Therefore, the rotation speed n can be calculated as follows.

When n is an integer other than 0, that is, when the rotation is one or more clockwise or counterclockwise, the head position change amount H can be obtained as H = βω. β is a proportional coefficient of the change amount of the head position per angular velocity. Therefore, the changed head position H _after is H _after = H4 + H.

  Here, by setting appropriate proportional coefficients α and β, the head position can be changed according to the time granularity required by the user. For example, the proportionality coefficient α is set to a second unit, and the proportionality coefficient β is set to a 2-frame unit. Thus, the seek can be realized with a coarse time granularity in the linear trajectory method, and the seek can be realized with a fine time granularity in the circular trajectory method, so that an intuitive seek operation can be performed. That is, in a situation where the area to which the cursor is moved is limited, a large time granularity may be required. In this case, if the head can be largely sought by moving the cursor over a short distance, the head position can be roughly adjusted. Conversely, since the cursor movement area is limited, the time granularity may be required to be small. In this case, the head position can be finely adjusted if a small seek is possible even when the cursor is moved over a long distance. In this way, by setting appropriate proportional coefficients α and β according to the time granularity, the user's intuitive seek operation is supported.

  Further, the video section handled by the thumbnail can be calculated by the section start time St and the section end time Et. Therefore, at the time of a seek operation in the vicinity of switching of thumbnails in the video, the head position is sought until the section end time Et, or the head position change amount H calculated in consideration of the section in charge of the next thumbnail is sought. It is also possible. As a result, the seek method near the switching point can be changed according to the behavior desired by the user.

  Further, when a device such as a mouse or a tablet pen that can draw a locus while operating a button is adopted as the input unit 20, a method of determining the end of movement by on / off of the click button is also conceivable. In other words, even when the cursor appears outside the thumbnail area, the seek operation is continued while the click button is on. As a result, a more intuitive seek operation is possible.

  FIG. 9 is a display example when the linear trajectory method is selected, and FIG. 10 is a display example when the circular trajectory method is selected. As shown in these drawings, the display unit 30 displays a list of thumbnails 31 to be operated, a time slider 32, a reproduction head 33, a cursor locus, and the like. The user can select a desired operation method by using the radio button 36. In either method, a guideline for the selected operation method is displayed on the thumbnail as a guide for cursor operation. That is, when the linear trajectory method is selected, a straight guideline 35 is displayed on the thumbnail as shown in FIG. On the other hand, when the circular locus method is selected, a circular guide line 35 is displayed on the thumbnail as shown in FIG. By drawing the locus of the cursor along this guideline 35, the playback position can be changed intuitively and smoothly even when the thumbnail area is small. In addition, since the currently selected operation method can be visually presented to the user, there is an effect of preventing an operation error.

  As described above, according to the video reproduction control apparatus in the embodiment of the present invention, it is possible to reduce a load when performing a seek operation on a plurality of videos. That is, based on the locus of the cursor on each display area of a plurality of videos, the speed at which the video displayed on the display area is sent is changed. Thereby, even when seeking a plurality of videos in parallel, it is possible to prevent the operation from becoming complicated. In addition, both a linear trajectory method for controlling reproduction at a high speed and a circular trajectory method for controlling reproduction at a slow speed are provided. Thereby, since the user can switch between the two operation methods, the operation efficiency is high and an intuitive seek operation is possible.

DESCRIPTION OF SYMBOLS 11 ... Thumbnail information storage part 12 ... Seek object selection part 13 ... Head position storage part 14 ... Head position reading part 15 ... Trajectory acquisition part 16 ... Coordinate storage part 18 ... Seek part 19 ... Operation method selection part 20 ... Input part 30 ... Display section

Claims (3)

A video playback control device that controls playback of a plurality of videos,
A seek target selection unit that selects a target video for a seek operation by selecting a thumbnail;
A head position reading unit for reading the head position of the image to be operated;
A trajectory acquisition unit for acquiring coordinates and time of the movement start and end of the cursor in the display area of the video;
An operation method selection unit for selecting a linear locus method or a circular locus method as the operation method of the image;
When the linear trajectory method is selected, the image is sought with coarse time granularity from the head position with the seek amount calculated based on the linear trajectory of the cursor, and when the circular trajectory method is selected. A seek unit that seeks the video with a fine time granularity from the head position with a seek amount calculated based on a circular locus of the cursor;
A video reproduction control apparatus comprising: A video playback control method for controlling playback of a plurality of videos,
A seek target selection step for selecting a video to be a target of a seek operation by selecting a thumbnail;
A head position reading step for reading the head position of the image to be operated;
A trajectory acquisition step for acquiring coordinates and time of the start and end of movement of the cursor in the display area of the video;
An operation method selection step of selecting a linear locus method or a circular locus method as the operation method of the video;
When the linear trajectory method is selected, the image is sought with a coarse time granularity from the head position with the seek amount calculated based on the linear trajectory of the cursor, and when the circular trajectory method is selected. A seek step for seeking the video with a fine time granularity from the head position with a seek amount calculated based on a circular locus of the cursor;
A video reproduction control method comprising: A video playback control program for controlling playback of a plurality of videos,
A seek target selection unit step for selecting a video to be a target of a seek operation by selecting a thumbnail;
A head position reading step for reading the head position of the image to be operated;
A trajectory acquisition step for acquiring coordinates and time of the start and end of movement of the cursor in the display area of the video;
An operation method selection step of selecting a linear locus method or a circular locus method as the operation method of the video;
When the linear trajectory method is selected, the image is sought with coarse time granularity from the head position with the seek amount calculated based on the linear trajectory of the cursor, and when the circular trajectory method is selected. A seek step for seeking the video with a fine time granularity from the head position with a seek amount calculated based on a circular locus of the cursor;
A video playback control program for causing a computer to execute.

Images