JP2012053543A - Information processor and control method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the operability of fast-forwarding and rewinding in video playback processing based on multi-touch operation.SOLUTION: A position detection unit 115 detects two touch point positions on a display screen, and a ratio acquisition unit 116 acquires a ratio of a rotation angle and a time on the basis of a distance between the detected touch point positions. A rotation angle acquisition unit 117 acquires a rotation angle obtained by the change in a relative position of two touch point positions. A playback time determination unit 113 specifies a time to be deviated from a reference time on the basis of the rotation angle and the ratio to determine the playback time after fast-forwarding or rewinding of video data corresponding to the reference time, and a playback processing unit 114 plays back video data corresponding to the determined playback time.

Description

  The present invention relates to an information processing apparatus that reproduces video data by a multi-touch operation.

  Conventionally, there is known a video playback system that includes buttons such as a “play button”, “pause button”, “fast forward button”, “rewind button”, and a “time bar” that can specify an arbitrary playback time in the video. It has been. When the user knows the approximate playback time, a desired scene can be played back from a long-time video by specifying the playback time with the “time bar”.

  On the other hand, in recent years, devices capable of multi-touch operation have increased, and there is an operation of rotating a map by a rotation operation in a state where a touch panel as proposed in Patent Document 1 is touched with a plurality of fingers. Specifically, this is realized by rotating the map at the rotation angle of the detected rotation operation by the user.

JP 2008-158842 A

  For example, consider applying the rotation operation to a video playback operation. In this case, the operation is difficult when searching for an arbitrary scene from a long-time video. Specifically, when the ratio for one rotation operation is set to 1 minute, 120 rotation operations are required to change the reproduction time of the video data for 2 hours. On the other hand, when the ratio of one rotation operation is set to 1 hour, it is necessary to perform a slight rotation operation of only 3 ° in order to move the reproduction time after 30 seconds. In other words, it is difficult to achieve both fast forward and rewind operations that are large in time and fast forward and rewind operations that are fine in time by simply applying a conventional rotational operation technique.

  The present invention has been made in view of the above points, and has as its main object to improve the operability of fast forward / rewind in video reproduction processing by multi-touch operation.

  The information processing apparatus according to the present invention that achieves the above object includes a detection unit that detects a touch position of two points on a display screen, and a rotation angle and time based on a distance between the two points of the detected touch position. A ratio acquisition means for acquiring a ratio between the two points, a rotation angle acquisition means for acquiring a rotation angle obtained by a change in the relative position of the two touch positions, and a variation from a reference time based on the rotation angle and the ratio A reproduction time determining means for determining a reproduction time after fast-forwarding or rewinding the video data corresponding to the reference time by specifying a time to be performed, and reproduction for reproducing the video data corresponding to the determined reproduction time It has the means.

  According to the present invention, the operability of fast forward / rewind in video reproduction processing by multi-touch operation is improved.

The block diagram of the information processing apparatus in this embodiment. The figure for demonstrating rotation operation. An example of display. An example of display. The flowchart in an information processing apparatus. Correspondence table of distance between two points and time per rotation, and correspondence table of distance between two points and auxiliary display. The figure for demonstrating the modification 2. FIG. The figure for demonstrating an example of this embodiment.

[First Embodiment]
Embodiments according to the present invention will be described below in detail with reference to the accompanying drawings. However, the constituent elements described in this embodiment are merely examples, and are not intended to limit the scope of the present invention only to them. In addition, not all the combinations of features described in the present embodiment are essential for the solving means of the invention.

  FIG. 1A is a block configuration diagram of an information processing apparatus that implements the present embodiment. As shown in the figure, this apparatus includes a CPU 101 that controls the entire apparatus, a ROM 102 that stores programs executed by the CPU 101 and data to be used in advance, and a RAM 103 that is used as a work area for the CPU 101. In addition, the apparatus includes a storage device 104 that stores and holds image files, and a display control unit 106 that expands an image to be displayed on a display 105 such as a liquid crystal or performs a drawing process under the control of the CPU 101. Further, the present apparatus includes a position detection unit 108 that detects whether the operator touches the transparent touch panel 107 provided on the front surface of the display screen of the display 105, a touch position, and an interface for communicating with an external device. 109. Note that the coordinate input device represented by the touch panel 107 and the position detection unit 108 according to the embodiment can detect at least a plurality of touch positions, regardless of the type.

  In the present embodiment, an example of reproducing video data will be described as an embodiment of the information processing apparatus. In the following description, it is assumed that the video data has already been stored in the storage device 104. When a switch (not shown) is operated to turn on the power of the apparatus of this embodiment, the CPU 100 executes the program stored in the ROM 102, thereby causing the apparatus to function as the video playback apparatus described above. Become. Although the operator does not touch the display (display unit) but strictly touches the touch panel 107 on the front surface, it is hereinafter referred to as touching the display 105 for convenience.

  FIG. 1B is a functional block diagram of an information processing apparatus that implements the present embodiment.

  First, video data stored in the storage device 104 is reproduced on the display unit 111 using the reproduction processing unit 114. The display unit 111 corresponds to the display 105 and has the function of the display control unit 106 and the function of the touch panel 107.

  The operation determination unit 112 includes a position detection unit 115, a ratio acquisition unit 116, and a rotation angle acquisition unit 117, as shown in FIG. The position detection unit 115 corresponds to the position detection unit 108 in FIG. 1A, and detects two touch positions of the operator on the display screen of the display unit 111. The rotation angle acquisition unit 117 acquires the rotation angle of the rotation operation obtained by the change in the relative position of the two touch positions. In the present embodiment, the rotation angle of the rotation operation is acquired by detecting the movement of the other touch position with the one touch position as the center of rotation among the two touch positions. Further, the ratio acquisition unit 116 acquires the ratio between the rotation angle and time from the distance X between the two touch positions. In the present embodiment, the ratio between the rotation angle and time is acquired by using a correspondence table between the distance X between two points and the ratio described later.

  Based on the rotation angle and ratio acquired by the operation determination unit 112, the playback time determination unit 113 determines a playback time at which the video data displayed on the display unit 111 is rewound or fast-forwarded. The reproduction processing unit 114 rewinds or fast-forwards the video data according to the reproduction time determined by the reproduction time determination unit 113 and reproduces it.

  FIG. 2 is a diagram for explaining the rotation operation. 2A is an example of a display screen before the rotation operation, FIG. 2B is an example of a display screen after the rotation operation, and FIG. 2C is an image that is reproduced by changing the reproduction time by the rotation operation. It is an example of a display screen. 2E is an enlarged view of the touch position before the rotation operation in FIG. 2A, and FIG. 2F is an enlarged display of the touch position after the rotation operation in FIG. 2B. Is.

  In FIG. 2A, reference numeral 21 denotes a display screen on which video data stored in the storage device 104 is reproduced. Reference numeral 22 denotes an operator's hand, and reference numerals 23 and 24 denote touch positions before the rotation operation. In FIG. 2B, 24 and 25 are touch positions after the rotation operation. In this example, the rotation operation is performed with the touch position 24 as the center of rotation. When the rotation operation is performed on the display 105 as in the examples of FIGS. 2A and 2B, the reference time shown in FIG. 2A is set for the designated time as shown in FIG. 2C. Normal playback is started after fast-forwarding or rewinding from the video data corresponding to.

  In this embodiment, the “time per rotation” obtained from the distance between the two touch positions 23 and 24 and the “rotation angle” obtained by moving the touch position 25 are shown in FIG. Specify the time to be mutated from the corresponding reference time. Then, the playback time after fast-forwarding / rewinding the video data corresponding to the reference time is determined for that time.

  In this embodiment, the time per rotation is changed according to the length of the distance X between the two touch positions 23 and 24. In the present embodiment, as shown in the correspondence table of FIG. 6A, when the distance X between two points is 0 <X ≦ 3 cm, the time per rotation is 12 hours, and the distance X between the two points is 3 cm. When <X ≦ 5 cm, the time per rotation is 60 minutes, and when the distance X between the two points is 5 cm <X, the time per rotation is 60 seconds. This is set similarly to the time changed by moving the short hand, long hand and second hand of the clock. In addition, 12 hours, 60 minutes, 60 seconds, 3 cm, and 5 cm are examples for showing the relationship between the numerical values of each other, and each numerical value is not limited to these values.

  The rotation angle is an angle 26 obtained from a line segment connecting the touch positions 23 and 24 and a line segment connecting the touch positions 24 and 25 after the rotation operation. Here, the rotation angle is 360 ° for one rotation, positive in the clockwise direction and negative in the counterclockwise direction. In the example of FIG. 2 (f), since it is a clockwise rotation, it is positive. The time for fast-forwarding and rewinding is calculated as time per rotation × rotation angle ÷ 360 °. When the rotation angle is positive, rewinding is performed, and when the rotation angle is negative, fast-forwarding is performed.

  In this embodiment, the time per rotation is used as an example of the ratio between the rotation angle and the time. As another example, the time per rotation may be used. In that case, the fast-forwarding and rewinding time may be obtained as time per rotation × rotation angle. The ratio between the rotation angle and time is not limited to these.

  FIG. 5 is a flowchart in the information processing apparatus.

  In step S501, the position detection unit 115 detects two touch positions of the operator. If it demonstrates using the example of FIG.2 (d), the touch positions 23 and 24 will be detected here. In step S502, the position detection unit 115 obtains a distance X between two points detected by the position detection unit 115. If it demonstrates using the example of FIG.2 (d), the distance between the touch positions 23 and 24 will be calculated | required here.

  In step S503, the ratio acquisition unit 116 acquires the ratio between the rotation angle and the time from the distance X between the two points obtained in step S502, using the correspondence table (table) in FIG. FIG. 6A is a table showing the correspondence between the distance X between two points and the time per rotation. As described above, in this embodiment, the time per rotation is changed according to the length of the distance X between two points.

  In step S504, the ratio acquisition unit 116 acquires information related to auxiliary display using the correspondence table (table) in FIG. FIG. 6B is a table showing the correspondence between the distance X between two points and the auxiliary display. The auxiliary display “60 minutes” indicates that “the distance X between the two points does not correspond to“ 60 minutes ”but is close to the distance corresponding to“ 60 minutes ”.” Further, the auxiliary display “12 hours”. "Indicates that the current distance X between the two points does not correspond to" 12 hours ", but is close to a distance corresponding to" 12 hours ". The point-to-point distance X does not correspond to “60 seconds” but is close to the distance corresponding to “60 seconds”. Further, “OFF” in the auxiliary display indicates that the auxiliary display is not displayed. That is, according to this table, the ratio and the vicinity of the boundary are shown near the boundary where the ratio is switched (in this embodiment, 0.5 cm before and after the boundary value). Note that 0.5 cm before and after the boundary value is an example, and is not limited to this value. Note that the correspondence tables in FIGS. 6A and 6B are stored in the ROM 102 or the storage device 104.

  In step S505, the display unit 111 displays information about time per rotation and auxiliary display information. The display will be described later with reference to FIGS. In step S506, the position detection unit 115 determines whether the distance X between the two points of the touch position has changed every predetermined time. If Yes in step S506, the process returns to step S502. If No in step S506, the process proceeds to step S507.

  In step S507, the rotation angle acquisition unit 117 determines whether or not a rotation operation is performed by moving one touch position among the two touch positions. If Yes in step S507, the process proceeds to step S508. If No in step S507, the process ends.

  In step S508, the rotation angle acquisition unit 117 obtains the rotation angle of the rotation operation in step S507. Explaining using the example of FIG. 2E, here, an angle 26 obtained from a line segment connecting the touch positions 23 and 24 and a line segment connecting the touch positions 24 and 25 after the rotation operation is obtained.

  In step S509, the reproduction time determination unit 113 obtains the rewind or fast-forward reproduction time from the ratio acquired in step S504 and the rotation angle obtained in step S508. In step S510, the reproduction processing unit 114 reproduces the video data using the rewind or fast-forward reproduction time obtained in step S509.

  FIG. 3 shows an example of a display example. In FIG. 3A, when the distance X between two points is 0 <X ≦ 2.5, the ratio display 31 is performed in a thick and short form like a short hand of a watch. In FIG. 3B, when the distance X between the two points is 3.5 <X ≦ 4.5, the ratio display 32 is performed in the form of an intermediate length and thickness like a long hand of a watch. In FIG. 3C, when the distance X between the two points is 5.5 <X, the ratio display 33 is performed in a thin and long form like a second hand of a clock.

  These are merely examples, and other displays may be used. For example, as shown in FIG. 3D, not only the currently selected ratio but also the unselected ratio may be displayed together. Further, in FIG. 3, in addition to the ratio display, a reference angle and “hour”, “minute”, and “second” which are helpful for the rotation operation are displayed, but these may not be displayed. .

  FIG. 4 shows an example of a display example when auxiliary display is performed. FIG. 4A shows a ratio display 31 in a thick and short form like a short hand of a watch when the distance X between the two points is 2.5 <X ≦ 3, and an intermediate length and thick like a long hand of a watch. The auxiliary display 41 having the same length as the ratio display 32 in this form is performed.

  FIG. 4B shows the ratio display 32 when the distance X between the two points is 3 <X ≦ 3.5, and an auxiliary display having the same length as the ratio display 31 in a thick and short form like a short hand of a watch. 42 is performed.

  FIG. 4C shows an auxiliary display having the same length as the ratio display 32 and the ratio display 33 in a thin and long form such as a second hand of a clock when the distance X between the two points is 4.5 <X ≦ 5. 43.

  FIG. 4D shows the ratio display 32 and the auxiliary display 41 when the distance X between the two points is 5 <X ≦ 5.5. The ratio display and the auxiliary display are displayed so as to be distinguishable. Moreover, the display method is an example, and other displays may be used. In addition to the ratio display and the auxiliary display, FIG. 4 displays a reference angle and “hour”, “minute”, and “second” which are helpful for the rotation operation, but these are not displayed. It doesn't matter. As described above, when the distance X between the two points is near the boundary where the ratio is switched, by performing the auxiliary display, the operator can grasp that the distance is between the boundary where the ratio is switched.

  FIG. 8 is a diagram for explaining an example of the present embodiment.

  FIG. 8A shows an example when the distance X between the two points is 2 cm and the rotation angle 81 is −30 degrees. At this time, since the distance X between the two points is 2 cm, the time per rotation is “12 hours”. From the formula of time per rotation × rotation angle ÷ 360 degrees, 12 hours × (−30 degrees) ÷ 360 degrees = (− 1 hour). Therefore, in the case of the example in FIG. 8A, the rewinding is performed for one hour from the reference time.

  FIG. 8B is an example when the distance X between the two points is 6 cm and the rotation angle 82 is 30 degrees. At this time, since the distance X between the two points is 6 cm, the time per rotation is “60 seconds”. From the formula of time per rotation × rotation angle ÷ 360 degrees, 60 seconds × (30 degrees) ÷ 360 degrees = 5 seconds. Therefore, in the case of the example of FIG. 8B, it is forwarded by 5 seconds from the reference time.

  In this way, by changing the ratio of the rotation angle and time according to the value of the multi-touch distance X between two points, even if the fast-forward / rewind time is large, the fast-forward / rewind time is fine. Even if it is a return, it can be operated easily, and there is an effect that the operation is easy by multi-touch.

  As described above, according to the present embodiment, the reproduction time for fast-forwarding / rewinding video data is determined from the ratio of the rotation angle determined by the distance between two points of multi-touch to the time and the multi-touch rotation angle. Thus, the operability of fast forward / rewind in the video reproduction process is improved.

<Modification 1>
In the above embodiment, the processing is performed without setting the center of rotation, but one of the touch positions may be set as the center of rotation in advance. For example, of the two touch positions, the touch position below the display screen is the center of rotation. This is set on the assumption that the operator touches with the thumb and forefinger and rotates with the index finger.

  By setting the center of rotation in this way in advance, the rotation angle can be detected even if the position of the center is slightly shifted due to the rotation.

  As a specific processing method, in step S502, in addition to obtaining the distance X between two points, the touch position at the lower part of the display screen is obtained and set as the center of rotation. In step S508, it is determined whether the rotation is from the set center. That is, if the rotation is from the set center, it is determined as a rotation operation, and the process proceeds to step S. If the rotation is not from the set center, the processing is terminated as it is not a rotation operation. The other steps are the same as in the above embodiment.

<Modification 2>
In addition to the first modification, a touch position where the rotatable angle is large may be set as the rotation center. Specifically, in the case of FIG. 7, since the rotatable angle 702 of the touch position 701 is larger than the rotatable angle 704 of the touch position 703, the touch position 1101 is set as the center of rotation. In particular, this is set on the assumption that the operator operates around the touch position where the rotatable angle is large as shown in FIG. By doing in this way, by setting the center of rotation at the touch position where the rotatable angle becomes large, the rotation angle can be detected even if the position of the center is slightly shifted due to the rotation. it can.

  As specific processing, in step S502, in addition to obtaining the distance X between two points, a touch position where a rotatable angle is increased is obtained and set as the center of rotation. In step S508, it is determined whether the rotation is from the set center. That is, if the rotation is from the set center, it is determined as a rotation operation, and the process proceeds to step S. If the rotation is not from the set center, the processing is terminated as it is not a rotation operation.

<Modification 3>
In the above embodiment, the rotation angle and time ratio are set by assigning a time such as 12 hours, 60 minutes, and 60 seconds to one rotation. Therefore, for example, when it is desired to fast-forward for 45 minutes, the operator has to operate 3/4 rotations, and the touch position has to be moved greatly. Therefore, an operation may be performed without assigning time to an angle (for example, 60 degrees) that the operator can easily rotate, without greatly moving the touch position. For example, when allocating 12 hours, 60 minutes, and 60 seconds to an angle of 60 degrees, the ratio of rotation angle to time is 0.2 hours per 1 degree rotation, 1 minute per 1 degree rotation, 1 second per 1 degree rotation Should be set. By performing in this way, the operator can perform an operation without greatly moving the touch position, so that the operability is improved.

  As a specific process, “time per one rotation” in the table of FIG. 6A may be set to “time per one degree rotation”. For example, when time is assigned to an angle of 60 degrees, if it is determined in step S508 that the rotation angle exceeds 60 degrees, the process may be performed as 60 degrees.

(Other embodiments)
The component of the present invention can be applied to a system including a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), or a device (for example, a camera, a copier, The present invention may be applied to a facsimile machine or the like. An object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and the system reads and executes the program codes stored in the storage medium. Is also achieved. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. Examples of the storage medium for supplying the program code include a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile data storage unit, and a ROM. Can be used. Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on the instruction of the program code. Perform some of the actual processing. Furthermore, it is needless to say that the case where the functions of the above-described embodiments are realized by the processing is included. Further, the program code read from the storage medium is written to a data storage unit provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. After that, based on the instruction of the program code, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing, and the processing of the above-described embodiment is realized by the processing. Needless to say.

Claims (6)

Detecting means for detecting a touch position of two points on the display screen;
A ratio acquisition means for acquiring a ratio between the rotation angle and time based on the distance between the two points of the detected touch position;
Rotation angle acquisition means for acquiring a rotation angle obtained by a change in the relative position of the two touch positions;
Based on the rotation angle and the ratio, a reproduction time determination means for determining a reproduction time after fast-forwarding or rewinding video data corresponding to the reference time by specifying a time to be mutated from a reference time;
An information processing apparatus comprising: a reproducing unit that reproduces video data corresponding to the determined reproduction time.   The information processing apparatus according to claim 1, further comprising a display control unit that displays the ratio in the display unit.   The information processing apparatus according to claim 1, wherein the display control unit displays information indicating a vicinity of a boundary where the ratio is switched on the display unit. A detection step in which the position detection means detects two touch positions on the display screen;
A ratio acquisition step in which the ratio acquisition means acquires a ratio between the rotation angle and time based on the distance between the two points of the detected touch position;
A rotation angle acquisition step in which a rotation angle acquisition unit acquires a rotation angle obtained by a change in the relative position of the two touch positions;
Based on the rotation angle and the ratio, the reproduction time determination means determines the reproduction time after fast-forwarding or rewinding the video data corresponding to the reference time by specifying the time to be mutated from the reference time. A decision process;
A control method for an information processing apparatus, wherein the playback means includes a playback step of playing back video data corresponding to the determined playback time.   A program that causes a computer to function as each unit of the information processing apparatus according to any one of claims 1 to 3 by being read and executed by a computer.   A computer-readable storage medium storing the program according to claim 5.

Images