JP5475905B2 - Playback apparatus and playback method - Google Patents

Description

  The present invention relates to a playback device and a playback method.

  Recent personal computers, portable video photographing devices, digital still cameras, and the like are display devices capable of displaying and reproducing large-capacity and long-time moving images. In this display device, control items such as a slide bar or a fast forward / rewind button are arranged on the screen above or below the moving image, and a scene search of the moving image is performed by the user operating the control item. ing.

  However, when a scene search is performed using a slide bar from a long-time moving image, the slide bar may jump to a far frame just by moving the dot by one dot. Sexuality sometimes worsened. Patent Documents 1 and 2 are known as techniques for improving operability when searching for a desired scene from a long-time moving image.

  Patent Document 1 discloses a technique for improving operability when searching for a desired scene by causing a sub-slide bar having a high resolution to appear next to a main slide bar. Patent Document 2 discloses a technique for improving the operability when searching for a desired scene by changing the search speed with the absolute coordinate value of the mouse pointer from an arbitrarily defined origin.

JP 2001-202176 A JP-A-5-236418

  However, in the method described in Patent Document 1, it is necessary to prepare an area for displaying a sub-slide bar in addition to an area for reproducing a moving image. There is a possibility that the visibility of a moving image at the time of searching is lowered. Further, in the method described in Patent Document 2, there is a case in which the time lag until the search operation is stopped when a desired scene is found may advance ahead of the desired scene, and further improvement in operability has been demanded. .

  The present invention has been made for the purpose of solving at least one of the problems of the prior art. An object of the present invention is to provide a playback apparatus and a playback method that can easily search for a desired scene from a series of images without reducing the visibility of the images.

  The object is to display a display unit having a touch sensor, display control means for reproducing and displaying a series of image data, display means for detecting a touch operation on the touch sensor, and the series of image data. When the detection unit detects a drag operation while displaying on the display unit, the series of image data forward feed processing or reverse feed processing is performed according to the direction and movement amount of the drag operation. And a processing unit that performs the drag operation, the processing unit sends the series of image data with respect to a lateral movement amount of the touch sensor according to a vertical touch position of the touch sensor in the drag operation. And when the drag operation is performed in an oblique direction of the touch sensor, the processing means performs the drag operation in the middle of the drag operation. Depending on the direction of the touch position is achieved by the reproducing apparatus and changes the feeding amount of the series of image data with respect to the amount of movement of the transverse direction.

  Further, the above object is a playback method by a playback device including a display unit having a touch sensor, wherein the display control unit of the playback device plays back a series of image data and displays it on the display unit. When the detection unit of the playback device detects a drag operation in the detection step while detecting the touch operation on the touch sensor and displaying the series of image data on the display unit. The processing means of the playback device has a processing step for performing forward feed processing or reverse feed processing of the series of image data in accordance with the direction and movement amount of the drag operation, and in the processing step, In the drag operation, the feed amount of the series of image data with respect to the lateral movement amount of the touch sensor differs according to the vertical touch position of the touch sensor. In the case where the drag operation is performed in an oblique direction of the touch sensor, in the processing step, in the middle of the drag operation, the lateral movement amount according to the vertical touch position. It is also achieved by a reproduction method characterized by changing the feed amount of the series of image data.

  According to the present invention, it is possible to easily search for a desired scene from a series of images without reducing the visibility of the images.

[First Embodiment]
Hereinafter, preferred and exemplary embodiments of the present invention will be described in detail with reference to the drawings. In the first embodiment, a portable display device capable of reproducing moving images will be described as an example. FIG. 1 is a block diagram illustrating a hardware configuration of the display device 1 according to the first embodiment.

  As illustrated in FIG. 1, the display device 1 includes a monitor 101, a CPU 102, a RAM 103, a ROM 104, a button 105, a touch sensor 106, an audio output unit 107, and a storage unit 108. In the display device 1, the respective units are connected to each other by a bus 109. CPU stands for Central Processing Unit, RAM stands for Random Access Memory, and ROM stands for Read Only Memory.

  The monitor 101 is an LCD (Liquid Crystal Display) or the like, and performs video output according to the video signal input under the control of the CPU 102. Various application programs are stored in the ROM 104, and the CPU 102 centrally controls the operation of the display device 1 by reading and executing the application programs stored in the ROM 104.

  The button 105 accepts a user operation input and outputs a signal corresponding to the operation input to the CPU 102. Specifically, the button 105 is a button that can be pressed by the user, and outputs a signal corresponding to the pressing operation of the button to the CPU 102. In the CPU 102, an interrupt is generated by a signal corresponding to the pressing operation of the button 105, and the pressing state of the button 105 can be detected.

The touch sensor 106 as a detection means has a rectangular area (sensing area) where contact can be sensed, and outputs a signal indicating the contact position in the area to the CPU 102 when the user touches or drags the sensing area. is there. For example, the touch sensor 106 may be a pressure-sensitive (resistive film pressure) sensor in which transparent electrodes are arranged in a grid pattern on the surface of the sensing region. In the CPU 102, an interrupt is generated when touching or dragging in the sensing area of the touch sensor 106, and coordinates indicating a contact position in the sensing area can be detected. In the display device 1, the instruction of one point in the display area of the monitor 101 is detected by the CPU 102 according to the coordinates indicating the contact position of the touch sensor 106.
As will be described later, in this embodiment, a drag operation on the touch sensor 106, more specifically, an operation of scrolling or dragging a displayed image is recognized as a specific operation related to display control, and responds to the specific operation. Various display controls.

  The audio output unit 107 is an earphone jack, a speaker, or the like, and performs audio output based on an audio signal input according to an instruction from the CPU 102. The storage unit 108 is a semiconductor memory, HDD (Hard Disk Drive), or the like, and stores application programs, various setting data, moving image data, still image data, and the like.

  For example, the ROM 104 stores a moving image reproduction application program. The CPU 102 as the display control means controls the reproduction of moving images on the display device 1 by executing the moving image reproduction application program. Specifically, the CPU 102 expands the moving image data read from the storage unit 108 in the work area of the RAM 103 according to the moving image reproduction application program, performs data processing such as decryption processing and conversion processing, and then processes the processed moving image. Is displayed in the display area of the monitor 101. Further, the CPU 102 similarly develops the audio data stored in the storage unit 108 as a set together with the moving image data in the work area of the RAM 103, performs predetermined processing, and then outputs it to the audio output unit 107. In this way, the display device 1 performs the moving image display stored in the storage unit 108 and the sound reproduction corresponding to the moving image. In the display device 1, an instruction to select a moving image to be reproduced and an operation instruction at the time of reproducing the moving image are received from the user via the button 105 or the touch sensor 106.

  FIG. 2 is a conceptual diagram illustrating the front appearance of the display device 1. As shown in FIG. 2, in the display device 1, each block illustrated in FIG. 1 is stored in a housing 201. A monitor 101, buttons 105, and a touch sensor 106 are arranged on the front surface of the housing 201 that is the front side of the display device 1. In addition, an earphone jack 204 is disposed on the upper surface of the housing 201.

  In the housing 201, the touch sensor 106 is mounted on the screen area of the monitor 101. Therefore, in the display device 1, by touching an arbitrary place in the screen area of the monitor 101, the coordinates on the touched screen area can be acquired and an instruction of one point in the display area can be detected. Further, the display device 1 can output sound from the earphone by connecting an earphone (not shown) to the earphone jack 204.

  Next, an outline of the operation of the display device 1 as a moving image playback player will be described. As illustrated in FIG. 3, the display device 1 has a function as a moving image reproduction player that reproduces an arbitrary moving image selected from the thumbnail list on the monitor 101 when the CPU 102 described above executes the moving image reproduction application program. . For example, the display device 1 displays a thumbnail list of moving images stored in the storage unit 108 on the monitor 101, receives a selection instruction from the user by the touch sensor 106, and the selected moving image is displayed on the monitor 101. indicate.

  The moving image playback player operates in an operation mode such as a thumbnail mode for displaying a thumbnail list and receiving a selection of a moving image to be played back, a playback mode, and a control mode for receiving an instruction for controlling a playback position. Hereinafter, the operation mode of the video player will be described in detail.

  FIG. 4 is a conceptual diagram illustrating the transition of the operation mode of the video player. As shown in FIG. 4, the moving image playback player operates in the operation modes of the thumbnail mode, the playback mode, the control panel display mode, and the guide display mode.

  In the thumbnail mode, a single or a plurality of moving images stored in the storage unit 108 are displayed as thumbnails on the monitor 101. In the thumbnail mode, an instruction to select an arbitrary moving image is received from the user via the touch sensor 106. When a moving image is selected in the thumbnail mode, a transition is made to a reproduction mode for reproducing the selected moving image.

  In the playback mode, the moving image selected in the thumbnail mode is displayed on the storage unit 108. In the display mode, when the user taps the touch sensor 106, the control panel display mode is entered. In the reproduction mode, the user touches the touch sensor 106 and then drags without releasing his / her finger to shift to the guide display mode. Details of the guide display mode will be described later.

  In the control panel display mode, in addition to a slide bar that indicates the playback position of a moving image, a control panel in which control items including play, stop, pause, fast forward, and rewind buttons are arranged is displayed on the storage unit 108. To do. In the control panel display mode, by detecting a touch position when the user touches the touch sensor 106, an operation instruction for a control item corresponding to the touch position is received, and playback of a moving image displayed on the storage unit 108 is controlled. To do.

  For example, in the control panel display mode, when an area on the screen of the storage unit 108 where the fast-forward button is displayed is touched, the moving image is played back in fast-forward. Similarly, when the rewind button is touched, the moving image is rewound and reproduced. When the pause button is tapped, the playback of the moving image is paused. When the pause button is further tapped in the pause state, the pause state is canceled and the reproduction of the moving image is resumed. When the playback button is tapped, the playback mode is entered. When the stop button is tapped, the thumbnail mode is entered.

  In the guide display mode, when a predetermined time has elapsed since the detection of the touch position by the touch sensor 106 after the finger was removed from the monitor 101, the mode is changed to the reproduction mode. In the guide display mode, if the monitor 101 is touched and dragged again within a predetermined time after the finger is removed from the monitor 101, the guide display mode continues.

The guide display mode will be described below. When the screen area of the monitor 101 is touched and dragged without releasing the finger while the moving image is being reproduced or paused, the mode is shifted to the guide display mode. In the guide display mode, as shown in FIG. 5, a translucent guide image 501 is superimposed and displayed on a display area including an area for displaying a moving image on the screen of the monitor 101. By displaying the guide image 501 in a superimposed manner, a guideline for dividing the screen area of the monitor 101 into a plurality of zones and a scale value assigned to each zone are displayed on the screen of the monitor 101. This scale value indicates the sensitivity that determines how much time or how many frames to fast forward / reverse the image feed operation.
That is, the scale value can be said to be a sensitivity for differentiating the fast-forward amount or the rewind amount of the image for the same operation or operation amount. Here, the fast-forward amount and the rewind amount are, for example, the number of frames (or the number of images) and the elapsed time.
More specifically, this scale value is a moving image playback speed, and indicates the number of frames or time of a moving image that jumps per unit moving amount in response to an instruction (drag) for moving one point in the touch sensor 106, for example. Value. The playback frame of the moving image is controlled based on the scale value (playback speed) and the amount of movement of the display pointer at the time of dragging, details of which will be described later.

  In the example of FIG. 5, the belt-like zones are stacked in stages from the bottom to the top of the screen area. Specifically, the zones are divided so that the resolution changes nonlinearly or linearly with respect to the vertical coordinates of the screen area. Each zone has “× 1/3”, “× 1/10”, “× 1/50”, “× 1/100”, “× 1/300”, “× 1” in order from the bottom of the screen area. A scale value of “/ 1000” is assigned. The order of the assigned scale values is “× 1/3”, “× 1/10”, “× 1/50”, “× 1/100”, “× 1/300” in order from the top of the screen area. Or “× 1/1000”.

In this guide display mode, the moving image is forward-forwarded (fast-forwarded) when dragged to the right along the belt-shaped zone, and the moving image is fed backward (rewinded) by dragging to the left. Also, during fast forward / rewind, as shown in the following equation (1), the total playback time of moving images and the amount of movement of the display pointer during dragging are multiplied by the scale value assigned to each zone.・ This is the amount of time change of the playback frame due to rewinding.
Expression (1): Frame movement amount (time) = total moving image playback time × scale value × drag movement amount

  Here, Formula (1) will be described in detail below. The unit of the total playback time of moving images is seconds, and the amount of drag movement is 1 when dragging from the left end to the right end of the screen.

  For example, a moving image having a total reproduction time of 120 minutes (120 × 60 = 7200 seconds) will be described as an example. As shown in FIG. 6, a scale value “× 1/3” is assigned to the zone 601. Therefore, the zone 601 functions as a slider that moves a frame of 120 minutes (7200 seconds) × 1/3 (scale value) × 1 (drag movement amount) = 40 minutes (2400 seconds).

  Similarly, the zone 602 is assigned a scale value of “× 1/300”. Accordingly, the zone 602 functions as a slider that moves a frame of 120 minutes (7200 seconds) × 1/300 (scale value) × 1 (drag movement amount) = 24 seconds.

  Here, the determination method of the scale value in Formula (1) is demonstrated in detail. As shown in FIG. 7, it is assumed that the sensing area of the touch sensor 106 has an X coordinate in the right direction and a Y coordinate in the downward direction with the upper left corner as the origin. The sensing area of the touch sensor 106 has a resolution of 800 pixels in the X coordinate direction and 600 pixels in the Y coordinate direction.

  As shown in FIG. 7, if the Y coordinate of the touched point 701 is 116 pixels, the second zone from the top (from 101 to 200 pixels) among the zones equally divided into 6 in the direction of the Y coordinate of the screen area. Is recognized as being touched. That is, in the direction of the Y coordinate as the first direction in the display area of the monitor 101, it is recognized that the display pointer is operated in the second zone among the zones in which the scale values are set stepwise. The scale value “× 1/300” assigned to this zone is the current scale of the slider.

  FIG. 8 is a flowchart showing a method for calculating a scale value when the screen area is 800 pixels in the X coordinate direction and 600 pixels in the Y coordinate direction. As shown in FIG. 8, the CPU 102 acquires the value of the Y coordinate of the point touched by the touch sensor 106 and stores it in y_begin (S101). Note that y_begin is the name of a variable secured in the work area on the RAM 103 in order to store the touched Y coordinate value.

  Next, the CPU 102 divides this size into six equal parts from the vertical pixel size of the screen area of the monitor 101 and assigns the area of each zone. In this embodiment, since there are 600 pixels in the Y coordinate direction, 1 to 100, 101 to 200, 201 to 300, 301 to 400, 401 to 500, and 501 to 600 pixels are assigned to each zone. It becomes.

  Next, the CPU 102 determines whether or not the value of y_begin is between 1 and 100 pixels and the touched zone is the first zone (S103). If it is determined in S103 that the value of y_begin exists in the first zone, the CPU 102 as the playback speed setting means sets “× 1/1000” in the scale (S108). The scale is a name of a variable secured in the work area on the RAM 103 in order to store the set scale value.

  When the y_begin value does not exist in the first zone, the CPU 102 determines whether the y_begin value is between 101 and 200 pixels and the touched zone is the second zone ( S104). When it is determined in S104 that the value of y_begin exists in the second zone, the CPU 102 sets “× 1/300” in the scale (S109).

  Further, when the value of y_begin does not exist in the second zone, the CPU 102 determines whether the value of y_begin is between 201 to 300 pixels and the touched zone is the third zone ( S105). When it is determined in S105 that the value of y_begin exists in the third zone, the CPU 102 sets “× 1/100” in the scale (S110).

  Similarly, the CPU 102 determines whether or not it is the fourth zone (301 to 400 pixels) in S106, and determines whether or not it is the fifth zone (401 to 500 pixels) in S107. Then, if it is the fourth zone, “× 1/50” is set, and if it is the fifth zone, “× 1/10” is set to the sixth zone (501 to 600 pixels) instead of the fifth zone. Is set to “scale” (S111 to S113). Through the processing described above, scale is set according to the zone in which the operation is performed among the zones in which the scale value is set stepwise in the direction of the Y coordinate as one direction in the display area of the monitor 101. It will be.

  From the above, the user can select a scale value set for the drag operation depending on which zone of the sensing area of the touch sensor 106 the drag operation is performed. For example, if the user wants to fast-forward / rewind at high speed, the user can find and drag the zone displayed as “× 1/3” from the zone displayed on the monitor screen. If the user wants to fast forward / rewind slowly, the user can similarly find and drag the zone displaying “× 1/300” from the monitor screen. Note that this semi-transparent guide image 501 can be set in a non-display state by a user setting via the button 105 or the like.

  FIG. 9 is a flowchart of the program in the playback mode of the video playback player. Specifically, FIG. 9 is a flowchart of a program for shifting from the reproduction mode to the guide display mode or to the control panel display mode.

  As shown in FIG. 9, in the playback mode, the CPU 102 determines whether or not a finger touches the touch sensor 106 in S201. When a finger touches the touch sensor 106 in S201, the CPU 102 sequentially performs the processes after S201.

  The CPU 102 acquires the X coordinate and Y coordinate of the point (one point) at which the touch sensor 106 sensed the finger on the monitor 101 in S202, and stores the X coordinate sensed in S203 in x_begin and the Y coordinate in y_begin. Note that x_begin is the name of a variable secured in the work area on the RAM 103 in order to store the touched X coordinate value. Next, the CPU 102 determines whether or not the finger is separated from the touch sensor 106 in S204. If the finger is separated from the touch sensor 106, the CPU 102 determines whether or not the time when the finger is separated is within a predetermined time in S205.

  When the time in which the finger is removed in S205 is within a certain time, the CPU 102 shifts the operation mode from the display mode to the control panel display mode. That is, the CPU 102 detects whether or not the touch sensor has been tapped with a combination of S204 and S205, and when tapped, the CPU 102 shifts from the playback mode to the control panel display mode.

  When the finger is not separated from the touch sensor 106 in S204, the CPU 102 acquires the X coordinate and the Y coordinate of the current pointer with the finger still touched in S206. Next, the CPU 102 stores the X coordinate acquired in S207 in x_current and the Y coordinate in y_current. Note that x_current is the name of a variable secured in the work area on the RAM 103 in order to store the current value of the touched X coordinate. Similarly, y_current is the name of a variable secured in the work area on the RAM 103 in order to store the current value of the touched Y coordinate. As described above, in S206 and S207, a drag that is an instruction to move a designated point can be detected, and the amount of movement of that point can be acquired.

  Next, the CPU 102 determines whether or not a drag of a certain distance or more has been detected based on the distance between the point where the touch of x_begin and y_begin is started in S208 and the current point of x_current and y_current. If the CPU 102 can detect a drag over a certain distance, the CPU 102 shifts the operation mode from the reproduction mode to the guide display mode. If the CPU 102 cannot detect a drag beyond a certain distance, the CPU 102 returns to S204 and continues the process.

  As described above, when the tap is performed by the touch sensor 106, the display device 1 shifts the operation mode from the reproduction mode to the control panel display mode. Further, the display device 1 shifts the operation mode from the reproduction mode to the guide display mode when the touch sensor 106 is dragged over a certain distance.

  FIG. 10 is a flowchart of the program in the guide display mode of the video player. Specifically, FIG. 10 is a flowchart of a frame advance process during the guide display mode and a program for shifting from the guide display mode to the reproduction mode.

  As shown in FIG. 10, in the guide display mode, the CPU 102 displays a guide image 501 on the screen of the monitor 101 in S301. Next, the CPU 102 calculates the resolution from the value of y_begin in S302 and stores it as a scale. Specifically, in S302, the CPU 102 sets the scale according to the flowchart illustrated in FIG.

  Next, the CPU 102 detects whether or not the finger is removed from the monitor 101 in S303 from the output of the touch sensor 106 installed on the monitor 101, and determines whether or not a certain time has passed since the finger was removed. Here, when a certain time has elapsed after the finger is removed, the CPU 102 shifts the operation mode from the guide display mode to the reproduction mode.

  That is, the display device 1 shifts to the reproduction mode when the operation by the touch sensor 106 is not performed for a predetermined time during the guide display mode. Further, if the display device 1 is dragged again after a certain time has elapsed after the finger is removed, the guide display mode is continued without shifting to the reproduction mode. Therefore, by repeating the operation of dragging and releasing the finger and dragging and releasing the finger, it is possible to perform the operation of fast-forwarding and rewinding the frames one after another.

  If the finger is still touched on the screen of the monitor 101 in S303, the CPU 102 acquires the X coordinate and Y coordinate of the current pointer in S304, and uses the acquired X coordinate as x_current and the acquired Y coordinate. Store in y_current (S305).

Next, in S306, the CPU 102 obtains the drag movement amount from the difference between x_current and x_begin and the width L in the X direction of the screen area (sensing area) as shown in the following equation (2). That is, the drag movement amount for designating the playback frame of the moving image is obtained from the pointer movement amount in the X coordinate direction, which is the second direction orthogonal to the Y coordinate direction, which is the first direction.
Formula (2): Drag movement amount = (x_current−x_begin) / L

  Then, the CPU 102 obtains the frame movement amount (a) as shown by the equation (1) based on the drag movement amount, the total moving image reproduction time (m), and the scale value (scale). Next, in step S307, the CPU 102 advances the playback frame of the moving image displayed on the monitor 101 by the calculated frame movement amount, and then returns the process to step S303. Regarding the movement of the playback frame, when dragging from the left to the right in the sensing area of the touch sensor 106, in the playback direction according to the amount of movement, conversely, when dragging from the right to the left in the sensing area. It is assumed that the movement proceeds in the reverse direction of the reproduction direction according to the movement amount.

  Here, as an example, when a moving image of 120 minutes is played, dragging is started from a point having an X coordinate of 200 and a Y coordinate of 468, and then dragging to a point having an X coordinate of 600 and a Y coordinate of 468. I will explain. The screen area (sensing area) is 800 pixels in the X direction and 600 pixels in the Y direction.

  First, since the Y coordinate is 468, the set scale value (scale) is “× 1/10”. Further, according to the equation (2), the drag movement amount is (600−200) /800=0.5. Therefore, according to Expression (1), the frame movement amount is 120 × (1/10) × 0.5 = 6 (minutes), and the moving image advances by 6 minutes by the illustrated operation.

  In addition, when a 125 minute moving image is being played back, a case where dragging starts from a point with an X coordinate of 0 and a Y coordinate of 116, and a drag to a point with an X coordinate of 800 and a Y coordinate of 116 will be described below. To do. The screen area (sensing area) is as described above.

  First, since the Y coordinate is 116, the set scale value (scale) is “× 1/300”. Further, according to the equation (2), the drag movement amount is (800-0) / 800 = 1. Therefore, according to the expression (1), the frame movement amount is 125 (125 minutes = 7500 seconds) × (1/300) × 1 = 25 (seconds), and the moving image advances by 25 seconds by the illustrated operation. Further, in the case of a moving image that displays 32 frames per second, 25 (seconds) × 32 (frames) = 800 (frames), and dragging one pixel moves the moving image by one frame.

  Here, a case where a moving image of 125 minutes displayed in 32 frames per second is operated with one slide bar having a length of 800 pixels as in the past will be exemplified. In this case, 125 (minutes) × 60 (seconds / minute) × 32 (frames / second) / 800 (pixels) = 300 (frames). When one pixel is dragged, 300 frames are advanced. Therefore, in this embodiment, it can be seen that by performing a drag operation in a zone where the scale value (scale) is “× 1/300”, a frame search can be performed at a level finer than that of a conventional slide bar. As described above, in this embodiment, the user can easily search for a desired scene by performing a drag operation in a zone in which the scale, which is the amount of frame movement per pixel, is set to a desired value. It becomes. Further, the display device 1 does not reduce the visibility of the moving image because the pointer is operated by the touch sensor 106 in the display area including the area where the moving image is displayed on the monitor 101.

[Second Embodiment]
In the first embodiment, the moving amount of the frame with respect to the unit moving amount of the drag changes depending on each zone. That is, in the first embodiment, the scale value, which is the moving image playback speed, is set stepwise with respect to the Y coordinate value, and the scale value is set nonlinearly according to the position of the Y coordinate. . On the other hand, in the second embodiment, a case where the scale value is set linearly (dynamically) according to the value of the Y coordinate without being distinguished by the zone is illustrated.

  FIG. 11 is a conceptual diagram illustrating the setting of the scale value according to the first embodiment, and illustrates how the scale value is set nonlinearly with respect to the value of the Y coordinate. As shown in FIG. 11, the Y coordinate in the zone 1101 where the scale value of “× 1/100” is set functions as a slider of the scale of “× 1/100”, regardless of where it is dragged. In addition, if it is dragged from within the “× 1/50” zone, it functions as a slider with a scale of “× 1/50”. That is, in the example of FIG. 11, the scale is determined nonlinearly from the Y coordinate that is the starting point of the drag.

  FIG. 12 is a conceptual diagram illustrating the setting of the scale value according to the second embodiment, and illustrates how the scale value is set linearly with respect to the Y coordinate. As shown in FIG. 12, when a point 1201 in the middle on the monitor 101 is dragged as a starting point, it functions as a slider having a scale of “× 1/50”. When dragging a point 1202 one point above the point 1201 as a starting point, the scale is “× 1/51”, and when dragging a point 1203 above the starting point, the slider is a scale of “× 1/52”. Function. That is, in the second embodiment, a scale value is set linearly with respect to the Y coordinate and functions as a slider of the set scale.

[Third Embodiment]
Next, as a third embodiment, a case will be described in which the position of the pointer is acquired in real time during dragging, and the current scale calculated from the Y coordinate where the current pointer is located is constantly updated. Specifically, as shown in FIG. 13, the behavior when dragging diagonally will be described as an example.

  When dragging as shown in FIG. 13, in the first embodiment, a scale corresponding to the Y coordinate at the point 1301 at which dragging is started is set. Then, the frame advances by an amount corresponding to the movement amount 1303 decomposed in the X coordinate direction in the dragged vector 1302.

  On the other hand, in the third embodiment, the position of the pointer (X coordinate, Y coordinate) is acquired in real time during dragging, and the current scale calculated from the Y coordinate where the current pointer is located is constantly updated. Then, the frame advances in accordance with the updated current scale and the movement amount decomposed in the X coordinate direction. In this case, since the scale continues to change in real time while dragging in an oblique direction, a frame search in which the moving amount of the frame is dynamic becomes possible.

  Specifically, the CPU 102 performs processing to be described later at a predetermined cycle, decomposes the locus of the pointer that moves by dragging into X-coordinate and Y-coordinate components, and moves the movement amount in the X-coordinate direction and the position of the Y-coordinate. Get the scale value according to. Next, the CPU 102 controls the playback frame of the moving image based on the acquired movement amount and scale value.

  FIG. 14 is a flowchart of a program in the guide display mode according to the third embodiment. As shown in FIG. 14, in the guide display mode, the CPU 102 displays a guide image 501 on the screen of the monitor 101 in S401. Next, in step S <b> 402, the CPU 102 substitutes x_begin and y_begin indicating the drag start point in x_current and y_current.

  Next, in step S403, the CPU 102 detects whether or not the finger has been removed from the monitor 101 from the output of the touch sensor 106 installed on the monitor 101, and determines whether or not a certain time has passed since the finger has been removed. Here, when a certain time has elapsed after the finger is removed, the CPU 102 shifts the operation mode from the guide display mode to the reproduction mode.

  If the finger remains touched on the screen of the monitor 101 in S403, the CPU 102 substitutes the X coordinate and Y coordinate of the current pointer for x_old and y_old in S404. Note that x_old and y_old are names of variables secured in the work area on the RAM 103 in order to record the history of touched X and Y coordinates.

  Next, the CPU 102 acquires the X coordinate and Y coordinate of the current pointer from the touch sensor 106 in S405, and stores the acquired X coordinate in x_current and the acquired Y coordinate in y_current (S406).

  Next, the CPU 102 calculates a resolution from the value of y_current in step S407 and stores it as a scale. Specifically, in S407, the CPU 102 sets the scale according to the flowchart illustrated in FIG.

  Next, in step S <b> 408, the CPU 102 obtains the frame movement amount (a) from x_current, x_old, and scale as indicated by the expression (1). Next, in step S409, the CPU 102 advances the moving image displayed on the monitor 101 by the calculated frame movement amount, and then returns the process to step S403.

[Fourth Embodiment]
In the first embodiment, a portable display device that can reproduce a moving image having a monitor and a touch panel is illustrated. This display device may be a personal computer as in the fourth embodiment described below.

  Specifically, as shown in FIG. 15, a personal computer 1500 in which the button 105 illustrated in FIG. 1 is replaced with a keyboard 1505 and the touch sensor 106 is replaced with a mouse 1506 may be used. Note that the mouse 1506 may be a pointing device other than a mouse, such as a joystick or a touch pad.

  The keyboard 1505 has keys that can be pressed, and outputs a signal indicating the key pressed by the user to the CPU 1502 to cause the CPU 1502 to generate an interrupt. When an interrupt occurs, the CPU 1502 detects a key pressing state and which key is pressed.

  The mouse 1506 is, for example, a laser-type or optical-type mouse, and can detect the location pointed by the user. Also, the mouse 1506 outputs a signal indicating the mouse button pressed by the user to the CPU 1502, thereby generating an interrupt to the CPU 1502 and notifying the CPU of the coordinates on the dragged or clicked area. ing.

  Note that the monitor 1501, the CPU 1502, the RAM 1503, the ROM 1504, the audio output unit 1507, and the storage unit 1508 are the same as those illustrated in FIG. Each part of the personal computer 1500 is connected to each other by a bus 1509.

  For example, in the personal computer 1500, the ROM 1504 stores a moving image playback application program, and the CPU 1502 executes the moving image playback application program. As a result, the CPU 1502 controls moving image reproduction in the personal computer 1500. Specifically, the CPU 1502 expands the moving image data read from the storage unit 1508 in the work area of the RAM 1503 according to the moving image reproduction application program. Next, the CPU 1502 performs data processing such as decoding processing and conversion processing on the developed moving image data, and displays the processed moving image on the monitor 1501. Further, the CPU 1502 similarly expands the audio data stored in the storage unit 1508 together with the moving image data in the work area of the RAM 1503, performs predetermined processing, and then outputs the audio data to the audio output unit 1507. In this way, the personal computer 1500 displays the moving image stored in the storage unit 1508 and reproduces the sound corresponding to the moving image. In the personal computer 1500, an instruction for selecting a moving image to be reproduced and an operation instruction for reproducing the moving image are received from the user via the keyboard 1505 and the mouse 1506.

  FIG. 16 is a conceptual diagram illustrating the external appearance of the personal computer 1500. As shown in FIG. 16, the main body 1601 stores the above-described CPU, RAM, ROM, storage unit, and the like. In addition, speakers are provided as audio output units 1507 on both sides of the monitor 1501. The personal computer 1500 can output sound from speakers provided on both sides of the monitor 1501.

  A moving image 1602 is displayed in a window area in the screen area of the monitor 101. When the mouse 1506 points to an arbitrary place in the window area and clicks or drags, the personal computer 1500 acquires coordinates on the window area. Therefore, in the personal computer 1500, the user can operate the video playback application by operating the mouse 1506 and clicking or dragging on the window area of the video playback application program.

  The keyboard 1505 has shortcut keys corresponding to playback, stop, fast forward, rewind, pause, and determination. Therefore, in the personal computer 1500, the user can operate the moving image playback application by pressing a shortcut key on the keyboard 1505.

  The operation of the personal computer 1500 described above is substantially the same as the operation of the display device 1 exemplified in the first embodiment, except that the user's operation input is changed from the touch sensor 106 to the mouse 1506. In the following, differences from the operation by the touch sensor 106 to the operation by the mouse 1506 will be listed and described.

・ The statement “tap the touch sensor” can be read as “click the mouse”.
・ The statement “Continue to touch” can be read as “Continue to press the mouse button”.
・ The statement that “Drag without releasing your finger from the monitor by touching the monitor screen” can be read as “Click and drag the mouse button while clicking on the video display area screen”. To do.
・ The statement “A certain time has elapsed after releasing your finger from the monitor screen” can be read as “A certain time has elapsed after releasing your finger from the mouse button”.
・ The statement “touch and drag again” can be read as “click and drag again”.
-The description of “touch panel is” can be read as “window area where moving image is displayed”.
・ The description of “to use touch panel” can be read as “to use window”.
・ The description of “touched” can be read as “clicked”.
・ The statement that “a finger touched the touch sensor” can be read as “mouse clicked”.
・ The description that “touch sensor has detected” can be read as “clicked”.
・ The description of “touch sensor tapped” can be read as “mouse clicked”.
-The statement to the effect that "the finger is still touched" can be read as "the mouse is still clicked".
-The statement that "the finger has been removed from the monitor screen" can be read as "the finger has been removed from the mouse" or "the click state has been released".
・ The statement “A certain time has passed since the finger has been removed” can be read as “A certain time has elapsed since the finger was removed from the mouse” or “A certain time has elapsed since the click state was released”.
-The statement to the effect that "the finger is still touching the monitor" can be read as "the mouse is still clicked".

  From the above, in addition to the display device 1 exemplified in the first embodiment, the present invention can be applied to a personal computer 1500. Therefore, in the personal computer 1500, a desired scene can be quickly searched for and reproduced / edited by a moving image reproducing application or moving image editing software operating on the operating system.

[Fifth Embodiment]
In the fifth embodiment described below, a scale value that does not depend on the total playback time of moving images is set. Here, Expression (1 ′) for calculating the frame movement amount according to the fifth embodiment is shown below. Note that Expression (1 ′) is an expression in which the term of the total playback time of moving images is deleted from Expression (1) in the first embodiment. In the fifth embodiment, the configuration and the processing procedure other than the equation (1 ′) and the processing procedure related to this equation are the same as those in the first embodiment.
Expression (1 ′): frame movement amount = scale × drag movement amount

The scale in equation (1 ′) is
Slowest: 1 frame / 10 pixels Notation ⇒ “× 1/10”
Fastest: 30 frames / 1 pixel Notation ⇒ “× 30/1”
And In this case, at the latest time, regardless of the total playback time of the moving image, a fine frame search is performed by dragging 10 pixels on the moving image screen and advancing one frame. At the fastest speed, a rough frame search is performed by dragging one pixel on the moving image screen by 30 frames regardless of the total reproduction time of the moving image. For example, when a user drags from the left edge of the screen to the right edge in the fastest “× 30/1” zone in a moving image having a screen area (sensing area) width of 800 pixels and 30 frames per second. The 800 second frame is advanced.

  From the above, regardless of the total playback time of a moving image, a fine frame search that advances one frame unit by dragging several pixels or a coarse frame search that advances several tens frames by dragging one pixel becomes possible. Therefore, the user can always search for a frame of a moving image on a familiar scale without being aware of the total playback time of the moving image.

[Sixth Embodiment]
In the first embodiment, the scale value of each zone arranged on the screen area (sensing area) is a fixed value, but the scale value is a switchable value as in the sixth embodiment shown below. It may be.

  In the sixth embodiment, as shown in FIG. 17, when the wheel as a switching unit is rolled down with a mouse with a wheel in the guide display mode which is the screen 1701, the screen is switched to the screen 1702. In the screen 1702, each zone is shifted down one by one with respect to the screen 1701, and a zone having a higher resolution scale appears in the top zone than that in the top zone so far. It is a thing. In this way, when the wheel is rolled down with a mouse with a wheel, the scale value of each zone may change to a value with higher resolution. This operation can be repeated a plurality of times, and the scale of each zone may change to a higher resolution value each time the operation is performed.

  Conversely, when the wheel is rolled up with a mouse with a wheel, the scale value of each zone may change to a lower resolution value. For example, if you roll a wheel up with a mouse with a wheel, each zone will be shifted up one by one, and the bottom zone will have a lower resolution than what was in the bottom zone so far A zone with appears. This operation can also be repeated a plurality of times, and the scale of each zone may change to a higher resolution value each time the operation is performed.

  By this method, the user can switch to a scale other than the scale displayed in the current screen area, select a user-preferred scale, and advance or reverse the frame. The switching instruction for switching the scale may be an operation instruction using a keyboard or a mouse operation while pressing a button on the keyboard, and is not limited to a method of rolling a wheel with a mouse with a wheel.

  Note that the description in the above-described embodiment shows an example, and the present invention is not limited to this. The configuration and operation in the embodiment described above can be changed as appropriate.

  For example, in this embodiment, the scale value is indicated according to the Y coordinate of the pointer, and the rewind amount / fast forward amount of the moving image is instructed by the movement amount of the X coordinate. -The rapid feed amount may be indicated by the scale value in the X coordinate. Further, the direction instructing the scale value and the direction instructing the moving image rewind amount / fast forward amount do not have to be orthogonal to each other.

  In addition, the instruction of the scale value and the moving image rewinding amount / fast-forwarding amount may be performed not only in the orthogonal coordinate system described above but also in a polar coordinate system based on the moving radius and the declination angle. Specifically, the scale value may be indicated by the distance from the center of the screen, which is the origin, to the start of dragging, and the rewinding amount / fast-forwarding amount of the moving image may be indicated by the declination formed from the start to the end of the dragging. In this case, unlike the orthogonal coordinate system, the screen width is limited in the radial direction, but the deflection angle is not limited by the screen width. Therefore, when instructing the rewind amount / fast forward amount of the moving image by the declination formed from the start to the end of the drag, it is possible to freely instruct rewinding or fast forwarding of the moving image without worrying about the limitation due to the screen width. . In addition, when the scale value is designated by the distance from the center of the screen, which is the origin, to the start of dragging, it is preferable to set the scale value so that the resolution becomes lower as the center of the screen is approached. In this case, when fast-forwarding / rewinding is performed quickly, the distance from the center is short, and the operation amount with respect to the declination is small. In addition, when fast-forwarding and rewinding slowly, the distance from the center is long and a large amount of operation is required for the declination, so that it is easy to detect a desired frame by rewinding or fast-forwarding a moving image. It becomes possible.

(Other embodiments)
In the above-described embodiment, a moving image has been described, but a plurality of still images can be handled in the same manner. That is, by handling each still image as one frame of a moving image (or moving image as a series of image data), the above-described operation can be similarly applied during reproduction of a still image. At this time, if the still image data has time information, it may be sequentially displayed in the order of the time information.
As a result, when a large number of still images are sequentially displayed, if a drag operation is performed at the bottom of the screen, for example, two images are reproduced, and if a drag operation is performed at the top, for example, 100 images are skipped. Can do.

  The above-described embodiment can also be realized in software by a computer of a system or apparatus (or CPU, MPU, etc.). Therefore, the computer program itself supplied to the computer in order to implement the above-described embodiment by the computer also realizes the present invention. That is, the computer program itself for realizing the functions of the above-described embodiments is also one aspect of the present invention.

  The computer program for realizing the above-described embodiment may be in any form as long as it can be read by a computer. For example, it can be composed of object code, a program executed by an interpreter, script data supplied to the OS, but is not limited thereto. A computer program for realizing the above-described embodiment is supplied to a computer via a storage medium or wired / wireless communication. Examples of the storage medium for supplying the program include a magnetic storage medium such as a flexible disk, a hard disk, and a magnetic tape, an optical / magneto-optical storage medium such as an MO, CD, and DVD, and a nonvolatile semiconductor memory.

  As a computer program supply method using wired / wireless communication, there is a method of using a server on a computer network. In this case, a data file (program file) that can be a computer program forming the present invention is stored in the server. The program file may be an executable format or a source code. Then, the program file is supplied by downloading to a client computer that has accessed the server. In this case, the program file can be divided into a plurality of segment files, and the segment files can be distributed and arranged on different servers. That is, a server apparatus that provides a client computer with a program file for realizing the above-described embodiment is also one aspect of the present invention.

  In addition, a storage medium in which the computer program for realizing the above-described embodiment is encrypted and distributed is distributed, and key information for decrypting is supplied to a user who satisfies a predetermined condition, and the user's computer Installation may be allowed. The key information can be supplied by being downloaded from a homepage via the Internet, for example. Further, the computer program for realizing the above-described embodiment may use an OS function already running on the computer. Further, a part of the computer program for realizing the above-described embodiment may be configured by firmware such as an expansion board attached to the computer, or may be executed by a CPU provided in the expansion board. Good.

1 is a block diagram of a display device according to a first embodiment. 1 is a conceptual diagram illustrating a front appearance of a display device according to a first embodiment. It is a conceptual diagram explaining the outline | summary of the moving image reproduction player which concerns on 1st Embodiment. It is a conceptual diagram which illustrates the transition of the operation mode of the moving image reproduction player which concerns on 1st Embodiment. It is a conceptual diagram which illustrates the guide display mode of the moving image reproduction player which concerns on 1st Embodiment. It is a conceptual diagram which shows the example of operation in guide display mode. It is a conceptual diagram which illustrates the relationship between the coordinate on a touch panel, and each zone. It is a flowchart which shows the calculation method of a scale value. It is a flowchart of the program in reproduction | regeneration mode. It is a flowchart of the program in guide display mode. It is a conceptual diagram which illustrates the case where the scale in guide display mode is set nonlinearly to the value of a Y coordinate. It is a conceptual diagram which illustrates the case where the scale in the guide display mode which concerns on 2nd Embodiment is set to the value of a Y coordinate linearly. It is a conceptual diagram which illustrates drag operation in the guide display mode which concerns on 3rd Embodiment. It is a flowchart of the program in the guide display mode which concerns on 3rd Embodiment. It is a block diagram of the personal computer which concerns on 4th Embodiment. It is a conceptual diagram which illustrates the external appearance of the personal computer which concerns on 4th Embodiment. It is a conceptual diagram which illustrates a mode that the scale currently displayed on the screen which concerns on 6th Embodiment is variably set.

Claims (15)

A display unit having a touch sensor;
Display control means for reproducing a series of image data and displaying the data on the display unit;
Detecting means for detecting a touch operation on the touch sensor;
When the detection unit detects a drag operation while displaying the series of image data on the display unit, the series of image data is forward-forwarded according to the direction and movement amount of the drag operation. Processing means for performing processing or reverse feed processing,
In the drag operation, the processing means makes the series of image data feed amounts different from the lateral movement amount of the touch sensor according to the vertical touch position of the touch sensor,
When the drag operation is performed in an oblique direction of the touch sensor, the processing unit performs the series of movements with respect to the lateral movement amount according to the vertical touch position during the drag operation. A reproduction apparatus characterized by changing a feed amount of image data.   2. The reproduction according to claim 1, wherein the display control unit further displays, on the display unit, information indicating a degree of change in a feed amount with respect to a normal movement amount according to the vertical touch position. apparatus.   The feed amount of the series of image data with respect to the lateral movement amount changes stepwise according to the vertical touch position, and is sent in order along the direction of change of the vertical touch position. The playback apparatus according to claim 1, wherein the playback apparatus changes so as to enable processing.   The series of image data is moving image data, and the amount of elapsed time with respect to the amount of movement in the horizontal direction differs according to the touch position in the vertical direction. The playback device according to item.   The series of image data is a plurality of still image data, and the number of images to be fed with respect to the amount of movement in the horizontal direction differs according to the touch position in the vertical direction. The playback apparatus according to any one of the above.   When the detection means detects a tap operation on the touch sensor while the series of image data is being reproduced, a plurality of buttons and a slide bar for controlling the reproduction of the series of image data are displayed on the display. The reproduction apparatus according to claim 1, wherein the reproduction apparatus is displayed in a unit.   The playback apparatus according to claim 1, further comprising an earphone jack that outputs sound. Detecting means for detecting a touch operation on the touch sensor;
Control means for performing control to change the reproduction position in the total reproduction time of data based on the operation detected by the detection means, and the detection means detects a drag operation when reproducing the data Control means for moving the reproduction position of the data in the forward direction or the reverse direction in accordance with the direction and amount of movement of the drag operation.
In the drag operation, the control means makes the movement amount of the data reproduction position different from the movement amount of the touch sensor in the horizontal direction according to the vertical touch position of the touch sensor,
When the drag operation is performed in an oblique direction of the touch sensor, the control unit determines the playback position with respect to the lateral movement amount according to the vertical touch position during the drag operation. A playback device characterized by changing the amount of movement of the player.   The playback apparatus according to claim 8, wherein the data includes audio data. A display unit having a touch sensor;
Display control means for reproducing a series of image data and displaying the data on the display unit;
Detecting means for detecting a touch operation on the touch sensor;
When the detection unit detects a drag operation while displaying the series of image data on the display unit, the series of image data is forward-forwarded according to the direction and movement amount of the drag operation. Processing means for performing processing or reverse feed processing,
The processing means, in the drag operation, varies the feed amount of the series of image data with respect to the vertical movement amount of the touch sensor in accordance with the horizontal touch position of the touch sensor.
When the drag operation is performed in an oblique direction of the touch sensor, the processing unit performs the series of movements with respect to the vertical movement amount according to the horizontal touch position during the drag operation. A reproduction apparatus characterized by changing a feed amount of image data. Detecting means for detecting a touch operation on the touch sensor;
Control means for performing control to change the reproduction position in the total reproduction time of data based on the operation detected by the detection means, and the detection means detects a drag operation when reproducing the data Control means for moving the reproduction position of the data in the forward direction or the reverse direction in accordance with the direction and amount of movement of the drag operation.
In the drag operation, the control means makes the movement amount of the reproduction position of the data different from the movement amount of the touch sensor in the vertical direction according to the horizontal touch position of the touch sensor,
When the drag operation is performed in an oblique direction of the touch sensor, the control means determines the playback position relative to the vertical movement amount according to the horizontal touch position during the drag operation. A playback device characterized by changing the amount of movement of the player. A playback method by a playback device including a display unit having a touch sensor,
A display control step in which the display control means of the reproduction device reproduces a series of image data and displays the data on the display unit;
A detecting step in which the detecting means of the playback device detects a touch operation on the touch sensor;
When a drag operation is detected in the detection step when the series of image data is displayed on the display unit, the processing unit of the playback device determines the drag operation according to the direction and the amount of movement of the drag operation. A processing step for performing forward feed processing or reverse feed processing of a series of image data,
In the processing step, in the drag operation, according to the vertical touch position of the touch sensor, the series of image data feed amount with respect to the horizontal movement amount of the touch sensor is made different,
When the drag operation is performed in an oblique direction of the touch sensor, in the processing step, during the drag operation, the series of the movement amounts in the horizontal direction according to the touch position in the vertical direction. A reproduction method characterized by changing a feed amount of image data. A playback method by a playback device,
A detection step in which the detection unit of the playback device detects a touch operation on the touch sensor, and a playback position in the total playback time of the data is changed based on the operation detected by the control unit of the playback device in the detection step. A control step of performing control, wherein when the data is being played back and the drag operation is detected in the detection step, the playback position of the data is ordered according to the direction and amount of movement of the drag operation. And a control process that moves in the direction or the reverse direction,
In the control step, in the drag operation, the movement amount of the reproduction position of the data is different from the movement amount of the touch sensor in the horizontal direction according to the vertical touch position of the touch sensor.
When the drag operation is performed in an oblique direction of the touch sensor, in the control step, during the drag operation, the reproduction position with respect to the lateral movement amount according to the vertical touch position. A reproduction method characterized by changing a movement amount of the video. A playback method by a playback device including a display unit having a touch sensor,
A display control step in which the display control means of the reproduction device reproduces a series of image data and displays the data on the display unit;
A detecting step in which the detecting means of the playback device detects a touch operation on the touch sensor;
When a drag operation is detected in the detection step when the series of image data is displayed on the display unit, the processing unit of the playback device determines the drag operation according to the direction and the amount of movement of the drag operation. A processing step for performing forward feed processing or reverse feed processing of a series of image data,
In the processing step, in the drag operation, according to the touch position in the lateral direction of the touch sensor, the feed amount of the series of image data with respect to the vertical movement amount of the touch sensor is made different,
When the drag operation is performed in an oblique direction of the touch sensor, in the processing step, the series of the movement amounts in the vertical direction with respect to the movement amount in the vertical direction according to the touch position in the horizontal direction during the drag operation. A reproduction method characterized by changing a feed amount of image data. A playback method by a playback device,
A detection step in which the detection unit of the playback device detects a touch operation on the touch sensor, and a playback position in the total playback time of the data is changed based on the operation detected by the control unit of the playback device in the detection step. A control step of performing control, wherein when the data is being played back and the drag operation is detected in the detection step, the playback position of the data is ordered according to the direction and amount of movement of the drag operation. And a control process that moves in the direction or the reverse direction,
In the control step, in the drag operation, the moving amount of the reproduction position of the data with respect to the moving amount of the touch sensor in the vertical direction is made different according to the touch position in the horizontal direction of the touch sensor,
When the drag operation is performed in an oblique direction of the touch sensor, in the control step, the reproduction position with respect to the vertical movement amount according to the horizontal touch position during the drag operation. A reproduction method characterized by changing a movement amount of the video.

Images