JP6218296B1 - Video playback device, video playback method, program thereof, and recording medium - Google Patents

Abstract

A moving image reproducing apparatus, a moving image reproducing method, and an image processing method capable of realizing image processing capable of reproducing between specified images from specified images to be reproduced from captured moving images, and further capable of image processing of reproduced images including line-of-sight detection information, It is an object to provide a program and a recording medium. A moving image reproducing apparatus for reproducing a moving image using acquired image data, an image data acquiring / storing unit for acquiring image data displayed on a display screen, and a moving image based on the image data on the screen A moving image reproducing means for reproducing the moving image, and a moving image reproducing range specifying means for designating a start time and an ending time of a desired range where the moving image is desired to be reproduced. The problem can be solved by the video playback device that plays back on the screen. [Selection] Figure 1

Description

  The present invention relates to a moving image reproducing apparatus, a moving image reproducing method, a program thereof, and a recording medium for reproducing a captured image.

  As for a moving image reproduction apparatus and method for reproducing a captured image, for example, Patent Document 1 discloses an image data acquisition unit that acquires image data capable of generating a reconstructed image, and a line-of-sight detection attached to the image data. A video reproduction device comprising: gaze detection information acquisition means for acquiring information; and image processing means for generating a reconstructed image from the image data based on the gaze detection information to generate a video. The line-of-sight detection information includes a line-of-sight position and a gaze time at the line-of-sight position, and the image processing unit generates a reconstructed image focused on the subject at the line-of-sight position, and the gaze time at the line-of-sight position is Based on this, the display time of the generated reconstructed image is set to generate the moving image, and the image processing means performs the reconstruction only for the line-of-sight position whose gaze time is longer than a predetermined time. Generating an image, the moving image reproducing apparatus, video playback device with a fixation time threshold setting means for setting the predetermined time is disclosed.

JP 2014-179870 A

  In the invention described in Patent Document 1, it is possible to reproduce an image whose image processing is longer than the threshold gaze time by setting a gaze time threshold, but a desired limited range from all the captured moving images. There was a problem that it was not possible to respond to the request to view the images.

The present invention was devised in view of these problems, and can perform image processing capable of reproducing a moving image limited to a range desired to be reproduced from captured moving images, and can further perform image processing of a reproduced image including line-of-sight detection information. It is an object to provide a moving image reproduction method, a program, and a recording medium.

The moving image reproducing device 1 according to claim 1 is a moving image reproducing device 1 that reproduces the moving image 10 using the acquired image data, and that obtains image data that is displayed on the display screen. 3, a moving image reproducing unit 4 that reproduces the moving image 10 based on the image data on a screen, a frame image data extracting unit 5 that extracts frame image data from the image data at a predetermined time interval, and the plurality of frame images scroll display means 6 for scrolling displayed with the arranged in time series a plurality of frame images 11 group represented by the data on the screen, specify the start and end times of the range desires to play a video It includes a video reproduction range designation means 7, wherein the video reproduction range designation means 7, a plurality of frame images 11 and the moving image 10 displayed on the same screen, in the screen, before A start mark 22 indicating the start time of the moving image 10, an end mark 23 indicating the end time of the moving image 10, and a playback time mark 24 indicating the time of the moving image 10 being played are displayed at corresponding positions on the same time axis. Mark display means 20 to be moved, and movement operation means 21 capable of moving the respective marks at a desired time, and the display area of the moving image 10 and the display area of the frame image 11 group are displayed on the screen. The frame images 11 grouped together in time series including the frame images 11 corresponding to the moving image 10 being reproduced are automatically scrolled by dragging the reproduction time mark 24 to the right end. is allowed, the moving image playback range by moving operating the start mark 22 and the end mark 23 at a desired time is specified, a range of videos the specified Characterized in that it reproduced on screen.

The moving image reproducing device 1 according to claim 2 is characterized in that, in claim 1, the line-of-sight detection data obtained by acquiring a line of sight with respect to the image data displayed on the display screen of the line-of-sight detection person 60 at a predetermined time interval. The line-of-sight coordinate data recording means 8 for adding time data and the line-of-sight coordinate data when the moving image 10 based on the image data is reproduced on the screen. Line-of-sight coordinate data reproduction means 9 that reproduces and displays on the same display screen in synchronization with each other, and the line-of-sight coordinate data reproduction means 9 uses the line-of-sight corresponding to the time during reproduction of the moving image 10 as the display reproduction mode. The position of the coordinate data on the display screen and the position of the line-of-sight coordinate data on the display screen within a predetermined time before the above time are respectively reproduced with predetermined figures. The first playback mode to be displayed on the video, and all the line-of-sight coordinate data from the time specified by the start mark 22 of the video playback range to the time being played back are displayed by assigning numbers to the video being played back in order of elapsed time. In accordance with the density of the number of all line-of-sight coordinate data from the time specified by the second playback mode or the time specified by the start mark 22 of the video playback range to the time during playback, the density is determined in advance for each density. The reproduction is performed in the third reproduction mode in which the identification display is performed .

3. Video reproducing apparatus 1 according to, in claim 2, you can separate the display of the second reproduction mode or the third reproduction mode until the reproduction start time-reproduction end time of the video 10 Mark setting display means 30 is provided for setting and displaying a possible delimiter mark 31, and the display on the screen in the second reproduction mode or the third reproduction mode is displayed in addition to the start from the reproduction start time. It is characterized by realizing the start from.

The moving image reproduction method 2 according to claim 4 is the moving image reproduction method 2 for reproducing the moving image 10 using the acquired image data, and an image data acquisition / storage step for acquiring the image data displayed on the display screen. 13, the video 10 by pre-Symbol the image data acquired and stored by the image data acquisition and storage step 13, the start time and end time in the range of desires to play the video 10 to the specified to the screen A frame image composed of a plurality of extracted frame image data, wherein frame image data is extracted at predetermined time intervals from the image data acquired and stored in the moving image reproduction step 14 and the image data acquisition / storage step 13 A frame image display step 15 for scroll-displaying eleven groups in a state of being arranged in time series on the screen, and the moving image reproduction step 14 includes the moving image 10 on the screen. The display area and the display area of the frame image 11 group are simultaneously displayed in a separated state, and the frame image 11 group arranged in chronological order including the frame image 11 corresponding to the moving image 10 being reproduced is displayed as a reproduction time mark. On the screen that is automatically scrolled by dragging 24 to the right end, a start mark 22 indicating the start time of the moving image 10, an end mark 23 indicating the end time of the moving image, and a playback time indicating the time of the moving image being played back The mark 24 is displayed at a corresponding position on the same time axis, and each mark is moved to a desired time to designate a moving image reproduction range .

The moving image reproduction method 2 according to claim 5 is the method of claim 4 , wherein the visual line detection data obtained by acquiring the line of sight with respect to the image data displayed on the display screen of the line-of-sight detection person 60 at a predetermined time interval. The line-of-sight coordinate data recording step 18 for recording with the time data added, and the line-of-sight coordinate data when the moving image 10 based on the image data is reproduced on the screen. A line-of-sight coordinate data reproduction step 19 for reproducing and displaying the same on the same display screen in synchronization with each other, and the line-of-sight coordinate data reproduction step 19 corresponds to a line of sight corresponding to a time during reproduction of the moving image 10 as a display reproduction mode. The position on the display screen of the coordinate data and the position on the display screen of the line-of-sight coordinate data within a predetermined time before the time are represented by a predetermined figure. In the first playback mode to be displayed on the playback video, all line-of-sight coordinate data from the time specified by the start mark 22 of the video playback range to the time being played back are numbered in order of the elapsed time. The density is previously displayed on the moving image 10 according to the density 34 of the number of all line-of-sight coordinate data from the time specified by the start mark 22 of the moving image reproduction range to the time being reproduced. The reproduction is performed in the third reproduction mode in which the identification display set for each of 34 is performed.

The moving image reproduction method 2 according to claim 6 , according to claim 5 , wherein the display of the second reproduction mode or the third reproduction mode is divided between a reproduction start time and a reproduction end time of the moving image 10. The possible separator mark 31 is set to a desired time, and the display on the screen in the second playback mode or the third playback mode is started from the separator mark 31 in addition to starting from the playback start time. The moving image reproduction method according to claim 9, wherein:

A program according to a seventh aspect is a program for causing a computer to execute the moving image reproduction method 2 according to any one of the fourth to sixth aspects.

A storage medium according to an eighth aspect is a computer-readable storage medium in which the program according to the seventh aspect is stored.

The invention according to claim 1, 4 , 7, or 8 has an effect that a range to be reproduced from the moving image 10 can be easily reproduced as desired by designating a time zone of the moving image 10.

According to the first, fourth, seventh, or eighth aspect of the present invention, the time zone of the moving image 10 to be reproduced from the moving image 10 can be designated as desired by checking the display of the frame image 11. Even if the time is not grasped, there is an effect that it is possible to designate a range to be reproduced by viewing the scene of the frame image 11.

According to the first, fourth, seventh, or eighth aspect of the present invention, means for designating the range of the moving image 10 as desired can be displayed on the screen, and the displayed mark can be dragged using the mouse to start mark 22. In addition, the end mark 23 can be easily moved to a desired time, and the moving image reproduction range is set.

The invention according to the second, fifth, seventh, or eighth aspect has an effect that the line of sight of the line-of-sight detection person 60 with respect to the moving image 10 displayed on the screen can be recorded along with the elapsed time and can be reproduced in various display modes.

According to the second, fifth, seventh, or eighth aspect of the invention, when the line-of-sight detection person 60 is reproduced with respect to the moving image 10 displayed on the screen, the first reproduction mode is, for example, the line-of-sight detection person 60. When the time zone for displaying each of the line-of-sight detection positions 32 based on the line-of-sight coordinate data indicating the point of the line of sight as a circular figure and displaying the number of the circular figures as 10 is set, As long as the detector 60 does not close his / her eyes, ten circular figures always going back to the past including the circular figure of the line-of-sight coordinate data corresponding to the currently displayed time are sequentially displayed. As a result, if only the line-of-sight detection position 32 based on the line-of-sight coordinate data corresponding to the time currently displayed on the screen is used, it is easy to lose sight of the circular figure when the circular figure suddenly moves around. By displaying a circular figure corresponding to the past time, there is an effect that the circular figure is not lost even if the line of sight of the subject detection person 60 moves on the screen.

  As the second mode, for example, “1” is set to the start time in the order of the elapsed time for all the lines of sight from the time specified by the start mark 22 of the video playback range to the time during playback. Can be displayed. Thereby, it can be easily known how the interested party of the subject-line-of-sight detection person 60 has changed.

  As a third mode, in advance on the moving image 10 according to the density 34 of the number of line-of-sight detection positions 32 based on all line-of-sight coordinate data from the time specified by the start mark 22 of the moving image reproduction range to the time during reproduction. An identification display is made with a color or pattern determined for each density 34. As a result, it is possible to easily know the distribution of the height of interest of the line-of-sight detector 60.

The invention according to claim 3, 6, 7 or 8 is a delimiter mark capable of delimiting the display of the second reproduction mode or the third reproduction mode from the reproduction start time to the reproduction end time of the moving image 10. By providing 31, the moving image 10 is being played back from the time set by the start mark 22, but by adding and setting a delimiter mark 31 in the middle, the scene of the moving image 10 changes from the beginning. The display of the second playback mode or the third playback mode that displayed the cumulative total is interrupted, and is newly displayed from the time set by the delimiter mark 31. For example, in the second playback mode, the number from “1” is displayed from the divided time, and in the third playback mode, the density 34 from the divided time is identified and displayed. Thus, the second playback mode or the third playback mode can be displayed in accordance with the scene of the moving image 10 that changes.

It is a functional block diagram of the moving image reproducing device of the present invention. It is a hardware block diagram of the moving image reproducing device of this invention. It is a flowchart of the moving image reproducing method of the present invention. It is a schematic diagram of the display apparatus of a screen. FIG. 5 is an enlarged view of a portion X in FIG. 4, and is a schematic explanatory diagram of a frame image, time, and arrangement status of various marks. It is explanatory drawing of a scroll and is a figure which shows before a scroll. It is explanatory drawing of a scroll and is a figure which shows after scrolling. It is explanatory drawing of the 1st reproduction | regeneration mode. It is explanatory drawing of 2nd reproduction | regeneration mode. It is explanatory drawing of the 3rd reproduction | regeneration mode. It is explanatory drawing explaining the level of density based on the range centering on a gaze detection position. FIG. 2 is an explanatory diagram for explaining the density level by weighting a range centering on the line-of-sight detection position, (a) is an explanatory diagram of a weighting method, and (b) is an embodiment of weighting. It is explanatory drawing of the delimiter by a delimiter mark, (a) And (b) is explanatory drawing when not using a delimiter mark, (c) is explanatory drawing when a delimiter mark is used.

  As shown in FIG. 1, the moving image reproducing apparatus 1 of the present invention is a moving image reproducing apparatus 1 that reproduces a moving image 10 using acquired image data, and image data that acquires image data displayed on a display screen. Acquiring / storing means 3, moving picture reproducing means 4 for reproducing the moving picture 10 based on the image data on the screen, and moving picture reproducing range specifying means 7 for designating a start time and an ending time of a desired range for reproducing the moving picture 10 And the moving image in the range designated by the moving image reproduction range designation means 7 is reproduced on the screen.

  Then, frame image data extraction means 5 for extracting frame image data from the image data at predetermined time intervals, and a plurality of frame images 11 groups represented by the plurality of frame image data are arranged in time series on the screen. Scroll display means 6 for scroll-displaying in the state. Further, the moving image reproduction range specifying means 7 is provided with mark setting / display means 30 for setting and displaying a delimiter mark 31 capable of delimiting the moving image 10.

  Then, as shown in FIG. 2, the moving image reproducing apparatus 1 acquires a control unit 40 controlled by the moving image reproducing device 1 including control of the various means, an operation unit 41 such as a mouse and a keyboard, and an image from the outside. An acquisition unit 42, a storage unit 43 that stores image data and the like, a display unit 45 that displays the moving image 10 and the like on a display device 44 such as a desktop, a power supply unit 46, and the like are provided.

  As a form of the display device 44 of the moving image reproducing device 1, for example, as shown in FIG. 4 and FIG. 5, a strip-shaped frame image 11 group below the display screen and a time below the frame image 11 group are displayed. A display unit 25 is arranged and displayed, and the frame image 11 and the time display unit 25 scroll in a synchronized state. Below the time display unit 25, a start mark 22, an end mark 23, and a reproduction time mark 24 are displayed, and a separator mark 31 is set and displayed. The start mark 22, the end mark 23, and the reproduction time mark 24 can be moved by dragging with the mouse, and the delimiter mark 31 can be set or canceled with the mouse.

  The image data acquisition / storage unit 3 acquires the image data of the line-of-sight detection target image 50 viewed by the line-of-sight detector 60 and stores it in the storage unit 43. As shown in FIG. 2, the line-of-sight detection target image 50 viewed by the line-of-sight detection person 60 is acquired by the acquisition unit 42 by the image data acquisition / storage unit 3 of the control unit 40 and stored in the storage unit 43.

  The moving image reproducing means 4 reproduces the moving image 10 based on the image data recorded in the recording unit 43 on the screen.

  The moving image reproduction range designating unit 7 designates the start time and end time of a desired range for reproducing the moving image 10. The moving image reproduction range specifying means 7 displays the start mark 22 indicating the start time of the moving image 10, the end mark 23 indicating the end time of the moving image 10, and the time of the moving image 10 being reproduced on the same screen as the moving image 10. It includes mark display means 20 for displaying the reproduction time marks 24 shown at corresponding positions on the same time axis, and movement operation means 21 capable of moving the marks at a desired time. The moving operation means 21 is a mouse, and the moving image reproduction range is set by dragging the start mark 22 and the end mark 23 with the mouse and moving them at a desired time.

  When the moving image 10 based on the image data recorded in the recording unit 43 is reproduced on the screen, it is generally reproduced from the start of recording to the end of recording of continuously captured and recorded image data. In addition, a start instruction and an end instruction are issued. By making it possible to change the start instruction or the end instruction, the playback range of the moving image 10 can be changed not only from the general recording start time to the recording end time but also from the desired start time to the end time range. It was. The start instruction can be changed by moving the start mark 22, and the end instruction can be changed by moving the end mark 23.

  The moving image reproduction means 4 reproduces on the screen the moving image 10 based on the image data corresponding to the range determined by the moving image reproduction range specifying means 7 from the image data recorded in the recording unit 43. For example, when the recording start time of the moving image 10 stored in the storage unit 43 is 0.00 minutes to 5.00 minutes, the desired start time of the moving image 10 to be reproduced is set to 1.00 minutes. When it is desired to set the time to 2.00 minutes, the start mark 22 is moved to the time 1.00 minute of the time display unit 25 and the end mark 23 is moved to the time 2.00 minutes of the time display unit 25 to start and end time. Is changed and set, and the moving image 10 of 1.00 minutes to 2.00 minutes is partially reproduced from the entire moving image 10.

  The frame image data extraction unit 5 extracts frame image data from the image data recorded in the recording unit 43 at predetermined time intervals. The predetermined time interval can be set differently from the time interval for each frame of the moving image, or can be set longer than the time interval for each frame of the moving image 10. The frame image 11 based on the extracted frame image data is displayed on the same screen as the moving image 10. For example, as shown in FIG. 4 or FIG. 5, the moving image 10 is created every 0.001 second for each time memory, and the frame image 11 is created every 0.01 second.

  The scroll display means 6 scrolls and displays a plurality of frame images 11 represented by the plurality of frame image data in a state of being arranged in time series on the screen. As one form of the positional relationship in which the moving image 10 and the frame image 11 are displayed, there is a form in which the frame image 10 group is displayed in a horizontally long strip shape below the moving image 10 as shown in FIG.

  When the playback time mark 24 is dragged to the right end, the frame image 11 and the time display unit 25 are automatically scrolled and the moving image 10 advances. For example, as shown in FIG. 6, when the playback time mark 24 is dragged to near the rightmost 0.11 second, the frame image 11 is scrolled from A to K shown in FIG. Scrolls automatically in order.

  Next, the moving image reproduction device 1 of the present invention acquires the line-of-sight detection data obtained at predetermined time intervals with respect to the line-of-sight detection target image 50 that is the image data displayed on the display screen of the line-of-sight detector 60. And the line-of-sight coordinate data recording means 18 for adding the elapsed time data and recording the line-of-sight coordinate data when the moving image 10 based on the image data is reproduced on the screen. Line-of-sight coordinate data reproduction means 19 for reproducing and displaying the data on the same display screen in synchronization with the elapsed time of the data.

  A commercially available line-of-sight detection device 51 is attached in the vicinity of the screen of the line-of-sight detection target image 50, and the line-of-sight coordinate data recording means 18 sets the line-of-sight detection information from the line-of-sight detection device 51 at predetermined time intervals. , Acquired by the acquisition unit 42, added with elapsed time data, and stored in the storage unit 43. The line-of-sight detection device 51 only needs to detect the line of sight and output the line-of-sight detection information.

  The line-of-sight coordinate data reproducing means 19 displays the image of the moving image 10 in which the line-of-sight coordinate data stored by the line-of-sight coordinate data recording means 18 is displayed on the display screen of the display device 44 as shown in FIGS. The time and the elapsed time of the line of sight coordinate data are synchronized and reproduced on the same display screen, and the coordinates on the image of the moving image 10 and the coordinates of the coordinate data of the line of sight are made coincident and reproduced.

  Next, as a display reproduction mode by the line-of-sight coordinate data reproduction means 19, the first reproduction mode is line-of-sight detection on the display screen based on line-of-sight coordinate data corresponding to the time during reproduction of the moving image 10, as shown in FIG. This is a reproduction mode in which the position 32 and the line-of-sight detection position 32 on the display screen of the line-of-sight coordinate data within a predetermined time before the time are displayed on the reproduction moving image 10 as predetermined figures, respectively.

  For example, the time interval in which the line-of-sight coordinate data is recorded is 0.01 seconds, the predetermined figure is a circular figure, and the time zone for displaying the circular figure indicating the line-of-sight detection position 32 based on the line-of-sight coordinate data is displayed. When the predetermined time length is set to 0.09 seconds, when the time of the displayed screen is 2.00 minutes, the line-of-sight detection position is displayed on the screen of the moving image 10 as shown in FIG. Ten circular figures indicating 32 are displayed corresponding to a time zone of 0.09 seconds between 2.0 minutes and 0.09 seconds before. Since a plurality of circular figures indicating the line-of-sight detection position 32 are displayed, tracking confirmation is easy on the screen of the moving image 10 even if the circular figure moves around. A figure such as a circle can be displayed with a color such as red.

  Here, in the case where the number of circular figures indicating the line-of-sight detection position 32 displayed is 10 corresponding to the set 0.09 seconds, the eyes are kept open even if the displayed moving image 10 changes over time. The number of circular figures indicating the line-of-sight detection positions 32 when the line-of-sight detection is continued is always 10, but if the line-of-sight detector cannot detect the line-of-sight such as when the eye-detected person closes his eyes, the figure is closed. The number of circular figures corresponding to time is reduced and displayed. For example, when the time when the eyes are closed is 0.02 seconds, the number of circular figures to be displayed is eight.

  Next, as shown in FIG. 9, the second playback mode is the elapsed time at the line-of-sight detection position 32 based on all the line-of-sight coordinate data from the time specified by the start mark 22 of the moving image playback range to the time during playback. This is a playback mode in which the number 33 is assigned in order and displayed on the video 10. This is displayed by connecting the numbers 33 assigned in order of elapsed time with lines as shown in FIG. If only the number 33 is displayed, it is difficult to determine the order with the eyes, but the order can be easily known with the eyes by connecting with a line.

  Next, in the third playback mode, as shown in FIG. 10, the number of eye-gaze detection positions 32 based on all eye-gaze coordinate data from the time specified by the start mark 22 of the moving image playback range to the time during playback. This is a playback mode in which an identification display is made on the moving image 10 in accordance with the density 34 using a color or pattern determined for each density 34 in advance.

  A circular range having a predetermined size centered on the line-of-sight detection position 32 on the moving image 10 based on the line-of-sight coordinate data is accumulated from the time designated by the start mark 22 of the moving image reproduction range to the time being reproduced. Then, a section for identifying the density from the difference between the maximum and minimum number of overlaps in the circular range, or a circle having a predetermined size around the line-of-sight detection position 32 on the moving image 10 based on the line-of-sight coordinate data. A circular range weighted according to the distance from the line-of-sight detection position 32 from the time specified by the start mark 22 of the video playback range to the time being played back, A division for identifying the density is determined from the difference between the maximum and minimum of the numbers obtained by adding the weights. Then, identification display is performed by a predetermined color or pattern for each category.

  For example, as shown in FIG. 11, when the circular ranges centering on the line-of-sight detection position 32 on the moving image 10 based on the three line-of-sight coordinate data overlap, the overlapped range is set as the high density a. In black display, a range where two sheets overlap each other is displayed as diagonal lines with a density b, and a range where only one sheet is displayed as white with a density low c, so that the density 34 can be visually recognized easily. As another example of the identification display, for example, the area with the highest density can be displayed in red, and as the density gradually decreases, the color can be changed according to the density, such as orange yellow, green, and blue. You can instantly know where you have seen frequently.

  As shown in FIG. 10, the density 34 display method shown in FIG. 11 is overlapped on the moving image 10 on the screen of the display device 44 to determine the density 34, and the area of the high density a is black and the density b The area with the density 34 is displayed in diagonal lines, and the area with the low density c is displayed in white so that the density 34 is visually easy to understand.

  Also, as shown in FIG. 12A, a circular range centering on the line-of-sight detection position 32 is weighted according to the distance from the line-of-sight detection position 32. Then, as shown in FIG. 12 (b), the ranges centering on the respective line-of-sight detection positions 32 are stacked, and the density is classified from the difference between the maximum and minimum numbers obtained by adding the number of weights. Depending on the number of added weights, the color is changed for identification display. The level of density 34 is made visually easy to understand.

  Next, a mark setting / display for setting and displaying a delimiter mark 31 that can divide the display of the second reproduction mode or the third reproduction mode between the reproduction start time and the reproduction end time of the moving image 10. Means 30 can be provided to realize display on the screen in the second reproduction mode or the third reproduction mode from the separation mark 31 in addition to the start from the reproduction start time.

  In order to divide the reproduction of the second reproduction mode or the third reproduction mode from the reproduction start time to the reproduction end time of the moving image 10, the second time is set at the time when the delimiter mark 31 of the time display unit 25 is set. The playback in the playback mode or the third playback mode is initialized and cleared. After the initialization and clearing, the reproduction in the second reproduction mode or the third reproduction mode is resumed from the time of the delimiter mark 31. Further, if the setting of the separator mark 31 is canceled, the separator is not executed.

  When investigating the movement of the line of sight of the line-of-sight detection person 60 by reproduction, the image scene may change in the moving image 10. At this time, when the second playback mode or the third playback mode is displayed separately for each scene of the moving image 10, it is effective to analyze the line of sight. It can be carried out.

  For example, as illustrated in FIG. 13A, when the reproduction time mark 24 indicates the time “A” of the frame image 11, the line-of-sight detection position is included in the moving image 10 in the order of the line-of-sight of the line-of-sight detection person 60. Numbers “1 to 3” are displayed at locations indicating 32. If the playback time mark 24 indicates the time “B” of the frame image 11 as shown in FIG. 13B, the video 10 is advanced as it is, and the video 10 is covered around the character “B”. Numbers “4 to 5” are displayed in the order of the line of sight of the line of sight detector 60. Here, as shown in FIG. 13C, when the delimiter mark 31 is set to a time when the scene of the moving image 10 changes from “A” to “B” in the frame image 11, the playback time mark 24 is set to “ When the time “B” is indicated, numbers “1 to 2” are displayed in the moving image 10 around the character “B” in the order of the line of sight of the line-of-sight detection person 60. As described above, since the display of the second playback mode or the third playback mode can be changed depending on the scene of the moving image 10, the playback mode can be selectively used according to desired data.

  Next, the moving image reproduction method 2 will be described. As shown in FIG. 3, the moving image reproducing method 2 of the present invention is a moving image reproducing method 2 for reproducing the moving image 10 using the acquired image data, and the image data for acquiring the image data displayed on the display screen. A screen specifying the start time and end time of a range in which the user wants to play back the moving image 10 of the image data acquired and stored in the acquisition / storage step 13 and the image data acquisition / storage step 13 And a moving image reproduction step 14 for reproduction on the top.

  Then, frame image data is extracted from the image data acquired and stored in the image data acquisition step 13 at a predetermined time interval, and a group of frame images 11 composed of the extracted plurality of frame image data is time-sequentially displayed on the screen. A frame image display step 15 for scrolling and displaying the images arranged in a row.

  The moving image reproduction step 14 includes a start mark 22 indicating the start time of the moving image 10, an end mark 23 indicating the end time of the moving image, and a reproduction time mark 24 indicating the time of the moving image 10 being reproduced on the same time axis. The moving image playback range is set by moving each mark to a desired time.

  In the moving image reproduction method 2, the line of sight is recorded by adding the elapsed time data to the line-of-sight detection data obtained at a predetermined time interval with respect to the image data displayed on the display screen of the line-of-sight detector 60. When the coordinate data recording step 18 and the line-of-sight coordinate data are reproduced on the screen of the moving image 10 based on the image data, the elapsed time of the image data and the elapsed time of the line-of-sight coordinate data are synchronized on the same display screen. A line-of-sight coordinate data reproduction step 19 for reproducing and displaying.

  Then, as the display reproduction mode in the line-of-sight coordinate data reproduction step 19, the position on the display screen of the line-of-sight coordinate data corresponding to the time during the reproduction of the moving image 10 and the line-of-sight coordinate data within a predetermined time before the time are displayed. A first playback mode in which the position on the display screen is displayed on the playback video 10 in a predetermined figure, and all line-of-sight coordinate data from the time specified by the start mark 22 of the video playback range to the time during playback. In the second playback mode in which numbers are displayed in the order of elapsed time on the moving image 10 being reproduced, or all the line-of-sight coordinate data from the time specified by the start mark 22 of the moving image reproduction range to the time being reproduced According to the number density 34, the third reproduction mode for displaying an identification display predetermined for each density 34 on the moving image 10 is selected.

  A delimiter mark 31 that can divide the display of the second reproduction mode or the third reproduction mode between the reproduction start time and the reproduction end time of the moving image 10 is set to a desired time by dragging with the mouse. Then, the display on the screen in the second reproduction mode or the third reproduction mode is realized from the start of the separation mark 31 in addition to the start from the reproduction start time.

  The present invention can also be realized by executing the following processing. A program capable of executing the moving image reproduction method by a computer, wherein the program is supplied to a system or apparatus via a network or a storage medium, and the computer of the system or apparatus calls and executes the program.

  A storage medium storing a program for causing a computer to execute the moving image reproduction method, wherein the program stored in the storage medium storing the program for realizing the computer-readable particle number measuring method is called and executed. It is. Examples of the storage medium include a CD-ROM, a hard disk, a flexible disk, a magnetic tape, and a magneto-optical disk.

DESCRIPTION OF SYMBOLS 1 Movie reproducing device 2 Movie reproducing method 3 Image data acquisition / storage means 4 Movie reproducing means 5 Frame image data extracting means 6 Scroll display means 7 Movie reproduction range designating means 8 Line of sight coordinate data storage means 9 Line of sight coordinate data reproducing means 10 Movie 11 Frame image 13 Image data acquisition / storage process 14 Movie reproduction process 15 Frame image display process 18 Eye coordinate data storage process 19 Eye coordinate data reproduction process 20 Mark display means 21 Moving operation means 22 Start mark 23 End mark 24 Playback time mark 25 hours Display unit 30 Mark setting / display means 31 Separation mark 32 Line-of-sight detection position 33 Number 34 Density 40 Control unit 41 Operation unit 42 Acquisition unit 43 Storage unit 44 Display unit 45 Display unit 50 Line-of-sight detection target image 51 Line-of-sight detection device 60 Line-of-sight detection Person

Claims (8)

A video playback device that plays back a video using acquired image data,
Image data acquisition / storage means for acquiring image data displayed on the display screen;
A moving image reproducing means for reproducing a moving image based on the image data on a screen;
Frame image data extracting means for extracting frame image data from the image data at predetermined time intervals;
Scroll display means for scroll-displaying a plurality of frame image groups represented by the plurality of frame image data in a state of being arranged in time series on the screen;
Includes a start time and end time in the range of desires to play a video and video reproduction range specifying means specifying, with,
The moving image playback range designating unit displays the moving image and the plurality of frame images on the same screen, and within the screen, a start mark indicating the start time of the moving image, an end mark indicating the end time of the moving image, and playback A mark display means for displaying a playback time mark indicating the time of the moving image in a position corresponding to each on the same time axis, and a movement operation means capable of moving each mark to a desired time. ,
The moving image display area and the frame image group display area are simultaneously displayed in a separated state on the screen, and the frame image group arranged in time series including the frame images corresponding to the moving image being reproduced, Scroll automatically by dragging the playback time mark to the right end,
A moving image reproduction apparatus , wherein a moving image reproduction range is designated by moving the start mark and the end mark at a desired time, and the moving image within the designated range is reproduced on a screen. Eye-gaze coordinate data recording means for recording the eye-gaze detection data acquired at predetermined time intervals with the eye-gaze detection data acquired on the display screen of the eye-gaze detector by adding elapsed time data;
The line-of-sight coordinate data is reproduced and displayed on the same display screen by synchronizing the elapsed time of the image data and the elapsed time of the line-of-sight coordinate data when the moving image based on the image data is reproduced on the screen. A reproducing means,
The line-of-sight coordinate data reproduction means has, as a display reproduction mode, the position on the display screen of the line-of-sight coordinate data corresponding to the time during the reproduction of the moving image and the line-of-sight coordinate data within a predetermined time before the time. The first playback mode in which each position is displayed on the playback video in a predetermined figure, the video currently playing all the line-of-sight coordinate data from the time specified by the start mark of the video playback range to the time during playback In the second playback mode that displays numbers in order of elapsed time, or in accordance with the density of the number of all line-of-sight coordinate data from the time specified by the start mark of the video playback range to the time during playback above, motion picture reproducing apparatus according to claim 1, characterized in that the play in the third reproducing mode in which an identification that defines for each advance densities. Mark setting display means is provided for setting and displaying a delimiter mark capable of delimiting the display of the second playback mode or the third playback mode from the playback start time to the playback end time of the moving image. 3. The moving picture reproducing apparatus according to claim 2 , wherein the display on the screen in the second reproduction mode or the third reproduction mode is realized not only from the reproduction start time but also from the separation mark. . A video playback method for playing back a video using acquired image data,
An image data acquisition and storage step for acquiring image data displayed on the display screen, the pre SL video by the image data acquired and stored by the image data acquisition and storage process, a range of desires to play the video and video playback step of playing on the screen the start time and end time by specifying,
Frame image data is extracted at predetermined time intervals from the image data acquired and stored in the image data acquisition / storage step, and a frame image group composed of the plurality of extracted frame image data is arranged in time series on the screen. A frame image display process that scrolls and displays the screen
The moving image reproduction step displays the moving image display area and the frame image group display area simultaneously on the screen in a separated state, and includes a frame image corresponding to the moving image being reproduced, arranged in time series. On the screen that automatically scrolls the frame image group by dragging the playback time mark to the right end, a start mark indicating the start time of the video, an end mark indicating the end time of the video, and the video being played back A moving image reproducing method, wherein a reproduction time mark indicating a time is displayed at a corresponding position on the same time axis, and the moving image reproduction range is specified by moving each mark to a desired time . A line-of-sight coordinate data recording step for recording the line-of-sight detection data acquired at predetermined time intervals with the line-of-sight detection data acquired on the display screen of the line-of-sight detector by adding elapsed time data, and
The line-of-sight coordinate data is reproduced and displayed on the same display screen by synchronizing the elapsed time of the image data and the elapsed time of the line-of-sight coordinate data when the moving image based on the image data is reproduced on the screen. A regeneration process,
The line-of-sight coordinate data reproduction step is a display reproduction mode in which a line-of-sight coordinate data corresponding to a time during reproduction of a moving image is displayed on the display screen and a line-of-sight coordinate data within a predetermined time before the time. The first playback mode in which each position is displayed on the playback video in a predetermined figure, the video currently playing all the line-of-sight coordinate data from the time specified by the start mark of the video playback range to the time during playback In the second playback mode that displays numbers in order of elapsed time, or in accordance with the density of the number of all line-of-sight coordinate data from the time specified by the start mark of the video playback range to the time during playback 5. The moving image reproduction method according to claim 4 , wherein the reproduction is performed in a third reproduction mode in which an identification display predetermined for each density is displayed . The second playback mode or the third playback mode display is set to a desired time by setting a delimiter mark that can divide the display of the moving image from the playback start time to the playback end time. 6. The moving image playback method according to claim 5 , wherein the display on the screen in the mode or the third playback mode is realized not only starting from the playback start time but also starting from the break mark. The program for making a computer perform the moving image reproduction method in any one of Claims 4-6 . A computer-readable storage medium storing the program according to claim 7 .

Images