JP6576704B2 - Movie playback apparatus and movie playback method - Google Patents

Description

  The present invention relates to a moving image reproducing apparatus and a moving image reproducing method, and more particularly, to a moving image reproducing apparatus and a moving image reproducing method capable of performing work analysis while reproducing a work moving image obtained by capturing work contents.

Conventionally, work videos shot of work content are played back in order to reduce work time, labor savings, and cost reduction at production sites by visualizing the movements and time of people, machines and things on the production line. A moving image reproducing apparatus capable of analyzing work while being known is known.
According to the moving image reproducing apparatus, it is possible to organize work processes based on the analysis result using the work moving image and to create a work standard with high accuracy.

For example, the work analysis apparatus described in Patent Document 1 analyzes each work process for each work element while reproducing a work image of an operator on the production line, and performs an efficient production preparation activity. Can do.
Specifically, the work video data of the worker is displayed on the preview section on the display screen, the work element list is displayed on the work time table section, and attribute information such as the start time and end time of the work element is displayed. The time axis of the work process and the playback time point of the work video data are displayed on the timeline section.

JP 2011-150569 A

By the way, in the video playback device for the purpose of work analysis as described above, as one of the requests for improving the user convenience, the analyst who becomes the user performs the operation of the worker at the time of playback of the work video. During the confirmation, there was a demand to confirm the operator's operation at a time slightly before and after the reproduction time.
On the other hand, if multiple work videos are displayed in addition to work videos on the same display screen, tools necessary for work analysis such as work element lists may not be displayed in an easy-to-view size, which is rather user-friendly. There was also a possibility that the property would deteriorate.
Therefore, when the analyst confirms the video at the playback time of the work video without degrading the user convenience, the video playback can also check the multiple videos at the time before and after the playback time. A device was sought.

Further, in the moving image playback device for the purpose of the work analysis, an analyst performs an overall work analysis or a detailed work analysis while appropriately changing the playback speed of the work moving image.
If the playback speed is changed here, the plurality of work videos to be confirmed together with the work video on the display screen should naturally be different.
Therefore, in order to improve user convenience, when the playback speed of the work video is changed by the analyst, the plurality of work videos displayed together with the work video are also changed according to the intention of the analyst. Ingenuity was required.

  In addition, the video playback device used for a wide range of purposes is not limited to the one for the purpose of work analysis, and there has been a demand for an improved user convenience as described above.

The present invention has been made in view of the above problems, and an object of the present invention is to provide a moving image reproducing apparatus and a moving image reproducing method which are widely used and improved in user convenience.
In addition, another object of the present invention is to allow a user to check a plurality of videos before and after the playback time when the user checks the video at the time of playback without reducing user convenience. And providing a moving image reproducing apparatus and moving image reproducing method.
Another object of the present invention is to provide a video playback device and video playback that can change the plurality of videos displayed together with the video according to the user's intention when the playback speed of the video is changed by the user. It is to provide a method.
Another object of the present invention is to provide a moving image reproducing apparatus and a moving image reproducing method which are used mainly for the purpose of work analysis and improve the convenience of an analyst who is a user.

The subject is a video playback device that plays back a video composed of a plurality of frame images, according to the video playback device of the present invention, wherein the video is a work video that captures work content, and the video The playback device is a device capable of acquiring work video data indicating the work video and analyzing the work content while playing back the work video, and displaying the video on a display screen And the frame image at a predetermined time point on the time axis set for the moving image, and the frame image at a time point determined when a predetermined time interval is left from the predetermined time point And an image selection unit for selecting a thumbnail display unit for displaying a thumbnail created based on each of the selected frame images together with the moving image on the display screen. A playback speed changing unit that receives a user operation and changes the playback speed of the displayed moving image, and a time interval that changes the time interval of the selected frame image in accordance with the changed playback speed. A change unit, and
When displaying the thumbnail on the display screen, the thumbnail display unit displays the playback time information corresponding to the thumbnail together, receives an input of a user operation, and displays the thumbnail displayed on the display screen. An analysis execution unit that calculates a work time for each work element by dividing the work process as the work content from the work video, and a work for displaying information on the work time for each work element on the display screen This is solved by further comprising an element list display section and a total time display section for totaling the total work time for each work element and displaying the total time on the display screen .

In the case of the moving image playback device having the above-described configuration, a moving image is displayed on the same display screen, and a predetermined time point and frame images before and after the predetermined time point are selected from the moving image, and thumbnails based on the selected frame images are displayed. Can be displayed.
Therefore, when the user is checking the video at a predetermined time (for example, playback time) of the moving image without deteriorating the user convenience (without displaying a plurality of frame images in a large size) This is a moving image playback apparatus that can also check the video at the time.
Also, with the video playback device having the above-described configuration, the time interval between the plurality of frame images can be changed in accordance with the playback speed of the video that has been changed by a user operation. Multiple thumbnails can be displayed.
Note that a thumbnail is a reduced image obtained by reducing the frame image, and when a user's selection operation is performed on the display screen, the thumbnail is not necessarily restarted from the frame image at the time corresponding to the thumbnail. It does not have to be limited.
Also, with the above configuration, it is possible to realize a moving image reproducing apparatus that is mainly used for work analysis and has improved convenience for an analyst who is a user.

At this time, the previous SL analysis execution unit, from the working motion picture, after calculating the effective operating time and invalid operation time in each work element, calculates the working standard time by accumulating the rating factor to the effective operating time The work element list display unit displays information on the work time, the valid operation time, the invalid operation time, and the work standard time in each work element on the display screen, and the total time display unit the working time of each working element, the effective operating time, aggregates respective total time of the invalid operating time and the working standard time, may that displays the respective total time the on the display screen.

At this time, the moving image display unit accepts a user operation for selecting the predetermined thumbnail, and switches from the frame image at the playback time immediately before the reception to the frame image at the time corresponding to the predetermined thumbnail, and performs switching. The reproduction of the moving image may be resumed from the frame image that has been received.
With the above configuration, when a user analyst wants to confirm in detail the video content at the time corresponding to a predetermined thumbnail from among the displayed thumbnails, the user can perform the operation by simply selecting the thumbnail. It is possible to resume playback of the video from the video content. Therefore, user convenience is further improved.

At this time, the video selection unit includes a video stop unit that receives a user operation and stops the video that is being played back, and the image selection unit, with the execution of the video stop unit, The frame image at a time determined when a predetermined time interval is set back and forth from the playback time may be selected.
With the above configuration, thumbnails are not displayed when a video is being played back, and thumbnails are displayed when the video being played back is stopped. This provides intuitive operability for the user analyst. it can.
In addition, since the thumbnail is displayed when the moving image is stopped, it is possible to reduce the possibility of the operation being delayed depending on the specifications of the CPU and the memory of the moving image reproducing apparatus.

At this time, the time interval changing unit sets the time interval to be wider than normal when the playback speed changing unit sets the playback speed faster than normal, and the playback speed changing unit When the speed is set slower than normal, the time interval is set to be narrower than normal, and the image selection unit sets the frame image at the predetermined time point and the predetermined time interval from the predetermined time point. Selecting the frame images at the first and previous time points determined when they are separated before and after, and the frame images at the second and subsequent time points determined when a predetermined time interval is provided from each of the first and previous time points, The thumbnail display unit may display at least five selected thumbnails on the display screen.
With the above configuration, when the user analyst wants to increase the playback speed of work videos and perform an overall (rough) work analysis, the time interval of the displayed thumbnails becomes wider, so the overall work content can be reduced. It becomes easier to grasp.
Further, when it is desired to perform a detailed work analysis by slowing down the reproduction speed of the work moving image, the time interval between thumbnails to be displayed is narrowed, so that it becomes easier to grasp the detailed work contents. Therefore, user convenience is further improved.
In addition, the above configuration allows the analyst who is a user to check five or more thumbnails at a predetermined time point, the first time point before and after the first time point, and the time point before and after the second time while simultaneously checking the work video. Leading to

At this time, the image selection unit may select the frame image at the predetermined time point and the frame image at a time point determined when a uniform time interval is set back and forth from the predetermined time point.
With the above configuration, it becomes easy for an analyst who is a user to intuitively understand the correspondence between the displayed thumbnails, which leads to efficiency of work analysis for the analyst.

At this time, the moving image display unit displays a seek bar together with the moving image on the display screen, receives a user operation for designating a time point different from the current reproduction time point on the displayed seek bar, and performs the current reproduction. The frame image at the time point is switched to the frame image at the different time point so that the reproduction of the moving image can be resumed from the switched frame image, and the image selection unit is designated with the different time point by a user operation. The frame image at the different time point and the frame image at the time point determined when a predetermined time interval is left from the different time point, and the thumbnail display unit re-selects the frame image at the re-selected time point. It is better to display thumbnails created based on this.
With the above configuration, it is possible to receive user operation designation using the seek bar and display thumbnails based on the designated designated time point and frame images before and after the designated time point, thus providing intuitive operability for the user. it can.

In addition, a moving image reproducing method by which a computer can reproduce a moving image composed of a plurality of frame images, wherein the moving image is a work moving image obtained by photographing work content, and the moving image reproducing method includes: It is possible to acquire work video data indicating a video, analyze the work content while reproducing the work video, and the computer displays a video on the display screen, and a display The frame image at a predetermined time point on the time axis set for the moving image and the frame image at a time point determined when a predetermined time interval is separated from the predetermined time point are selected from the moving image Image selection processing to be performed, and thumbnails created based on the selected frame images together with the moving images are displayed on the display screen. A display process, a playback speed changing process for receiving a user operation and changing the playback speed of the displayed video, and the time interval of the selected frame image is changed in accordance with the changed playback speed. In the thumbnail display process, when the thumbnail is displayed on the display screen, the playback time information corresponding to the thumbnail is displayed together, and input of a user operation is performed. Receiving, analyzing from the work video displayed on the display screen, dividing the work process as the work content into work elements, and calculating the work time in each work element; and in each work element Work element list display processing for displaying work time information on the display screen, and totaling the work time in each work element The moving image reproduction method further executes a total time display process for displaying the total time on the display screen can be realized.

ADVANTAGE OF THE INVENTION According to this invention, the moving image reproducing apparatus and moving image reproducing method which were utilized widely and improved the user convenience are realizable.
In addition, when the user is confirming the video at the playback time of the moving image without deteriorating the user convenience, a plurality of videos at the time points before and after the playback time can also be confirmed.
Further, when the playback speed of the moving image is changed by the user, the plurality of videos displayed together with the moving image can be changed according to the user's intention.
Further, it is possible to realize a moving image reproducing apparatus and a moving image reproducing method which are mainly used for work analysis and improve the convenience of an analyst who is a user.

It is a block diagram of the whole work moving image reproduction system of this embodiment. It is a hardware block diagram of a working moving image reproducing device. It is a software block diagram of a working moving image reproduction system. It is a figure which shows an example of work element list data. It is a figure which shows an example of the reproduction speed / time interval corresponding | compatible data which shows the correspondence of the reproduction speed of a working moving image, and the time interval of the selected frame image. It is a figure which shows an example of the reproduction | regeneration time / time interval coefficient corresponding | compatible data which shows the correspondence of the total reproduction time of a working moving image, and the time interval coefficient of the frame image selected. It is a figure which shows an example of a work analysis screen. It is a figure explaining the procedure which reselects a frame image with the change of reproduction speed. It is a figure explaining the procedure which reselects a frame image with the change of reproduction speed. It is a flowchart which shows an example of a process of the working moving image reproduction method of this embodiment.

Emphasis Hereinafter, embodiments of the present invention will be described with reference to FIGS.
The present embodiment is a work video playback device that plays back a work video obtained by capturing work content. When a work video is displayed on a display screen, a user operation is accepted and the work video being played back is stopped, Select the frame image at the playback time just before the stop and the frame image at the time determined when a predetermined time interval is set back and forth from the playback time, and display thumbnails based on each frame image on the same screen In addition, the present invention relates to an invention of a working video playback device, wherein when the playback speed of a work video is changed by a user operation, the time interval of each frame image is changed in accordance with the changed playback speed. Is.
The work video is composed of a plurality of frame images.

FIG. 1 shows a configuration of the entire work moving image reproduction system S of the present embodiment.
The work moving image reproduction system S is connected to a plurality of photographing devices 1 for photographing work contents of each work process and recording a work moving image in line work, and a plurality of photographing devices 1 through a network. Mainly composed of a work video reproduction device 10 that obtains work video data to be shown, analyzes a work process while reproducing the work video, and outputs work standard data indicating the contents of the work standard based on the analysis result Has been.
Here, the line work refers to an assembly of a series of work processes, and includes, for example, an “assembly line”. The work process refers to an assembly of a series of work elements, such as “engine assembly”, “bumper attachment”, “tire attachment”, and the like.
The work element indicates an assembly of a series of operations, and includes, for example, “preparing a bush”, “checking a bush set position”, “setting a bush”, “assembling to a vehicle body”, and the like. The operation indicates a minimum unit when the work is subdivided.

The photographing apparatus 1 is a video camera, for example, and is installed at a position where the work contents of each work process can be photographed in the line work, as shown in FIG.
The imaging device 1 captures each work content and records a work video. Then, work video data indicating the work video is created, and data is transmitted to the work video playback device 10.

The work video playback device 10 is a computer used by an analyst who performs work analysis, displays a work video indicated by work video data on a display screen, accepts a user operation, and selects a predetermined time from the work video. And a frame image at a time point determined when a predetermined time interval is set back and forth from a predetermined time point, and thumbnails based on the selected frame images are displayed on the same screen.
In addition, after accepting user operation, change the playback speed of the work video, change the time interval of each frame image according to the changed playback speed, and reselect the frame image at the changed time interval, A thumbnail based on each re-selected frame image is displayed.
The work moving image reproducing device 10 can perform data communication with the image capturing device 1 and store the work moving image data transmitted from the image capturing device 1.
In addition, the work video reproduction device 10 creates work standard data based on the results of work analysis and work organization based on the work video data, and outputs and displays the work standard data on a display screen. Can be printed.

A hardware configuration of the work moving image reproducing apparatus 10 is shown in FIG.
A working moving image reproduction apparatus 10 includes a CPU as a data calculation / control processing device, a ROM, a RAM, and an HDD as storage devices, and a communication interface that transmits and receives information data through a home network or the Internet. It is.
In addition, the working video playback device 10 includes a display device that displays information on characters or images displayed in a predetermined format, an input device that is operated by a user when inputting a predetermined command to the CPU, an external hard disk, and the like. A storage medium device. In addition, the work moving image playback device 10 may further include a printing device that outputs character or image information.
The photographing apparatus 1 is also a computer having a similar hardware configuration.

  In the ROM, HDD, and external storage device of the work video playback device 10, a work video playback program is stored in addition to the main program that performs the necessary functions as a computer, as shown in FIG. By being executed by the CPU, the function of the work moving image reproducing apparatus 10 is exhibited.

FIG. 3 shows a software configuration of the work moving image playback apparatus 10.
The work video reproduction device 10 will be described in terms of functions. The data storage unit 11 that stores various programs and various data, the data acquisition unit 12 that acquires the work video data from each photographing device 1, and each acquired work video data. The moving image display unit 13 that displays the work moving image indicated by the user on the display screen, the work element list display unit 14 that displays the work element list based on the work element list data stored in advance on the display screen, and accepts user operations. A video stop unit 15 for stopping the work video being played back, a frame image at the time of playback on the time axis set for the work video from the displayed work video, and a predetermined time interval before and after the playback time An image selection unit 16 for selecting a frame image at a time determined when the image is opened, and thumbnails based on the selected frame images are displayed on the display screen. A thumbnail display unit 17, a playback speed change unit 18 that receives a user operation and changes the playback speed of the displayed work video, and changes the time interval of the selected frame image in accordance with the changed playback speed. And a time interval changing unit 19 to be used as main components.
In addition, an analysis execution unit 20 that performs operation analysis on the work content from the displayed work video and a data output unit 21 that outputs work standard data based on the analysis result are provided as constituent elements.
These are constituted by a CPU, ROM, RAM, HDD, communication interface, various programs, and the like.

The data storage unit 11 stores work moving image data acquired from the photographing apparatus 1, work element list data shown in FIG. 4, reproduction speed / time interval correspondence data shown in FIG. 5, and reproduction time / time interval shown in FIG. Coefficient correspondence data and work standard data are stored.
The data storage unit 11 may be configured to hold and store various programs and various information data, or read various programs and various information data from a data server (not shown) and temporarily store them. It may be configured to be kept.

The moving image display unit 13 displays the work analysis screen 30 shown in FIG. 7 on the display of the work moving image playback apparatus 10 and displays the work moving image on the work analysis screen 30.
In addition, a user operation for selecting a predetermined thumbnail 38 displayed on the work analysis screen 30 is accepted, and the frame image at the playback time immediately before the reception is switched to the frame image at the time corresponding to the predetermined thumbnail 38. The reproduction of the moving image can be resumed from the switched frame image.
Further, on the seek bar 32 displayed on the work analysis screen 30, a user operation for designating a time point different from the current reproduction time point is accepted, and the frame image at the current reproduction time point is switched to the frame image at a different time point. Thus, the reproduction of the moving image can be resumed from the switched frame image.

The analysis execution unit 20 receives an input of a user operation, and calculates a work time of each work element by dividing the work process into work elements from the work moving image displayed on the work analysis screen 30 in FIG.
Also, the effective operation time is calculated after calculating the effective operation time indicating the time during which the human or machine has performed an effective operation on the work content and the invalid operation time indicating the time during which the human or machine has performed an invalid operation. The standard work time is calculated by integrating the rating rate.

  The photographing apparatus 1 will also be described in terms of functions. As shown in FIG. 3, in addition to storing various programs and various data, a data storage unit 2 for storing work moving image data and data creation for generating work moving image data. The unit 3 and a data transmission unit 4 that transmits work video data to the work video playback device 10 are provided as main components.

Next, the work element list data, the reproduction speed / time interval correspondence data, and the reproduction time / time interval coefficient correspondence data stored in the work moving image reproduction apparatus 10 will be described in detail with reference to FIGS.
As shown in FIG. 4, the work element list data is a data table showing a list of detailed contents of each work element in the work process, and the detailed contents of each work element are created and updated by accepting an input of a user operation. It is what is done.
Specifically, in the work element list data, NO. (Number), work element (name), type, start, element time (work time), valid time (valid operation time), invalid time (invalid operation time), rating (rating rate), and standard time (work standard time) ) Are associated with each other.
Here, the type is an item that is selected and input from the categories of “1: manual work”, “2: tool work”, and “3: machine work” for each work element.

As shown in FIG. 5, the reproduction speed / time interval correspondence data is a data table showing the correspondence between the reproduction speed of the work moving image and the time interval of the selected frame image.
FIG. 5 shows that the time interval of the selected frame images is 0.5 seconds when the reproduction speed of the work moving image is 1.0 times normal speed (normal state).
It shows that the time interval between frame images becomes wider as the playback speed becomes faster, and the time interval between frame images becomes narrower as the playback speed becomes slower.
More specifically, the time interval (seconds) of the frame image is calculated by integrating the reproduction speed (double speed) and the time interval coefficient serving as an index.

As shown in FIG. 6, the reproduction time / time interval coefficient correspondence data is a data table showing the correspondence between the total reproduction time of the work moving image and the time interval coefficient of the selected frame image.
Referring to the example of FIG. 5, when the total playback time of the work video is 60.0 seconds or more and less than 300.0 seconds (60.0 to 300.0 seconds), the time of the selected frame image It shows that the interval coefficient is 0.5.
The time interval coefficient increases as the total reproduction time increases.

Next, the work analysis screen 30 displayed on the display of the work video player 10 will be described in detail with reference to FIG.
The work analysis screen 30 mainly displays the content of the work video indicated by the work video data and the content of the work element list indicated by the work element list data, and accepts an input of a user operation to analyze the operation of the work process. It is a display screen for performing.
The content of the work video is displayed on a video window 31 provided on the work analysis screen 30. Looking at the embodiment, in the work process 1 “engine assembly”, the video of the work element 4 “assembly to the vehicle body” The contents are displayed.

In the work analysis screen 30, in the lower part of the moving image window 31, there is a seek bar 32 that indicates the reproduction time point of the reproduced working movie, and an execution button for accepting a user operation and stopping the working movie that is being reproduced. A stop button 33 that becomes and a play button 34 that is an execution button for receiving a user operation and playing the stopped work video are mainly displayed.
In the embodiment, the content of the moving image is displayed in a state of being stopped at the reproduction time “40.00 seconds”.

On the left side of the work analysis screen 30 with respect to the moving image window 31, a reproduction speed list window 35 showing the content of the reproduction speed of the reproduced work moving image is displayed.
The playback speed can be arbitrarily set from a maximum of 8.0 times speed to a minimum of 0.2 times speed in response to an input of a user operation.
In the embodiment, it is displayed that the reproduction speed of the work moving image is set at 1.0 times speed.

Numeric icons displayed side by side on the reproduction speed list window 35 in order to accept a user operation for selecting a predetermined numerical icon and change the current reproduction speed to a reproduction speed corresponding to the predetermined numerical icon. Functions as an execution button.
For example, when a user operation is accepted and the execution button of the number icon “4.0” is pressed, the playback speed of the work movie is changed from the current playback speed (for example, 1.0 times speed) to the number icon “4.0”. The playback speed is changed to 4.0 times normal speed.

The contents of the work element list are displayed on a work element list window 36 provided in the lower part of the work analysis screen 30.
In the embodiment, when an input of a user operation is received, NO. “1”, work element “prepare bush”, type “1: manual work”, start “1.00 (second)”, element time “8.00 (second)”, effective time “8.00 (second)” ”, Invalid time“ 0.00 (second) ”, rating“ 150 (%) ”, and standard time“ 12.00 (second) ”.
A total time display tab 37 indicating the work time, valid operation time, invalid operation time, and standard time of the work process is provided below the work element list window 36, and the input result of the work element list is displayed. It is automatically aggregated based on.

Here, on the moving image window 31, the thumbnail 38 a at a predetermined time of the work moving image, the thumbnails 38 b and 38 c at the first and previous time points determined when a predetermined time interval is set back and forth from the predetermined time point, and the first front and rear of each. The thumbnails 38d and 38e at the second and previous time points determined when a predetermined time interval is left from the time point are displayed.
In the embodiment, the thumbnail 38a displays the content of the frame image at the time of playback, and the thumbnails 38b and 38c display the content of the frame image at the time determined when the time interval is 0.5 seconds before and after the playback time. it's shown. In addition, the thumbnails 38d and 38e display the contents of the frame image at the time determined when the time interval is 1.0 seconds before and after the playback time.

Each of the thumbnails 38a to 38e receives a user operation for selecting a predetermined thumbnail, and switches from the frame image at the time of reproduction displayed immediately before the reception to the frame image at the time corresponding to the predetermined thumbnail. Functions as an execution button for resuming playback of a moving image from a frame image.
For example, when a user operation is accepted and the execution button of the thumbnail 38a displayed on the work analysis screen 30 is pressed, the work video displayed on the video window 31 is displayed from the frame image at the playback time point (40.00 seconds). The frame image at the time (39.00 seconds) corresponding to the thumbnail 38a is switched to, and the reproduction of the moving image is resumed from the switched frame image.

Next, a procedure for re-selecting a frame image from the work moving image according to the change in the reproduction speed will be described with reference to FIGS.
As a specific example, a case where the playback speed is changed from 1.0 times speed to 4.0 times speed for a work moving image with a total playback time of 100.0 seconds will be given.

First, as shown in FIG. 8, when an input of a user operation for stopping the work video being played back is made, a frame image at the time of playback when the work video is stopped and a time interval T from the playback time are set back and forth. A total of five frame images are selected, which are frame images at the first and subsequent time points determined at times, and frame images at the second and previous time points determined when the time interval T is spaced from the first and previous time points.
At this time, the time interval T (seconds) is a value calculated by integrating the reproduction speed V (double speed) and the time interval coefficient X serving as an index.
In this embodiment, since the total reproduction time is 100.0 seconds, the time interval coefficient is 0.5 with reference to the reproduction time / time interval coefficient correspondence data in FIG. As a result, the time interval T becomes 0.5 (seconds) by adding the time interval coefficient 0.5 to the reproduction speed 1.0 (double speed).
That is, the five frame images to be selected are a frame image at the time of reproduction and a frame image that is determined when a time interval of 0.5 seconds is sequentially provided before and after the reproduction time point.

Note that the work moving image is set with, for example, 30 frame images per second (frame rate is 30 fps (frame per second)).
In this case, the frame image determined when the time interval is 0.5 seconds from the playback time point is the 15th frame image counted from the frame image at the playback time point, and the 15th frame image is selected. The

Then, as shown in FIG. 9, when the input of a user operation is accepted and the playback speed of the work video is changed from 1.0 times speed to 4.0 times speed, the time interval T is also set corresponding to the changed playback speed. The time interval is changed to T ′.
The time interval T ′ becomes 2.0 (seconds) by adding the time interval coefficient 0.5 to the reproduction speed 4.0 (double speed).
As a result, the five frame images to be reselected include a frame image at the time of reproduction, a frame image at the first time point before and after the time interval of 1.0 seconds before and after the reproduction time point as a reference, It becomes a frame image at the second time point.

With the video playback device 10 having the above-described configuration, when the analyst who is a user wants to increase the playback speed of the work video and perform an overall work analysis, the time interval between the displayed thumbnails is widened. It becomes easier to grasp the work contents.
Further, when it is desired to perform a detailed work analysis by slowing down the reproduction speed of the work moving image, the time interval between thumbnails to be displayed is narrowed, so that it becomes easier to grasp the detailed work contents. Therefore, user convenience is improved.

<Work video playback method>
Next, processing of the work moving image reproduction program executed in the work moving image reproduction system S will be described with reference to FIG.
FIG. 10 shows that the work video playback device 10 corresponding to a computer displays the work video on the display screen based on the work video data acquired from each photographing device 1 in the processing of the work video playback program according to the present embodiment. When the work video that is being played back is stopped by accepting a user operation, the frame image at the time of playback is selected from the work video, and the frame image at the time determined when a predetermined time interval is set back and forth from the time of playback. Then, thumbnails based on each frame image are displayed on the same screen, and after that, when the playback speed of the work video is changed by a user operation, the time interval of each frame image is changed according to the changed playback speed, It is a flowchart which performs the process which redisplays the thumbnail based on each frame image selected again on the same screen.

  The work video playback program according to the present embodiment includes the data acquisition unit 12, the video display unit 13, and the work element list display unit described above as functional components of the work video playback device 10 including the data storage unit 11. 14, moving image stop unit 15, image selection unit 16, thumbnail display unit 17, playback speed change unit 18, time interval change unit 19, analysis execution unit 20, and data output unit 21. Therefore, it is a utility program in which various programs are aggregated, and the CPU of the work moving image reproducing apparatus 10 executes this work analysis program.

In the work video playback process shown in FIG. 10, first, the data acquisition unit 12 of the work video playback device 10 receives the work video data from each photographing device 1 installed at a position where each work content process can be photographed in the line work. It starts from step 01 (ST01) to acquire.
The work moving image data is data indicating a work moving image obtained by photographing the work content of each work process, and is stored and stored in the data storage unit 11 after the data is acquired.

Next, in step 02, the moving image display unit 13 displays the work moving image indicated by the working moving image data on the display screen.
Specifically, the work analysis screen 30 of FIG. 7 is displayed on the display screen of the work video playback device 10, and the content of the work video of work process 1 “engine assembly” is displayed on the video window 31 on the work analysis screen 30. To display.

Next, in step 03, the moving image stop unit 15 receives a user operation input and stops the work moving image being reproduced.
Specifically, as shown in FIG. 7, when a stop button 33 displayed on the work analysis screen 30 is received in response to an input of a user operation, the work movie being reproduced is stopped.

Next, in step 04, the image selection unit 16 moves the frame image at a predetermined time point on the time axis set for the work moving image from the displayed work moving image and the predetermined time interval before and after the predetermined time point. A frame image at a time point that is determined when it is freed is selected.
Specifically, as shown in FIG. 8, a frame image at the time of playback when the work video is stopped, and a frame image at the first and previous time points determined when a predetermined time interval is set back and forth from the playback time point, A total of five frame images are selected, including the frame images at the second and previous time points determined when a predetermined time interval is left from the first and previous time points.

Next, in step 05, the thumbnail display unit 17 displays thumbnails created based on the selected frame images on the display screen.
Specifically, on the work analysis screen 30 in FIG. 7, the thumbnail 38 a at the playback time immediately before the stop, the thumbnails 38 b and 38 c at the first and previous time points, and the thumbnails 38 d and 38 e at the second and previous time points are displayed on the moving image window 31. Are displayed side by side in the horizontal width direction.

Next, in step 06, the playback speed changing unit 18 receives an input of a user operation and changes the playback speed of the displayed work video.
Specifically, when a user operation input is accepted and an execution button of a predetermined number icon is pressed on the playback speed list window 35 of FIG. 7, the work video playback speed is changed from the current playback speed to a predetermined number. Change to the playback speed corresponding to the icon.

Next, in step 07, the time interval changing unit 19 changes the time interval of the selected frame image in accordance with the changed reproduction speed.
Specifically, the time interval of the frame image is changed in accordance with the changed playback speed with reference to the playback speed / time interval correspondence data in FIG. 5 and the playback time / time interval coefficient correspondence data in FIG. .

Next, in step 08, when the time interval is changed, the image selection unit 16 sets a frame image at a predetermined time point, and a frame image at a time point determined when the time interval changed from the predetermined time point is set back and forth. Reselect.
Specifically, as shown in FIG. 9, the frame image at the playback time point, the frame image at the first and previous time points determined when the time interval changed from the playback time point is set back and forth, and the change from the first and previous time points A total of five frame images are selected again from the frame images at the second and previous time points determined when the set time interval is left.

Finally, in step 09, the thumbnail display unit 17 redisplays the thumbnails created based on the reselected frame images on the display screen.
Specifically, on the work analysis screen 30 in FIG. 7, the thumbnail 38a at the playback time point, the thumbnails 38b ′ and 38c ′ at the first and previous time points, and the thumbnails 38d ′ and 38e ′ at the second and previous time points are displayed in the moving image window 31. Displayed side by side in the horizontal width direction.

The process of FIG. 10 is terminated through the above steps 01 to 09.
According to the above processing flow of the work video playback program, when the user analyst checks the video at the time of playback of the work video, it can also check a plurality of thumbnails at the time before and after the playback time. it can.
Further, when the analysis speed of the work video is changed by the analyst, a plurality of thumbnails displayed together with the work video can be changed according to the intention of the analyst.

<Other embodiments>
In the above embodiment, as shown in FIG. 8, the image selection unit 16 selects a frame image at the time of playback and a frame image at a time before and after a predetermined time interval from the playback time from the work video. However, the frame image may be selected based on an arbitrary time point without being limited to the playback time point.
In addition, the image selection unit 16 may be able to select a frame image at the reproduction time point and a frame image only at a time point before the reproduction time point. Further, it may be possible to select the frame images only at the time points before and after the reproduction time point without using the frame image at the reproduction time point.
Furthermore, although each frame image is selected with a uniform time interval, it may be possible to select each frame image with a different time interval.

In the above embodiment, as shown in FIG. 8, when a user operation is performed to stop the work video being played back, the image selection unit 16 selects five predetermined frame images from the work video. However, it can be changed without any particular limitation.
For example, the image selection unit 16 may receive a user operation and select a predetermined frame image even while the work moving image is being reproduced. Further, it may be possible to automatically select a predetermined frame image regardless of a user operation.
Then, the thumbnail display unit 17 can display the thumbnail even while the work video is being played back, and the video playback device 10 can be set and changed according to the user's intention.
Further, for example, the image selection unit 16 may be able to select only two or three predetermined frame images, or may be able to select more than five.

  In the above embodiment, as shown in FIG. 6, the time interval coefficient is set corresponding to the total playback time of the work video, but is not particularly limited, and the user can arbitrarily set the time interval coefficient. It may be possible. Then, since the user can freely determine the time interval between adjacent thumbnails, the convenience for the user is further improved.

In the present embodiment, the video playback apparatus and video playback method according to the present invention have been mainly described.
However, said embodiment is only an example for making an understanding of this invention easy, and does not limit this invention. The present invention can be changed and improved without departing from the gist thereof, and the present invention includes the equivalents thereof.
In particular, the processing described in the above embodiment regarding the processing of the video playback program executed by the video playback device 10 and the configuration and layout of various data and various display screens are merely examples, and this The invention is not limited.

S Work video playback system (video playback system)
DESCRIPTION OF SYMBOLS 1 Image pick-up device 2 Data storage part 3 Data preparation part 4 Data transmission part 10 Work moving image reproduction apparatus (moving image reproduction apparatus)
11 Data storage unit 12 Data acquisition unit 13 Movie display unit 14 Work element list display unit 15 Movie stop unit 16 Image selection unit 17 Thumbnail display unit 18 Playback speed change unit 19 Time interval change unit 20 Analysis execution unit 21 Data output unit 30 Work Analysis screen 31 Movie window 32 Seek bar 33 Stop button 34 Playback button 35 Playback speed list window 36 Work element list window 37 Total time display tab (total time display section)
38, 38a, 38b, 38c, 38d, 38e Thumbnail 38a ', 38b', 38c ', 38d', 38e 'Thumbnail

Claims (8)

A video playback device that plays back a video composed of a plurality of frame images,
The video is a work video shot of the work content,
The video playback device is a device capable of acquiring work video data indicating the work video and analyzing the work content while playing back the work video,
A video display unit for displaying the video on a display screen;
From the displayed moving image, the frame image at a predetermined time point on a time axis set for the moving image, and the frame image at a time point determined when a predetermined time interval is left from the predetermined time point, An image selection section to select;
A thumbnail display unit for displaying a thumbnail created based on each of the selected frame images on the display screen together with the moving image;
A playback speed changing unit that receives a user operation and changes the playback speed of the displayed video;
A time interval changing unit that changes the time interval of the selected frame image in correspondence with the changed playback speed, and
When displaying the thumbnail on the display screen, the thumbnail display unit displays information at the time of playback corresponding to the thumbnail ,
An analysis execution unit that accepts an input of a user operation, divides a work process as the work content into work elements from the work video displayed on the display screen, and calculates a work time in each work element;
A work element list display unit for displaying information on work time in each work element on the display screen;
A moving picture reproducing apparatus , further comprising: a total time display unit that totals the total work time of each work element and displays the total time on the display screen . The analysis execution unit calculates an effective operation time and an invalid operation time in each work element from the work video, and then calculates a work standard time by adding a rating rate to the effective operation time,
The work element list display unit displays information on the work time, the valid operation time, the invalid operation time, and the work standard time in each work element on the display screen,
The total time display unit totals the total time of the work time, the valid operation time, the invalid operation time, and the work standard time in each work element, and displays the total time on the display screen. video playback apparatus according to claim 1, wherein the benzalkonium be displayed. The moving image display unit accepts a user operation to select a predetermined thumbnail, switches the frame image at a playback time immediately before reception from the frame image at a time corresponding to the predetermined thumbnail, and switches the frame image video playback apparatus according to claim 1 or 2, characterized in that to resume the reproduction of the moving image from the frame image. A video stop unit that accepts user operations and stops the video being played,
The image selection unit, with the execution of the moving image stop unit, the frame image at the playback time immediately before the stop, and the frame image at a time determined when a predetermined time interval is set back and forth from the playback time point, video playback apparatus according to any one of claims 1 to 3, characterized in that selecting. The time interval changing unit is
When the playback speed changing unit sets the playback speed faster than normal, the time interval is set to be wider than normal,
When the playback speed changing unit sets the playback speed slower than normal, the time interval is set to be narrower than normal,
The image selection unit includes the frame image at the predetermined time point, the frame image at the first time point before and after the predetermined time interval from the predetermined time point, and the first front and back time points. Selecting the frame images at the second and previous time points determined when a predetermined time interval is provided;
The thumbnail display section, video playback apparatus according to the thumbnail consisting of at least five selected in any one of claims 1 to 4, characterized in that displayed on the display screen. Wherein the image selecting section includes: the frame image in the predetermined time, according to claim 5, characterized in that selecting, said frame images at the time determined when the opened respectively before and after a uniform time intervals from the predetermined time The moving image reproducing apparatus according to 1. The moving image display unit displays a seek bar together with the moving image on the display screen, receives a user operation for designating a time point different from the current reproduction time point on the displayed seek bar, and receives the user operation at the current reproduction time point. Switching from the frame image to the frame image at the different time point, the playback of the moving image can be resumed from the switched frame image,
When the different time point is specified by a user operation, the image selection unit reselects the frame image at the different time point and the frame image at a time point determined when a predetermined time interval is separated from the different time point. And
The thumbnail display section, video playback apparatus according to any one of claims 1 to 6, characterized in that displaying the thumbnails is created based on the frame image reselection. A video playback method that allows a computer to play a video composed of a plurality of frame images,
The video is a work video shot of the work content,
The video playback method is capable of acquiring work video data indicating the work video and analyzing the work content while playing back the work video,
The computer is
A video display process for displaying the video on a display screen;
From the displayed moving image, the frame image at a predetermined time point on a time axis set for the moving image, and the frame image at a time point determined when a predetermined time interval is left from the predetermined time point, Image selection process to select,
A thumbnail display process for displaying a thumbnail created based on each selected frame image on the display screen together with the video;
A playback speed change process for receiving a user operation and changing the playback speed of the displayed video;
A time interval changing process for changing the time interval of the selected frame image in correspondence with the changed playback speed, and
In the thumbnail display process, when displaying the thumbnail on the display screen, the playback time information corresponding to the thumbnail is displayed together,
An analysis execution process that accepts an input of a user operation and divides a work process as the work content into work elements from the work video displayed on the display screen, and calculates a work time in each work element;
Work element list display processing for displaying work time information in each work element on the display screen;
A moving image reproduction method , further comprising: performing a total time display process of totaling the total work time in each work element and displaying the total time on the display screen .

Images