JP6842194B2 - Display control device, display control method and display control program - Google Patents

Description

Cross-reference of related applications

This application is based on Japanese Application No. 2016-241446 filed on December 13, 2016, the contents of which are incorporated herein by reference.

The present invention relates to a display control device, a display control method, and a display control program.

In recent years, cameras have become smaller and lighter, and cameras have been installed in various places to shoot moving images. For example, wearable cameras that can be worn on the body to continuously shoot first-person viewpoint images are becoming widespread. A long-time video taken may be confirmed by fast-forwarding.

Regarding high-speed playback processing of moving images, Patent Document 1 describes a calculation system that calculates a smoothed camera path based on an input moving image and outputs a moving image with reduced shaking.
Further, Non-Patent Document 1 describes a moving image player that reproduces a scene related to a specific event relatively slowly and reproduces other scenes relatively quickly.

U.S. Pat. No. 2015/0248916

Kai-Yin Cheng, 3 others, "SmartPlayer: User-Centric Video Fast-Forwarding", April 4, 2009, CHI2009, Internet (URL: http://vc.cs.nthu.edu.tw/home/ paper / codfiles / klhsueh / 201103100947 / SmartPlayer, User-Centric Video Fast-Forwarding.pdf)

According to the technique described in Patent Document 1, even for a moving image including shaking such as a moving image taken by a wearable camera, it is possible to suppress the amplification of shaking due to fast-forwarding and generate a fast-forwarding moving image with relatively little shaking. it can. Further, according to the technique described in Non-Patent Document 1, it is possible to confirm the details of the scene related to a specific event and grasp the outline of other scenes.

However, since the specific event in Non-Patent Document 1 is predetermined, when trying to grasp the details of a scene other than the specific scene, it is necessary to observe a moving image that is played back relatively quickly. , It may be difficult to grasp the contents.

Therefore, the present invention provides a display control device, a display control method, and a display control program capable of grasping the details of a scene that the user pays attention to and grasping the outline of other scenes.

The display control device according to one aspect of the present invention includes a video acquisition unit that acquires a video including an event frame group that is a set of frames associated with an event, and an event selection reception that accepts selection of one or a plurality of events from a user. The playback speed of the first frame group associated with the unit and one or more events related to the selection received by the event selection reception unit among the event frame groups is the playback speed of the second frame group other than the first frame group. It is provided with a moving image display control unit that displays moving images in different ways.

According to this aspect, since the event is associated with the frame constituting the moving image, the scene of interest of the user can be selected from the moving image. Then, the first frame group associated with one or more events related to the user's selection is displayed at a different speed from the second frame group, which is another frame group, so that the details of the scene that the user pays attention to can be displayed. You can grasp and get an overview of other scenes.

In the above aspect, the playback speed receiving unit that receives the first playback speed of the moving image is further provided, and the moving image display control unit displays the moving image with the total playback time calculated based on the length of the moving image and the first playback speed. As described above, the second frame group may be displayed at a second reproduction speed faster than the first reproduction speed, and the first frame group may be displayed at a reproduction speed slower than the second reproduction speed.

According to this aspect, the total playback time is determined according to the setting of the first playback speed, and the scene related to the selected event is displayed relatively slowly so as to be within the set total playback time. Other scenes are displayed relatively quickly. Therefore, the details of the scene that the user pays attention to can be grasped within a predetermined time, and the outline of other scenes can be grasped.

In the above aspect, a speed ratio receiving unit that accepts one or more speed ratios of the reproduction speed of the first frame group and the reproduction speed of the second frame group may be further provided.

According to this aspect, the speed ratio of the playback speed of the scene related to the selected event and the playback speed of other scenes is set, and the playback speed of the scene related to the event can be adjusted according to the degree of attention.

In the above embodiment, the time of the moving image is such that the scale intervals are unequal according to the playing speed of the moving image based on the ratio of the scene related to the event to the entire moving image, the length of the moving image, and the speed ratio of one or more. A scale display control unit that displays a scale indicating the progress may be further provided.

According to this aspect, it is possible to intuitively grasp the difference in the playback speed between the scene related to the selected event and the other scenes without playing the moving image.

In the above aspect, a slider display control unit that displays a slider that moves along the scale with the display of the moving image so as to move at a constant speed regardless of a change in the playback speed of the moving image may be further provided.

According to this aspect, the movement speed of the slider, whose movement cannot be grasped unless the video is played, is fixed, and the change in the playback speed is represented by a scale that allows the entire picture to be grasped without playing the video, so that the video is not played. It is also possible to grasp the difference in playback speed between the scene related to the selected event and other scenes.

In the above aspect, an effect display control unit that visualizes the change in the reproduction speed of the moving image may be further provided along the scale.

According to this aspect, it is possible to grasp the relative difference in the playback speed between the scene related to the selected event and the other scenes and the difference in the absolute playback speed without playing the moving image.

In the above embodiment, when one or more speed ratios received by the speed ratio receiving unit are changed, the scale display control unit sets the scale so that the scale interval changes according to the change of one or more speed ratios. It may be displayed.

According to this aspect, it is possible to intuitively grasp how the difference in playback speed between the scene related to the selected event and other scenes changes according to the change in the speed ratio without playing the video. it can.

In the above aspect, when the first reproduction speed received by the reproduction speed reception unit is changed, the scale display control unit displays the scale so that the scale interval does not change regardless of the change in the first reproduction speed. May be good.

According to this aspect, it is possible to intuitively grasp that the speed ratio between the playback speed of the selected scene and the playback speed of other scenes is constant even when the entire playback time is changed. it can.

The display control method according to one aspect of the present invention is a first step of acquiring a moving image including an event frame group which is a set of frames associated with an event, and a second step of accepting selection of one or a plurality of events from a user. The playback speed of the first frame group associated with one or more events related to the selection received in the second step of the event frame group is different from the playback speed of the second frame group other than the first frame group. Includes a third step of displaying a moving image.

According to this aspect, since the event is associated with the frame constituting the moving image, the scene of interest of the user can be selected from the moving image. Then, the first frame group associated with one or more events related to the user's selection is displayed at a different speed from the second frame group, which is another frame group, so that the details of the scene that the user pays attention to can be displayed. You can grasp and get an overview of other scenes.

The display control program according to one aspect of the present invention allows the computer to receive from the user a moving image acquisition unit that acquires a moving image including an event frame group that is a set of frames associated with an event, and selection of one or a plurality of events. The playback speed of the event selection reception unit and the first frame group associated with one or more events related to the selection received by the event selection reception unit among the event frame groups is that of the second frame group other than the first frame group. It functions as a video display control unit that displays a video so that it differs from the playback speed.

According to this aspect, since the event is associated with the frame constituting the moving image, the scene of interest of the user can be selected from the moving image. Then, the first frame group associated with one or more events related to the user's selection is displayed at a different speed from the second frame group, which is another frame group, so that the details of the scene that the user pays attention to can be displayed. You can grasp and get an overview of other scenes.

It is a figure which shows the physical structure of the display control apparatus which concerns on embodiment of this invention. It is a functional block diagram of the display control device which concerns on embodiment of this invention. It is a figure which shows the structure of the moving image acquired by the display control device which concerns on embodiment of this invention. It is a figure which shows the 1st example of the display screen displayed by the display control device which concerns on embodiment of this invention. It is a flowchart of the moving image display processing executed by the display control device which concerns on embodiment of this invention. It is a figure which shows the 2nd example of the display screen displayed by the display control device which concerns on embodiment of this invention. It is a flowchart of the speed ratio change process executed by the display control device which concerns on embodiment of this invention. It is a flowchart of the 1st fast-forward speed change process executed by the display control apparatus which concerns on embodiment of this invention. It is a figure which shows the 3rd example of the display screen displayed by the display control device which concerns on embodiment of this invention. It is a flowchart of the selection event addition processing executed by the display control device which concerns on embodiment of this invention.

Embodiments of the present invention will be described with reference to the accompanying drawings. In each figure, those having the same reference numerals have the same or similar configurations.

FIG. 1 is a diagram showing a physical configuration of a display control device 10 according to an embodiment of the present invention. The display control device 10 includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 12, a ROM (Read only Memory) 13, a communication interface 14, an input unit 15, and a display unit 16. Each of these configurations is connected to each other via a bus so that data can be transmitted and received.

The CPU 11 is a control unit that controls the display of moving images stored in the RAM 12 or the ROM 13, calculates data, and processes the data. The CPU 11 is an arithmetic unit that executes an application program for displaying a moving image. The CPU 11 receives various input data from the input unit 15 and the communication interface 14, displays the calculation result of the input data on the display unit 16, and stores it in the RAM 12 or the ROM 13.

The RAM 12 is a storage unit capable of rewriting data, and is composed of, for example, a semiconductor storage element. The RAM 12 stores programs and data such as application software executed by the CPU 11.

The ROM 13 is a storage unit capable of only reading data, and is composed of, for example, a semiconductor storage element. The ROM 13 stores programs and data such as firmware.

The communication interface 14 is an interface for connecting the display control device 10 to a communication network, and is, for example, a communication network such as a LAN (Local Area Network) or WAN (Wide Area Network) configured by a data transmission line of a wired or wireless line. Connected to.

The input unit 15 receives data input from the user, and is composed of, for example, a keyboard, a mouse, and a touch panel.

The display unit 16 visually displays the calculation result by the CPU 11, and is configured by, for example, an LCD (Liquid Crystal Display) to display a moving image.

The display control device 10 may be configured by executing the moving image display control program according to the present embodiment by the CPU 11 of a general personal computer or a smartphone. The moving image display control program may be stored in a storage medium readable by a computer such as a RAM 12 or a ROM 13 and provided, or may be provided via a communication network connected by a communication interface 14.

FIG. 2 is a functional block diagram of the display control device 10 according to the embodiment of the present invention. In addition to the input unit 15 and the display unit 16, the display control device 10 includes a playback speed reception unit 20, a display control unit 21, an event selection reception unit 22, a speed ratio reception unit 23, and a moving image acquisition unit 25.

The event selection reception unit 22 accepts the selection of one or a plurality of events from the user. The event selection reception unit 22 accepts the selection of one or a plurality of events input by the user by the input unit 15. Here, the event means an event related to a specific object or action. The event selection reception unit 22 receives from the user the selection of the target or action that the user pays attention to. In the present embodiment, the case where the event selection reception unit 22 accepts the selection of one or more events from the operation event, the stop event, the hand event, and the person event will be described. An operation event is an event of moving a camera that shoots a moving image, and a stop event is an event of stopping a camera that shoots a moving image. A hand event is an event related to the hand (arm, finger) of a videographer, and a person event is an event in which a videographer and a person are confronting each other.

The video acquisition unit 25 acquires a video including an event frame group which is a set of frames associated with the event. In the present embodiment, the moving image is stored in the moving image storage unit 30 placed outside the display control device 10, and the moving image acquisition unit 25 acquires the moving image from the moving image storage unit 30. However, the moving image storage unit 30 may be provided in the display control device 10. Further, the moving image acquisition unit 25 may acquire a moving image via the communication network by the communication interface 14. Further, the video acquisition unit 25 acquires a video having no association with the event from the video storage unit 30, analyzes the frame included in the video, associates it with the event, and includes the event frame group. It may be converted into a video.

The display control unit 21 causes the display unit 16 to display a moving image and a UI (User Interface) related to the moving image. The display control unit 21 includes a moving image display control unit 21a, a scale display control unit 21b, a slider display control unit 21c, and an effect display control unit 21d. In the moving image display control unit 21a, the playback speed of the first frame group associated with one or a plurality of events related to the selection received by the event selection reception unit 22 among the event frame groups is the second frame other than the first frame group. Display the video so that it is slower than the playback speed of the group.

The scale display control unit 21b displays a scale indicating the passage of time in the moving image. The scale display control unit 21b is one or a plurality of the playback speed of the first frame group and the playback speed of the second frame group received by the reception unit 23, the ratio of the scene related to the event to the entire moving image, the length of the moving image, and the speed ratio. Based on the speed ratio, the scales are displayed so that the scale intervals are unequal according to the playback speed of the moving image.

The slider display control unit 21c displays a slider that moves along the scale along with the display of the moving image so as to move at a constant speed regardless of the change in the playback speed of the moving image. The effect display control unit 21d displays an effect that visualizes the change in the playback speed of the moving image along the scale.

The playback speed reception unit 20 receives the first playback speed of the moving image. In the present specification, the case where the first reproduction speed is the first fast-forward speed v1 which is faster than the normal reproduction speed of a moving image (for example, the reproduction speed of displaying 30 frames per second) will be described. However, the first reproduction speed may be a reproduction speed lower than the normal reproduction speed of the moving image. The moving image display control unit 21a performs the second reproduction faster than the first reproduction speed in the second frame group so that the moving image is displayed with the total reproduction time calculated based on the length of the moving image and the first reproduction speed. It is displayed at a speed, and the first frame group is displayed at a playback speed slower than the second playback speed. In this specification, the case where the second reproduction speed is the second fast-forward speed v2 which is faster than the first fast-forward speed v1 will be described. Further, in the present specification, the case where the reproduction speed of the first frame group is slower than the second fast-forward speed v2 and is the reproduction speed v of the scene related to the event related to the selection will be described.

FIG. 3 is a diagram showing a configuration of a moving image MV acquired by the display control device 10 according to the embodiment of the present invention. The moving image MV is composed of a plurality of frame FRs (still images), and includes a frame group which is a set of a plurality of frame FRs. The figure shows how the frame FRs are arranged in the order of reproduction from left to right to form a moving image MV. The frame group is roughly divided into an event frame group, which is a set of frames associated with an event, and a non-event frame group MV10 (a set of frames not associated with an event). In the case of the moving image MV of this example, the event frame group includes the hand event frame group MV11 and the person event frame group MV12. In this example, two types of frame groups, a hand event frame group MV11 and a person event frame group MV12, are exemplified as the event frame group, but the moving image MV may include three or more types of frame groups. It may be good, and the non-event frame group may not be included. For example, with respect to an operation event representing an event of moving a camera for shooting a moving image and a stopping event representing an event of stopping a camera, the frames constituting the moving image are divided into an operation event frame group and a stop event frame group. It will be.

The moving image MV of this example includes a non-event frame group MV10, a hand event frame group MV11, a non-event frame group MV10, a person event frame group MV12, a non-event frame group MV10, and a hand event frame group MV11 in the order of playing the moving image. It is configured. A hand tag TG1 is attached to a plurality of frame FRs included in the hand event frame group MV11, and a person tag TG2 is attached to the person event frame group MV12. The moving image MV is stored in the moving image storage unit 30 in a state where an event tag such as a hand tag TG1 or a person tag TG2 is attached to each frame FR and the frame FR and the event are associated with each other. The event tag does not necessarily have to be assigned for each frame, and may be assigned by specifying the frame number to which the event tag is attached, or for each frame group. Further, the association between the frame and the event constituting the moving image may be performed by a method other than tagging, and for example, the correspondence table between the frame and the event may be associated with the moving image and stored.

The moving image MV may be one that has been analyzed in advance for each frame and stored in the moving image storage unit 30 in a state associated with the event. However, not only the moving image MV is in a state associated with the event when it is stored in the moving image storage unit 30, but also the frame is analyzed by the display control device 10 after being acquired by the moving image acquisition unit 25. , It may be converted to the state associated with the event by associating it with the event. The display control device 10 may analyze the original data of the moving image and convert it into a state associated with the event. Further, the association between the frame and the event may be performed by associating the degree of matching between the frame and the event with the frame. The degree of matching may be calculated for a plurality of events for one frame or a group of frames.

FIG. 4 is a diagram showing a first example of a display screen DP displayed by the display control device 10 according to the embodiment of the present invention. The display screen DP includes a moving image display screen DP1, a moving image selection screen DP2, a scale DP3, an operation cue DP21, a stop cue DP22, a hand cue DP23, a person cue DP24, a first fast-forward speed setting slider DP30, and a playback slider DP40. In this specification, the case where the moving image MV shown in FIG. 3 is acquired and displayed by the moving image acquisition unit 25 will be described. That is, in the following, the moving image MV including the non-event frame group MV10, the hand event frame group MV11, the non-event frame group MV10, the person event frame group MV12, the non-event frame group MV10, and the hand event frame group MV11 is displayed in the order of reproduction. The case will be described.

The moving image display screen DP1 is a display area for displaying a moving image. A moving image is displayed on the moving image display screen DP1 by the moving image display control unit 21a. The moving image selection screen DP2 is a display area for selecting a moving image other than the moving image displayed on the moving image display screen DP1. In this example, thumbnails of four videos are displayed on the video selection screen DP2, but thumbnails of three or less or five or more videos may be displayed on the video selection screen DP2, and text information is displayed. May be done.

The scale DP3 is displayed by the scale display control unit 21b and indicates the passage of time of the moving image. In the case of the example shown in FIG. 4, the scale DP3 is the first example DP10a of the non-event section, the first example DP11a of the hand event section, the first example DP10a of the non-event section, and the first hand event section in the order of playback of the moving images. Examples include DP11a. Each of these sections corresponds to a group of frames included in the moving image.

The scale display control unit 21b displays the scale DP3 so that the scale intervals are unequal according to the playback speed of the moving image. In the case of this example, since the moving image display control unit 21a displays the scene related to the hand event later than the other scenes, the scale display control unit 21b sets the scale interval of the first example DP11a of the hand event section to the non-event section. The first example of the above is displayed wider than the scale interval of DP10a. By displaying the scale intervals at unequal intervals in this way, it is possible to intuitively grasp the difference in playback speed between the scene related to the selected event and other scenes without playing the moving image.

On the scale DP3, the effect DP11e of the hand event that visualizes the change in the reproduction speed of the moving image is displayed by the effect display control unit 21d along the scale DP3. In FIG. 4, the effect DP11e of the hand event is displayed so as to be darker at a portion where the reproduction speed is slower and lighter at a portion where the reproduction speed is faster. The intensity (thinness) of the effect may be changed according to the absolute value of the playback speed. By displaying the effect by the effect display control unit 21d, the relative difference in playback speed between the scene related to the selected event and other scenes and the absolute difference in playback speed can be grasped without playing the video. can do.

The operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24 function as an event selection reception unit 22 that receives selection of an operation event, a stop event, a hand event, and a person event from the user, respectively. The operation queue DP21 selects a frame in which the camera for shooting a moving image is determined to be moving, and the stop queue DP22 selects a frame in which the camera for shooting a moving image is determined to be stopped. is there. In addition, the hand cue DP23 selects a frame in which the hand (arm, finger) of the videographer is determined to be reflected, and the person cue DP24 is the whole body and upper body of the person facing the videographer. , The frame that is judged to show the lower body or face is selected. In the case of this example, the frame selected by the hand queue DP23 does not overlap with the frame selected by the person queue DP24. In the case of the moving image MV shown in FIG. 3, the hand cue DP23 selects the hand event frame group MV11, and the person cue DP24 selects the person event frame group MV12. The event selection reception unit 22 may select a frame group corresponding to the event related to the user's selection based on the degree of matching between the frame and the event associated with the frame of the moving image.

The operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24 each include a slider. Each slider functions as a speed ratio reception unit 23, and by moving each slider between 0 and 1, the playback speed of the first frame group constituting the scene related to the selected event and other scenes are configured. The speed ratio with the playback speed of the second frame group can be adjusted. When the slider is in the 0 position, the event is not included in the selection received by the event selection reception unit 22, and the scene related to the event is displayed at the same playback speed (second fast forward speed v2) as the non-event scene. Will be done. When the slider is at a position larger than 0, the event becomes an event related to the selection received by the event selection reception unit 22, and the scene related to the event has a slower playback speed than the non-event scene (the scene related to the event related to the selection). It is displayed at the playback speed v). The larger the numerical value pointed to by the slider, the larger the speed ratio r obtained by dividing the second fast-forward speed v2 by the playback speed v is set. For example, when the position of the slider is x (0 ≦ x ≦ 1), the speed ratio r = v2 / ve of the second fast-forward speed v2 and the playback speed ve of the scene related to the event may be r = 1 + x. .. In general, the speed ratio may be determined by r = 1 + f (x) using a monotonically increasing function f (x) that satisfies f (0) = 0. In the case of this example, the hand speed ratio adjustment slider DP23a is set to the position of "0.25", the hand event is selected by the user, the playback speed ve of the scene related to the hand event and the playback speed of other scenes ( The speed ratio with the second fast-forward speed v2) may be, for example, r = v2 / ve = 1.25. The speed ratio reception unit 23 refers to the event tag (or the correspondence table between the frame and the event) attached to the frame of the moving image, and based on the degree of matching between the frame and the event and the position of the slider, the event related to the user's selection. The speed ratio between the playback speed of the frame group corresponding to the above and the playback speed of other scenes may be calculated.

Speed ratio According to the reception unit 23 (slider included in the operation cue DP21, the stop cue DP22, the hand cue DP23, and the person cue DP24, respectively), the speed ratio of the playback speed of the scene related to the selected event to the playback speed of other scenes. Is set, and the playback speed of the scene related to the event can be adjusted according to the degree of attention. The case where a plurality of sliders are set to non-zero positions will be described in detail later.

The first fast-forward speed setting slider DP30 functions as a playback speed reception unit 20 that receives the first playback speed of the moving image. In the case of this example, the first fast-forward speed setting slider DP30 is set at the position of "× 10.0", indicating that the first fast-forward speed v1 is 10 times the normal playback speed. .. If the normal playback speed is a speed that displays 30 frames per second, the first fast-forward speed v1 that is 10 times that speed displays 30 frames per 0.1 second (or is selected from the 30 frames). It is the speed to display several frames). In this case, the moving image display control unit 21a extracts 3 frames from the 30 frames displayed in the case of normal playback and displays the 3 frames in 1 second to display the moving image at the first fast-forward speed v1. May be done.

The moving image display control unit 21a sets the second frame group faster than the first playback speed v1 so that the moving image is displayed with the total playback time T calculated based on the length of the moving image and the first playback speed v1. The second reproduction speed v2 is displayed, and the first frame group is displayed at a reproduction speed v slower than the second reproduction speed v2.

If the length of the moving image is 10 minutes and the first fast-forward speed setting slider DP30 sets the first fast-forward speed v1 to be 10 times the normal playback speed, the total playback time T is 1. Minutes. In this case, the moving image display control unit 21a displays the second frame group (frame group corresponding to the first example DP10a of the non-event section) at the second fast-forward speed v2 so that the moving image is played back in one minute as a whole. Then, the first frame group (frame group corresponding to the first example DP11a of the hand event section) is displayed at a speed v slower than the second fast-forward speed v2. In this way, according to the playback speed reception unit 20, the entire playback time is determined according to the setting of the first playback speed (first fast-forward speed), and is selected so as to be within the set total playback time. Scenes related to the event are displayed relatively slowly, and other scenes are displayed relatively fast. Therefore, the details of the scene that the user pays attention to can be grasped within a predetermined time, and the outline of other scenes can be grasped.

The playback slider DP40 is a slider displayed by the slider display control unit 21c, and is displayed so as to move along the scale DP3 with the display of the moving image and move at a constant speed regardless of the change in the playing speed of the moving image. To. The movement of the playback slider DP40, which cannot be grasped without playing the video, is fixed, and the change in the playback speed is represented by the scale DP3, which allows the entire picture to be grasped without playing the video. It is possible to grasp the difference in playback speed between the scene related to the event and other scenes.

The first example of the display screen DP shown in FIG. 4 and the display screen DP shown in other drawings are examples, and the display contents can be arbitrarily changed. For example, in addition to the operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24 that function as the event selection reception unit 22 and the speed ratio reception unit 23, selection of events other than the operation event, stop event, hand event, and person event. And a queue that accepts speed ratios may be displayed. Further, the position of the slider included in each queue may be initially set to an average value calculated based on the usage history of a plurality of users.

FIG. 5 is a flowchart of a moving image display process executed by the display control device 10 according to the embodiment of the present invention. The moving image display process is a process performed after the moving image is acquired from the moving image storage unit 30 by the moving image acquisition unit 25. A video contains a set of event frames, which is a set of frames associated with an event.

First, the event selection receiving unit 22 (slider included in each of the operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24) accepts the selection of one or a plurality of events from the user (S10). Selection of one or more events is performed by setting the slider of the queue for the selected event to a position greater than 0.

The display control device 10 calculates the ratio p of the scene related to the event related to the selection and the other scenes (S11). The display control device 10 may calculate the ratio p of the scene related to the event related to the selection and the other scenes by dividing the number of frames of the first frame group by the number of frames of the entire moving image. As shown in the example shown in FIG. 4, when a hand event is selected, the number of frames included in the hand event frame group MV11 is the number of frames of the entire moving image, and the value is that of the scene related to the event related to the selection and other scenes. The ratio is p.

The playback speed reception unit 20 (first fast-forward speed setting slider DP30) receives the first fast-forward speed v1 (first playback speed) of the moving image (S12). The display control device 10 calculates the total playback time T based on the first fast-forward speed v1 and the length of the moving image (S13). Specifically, when the length of the moving image is expressed by the number of frames F included in the moving image and the first fast-forward speed v1 is expressed in units of frames per second, the playback time T [seconds] is calculated by T = F / v1. To.

Further, the speed ratio receiving unit 23 (slider included in the operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24) has a playback speed v of the first frame group and a playback speed v2 of the second frame group. Accepts one or more speed ratios r. That is, the speed ratio receiving unit 23 receives the playback speed v of the scene related to the event related to the selection and the speed ratio r of the second fast forward speed v2 by setting the position of the slider.

The display control device 10 is based on the ratio p of the scene related to the selection-related event and the other scenes, the overall playback time T, the playback speed v of the scene related to the selection-related event, and the speed ratio r of the second fast-forward speed v2. The playback speed v and the second fast-forward speed v2 of the scene related to the event are calculated (S15). Specifically, when the number of frames of the entire moving image is expressed as F, by solving the simultaneous equations of the first equation of Fp / ve + F (1-p) / v2 = T and the second equation of r = v2 / ve. , The playback speed v and the second fast-forward speed v2 of the scene related to the event may be calculated. Since the solutions are v2 = (Fpr + F (1-p)) / T and ve = (Fpr + F (1-p)) / Tr, the playback speed of the scene related to the event can be reproduced by substituting numerical values into these solutions. You may calculate ve and the second fast-forward speed v2. Further, the display control device 10 may calculate the reproduction speed v and the second fast-forward speed v2 of the scene related to the event so that the reproduction speed and the second fast-forward speed of the scene related to the event change continuously. For example, when the scene related to the event is displayed, the playback speed is gradually decreased according to Gaussian from the second fast-forward speed v2, and when the scene related to the event is displayed, the playback speed is gradually increased according to Gaussian. Good.

The scale display control unit 21b calculates the scale interval according to the calculated playback speed of the moving image (S16). For example, in the case of the example shown in FIG. 4, in the scale display control unit 21b, the relationship between the scale interval L1 of the first example DP10a in the non-event section and the scale interval L2 of the first example DP11a in the hand event section is L2 /. The scale interval may be calculated so that L1 = r (velocity ratio). Then, the scale display control unit 21b displays the scale DP3 at the calculated unequal scale intervals (S17).

The effect display control unit 21d displays an effect that visualizes the change in the playback speed of the moving image along the scale (S18). The effect display control unit 21d may change the display mode of the effect (for example, the intensity of the effect) according to the calculated playback speed of the moving image.

In the moving image display control unit 21a, the playback speed of the first frame group associated with one or a plurality of events related to the selection received by the event selection reception unit 22 among the event frame groups is the second frame other than the first frame group. The moving image is displayed so as to be slower than the playback speed of the group (S19). That is, the moving image display control unit 21a displays the scene related to the event related to the selection among the moving images on the moving image display screen DP1 at the reproduction speed v2, and displays the other scenes on the moving image display screen DP1 at the reproduction speed v2.

The slider display control unit 21c displays a slider (playback slider DP40) that moves along the scale along with the display of the moving image so as to move at a constant speed regardless of the change in the playing speed of the moving image (S20). With the above, the moving image display process is completed. The contents and order of the processes included in the moving image display process are not limited to those shown in FIG. For example, the selection of one or more events by the event selection reception unit 22 (S10) and the reception of one or more speed ratios by the speed ratio reception unit (S14) may be performed at the same time.

According to the display control device 10 according to the present embodiment, since the event is associated with the frame constituting the moving image, the scene of interest of the user can be selected from the moving image. Then, the first frame group associated with one or more events related to the user's selection is displayed later than the second frame group, which is the other frame group, so that the details of the scene that the user pays attention to can be grasped. You can get an overview of other scenes.

FIG. 6 is a diagram showing a second example of the display screen DP displayed by the display control device 10 according to the embodiment of the present invention. The second example of the display screen DP is about the position of the hand speed ratio adjustment slider DP23a, the scale interval of the scale DP3, and the effect DP11e of the hand event, as compared with the first example of the display screen DP shown in FIG. It's different. Regarding other points, the second example of the display screen DP has the same configuration as the first example of the display screen DP shown in FIG. Hereinafter, the difference between the second example of the display screen DP and the first example of the display screen DP shown in FIG. 4 will be described.

In the second example of the display screen DP shown in FIG. 6, the speed ratio is changed as compared with the case of the first example of the display screen DP shown in FIG. The hand speed ratio adjustment slider DP23a of this example is set to the position of "0.59", the hand event is selected by the user, the playback speed v of the scene related to the hand event and the playback speed of other scenes (second). The speed ratio with the fast-forward speed v2) may be r = v2 / ve = 1.59.

When one or more speed ratios received by the speed ratio receiving unit 23 are changed, the scale display control unit 21b displays the scale DP3 so that the scale interval changes according to the change of one or more speed ratios. Let me. Specifically, the scale DP3 of this example is the second example DP10b of the non-event section, the second example DP11b of the hand event section, the second example DP10b of the non-event section, and the second example of the hand event section in the order of playback of the moving images. Examples include DP11b. The second example DP11b of the hand event section is shown in FIG. Compared with the first example DP11a of the hand event section shown in 4, the scale interval is changed to be wider. On the other hand, the second example DP10b in the non-event section is changed so that the scale interval is narrower than that in the first example DP10a in the non-event section shown in FIG. In this way, by changing the scale interval according to the change in the speed ratio, the difference in the playback speed between the scene related to the selected event and the other scenes can be changed according to the change in the speed ratio without playing the video. You can intuitively understand how it changes.

The effect display control unit 21d changes the intensity of the effect according to the absolute value of the playback speed ve of the scene related to the selected event. In the case of this example, the first fast-forward speed v1 is the same as that of the first example of the display screen DP shown in FIG. 4, but the playback speed v of the scene related to the hand event and the playback speed of other scenes (second fast-forward speed v2). Since the speed ratio r with and is increasing, the absolute value of the playback speed ve of the scene related to the selected event is increasing. The effect display control unit 21d sets the effect DP11e of the hand event of this example to the maximum density of the effect DP11e of the hand event shown in FIG. 4 according to the change in the absolute value of the playback speed ve of the scene related to the selected event. Is displayed so that it becomes darker. This allows the user to grasp the difference in absolute playback speed between the scene related to the selected event and other scenes without playing the video.

FIG. 7 is a flowchart of the speed ratio changing process executed by the display control device 10 according to the embodiment of the present invention. The speed ratio receiving unit 23 (slider included in the operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24, respectively) accepts one or a plurality of changes in the speed ratio r (S30). The scale display control unit 21b displays the scale DP3 so that the scale interval changes according to the change of one or a plurality of speed ratios r (S31). Further, the effect display control unit 21d displays the effect along the scale DP3 so that the display mode of the effect changes according to the change of one or a plurality of speed ratios r (S32).

The display control device 10 has a playback speed v (reproduction speed of the first frame group) of the scene related to the selected event and a reproduction speed v2 (reproduction of the second frame group) of other scenes according to the change of the speed ratio r. The second fast-forward speed v2), which is the speed, is corrected (S33). With the above, the speed ratio change process is completed.

FIG. 8 is a flowchart of the first fast-forward speed changing process executed by the display control device 10 according to the embodiment of the present invention. The reproduction speed reception unit 20 accepts a change in the first fast-forward speed v1 (S40). For example, in the first example of the display screen DP shown in FIG. 4 and the second example of the display screen DP shown in FIG. 6, the first fast-forward speed v1 was 10 times the normal playback speed, but the playback speed reception unit. 20 changes the first fast-forward speed v1 to a speed other than 10 times the normal playback speed.

When the first playback speed (first fast-forward speed v1) received by the playback speed reception unit 20 is changed, the scale display control unit 21b prevents the scale interval from changing regardless of the change in the first playback speed. The scale DP3 is displayed (S41). When the first fast-forward speed v1 is changed, the playback speed v of the scene related to the selected event and the second fast-forward speed v2 of the other scenes are changed. However, if the speed ratio r between the playback speed ve of the scene related to the selected event and the second fast-forward speed v2 of the other scene is not changed, the playback speed ve of the scene related to the selected event and the second fast-forward speed v2 of the other scene are not changed. 2 Since the relative speed difference from the fast-forward speed v2 does not change, the scale display control unit 21b maintains the scale interval. In this way, by not changing the scale interval when the first playback speed is changed, the playback speed of the selected scene and the playback of other scenes are played even if the playback time of the entire video is changed. It is possible to intuitively grasp that the speed ratio of speed is constant.

The display control device 10 corrects the playback time T of the entire moving image based on the changed first fast-forward speed v1 and the number of frames included in the moving image (S42). Then, the display control device 10 corrects the playback speed v of the scene related to the selected event and the second fast-forward speed v2 of the other scenes (S43). With the above, the first fast-forward speed change process is completed.

FIG. 9 is a diagram showing a third example of a display screen DP displayed by the display control device 10 according to the embodiment of the present invention. The third example of the display screen DP is the position of the hand speed ratio adjustment slider DP23a and the person speed ratio adjustment slider DP24a, the scale interval of the scale DP3, and the hand, as compared with the second example of the display screen DP shown in FIG. The difference is between the event effect DP11e and the person event effect DP12e. Regarding other points, the third example of the display screen DP has the same configuration as the second example of the display screen DP shown in FIG. Hereinafter, the difference between the third example of the display screen DP and the second example of the display screen DP shown in FIG. 6 will be described.

In the third example of the display screen DP shown in FIG. 9, the selection of the person event is added as compared with the case of the second example of the display screen DP shown in FIG. The person speed ratio adjustment slider DP24a of this example is set to the position of "1.00", and the person event is selected by the user. Further, the hand speed ratio adjustment slider DP23a is set to the position of "0.59", and the hand event is selected by the user. Further, the positions of the hand speed ratio adjustment slider DP23a and the person speed ratio adjustment slider DP24a are the playback speed v1 of the scene related to the hand event, the playback speed v2 of the scene related to the person event, and the playback speed of other scenes (second fast forward speed v2). ) And the speed ratio are set.

When event selection is added and one or more speed ratios received by the speed ratio reception unit 23 are changed, the scale display control unit 21b changes the scale interval according to the change of one or more speed ratios. The scale DP3 is displayed so as to be performed. Specifically, the scale DP3 of this example is the third example DP10c of the non-event section, the third example DP11c of the hand event section, the third example DP10c of the non-event section, the person event section DP12, and the non-event section in the order of video playback. The third example DP10c of the event section and the second example DP11b of the hand event section are included. Each of these sections corresponds to a frame group included in the moving image MV shown in FIG. The person event section DP12 has been added in response to the addition of the person event selection. In addition, according to the change in the speed ratio between the playback speed v1 of the scene related to the hand event and the playback speed v2 of the scene related to the person event and the playback speed (second fast forward speed v2) of the other scenes, the hand event section The third example DP11c is changed so that the scale interval is narrower than that of the second example DP11b in the hand event section shown in FIG. Further, the third example DP10c of the non-event section has a scale interval larger than that of the first example DP10a of the non-event section shown in FIG. 4 and the second example DP10b of the non-event section shown in FIG. It is changing to become narrower. In this way, by adding an event selection and changing the scale interval according to the change in speed ratio due to the addition, the difference in playback speed between the scene related to the selected event and other scenes without playing the video However, it is possible to intuitively grasp how the event changes according to the addition of the event and the change of the speed ratio due to the addition.

The effect display control unit 21d changes the intensity of the effect according to the absolute values of the playback speed ve1 of the scene related to the hand event and the playback speed ve2 of the scene related to the person event. In the case of this example, the first fast-forward speed v1 is the same as that of the second example of the display screen DP shown in FIG. 6, but the playback speed v1 of the scene related to the hand event, the playback speed v2 of the scene related to the person event, and other scenes. Since the speed ratio with the playback speed (second fast-forward speed v2) has changed, the absolute value of the playback speed v1 of the scene related to the hand event has changed as compared with the case of the second example of the display screen DP shown in FIG. doing. The effect display control unit 21d displays the effect DP12e of the person event and the effect DP11e of the hand event according to the absolute values of the reproduction speed v1 of the scene related to the hand event and the reproduction speed v2 of the scene related to the person event. This allows the user to grasp the difference in absolute playback speed between the scene related to the selected event and other scenes without playing the video.

FIG. 10 is a flowchart of the selection event addition process executed by the display control device 10 according to the embodiment of the present invention. The event selection reception unit 22 (slider included in each of the operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24) accepts the selection of a new event (S50). Further, the speed ratio receiving unit 23 (slider included in each of the operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24) is one of the playback speed v and the second fast forward speed v2 of the scene related to the event related to the selection. Accepts a plurality of speed ratios r (S51). The scale display control unit 21b displays the scale DP3 so that the scale interval changes according to the change of one or a plurality of speed ratios r (S52). The effect display control unit 21d displays the effect along the scale DP3 so that the display mode of the effect changes according to the change of one or a plurality of speed ratios r (S53).

The display control device 10 has a playback speed v of the scene related to the selected event (playback speed of the first frame group) and a playback speed v2 of other scenes (second) according to the change of one or a plurality of speed ratios r. The second fast-forward speed v2), which is the playback speed of the frame group, is corrected (S54). With the above, the selection event addition process is completed.

In the above description, the hand event and the person event are separated from each other, but in general, a plurality of events may be associated with one frame or a group of frames. In that case, the display control device 10 may control so that the reproduction speed of the frame or the frame group becomes relatively slow as the association of the plurality of events related to the selection overlaps. When the frame and the event are associated with each other by associating the degree of matching between the frame and the event, the degree of matching for a plurality of events may be associated with one frame or a group of frames.

Further, in the above description, the case where the event selection reception unit 22 accepts the selection of the target or action that the user pays attention to from the user has been described, but the event selection reception unit 22 selects the target or action that the user does not pay attention to. You may accept from. When the event selection reception unit 22 accepts the selection of an object or action that the user does not pay attention to, the video display control unit 21a associates one or a plurality of events related to the selection received by the event selection reception unit 22 in the event frame group. The moving image may be displayed so that the reproduction speed of the first frame group is faster than the reproduction speed of the second frame group other than the first frame group. The first frame group associated with one or more events related to the user's selection is displayed faster than the second frame group, which is the other frame group, by accepting the selection of the target or action that the user does not pay attention to. This also allows the user to grasp the details of the scene of interest and to grasp the outline of other scenes.

The embodiments described above are for facilitating the understanding of the present invention, and are not for limiting and interpreting the present invention. Each element included in the embodiment and its arrangement, material, condition, shape, size, and the like are not limited to those exemplified, and can be changed as appropriate. In addition, the configurations shown in different embodiments can be partially replaced or combined.

10 ... Display control device, 11 ... CPU, 12 ... RAM, 13 ... ROM, 14 ... Communication interface, 15 ... Input unit, 16 ... Display unit, 20 ... Playback speed reception unit, 21 ... Display control unit, 21a ... Movie display Control unit, 21b ... Scale display control unit, 21c ... Slider display control unit, 21d ... Effect display control unit, 22 ... Event selection reception unit, 23 ... Speed ratio reception unit, 25 ... Video acquisition unit, 30 ... Video storage unit, DP ... display screen, DP1 ... video display screen, DP2 ... video selection screen, DP10a ... first example of non-event section, DP10b ... second example of non-event section, DP10c ... third example of non-event section, DP11a ... hand 1st example of event section, DP11b ... 2nd example of hand event section, DP11c ... 3rd example of hand event section, DP11e ... hand event effect, DP12 ... person event section, DP12e ... person event effect, DP21 ... operation Cue, DP22 ... Stop cue, DP23 ... Hand cue, DP23a ... Hand speed ratio adjustment slider, DP24 ... Person cue, DP24a ... Person speed ratio adjustment slider, DP30 ... 1st fast forward speed setting slider, DP40 ... Playback slider, MV ... Movie , MV10 ... non-event frame group, MV11 ... hand event frame group, MV12 ... person event frame group, TG1 ... hand tag, TG2 ... person tag.

Claims (10)

A video acquisition unit that acquires a video including an event frame group that is a set of frames associated with an event,
An event selection reception unit that accepts the selection of one or more events from the user,
The playback speed of the first frame group associated with one or more events related to the selection received by the event selection reception unit among the event frame groups is higher than the playback speed of the second frame group other than the first frame group. A video display control unit that displays the video so that it is slower
A scale display control unit that displays a scale indicating the passage of time of the moving image so that the scale intervals are unequal according to the playback speed of the moving image.
Equipped with a,
The moving image display control unit displays the moving image so that the playback speed changes continuously in the vicinity of the boundary between the first frame group and the second frame group.
The scale display control unit displays the scale so that the scale interval continuously changes near the boundary between the scale corresponding to the first frame group and the scale corresponding to the second frame group.
Display control device. A playback speed reception unit that receives the first playback speed of the moving image is further provided.
The moving image display control unit sets the second frame group from the first playback speed so that the moving image is displayed with the total playback time calculated based on the length of the moving image and the first playback speed. Is displayed at a faster second playback speed, and the first frame group is displayed at a playback speed slower than the second playback speed.
The display control device according to claim 1. A speed ratio receiving unit that accepts one or more speed ratios of the reproduction speed of the first frame group and the reproduction speed of the second frame group is further provided.
The display control device according to claim 2. Scale display control unit, the ratio of the scene relating to the event in the whole moving picture, based on the length and the one or more speed ratios of the video, Ru to display the scale,
The display control device according to claim 3. A slider display control unit for displaying a slider that moves along the scale with the display of the moving image so as to move at a constant speed regardless of a change in the playback speed of the moving image is further provided.
The display control device according to claim 4. An effect display control unit for displaying an effect that visualizes a change in the playback speed of the moving image along the scale is further provided.
The display control device according to claim 4 or 5. When the one or more speed ratios received by the speed ratio receiving unit are changed, the scale display control unit changes the scale interval according to the change of the one or more speed ratios. Display the scale,
The display control device according to any one of claims 4 to 6. When the first reproduction speed received by the reproduction speed reception unit is changed, the scale display control unit displays the scale so that the scale interval does not change regardless of the change in the first reproduction speed. Let,
The display control device according to any one of claims 2 to 7. The first step of getting a video containing an event frame group, which is a set of frames associated with an event,
The second step of accepting the selection of one or more events from the user,
The playback speed of the first frame group associated with one or more events related to the selection received in the second step of the event frame group is higher than the playback speed of the second frame group other than the first frame group. The third step of displaying the video so as to be slow, and
The fourth step of displaying the scale indicating the passage of time of the moving image so that the scale intervals are unequal according to the playback speed of the moving image.
Only including,
In the third step, the moving image is displayed so that the playback speed changes continuously in the vicinity of the boundary between the first frame group and the second frame group.
In the fourth step, the scale is displayed so that the scale interval continuously changes near the boundary between the scale corresponding to the first frame group and the scale corresponding to the second frame group.
Display control method. Computer,
A video acquisition unit that acquires a video including an event frame group that is a set of frames associated with an event,
An event selection reception unit that accepts the selection of one or more events from the user,
The playback speed of the first frame group associated with one or more events related to the selection received by the event selection reception unit among the event frame groups is higher than the playback speed of the second frame group other than the first frame group. A video display control unit that displays the video so that it is slower
A scale display control unit that displays a scale indicating the passage of time of the moving image so that the scale intervals are unequal according to the playback speed of the moving image.
To function as,
The moving image display control unit displays the moving image so that the playback speed changes continuously in the vicinity of the boundary between the first frame group and the second frame group.
The scale display control unit displays the scale so that the scale interval continuously changes near the boundary between the scale corresponding to the first frame group and the scale corresponding to the second frame group.
Display control program.