JPWO2018110298A1 - Display control apparatus, display control method, and display control program - Google Patents

Abstract

Provided are a display control device, a display control method, and a display control program, which can grasp details of a scene that a user is interested in and can grasp an outline of other scenes. The display control apparatus 10 includes a moving image acquisition unit 25 that acquires a moving image including an event frame group that is a set of frames associated with an event, an event selection reception unit 22 that receives selection of one or a plurality of events, and an event The playback speed of the first frame group associated with one or more events related to the selection received by the event selection receiving unit 22 in the frame group is different from the playback speed of the second frame group other than the first frame group. A moving image display control unit 21a for displaying moving images.

Description

Cross-reference of related applications

  This application is based on Japanese Patent Application No. 2014-241446 filed on Dec. 13, 2016, the contents of which are incorporated herein by reference.

  The present invention relates to a display control device, a display control method, and a display control program.

  In recent years, cameras have become smaller and lighter, and cameras are installed in various places to shoot moving images. For example, wearable cameras that can be worn on the body and can continuously shoot first-person perspective images are becoming popular. A long moving image that has been shot may be confirmed by fast-forwarding.

Regarding high-speed playback processing of moving images, Patent Document 1 describes a calculation system that calculates a smoothed camera path based on an input moving image and outputs a moving image with reduced shaking.
Non-Patent Document 1 describes a moving image player that reproduces a scene related to a specific event relatively slowly and reproduces other scenes relatively quickly.

US Patent No. 2015/0248916

Kai-Yin Cheng and three others, “SmartPlayer: User-Centric Video Fast-Forwarding”, April 4, 2009, CHI2009, Internet (URL: http://vc.cs.nthu.edu.tw/home/ paper / codfiles / klhsueh / 201103100947 / SmartPlayer, User-Centric Video Fast-Forwarding.pdf)

  According to the technique described in Patent Document 1, even when a moving image includes a shake, such as a moving image shot by a wearable camera, it is possible to suppress the amplification of the shake caused by fast-forwarding and generate a fast-forward moving image with relatively little shaking. it can. Further, according to the technique described in Non-Patent Document 1, it is possible to confirm the details of a scene related to a specific event and grasp the outline of other scenes.

  However, since the specific event in Non-Patent Document 1 is predetermined, when trying to grasp details about a scene other than the specific scene, a moving image that is played relatively quickly is observed. In some cases, it was difficult to grasp the contents.

  Therefore, the present invention provides a display control device, a display control method, and a display control program that can grasp details of a scene that a user is interested in and can grasp an outline of other scenes.

  A display control device according to an aspect of the present invention includes a moving image acquisition unit that acquires a moving image including an event frame group that is a set of frames associated with an event, and an event selection reception that receives selection of one or more events from a user And the playback speed of the first frame group associated with one or a plurality of events related to the selection received by the event selection receiving unit among the event frame groups is the playback speed of the second frame group other than the first frame group A moving image display control unit that displays moving images differently.

  According to this aspect, since the event is associated with the frame constituting the moving image, it is possible to select the scene that the user pays attention from the moving image. The first frame group associated with one or more events related to the user's selection is displayed at a different speed from the second frame group, which is another frame group, so that the details of the scene that the user is interested in can be displayed. You can grasp the outline of other scenes.

  In the above aspect, the video display control unit further includes a playback speed receiving unit that receives the first playback speed of the video, and the video display control unit displays the video in the entire playback time calculated based on the length of the video and the first playback speed. As described above, the second frame group may be displayed at a second playback speed that is faster than the first playback speed, and the first frame group may be displayed at a playback speed that is slower than the second playback speed.

  According to this aspect, the entire playback time is determined according to the setting of the first playback speed, and the scene related to the selected event is displayed relatively slowly so as to be within the set total playback time, Other scenes are displayed relatively quickly. Therefore, it is possible to grasp the details of the scene that the user pays attention to within a predetermined time and grasp the outline of other scenes.

  In the above aspect, a speed ratio receiving unit that receives one or a plurality of speed ratios between the playback speed of the first frame group and the playback speed of the second frame group may be further provided.

  According to this aspect, the speed ratio between the playback speed of the scene related to the selected event and the playback speed of other scenes is set, and the playback speed of the scene related to the event can be adjusted according to the degree of attention.

  In the above aspect, based on the ratio of scenes related to the event to the entire moving image, the length of the moving image, and one or more speed ratios, the time of the moving image is such that the scale intervals are unequal according to the playback speed of the moving image. You may further provide the scale display control part which displays the scale which shows progress.

  According to this aspect, it is possible to intuitively grasp the difference in playback speed between the scene related to the selected event and the other scenes without playing back the moving image.

  In the above aspect, a slider display control unit may be further provided that displays a slider that moves along the scale as the moving image is displayed so as to move at a constant speed regardless of a change in the moving image reproduction speed.

  According to this aspect, the moving speed of the slider, which cannot grasp the movement unless the moving image is reproduced, is fixed, and the change in the reproducing speed is expressed by a scale that can grasp the whole image without reproducing the moving image, so that the moving image is not reproduced. In both cases, the difference in playback speed between the scene related to the selected event and other scenes can be grasped.

  The said aspect WHEREIN: You may further provide the effect display control part which displays the effect which visualized the change of the reproduction speed of a moving image along a scale.

  According to this aspect, it is possible to grasp the relative difference between the playback speeds of the scene related to the selected event and other scenes and the absolute playback speed difference without playing back the moving image.

  In the above aspect, when one or more speed ratios received by the speed ratio receiving unit are changed, the scale display control unit sets the scales so that the scale interval changes according to the change of the one or more speed ratios. It may be displayed.

  According to this aspect, it is possible to intuitively understand how the difference between the playback speeds of the scene related to the selected event and other scenes changes according to the change of the speed ratio without playing the moving image. it can.

  In the above aspect, when the first playback speed received by the playback speed receiving unit is changed, the scale display control unit displays the scale so that the scale interval does not change regardless of the change in the first playback speed. Also good.

  According to this aspect, even when the entire playback time is changed, it is possible to intuitively understand that the speed ratio between the playback speed of the selected scene and the playback speed of other scenes is constant. it can.

  The display control method according to an aspect of the present invention includes a first step of acquiring a moving image including an event frame group that is a set of frames associated with an event, and a second step of receiving selection of one or a plurality of events from a user. And the playback speed of the first frame group associated with one or more events related to the selection received in the second step from the event frame group is different from the playback speed of the second frame group other than the first frame group. And a third step of displaying a moving image.

  According to this aspect, since the event is associated with the frame constituting the moving image, it is possible to select the scene that the user pays attention from the moving image. The first frame group associated with one or more events related to the user's selection is displayed at a different speed from the second frame group, which is another frame group, so that the details of the scene that the user is interested in can be displayed. You can grasp the outline of other scenes.

  A display control program according to one aspect of the present invention receives a selection of one or a plurality of events from a user, and a moving image acquisition unit that acquires a moving image including an event frame group that is a set of frames associated with an event. The playback speed of the first frame group associated with one or a plurality of events related to the selection received by the event selection receiving unit and the event selection receiving unit among the event frame groups is the second frame group other than the first frame group. It is made to function as a moving image display control unit that displays moving images different from the reproduction speed.

  According to this aspect, since the event is associated with the frame constituting the moving image, it is possible to select the scene that the user pays attention from the moving image. The first frame group associated with one or more events related to the user's selection is displayed at a different speed from the second frame group, which is another frame group, so that the details of the scene that the user is interested in can be displayed. You can grasp the outline of other scenes.

It is a figure which shows the physical structure of the display control apparatus which concerns on embodiment of this invention. It is a functional block diagram of the display control apparatus which concerns on embodiment of this invention. It is a figure which shows the structure of the moving image acquired by the display control apparatus which concerns on embodiment of this invention. It is a figure which shows the 1st example of the display screen displayed by the display control apparatus which concerns on embodiment of this invention. It is a flowchart of the moving image display process performed by the display control apparatus which concerns on embodiment of this invention. It is a figure which shows the 2nd example of the display screen displayed by the display control apparatus which concerns on embodiment of this invention. It is a flowchart of the speed ratio change process performed by the display control apparatus which concerns on embodiment of this invention. It is a flowchart of the 1st fast-forward speed change process performed by the display control apparatus which concerns on embodiment of this invention. It is a figure which shows the 3rd example of the display screen displayed by the display control apparatus which concerns on embodiment of this invention. It is a flowchart of the selection event addition process performed by the display control apparatus which concerns on embodiment of this invention.

  Embodiments of the present invention will be described with reference to the accompanying drawings. In addition, in each figure, what attached | subjected the same code | symbol has the same or similar structure.

  FIG. 1 is a diagram showing a physical configuration of a display control apparatus 10 according to an embodiment of the present invention. The display control device 10 includes a central processing unit (CPU) 11, a random access memory (RAM) 12, a read only memory (ROM) 13, a communication interface 14, an input unit 15, and a display unit 16. These components are connected to each other via a bus so that data can be transmitted and received.

  The CPU 11 is a control unit that performs control related to the display of moving images stored in the RAM 12 or the ROM 13, and calculates and processes data. The CPU 11 is an arithmetic device that executes an application program for displaying a moving image. The CPU 11 receives various input data from the input unit 15 and the communication interface 14 and displays the calculation result of the input data on the display unit 16 or stores it in the RAM 12 or the ROM 13.

  The RAM 12 is a storage unit capable of rewriting data, and is configured by, for example, a semiconductor storage element. The RAM 12 stores programs such as application software executed by the CPU 11 and data.

  The ROM 13 is a storage unit that can only read data, and is composed of, for example, a semiconductor storage element. The ROM 13 stores programs such as firmware and data, for example.

  The communication interface 14 is an interface for connecting the display control apparatus 10 to a communication network. For example, a communication network such as a LAN (Local Area Network) or a WAN (Wide Area Network) configured by a data transmission path of a wired or wireless line. Connected to.

  The input unit 15 receives data input from the user, and includes, for example, a keyboard, a mouse, and a touch panel.

  The display unit 16 visually displays the calculation result by the CPU 11, and is configured by, for example, an LCD (Liquid Crystal Display) and displays a moving image.

  The display control device 10 may be configured by executing the moving image display control program according to the present embodiment by the CPU 11 of a general personal computer or smartphone. The moving image display control program may be provided by being stored in a computer-readable storage medium such as the RAM 12 or the ROM 13 or may be provided via a communication network connected by the communication interface 14.

  FIG. 2 is a functional block diagram of the display control apparatus 10 according to the embodiment of the present invention. In addition to the input unit 15 and the display unit 16, the display control device 10 includes a playback speed reception unit 20, a display control unit 21, an event selection reception unit 22, a speed ratio reception unit 23, and a moving image acquisition unit 25.

  The event selection receiving unit 22 receives selection of one or more events from the user. The event selection receiving unit 22 receives selection of one or a plurality of events input by the user through the input unit 15. Here, an event refers to an event related to a specific object or action. The event selection receiving unit 22 receives from the user a selection of an object or action that the user pays attention to. In the present embodiment, a case will be described in which the event selection receiving unit 22 receives selection of one or more events from an operation event, a stop event, a hand event, and a person event. The operation event is an event of movement of a camera that shoots a moving image, and the stop event is an event of stop of a camera that shoots a moving image. The hand event is an event related to the hand (arm, finger) of the videographer, and the person event is an event that the videographer and the person are confronting each other.

  The moving image acquisition unit 25 acquires a moving image including an event frame group that is a set of frames associated with the event. In the present embodiment, the moving image is stored in the moving image storage unit 30 placed outside the display control apparatus 10, and the moving image acquisition unit 25 acquires the moving image from the moving image storage unit 30. However, the moving image storage unit 30 may be provided in the display control device 10. The moving image acquisition unit 25 may acquire a moving image via the communication network by the communication interface 14. In addition, the moving image acquisition unit 25 acquires a moving image having no association with the event from the moving image storage unit 30, analyzes a frame included in the moving image, performs association with the event, and includes an event frame group It may be converted into a video.

  The display control unit 21 causes the display unit 16 to display a moving image and a UI (User Interface) related to the moving image. The display control unit 21 includes a moving image display control unit 21a, a scale display control unit 21b, a slider display control unit 21c, and an effect display control unit 21d. The moving image display control unit 21a determines that the playback speed of the first frame group associated with one or a plurality of events related to the selection received by the event selection receiving unit 22 among the event frame groups is a second frame other than the first frame group. The moving image is displayed so as to be slower than the playback speed of the group.

  The scale display control unit 21b displays a scale indicating the passage of time of the moving image. The scale display control unit 21b includes one or more of the ratio of the scene relating to the event to the entire moving image, the length of the moving image, and the playback speed of the first frame group and the playback speed of the second frame group received by the speed ratio receiving unit 23. Based on the speed ratio, the scales are displayed so that the scale intervals are unequal according to the moving image playback speed.

  The slider display control unit 21c displays a slider that moves along the scale as the moving image is displayed so as to move at a constant speed regardless of a change in the moving image reproduction speed. The effect display control unit 21d displays an effect that visualizes a change in the playback speed of the moving image along the scale.

  The playback speed receiving unit 20 receives the first playback speed of the moving image. In the present specification, a case will be described in which the first playback speed is the first fast-forward speed v1 that is faster than the normal playback speed of moving images (for example, the playback speed for displaying 30 frames per second). However, the first playback speed may be a playback speed that is equal to or lower than the normal playback speed of moving images. The video display control unit 21a performs the second playback in which the second frame group is faster than the first playback speed so that the video is displayed in the entire playback time calculated based on the length of the video and the first playback speed. The first frame group is displayed at a playback speed slower than the second playback speed. In this specification, a case where the second reproduction speed is the second fast-forward speed v2 that is faster than the first fast-forward speed v1 will be described. Also, in this specification, a case will be described in which the playback speed of the first frame group is a speed slower than the second fast-forward speed v2 and is the scene playback speed ve related to the event related to the selection.

  FIG. 3 is a diagram showing a configuration of the moving image MV acquired by the display control apparatus 10 according to the embodiment of the present invention. The moving image MV is composed of a plurality of frames FR (still images), and includes a frame group that is a set of a plurality of frames FR. In the figure, a state is shown in which a moving image MV is formed by arranging frames FR in order of reproduction from left to right. The frame group is roughly divided into an event frame group that is a set of frames associated with an event and a non-event frame group MV10 (a set of frames that are not associated with an event). In the case of the moving image MV of this example, the event frame group includes a hand event frame group MV11 and a person event frame group MV12. In this example, two types of frame groups, ie, a hand event frame group MV11 and a person event frame group MV12 are illustrated as event frame groups. However, a moving image MV may include three or more types of frame groups. The non-event frame group may not be included. For example, for an operation event that represents an event of movement of a camera that shoots a movie and a stop event that represents an event of camera stop, the frames constituting the movie are divided into an operation event frame group and a stop event frame group. It will be.

  The moving image MV of this example includes a non-event frame group MV10, a hand event frame group MV11, a non-event frame group MV10, a person event frame group MV12, a non-event frame group MV10, and a hand event frame group MV11 in the reproduction order of moving images. It is configured. A hand tag TG1 is assigned to the plurality of frames FR included in the hand event frame group MV11, and a person tag TG2 is assigned to the person event frame group MV12. The moving image MV is stored in the moving image storage unit 30 with an event tag such as a hand tag TG1 or a person tag TG2 assigned to each frame FR and the event associated with the frame FR. The assignment of the event tag does not necessarily have to be performed for each frame, and may be performed by designating the frame number to which the event tag is assigned or for each frame group. Further, the association between the frames constituting the moving image and the event may be performed by a method other than tagging. For example, the correspondence table between the frame and the event may be stored in association with the moving image.

  The moving image MV may be analyzed in advance for each frame and stored in the moving image storage unit 30 in a state associated with the event. However, the moving image MV is not only in a state associated with the event when stored in the moving image storage unit 30, but after being acquired by the moving image acquisition unit 25, the display control device 10 analyzes the frame. The event may be associated with the event and converted into a state associated with the event. The display control device 10 may analyze the original data of the moving image and convert it to a state associated with the event. Further, the association between the frame and the event may be performed by associating the matching degree between the frame and the event with the frame. The degree of match may be calculated for a plurality of events for one frame or a group of frames.

  FIG. 4 is a diagram showing a first example of the display screen DP displayed by the display control apparatus 10 according to the embodiment of the present invention. The display screen DP includes a moving image display screen DP1, a moving image selection screen DP2, a scale DP3, an operation queue DP21, a stop queue DP22, a hand queue DP23, a person queue DP24, a first fast-forward speed setting slider DP30, and a reproduction slider DP40. In this specification, the case where the moving image MV shown in FIG. 3 is acquired and displayed by the moving image acquisition unit 25 will be described. That is, in the following, the moving image MV including the non-event frame group MV10, the hand event frame group MV11, the non-event frame group MV10, the person event frame group MV12, the non-event frame group MV10, and the hand event frame group MV11 is displayed in the playback order. The case will be described.

  The moving image display screen DP1 is a display area for displaying a moving image. A moving image is displayed on the moving image display screen DP1 by the moving image display control unit 21a. The moving image selection screen DP2 is a display area for selecting a moving image other than the moving image being displayed on the moving image display screen DP1. In this example, four moving image thumbnails are displayed on the moving image selection screen DP2. However, three or less or five or more moving image thumbnails may be displayed on the moving image selection screen DP2, and text information is displayed. May be.

  The scale DP3 is displayed by the scale display control unit 21b and indicates the passage of time of the moving image. In the example shown in FIG. 4, the scale DP3 includes the first example DP10a in the non-event section, the first example DP11a in the hand event section, the first example DP10a in the non-event section, and the first in the hand event section in the playback order of the moving images. Example DP11a is included. Each of these sections corresponds to a frame group included in the moving image.

  The scale display control unit 21b displays the scale DP3 so that the scale intervals are unequal according to the playback speed of the moving image. In the case of this example, since the moving image display control unit 21a displays the scene related to the hand event later than the other scenes, the scale display control unit 21b sets the scale interval of the first example DP11a in the hand event interval as the non-event interval. The first example DP10a is displayed wider than the scale interval. Thus, by displaying the scale intervals at unequal intervals, it is possible to intuitively grasp the difference between the playback speeds of the scene related to the selected event and the other scenes without reproducing the moving image.

  On the scale DP3, along with the scale DP3, the effect display control unit 21d displays a hand event effect DP11e that visualizes a change in the playback speed of the moving image. In FIG. 4, the hand event effect DP <b> 11 e is displayed so that it is darker at a portion where the playback speed is slower and lighter at a portion where the playback speed is faster. The darkness (thinness) of the effect may be changed according to the absolute value of the playback speed. By displaying the effect by the effect display control unit 21d, the relative difference between the playback speed of the scene related to the selected event and the other scenes and the absolute playback speed difference can be grasped without playing the video. can do.

  The operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24 function as an event selection reception unit 22 that receives selection of an operation event, a stop event, a hand event, and a person event from the user, respectively. The operation queue DP21 is for selecting a frame for which it is determined that the camera for capturing a moving image is moving, and the stop queue DP22 is for selecting a frame for which it is determined that the camera for capturing a moving image is stopped. is there. The hand cue DP 23 selects a frame that is determined to show the hand (arm, finger) of the movie photographer. The person queue DP 24 is the whole body and upper body of the person facing the movie photographer. The frame that is determined to reflect the lower body or face is selected. In this example, the frame selected by the hand queue DP23 does not overlap with the frame selected by the person queue DP24. In the case of the moving image MV shown in FIG. 3, the hand queue DP23 selects the hand event frame group MV11, and the person queue DP24 selects the person event frame group MV12. The event selection receiving unit 22 may select a frame group corresponding to the event related to the user's selection based on the matching degree between the frame and the event associated with the frame of the moving image.

  The operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24 each include a slider. Each slider functions as a speed ratio receiving unit 23, and by moving each slider from 0 to 1, the playback speed of the first frame group constituting the scene relating to the selected event and other scenes are configured. The speed ratio with the playback speed of the second frame group can be adjusted. When the slider is at the position 0, the event is an event that is not included in the selection received by the event selection receiving unit 22, and the scene related to the event is displayed at the same playback speed (second fast-forward speed v2) as the non-event scene. Is done. When the slider is at a position greater than 0, the event is an event related to the selection received by the event selection receiving unit 22, and the scene related to the event has a lower playback speed than the non-event scene (the scene related to the event related to the selection). Displayed at the playback speed ve). The larger the numerical value indicated by the slider, the larger the speed ratio r obtained by dividing the second fast-forward speed v2 by the reproduction speed ve. For example, when the position of the slider is x (0 ≦ x ≦ 1), the speed ratio r = v2 / ve between the second fast-forward speed v2 and the scene reproduction speed ve related to the event may be r = 1 + x. . In general, the speed ratio may be determined by r = 1 + f (x) using a monotonically increasing function f (x) that satisfies f (0) = 0. In this example, the hand speed ratio adjustment slider DP23a is set to a position of “0.25”, the hand event is selected by the user, the scene playback speed ve related to the hand event and the playback speeds of other scenes ( The speed ratio with the second fast-forward speed v2) may be, for example, r = v2 / ve = 1.25. The speed ratio receiving unit 23 refers to an event tag (or a correspondence table between frames and events) attached to the frame of the moving image, and determines an event related to the user's selection based on the matching degree between the frame and the event and the position of the slider. A speed ratio between the playback speed of the frame group corresponding to and the playback speed of other scenes may be calculated.

  According to the speed ratio receiving unit 23 (the sliders included in the operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24, respectively), the speed ratio between the playback speed of the scene related to the selected event and the playback speed of other scenes. Is set, and the playback speed of the scene related to the event can be adjusted according to the degree of attention. The case where the plurality of sliders are set to positions other than 0 will be described in detail later.

  The first fast-forwarding speed setting slider DP30 functions as a playback speed receiving unit 20 that receives the first playback speed of moving images. In the case of this example, the first fast-forward speed setting slider DP30 is set at the position “× 10.0”, and the first fast-forward speed v1 is 10 times the normal reproduction speed. . If the normal playback speed is a speed at which 30 frames are displayed per second, the first fast-forward speed v1 that is 10 times higher than that is displayed 30 frames per 0.1 second (or selected from the 30 frames). Speed to display several frames). In this case, the moving image display control unit 21a extracts three frames from the 30 frames displayed in the case of normal reproduction and displays the three frames per second, thereby displaying the moving image at the first fast-forward speed v1. May be performed.

  The moving image display control unit 21a makes the second frame group faster than the first reproduction speed v1 so that the moving image is displayed in the entire reproduction time T calculated based on the length of the moving image and the first reproduction speed v1. The second playback speed v2 is displayed, and the first frame group is displayed at a playback speed ve that is slower than the second playback speed v2.

  If the length of the moving image is 10 minutes and the first fast-forward speed v1 is set as 10 times the normal playback speed by the first fast-forward speed setting slider DP30, the total playback time T is 1 Minutes. In this case, the moving image display control unit 21a displays the second frame group (the frame group corresponding to the first example DP10a in the non-event section) at the second fast-forward speed v2 so that the moving image is reproduced in one minute as a whole. Then, the first frame group (the frame group corresponding to the first example DP11a in the hand event section) is displayed at a speed ve that is slower than the second fast-forward speed v2. As described above, according to the playback speed receiving unit 20, the overall playback time is determined according to the setting of the first playback speed (first fast-forward speed), and is selected so as to be within the set overall playback time. The scene related to the selected event is displayed relatively slowly, and the other scenes are displayed relatively quickly. Therefore, it is possible to grasp the details of the scene that the user pays attention to within a predetermined time and grasp the outline of other scenes.

  The playback slider DP40 is a slider displayed by the slider display control unit 21c, and moves along the scale DP3 as the moving image is displayed, and is displayed so as to move at a constant speed regardless of a change in the moving image playback speed. The The moving speed of the playback slider DP40, which cannot grasp the movement unless the moving image is reproduced, is constant, and the change in the reproducing speed is expressed by the scale DP3 that can grasp the whole picture without reproducing the moving image, so that the moving speed is selected without reproducing the moving image. It is possible to grasp the difference in playback speed between a scene related to an event and other scenes.

  The first example of the display screen DP shown in FIG. 4 and the display screen DP shown in other drawings are examples, and the display contents can be arbitrarily changed. For example, in addition to the operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24 that function as the event selection reception unit 22 and the speed ratio reception unit 23, selection of events other than the operation event, stop event, hand event, and person event Or a queue for receiving a speed ratio may be displayed. Further, the position of the slider included in each queue may be initially set to an average value calculated based on the usage histories of a plurality of users.

  FIG. 5 is a flowchart of the moving image display process executed by the display control apparatus 10 according to the embodiment of the present invention. The moving image display process is a process performed after the moving image acquisition unit 25 acquires a moving image from the moving image storage unit 30. The moving image includes an event frame group that is a set of frames associated with the event.

  First, the event selection receiving unit 22 (sliders included in the operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24) receives selection of one or more events from the user (S10). Selection of one or a plurality of events is performed by setting a cue slider related to the event related to the selection to a position larger than zero.

  The display control apparatus 10 calculates the ratio p between the scene relating to the event related to the selection and the other scenes (S11). The display control apparatus 10 may calculate the ratio p between the scene related to the event related to the selection and the other scenes by dividing the number of frames of the first frame group by the number of frames of the entire moving image. As in the example shown in FIG. 4, when a hand event is selected, the number of frames included in the hand event frame group MV11 is the number of frames of the entire moving image. The ratio is p.

  The playback speed receiving unit 20 (first fast-forward speed setting slider DP30) receives the first fast-forward speed v1 (first playback speed) of the moving image (S12). The display control device 10 calculates the entire reproduction time T based on the first fast-forward speed v1 and the length of the moving image (S13). Specifically, when the length of the moving image is represented by the number of frames F included in the moving image and the first fast-forward speed v1 is represented in units of frames per second, the reproduction time T [seconds] is calculated by T = F / v1. The

  Furthermore, the speed ratio receiving unit 23 (the sliders included in the operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24, respectively) generates a reproduction speed ve of the first frame group and a reproduction speed v2 of the second frame group. One or more speed ratios r are accepted. That is, the speed ratio receiving unit 23 receives the speed ratio r between the scene playback speed ve and the second fast-forward speed v2 related to the selected event by setting the position of the slider.

  The display control apparatus 10 determines the ratio p between the scene related to the event related to the selection and the other scenes p, the overall playback time T, and the speed ratio r between the playback speed ve of the scene related to the event related to the selection and the second fast-forward speed v2. The scene playback speed ve and the second fast-forward speed v2 relating to the event are calculated (S15). Specifically, when the number of frames of the entire moving image is expressed as F, by solving simultaneous equations of the first equation Fp / ve + F (1−p) / v2 = T and the second equation r = v2 / ve. The scene playback speed ve and the second fast-forward speed v2 relating to the event may be calculated. Since the solution is v2 = (Fpr + F (1-p)) / T and ve = (Fpr + F (1-p)) / Tr, by substituting numerical values into these solutions, the scene playback speed related to the event ve and the second fast-forwarding speed v2 may be calculated. Further, the display control apparatus 10 may calculate the scene playback speed ve and the second fast-forward speed v2 related to the event so that the scene playback speed and the second fast-forward speed related to the event change continuously. For example, when a scene related to an event is displayed, the playback speed is gradually decreased according to Gaussian from the second fast-forward speed v2, and when the scene related to the event is displayed, the playback speed is gradually increased according to Gaussian. Good.

  The scale display control unit 21b calculates the scale interval according to the calculated moving image playback speed (S16). For example, in the example shown in FIG. 4, the scale display control unit 21b determines that the relationship between the scale interval L1 of the first example DP10a in the non-event section and the scale interval L2 of the first example DP11a in the hand event section is L2 / The scale interval may be calculated so that L1 = r (speed ratio). Then, the scale display control unit 21b displays the scale DP3 at the calculated unequal scale intervals (S17).

  The effect display control unit 21d displays the effect that visualizes the change in the playback speed of the moving image along the scale (S18). The effect display control unit 21d may change the display mode of the effect (for example, the intensity of the effect) according to the calculated moving image playback speed.

  The moving image display control unit 21a determines that the playback speed of the first frame group associated with one or a plurality of events related to the selection received by the event selection receiving unit 22 among the event frame groups is a second frame other than the first frame group. The moving image is displayed so as to be slower than the reproduction speed of the group (S19). That is, the moving image display control unit 21a displays a scene related to the selected event from the moving images on the moving image display screen DP1 at the reproduction speed ve, and displays other scenes on the moving image display screen DP1 at the reproduction speed v2.

  The slider display control unit 21c displays a slider (reproduction slider DP40) that moves along the scale as the moving image is displayed so as to move at a constant speed regardless of the change in the moving image reproduction speed (S20). Thus, the moving image display process ends. The contents and order of the processes included in the moving image display process are not limited to those shown in FIG. For example, the selection of one or more events by the event selection receiving unit 22 (S10) and the reception of one or more speed ratios by the speed ratio receiving unit (S14) may be performed simultaneously.

  According to the display control apparatus 10 according to the present embodiment, an event is associated with a frame that configures a moving image, so that a scene that is noticed by the user can be selected from the moving image. The first frame group associated with one or more events related to the user's selection is displayed later than the second frame group, which is another frame group, so that the details of the scene that the user is interested in can be grasped. It is possible to grasp the outline of other scenes.

  FIG. 6 is a diagram showing a second example of the display screen DP displayed by the display control apparatus 10 according to the embodiment of the present invention. Compared to the first example of the display screen DP shown in FIG. 4, the second example of the display screen DP is about the position of the hand speed ratio adjustment slider DP23a, the scale interval of the scale DP3, and the hand event effect DP11e. Is different. In other respects, the second example of the display screen DP has the same configuration as the first example of the display screen DP shown in FIG. Hereinafter, the difference between the second example of the display screen DP and the first example of the display screen DP illustrated in FIG. 4 will be described.

  In the second example of the display screen DP shown in FIG. 6, the speed ratio is changed compared to the case of the first example of the display screen DP shown in FIG. The hand speed ratio adjustment slider DP23a of this example is set to a position of “0.59”, the hand event is selected by the user, the scene playback speed ve related to the hand event and the playback speed of the other scenes (the second playback speed). The speed ratio with the rapid traverse speed v2) may be r = v2 / ve = 1.59.

  When one or more speed ratios received by the speed ratio receiving unit 23 are changed, the scale display control unit 21b displays the scale DP3 so that the scale interval changes according to the change of one or more speed ratios. Let Specifically, the scale DP3 of this example includes the second example DP10b of the non-event section, the second example DP11b of the hand event section, the second example DP10b of the non-event section, and the second of the hand event section in the playback order of the moving images. Example DP11b is included. The second example DP11b of the hand event section is shown in response to the change in the speed ratio between the playback speed ve of the scene related to the hand event and the playback speed of the other scene (second fast-forward speed v2). Compared with the first example DP11a in the hand event section shown in FIG. 4, the scale interval changes so as to become wider. On the other hand, the second example DP10b in the non-event section changes so that the scale interval becomes narrower than the first example DP10a in the non-event section shown in FIG. In this way, by changing the scale interval according to the speed ratio change, the difference in playback speed between the scene related to the selected event and other scenes can be changed according to the speed ratio change without playing the video. You can intuitively understand how it changes.

  The effect display control unit 21d changes the intensity of the effect according to the absolute value of the playback speed ve of the scene related to the selected event. In the case of this example, the first fast-forward speed v1 is the same as in the first example of the display screen DP shown in FIG. 4, but the scene playback speed ve related to the hand event and the playback speed of other scenes (second fast-forward speed v2). Since the speed ratio r is increased, the absolute value of the scene playback speed ve for the selected event is increased. The effect display control unit 21d sets the effect DP11e of the hand event of this example to the maximum density of the effect DP11e of the hand event shown in FIG. 4 according to the change in the absolute value of the playback speed ve of the scene related to the selected event. Is displayed so as to become darker. Thereby, the user can grasp the difference between the absolute reproduction speeds of the scene related to the selected event and the other scenes without reproducing the moving image.

  FIG. 7 is a flowchart of the speed ratio changing process executed by the display control apparatus 10 according to the embodiment of the present invention. The speed ratio receiving unit 23 (sliders included in each of the operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24) receives a change in one or a plurality of speed ratios r (S30). The scale display control unit 21b displays the scale DP3 so that the scale interval changes according to the change of one or a plurality of speed ratios r (S31). In addition, the effect display control unit 21d displays the effect along the scale DP3 so that the display mode of the effect changes according to the change of one or a plurality of speed ratios r (S32).

  The display control apparatus 10 changes the playback speed ve of the scene related to the selected event (playback speed of the first frame group) and the playback speed v2 of other scenes (playback of the second frame group) according to the change in the speed ratio r. The second fast-forwarding speed v2), which is the speed, is corrected (S33). Thus, the speed ratio changing process ends.

  FIG. 8 is a flowchart of the first fast-forward speed change process executed by the display control apparatus 10 according to the embodiment of the present invention. The reproduction speed receiving unit 20 receives a change in the first fast-forward speed v1 (S40). For example, in the first example of the display screen DP shown in FIG. 4 and the second example of the display screen DP shown in FIG. 6, the first fast-forward speed v1 is 10 times the normal playback speed. 20 changes the first fast-forward speed v1 to a speed other than 10 times the normal playback speed.

  When the first playback speed (first fast-forward speed v1) received by the playback speed receiving unit 20 is changed, the scale display control unit 21b does not change the scale interval regardless of the change in the first playback speed. The scale DP3 is displayed (S41). When the first fast-forward speed v1 is changed, the playback speed ve of the scene related to the selected event and the second fast-forward speed v2 of other scenes are changed. However, if the speed ratio r between the scene playback speed ve related to the selected event and the second fast-forward speed v2 of the other scene is not changed, the scene playback speed ve related to the selected event Since the relative speed difference with 2 fast-forwarding speed v2 does not change, the scale display control part 21b maintains a scale space | interval. In this way, when the first playback speed is changed, the scale interval is not changed, so that the playback speed of the selected scene and the playback of other scenes are changed even when the playback time of the entire movie is changed. It can be intuitively understood that the speed ratio is constant.

  The display control apparatus 10 corrects the reproduction time T of the entire moving image based on the changed first fast-forward speed v1 and the number of frames included in the moving image (S42). Then, the display control apparatus 10 corrects the scene playback speed ve related to the selected event and the second fast-forward speed v2 of other scenes (S43). Thus, the first fast-forward speed changing process is completed.

  FIG. 9 is a diagram showing a third example of the display screen DP displayed by the display control apparatus 10 according to the embodiment of the present invention. The third example of the display screen DP is different from the second example of the display screen DP shown in FIG. 6 in that the positions of the hand speed ratio adjustment slider DP23a and the person speed ratio adjustment slider DP24a, the scale interval of the scale DP3, and the hand The event effect DP11e is different from the person event effect DP12e. In other respects, the third example of the display screen DP has the same configuration as the second example of the display screen DP shown in FIG. Hereinafter, the difference between the third example of the display screen DP and the second example of the display screen DP illustrated in FIG. 6 will be described.

  In the third example of the display screen DP shown in FIG. 9, selection of a person event is added as compared to the case of the second example of the display screen DP shown in FIG. The person speed ratio adjustment slider DP24a in this example is set to a position of “1.00”, and the person event is selected by the user. Further, the hand speed ratio adjustment slider DP23a is set at a position of “0.59”, and the hand event is selected by the user. The positions of the hand speed ratio adjustment slider DP23a and the person speed ratio adjustment slider DP24a are the scene playback speed ve1 related to the hand event, the scene playback speed ve2 related to the person event, and the playback speed (second fast-forward speed v2) of other scenes. ) And the speed ratio.

  When an event selection is added and one or more speed ratios received by the speed ratio receiving unit 23 are changed, the scale display control unit 21b changes the scale interval in accordance with the change of one or more speed ratios. The scale DP3 is displayed as shown. Specifically, the scale DP3 of this example includes, in the playback order of moving images, the third example DP10c of the non-event section, the third example DP11c of the hand event section, the third example DP10c of the non-event section, the person event section DP12, A third example DP10c of the event section and a second example DP11b of the hand event section are included. Each of these sections corresponds to a frame group included in the moving image MV shown in FIG. A person event section DP12 is added in response to the addition of the person event selection. Further, according to the change in the speed ratio between the scene playback speed ve1 related to the hand event and the scene playback speed ve2 related to the person event and the playback speed of the other scene (second fast-forward speed v2), Compared to the second example DP11b in the hand event section shown in FIG. 6, the third example DP11c changes so that the scale interval becomes narrower. Further, the third example DP10c of the non-event section has a scale interval that is larger than that of any of the first examples DP10a of the non-event section shown in FIG. 4 and the second example DP10b of the non-event section shown in FIG. It is changing to become narrower. In this way, by changing the scale interval according to the addition of event selection and the change in the speed ratio accompanying the addition, the difference in playback speed between the scene related to the selected event and other scenes can be obtained without playing the video. However, it is possible to intuitively understand how it changes according to the addition of an event and the change in the speed ratio accompanying the addition.

  The effect display controller 21d changes the intensity of the effect according to the absolute values of the scene playback speed ve1 related to the hand event and the scene playback speed ve2 related to the person event. In this example, the first fast-forward speed v1 is the same as in the second example of the display screen DP shown in FIG. 6, but the scene playback speed ve1 related to the hand event, the scene playback speed ve2 related to the person event, and other scenes. Since the speed ratio with the playback speed (second fast-forward speed v2) changes, the absolute value of the scene playback speed ve1 related to the hand event changes compared to the second example of the display screen DP shown in FIG. is doing. The effect display control unit 21d displays the person event effect DP12e and the hand event effect DP11e in accordance with the absolute values of the scene playback speed ve1 related to the hand event and the scene playback speed ve2 related to the person event. Thereby, the user can grasp the difference between the absolute reproduction speeds of the scene related to the selected event and the other scenes without reproducing the moving image.

  FIG. 10 is a flowchart of selection event addition processing executed by the display control apparatus 10 according to the embodiment of the present invention. The event selection receiving unit 22 (sliders included in the operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24) receives a selection of a new event (S50). Further, the speed ratio receiving unit 23 (the sliders included in the operation queue DP21, the stop queue DP22, the hand queue DP23, and the person queue DP24, respectively) is one of the scene playback speed ve and the second fast-forward speed v2 related to the selected event. A plurality of speed ratios r are received (S51). The scale display control unit 21b displays the scale DP3 so that the scale interval changes according to the change of one or a plurality of speed ratios r (S52). The effect display control unit 21d displays the effect along the scale DP3 so that the display mode of the effect changes according to the change of one or a plurality of speed ratios r (S53).

  The display control apparatus 10 changes the playback speed ve of the scene related to the selected event (the playback speed of the first frame group) and the playback speed v2 of the other scenes (second) according to the change of one or more speed ratios r. The second fast-forward speed v2), which is the frame group reproduction speed, is corrected (S54). Thus, the selected event addition process ends.

  In the above description, the hand event and the person event are assumed to be separated from each other, but in general, a plurality of events may be associated with one frame or a group of frames. In that case, the display control apparatus 10 may perform control such that the reproduction speed of the frame or the frame group becomes relatively slower as the association of the plurality of events related to selection overlaps. When the association between the frame and the event is performed by associating the degree of coincidence between the frame and the event, the degree of coincidence for a plurality of events may be associated with one or a group of frames.

  Further, in the above description, the event selection receiving unit 22 has been described to receive a selection of a target or action that the user is interested in from the user. However, the event selection reception unit 22 selects a target or action that is not noted by the user. You may accept from. When the event selection receiving unit 22 receives a selection of an object or action that the user does not pay attention to, the moving image display control unit 21a associates with one or more events related to the selection received by the event selection receiving unit 22 in the event frame group. The moving image may be displayed such that the playback speed of the first frame group thus set is faster than the playback speed of the second frame group other than the first frame group. The user selects a target or action that the user is not interested in, and the first frame group associated with one or more events related to the user's selection is displayed faster than the second frame group, which is another frame group. Also, the user can grasp the details of the scene of interest and can grasp the outline of other scenes.

  The embodiments described above are for facilitating the understanding of the present invention, and are not intended to limit the present invention. Each element included in the embodiment and its arrangement, material, condition, shape, size, and the like are not limited to those illustrated, and can be changed as appropriate. In addition, the structures shown in different embodiments can be partially replaced or combined.

  DESCRIPTION OF SYMBOLS 10 ... Display control apparatus, 11 ... CPU, 12 ... RAM, 13 ... ROM, 14 ... Communication interface, 15 ... Input part, 16 ... Display part, 20 ... Playback speed reception part, 21 ... Display control part, 21a ... Movie display Control unit, 21b ... Scale display control unit, 21c ... Slider display control unit, 21d ... Effect display control unit, 22 ... Event selection reception unit, 23 ... Speed ratio reception unit, 25 ... Movie acquisition unit, 30 ... Movie storage unit, DP ... display screen, DP1 ... moving image display screen, DP2 ... moving image selection screen, DP10a ... first example of non-event section, DP10b ... second example of non-event section, DP10c ... third example of non-event section, DP11a ... hand First example of event interval, DP11b ... Second example of hand event interval, DP11c ... Third example of hand event interval, DP11e ... F of hand event , DP12 ... person event section, DP12e ... person event effect, DP21 ... action queue, DP22 ... stop queue, DP23 ... hand cue, DP23a ... hand speed ratio adjustment slider, DP24 ... person queue, DP24a ... person speed ratio adjustment slider , DP30: first fast-forward speed setting slider, DP40: playback slider, MV: moving image, MV10: non-event frame group, MV11: hand event frame group, MV12: person event frame group, TG1: hand tag, TG2: person tag.

Claims (10)

A video acquisition unit that acquires a video including an event frame group that is a set of frames associated with an event;
An event selection accepting unit for accepting selection of one or more events from the user;
Among the event frame groups, the playback speed of the first frame group associated with one or more events related to the selection received by the event selection receiving unit is the playback speed of the second frame group other than the first frame group. A video display control unit for displaying the video differently,
A display control device. A playback speed receiving unit that receives a first playback speed of the moving image;
The moving image display control unit moves the second frame group based on the first reproduction speed so that the moving image is displayed with the entire reproduction time calculated based on the length of the moving image and the first reproduction speed. Is displayed at a higher second playback speed, and the first frame group is displayed at a lower playback speed than the second playback speed.
The display control apparatus according to claim 1. A speed ratio receiving unit that receives one or more speed ratios between the playback speed of the first frame group and the playback speed of the second frame group;
The display control apparatus according to claim 2. Based on the ratio of the scene relating to the event to the entire moving image, the length of the moving image, and the one or more speed ratios, the moving image interval is unequal according to the reproduction speed of the moving image. A scale display control unit for displaying a scale indicating the passage of time of
The display control apparatus according to claim 3. A slider display control unit configured to display a slider that moves along the scale as the moving image is displayed so as to move at a constant speed regardless of a change in the reproduction speed of the moving image;
The display control apparatus according to claim 4. An effect display control unit that displays an effect that visualizes a change in the playback speed of the moving image along the scale;
The display control apparatus according to claim 4 or 5. When the one or more speed ratios received by the speed ratio receiving unit are changed, the scale display control unit is configured to change the scale interval according to the change of the one or more speed ratios. Display tick marks,
The display control apparatus according to any one of claims 4 to 6. When the first playback speed received by the playback speed receiving unit is changed, the scale display control unit displays the scale so that the scale interval does not change regardless of the change in the first playback speed. Let
The display control apparatus of any one of Claim 2 to 7. A first step of obtaining a moving image including an event frame group that is a set of frames associated with the event;
A second step of accepting selection of one or more events from the user;
Of the event frame group, the playback speed of the first frame group associated with one or more events related to the selection received in the second step is different from the playback speed of the second frame group other than the first frame group. A third step of displaying the moving image as follows:
A display control method including: Computer
A video acquisition unit that acquires a video including an event frame group that is a set of frames associated with an event;
An event selection accepting unit for accepting selection of one or more events from the user;
Among the event frame groups, the playback speed of the first frame group associated with one or more events related to the selection received by the event selection receiving unit is the playback speed of the second frame group other than the first frame group. A video display control unit for displaying the video differently,
Display control program to function as.