JP5838791B2 - Program, image processing apparatus and image processing method - Google Patents

Description

  The present invention relates to a program, an image processing apparatus, and an image processing method for setting an anchor for a moving object.

  Conventionally, in a hypermedia environment using a moving image, it is known to perform a link operation by displaying an anchor on an object of the moving image, connecting a link to the anchor, and specifying the anchor on the moving image. Hereinafter, the object is also referred to as an object.

  For example, there is a technique in which an anchor is set in an arbitrary area on a moving image, anchor information and link information are stored, and the anchor is dynamically displayed based on the display attribute of the moving image and the anchor.

JP-A-8-123816

  Here, when setting an anchor for an object in a moving image, for example, the shape of the object is extracted by extracting an edge in each frame in the moving image, and further, an error between frames is extracted. A method of extracting the movement of the object can be considered. An anchor refers to an element set to a hyperlink, for example.

  When an object for which an anchor is to be set moves in a movie, in the conventional technology, the position coordinates of the object in each frame are specified, and the position of the anchor is defined by the frame number and the position coordinates of the object. .

  On the other hand, it may be necessary to edit an anchor once set for an object. For example, assume that an object is extracted by edge extraction, and an anchor is set at the position of the object. Depending on the accuracy of edge extraction, the position or shape of the object on the image viewed from the human eye may be different from the position or shape of the object recognized by the computer by edge extraction. In such a case, an operation for changing the position of the anchor on the frame occurs so that the anchor is superimposed on the object as viewed from the human eye. Hereinafter, this work is also referred to as editing work.

  However, if the position coordinates of the object in each frame are specified and the anchor position is defined by the frame number and the position coordinates, for example, there are as many anchor position definitions as the number of frames. The amount will increase.

  If the anchor position editing operation is performed for the definition of the anchor position existing in each frame, the definition data corresponding to the number of frames is changed, which is very complicated for the editor. It was a difficult process.

  Accordingly, the disclosed technology has been made in view of the above problems, and provides a program, an information processing apparatus, and an information processing method capable of reducing the data amount of anchor information while facilitating editing of an anchor. The purpose is to do.

A program according to an aspect of the disclosure receives an anchor setting for an object in an image included in a moving image, the object in which the anchor in a predetermined image included in the moving image is set, and another included in the moving image It is determined whether or not the amount of movement with respect to the object in the image is equal to or greater than a predetermined value. When it is determined that the amount of movement is equal to or greater than the predetermined value, the identifier of the image to be determined and the position information of the anchor When the other image is the latest image among the objects to be stored in the storage unit, the storing process includes the identifier of the predetermined image and the predetermined image. The position information of the anchor in the image is stored in the storage unit .

  The disclosed technology can reduce the data amount of anchor information while facilitating editing of the anchor.

The block diagram which shows an example of a functional structure of the information processing apparatus in an Example. The figure which shows an example of the data structure of anchor information. The figure which shows an example of anchor information. The figure for demonstrating the automatic production | generation of an anchor position. The figure for demonstrating the automatic generation of an anchor position, and an example of an edit. The figure for demonstrating the example of drawing of an anchor. The figure for demonstrating the example of a display of an anchor. The figure for demonstrating a link destination display. The flowchart which shows an example of an anchor setting process. The flowchart which shows an example of the production | generation process of anchor information. The flowchart which shows an example of a moving image reproduction process. The block diagram which shows an example of the hardware of information processing apparatus.

  Hereinafter, embodiments will be described with reference to the accompanying drawings.

[Example]
<Configuration>
FIG. 1 is a block diagram illustrating an example of a functional configuration of the information processing apparatus 1 according to the embodiment. The information processing apparatus 1 has a function of setting an anchor for which a link destination is set as a moving object (object). An anchor is an icon for calling a link destination, for example. Below, this icon is also called a link icon.

  The information processing apparatus 1 may have a function of editing a set anchor. The information processing apparatus 1 may have a function of displaying or playing back a link destination in association with an anchor when the anchor is pressed or instructed during moving image playback.

  The information processing apparatus 1 illustrated in FIG. 1 includes an anchor information generation unit 10, an operation unit 11, a link definition storage unit 12, a moving image data storage unit 13, an anchor information editing unit 14, a playback control unit 15, and a display unit 16.

  First, the anchor information generation unit 10 reads and acquires a moving image from the moving image data storage unit 13, and receives the setting of the frame and anchor position for setting the anchor. The anchor information generation unit 10 has a function for automatically extracting an object in which an anchor is set in a subsequent frame and causing the anchor to follow the object.

  When the object is automatically extracted, the anchor information generation unit 10 determines whether or not to store the position of the anchor according to the movement amount of the object or the anchor. As a result, the anchor information does not have to be stored every frame, so that the data amount of the anchor information can be reduced.

  The anchor information generation unit 10 includes a setting unit 111, an extraction unit 112, and a determination unit 113 in order to realize the above functions. The setting unit 111 receives a frame for setting an anchor from the operation unit 11 and the position of the anchor in the frame for each frame included in the moving image.

  The position of the anchor is represented by coordinates in the frame and is also called anchor position information. The setting unit 111 outputs an identifier indicating the received frame and anchor position information to the extraction unit 112. An identifier indicating a frame is also called a frame identifier, and may be a frame number, a time code indicating a playback time from the beginning of a moving image, a time stamp, or the like.

  The extraction unit 112 automatically extracts a region of an object using an image recognition technique around the position where the anchor is set with respect to the frame where the anchor is set. For example, the extraction unit 112 automatically extracts the coordinates of the object region recognized by performing edge extraction. The coordinates of the object are, for example, the center coordinates of the object area.

  The extraction unit 112 tracks the extracted object in each subsequent frame, and outputs the recognized object coordinates to the determination unit 113.

  The determination unit 113 determines whether or not the recognized object has moved by a predetermined value or more from this object in another frame. For example, the determination unit 113 determines whether or not the amount of movement between the object of the current frame and the object of the previous frame is greater than or equal to a predetermined value. Thereby, the determination part 113 can determine the case where the movement amount of the object in a short time is large.

  The amount of movement is, for example, a difference in object coordinates between frames or a movement of an object region that has undergone an inter-frame error extraction process. The movement amount may be the movement amount of the center coordinates of the anchor.

  The predetermined value is, for example, the size of one object extracted by the extraction unit 112. Further, the predetermined value may be the size of the anchor, and may be set to an appropriate value through experiments or the like.

  Further, the determination unit 113 determines whether or not the movement amount between the object of the current frame and the object of the latest frame stored or stored in the link definition storage unit 12 described later is a predetermined value or more. judge. As a result, the determination unit 113 can determine a case where the object moves little by little as a result of moving from the determination reference position by a predetermined value or more.

  The latest frame stored or stored in the link definition storage unit 12 is a frame before the current frame and closest to the current frame.

  The determination unit 113 may determine whether a negative determination result indicating that the amount of movement of the object is less than a predetermined value has continued for a predetermined time or more. Further, the determination unit 113 may determine whether it is the last frame or the first frame in which the anchor is set by the user. The final frame represents either the last frame in which the object to which the anchor is set is displayed or the final frame of the moving image.

  The determination unit 113 includes a generation unit 114. When the determination unit 113 determines that the value is equal to or greater than the predetermined value, the generation unit 114 generates a determination target frame identifier and anchor position information, and stores them in the link definition storage unit 12. The anchor position information is, for example, the center coordinates of the extracted object.

  When the current frame and the immediately preceding frame are to be determined, the generation unit 114 associates the frame identifier of the current frame with the anchor position information of the current frame, and sets the frame identifier of the immediately preceding frame, the anchor position information of the immediately preceding frame, Are stored in the link definition storage unit 12 in association with each other.

  When the current frame and the latest frame stored in the link definition storage unit 12 are to be determined, the generation unit 114 associates the frame identifier of the current frame with the anchor position information of the current frame and associates the link definition storage unit 12 to store. Hereinafter, information including the frame identifier of the current frame and anchor position information is also referred to as anchor information. Although the generation unit 114 has been described with the configuration included in the determination unit 113, the generation unit 114 may have a configuration different from that of the determination unit 113.

  When the movement amount is less than the predetermined value for a predetermined time or more, or when the current frame is the last frame or the first frame in which the anchor is set, the generation unit 114 determines the frame identifier and anchor position information of the current frame. Are stored in the link definition storage unit 12 in association with each other.

  Thereby, the anchor information generation part 10 does not need to define anchor information for every flame | frame, when setting an anchor. Further, since the anchor information generation unit 10 only needs to store the anchor information for a frame in which the movement amount of the object for which the anchor is set is large, it is possible to reduce the data amount of the anchor information.

  The operation unit 11 has a GUI (Graphical User Interface) operation function, and performs setting of an anchor position, setting of a link destination to be associated with the anchor, editing of the anchor position, instruction for reproducing a moving image, selection of an anchor, and the like. When there is an operation from the user, the operation unit 11 notifies the operation content to each unit.

  The link definition storage unit 12 stores the anchor information generated by the anchor information generation unit 10. The anchor information includes anchor position information initially set by the user and its frame identifier. The anchor information also includes information on the link destination associated with the anchor. The anchor information will be described later with reference to FIG.

  The moving image data storage unit 13 stores moving image data. The moving image data is, for example, content for setting an anchor associated with a link destination. As moving image data, for example, there are an operation manual for a portable terminal, an inspection manual for a private car, and the like.

  Although the link definition storage unit 12 and the moving image data storage unit 13 have been described as separate storage units, they may be the same storage device. The link definition storage unit 12 and the moving image data storage unit 13 include, for example, a RAM (Random Access Memory) including a VRAM (Video Random Access Memory), a ROM (Read Only Memory), a flash memory (flash memory), and the like. A semiconductor memory device is mentioned. Note that a storage device such as a hard disk or an optical disk may be applied to the link definition storage unit 12 and the moving image data storage unit 13.

  The anchor information editing unit 14 edits anchor position information set in the moving image. Since the anchor information generation unit 10 automatically generates anchor position information, the position may deviate from the actual object on the moving image. Therefore, in such a case, the editor needs to edit the anchor position. The anchor information editing unit 14 has a function of facilitating editing of anchor information.

  The anchor information editing unit 14 includes an editing unit 141 and a changing unit 142. The editing unit 141 uses the moving image stored in the moving image data storage unit 13 and the anchor information stored in the link definition storage unit 12 to reproduce the moving image on which the anchor is displayed.

  At this time, the editing unit 141 controls the display unit 16 to display an editing screen in which the anchor position and the link destination can be edited. When the anchor is edited using the editing screen displayed on the display unit 16, the editing unit 141 receives an editing operation related to the anchor from the operation unit 11.

  For example, the editing unit 141 receives a change of the anchor position, a change of a link destination associated with the anchor, or the like from the operation unit 11. The editing unit 141 notifies the changing unit 142 of the contents of the user operation received from the operation unit 11, for example, the frame identifier of the edited frame and the changed anchor position information.

  The changing unit 142 changes the anchor information stored in the link definition storage unit 12 based on the operation content acquired from the editing unit 141. For example, it is assumed that the operation content includes a frame identifier and edited anchor position information.

  In this case, the changing unit 142 searches the anchor information stored in the link definition storage unit 12 for a frame identifier that matches the frame identifier included in the acquired operation content. The changing unit 142 changes the anchor position information associated with the matched frame identifier to the edited anchor position information.

  As a result, the editing work only needs to be performed on the frames stored in the link definition storage unit 12, so that editing is facilitated.

  The reproduction control unit 15 reads out and acquires moving image data from the moving image data storage unit 13, reads out and acquires anchor information from the link definition storage unit 12, and reproduces the moving image on which the anchor is superimposed and displayed on the display unit 16. To do.

  The playback control unit 15 includes a drawing unit 151 and a link content playback unit 152. When the display unit 16 displays the frame indicated by the frame identifier stored in the anchor information on the display unit 16, the drawing unit 151 draws the anchor at the position indicated by the anchor position information and superimposes the anchor on the moving image.

  When a frame other than the frame indicated by the frame identifier stored in the link definition storage unit 12 is displayed, the drawing unit 151 performs interpolation calculation and continuously displays the anchor. The interpolation calculation linearly interpolates the respective anchor position information corresponding to two frames located before and after the display target frame among the frames stored in the link definition storage unit 12. The drawing unit 151 draws, for example, an animation of the linearly interpolated anchor.

  As a result, the drawing unit 151 does not need to redraw all the anchor pixels for each frame to be displayed, and displays the anchor subjected to the interpolation calculation. Therefore, it is possible to redraw the minimum necessary pixels. The minimum necessary pixel means a pixel at a changed portion. Therefore, the flickering of the anchor image can be prevented as compared with the case of redrawing with all the anchor pixels.

  When the link content playback unit 152 is notified from the operation unit 11 that the anchor has been selected by pressing the anchor, the link content playback unit 152 moves to the link destination associated with the anchor, and plays back, for example, the video hyperlink content on the display unit 16. Control as follows.

  Note that various integrated circuits and electronic circuits can be employed for the anchor information generation unit 10, the anchor information editing unit 14, and the reproduction control unit 15. For example, examples of the integrated circuit include ASIC (Application Specific Integrated Circuit) and FPGA (Field Programmable Gate Array). Examples of the electronic circuit include a central processing unit (CPU) and a micro processing unit (MPU).

<Anchor information>
Next, the data structure of anchor information stored in the link definition storage unit 12 will be described. FIG. 2 is a diagram illustrating an example of a data structure of anchor information. As shown in FIG. 2, the anchor information is synchronized with the moving image data indicating the anchor identification name (name), the anchor type (type), the anchor area (size), the link destination information (link), and the data (data) related to the anchor. Frame position or elapsed time (time), and anchor position information (px, py) indicating the coordinates of the anchor on the screen.

  The anchor type indicates an icon or a link type. The anchor area indicates the size of the click range. The coordinates on the screen are based on the original video size.

  The data (data) has a hierarchical structure and can have a plurality of “time” and “(px, py)”. The frame position or the elapsed time may be any value that can identify a frame in the moving image, such as a frame number.

  Next, a specific example of anchor information will be described. FIG. 3 is a diagram illustrating an example of anchor information. The example shown in FIG. 3 is an example in which anchor information is implemented in XML (Extensible Markup Language).

  For example, the anchor identification name is “sampleA”, the anchor type is “LINK”, the anchor area is “60”, and the link destination information is “nextset”. In the example shown in FIG. 3, four frame identifiers and anchor position information are held. These frame identifiers and anchor position information are information generated by the anchor information generation unit 10.

<Generation and editing of anchor position information>
Next, the automatic generation of anchor positions will be specifically described. FIG. 4 is a diagram for explaining automatic generation of anchor positions. In the example illustrated in FIG. 4, frames t11 to t14 are displayed in order. Further, it is assumed that an object (target object) for setting an anchor is designated by the user in the frame at t11.

  At this time, the anchor information generation unit 10 extracts an edge around the designated object and extracts an object region. The anchor information generation unit 10 uses the center coordinates of the extracted object area as anchor position information, and stores the identifier (for example, time code) of the frame t11 in the link definition storage unit 12 in association with the anchor position information.

  Next, the anchor information generation unit 10 (extraction unit 112) tracks the object in the frame at t12, and obtains the movement amount from the frame at t11 by an inter-frame error extraction process or the like. The anchor information generation unit 10 (determination unit 113) determines whether or not the movement amount is greater than or equal to a predetermined value, and here determines that it is less than the predetermined value. Here, the predetermined value is the object size.

  Next, the anchor information generation unit 10 (extraction unit 112) tracks the object in the frame at t13 and obtains the movement amount from the frame at t12. The anchor information generation unit 10 (determination unit 113) determines whether or not the movement amount is greater than or equal to a predetermined value, and here determines that it is greater than or equal to the predetermined value.

  The anchor information generation unit 10 (generation unit 114) stores the frame identifiers of t12 and t13 and the anchor position information of the frames of t12 and t13 in the link definition storage unit 12. The frame identifier here is, for example, a time code, and the anchor position information is, for example, the center coordinates of the object.

  Next, the anchor information generation unit 10 (extraction unit 112) tracks the object in the frame at t14 and obtains the movement amount from the frame at t13. The anchor information generation unit 10 (determination unit 113) determines whether or not the movement amount is greater than or equal to a predetermined value, and here determines that it is greater than or equal to the predetermined value. Since the frame identifier and anchor position information of t13 are already stored in the link definition storage unit 12, the anchor information generation unit 10 (generation unit 114) obtains the frame identifier of t14 and the anchor position information of the frame of t14. Store in the link definition storage unit 12.

  Thereby, since it is not necessary to define an anchor in all the frames after the frame in which the anchor is set, the data amount of the anchor information can be reduced.

  Next, a specific example using the battery pack of the portable terminal as an object will be described. FIG. 5 is a diagram for explaining an example of automatic generation and editing of anchor positions. The example shown in FIG. 5 is an example when the battery pack of the mobile terminal is set as an object.

  The anchor information generation unit 10 (setting unit 111) reads and acquires the target moving image from the moving image data storage unit 13. At this time, the start frame of the displayed moving image is the image inside the screen d11.

  Next, it is assumed that the user sets the anchor an12 at the position of the battery pack on the screen d12. This can be set by, for example, pressing the link button to display the anchor an12 on the screen d12 and moving the position of the anchor an12.

  When an anchor is set first, the anchor information generation unit 10 can automatically generate an anchor position where the amount of movement of the object is large by tracking the object where the anchor is set.

  The screen d13 is a screen for confirming the automatically generated anchor position information by preview reproduction.

  The screen d14 is a screen for editing the automatically generated anchor position. The user specifies a frame for position adjustment by frame advance or the like, and moves the anchor an14 displayed on the frame to a desired position by a drag operation or the like.

  Thus, the editor only needs to confirm the anchor position information of the frame indicated by the frame identifier stored in the link definition storage unit 12, and does not need to confirm the anchor position in all the frames. Therefore, editing work becomes easy.

<Anchor drawing, video playback>
Next, a drawing structure of a moving image and an anchor will be described. FIG. 6 is a diagram for explaining an anchor drawing example. In the example shown in FIG. 6, the anchor drawing layer is superimposed on the moving image playback layer. With this structure, the anchor can be superimposed on the object in the moving image being reproduced.

  FIG. 7 is a diagram for explaining a display example of an anchor. In the example shown in FIG. 7, anchor information is stored in the link definition storage unit 12 at frames t21, t23, t24, and t28. For the frame indicated by the frame identifier stored in the link definition storage unit 12, the drawing unit 151 draws an anchor at the position indicated by the anchor position information.

  For the frames other than the frame indicated by the frame identifier stored in the link definition storage unit 12, the drawing unit 151 draws an anchor, for example, by performing an interpolation operation based on the position of the drawn anchor.

  For example, the anchor of the frame t22 is displayed between the anchor position of the frame t21 and the anchor position of the frame t23. In addition, the anchors of the frames t25 to t27 are displayed at positions obtained by interpolation between the anchor position of the frame t24 and the anchor position of the frame t28.

  Note that the anchors displayed in frames t21, t23, t24, and t28 shown in FIG. 7 are to be edited. In the general technique, the anchor position information of the frames t21 to t28 is stored, and the anchors of the frames t21 to t28 are to be edited.

  As a result, the anchor drawing can be applied with a drawing method based on an animation of coordinate movement instead of redrawing all the pixels of the anchor for each frame, so that the anchor can be smoothly displayed without flickering.

  Next, a specific example using a microSD card of a mobile terminal as an object will be described. FIG. 8 is a diagram for explaining the link destination display. The example shown in FIG. 8 is an example of a moving image for explaining an operation of attaching a microSD card of a mobile terminal. In the example shown in FIG. 8, an anchor is set in the microSD card.

  The screen d21 is a screen that displays a mobile terminal to which a microSD card is attached. The reproduction control unit 15 reads the target moving image from the moving image data storage unit 13, reads the anchor information from the link definition storage unit 12, and reproduces the image on the screen d21. At this time, no anchor is set on the screen d21.

  The screen d22 is a screen on which a hand holding a microSD card is displayed and an anchor is superimposed on the microSD card. When the frame indicated by the frame identifier included in the anchor information is reproduced, the drawing unit 151 draws the anchor on the frame. The screen on which the anchor is drawn is the screen d22.

  The screen d23 is a screen in which the microSD card is attached to the mobile terminal. At this time, it is assumed that the anchor an23 in the image on the screen d23 is selected. The anchor an23 is drawn following the microSD during moving image reproduction.

  At this time, for the frames in which the anchor information is not stored, the anchors are continuously displayed by interpolation calculation (for example, linear interpolation of coordinates). Anchor selection can be detected by clicking with the mouse or pressing on the touch panel.

  The screen d24 is a screen on which one frame of the linked video associated with the anchor is displayed. When notified that the anchor an23 has been selected, the link content playback unit 152 links to the link destination information included in the anchor information, and plays back the link destination video. On the screen d24, the attachment position of the microSD is enlarged and displayed.

  As a result, the anchor can be continuously displayed even for frames in which the anchor information is not stored, and when the anchor is selected, the linked video can be reproduced by moving to the link destination. .

<Operation>
Next, the operation of the information processing apparatus 1 will be described. FIG. 9 is a flowchart illustrating an example of the anchor setting process. In step S101 illustrated in FIG. 9, the anchor information generation unit 10 reads and acquires the target moving image from the moving image data storage unit 13. Here, the anchor information generation unit 10 plays or frames the target moving image and waits for the designation of the object for setting the anchor.

  In step S <b> 102, the setting unit 111 receives from the operation unit 11 designation of an object for which the user wants to set an anchor. At this time, the setting unit 111 identifies the start frame in which the position coordinates and anchors of the object are set. For example, in the case of designation as in the screen d12 shown in FIG. 5, the position coordinates of the object are the center coordinates of the anchor.

  In step S103, the extraction unit 112 performs image recognition and extracts object coordinates for each frame after the start frame in the moving image. For example, the extraction unit 112 extracts an object area by edge extraction or the like, and sets the center coordinates of the object area as object coordinates.

  In step S <b> 104, the determination unit 113 identifies a frame in which anchor information is to be stored based on the amount of movement of object coordinates between the current frame and other past frames different from the current frame. The process of step S104 will be described later with reference to FIG.

  In step S105, the anchor information generation unit 10 additionally sets an attribute of anchor information. The attribute of the anchor information is, for example, a link destination, a display attribute, a name, or the like.

  In step S106, the generation unit 114 stores the frame identifier and anchor position information of the frame specified as the storage target in the link definition storage unit 12 as anchor information.

  In step S107, the anchor information editing unit 14 previews the set anchor and determines whether or not a position change request is notified from the operation unit 11. If there is a position change request (step S107—YES), the process proceeds to step S108, and if there is no position change request (step S107—NO), the process is terminated.

  In step S108, the changing unit 142 edits the anchor position information. For example, the changing unit 142 acquires the frame identifier of the frame to be edited and the anchor position information after editing, and uses the anchor position information of the frame to be edited stored in the link definition storage unit 12 as the anchor position after editing. Change to information.

  Next, the process of step S104 will be described in detail. FIG. 10 is a flowchart illustrating an example of an anchor information generation process. In step S201 illustrated in FIG. 10, the generation unit 114 sets the start frame as the current frame and specific data. The current frame is a frame that serves as a reference for determination. The specific data is data to be stored in the link definition storage unit 12.

  In step S202, the determination unit 113 increments the current frame. By incrementing, the current frame becomes the next frame in display time order.

  In step S203, the determination unit 113 sets the object coordinates of the current frame and the previous frame as comparison targets. The previous frame is, for example, a frame immediately before the current frame.

  In step S204, the determination unit 113 determines whether or not the absolute value of the movement amount indicating the difference between the object coordinates is equal to or greater than a predetermined value (object size). Hereinafter, the movement amount indicating the difference between the object coordinates is also referred to as an object movement amount. If the absolute value of the object movement amount is equal to or larger than the object size (step S204—YES), the process proceeds to step S206. If the absolute value of the object movement amount is less than the object size (step S204—NO), the process proceeds to step S205. Note that the absolute value of the object movement amount being equal to or larger than the object size means a case where the object has moved so that the object areas do not overlap between frames.

  In step S205, the determination unit 113 determines whether or not the absolute value of the object movement amount is equal to or greater than a predetermined value (anchor size). If the absolute value of the object movement amount is greater than or equal to the anchor size (step S205—YES), the process proceeds to step S206. If the absolute value of the object movement amount is less than the anchor size (step S205—NO), the process proceeds to step S207. Note that the absolute value of the object movement amount being equal to or larger than the anchor size refers to a case where the object has moved more than the vertical, horizontal, or diagonal lines of the anchor between frames.

  The reason for performing the determination in step S205 is that when the object size is large, the determination in step S204 is less likely to be affirmed, so that the current frame is used as the specific data when moving beyond the anchor size.

  In step S206, the generation unit 114 sets the current frame and the previous frame as specific data. Note that when the previous frame has already been specified data, the generation unit 114 sets only the current frame as specified data.

  Note that the processes in steps S204 and S205 are processes for discriminating when the amount of movement between the previous and subsequent frames is large. As a result, it is possible to specify a case where the object has moved greatly instantaneously and use the current frame as the specified data.

  In step S207, the determination unit 113 sets the immediately preceding specific data and the object coordinates of the current frame as comparison targets. The immediately preceding specific data refers to the frame with the last display order (latest) in the specific data.

  In step S208, the determination unit 113 determines whether or not the absolute value of the object movement amount is greater than or equal to a predetermined value (object size). If the absolute value of the object movement amount is greater than or equal to the object size (step S208—YES), the process proceeds to step S211. If the absolute value of the object movement amount is less than the object size (step S208—NO), the process proceeds to step S209.

  In step S209, the determination unit 113 determines whether or not the absolute value of the object movement amount is equal to or greater than a predetermined value (anchor size). If the absolute value of the object movement amount is equal to or larger than the anchor size (step S209—YES), the process proceeds to step S211. If the absolute value of the object movement amount is less than the anchor size (step S209—NO), the process proceeds to step S210.

  Note that the processing in steps S208 and S209 is processing for discriminating when the movement is slowly performed from the frame of the specific data and the movement amount from the object of the specific data is large. As a result, it is possible to specify the case where the object moves slowly and moves a predetermined amount or more from the position of the object of the specific data, and the current frame can be used as the specific data.

  In step S210, the determination unit 113 determines whether or not the frame interval between the immediately preceding specific data and the current frame is greater than or equal to a set reference value (threshold value). The threshold is 3 or 5 seconds, for example, but an appropriate value may be set by experiment or the like. If the frame interval is greater than or equal to the threshold (step S210—YES), the process proceeds to step S211. If the frame interval is less than the threshold (step S210—NO), the process proceeds to step S212.

  The reason for performing the determination in step S210 is to make the current frame specific data at a predetermined interval in order to make the anchor follow the delicate movement of the object.

  In step S211, the generation unit 114 sets the current frame as specific data.

  In step S212, the determination unit 113 determines whether or not the current frame is the last frame. If the current frame is the final frame (step S212—YES), the process proceeds to step S213, and if the current frame is not the final frame (step S212—NO), the process returns to step S202.

  In step S213, the generation unit 114 sets the final frame as specific data. The reason for using the final frame as specific data is that the position of the anchor of the final frame is used for the interpolation calculation.

  With the above processing, the anchor information does not have to be stored in every frame, so that the data amount of the anchor information can be reduced.

  Next, a process for playing back a moving image with an anchor set will be described. FIG. 11 is a flowchart illustrating an example of the moving image reproduction process. In step S301 illustrated in FIG. 11, the reproduction control unit 15 reads the target moving image from the moving image data storage unit 13 and reads anchor information from the link definition storage unit 12.

  In step S302, the reproduction control unit 15 reproduces the read moving image data. In step S303, the drawing unit 151 determines whether to draw an anchor. For example, the drawing unit 151 determines whether a frame between the frame indicated by the first frame identifier and the frame indicated by the last frame identifier included in the anchor information is reproduced. When drawing is performed (step S303—YES), the process proceeds to step S304. When drawing is not performed (step S303—NO), the process returns to step S302.

  In step S304, the drawing unit 151 determines whether there is anchor position information associated with the playback target frame. If there is anchor position information (step S304—YES), the process proceeds to step S305, and if there is no anchor position information (step S304—NO), the process proceeds to step S306.

  In step S305, when the frame indicated by the frame identifier included in the anchor information is reproduced, the drawing unit 151 draws the anchor at the position indicated by the anchor position information in synchronization with the frame of the moving image data or the reproduction time. The anchor is a link icon, for example.

  In step S306, the drawing unit 151 obtains an anchor display position by performing an interpolation operation from anchor position information existing before and after the display target frame. The drawing unit 151 draws by moving the anchor to the obtained position.

  In step S307, the link content reproduction unit 152 determines whether an anchor is selected. If an anchor has been selected (step S307—YES), the process proceeds to step S308, and if no anchor has been selected (step S307—NO), the process proceeds to step S310.

  In step S308, the link content reproduction unit 152 reproduces the link destination video associated with the anchor. The link destination is not necessarily a moving image, and may be a still image or text.

  In step S309, the link content reproduction unit 152 determines whether or not the button for returning from the link destination to the moving image has been pressed. When returning to a moving image (step S309-YES), it returns to step S302, and when not returning to a moving image (step S309-NO), it returns to step S308.

  In step S310, the playback control unit 15 determines whether the target moving image has ended. If the movie ends (step S310—YES), the playback process ends. If the movie does not end (step S310—NO), the process returns to step S302.

  Through the above processing, a moving image with an anchor set can be reproduced. Further, in the process of step S306, for example, an animation drawing process is performed, so that anchor flickering can be prevented.

  As described above, according to the embodiment, it is possible to reduce the data amount of anchor information while facilitating editing of an anchor.

[Modification]
FIG. 12 is a block diagram illustrating an example of hardware of the information processing apparatus. As illustrated in FIG. 12, the information processing apparatus 2 includes a control unit 201, a main storage unit 202, an auxiliary storage unit 203, a drive device 204, a network I / F unit 206, an input unit 207, and a display unit 208. These components are connected to each other via a bus so as to be able to transmit and receive data.

  The control unit 201 is a CPU that controls each device, calculates data, and processes in a computer. The control unit 201 is an arithmetic device that executes a program stored in the main storage unit 202 or the auxiliary storage unit 203. This program is a program for executing the information processing described with reference to FIGS.

  The control unit 201 can realize the information processing described in the embodiment by executing this program.

  The main storage unit 202 is a ROM (Read Only Memory), a RAM (Random Access Memory), or the like, and a storage device that stores or temporarily stores programs and data such as an OS and application software that are basic software executed by the control unit 201. It is.

  The auxiliary storage unit 203 is an HDD (Hard Disk Drive) or the like, and is a storage device that stores data related to application software and the like.

  The drive device 204 reads the program from the recording medium 205, for example, a flexible disk, and installs it in the storage device.

  A predetermined program is stored in the recording medium 205, and the program stored in the recording medium 205 is installed in the information processing apparatus 2 via the drive device 204. The installed predetermined program can be executed by the information processing apparatus 2.

  The network I / F unit 206 has a communication function connected via a network such as a LAN (Local Area Network) or a WAN (Wide Area Network) constructed by a data transmission path such as a wired and / or wireless line. This is an interface between the device and the information processing apparatus 2.

  The input unit 207 includes a keyboard having cursor keys, numeric input, various function keys, and the like, a mouse and a slice pad for performing key selection on the display screen of the display unit 208, and the like. The input unit 207 is a user interface for a user to give an operation instruction to the control unit 201 or input data.

  The display unit 208 is configured by a CRT (Cathode Ray Tube), an LCD (Liquid Crystal Display), or the like, and performs display according to display data input from the control unit 201.

  As described above, the information processing described in the above-described embodiments may be realized as a program for causing a computer to execute. The information processing described above can be realized by installing this program from a server or the like and causing the computer to execute it.

  It is also possible to record the program on the recording medium 205 and cause the computer or portable terminal to read the recording medium 205 on which the program is recorded, thereby realizing the information processing described above. The recording medium 205 is a recording medium that records information optically, electrically, or magnetically, such as a CD-ROM, a flexible disk, or a magneto-optical disk, and information is electrically stored such as a ROM or flash memory. Various types of recording media such as a semiconductor memory for recording can be used. The recording medium does not include a carrier wave. Further, the information processing described in the above-described embodiments may be implemented in one or a plurality of integrated circuits.

  The above-described embodiments and modifications can be applied to, for example, an explanatory commentary document, an operation manual, and an apparatus that creates educational content using moving images.

  Although the embodiments have been described in detail above, the present invention is not limited to the above-described embodiments, and various modifications and changes other than the above-described modifications are possible within the scope described in the claims.

In addition, the following additional notes are disclosed regarding each of the above embodiments.
(Appendix 1)
Accept anchor settings for objects in the images included in the video,
Determining whether the amount of movement between the object in which the anchor in the predetermined image included in the video is set and the target in the other image included in the video is greater than or equal to a predetermined value;
A program for causing a computer to execute a process of storing an identifier of an image to be determined and position information of the anchor in a storage unit when it is determined that the value is equal to or greater than the predetermined value.
(Appendix 2)
When the other image is an image immediately before the predetermined image,
The storing process is:
The program according to claim 1, wherein an identifier of the predetermined image, position information of an anchor in the predetermined image, an identifier of the immediately preceding image, and position information of an anchor in the next image are stored in the storage unit.
(Appendix 3)
When the other image is the latest image among the objects to be stored in the storage unit,
The storing process is:
The program according to appendix 1 or 2, wherein an identifier of the predetermined image and position information of an anchor in the predetermined image are stored in the storage unit.
(Appendix 4)
The determination process is as follows.
It is further determined whether or not an interval between the predetermined image and the latest image is greater than or equal to a threshold value,
The storing process is:
The program according to any one of appendices 1 to 3, wherein when the interval is determined to be greater than or equal to a threshold value, an identifier of the predetermined image and position information of the predetermined image are stored in the storage unit.
(Appendix 5)
When playing the video,
When displaying the image indicated by the identifier stored in the storage unit, the anchor is displayed superimposed on the position indicated by the position information,
When displaying an image other than the image indicated by the identifier stored in the storage unit, among the images indicated by the identifier stored in the storage unit, each corresponding to two images positioned before and after the display target image The program according to any one of appendices 1 to 4, further causing a computer to execute a process of superimposing and displaying the anchor at a position calculated by interpolation based on the position information of the anchor.
(Appendix 6)
A setting unit for setting an anchor for an object in an image included in the video;
A determination unit that determines whether or not a moving amount between the object in which the anchor is set in the predetermined image included in the moving image and the target object in the other image included in the moving image is equal to or larger than a predetermined value. When,
A storage unit that stores an identifier of a determination target image and position information of the anchor when it is determined that the value is equal to or greater than the predetermined value;
An information processing apparatus comprising:
(Appendix 7)
Accept anchor settings for objects in the images included in the video,
Determining whether the amount of movement between the object in which the anchor in the predetermined image included in the video is set and the target in the other image included in the video is greater than or equal to a predetermined value;
An information processing method in which a computer executes a process of storing an identifier of an image to be determined and position information of the anchor in a storage unit when it is determined that the value is equal to or greater than the predetermined value.
(Appendix 8)
Accept anchor settings for objects in the images included in the video,
Determining whether the amount of movement between the object in which the anchor in the predetermined image included in the video is set and the target in the other image included in the video is greater than or equal to a predetermined value;
A computer-readable recording medium storing a program for causing a computer to execute processing for storing an identifier of an image to be determined and position information of the anchor in a storage unit when it is determined that the value is equal to or greater than the predetermined value. recoding media.

DESCRIPTION OF SYMBOLS 1 Information processing apparatus 10 Anchor information production | generation part 11 Operation part 12 Link definition memory | storage part 13 Movie data memory | storage part 14 Anchor information editing part 15 Playback control part 16 Display part 111 Setting part 112 Extraction part 113 Determination part 114 Generation part 141 Editing part 142 Change unit 151 Drawing unit 152 Link content playback unit 201 Control unit

Claims (6)

Accept anchor settings for objects in the images included in the video,
Determining whether the amount of movement between the object in which the anchor in the predetermined image included in the video is set and the target in the other image included in the video is greater than or equal to a predetermined value;
When it is determined that the value is equal to or greater than the predetermined value, the computer executes a process of storing the identifier of the determination target image and the position information of the anchor in a storage unit ,
When the other image is the latest image among the objects to be stored in the storage unit,
The storing process is:
The program which memorize | stores the identifier of the said predetermined image, and the positional information on the anchor in the said predetermined image in the said memory | storage part . Accept anchor settings for objects in the images included in the video,
Determining whether the amount of movement between the object in which the anchor in the predetermined image included in the video is set and the target in the other image included in the video is greater than or equal to a predetermined value;
When it is determined that the value is equal to or greater than the predetermined value, the computer executes a process of storing the identifier of the determination target image and the position information of the anchor in a storage unit ,
The determination process is as follows:
It is further determined whether or not an interval between the predetermined image and the latest image in the storage target for the storage unit is greater than or equal to a threshold value,
The storing process is:
The program which memorize | stores the identifier of the said predetermined image, and the positional information on the said predetermined image in the said memory | storage part, when it determines with the said space | interval being more than a threshold value . When the other image is an image immediately before the predetermined image,
The storing process is:
An identifier of the predetermined image, and position information of the anchor within the predetermined image, an identifier of the immediately preceding image, and position information of the anchor in the next image of claim 1, wherein stored in the storage unit program. When playing the video,
When displaying the image indicated by the identifier stored in the storage unit, the anchor is displayed superimposed on the position indicated by the position information,
When displaying an image other than the image indicated by the identifier stored in the storage unit, among the images indicated by the identifier stored in the storage unit, each corresponding to two images positioned before and after the display target image The program according to any one of claims 1 to 3 , further causing a computer to execute a process of superimposing and displaying the anchor at a position calculated by interpolation based on the position information of the anchor. A setting unit for setting an anchor for an object in an image included in the video;
A determination unit that determines whether or not a moving amount between the object in which the anchor is set in the predetermined image included in the moving image and the target object in the other image included in the moving image is equal to or larger than a predetermined value. When,
A storage unit that stores an identifier of a determination target image and position information of the anchor when it is determined that the value is equal to or greater than the predetermined value;
Equipped with a,
When the other image is the latest image among the objects to be stored in the storage unit,
The storage unit
An information processing apparatus that stores an identifier of the predetermined image and position information of an anchor in the predetermined image . Accept anchor settings for objects in the images included in the video,
Determining whether the amount of movement between the object in which the anchor in the predetermined image included in the video is set and the target in the other image included in the video is greater than or equal to a predetermined value;
When it is determined that the value is equal to or greater than the predetermined value, the computer executes a process of storing the identifier of the image to be determined and the position information of the anchor in a storage unit ,
When the other image is the latest image among the objects to be stored in the storage unit,
The storing process is:
The information processing method which memorize | stores the identifier of the said predetermined image, and the positional information on the anchor in the said predetermined image in the said memory | storage part .

Images