WO2019012783A1

WO2019012783A1 - Program, method, and device for assisting with document creation

Info

Publication number: WO2019012783A1
Application number: PCT/JP2018/016954
Authority: WO
Inventors: 悟史鈴木; 吉田　健一; 雷太平山; 歩渡邉; 弓子原口
Original assignee: 株式会社スタディスト
Priority date: 2017-07-11
Filing date: 2018-04-26
Publication date: 2019-01-17
Also published as: JP6472062B2; JP2019020789A

Abstract

An objective of the present invention is to provide a program to enable easy creation of all images (whether still images or video) needed to create a document. Provided is a program for assisting with document creation, the program being executed on a user device used by a user. The user device comprises a processor unit for controlling an operation of the user device. The program causes the processor unit to perform at least: identification of one video; identification of either one or more still images to be clipped out of said video or one or more partial videos to be clipped out of said video; and creating a document using either the said identified still images or the said identified partial videos.

Description

Program, method and apparatus for supporting document creation

The present invention relates to a program, method and apparatus for supporting the creation of a document.

Conventionally, a document (for example, an electronic manual) utilizing an image has been known (see, for example, Non-Patent Document 1).

Although it is possible to make a document easy to understand by using many images, generally it takes a lot of effort to prepare many images.

The inventor considered it important to be able to easily create all the images (whether still or moving) necessary for a document (e.g. an electronic manual).

The present invention provides a program, method and apparatus that make it possible to easily create all the images (whether still or moving images) necessary for creating a document (for example, an electronic manual). The purpose is to

In one aspect of the present invention, a program of the present invention is a program for supporting the creation of a document, wherein the program is executed in a user device used by a user, and the user device is a device of the user device. A processor unit for controlling the operation, the program specifying one moving image, and one or more still images to be cut out from the one moving image or one or more portions to be cut out from the one moving image Causing the processor unit to at least execute identifying a moving image and creating a document using the identified one or more still images or the identified one or more partial animations .

In one embodiment of the present invention, each of the one or more still images or the one or more partial moving images may be identified in association with temporal information.

In one embodiment of the present invention, the program causes the processor unit to further execute switching between a still image cutout mode and a partial moving image cutout mode, and in the still image cutout mode, the one moving image One or more still images to be clipped out of the video may be specified, and in the partial moving image cutout mode, one or more partial moving images to be cut out from the one moving image may be specified.

In one embodiment of the present invention, each of the one or more still images or the one or more partial moving images may be identified in response to an input from the user to the user device.

In one embodiment of the present invention, the program causes the processor unit to further execute detecting a temporal change of an image displayed by playing back the specified one moving image. Each of the one or more still images or the one or more partial moving images may be identified in response to detecting a temporal change of the video.

In one embodiment of the invention, the document may be an electronic manual.

In one embodiment of the present invention, each of the one or more still images or the one or more partial moving images is identified in association with temporal information, and the program is configured to perform a plurality of tasks of the electronic manual. The processor unit is further caused to perform generating steps, and the plurality of working steps of the electronic manual include one or more still images or one or more partial moving pictures in respective time It may be generated in a state associated with a plurality of work steps of the electronic manual according to a temporal order defined by information.

In one aspect of the present invention, the method of the present invention is a method for supporting the creation of a document, the method comprising: identifying one moving image; and one to be extracted from the one moving image Identifying one or more partial videos to be cut out from the one or more still images, and using the one or more still images identified or the one or more partial videos identified. Creating a document.

In one aspect of the present invention, the device of the present invention is a device for supporting the creation of a document, said device comprising: means for identifying one moving image; and one to be extracted from said one moving image Means for identifying one or more partial videos to be extracted from the above still images or the one moving image, and using the one or more still images identified or the one or more partial videos identified And means for producing the document.

According to the present invention, a program, method and apparatus that make it possible to easily create all images (whether still or moving images) necessary for creating a document (for example, an electronic manual) It is possible to provide

A diagram showing an example of a screen 100 displayed on a user device A diagram showing an example of a screen 110 displayed on a user device A diagram showing an example of a screen 120 displayed on a user device A diagram showing an example of a screen 130 displayed on a user device A diagram showing an example of a screen 140 displayed on a user device A diagram showing an example of a screen 150 displayed on a user device A diagram showing an example of a screen 160 displayed on a user device A diagram showing an example of a screen 170 displayed on a user device A diagram showing an example of a screen 180 displayed on a user device The figure which shows an example of processing of the program in "still picture extraction mode" The figure which shows an example of processing of the program in "partial animation cutout mode" A diagram showing an example of hierarchical data 300 of a document A diagram showing another example of the document hierarchical data 300 ' Diagram showing an example of the configuration of a system 400 for realizing supporting creation of a document

Hereinafter, definitions of terms used in the present specification will be described.

"Moving image" refers to a moving image, or more precisely, an image that appears to move using the illusion of human vision by rapidly switching between continuously changing still images.

"Still image" refers to an image that does not move. The "still image" is also a component of the "moving image".

"Partial moving image" refers to a specific part of "moving image" that is a moving image. Therefore, "partial animation" is also a component constituting "animation".

“Cut out one or more still images from one moving image” refers to extracting one or more still images from a plurality of still images included in one moving image from one moving image.

“Cut out one or more partial videos from one video” means to extract a part of one video from one video.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

1. A transition diagram 1A of the screen displayed on the user device shows an example of the screen 100 displayed on the user device. The screen 100 is an initial screen when creating a document (for example, an electronic manual) using an image (still image and / or moving image) using the program of the present invention. It is assumed that the program of the present invention is installed in advance in this user device.

In the example shown in FIG. 1A, the screen 100 displays a representative image area 101 in which a representative image of the document is displayed, a title explanation area 102 in which a title and an explanation of the document are displayed, and each step. And a step area 103. In the example shown in FIG. 1A, since the screen 100 is an initial screen, the step area 103 includes an empty step 104 described as “addition of new step”. The user can add one or more new steps to the step area 103 by selecting (e.g., tapping) the empty step 104.

FIG. 1B shows an example of a screen 110 displayed on the user device. The screen 110 is an example of a screen transitioning from the screen 100 shown in FIG. 1A when the empty step 104 in the screen 100 shown in FIG. 1A is selected by the user.

In the screen 110, the user can select to use a still image or an animation at each step to add a new step. In addition, when the user chooses to use a moving image, the user can further select whether to cut out a still image or a partial moving image from the one moving image. In the example shown in FIG. 1B, on the screen 110, the user selects an item "select a still image", an item "shoot a still image from now", an item "select a moving image (still image cutout)", an item "moving image It is possible to select one of the items “shoot moving image from now (still image cutting)” and the item “shoot moving image from now (partial moving image cutout)”.

When the user selects the item "select a still image" on the screen 110, a list of still image data stored in the memory unit of the user device may be displayed. In the case where the user selects the item “shoot still image from now”, the item “shoot video from now (still image clipping)” or the item “shoot video from now (partial video clipping)” on the screen 110 The camera mounted on the user device can be activated. When the user selects the item “select a moving image (still image cutout)” or the item “select a moving image (partial moving image cutout)” on the screen 110, it is stored in the memory unit of the user device A list of video data may be displayed. When the user selects one of the moving image data lists, a screen as shown in FIG. 1C or 1F described later is displayed.

In the example illustrated in FIG. 1B, items for specifying a still image or a moving image are displayed on the screen 110, but the present invention is not limited to this. For example, items for generating a step may be displayed without selecting a still image and a moving image. This allows the user, for example, to generate steps that include only text, without using still or moving images.

FIG. 1C shows an example of the screen 120 displayed on the user device. The screen 120 is an example of a screen transitioning from the screen 110 shown in FIG. 1B when the item “select moving image (still image cutout)” in the screen 110 shown in FIG. 1B is selected by the user. The screen 120 is used to cut out one or more still images from one moving image when one moving image is selected.

In the example shown in FIG. 1C, the screen 120 includes a moving image preview area 121 capable of displaying and reproducing one selected moving image, and a cutout button 122 for cutting out the one moving image at a predetermined timing, A timeline area 123 that facilitates specification of the cutout position of the one moving image (for example, time information in the moving image from which the one moving image is cut out), and a thumbnail of the cutout still image for each cutout still image And a completion button 125 for completing the clipping operation. The timeline area 123 includes an indicator 126 for indicating the cutout position of the moving picture, a reproduction button 127 for reproducing the moving picture displayed in the moving picture preview area 121, and a predetermined time (for example, 1/60 seconds, 1/30) A fast forward button 128 and a rewind button 129 for skipping by 1 second, 1/10 second, 1 second, 3 seconds, 5 seconds, 10 seconds) are included.

In the moving image preview area 121, the moving image is displayed in a state of being paused in the time information in the moving image corresponding to the position of the indicator 126 in the timeline area 123. The indicator 126 in the timeline area 123 is fixed substantially at the center in the left-right direction of the timeline area 123. In the timeline area 123, a part or all of a series of strip-shaped thumbnails in which thumbnails of a plurality of still images included in a moving image are continuously displayed. The user can slide a series of strip thumbnails on the timeline area 123 by swipe operation in the left and right direction.

The user moves the series of strip-shaped thumbnails in the left-right direction so that the position at which the still image is to be cut out from the moving image overlaps the position of the indicator 126 (that is, the substantially horizontal position of the timeline area 123 in the left-right direction). The user can, for example, move the series of strip thumbnails widely by swipe operation, and then move the series of strip thumbnails small by selecting the fast forward button 128 or the rewind button 129. Thereby, the user can efficiently move the position where the user wants to cut out the still image from the moving image to the position of the indicator 126. In addition, the user can move the series of strip-like thumbnails small by selecting the play button 127, thereby identifying the position at which the still image is to be cut out while confirming the moving image being played. Is possible. When the play button 127 is selected, the play button 127 changes to a pause button for pausing the moving image being played. When the pause button is selected, the pause button changes to the play button 127 again.

The user moves the series of strip-shaped thumbnails by a desired amount as described above to move the position where the still image is to be cut out from the moving image to the position of the indicator 126, and then selects the cut-out button 122. Thereby, the still image corresponding to the position of the indicator 126 is cut out. The cut out still image is displayed in the cut out image display area 124. When the user selects the completion button 125, the above-described still image clipping operation is completed.

FIG. 1D shows an example of a screen 130 displayed on the user device. The screen 130 is an example of the screen after the user has performed the still image cutting operation three times on the screen 120 illustrated in FIG. 1C.

In the example shown in FIG. 1D, still image 1 in time information “0:11” in the moving image and still image 2 in time information “0:42” in the moving image and still information in time information “1:30” in the moving image The image 3 is displayed in the cutout image display area 124. The still image 1 is a still image cut out from one moving image by the user selecting the cutout button 122 at the time information “0:11” in the moving image. The still image 2 is a still image cut out from one moving image by the user selecting the cut-out button 122 at the time information “0: 42” in the moving image. The still image 3 is a still image cut out from one moving image by the user selecting the cutout button 122 at the time information “1:30” in the moving image.

As described above, by displaying the still image clipped from one moving image in the cut-out image display area 124, the user can cope with the number of still images clipped already from one moving image and the already cut-out still images. It is possible to visually recognize the time information in the moving image.

FIG. 1E shows an example of a screen 140 displayed on the user device. The screen 140 is an example of a screen transitioning from the screen 130 when the user selects the completion button 125 on the screen 130 shown in FIG. 1D.

In the example shown in FIG. 1E, the step 141 corresponding to the still picture 1 in the time information “0:11” in the moving picture, and the step 142 corresponding to the still picture 2 in the time information “0:42” in the moving picture Step 143 corresponding to the still image 3 in the time information “1:30” in the moving image, and empty step 104 described as “addition of new step” are shown in the step area 103. This is because three still images (still image 1, still image 2, and still image 3) have been cut out on the screen 130 shown in FIG. 1D. In the example shown in FIG. 1E, steps 141, 142, and 143 are shown in ascending order according to the temporal order defined by the time information in the respective moving pictures. Each step (ie, step 141, step 142, step 143) includes a thumbnail of the still image of each step, an input field for the title of each step, and an input field for the description of each step.

The number of steps displayed in the step area 103 in the screen 140 shown in FIG. 1E changes in accordance with the number of still images cut out in the screen 130 shown in FIG. 1D. For example, the number of steps displayed in the step area 103 in the screen 140 shown in FIG. 1E may be the same as the number of still images cut out in the screen 130 shown in FIG. 1D. In addition, the user can switch the order of the steps in the step area 103.

When the user selects the empty step 104 on the screen 140 shown in FIG. 1E, the screen transitions to the screen 110 shown in FIG. 1B again. This allows the user to add one or more steps to the step area 103 in the screen 110 shown in FIG. 1B. Therefore, the user can select an item displayed on the screen 110 on the screen 110.

FIG. 1F shows an example of a screen 150 displayed on the user device. The screen 150 is an example of a screen transitioning from the screen 110 shown in FIG. 1B when the item “select moving image (partial moving image cutout)” in the screen 110 shown in FIG. 1B is selected by the user. The screen 150 is used to cut out a partial moving image from one moving image when one moving image is selected.

In the example shown in FIG. 1F, the screen 150 includes the moving image preview area 121, the timeline area 123, the cut-out image display area 124, and the completion button 125 similarly to the screen 120 shown in FIG. 1C. The line area 123 includes an indicator 126, a play button 127, a fast forward button 128 and a rewind button 129. Unlike the screen 120 shown in FIG. 1C, the screen 150 includes a cutout start button 151 for specifying the timing of cutout start. The user can specify the start time of the partial moving image to be cut out from one moving image by selecting the cut-out start button 151. The start time of the partial moving image is specified to correspond to the position of the indicator 126 when the cutout start button 151 is selected.

FIG. 1G shows an example of a screen 160 displayed on the user device. The screen 160 is an example of a screen immediately after the user selects the cutout start button 151 on the screen 150 shown in FIG. 1F. In the example shown in FIG. 1G, the screen 160 includes a cutout end button 161 for specifying the timing of the cutout end.

When the user selects the cutout start button 151, the cutout start button 151 changes to the cutout end button 161. This allows the user to specify the end time of the partial moving image to be cut out next. The end time of the partial moving image is specified to correspond to the position of the indicator 126 when the cutout end button 161 is selected, similarly to the start time of the partial moving image.

FIG. 1H shows an example of a screen 170 displayed on the user device. The screen 170 is an example of a screen immediately after the user selects the cutout end button 161 after a certain amount of time has elapsed from the screen 160 shown in FIG. 1G. That is, the screen 170 is an example of the screen after the user has performed the cutout operation of the partial moving image described with reference to FIGS. 1F and 1G once.

In the example shown in FIG. 1H, the partial moving image 1 in the time information “1:02” to “1:15” in the moving image is displayed in the cutout image display area 124.

As described above, by displaying the partial moving image cut out from one moving image in the cutout image display area 124, the user can cope with the number of partial moving images already cut out from one moving image and the partial moving image already cut out. It is possible to visually recognize the time information in the moving image.

FIG. 1I shows an example of a screen 180 displayed on the user device. The screen 180 is an example of a screen transitioning from the screen 170 when the user selects the completion button 125 on the screen 170 shown in FIG. 1H.

In the example shown in FIG. 1I, the partial moving picture 1 in the time information “1:02” to “1:15” in the moving picture is shown for the steps 141 to 143 and the empty step 104 shown on the screen 140 shown in FIG. A corresponding step 181 is added and shown in step area 103. In the example shown in FIG. 1I, steps 141, 142, 181 and 143 are shown in ascending order according to the temporal order defined by the time information in the respective moving pictures. Each step (ie, step 141, step 142, step 181, step 143) includes a thumbnail of the still image of each step, an input field for the title of each step, and an input field for the description of each step.

In this way, the user does so by identifying one animation and by identifying one or more still images and / or one or more partial animations to be clipped out of the identified one animation. The document is created utilizing one or more still images identified and / or one or more partial animations. Here, the mode of use does not matter. For example, even if one or more still images and / or one or more partial moving images included in one moving image are replicated, and one or more still images and / or one or more partial moving images are used. One or more still images and / or one or more parts included in one moving image by pointing at one or more still images and / or one or more partial videos included in one moving image with a pointer. You may use a video. In this way, if the user takes a single moving image, the user is not required to retake one or more still images and / or one or more partial moving images separately from the single moving image already taken. It is possible to easily create a document by using one or more still images and / or partial moving images cut out from a moving image of a book.

Furthermore, when creating a document such as an electronic manual having a plurality of work steps, one or more still images and / or one or more partial moving images are temporally defined by respective temporal information. The plurality of work steps of the electronic manual are generated in association with the plurality of work steps of the electronic manual (for example, in ascending order of time) according to the order. Thereby, it is possible to easily create a plurality of work steps of the electronic manual using one or more still images and / or partial moving images cut out from one moving image.

Furthermore, since it is possible to create a document (for example, an electronic manual) using a single device, the document can be compared to the case of creating a document (for example, an electronic manual) using a plurality of devices. It is possible to easily create (for example, an electronic manual).

In the embodiment described above, when the user selects the item “select moving image (still image cutout)” on the screen 110 shown in FIG. 1B, the “still image cutout mode” is entered, and the user selects the item Although an example in case of entering into "partial animation cutout mode" by selecting (selecting (partial animation cutout)) is described, the present invention is not limited to this. For example, in the screen 120 shown in FIG. 1C, the "still image cutout mode" and the "partial moving image cutout mode" are switched on the screen 120 by further arranging the cutout start button 151 in addition to the cutout button 122. May be possible.

Further, in the embodiment described above, the case where the cutout position of the still image or the partial moving image is specified by sliding a series of strip-shaped thumbnails has been described, but the present invention is not limited to this. For example, the cutout position of the still image or the partial moving image may be specified by moving the indicator 126 in the timeline area 123 in the left-right direction. More specifically, the indicator 126 in the timeline area 123 can be freely moved horizontally in the horizontal direction by the user's swipe operation in the horizontal direction on the timeline area 123, and the fast forward button 128 or the rewind button by the user It may be movable to a position skipped by a predetermined time by the selection of 129, and may be movable to the right according to the reproduction speed of the moving image by the selection of the reproduction button 127 by the user. In this case, the moving image displayed in the moving image preview area 121 can be switched in accordance with the horizontal movement of the indicator 126 in the timeline area 123.

When the user specifies the cutout position of a still image or a partial moving image by moving the indicator 126 in the timeline area 123 in the left and right direction, the user stops the indicator 126 in the timeline area 123 from the moving image in the left and right direction. Move to the position where you want to cut out the picture. The user can move the indicator 126 large by, for example, swiping, and then move the indicator 126 small by selecting the fast forward button 128 or the rewind button 129. Thereby, the user can efficiently move the indicator 126 to a position where he wants to cut out a still image from the moving image. In addition, the user can move the indicator 126 small by selecting the play button 127. This allows the user to specify the position at which the still image is to be cut out while confirming the moving image being played. It is.

2. Processing of Program in User Device FIG. 2A shows an example of processing of a program in the “still image cutout mode” described above. Note that this program is installed in the user device. Each step shown in FIG. 2A will be described in detail below.

Step S201: One animation is specified. There is no limitation on how to identify one moving image. For example, identifying one animation may be accomplished by input from a user who can identify the one animation, or using information to identify the one animation It may be done.

Step S202: It is determined whether the cutout button 122 is selected. If the determination result is "Yes", the process proceeds to step S203. If the determination result is "No", the process returns to step S202. Selection of the cutout button 122 is achieved by, for example, input from a user.

Step S203: Time information (that is, extraction time information) in the moving image corresponding to the position of the indicator 126 on the timeline area 123 when the extraction button 122 is selected is specified.

Step S204: Based on the time information in the identified moving image, a still image to be extracted from the identified one moving image is identified. Therefore, the still image is identified in association with time information in the moving image corresponding to the position of the indicator 126 on the timeline area 123 when the cutout button 122 is selected.

Step S205: It is determined whether the cutout button 122 is further selected. If the determination result is "Yes", the process returns to step S203, and if the determination result is "No", the process proceeds to step S206.

Step S206: It is determined whether the completion button 125 has been selected. If the determination result is "Yes", the process proceeds to step S207. If the determination result is "No", the process returns to step S205.

Step S207: A document having steps is created for each of one or more specified still images. For example, an electronic manual having work steps is created for each of one or more specified still images.

In the embodiment described above, the case where the specification of the still image to be cut out from one moving image is performed according to the input from the user has been described, but the present invention is not limited to this. For example, the program causes the user device to detect a temporal change of the displayed video by playing back one specified moving image, and responds to the detection of the temporal change of the video. Then, one or more still images may be specified. This makes it possible to automatically cut out a still image without requiring user action.

FIG. 2B illustrates an example of processing of a program in the “partial moving image cutout mode” described above. Note that this program is installed in the user device. Each step shown in FIG. 2B will be described in detail below.

Step S201 ': One animation is specified. There is no limitation on how to identify one moving image. For example, identifying one animation may be accomplished by input from a user who can identify the one animation, or using information to identify the one animation It may be done.

Step S202 ': It is determined whether the cutout start button 151 has been selected. If the determination result is "Yes", the process proceeds to step S203 ', and if the determination result is "No", the process returns to step S202'. Selection of the cutout start button 151 is achieved by, for example, input from the user.

Step S203 ': Time information (that is, extraction start time information) in the moving image corresponding to the position of the indicator 126 on the timeline area 123 when the extraction start button 151 is selected is specified.

Step S204 ': It is determined whether the cutout end button 161 has been selected. If the determination result is "Yes", the process proceeds to step S205 ', and if the determination result is "No", the process returns to step S204'. Selection of the cutout end button 161 is achieved by, for example, input from the user.

Step S205 ': The time information (that is, extraction end time information) in the moving image corresponding to the position of the indicator 126 on the timeline area 123 when the extraction end button 161 is selected is specified.

Step S206 ': The partial moving image to be cut out from the specified one moving image is specified based on the specified cutting start time and the cut-out end time. Therefore, this partial moving image has time information in the moving image corresponding to the position of the indicator 126 on the timeline area 123 when the cutout start button 151 is selected, and a timeline area when the cutout end button 161 is selected. It is specified in a state associated with time information in the moving image corresponding to the position of the indicator 126 on 123.

Step S207 ': It is determined whether the cutout start button 151 is further selected. If the determination result is "Yes", the process returns to step S203 '. If the determination result is "No", the process proceeds to step S208'.

Step S208 ': It is determined whether the completion button 125 is selected. If the determination result is "Yes", the process proceeds to step S209 ', and if the determination result is "No", the process returns to step S207'.

Step S209 ': A document having steps is created for each of the identified one or more partial moving images. For example, an electronic manual having a work step is created for each of the specified one or more partial moving images.

In the embodiment described above, the case where specification of a partial moving image to be cut out from one moving image is performed according to an input from a user has been described, but the present invention is not limited to this. For example, the program causes the user device to detect a temporal change of the displayed video by playing back one specified moving image, and responds to the detection of the temporal change of the video. Then, one or more partial moving images may be specified. This makes it possible to cut out a partial moving image automatically without requiring user action.

3. Hierarchical Data of Created Document FIG. 3A shows an example of hierarchical data 300 of a document. At the same time as the document is created as described above, hierarchical data 300 of the document is also created.

In the example shown in FIG. 3A, the document hierarchical data 300 is identified by a family ID uniquely assigned to a family ("family") 310 representing the document. Here, the family ("family") 310 is used to manage update information, the number of views, authority information, etc. of the entire document.

In the example shown in FIG. 3A, the hierarchical data 300 of the document has content data for editing (“content”) 320 as a lower structure of the family (“family”) 310. Content data 320 for editing is data used to edit a document.

The hierarchical data 300 of the document is, as a lower structure of the content data 320 for editing, an image ("image") 320a of a thumbnail of the document, a moving image ("video") 320b, an audio ("audio") 320c, and a link (" link ") 320d and document step (" step ") 320e. Here, for the link ("link") 320d, it is possible to define a plurality of links ("link") 320d, and for the document step ("step") 320e, a plurality of document steps It is possible to define ("step") 320e.

The hierarchical data 300 of the document is, as a lower structure of the document step ("step") 320e, an image ("image") 320sa for the document step, a moving image ("video") 320sb, and an audio ("audio") 320sc. , Link ("link") 320sd.

FIG. 3B shows another example of the document hierarchical data 300 '.

When the user completes creation and editing of the document, the user sends the document to the server device using the user device for the purpose of disclosing the document. When the server device receives the document from the user device, the server device duplicates the lower structure of the family (“family”) 310 to generate content data (“content”) 330 for disclosure. The content data 330 for publication is data for publishing a document.

The hierarchical data 300 ′ of the document has the same structure as the lower structure of the content data 320 for editing as the lower structure of the content data 330 for publication.

A family ("family") 340 that controls the steps ("step") 320e of the document under the content data 320 for editing and the steps ("step") 330e of the document under the content data 330 for release Is defined. Here, a family ("family") 340 is used to manage update information of the steps of the document.

As described above, the hierarchical data 300 'of the document always includes the content data for editing and the content data for publication in a double format. Thus, it is possible to edit the content data for editing in parallel with publishing the content data for publication on the same document. Further, it is possible to prevent the content data for editing and the content data for disclosure from being separated and dissipated in the same electronic document.

The image (“image”) 320 a and the moving image (“video”) 320 b indicate information indicating the location of the still image and information indicating the location of the moving image, respectively. An example of such information indicating the location is a URL (Uniform Resource Locator), but is not limited thereto. The same applies to the other images shown in FIG. 3A and FIG. In addition, text data related to a still image or a moving image is included in the still image or the moving image. The same applies to the image ("image") 330a and the moving image ("video") 330b.

4. System Configuration FIG. 4 shows an example of the configuration of a system 400 for implementing supporting document creation.

In the example shown in FIG. 4, the system 400 comprises a server device 430 configured to be able to communicate with one or more user devices 410 and each user device 410 via the Internet 420, and a server And a database unit 440 connected to the device 430.

In the example shown in FIG. 4, each of the one or more user devices 410 includes an interface unit 411, a processor unit 412 including one or more CPUs, a memory unit 413, and an input unit 414 such as a cursor key. And an input unit and display unit 415 such as a touch panel display. Each of the one or more user devices 410 may be, for example, a portable wireless terminal such as a mobile phone, a smartphone, a tablet terminal, a smart glass, a smart watch terminal, etc., and a desktop PC, laptop PC, notebook PC, etc. It may be a personal computer.

In the user device 410, in addition to a basic program such as an operation system (OS), an application program (client application program) required to support the creation of a document is installed. Alternatively, the user device 410 can use a web browser embedded program or additional program. In this case, the user device 410 can use the service on the web browser without installing the application program.

The interface unit 411 controls communication with the server device 430.

The memory unit 413 stores a program required to execute processing and data required to execute the program. For example, a program for realizing the processing shown in FIGS. 2A and 2B is stored. Here, it does not matter how the program is stored in the memory unit 413. For example, the program may be preinstalled in the memory unit 413. Alternatively, the program may be installed in the memory unit 413 by being downloaded via a network such as the Internet 420, or installed in the memory unit 413 via a storage medium such as an optical disk or USB. You may do so.

The processor unit 412 controls the overall operation of the user device 410. The processor unit 412 reads a program stored in the memory unit 413 and executes the program. This allows the user device 410 to function as a device that forms part of the system 400.

The server apparatus 430 is, for example, a workstation or a personal computer, and has a general hardware configuration as a server apparatus. In the example illustrated in FIG. 4, the server device 430 includes an interface unit 431, a processor unit 432 including one or more CPUs (Central Processing Units), and a memory unit 433. The hardware configuration of the server apparatus 430 is not particularly limited as long as the function can be realized, and may be configured by a single machine, or may be configured by combining a plurality of machines.

In the server device 430, in addition to a basic program such as an operation system (OS), various kinds of software necessary to support the creation of a document are installed. The software installed in the server apparatus 430 is, for example, software installed in a database server, a web server, an FTP server, or the like.

The interface unit 431 controls communication with one or more user devices 410.

The memory unit 433 stores a program required to execute processing and data required to execute the program. Here, it does not matter how the program is stored in the memory unit 433. For example, the program may be preinstalled in the memory unit 433. Alternatively, the program may be installed in the memory unit 433 by being downloaded via a network such as the Internet 420, or may be installed in the memory unit 433 via a storage medium such as an optical disk or USB. You may do so.

The processor unit 432 controls the overall operation of the server apparatus 430. The processor unit 432 reads a program stored in the memory unit 433 and executes the program. Thus, the server apparatus 430 can function as an apparatus that constitutes a part of the system 400.

In the database unit 440, for example, document data transmitted from the user device and hierarchical data of the document shown in FIG. 3B are stored. The database unit 440 may be built in the server device 430 or may be provided outside the server device 430. It is sufficient that the database unit 440 is connected to the server device 430, and it does not matter whether it is wireless connection or wired connection.

At least part of the processing of the program described with reference to FIGS. 2A and 2B may be executed in the server device. For example, one moving image is transmitted from the user device 410 to the server device 430 via the network, and one or more extraction time information, and / or one or more extraction start time information and extraction end time information are transmitted to the user device 410. , And one or more still images and / or one or more partial moving pictures are identified in the server device 430, and one or more still images and / or one in the server device 430. A document having steps may be created for each of the partial moving images described above.

As mentioned above, although the present invention is illustrated using a preferred embodiment of the present invention, the present invention should not be construed as being limited to this embodiment. It is understood that the scope of the present invention should be interpreted only by the claims. It is understood that those skilled in the art can implement the equivalent scope based on the description of the present invention and common technical knowledge, from the description of the specific preferred embodiments of the present invention.

The present invention provides a program, method, apparatus and the like that make it possible to easily create all images (whether still images or moving images) necessary for creating a document (for example, an electronic manual). Useful as provided.

400 system 410 user device 420 Internet 430 server device 440 database unit

Claims

A program for supporting the creation of a document, wherein the program is executed on a user device used by a user,
The user device includes a processor unit that controls the operation of the user device,
The program is
Identifying one video, and
Specifying one or more still images to be cut out from the one moving image or one or more partial moving images to be cut out from the one moving image;
A program for causing the processor unit to at least execute: creating a document using the specified one or more still images or the specified one or more partial moving images.
The program according to claim 1, wherein each of the one or more still images or the one or more partial moving images is specified in association with temporal information.
The program is
Causing the processor unit to further execute switching between the still image cutout mode and the partial moving image cutout mode;
In the still image clipping mode, one or more still images to be clipped out of the one moving image are identified,
The program according to claim 1, wherein in the partial moving image cutout mode, one or more partial moving images to be cut out from the one moving image are specified.
The program according to any one of claims 1 to 3, wherein each of the one or more still images or the one or more partial moving images is specified in response to an input from the user to the user device. .
The program is
Causing the processor unit to further execute detecting a temporal change of a displayed image by playing back the specified one moving image;
The method according to any one of claims 1 to 3, wherein each of the one or more still images or the one or more partial moving images is identified in response to detection of temporal change of the image. Programs.
The program according to any one of claims 1 to 5, wherein the document is an electronic manual.
Each of the one or more still images or the one or more partial moving images is identified in association with temporal information,
The program is
Causing the processor unit to further perform generating a plurality of work steps of the electronic manual,
The plurality of operation steps of the electronic manual may be a plurality of operations of the electronic manual according to a temporal order in which the one or more still images or the one or more partial moving pictures are defined by respective temporal information. The program according to claim 6, which is generated in a state associated with a step.
A method for assisting in the creation of a document, said method comprising
Identifying one video, and
Specifying one or more still images to be cut out from the one moving image or one or more partial moving images to be cut out from the one moving image;
Creating a document using the identified one or more still images or the identified one or more partial animations.
An apparatus for assisting in the creation of a document, said apparatus comprising
A means to identify one movie,
Means for identifying one or more still images to be clipped from the one animation or one or more partial animations to be clipped from the one animation;
Means for creating a document utilizing the identified one or more still images or the identified one or more partial animations.