JP2008140297A - Animation generation method and system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an animation generation method and system capable of minimizing the number of photographed sheets without complicating processing, and generating an animation whose generated three-dimensional model can be perceived to move smoothly by a user. <P>SOLUTION: An editing device generates operation information for defining operation of the three-dimensional model in three-dimensional virtual space and a moving route of a view position, and determines, based on the operation information, a photographing condition of a subject where the movement of the three-dimensional model is smooth from the view of the user and the photographing interval of the subject becomes maximum. A photographing device acquires a plurality of two-dimensional static images according to the photographing condition, and the three-dimensional model from the two-dimensional static images. The editing device generates an animation using the operation information and the three-dimensional model generated by the photographing device. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a moving image generation method and system for generating a moving image including a three-dimensional model of a subject using a plurality of photographs obtained by photographing the subject from various directions.

  In recent years, as a technology for automatically generating realistic 3D CG (computer graphics) from photographs (2D still images), the effectiveness of a technique called image base has been recognized in terms of both quality and cost, and many studies have been conducted. Has been made. For example, Matsuoka et al. Developed a background removal technique for calculating the transparency of a background color by shooting an object while changing the background color, and by shooting a subject from multiple directions in advance, a highly realistic 3 An automatic three-dimensional CG generation system for creating a three-dimensional CG is constructed. This system is characterized by an image processing technique that can reproduce the transparency and glossiness of a subject by considering human visual characteristics (see Non-Patent Document 1).

  However, when a moving image or the like is generated based on the data of the photograph, it is necessary to sufficiently reduce the interval between the photographing angles. If the interval is too large, the smoothness of the movement of the three-dimensional model that is a CG image of the subject. May be damaged. For example, when data having a large shooting angle interval is used to generate a video clip or an interactive animation, the user perceives the movement of the three-dimensional model as a jerky geometrically inconsistent image. This problem can be solved by reducing the shooting angle interval, but in order to generate a three-dimensional model with an arbitrary position as the viewpoint, it is necessary to shoot the subject in a hemispherical shape from the periphery. There is a problem that the number of shots increases in inverse proportion to the square of the angle interval, and the shooting time and the data amount increase.

As described above, since the image-based method requires a large amount of photographs, it is possible to partially use a conventional CG (geometry-based method) using shape information (information on the depth of a subject in a still image). A study that analyzes how much the number of shots can be reduced has been reported (see Non-Patent Document 2). Non-Patent Document 2 shows a technique for quantitatively obtaining a solution to the problem of how much shape information should be compensated when the number of shots is reduced.
Matsuoka, H. Takeuchi, T. Kitazawa, and H. Onozawa, “Representation of Pseudo Inter-reflection and Transparency by Considering Characteristics of Human Vision”, Proceedings of Eurographics 2002, pp. 503-510 (2002). Lin, Z. and Shum, H.-Y .: “A Geometric Analysis of Light Field Rendering”; Int'l J. of Computer Vision, Vol. 58, No.2, pp. 121-138, February (2004) .

  As described above, the image-based method used in the conventional moving image generation method requires a large amount of photographs to generate a moving image, and thus has a problem that the photographing time and the amount of data increase.

  On the other hand, as described in Non-Patent Document 2, the method combining the image-based method and the geometry-based method can reduce the number of shots, but shape information is indispensable for reducing the number of shots. Therefore, the processing is complicated compared to the image-based method. Further, the more the shape information is used, the lower the realism of the generated three-dimensional model due to the accuracy of the shape information.

  The present invention has been made in order to solve the above-described problems of the prior art. The number of shots is reduced as much as possible without complicating the processing, and a three-dimensional model generated by a user is provided. It is an object of the present invention to provide a moving image generation method and system capable of generating a moving image perceived to be smooth.

In order to achieve the above object, a moving image generating method of the present invention uses a plurality of two-dimensional still images obtained by photographing a subject from a plurality of directions, and uses a three-dimensional virtual space including a three-dimensional model of the subject. A moving image generation method for generating a moving image,
Computer
Generating motion information for defining the motion of the three-dimensional model in the three-dimensional virtual space and the movement path of the viewpoint position;
From the operation information, the shooting conditions of the subject are determined such that the movement of the three-dimensional model is smooth when viewed from the user and the shooting interval of the subject is maximized,
According to the photographing conditions, the photographing device is photographed to obtain a plurality of two-dimensional still images,
Generating the three-dimensional model using the plurality of two-dimensional still images;
It is a method for generating a moving image in a three-dimensional virtual space including the movement information and the generated three-dimensional model.

On the other hand, the moving image generation system of the present invention generates a moving image in a three-dimensional virtual space including a three-dimensional model of a subject using a plurality of two-dimensional still images obtained by photographing the subject from a plurality of directions. A moving image generation system for
A virtual space information generating unit that generates motion information for defining a motion of the 3D model and a movement path of a viewpoint position in the 3D virtual space; a motion of the 3D model as viewed from a user from the motion information 3D including a shooting condition deriving unit for determining shooting conditions of the subject, and a three-dimensional model generated from the motion information and a plurality of two-dimensional still images, in which the shooting interval of the subject is maximized An editing device including a moving image generation unit for generating a moving image of a virtual space;
A subject photographing unit that photographs the subject with a photographing device according to the photographing condition and obtains a plurality of two-dimensional still images, and a three-dimensional model generation unit that generates the three-dimensional model using the plurality of two-dimensional still images. Photographing device,
Have

  In the moving image generation method and system as described above, from the operation information, the shooting condition of the subject in which the movement of the three-dimensional model is smooth as seen from the user and the shooting interval of the subject is maximized is determined, and the shooting is performed. In order to obtain the 2D still image necessary for generating the 3D model according to the conditions, the number of shots is reduced as much as possible within the range where the user can perceive that the motion of the 3D model is sufficiently smooth. can do. Further, since a moving image can be generated using only a two-dimensional still image without using shape information, the moving image generation process does not become complicated.

  According to the present invention, it is possible to generate a moving image in which the motion of the three-dimensional model generated by the user is perceived as being smooth while reducing the number of shots as much as possible. Further, since a moving image can be generated using only a two-dimensional still image without using shape information, the moving image generation process does not become complicated.

  Next, the present invention will be described with reference to the drawings.

In order to examine the visual characteristics of the user, the present inventor presented a plurality of subjects with moving images by three-dimensional CG, and evaluated the smoothness of the movement of the three-dimensional model. In the present invention, the condition that can be perceived by the user that the motion of the generated three-dimensional model is smooth or the image quality acceptable by the user can be ensured is identified by the perceptual experiment. Then, a method for reducing the number of shots required for the synthesis of the three-dimensional CG while satisfying the condition is proposed.
[System configuration]
FIG. 1 is a block diagram showing a configuration example of a moving image generation system of the present invention.

  As shown in FIG. 1, the moving image generation system of the present invention is configured to include an editing device 1, a photographing device 2, and a display device 3.

  The editing apparatus 1 includes a virtual space information generation unit 11, a shooting condition derivation unit 12, and a moving image generation unit 13. The imaging device 2 includes a subject imaging unit 21 and a three-dimensional model generation unit 22, and the display device 3 includes a moving image display unit 31.

  The editing device 1 and the display device 3 can be realized by a computer system that performs processing according to a program, for example. The subject photographing unit 21 of the photographing device 2 can be realized by a camera, a computer system used for controlling the photographing position of the camera, a table for placing a subject, and a background display device that displays the background of the subject. The three-dimensional model generation unit 22 of the photographing apparatus 2 can be realized by a computer system equipped with a program for generating a three-dimensional model.

  As shown in FIG. 1, the editing device 1, the imaging device 2, and the display device 3 can transmit and receive data to and from each other via the network 4. The editing device 1, the photographing device 2, and the display device 3 are not limited to the configuration illustrated in FIG. 1. For example, the editing device 1 and the display device 3 may be configured by a single computer system. The dimensional model generation unit 22, the editing device 1, and the display device 3 may be configured by one computer system.

  FIG. 2 is a block diagram showing a configuration example of a computer system included in the moving image generation system shown in FIG.

A computer system 5 shown in FIG. 2 has a well-known general configuration, and includes a CPU 51, a memory 52, a hard disk 53, an input device 54, an output device 55, and a CD-ROM drive 56. By installing a program for executing the processing of the editing device 1 and the photographing device 2 in the computer system 5, the functions of these devices can be realized. The program can be recorded and stored in a recording medium such as an FD (flexible disk), MO, ROM, memory card, CD-ROM, DVD, flash memory, or distributed. The program can also be provided via a network such as the Internet or e-mail.
[Outline of processing]
FIG. 3 is a flowchart showing the processing procedure of the moving image generation method of the present invention.

  The outline of the moving image generation method of the present invention will be described below with reference to FIG. Note that the flowchart shown in FIG. 3 is also a view shown in a previous patent application (Japanese Patent Laid-Open No. 2006-244306) by the present applicant. In the present invention, the photographing condition derivation process S2 shown in FIG. 3 includes a process for maximizing the interval between photographing angles of photographs used for generating a moving image based on human visual characteristics. Other processing can be realized by referring to the above-mentioned JP-A-2006-244306.

  As shown in FIG. 3, in the moving image generation system of the present invention, first, a virtual space information generation unit 11 of the editing apparatus 1 generates a temporary object on a three-dimensional virtual space editor in accordance with a user operation. Information is generated (step S1). In the moving image generation system according to the present embodiment, not only an object animation that specifies a motion of a temporary object but also a scene animation with a different viewpoint can be constructed by setting a camera path and a gazing point. By these processes, the movement pattern of the subject is defined, and motion information is generated based on the movement pattern.

  Note that the 3D virtual space editor edits a 3D virtual space constructed as a moving image including a 3D model and a camera path generated based on a plurality of 2D still images obtained by photographing a subject. Is to do.

  The temporary object is a simple three-dimensional model used in place of the three-dimensional model in order to specify the operation of the three-dimensional model in the three-dimensional virtual space. It is composed of a rectangular parallelepiped that is close to the approximate shape of the actual product.

  The motion information is information that defines the motion of the three-dimensional model. Here, the motion information of the temporary object that defines the motion of the temporary object that replaces the three-dimensional model, and the movement path of the camera path and the gazing point, that is, the viewpoint position. Operation information of the viewpoint position that defines the movement route is provided.

  The camera path is a simulation showing which viewpoint position the temporary object in the 3D virtual space is shot from. The camera path and path of the virtual camera set in the 3D virtual space Shown with curves and figures. The camera path is arranged on the three-dimensional virtual space editor including the temporary object.

  Next, in the moving image generating system, the shooting condition deriving unit 12 uses the operation information generated by the virtual space information generating unit 11 to take into account human visual characteristics, and the moving image generating unit 13 Determines the shooting angle interval that maximizes the shooting angle interval of the subject within the range where the movement of the three-dimensional model looks sufficiently smooth, that is, the smallest shooting number of subjects, and outputs that value as the shooting condition. (Step S2).

  The subject photographing unit 21 of the photographing apparatus 2 photographs the subject from a plurality of directions according to the photographing conditions derived by the photographing condition deriving unit 12, and outputs a plurality of two-dimensional still images (step S3).

  When the photographing by the subject photographing unit 21 of the photographing apparatus 2 is completed, the moving image generating system synthesizes a three-dimensional model from a plurality of photographed two-dimensional still images by the three-dimensional model generating part 22 of the photographing apparatus 2 (step S4). The synthesized three-dimensional model data is sent to the editing apparatus 1.

  The editing device 1 generates a moving image by the moving image generation unit 13 using the three-dimensional model data received from the imaging device 2 and the motion information generated by the virtual space information generation unit 11 (step S5). The generated moving image is sent to the display device 3 and displayed by the moving image display unit 31 of the display device 3 (step S6).

  In the conventional moving image generation system, a subject is photographed in fine angle units from all directions of 360 degrees to acquire a large number of two-dimensional still images, so that the photographing time becomes very long and the amount of data becomes very large. On the other hand, in the moving image generation system of the present invention, a subject is photographed from a camera position (a camera position of the photographing apparatus 2) corresponding to the position of the camera path set on the three-dimensional virtual space editor for each time. Get a still image. That is, since only a photograph necessary for generating a moving image is taken, a three-dimensional model can be generated quickly, and the data amount can be reduced.

  FIG. 4 is a flow chart showing a graph showing a minimum sampling curve and a conventional procedure for generating a three-dimensional model using the minimum sampling curve. The minimum sampling curve shown in FIG. 4A is derived by the technique described in Non-Patent Document 2, and shows how much the number of shots can be reduced by increasing the number of uses of the shape information. ing.

  As can be understood by comparing the processing of steps S2 to S4 shown in FIG. 3 with the processing of steps S21 to S24 shown in FIG. 4B, the technique described in Non-Patent Document 2 reduces the number of shots. In addition to taking pictures, it is necessary to separately calculate the shape (depth) of the subject, which complicates the moving image composition processing. Generally, in order to restore the shape of a subject from an image such as a photograph, generate geometry (polygon) data, and calculate depth information, it is necessary to perform enormous calculations, which puts a heavy load on the computer system. . Furthermore, in the method described in Non-Patent Document 2, it is possible to reduce the number of shots as the shape information is used more frequently. However, as described above, the generated three-dimensional model is caused by the accuracy of the shape information. It is known that the reality of In Non-Patent Document 2, image quality evaluation of a moving image generated by a user is not performed, and thus a good image quality perceived by the user as a smooth movement of the three-dimensional model may not be obtained. There was sex.

On the other hand, in the present invention, the editing apparatus 1 determines in advance the size of the shooting interval of the subject, that is, how many times the subject should be shot, in consideration of the visual characteristics of the user, The imaging condition deriving unit 12 for outputting as follows. As a result, the number of shots can be reduced as much as possible within a range where the user can perceive that the movement of the three-dimensional model is sufficiently smooth when viewed from the user. Further, since a moving image can be generated using only a two-dimensional still image without using shape information, the moving image generation process does not become complicated.
[Detailed processing]
Next, the virtual space information generation unit 11, the shooting condition derivation unit 12, the moving image generation unit 13, the subject shooting unit 21, the three-dimensional model generation unit 22, and the moving image display unit included in the moving image generation system illustrated in FIG. 31 will be described in detail with reference to the drawings.
(1) Virtual Space Information Generation Unit FIG. 5 is a block diagram illustrating a configuration example of the virtual space information generation unit illustrated in FIG.

  As shown in FIG. 5, the virtual space information generation unit 11 includes a temporary object generation unit 111, a camera path generation unit 112, a gazing point specification unit 113, and a motion information generation unit 114. FIG. 5 also shows information generated by each unit included in the virtual space information generation unit 11.

  The virtual space information generation unit 11 illustrated in FIG. 5 executes processing described below. The following processing is executed based on user operations.

  First, the virtual space information generation unit 11 generates the temporary object on the three-dimensional virtual space editor by the temporary object generation unit 111. Further, the camera path generation unit 112 generates a camera path on the three-dimensional virtual space editor. Further, the gazing point designating unit 113 designates the gazing point on the three-dimensional virtual space editor. The motion information generation unit 114 generates motion information using the temporary object, the camera path, and the gazing point.

  In the motion information, as described above, the motion information of the temporary object that defines how the temporary object operates, and the motion of the viewpoint position that specifies how the viewpoint position moves according to the camera path and the gazing point. There are two pieces of information. The operation information generated by the operation information generation unit 114 is stored in a storage device (memory 52 or hard disk 53) provided in the computer system.

  The virtual space information generation unit 11 converts the operation information into an image signal that can be displayed as an image by the operation information generation unit 114, and displays the preview image on a display or the like. By viewing the preview image as necessary, the user can know the state of completion before the actual moving image is completed. As a result of checking the preview image, if the movement of the temporary object is different from that assumed, it may be corrected as appropriate by an operation such as changing the camera path. Since the temporary object does not indicate the exact size of the subject, the moving image generation unit 13 needs to correct the size as will be described later, but at this point, if the completed moving image can be imaged. Since it is sufficient, it is generated using a simple rectangular parallelepiped.

  In the image composition system of this embodiment, one or a plurality of temporary objects can be arranged on the three-dimensional virtual space editor. When there is only one temporary object, the camera's point of interest is set at a fixed position (for example, the center of gravity of the temporary object). When there are multiple temporary objects, the camera's point of interest is an arbitrary point on the 3D virtual space editor. Can be specified.

  FIG. 6 is a schematic diagram illustrating an example of setting a camera path by the virtual space information generation unit illustrated in FIG. FIG. 6 shows an example of setting the camera path when the temporary object is viewed from above. FIG. 6 shows an example of setting a camera path by taking as an example a case where a moving image (scene animation) in which the position of the viewpoint moves is generated by generating a camera path and a gazing point. By associating the temporary object, it is also possible to edit the object animation that specifies the movement of the temporary object.

  The method of setting the camera path in the three-dimensional virtual space editor is a standard technique used when building a geometry-based three-dimensional model using a known polygon, and a system that employs an image base as in the present invention. But it can be done in the same way. The shape, number, and combination of camera paths can be freely defined by providing input means for setting camera paths. The camera path input means is described, for example, in Japanese Patent Application No. 2005-205831.

  Since the camera path expresses the movement path of the camera (the image photographing device 214 described later included in the subject photographing unit 21) as shape information on the three-dimensional virtual space editor, it includes time information as well as position information. Yes. For editing the camera path time information on the three-dimensional virtual space editor, a user interface called a timeline is usually used. The timeline is a user interface for managing an object having a time attribute (for example, a camera path) using a time axis for each layer, and has been conventionally used when constructing a three-dimensional CG image. It is used. By using the timeline interface, the camera path can be easily managed. In this embodiment, the use of this timeline interface is assumed.

  FIG. 7 is a schematic diagram showing an example of a setting screen by the timeline interface.

  As shown in FIG. 7, when the timeline interface is used, the duration (moving image display time) can be designated for each object having time information such as a temporary object and a camera path. In the timeline interface, it is possible to specify a frame rate FPS that is an image update frequency per second, and the user can select a desired one according to a moving image playback format (AVI, QUICKTIME, MPEG, DIVX, etc.). You can specify the frame rate.

  In general, it is known that the faster the frame rate FPS, the smoother the movement of an object to be displayed. For example, since the frame rate FPS is 30 in a television receiver, the upper limit of the frame rate FPS is about 30 in the present invention.

  In the example shown in FIG. 7, the temporary object has a duration of 20 seconds, camera path 1 and camera path 2 having a duration of 10 seconds are set, and the frame rate FPS is set to 15. In this case, the total number of frames (number of still images) necessary for moving image reproduction is 300.

  As described above, the motion information is configured by position information and time information held by the temporary object and the camera path. In this embodiment, when a moving image is constructed using only one temporary object, the gazing point of the camera may be set to a fixed position (for example, the center of gravity position of the temporary object). In this case, since the operation information can be generated quickly, it is suitable for a case where individual objects (products, etc.) are desired to be presented to the user as independent high-quality images such as museum works and jewelry.

In addition, when a moving image is constructed using a plurality of temporary objects, the gazing point of the camera may be designated as an arbitrary point on the three-dimensional virtual space editor. In this case, an expression closer to the real space is possible. A method for designating a camera gazing point as an arbitrary point on the three-dimensional virtual space editor is to display a combination of a plurality of objects (products, etc.) such as a room in which various objects are arranged. Suitable for image generation.
(2) Shooting Condition Deriving Unit Next, the shooting condition deriving unit 12 included in the editing apparatus 1 shown in FIG. 1 will be described with reference to the drawings.

  FIG. 8 is a block diagram illustrating a configuration example of the imaging condition deriving unit illustrated in FIG.

  As shown in FIG. 8, the imaging condition deriving unit 12 includes an imaging interval maximizing unit 121, a coordinate converting unit 122, an imaging distance calculating unit 123, a vertical angle calculating unit 124, a horizontal angle calculating unit 125, and an imaging procedure generating unit 126. It has.

  The shooting condition deriving unit 12 of the present embodiment has a function for reducing the number of shots by the shooting apparatus 2 by maximizing the shooting angle interval under a certain condition. Here, the certain condition is a value that defines the smoothness of the motion of the moving image based on the perceptual experiment results by a plurality of subjects. Therefore, by using the method of the present invention, it is possible to reduce the number of shots required for generating moving images while maintaining the quality of moving images. Furthermore, the shooting condition deriving unit 12 of the present embodiment includes a coordinate conversion unit 122 that calculates the coordinates of the viewpoint position in the three-dimensional virtual space, a shooting distance calculation unit 123 that determines a shooting distance between the shooting device 2 and the subject, Vertical angle calculation means 124 for calculating the angle of the shooting interval in the vertical direction by the shooting device 2, horizontal angle calculation means 125 for calculating the angle of the shooting interval in the horizontal direction by the shooting device 2, and shooting set by the user An imaging procedure generation unit 126 that generates an imaging procedure for imaging along a route (camera path) is provided.

  Hereinafter, a perceptual experiment performed by the present inventor will be described before describing the processing procedure of the imaging condition deriving unit 12.

  In the perception experiment, a test image in which a three-dimensional model (here, a cube) rotates at a constant speed on the basis of the Y axis is presented to nine subjects, and the smoothness of the movement of the three-dimensional model is repeated while changing the parameters. Subjects were evaluated. The evaluation was performed based on a five-level rating (rank 5: very smooth, rank 4: somewhat smooth, rank 3: not sure, rank 2: slightly jerky, rank 1: very jerky). There are two types of changed parameters: frame rate F [fps] and rotation period T [sec]. The parameter values used are F [fps] = 6, 8, 10, 12, 14, 15, 16, 18, T [sec] = 1, 2, 4, 6, 8, 10, 12. In this perceptual test, constant speed rotational motion is taken as an example, and thus the rotation period, which is the time required for one rotation of the three-dimensional model, is the motion information. In the above description, the general concept of the frame rate is expressed as FPS. Hereinafter, the frame rate used as a parameter for the perceptual experiment is expressed as F [fps].

  When the evaluation result of the subject is analyzed by the signal detection theory, it is possible to identify a range in which a large deterioration in image quality is not perceived even when the frame rate FPS is reduced. FIG. 9 shows the analysis result of this perceptual test.

  FIG. 9 is a diagram showing the analysis result of the perceptual experiment. FIG. 9A is a graph showing the ROC curve, and FIG. 9B is a table showing sensitivity values and standard errors corresponding to the frame rate.

  The signal detection theory is a theory for knowing how correctly a subject can detect a signal from noise. In this perceptual experiment, it is assumed that a moving image displayed at F = 15 has a standard image quality, and a moving image displayed at other values of F is used as noise to calculate the cumulative probability of each rating level. The ROC curve shown in the graph of FIG. 9A was drawn by plotting the relationship between the value and the false alarm rate FA.

  The area under the ROC curve corresponds to a sensitivity d ′ that allows the subject to identify whether the movement of the three-dimensional model is smooth or jerky in the test video used in this perception experiment. FIG. 9B shows the value of the sensitivity d ′ and the standard error corresponding to the value of each frame rate F when the rotation period T = 12. Sensitivity d 'is an index of stimulus detection power that is not affected by changes in the judgment criteria of the subject, and the value of sensitivity d' when F = 15 indicated by the broken line in FIG.

  A relatively high value of sensitivity d 'indicates that the subject has easily identified whether the movement of the 3D model is smooth or jerky. When F = 6 or F = 8, it can be seen that the value of the sensitivity d 'is larger than other conditions, and the subject easily recognizes that the movement of the three-dimensional model is not smooth.

  On the other hand, with F = 10 as the boundary, F = 12 and F = 14 show values close to 0, and the subject may not be distinguished from the test video at the standard image quality of F = 15. High nature. That is, although it is not an image of F = 15 with the standard image quality, it is often rated as “smooth”, so that the test video when F = 12 or F = 14 is F = 15 for the subject. It can be estimated that it is at the same psychological distance as the test video.

  From the above experimental results, it can be considered that there is a threshold value for determining whether the movement of the three-dimensional model is smooth or jerky in the vicinity of F = 10. If the frame rate is in the range of 10 ≦ F ≦ 15 (where T = 12), the subject perceives the image quality as being almost equivalent to the test video when F = 15 or within an acceptable range. It is thought that. Therefore, when the frame rate F is 10 ≦ F ≦ 15 (where T = 12) and the moving image is as close as possible to F = 10, the moving image has the minimum number of frames at which the image quality acceptable by the user can be obtained. I can say that. In order to clarify the relationship between the value of the frame rate F and the rotation period T, the results of plotting the ratios determined to be “very smooth” for each rotation period T from the total 1512 evaluation results are shown in FIG. Shown in The horizontal axis of the graph shown in FIG. 10 is the frame rate F, and the vertical axis is the probability that the movement of the three-dimensional model at that time is determined to be smooth for the subject.

  Here, assuming that the response probability of the subject to various presented stimuli (in this case, test video) follows a normal distribution, fitting a cumulative normal distribution function or a logistic function to the measurement result gives a perceptual probability curve . From FIG. 10, it can be seen that the value of the frame rate F necessary for displaying a smoothly moving three-dimensional model increases as T = 1, that is, as the rotational speed increases.

  Further, from the graph shown in FIG. 10, when the value of the frame rate F when the probability that the subject determines that the movement of the three-dimensional model is smooth is 50%, when T = 12, 10 ≦ F ≦ 15 And a value close to F = 10. In the present embodiment, a 50% threshold value (hereinafter referred to as F50% TH) is used as an index for deriving an optimal frame rate F value, with emphasis on smoother movement of the three-dimensional model. Adopt).

  Based on the above knowledge, the basic idea of the present invention was devised.

  Assuming that the frame rate F = 10 is FMIN, the optimal shooting condition can be obtained by calculation if the subject is shot so that it can be displayed at the frame rate closest to FMIN within the range of 10 ≦ F ≦ 15. Here, the optimal shooting condition is that the motion of the three-dimensional model in the moving image is sufficiently smooth (but not ideal) for the user and has the minimum frame rate (that is, the maximum shooting interval). Means that. If the frame rate is slower than FMIN, the range of the predetermined condition is deviated. Therefore, when a moving image is displayed, the motion of the three-dimensional model is recognized as geometrically inconsistent, and looks awkward.

  Hereinafter, a procedure for specifically quantifying the above idea will be described.

  The value of F50% TH can be converted into an imaging interval A [deg] when the subject is imaged by the imaging apparatus 2 of the present embodiment by using the following expression (1).

  However, ω is an angular velocity and is obtained by ω = 2π / T.

  When the shooting interval A [deg] obtained by the equation (1) is plotted against the rotation cycle T [sec], the shooting interval A can be approximated by the model function represented by the equation (2) with respect to the rotation cycle T.

  However, k is a constant and n is a power exponent.

  The graph shown in FIG. 11 shows the relationship between the value and the rotation period T [sec] when the value of F50% TH is converted into the shooting interval A [deg] of the subject.

  Therefore, the required shooting interval A [deg] can be modeled by a power law with respect to the rotation period T [sec]. When parameters are actually given, the following equation (3) is obtained.

  Hereinafter, the photographing interval maximizing unit 121 that executes processing based on the expression (3) will be described.

  The movement of the three-dimensional model in the generated moving image is sufficiently smooth when viewed from the user, and the number of frames is minimized when the shooting interval A [deg] is the upper limit value AMAX. The upper limit value AMAX can be obtained from the simultaneous equations of the following inequality (4) and conditional expression (5). That is, the shooting interval A is obtained by giving the value of the rotation period T to the equation (4).

  However, since the photographing apparatus 2 photographs the subject from the upper hemisphere set around it, it is necessary to give a restriction that the camera goes around the photographing position and returns to the original position at the time of photographing. It is necessary to satisfy (5) as a condition.

  Therefore, by obtaining the maximum value AMAX of the photographing interval A that satisfies the simultaneous equations (4) and (5), it is possible to derive the optimum photographing condition that expresses the constant speed rotation motion of the three-dimensional model. Since it is an important point, when reconfirmed, “optimal” here means that the movement of the three-dimensional model is smooth and the shooting interval is maximized when viewed from the user. If the maximum value AMAX of the shooting interval A is determined, it is determined how many times the camera path should be shot at an interval, so that data can be passed to the subsequent coordinate conversion means 122.

  In the present embodiment, the process for deriving the optimal shooting condition is exemplified by taking a cube at a constant speed as an example of the three-dimensional model. However, the process executed by the shooting condition deriving unit 12 of the present invention is as follows. It can also be applied to various other motion patterns such as rotational movement with acceleration and parallel movement. However, when obtaining the optimum shooting conditions other than the constant speed rotation motion, it is necessary to obtain the parameters by the same perceptual experiment as described above.

  When the optimum shooting condition is obtained, the coordinate conversion unit 122 obtains a plurality of coordinate data indicating the relative position of the temporary path for each time, which represents the center of the temporary object. For example, the center of the temporary object, that is, the origin of the object coordinate system in the world coordinate system of the three-dimensional virtual space editor is (2, 2, 2), and the camera coordinates at any two points on the camera path are (10, 2). , 10) and (14, 2, 8), the output of the coordinate conversion means 122 is (8, 0, 8) and (12, 0, 6).

  Since the camera coordinates on the camera path exist for each frame, coordinate data equal to the total number of frames is output. At this time, by specifying the frame interval FI, the number of coordinate data to be obtained can be adjusted. Here, the frame interval FI is a value that serves as an index indicating how much the coordinate data is extracted with respect to the total number of frames in a certain camera path. In this case, since coordinate data is output at every frame interval, a value obtained by dividing the total number of frames by the number of frame intervals is the number of coordinate data to be output. That is, n = (D × FPS) / FI, where n is the number of coordinate data obtained by the coordinate conversion means 122 and D is the duration of the camera path. However, D is in seconds.

  For example, in a camera path with a duration of 10 seconds and a frame rate FPS of 12, the total number of frames is 120. If the frame interval is specified as 12 for this camera path, the number of coordinate data to be obtained is 120/12. = 10.

  In order to generate a moving image in which the three-dimensional model operates more smoothly, the frame interval may be shortened and the number of coordinate data may be increased, but the user's visual characteristics have already been taken into consideration in the processing of the shooting interval maximization unit 121. Since the optimum frame interval is obtained, the photographer does not need to determine the frame interval based on intuition, empirical rules, or the like at this stage.

  Since the camera path is a part of the space on the 3D virtual space editor, the total number of shots when the subject is photographed from all directions as in the conventional method is Pm. If the number of shots is Pn, the relationship Pm ≧ Pn is established. Therefore, according to the present embodiment, a moving image in which the three-dimensional model operates smoothly can be obtained, and the number of necessary captured images can be reduced as compared with the conventional method.

  FIG. 12 is a table showing an example of coordinate data of the camera position obtained by the coordinate conversion means.

  In the conventional method, since the position (coordinates) of the camera to be photographed is set by a human operation, the coordinate data of the camera input as the photographing condition is an integer. On the other hand, in the present invention, since coordinate data of the camera is obtained by the coordinate conversion means 21 as shown in FIG. 9, the coordinate data is obtained as a real number. Therefore, it is possible to specify the shooting position of the camera more precisely.

  When the coordinate data is obtained by the coordinate conversion unit 122, the imaging condition deriving unit 12 calculates the imaging distance in mm units by the imaging distance calculation unit 123 based on the coordinate data. The shooting distance is the distance between the camera and the subject center.

  In the editing apparatus 1 of the present embodiment, since the shape of the camera path arranged on the three-dimensional virtual space editor can be set freely, the shooting distance can be set to an arbitrary value, and the distance from the temporary object can be set. Can be set freely. On the other hand, in the actual photographing apparatus 2, there are cases where the photographing distance is limited (for example, photographing must be performed at a fixed distance) due to restrictions such as the operating range of the arm that supports the camera. Therefore, the photographing distance is corrected as necessary by the photographing distance calculation means 123 by inputting in advance such photographing restrictions as data.

  The distance between the camera and the subject at the time of shooting may be measured by using a conventionally known method of obtaining distance information by performing stereo processing on a plurality of images shot from the same direction, such as a range finder. A method of obtaining distance information from the geometric positional relationship by measuring the position of the pattern light projected on the subject by the optical means may be used.

  Further, when the shooting distance cannot be changed, a method of replacing the physical position of the camera by using a zoom function provided in the camera instead of changing the physical position of the camera can be considered. However, in this case, since information regarding perspective is lost, the generated temporary object does not accurately indicate the positional relationship between the subject and the camera. Therefore, it is necessary to separately correct the distance. However, when a single subject is photographed at a short distance, the error in the distance does not greatly affect the generated moving image.

  Next, for each camera position on the camera path on the three-dimensional virtual space editor obtained by the coordinate conversion means 122, the shooting condition deriving unit 12 is based on the coordinate data and the value of the origin coordinate of the temporary object in the object coordinate system. Vector calculation is performed, the vertical angle calculation unit 124 obtains the vertical angle, and the horizontal angle calculation unit 125 obtains the horizontal angle.

  The vertical angle is an angle formed by a line connecting the camera and the subject center and the horizontal plane, and the horizontal angle is a line connecting the subject center and a predetermined position of the subject and the subject center and the camera position on the horizontal plane. The angle of the connecting line. Parameters such as the shooting distance, the vertical angle, and the horizontal angle can be calculated by a known technique.

  After obtaining the shooting distance, the vertical angle, and the horizontal angle, the shooting condition derivation unit 12 generates a shooting procedure by the shooting procedure generation unit 126. For example, as shown in FIG. 13, the shooting procedure describes shooting conditions of shooting distance, vertical angle, and horizontal angle as one set, and describes them in the shooting order. The photographing apparatus 2 sequentially reads each photographing condition included in the photographing procedure generated by the photographing condition deriving unit 12 to photograph a subject from a plurality of directions according to the photographing condition.

  By the way, when the shooting route is simple, it is not difficult to determine the shooting procedure. However, when the shooting route is complicated, it is difficult to obtain a shooting procedure that takes the shortest shooting time. Therefore, it is necessary to obtain an approximate solution using a known algorithm to determine the shooting procedure. Conventionally, these parameters have been set one by one by user operation before photographing based on the user's rule of thumb. However, it is troublesome to manually specify various shooting conditions while taking the shooting procedure into account, and it is difficult to create various shooting patterns. In addition, the generated three-dimensional model sometimes appears jerky so that the user cannot accept it.

On the other hand, in this embodiment, since all the photographing conditions can be obtained from the coordinate data set on the three-dimensional virtual space editor, the photographing conditions given to the photographing apparatus 2 can be automatically obtained. Further, since the photographing condition deriving unit 12 obtains the photographing condition in consideration of the visual characteristics of the user, the photographing condition deriving unit 12 has smoothness that allows the movement of the three-dimensional model to be practically acceptable.
(3) Subject Photographing Unit Next, the subject photographing unit 21 provided in the photographing apparatus 2 shown in FIG. 1 will be described with reference to the drawings.

  The subject photographing unit 21 receives the photographing conditions from the editing apparatus 1 and photographs the subject according to the photographing conditions. The subject photographing unit 21 includes a camera and means for photographing while changing the relative position between the camera and the subject in accordance with the photographing condition received from the editing device 1.

  FIG. 14 is a perspective view showing a configuration example of the subject photographing unit shown in FIG.

  As illustrated in FIG. 14, the subject photographing unit 21 includes an image photographing device 214, a table 212, a background display device 213, a switch 215, and a control device 216. The configuration of the subject photographing unit 21 and the image processing method thereof shown in FIG. 14 are described in, for example, the non-patent document 1 and Japanese Patent Laid-Open No. 2001-148021.

  As shown in FIG. 14, the subject 211 is placed on the table 212 at the time of photographing, and is photographed by the image photographing device 214 such as a camera against the background displayed on the background display device 213. The control device 216 operates the switch 215 and the background display device 213 in order to remove the background from the two-dimensional still image in which the subject 211 is captured according to the shooting conditions received from the editing device 1. The background removal method is described in Non-Patent Document 1.

  Hereinafter, a method for controlling the shooting position of the subject 211 by the image shooting device 214 will be described.

  For example, the control device 216 reads the photographing condition file shown in FIG. 13 and photographs the subject according to the photographing conditions defined in the photographing condition file. According to the imaging condition file shown in FIG. 13, the control device 216 performs imaging while rotating the table 212 in units of 15 degrees in the horizontal direction. The shooting condition file shown in FIG. 13 is an example in which the shooting distance (camera distance) is set to a fixed value assuming that the subject shooting unit 21 has the configuration shown in FIG.

  Note that the subject photographing unit 21 is not limited to the configuration illustrated in FIG. 14, and includes, for example, a robot arm that can move the image photographing device 214 in a hemispherical shape with the subject 211 as the center. Also good. In such a configuration, the vertical imaging interval can also be controlled by the control device 216. In a configuration including a robot arm or the like, the distance between the image capturing device 214 and the subject 211 can be changed. When the shooting distance is outside the movable range of the robot arm, for example, the focal length of a lens provided in the image shooting device 214 may be adjusted.

In this way, the control device 216 controls the image photographing device 214, the table 212, the background display device 213, and the switch 215 to photograph the subject 211, whereby a plurality of two-dimensional still images can be acquired.
(4) 3D Model Generation Unit Next, the 3D model generation unit 22 included in the photographing apparatus 2 shown in FIG. 1 will be described with reference to the drawings.

  If the subject photographing unit 21 has the configuration shown in FIG. 14, the three-dimensional model generation unit 22 can be realized by installing a program for generating a three-dimensional model in the control device 216.

The three-dimensional model generation unit 22 generates a three-dimensional model based on a plurality of two-dimensional still images obtained by photographing the subject output from the subject photographing unit 21 and their photographing information. The three-dimensional model includes a subject size, a plurality of two-dimensional still images obtained by photographing the subject, a plurality of mask images indicating subjects in the two-dimensional still image, and photographing information when the subject is photographed (subject Distance, angle, resolution, angle of view, etc.). The subject size can be calculated using, for example, the well-known Shape from Silhouette method, or the front and side images of the subject. The mask image can be generated using a well-known chroma key method or a method described in Non-Patent Document 1 and Japanese Patent Application Laid-Open No. 2004-46776.
(5) Moving Image Generating Unit Next, the moving image generating unit 13 provided in the editing apparatus 1 shown in FIG. 1 will be described with reference to the drawings.

  The moving image generation unit 13 generates a moving image using the movement information generated by the virtual space information generation unit 11 and the three-dimensional model generated by the three-dimensional model generation unit 22.

  When receiving the 3D model data from the 3D model generation unit 22, the moving image generation unit 13 corrects the size of the 3D model and the camera path deviation. Then, a moving image is generated by outputting an image sequence of each still image from the motion information and the three-dimensional model constructed on the three-dimensional virtual space editor. Note that the moving image generation unit 13 may include a preview function or the like for confirming the final output before generating a moving image. If the preview image does not show the user's desired moving image, the operation information may be corrected by returning to the processing of the virtual space information generating unit 11.

  FIG. 15 is a block diagram illustrating a configuration example of the moving image generation unit illustrated in FIG.

  As illustrated in FIG. 15, the moving image generation unit 13 includes a comparison unit 131, a correction unit 132, and an image sequence output unit 133. Hereinafter, processing of the moving image generation unit 13 illustrated in FIG. 15 will be described.

  First, the moving image generation unit 13 compares the size of the temporary object generated by the virtual space information generation unit 11 and the size of the 3D model generated by the 3D model generation unit 22 by the comparison unit 131. Since the virtual space information generation unit 11 generates a temporary object with a rough shape, the virtual object information generation unit 11 circumscribes the rough shape of the temporary object with the three-dimensional model to perform the size comparison process.

  The temporary object can be generated using a two-dimensional still image obtained by roughly photographing the subject. In such a case, since the sizes of the temporary object and the three-dimensional model are the same, it is not necessary to perform size comparison processing.

  When the sizes of the temporary object and the 3D model are different, the moving image generation unit 13 resizes the 3D model by the correction unit 132 and shifts the preview image before the generation of the 3D model from the preview image at this processing stage. Correct the camera path to suppress. In the camera path correction, when the size of the 3D model is changed, the camera path remains the motion information generated by the virtual space information generation unit 11, and thus the 3D model is not changed even if the position of the 3D model is not changed. This is performed because there is a possibility that the appearance of the image may change and a desired moving image may not be obtained. If necessary, the camera path may be edited again by user operation. The temporary object is deleted when resizing of the three-dimensional model is completed. If there is no need to resize the 3D model, it is deleted when the 3D model data is received from the 3D model generator 22.

Finally, the moving image generation unit 13 converts the operation information including the three-dimensional model into an image sequence using the frame rate set by the image sequence output unit 133 through the timeline interface, and generates a moving image. By converting to an image sequence, a moving image can be reproduced using a widely used format such as AVI, QUICKTIME, MPEG, or DIVX. Note that the image sequence output unit 133 may output a moving image by combining image frames into one data, or may output each image frame by image.
(6) Moving Image Display Unit Next, the moving image display unit 31 included in the display device 3 illustrated in FIG. 1 will be described with reference to the drawings.

  The image data generated by the moving image generation unit 13 is sent to the display device 3 and displayed on the moving image display unit 31 to provide a moving image to the user. The moving image display unit 31 can be realized by a display device such as a CRT monitor, a liquid crystal display, a plasma display, or a television.

  Since the moving image displayed on the moving image display unit 31 is generated based on the three-dimensional model generated in consideration of the visual characteristics of the user, the number of captured images on which the three-dimensional model is based is reduced. However, it is possible to display a moving image that is allowed to be smoothly operated by the user.

  According to the present invention, by deriving the number of shots having a certain level of image quality from the result of a perceptual experiment, a moving image that the user perceives as a smooth movement of the three-dimensional model while reducing the number of shots is obtained. Can be generated. For example, when the movement of the three-dimensional model is constant speed rotation, the present invention can be expected to reduce the number of shots by about 30% to 60%.

  As a result of evaluating a moving image generated using the method of the present invention, it was possible to determine that the image quality was deteriorated compared to the standard image quality, but it was confirmed that the image quality was acceptable for the user. . Therefore, by using the present invention, it is possible to quickly generate a moving image having sufficient image quality in practical use.

It is a block diagram which shows the example of 1 structure of the moving image generation system of this invention. It is a block diagram which shows one structural example of the computer system with which the moving image generation system shown in FIG. 1 is provided. It is a flowchart which shows the process sequence of the moving image generation method of this invention. It is a flowchart which shows the production | generation procedure of the graph which shows the minimum sampling curve, and the conventional 3-dimensional CG using this minimum sampling curve. It is a block diagram which shows the example of 1 structure of the virtual space information generation part VP shown in FIG. It is a schematic diagram which shows the example of a camera path setting by the virtual space information generation part shown in FIG. It is a schematic diagram which shows an example of the setting screen by a timeline interface. FIG. 2 is a block diagram illustrating a configuration example of an imaging condition derivation unit illustrated in FIG. 1. It is a figure which shows the analysis result of a perception experiment, The figure (a) is a graph which shows a ROC curve, The figure (b) is a table figure which shows the value of sensitivity corresponding to a frame rate, and a standard error. It is a graph which shows the relationship between the frame rate of a moving image, and the probability determined to be smooth by a test subject. It is a graph which shows the relationship between the value and the rotation period T [sec] when the value of F50% TH is converted into the photographing interval A [deg] of the subject. It is a table figure which shows an example of the coordinate data of the camera position calculated | required by the coordinate conversion means. It is a table figure which shows an example of the imaging condition produced | generated in an imaging condition deriving part. FIG. 2 is a perspective view illustrating a configuration example of a subject photographing unit illustrated in FIG. 1. It is a block diagram which shows one structural example of the moving image generation part shown in FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Editing apparatus 2 Imaging device 3 Display apparatus 4 Network 11 Virtual space information generation part 12 Imaging condition derivation part 13 Moving image generation part 21 Subject imaging part 22 3D model generation part 31 Moving image display part 5 Computer system 51 CPU
52 Memory 53 Hard Disk 54 Input Device 55 Output Device 56 CD-ROM Drive 111 Temporary Object Generation Unit 112 Camera Path Generation Unit 113 Gaze Point Specification Unit 114 Motion Information Generation Unit 121 Shooting Interval Maximization Unit 122 Coordinate Conversion Unit 123 Shooting Distance Calculation Unit 123 124 vertical angle calculation means 125 horizontal angle calculation means 126 photographing procedure generation means 131 comparison means 132 correction means 133 image sequence output means 211 subject 212 table 213 background display device 214 image photographing device 215 switch 216 control device

Claims (8)

A moving image generation method for generating a moving image in a three-dimensional virtual space including a three-dimensional model of a subject using a plurality of two-dimensional still images obtained by photographing the subject from a plurality of directions,
Computer
Generating motion information for defining the motion of the three-dimensional model in the three-dimensional virtual space and the movement path of the viewpoint position;
From the operation information, the shooting conditions of the subject are determined such that the movement of the three-dimensional model is smooth when viewed from the user and the shooting interval of the subject is maximized,
According to the photographing conditions, the photographing device is photographed to obtain a plurality of two-dimensional still images,
Generating the three-dimensional model using the plurality of two-dimensional still images;
A moving image generation method for generating a moving image in a three-dimensional virtual space including the movement information and the generated three-dimensional model. As a process for determining the shooting condition of the subject,
Determining a shooting angle interval at which the movement of the three-dimensional model is smooth when viewed from the user, and the shooting interval of the subject is maximized, and the number of captured subjects is minimized;
Calculating coordinates of the viewpoint position in the three-dimensional virtual space;
Determining a shooting distance between the shooting device and the subject;
Calculate the angle of the shooting interval in the vertical direction by the shooting device,
Calculate the angle of the horizontal shooting interval by the imaging device,
The moving image generation method according to claim 1, wherein a shooting procedure for shooting along a shooting route set by the user is generated. A moving image generation system for generating a moving image of a three-dimensional virtual space including a three-dimensional model of a subject using a plurality of two-dimensional still images obtained by photographing the subject from a plurality of directions,
A virtual space information generating unit that generates motion information for defining a motion of the 3D model and a movement path of a viewpoint position in the 3D virtual space; a motion of the 3D model as viewed from a user from the motion information 3D including a shooting condition deriving unit for determining shooting conditions of the subject, and a three-dimensional model generated from the motion information and a plurality of two-dimensional still images, in which the shooting interval of the subject is maximized An editing device including a moving image generation unit for generating a moving image of a virtual space;
A subject photographing unit that photographs the subject with a photographing device according to the photographing condition and obtains a plurality of two-dimensional still images, and a three-dimensional model generation unit that generates the three-dimensional model using the plurality of two-dimensional still images. Photographing device,
A moving image generation system. The photographing condition deriving unit
Shooting interval maximizing means for determining a shooting angle interval at which the movement of the three-dimensional model is smooth as viewed from the user, the shooting interval of the subject is maximized, and the number of shots of the subject is minimized; ,
Coordinate conversion means for calculating coordinates of the viewpoint position in the three-dimensional virtual space;
Shooting distance calculation means for determining a shooting distance between the shooting device and the subject;
Vertical angle calculation means for calculating the angle of the vertical shooting interval by the imaging device;
Horizontal angle calculation means for calculating the angle of the horizontal shooting interval by the imaging device;
Photographing procedure generating means for generating a photographing procedure for photographing along the photographing route set by the user;
The moving image generating system according to claim 3. An editing apparatus provided in a moving image generation system for generating a moving image in a three-dimensional virtual space including a three-dimensional model of a subject using a plurality of two-dimensional still images obtained by photographing the subject from a plurality of directions Because
A virtual space information generation unit that generates operation information for defining the movement of the three-dimensional model and the movement path of the viewpoint position in the three-dimensional virtual space;
From the operation information, a shooting condition deriving unit that determines shooting conditions of the subject in which the movement of the three-dimensional model is smooth when viewed from the user and the shooting interval of the subject is maximized;
A moving image generating unit that generates a moving image of a three-dimensional virtual space including a three-dimensional model generated from the motion information and a plurality of two-dimensional still images;
An editing device. The photographing condition deriving unit
Shooting interval maximizing means for determining a shooting angle interval at which the movement of the three-dimensional model is smooth as viewed from the user, the shooting interval of the subject is maximized, and the number of shots of the subject is minimized; ,
Coordinate conversion means for calculating coordinates of the viewpoint position in the three-dimensional virtual space;
Shooting distance calculation means for determining a shooting distance between the shooting device and the subject;
Vertical angle calculation means for calculating the angle of the vertical shooting interval by the imaging device;
Horizontal angle calculation means for calculating the angle of the horizontal shooting interval by the imaging device;
Photographing procedure generating means for generating a photographing procedure for photographing along the photographing route set by the user;
The editing apparatus according to claim 5. Using a plurality of two-dimensional still images obtained by photographing a subject from a plurality of directions to cause a computer to execute processing for generating a moving image in a three-dimensional virtual space including a three-dimensional model of the subject A program,
Generating motion information for defining the motion of the three-dimensional model in the three-dimensional virtual space and the movement path of the viewpoint position;
From the operation information, the shooting conditions of the subject are determined such that the movement of the three-dimensional model is smooth when viewed from the user and the shooting interval of the subject is maximized,
According to the photographing conditions, the photographing device is photographed to obtain a plurality of two-dimensional still images,
Generating the three-dimensional model using the plurality of two-dimensional still images;
A program for causing a computer to execute a process of generating a moving image of a three-dimensional virtual space including the movement information and the generated three-dimensional model. As a process for determining the shooting condition of the subject,
Determining a shooting angle interval at which the movement of the three-dimensional model is smooth when viewed from the user, and the shooting interval of the subject is maximized, and the number of captured subjects is minimized;
Calculating coordinates of the viewpoint position in the three-dimensional virtual space;
Determining a shooting distance between the shooting device and the subject;
Calculate the angle of the shooting interval in the vertical direction by the shooting device,
Calculate the angle of the horizontal shooting interval by the imaging device,
The program according to claim 7 for causing a computer to execute processing for generating a shooting procedure for shooting along a shooting route set by the user.

Images