JP4200858B2 - Information processing apparatus and method, recording medium, and program - Google Patents

Description

  The present invention relates to an information processing apparatus and method, a recording medium, and a program, and in particular, an information processing apparatus and an information processing apparatus that can improve both operability and entertainment for browsing content (data, photographs, movies, and the like). The present invention relates to a method, a recording medium, and a program.

  In recent years, digital still cameras have become widespread. When a user browses a photograph (still image) taken with this digital still camera, the photographed photograph is moved to a personal computer as data, and the data moved by image application software installed in the personal computer. Can be displayed on a display of a personal computer or printed on photographic paper, and the photographic paper (photo) can be pasted on an album.

  As a method for browsing pictures using image application software on such a personal computer, for example, a slide show in which a plurality of pictures are sequentially switched and displayed on the entire display screen at predetermined time intervals. A method called a function and a method called a thumbnail function for displaying a list of a plurality of reduced images of a photo on a display screen are known. By using this thumbnail function, the user can simultaneously browse a plurality of photos when selecting a photo to be printed or organizing data.

  As image application software that enables browsing of photographs (still images), for example, “3D-ALBUM (trademark)” as shown in Non-Patent Document 1 is also known.

  By the way, in the same way as a digital still camera, in recent years, a digital video camera has been rapidly spread. When a user views a movie (moving image and its corresponding sound) shot with this digital video camera, the movie (moving image and its corresponding sound) is recorded as data in the same way as with a digital still camera. To a personal computer and, if necessary, recorded on a predetermined removable recording medium (for example, a DVD (Digital Versatile Disk)) and moved by an image (movie) application software installed on the personal computer. Or a movie corresponding to the data recorded on the DVD or the like can be displayed on the display of the personal computer.

Product description of “3D-ALBUM”, [online], Micro Reserch, INC homepage, [Search August 25, 2003], Internet, <URL: http://www.3d-album.com/>

  However, the conventional method of viewing a movie using image (movie) application software on a personal computer has a problem that operability and entertainment are inferior.

  That is, in many conventional methods for viewing movies using image (movie) application software on a personal computer, a display area (frame) of a movie called a player window is simply provided on the display screen. It is displayed and only one movie is reproduced in the player window, and the reproduction operation can be simply performed by basic operations such as reproduction, stop, fast forward and rewind. For this reason, when the user views the movie from a desired location (a location other than the beginning) using this method, the user needs to repeat the fast forward or rewind operation until the desired location is found. There is a problem that it is necessary to perform such an operation. In addition, this method cannot satisfy the demand for simultaneously playing a plurality of movies, and from such a viewpoint, there is a problem that operability and entertainment are lacking.

  Note that the user can also view a movie using “3D-ALBUM” of Non-Patent Document 1, but the number of movies that can be viewed is one at this time. The same problems as those of the conventional method of viewing movies using the conventional image (movie) application software are caused.

  By the way, generally, in a DVD, all the recorded data is divided into a plurality of recording sections in advance, and when a predetermined operation is performed, playback from the beginning of an arbitrary recording section is possible. . Such a DVD recording section is generally called a chapter.

  Therefore, when a picture (data) showing each chapter is recorded on a DVD, as a method of viewing a movie using an image (movie) application software on a personal computer, for example, the thumbnail function described above is used. By using each of a plurality of photos indicating each of a plurality of chapters as a list, and letting a user select a predetermined one of the plurality of photos displayed in the list, the selected photos are displayed. A method of starting playback from the beginning of the corresponding chapter is also conceivable.

  By using such a method for selecting a chapter, the user can easily perform an operation until a desired location in the movie is selected as compared with the method described above. However, in this method of selecting a chapter, a plurality of photos are simply displayed as a chapter table of contents, and it is difficult to say that such a display form itself is entertaining, It is difficult to say that the operation of selecting a chapter by the user is also entertaining. Also, this method only allows playback from a chapter corresponding to a predetermined one, and does not allow simultaneous playback of a plurality of chapters. From this viewpoint, operability and entertainment are lacking. It can be said that.

  The present invention has been made in view of such a situation, and makes it possible to improve both the operability and entertainment of browsing content (data, photographs, movies, etc.).

The information processing apparatus according to the present invention individually sets the reproduction quality including the reproduction rate and the resolution of each of the first moving image and the second moving image that are to be reproduced from among a plurality of moving images. The setting means, each of the first moving image and the second moving image is reproduced with the reproduction quality set by the setting means, and a first area and a second area of a predetermined 3D (3Dimensional) object are reproduced. Display control means for executing control to display the 3D object by pasting it as a texture to each of the display area, the setting means, the display area of the first area of the 3D object, and the original of the first moving image Based on the resolution, the resolution of the first moving image when playback is controlled by the display control means is set, and the display area of the second region of the 3D object and the original of the second moving image Based on resolution Then, the resolution of the second moving image when the reproduction is controlled by the display control means is set, and the reproduction is controlled by the display control means when the processing load exceeds a predetermined threshold. Of the moving images and the second moving image, the remaining moving images are reduced in reproduction rate until a load capable of maintaining the reproduction rate of the moving image of interest at a constant value is obtained .

  The 3D object is an object simulating an album having a book shape, and the display control means displays a 3D object simulating an album with a predetermined page opened, and the first moving image and the second moving image are displayed. Are pasted as textures on the first area corresponding to the place where the first photo is pasted and the second area corresponding to the place where the second photo is pasted on the page. Thus, it is possible to execute the control to be reproduced.

The display control means turns the page so that the next or previous spread page is displayed from the currently displayed spread page according to a user operation, and a new spread page of the plurality of moving images is displayed. In each of the third moving image and the fourth moving image that are to be reproduced in the first spread page, a third area corresponding to a place where the third photo is pasted, The control is executed to paste and reproduce the texture as a texture in each of the fourth areas corresponding to the place where the photograph is pasted, and the setting means displays a moving image displayed in the area within the page to be turned. The image reproduction rate can be lowered.

  Each of the plurality of moving images is associated with each of the plurality of still images, and the display control unit displays a 3D object as an initial state, and a first still image corresponding to the first moving image and , Further executing control for pasting and displaying each of the second still images corresponding to the second moving image as a texture in each of the first region and the second region of the 3D object, When the reproduction of the first moving image is instructed, the control of causing the first moving image to be pasted and displayed as a texture in the first area and the reproduction of the second moving image are instructed. In this case, each of the controls for pasting and displaying the second moving image as a texture in the second area can be executed independently.

  In the display control means, the shutter is pressed as at least one of a set of the first still image and the first moving image and a set of the second still image and the second moving image. A set of a still image of the shooting space shot by the shooting device at the time and a moving image of the shooting space shot by the shooting device during a predetermined period before and after the shutter is pressed is used. Can be.

  The setting means further sets the output level and the localization individually for each of the first sound corresponding to the first moving image and the second sound corresponding to the second moving image, It is possible to further provide sound output control means for executing control for outputting each of the sound and the second sound at the output level and localization set by the setting means.

The information processing method of the present invention individually sets the reproduction quality including the reproduction rate and resolution of each of the first moving image and the second moving image that are to be reproduced from among a plurality of moving images. Each of the setting step, the first moving image and the second moving image is reproduced with the reproduction quality set by the processing of the setting step, and the first region and the second of the predetermined 3D (3 Dimensional) objects are reproduced. A display control step of executing control to display the 3D object by pasting it as a texture in each of the regions, and in the setting step, the display area of the first region of the 3D object, and the first moving image Based on the original resolution, the resolution of the first moving image when reproduction is controlled by the processing of the display control step is set, and the display area of the second region of the 3D object is set And the resolution of the second moving image when playback is controlled by the processing of the display control step based on the original resolution of the second moving image, and the processing load is set to a predetermined threshold value. In the case of exceeding, until a load is reached that can maintain the reproduction rate of the moving image to be noticed at a constant value out of the first moving image and the second moving image whose reproduction is controlled by the process of the display control step. The reproduction rate of the remaining moving images is lowered .

The recording medium program of the present invention is a program that causes a computer to execute a moving image reproduction process, and is a first moving image and a second moving image that are to be reproduced from among a plurality of moving images. A setting step for individually setting the reproduction quality including the reproduction rate and resolution of each of the images, and reproducing each of the first moving image and the second moving image with the reproduction quality set by the processing of the setting step, paste as a texture to each of the first and second regions of the predetermined 3D (3Dimensional) object, and a display control step of performing control to display the 3D object, in the setting step, 3D When playback is controlled by processing of the display control step based on the display area of the first region of the object and the original resolution of the first moving image When the resolution of one moving image is set and playback is controlled by the processing of the display control step based on the display area of the second area of the 3D object and the original resolution of the second moving image The resolution of the second moving image is set and the load on the processing exceeds a predetermined threshold value, and the first moving image and the second moving image whose reproduction is controlled by the processing of the display control step Among them, the reproduction rate of the remaining moving images is lowered until a load that can maintain the reproduction rate of the moving image of interest at a constant value is obtained .

The program of the present invention is a program that causes a computer to execute a moving image reproduction process, and each of a first moving image and a second moving image that are to be reproduced from among a plurality of moving images. A setting step for individually setting the playback quality including the playback rate and resolution, and playing each of the first moving image and the second moving image with the playback quality set by the processing of the setting step, and a predetermined 3D And (3 Dimensional) including a control for displaying the 3D object by pasting it as a texture on each of the first area and the second area of the object, and executing the display control step . Based on the display area of the region and the original resolution of the first moving image, the first moving image in the case where the reproduction is controlled by the processing of the display control step The second in the case where the reproduction is controlled by the process of the display control step based on the display area of the second area of the 3D object and the original resolution of the second moving image based on the image intensity setting When the resolution of the moving image is set and the processing load exceeds a predetermined threshold value, attention is paid to the first moving image and the second moving image whose reproduction is controlled by the processing of the display control step. The reproduction rate of the remaining moving images is lowered until a load that can maintain the reproduction rate of the moving images at a constant value is reached .

In the information processing apparatus and method, the recording medium, and the program of the present invention, the reproduction rate and resolution of each of the first moving image and the second moving image to be reproduced among a plurality of moving images. reproduction quality including is set individually, each of the first moving image and the second moving image, is reproduced at the set reproduction quality, the first and second regions of its 3D object A 3D object pasted as a texture is displayed on a predetermined display device, the display area of the first region of the 3D object, and the original resolution of the first moving image And the resolution of the first moving image is set, and the second moving image is determined based on the display area of the second area of the 3D object and the original resolution of the second moving image. Resolution is set In addition, when the processing load exceeds a predetermined threshold, the reproduction rate of the noticed moving image of the first moving image and the second moving image is a load that can be maintained at a constant value. The playback rate of the remaining moving images is lowered.

  At this time, the display device for displaying the 3D object may be built in the information processing device itself, or may be an external display device or a display device built in another external information processing device. Good.

  Further, the moving image to be reproduced may be stored in advance in the information processing apparatus, or may be provided from another external apparatus or recording medium.

  Similarly, the 3D object may be stored in advance in the information processing apparatus, or may be provided from another external apparatus or recording medium. Alternatively, the information processing apparatus may generate a 3D object each time.

  As described above, according to the present invention, a moving image can be reproduced. In particular, since a plurality of moving images can be pasted on a predetermined 3D object and played back simultaneously, a user who views the moving images can view the moving images (contents) rich in entertainment with a simple operation. It becomes possible to do.

  Embodiments of the present invention will be described below. Correspondences between constituent elements described in the claims and specific examples in the embodiments of the present invention are exemplified as follows. This description is to confirm that specific examples supporting the invention described in the claims are described in the embodiments of the invention. Therefore, even if there are specific examples that are described in the embodiment of the invention but are not described here as corresponding to the configuration requirements, the specific examples are not included in the configuration. It does not mean that it does not correspond to a requirement. On the contrary, even if a specific example is described here as corresponding to a configuration requirement, this means that the specific example does not correspond to a configuration requirement other than the configuration requirement. not.

  Further, this description does not mean that all the inventions corresponding to the specific examples described in the embodiments of the invention are described in the claims. In other words, this description is an invention corresponding to the specific example described in the embodiment of the invention, and the existence of an invention not described in the claims of this application, that is, in the future, a divisional application will be made. Nor does it deny the existence of an invention added by amendment.

The information processing apparatus according to claim 1 (for example, the information processing apparatus 1 of FIG. 1) is a first moving image (for example, the moving image of FIG. 3) that is a reproduction target among a plurality of moving images. 51-a) and the second moving image (e.g., may be any of the remaining moving image 51-B to the moving image 51-C in FIG. 3, hereinafter referred to as moving image 51-B) of each playback rate And the resolution (for example, FPS (reproduction rate) and Size (reproduction resolution)) in the display information of each of the moving image (data) 51-A and moving image (data) 51-B in FIG. 1 (for example, when the information processing apparatus 1 in FIG. 1 is configured as a personal computer as in FIG. 5), the setting unit 19 in FIG. Each of the first moving image and the second moving image The first area (for example, the area 41-A in FIG. 3) and the second of the predetermined 3D (3Dimensional) objects (for example, the 3D album 31 in FIG. 3) are reproduced with the reproduction quality set by the stage. Display control means (for example, the display control unit 15 in FIG. 1, for example, the display control unit 15 in FIG. 1), and pastes it as a texture to each of the regions (for example, the region 41-B in FIG. 3). If the information processing apparatus 1 of FIG. 1 is configured as a personal computer as in FIG. 5, a graphics card 79 of FIG. 5, with Figure CPU71 5) to control it, setting means, first of 3D objects The display area of one region (for example, the region 41-A in FIG. 3) and the original resolution of the first moving image (for example, the moving image 51-A in FIG. 3) (for example, the moving image (data in FIG. 4) 51-A Based on the resolution (Size = 640 × 480) included in the source information, the resolution of the first moving image when reproduction is controlled by the display control means (for example, moving image (data) 51− of FIG. 4) A display resolution (Size = 320 × 240) included in the display information of A is set, and the display area of the second area (for example, the area 41-B in FIG. 3) of the 3D object and the second moving image Based on the original resolution of the image (for example, the moving image 51-B in FIG. 3) (for example, the resolution (Size = 640 × 480) included in the source information of the moving image (data) 51-B in FIG. 4). The resolution of the second moving image (for example, the display resolution (Size = 320 × 240) included in the display information of the moving image (data) 51-B in FIG. 4) when reproduction is controlled by the display control means. Set (ie, execute the resolution control of FIG. 28 based on the table of FIG. 29, for example) In addition, when the processing load exceeds a predetermined threshold value, a noticed moving image (for example, a diagram) of the first moving image and the second moving image whose reproduction is controlled by the display control unit. The remaining moving images (for example, in this case, moving images) until the reproduction rate of the moving image 51-A pasted in the area 41-A in which the third cursor 42 is arranged can be maintained at a constant value. 51-B) is reduced (for example, as shown in FIGS. 26 and 27, the FPS of the display information of the moving image 51-B is reduced from 15 to 7). That is, for example, the reproduction rate control of FIG. 25 is executed).

  3. The information processing apparatus according to claim 2, wherein the 3D object is an object imitating an album having a book shape (for example, 3D album 31 in FIG. 3), and the display control means opens a predetermined page. The 3D object imitating the album is displayed (for example, as shown in FIG. 3), and each of the first moving image and the second moving image is displayed on the first of the pages. Performing control to paste and reproduce as a texture in each of the first area corresponding to the place where the second photo is pasted and the second area corresponding to the place where the second photograph is pasted Features.

5. The information processing apparatus according to claim 4 , wherein each of the plurality of moving images is associated with each of a plurality of still images (for example, each of the moving images 51-A to 51-D in FIG. The display control unit displays the 3D object as an initial state and associates the first moving image with the first moving image. The still image and the second still image corresponding to the second moving image are pasted and displayed as textures in the first area and the second area of the 3D object, respectively. If the control is further executed (for example, the initial image display process of FIG. 8 is executed) and then the reproduction of the first moving image is instructed, the first moving image is textured in the first region. age The control for pasting and displaying and the control for pasting and displaying the second moving image as a texture in the second area when reproduction of the second moving image is instructed are executed independently. It is characterized by doing.

6. The information processing apparatus according to claim 5 , wherein the display control means includes a set of the first still image and the first moving image, and the second still image and the second moving image. As at least one of the sets, a still image (for example, in FIG. 38) of the shooting space shot by the shooting device (for example, the digital short movie camera 201 in FIGS. 38 to 42) when the shutter is pressed. As shown, a still image 32 at time t1 when the shutter 212 is pressed, and a moving image of the shooting space (for example, taken by the shooting device during a predetermined period before and after the shutter is pressed) As shown in FIG. 38, a combination with a moving image 51) at time T before and after time t1 when the shutter 212 is pressed is used.

The information processing apparatus according to claim 6 , wherein the setting unit is configured for each of a first sound corresponding to the first moving image and a second sound corresponding to the second moving image. The output level and the localization are individually set (for example, the simultaneous sound reproduction control of FIG. 31 is executed), and the first sound and the second sound are set to the output level set by the setting unit and Audio output control means (for example, the audio output control unit 17 in FIG. 1 in which the information processing apparatus 1 in FIG. 1 is configured as a personal computer as shown in FIG. 5). 5 is further provided with a sound card 77 in FIG. 5 and a CPU 71 in FIG. 5 for controlling the sound card.

The information processing method according to claim 7 , wherein the reproduction quality including the reproduction rate and the resolution of each of the first moving image and the second moving image to be reproduced among the plurality of moving images is individually set. (For example, each step such as the playback rate control process of FIG. 25 and the resolution control process of FIG. 28 executed by the setting unit 19 of FIG. 1), the first moving image, and the first Each of the two moving images is reproduced with the reproduction quality set by the processing of the setting step, and is pasted as a texture on each of the first area and the second area of a predetermined 3D (3Dimensional) object. Display control step for executing control for displaying the 3D object (for example, in each step of the 3D album display process of FIGS. 18 to 21 executed by the main control unit 11 and the display control unit 15 of FIG. 1). In particular, in the setting step, the display area of the first region of the 3D object and the first moving image are included in the setting step. And setting the resolution of the first moving image when playback is controlled by the processing of the display control step, and the display area of the second area of the 3D object, Based on the original resolution of the moving image, the resolution of the second moving image in the case where the reproduction is controlled by the processing of the display control step is set, and the display control is performed when the processing load exceeds a predetermined threshold Of the first moving image and the second moving image, the reproduction of which is controlled by the processing of the step, it becomes a load capable of maintaining the reproduction rate of the moving image of interest at a constant value. Until, characterized in that lowering the playback rate of the remaining moving image.

  Hereinafter, an information processing apparatus to which the exemplary embodiment is applied will be described with reference to the drawings.

  FIG. 1 shows a configuration example of an information processing apparatus to which this exemplary embodiment is applied.

  In the information processing apparatus 1 of FIG. 1, the main control unit 11 controls the entire information processing apparatus 1. That is, the main control unit 11 controls at least a part of the content storage unit 13 to the setting unit 19 (excluding the display unit 16 and the audio output unit 18) based on information input from the input unit 12, for example. To do.

  The input unit 12 inputs various types of information to the information processing apparatus 1 (main control unit 11) by a user operation.

The content storage unit 13 stores various contents such as photographs (still images) and movies (moving images and corresponding sounds) as data. That is, the content storage unit 13 stores a plurality of still image data or a set of moving image data and audio data (more precisely, this set is further shown in FIG. 3 described later). In this way, a plurality of sets of still images associated with the respective moving images are included.

  A 3D (3 Dimensional) object storage unit 14 is a 3D object 31 (hereinafter referred to as a 3D object 31) imitating a predetermined 3D object, for example, an album having a book shape as shown in FIG. Such a 3D object 31 is referred to as a 3D album 31).

  The display control unit 15 controls display on the display unit 16. That is, the display unit 16 displays a still image (such as a photograph) or a moving image (such as a moving image constituting a movie) based on the control of the display control unit 15.

  In addition, in reality, pictures and the like are included in addition to photographs, but hereinafter, still images and photographs are used as synonyms unless otherwise noted. A movie is composed of a moving image and sound corresponding to the movie, but it is not necessary to consider the sound of the movie when described as a comparison with a still image. Therefore, when such consideration for the sound of a movie is not particularly necessary, a moving image and a movie may be used as synonyms.

  Specifically, for example, the display control unit 15 acquires the data of the 3D album 31 in which a predetermined page is opened, which is stored in the 3D object storage unit 14, and the predetermined 4 stored in the content storage unit 13. The data of one photo (for example, the still image 32 shown in FIG. 2) is acquired, and each of the four photos is assigned to an opened page of the 3D album 31 (hereinafter, such pages are referred to as two pages). The 3D album 31 in which four photos (still images 32) are pasted on a predetermined two-page spread is displayed on the display unit 16.

  That is, when the user views a still image 32 (or a still image 32 supplied as data from the outside of the information processing apparatus 1 as described later) stored as data in the content storage unit 13, the input unit 12, a desired still image 32 (photograph) is displayed on the display unit 16 (or an external display device such as the television receiver 102 of FIG. 5 described later, which is not shown in FIG. 1). ) Can be displayed.

  Further, as indicated by a dotted line in FIG. 2, the user can turn (send) the page of the 3D album 31 by turning the input unit 12 so as to turn the page of the actual album. In other words, in the example of FIG. 2, four still images 32 (photos) are pasted on the two-page spread of the 3D album 31, so that when the user wants to view five or more still images 32, the input unit 12. , Turn the page of the 3D album 31 (change the two-page spread), a new image that is different from the still image 32 displayed so far (the photo pasted on the two-page spread) A still image 32 (a photograph pasted on the changed two-page spread) can be displayed on the display control unit 15. The details of the page feed of the 3D album 31 will be described later with reference to FIGS.

  In this way, the user turns the pages of the 3D album 31 by operating the input unit 12 (displays such an image), and various photos pasted on the respective pages of the 3D album 31. You can browse or select (select) a desired photo. Further, in the present embodiment, the display form of the photo is a form that is pasted and displayed on each page of the 3D album 31, and as a result, compared to the display form by the conventional slide show function or the like. It has become a more entertaining form.

  By the way, the display control unit 15 can paste a photo (still image 32) on each page of the 3D album 31, but can also paste a moving image.

  For example, FIG. 3 shows an example of a moving image pasted as a texture on each page of the 3D album 31.

  As shown in FIG. 3, for example, it is assumed that each of the moving images 51-A to 51-D is associated with each of the still images 32-A to 32-D. That is, the content storage unit 13 includes a set of moving image 51-A and still image 32-A, a set of moving image 51-B and still image 32-B, a moving image 51-C and a still image 32-C. And a set of moving image 51-D and still image 32-D are stored as data.

  In this case, for example, as an initial state, the display control unit 15 acquires the respective data of the still image 32-A to the still image 32-D from the content storage unit 13 and displays a predetermined two-page spread on the 3D album 31. The areas 41 -A to 41 -D are pasted as textures, and the 3D album 31 is displayed on the display unit 16.

  Further, the display control unit 15 causes the display unit 16 to display the cursor 42 indicated by the dotted frame in FIG. 3 so as to be arranged at the position of the region 41-A, for example.

  The user operates the input unit 12 to cause the information processing apparatus 1 to input a predetermined command, thereby moving the position of the cursor 42 (displaying an image in which the position of the cursor 42 has been moved is displayed on the display unit 16). Can do. However, the cursor 42 is arranged at any position in the areas 41-A to 41-D, and the current position in the areas 41-A to 41-D is one command from the input unit 12. It is assumed that the area 41-A to the area 41-D are moved from the arranged area to the previous area or the next area. Specifically, for example, although not shown in the figure, if the cursor 42 is arranged in the area 41-B, the cursor 42 is moved to the area 41-A or the area by a single command from the input unit 12. 41-C.

  As shown in FIG. 3, when the cursor 42 is placed in the area 41 -A, the cursor 42 is moved to the area before the area 41 -A or the area by one command from the input unit 12. 41-B. Here, the area before the area 41 -A refers to an area existing on a page (a page that is not displayed) immediately before the two spread pages of the 3D album 31 currently displayed on the display unit 16. Therefore, when the cursor 42 is moved to the area in front of the area 41-A, the above-described page turning is performed, and the page 2 immediately before the current two pages is displayed as two pages on the display unit 16. This means that the 3D album 31 is displayed, and the cursor 42 is displayed in the lower right area of the two-page spread (area corresponding to the area 41-D in FIG. 3).

  Similarly, although not shown, if the cursor 42 is arranged in the area 41-D, the cursor 42 is moved to the area 41-C or the area 41-D by a single command from the input unit 12. Moved to the area. Here, the area next to the area 41 -D refers to an area existing on a page (a page not displayed) immediately after two spread pages of the 3D album 31 currently displayed on the display unit 16. Therefore, when the cursor 42 is moved to the area next to the area 41-D, the above-described page turning is performed, and two pages immediately after the current two pages are displayed as two spread pages on the display unit 16. This indicates that the 3D album 31 is displayed, and the cursor 42 is displayed in the upper left area of the two-page spread (area corresponding to the area 41-A in FIG. 3).

  Hereinafter, such a command (input) for moving the cursor 42 is referred to as “cursor movement” in order to distinguish it from other commands described later.

  In this way, the user moves the position of the cursor 42 by simply operating the input unit 12 to input “move cursor” to the information processing apparatus 1, and the spread 2 of the 3D album 31. A desired one of the still images 32-A to 32-D pasted on the page can be selected, or a page of the 3D album 31 can be turned.

  Further, after the user selects a predetermined still image 32-n (n is any sign of A to Z) (after moving the cursor 42 to the position of the still image 32-n), By operating the input unit 12 to cause the information processing apparatus 1 to input a predetermined command, the moving image 51-n associated with the selected still image 32-n (the still image 32-A in the example of FIG. 3). The moving image 51-A) associated with can be reproduced. Hereinafter, this command is referred to as “movie playback” in order to distinguish it from other commands described above or later.

  Further, here, when it is not necessary to distinguish and explain the still image 32-n, as described above, the still image 32-n is simply referred to as the still image 32. Accordingly, similarly to the relationship between the still image 32-n and the still image 32, hereinafter, the moving image 51-n will be referred to simply as the moving image 51 when it is not necessary to be described separately.

  Specifically, for example, in FIG. 3, still images 31 -A to 31 -D are respectively present in regions 41 -A to 41 -D on the two-page spread of the 3D album 31. With the image pasted and the cursor 42 arranged in the area 41 -A being displayed on the display unit 16, the user operates the input unit 12 to perform “movie playback” via the main control unit 11. Is input to the display control unit 15.

  In this case, the display control unit 15 moves the moving image 51-A corresponding to the still image 32-A on which the cursor 42 is arranged (the still image 32-A pasted on the area 41-A on which the cursor 42 is arranged). Is obtained from the content storage unit 13. Then, the display control unit 15 starts reproduction of the moving image 51-A, and pastes the reproduced moving image 51-A as a texture in the region 41-A. Then, the display control unit 15 pastes an image including the 3D album 31 (the moving image 51-A being reproduced is pasted in an area 41-A where the cursor 42 is arranged in the two facing pages of the 3D album 31). The still image 32-B to the still image 32-D are pasted on each of the other regions 41-B to 41-D, and the display unit 16 displays them.

  Thus, the information processing apparatus 1 pays attention to the still image 32 (the still image 32-A pasted on the region 41-A in the example of FIG. 3) on which the cursor 42 is arranged. When “movie playback” is input, a moving image 51 having the same size as the still image 32 (in the still image 32) is displayed at the same position (in the example of FIG. 3, area 41-A) as the still image 32. In the example of FIG. 3, the reproduction of the moving image 51 -A) that is associated with the moving image 51 can be started.

  In this case, the information processing apparatus 1 may perform the loop reproduction of the moving image 51 when the reproduction of the moving image 51 is completed (when the reproduction position reaches the end), or the original still image may be reproduced. A process of switching the drawing to 32 may be executed. Here, the trigger for playing the moving image 51 is an input from the user (“movie playback” from the input unit 12), but is not limited to this, and a specified time after the cursor 42 is arranged. May have passed.

  Generally, since the moving image 51 is associated with sound, that is, in FIG. 1, the content storage unit 13 also stores sound corresponding to the moving image 51 as data. While the display control unit 15 controls the reproduction of the moving image 51 (while the moving image 51 is displayed on the display unit 16), the audio output control unit 17 outputs the audio corresponding to the moving image 51. Control is performed to acquire data from the content storage unit 13 and output audio corresponding to the data from the audio output unit 18. That is, while the display unit 16 reproduces (displays) the moving image 51, the audio output unit 18 reproduces (outputs) audio corresponding to the moving image 51.

  The example in which one moving image 51 is pasted to two pages of the 3D album 31 (one moving image 51 is reproduced) has been described above. However, the information processing apparatus 1 according to the present embodiment further includes 3D. A plurality of moving images 51 can be pasted on two pages of the album 31 (a plurality of moving images 51 can be reproduced simultaneously) and displayed on the display unit 16.

  That is, the display control unit 15 sets the content (moving image 51 or still image 32) to be pasted to each of the four regions 41-A to 41-D on a predetermined two-page spread of the 3D album 31 as another region. Can be selected independently.

  Specifically, for example, the display control unit 15 acquires either one of the still image 32-A and the moving image 51-A from the content storage unit 13, and pastes it as a texture in the region 41-A. The processing can be executed independently of the processing in other areas.

  Similarly, for example, the display control unit 15 acquires any one of the still image 32-B and the moving image 51-B from the content storage unit 13 and pastes the data as a texture in the region 41-B. Processing for acquiring either one of the still image 32-C and the moving image 51-C from the content storage unit 13 and pasting it as a texture in the area 41-C, and the still image 32-D from the content storage unit 13 The process of acquiring any one of the moving images 51-D and pasting it as a texture in the area 41-D can be executed independently of the processes of the other areas.

  However, for the sake of simplicity, the number of moving images 51 that are simultaneously reproduced in one screen of the display unit 16 is one or all. In other words, hereinafter, it is assumed that the information processing apparatus 1 reproduces the moving image 51 in one of the following first display form and second display form. In other words, as described above, the first display form is an area (in the example of FIG. 3, the areas 41 -A to 41 -A to which the content (still image 34 or moving image 51) of two-page spread of the 3D album 31 is pasted. In the area 41-D), one moving image 51 is pasted to the area where the cursor 42 is arranged (in the example of FIG. 3, the moving image 51-A is pasted to the area 41-A). The still image 32 is pasted on the remaining area (in the example of FIG. 3, the still image 32-B is in the area 41-B, the still image 32-C is in the area 41-C, and the still image is in the area 41-D. 32-D is displayed). In the second display mode, a moving image is pasted in all the areas where the content of the two-page spread of the 3D album 31 is pasted (in the example of FIG. 3, the four areas 41-A to 41 are included). -D is a display form in which each of the moving images 51-A to 51-D is pasted.

  In the following, among the “movie playback” input from the input unit 12, a command for instructing the second display form (command for playing back all the moving images 51) is particularly referred to as “all movie playback”. .

  That is, when “all movie playback” is input from the input unit 12 via the main control unit 11, the display control unit 15 stores the data of the moving images 51 -A to 51 -D in the content storage unit 13. It is acquired, reproduced, and pasted as a texture in each of the areas 41-A to 41-D. The display control unit 15 then displays the 3D album 31 in which each of the moving images 51-A to 51-D being reproduced is pasted in each of the two-page spread areas 41-A to 41-D. To be displayed on the display unit 16.

  In this case, as an initial state of reproduction, for example, the display control unit 15 sets the reproduction quality (resolution, reproduction rate, etc.) of all the moving images 51-A to 51-D to the original reproduction quality (content storage). Reproduction quality specified in the data of the moving image 51-A to moving image 51-D stored in the unit 13).

  However, simultaneous playback of a plurality of moving images 51 is a heavy processing for the information processing device 1, and the processing capability of the information processing device 1 is low, or the information processing device 1 is in an overloaded state. In this case, the display control unit 15 has a problem that it is impossible to maintain the reproduction quality of all the moving images 51-A to 51-D with the original reproduction quality. .

  Therefore, in order to solve this problem, the information processing apparatus 1 according to the present embodiment is provided with a setting unit 19 (FIG. 1). That is, as shown in FIG. 4, the setting unit 19 constantly monitors the state of the information processing apparatus 1 via the main control unit 11 and the display state of the display unit 16 via the display control unit 15. Monitoring, and based on the monitoring result, the playback quality of each of the moving images 51-A to 51-D that are currently being played is set individually.

  Specifically, the main control unit 11 is often configured as a CPU (Central Processing Unit) as shown in FIG. Further, the information processing apparatus 1 is often connected to a network and transmits and receives various information via the network. Therefore, for example, as illustrated in FIG. 4, the setting unit 19 acquires a CPU load and a network bandwidth load from the main control unit 11 as information for monitoring the state of the information processing apparatus 1. In addition, the setting unit 19 acquires the screen resolution of the display unit 16 from the main control unit 11 as information for monitoring the state of the information processing apparatus 1.

  Further, as shown in FIG. 4, for example, ID, source information, display information, and each of the data of the moving images 51 -A to 51 -D to be controlled by the display control unit 15, Attached information such as a cursor is included.

  The ID is an identifier assigned to the moving image 51 individually. The source information is the original reproduction quality of the moving image 51, that is, the resolution (Size) and the reproduction rate (FPS (Frame per second)) of the moving image 51 specified at the time when the moving image 51 is stored. It is information which shows. The display information is information indicating the current reproduction quality of the moving image 51, that is, the resolution (Size) and the reproduction rate (FPS) of the moving image at the present time being reproduced on the display unit 16. The cursor is information indicating whether or not the cursor 42 (FIG. 3) is placed in the area where the moving image 51 is pasted. For example, in the example of FIG. 4, a circle mark is described in the item of the cursor of the moving image 51-A, but this circle mark (actually, for example, a value such as “1” in the binary value) is displayed. , Information indicating that the cursor 42 is arranged. In addition, an X mark is described in each cursor item of the moving image 51-B to the moving image 51-D, but this X mark (actually, for example, a value such as “0” in a binary value). ) Is information indicating that the cursor 42 is not arranged.

  Therefore, the setting unit 19 acquires each of the incidental information included in each of the data of the moving images 51-A to 51-D as information for monitoring the display state of the display unit 16.

  In addition, when an animation to be described later (see FIGS. 10 to 17) is displayed on the display unit 16, the setting unit 19 displays the animation display state (hereinafter referred to as the information for monitoring the display state of the display unit 16). Such a state is referred to as an animation state).

  Then, the setting unit 19 comprehensively collects the acquired information (CPU load, network bandwidth load, screen resolution, respective supplementary information of the data of the moving image 51-A to the moving image 51-D, the animation state, etc.). Therefore, the reproduction quality of each of the moving images 51-A to 51-D is set. That is, the setting unit 19 updates the display information contents (resolution (Size) and playback rate (FPS)) of each of the moving images 51-A to 51-D. Then, the display control unit 15 moves the moving images 51-A to 51-D in accordance with the contents of the updated display information, that is, with the updated resolution (Size) and the updated playback rate (FPS). Play each of the.

  In the following, the control executed by the setting unit 19, that is, the control for setting the playback rate (FPS) in the control for setting the playback quality is referred to as playback rate control and the resolution (FPS). ) Setting control is referred to as resolution control.

  By the way, when each of the moving images 51-A to 51-D is reproduced (displayed) on the display unit 16, the audio output unit 18 controls the moving images under the control of the audio output control unit 17. Each of the first to fourth sounds corresponding to each of 51-A to 51-D is also reproduced (output).

  In this case, if all of the first to fourth sounds are output from the sound output unit 18 at the same output level and the same localization, the first to fourth sounds are mixed. Thus, there arises a problem that it is difficult for the user to hear (it is difficult to distinguish each of the first to fourth sounds).

  Therefore, in order to solve such a problem, for example, the setting unit 19 further sets an output level and a localization for each of the first to fourth sounds, and sets the setting contents. The audio output control unit 17 is supplied. Then, the sound output control unit 17 causes the sound output unit 18 to output each of the first sound to the fourth sound according to the setting content.

  Hereinafter, the control of setting the output level and the localization for each of a plurality of sounds performed by the setting unit 19 in this way is referred to as simultaneous sound reproduction control.

  As described above, the setting unit 19 can independently execute the reproduction rate control, the resolution control, and the audio simultaneous reproduction control. Details of each of the playback rate control, resolution control, and simultaneous audio playback control will be described later.

  As described above, with reference to FIG. 2 and FIG. 3, the information processing apparatus 1 pastes only the still image 32 on the predetermined two spread pages of the 3D album 31 or pastes only the moving image 51 ( However, in the case where the moving image 51 is not reproduced, the example in which the still image 32 associated with the moving image 51 is pasted as a thumbnail has been described.

  Furthermore, the information processing apparatus 1 includes a still image 32 (for example, a photograph taken by a digital still camera 103 in FIG. 5 described later) and a moving image 51 (for example, FIG. 5 described later) that are not associated with the moving image 51. And a photograph taken by the digital video camera 104 can be mixed and pasted. Thus, the user does not need to be aware of the difference in data between the still image 32 and the moving image 51, and can view each of the still image 32 and the moving image 51 with exactly the same operation.

  By the way, the form of the information processing apparatus 1 is not limited to the example of FIG. 1 as long as it has at least the functions of the display control unit 15, the audio output control unit 17, and the setting unit 19 shown in FIG. Can take various forms. Also, each form of the display control unit 15, the audio output control unit 17, and the setting unit 19 is not particularly limited, and may be configured by software, may be configured by hardware, or It may be configured by a combination of software and hardware.

  Specifically, for example, the information processing apparatus 1 can be configured as a personal computer as shown in FIG.

  In the information processing apparatus 1 of FIG. 5, the CPU 71 executes various processes according to a program recorded in a ROM (Read Only Memory) 72 or a program loaded from a storage unit 81 to a RAM (Random Access Memory) 73. . The RAM 73 also appropriately stores data necessary for the CPU 71 to execute various processes. That is, for example, the CPU 71 corresponds to the main control unit 11 in FIG.

  Further, for example, when the setting unit 19 in FIG. 1 is configured as a program and the program is stored in the storage unit 81, the CPU 71 executes processing according to the program loaded from the storage unit 81 to the RAM 73. The function of the setting unit 19 can be realized.

  The CPU 71, ROM 72, and RAM 73 are connected to each other via a bus 74. An input / output interface 75 is also connected to the bus 74.

  The input / output interface 75 is also connected to a portable remote controller 91, a wireless receiver 92 for receiving information wirelessly transmitted from the remote controller 91, and an input unit 76 including a keyboard 93. . That is, for example, the input unit 76 corresponds to the input unit 12 of FIG. Therefore, although not shown in the figure, by associating the upward movement key and the downward movement key of the remote controller 91 with the above-described “cursor movement”, the user can perform the operation shown in FIG. It becomes possible to view a desired still image 32 or moving image 51 pasted on the 3D album 31 shown in FIG.

  Also connected to the input / output interface 75 are a sound card 77 for executing control for outputting sound from the speaker 78 and a graphics card 79 for executing control for displaying an image on the display 80 or the external television receiver 102. ing.

  That is, the sound card 77 performs predetermined processing (for example, processing for changing the localization) on the supplied audio data and the like, and further converts the data into a music signal in the format of the speaker 78 to obtain a predetermined level. To the speaker 78. The speaker 78 outputs the sound corresponding to the supplied audio signal to the outside at an output level corresponding to the level of the supplied audio signal. Therefore, the sound card 77 and the CPU 71 that controls the sound card 77 correspond to the audio output control unit 17 in FIG. The speaker 78 corresponds to the audio output unit 18 of FIG.

  The graphics card 79 performs predetermined processing (for example, 3D graphics processing such as texture mapping processing) on the supplied still image or moving image data, and further converts it into an image signal in the format of the display 80. Then, it is supplied to the display 80, converted into an image signal in the format of the television receiver 102, and supplied to the television receiver 102. The display 80 and the television receiver 102 display an image (still image or moving image) corresponding to the supplied image signal on the screen. Accordingly, the graphics card 79 and the CPU 71 that controls the graphics card 79 correspond to the display control unit 15 in FIG. The display 80 corresponds to the display unit 16 in FIG.

  A storage unit 81 and a communication unit 82 are also connected to the input / output interface 75.

  The storage unit 81 is configured by, for example, a hard disk or the like, and stores programs and data groups for the information processing apparatus 1 to function. That is, the storage unit 81 stores not only the operating system and setting information, but also application software, data associated therewith, audio and image data, and the like.

  Specifically, for example, the storage unit 81 displays an image (an image in which a still image 32, a moving image 51, etc. are pasted on the 3D album 31) as shown in FIG. Application software for executing the function to be performed, that is, a program for realizing the function of the setting unit 19 in FIG. 1, a program for controlling the sound card 77 (ie, a program for realizing at least a part of the function of the audio output control unit 17), In addition, application software to which the present embodiment is applied, which includes a program for controlling the graphics card 79 (that is, a program for realizing at least a part of the function of the display control unit 15) or the like, is stored.

  Further, the storage unit 81 stores the data of the 3D album 31 shown in FIGS. 2 and 3 and the contents pasted on the 3D album 31 (that is, the data of the still image 32 and the moving image 51 and the moving image 51). Corresponding audio data, etc.) are stored. That is, the predetermined area of the storage unit 81 corresponds to each of the content storage unit 13 and the 3D object storage unit 14 in FIG.

  The communication unit 82 controls communication with another information processing apparatus (not shown) via a network (not shown). That is, for example, the communication unit 82 receives content (for example, data of a still image 32 or a movie (moving image 51 and corresponding sound) data that can be pasted on the 3D album 31) distributed from another information processing apparatus. And received via a network or the like and supplied to the storage unit 81 or the like. In addition, for example, the content supplied from the storage unit 81 or the CPU 11 is transmitted to another information processing apparatus via a network or the like.

  A drive 83 is connected to the input / output interface 75 as necessary, and a removable recording medium 101 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately installed, and a computer program read from them is read. Alternatively, content (for example, data of a still image 32 or a movie (moving image 51 and corresponding sound) that can be pasted on the 3D album 31) is installed in the storage unit 81 as necessary.

  Further, a USB (Universal Serial Bus) interface 84 and an IEEE (Institute of Electrical and Electronics Engineers) 1394 interface 85 are connected to the input / output interface 75.

  Various USB devices (in the example of FIG. 5, the digital still camera 103) can be connected to the USB interface 84, and the information processing apparatus 1 communicates with the USB device connected to the USB interface 84. be able to. Specifically, for example, in the example of FIG. 5, the digital still camera 103 is connected to the USB interface 84 as a USB device, and the photo data output from the digital still camera 103 is transmitted via the USB interface 84. And stored in the storage unit 81. That is, the information processing apparatus 1 can use the photo data output from the digital still camera 103 as data of the still image 32 to be pasted on the 3D album 31.

  The IEEE1394 interface 85 is a high-speed digital serial interface that conforms to the IEEE1394 standard. Therefore, the information processing apparatus 1 can transmit / receive data (data stored in a packet) conforming to the IEEE1394 standard to / from other information processing apparatuses connected to the IEEE1394 interface 85. Specifically, for example, in the example of FIG. 5, a digital video camera 104 is connected to the IEEE1394 interface 85, and movie data output from the digital video camera 104 is stored via the IEEE1394 interface 85. Stored in the unit 81. That is, the information processing apparatus 1 can use the movie data output from the digital video camera 104 as moving image 51 data to be pasted on the 3D album 31 and audio data corresponding to the moving image 51. .

  FIGS. 6 and 7 are flowcharts for explaining an example of processing in which the information processing apparatus in FIG. 1 displays the 3D album 31 (image as shown in FIG. 2) with the still image 32 pasted on the display unit 16. is there. Hereinafter, the process of displaying the 3D album 31 on which the content (the still image 32, the moving image 51, etc.) is pasted on the display unit 16 as shown in FIGS. 2 and 3 is referred to as a 3D album display process.

  Therefore, with reference to FIG. 6 and FIG. 7, a process for pasting the still image 32 in the 3D album display process will be described below. Of the 3D album display processing, processing for attaching the moving image 51 also will be described later with reference to the flowcharts of FIGS.

  In the 3D album display process of FIGS. 6 and 7, first, in step S1 of FIG. 6, the information processing apparatus 1 (the display control unit 15 controlled by the main control unit 11) has predetermined 4 pages on the first two spread pages. An image including the 3D album 31 to which a piece of content (still image 32) is pasted is displayed on the display unit 16.

  Hereinafter, such an image initially displayed on the display unit 16 is referred to as an initial image, and such processing in step S1 is referred to as “initial image display processing”.

  An example of detailed processing of the “initial image display processing” is shown in the flowchart of FIG. Therefore, an example of detailed processing of “initial image display processing” will be described with reference to the flowchart of FIG.

  First, in step S21, the display control unit 15 creates a list in which a plurality of image data stored in the content storage unit 13 is sorted in a predetermined order.

  In this case, the image data to be sorted does not have to be all image data stored in the content storage unit 13, and may be image data selected by the user operating the input unit 12, for example.

  Specifically, for example, it is assumed that a plurality of folders are produced in advance in the content storage unit 13 and one or more related contents are stored in each of these folders. In this case, the user operates the input unit 12 to select a predetermined one from these folders, thereby giving a command to sort the image data included in the selected folder. It can be input via the control unit 11. At this time, when the display control unit 15 acquires the command via the main control unit 11, in step S21, the display control unit 15 creates a list in which a plurality of image data included in the designated folder is sorted in a predetermined order. .

  In step S <b> 22, the display control unit 15 acquires background image data (not shown) from the content storage unit 13 or the 3D object storage unit 14 and causes the display unit 16 to display a background image corresponding to the data.

  In step S23, the display control unit 15 reads from the content storage unit 13 the fourth image data from the top of the list generated in step S21.

  In step S <b> 24, the display control unit 15 pastes four images (still images 32) corresponding to the read image data as textures on the two-page spread of the 3D album 31 on the display unit 16. Display.

  Specifically, for example, now, in step S <b> 23, the display control unit 15 causes the display control unit 15 to select each of the still images 32-A to 32-D (FIG. 10) from the content storage unit 13. Assume that data is read. At this time, for example, the display control unit 15 also acquires, from the 3D object storage unit 14, data of the 3D album 31-1 as shown in FIG.

  In this case, as shown in FIG. 10, in step S24, the display control unit 15 pastes each of the still images 32-A to 32-D as a texture on the two-page spread of the 3D album 31-1. The 3D album 31-1 to which such a texture (still image 32-A to still image 32-D) is pasted is displayed on the display unit 16.

  Returning to FIG. 8, in step S <b> 25, the display control unit 15 also displays the cursor 42 (FIG. 3) on the display unit 16. That is, in this case, although not shown in FIG. 10, the display control unit 15 displays the upper left area of the two spread pages of the 3D album 31-1 (area corresponding to the area 41-A in FIG. 3). That is, the cursor 42 is displayed at the position where the still image 32-A is pasted.

  Thereby, the “initial image display process” is completed, and in step S2 of FIG. 6, the main control unit 11 determines whether or not an input from the user has been made.

  If no input is made from the input unit 12 (when it is determined in step S2 that no input from the user has been made), the process returns to step S2 to determine again whether or not the input from the user has been made. Determined. That is, the execution of the 3D album display process is awaited until some input is made from the input unit 12, and the display unit 16 displays the image displayed at that time (in this case, for example, as shown in FIG. 10). Such as the initial image) continues to be displayed.

  On the other hand, when any input is made from the input unit 12 (when it is determined in step S2 that an input from the user has been made), the main control unit 11 in step S3, the input is “ It is determined whether or not “cursor movement”.

  If the input is not “cursor movement” (when it is determined in step S3 that the input is not “cursor movement”), the process proceeds to step S9 in FIG. However, the processing after step S9 will be described later.

  On the other hand, when the input is “cursor movement” (when it is determined in step S3 that the input is “cursor movement”), the display control unit 15 displays an enlarged photo. It is determined whether or not.

  Incidentally, although details will be described later (although described as processing in steps S9 to S12 in FIG. 7), when a predetermined command (first command) is input from the input unit 12 via the main control unit 11, The display control unit 15 enlarges and displays a predetermined one of the four photos (still images 32) displayed on the two-page spread of the 3D album 31 on almost the entire screen of the display unit 16. Specifically, for example, only the still image 32-A among the still images 32-A to 32-D shown in FIG. 14 is enlarged and displayed on the display unit 16 as shown in FIG. Sometimes. Hereinafter, the display state of the display unit 16 at this time is referred to as an enlarged display state.

  When the display state of the display unit 16 is an enlarged display state, when a predetermined command (second command) is input from the input unit 12 via the main control unit 11, the display control unit 15 displays the original image. That is, an image (for example, the image shown in FIG. 14) including the 3D album 31 in which four photos (still images 32) are pasted on two pages of spread pages is displayed on the display unit 16 again. Hereinafter, the display state of the display unit 16 at this time (when the 3D album 31 is displayed) is referred to as a normal display state.

  That is, when the first command is input from the input unit 12, the display state of the display unit 16 transitions from the normal display state to the enlarged display state. Thereafter, when the second command is input from the input unit 12, the display state of the display unit 16 transitions from the enlarged display state to the normal display state.

  Hereinafter, the first command and the second command are collectively referred to as “enlargement / reduction display designation”.

  Focusing on the process of step S4 again, when the display state of the display unit 16 is the above-described enlarged display state, the display control unit 15 determines in step S4 that the photograph is being enlarged and displayed in step S5. The next or previous image data in the list is read, and a photograph (still image 32) corresponding to the image data is enlarged and displayed on the display unit 16 (displayed on almost the entire screen of the display unit 16).

  In step S6, the display control unit 15 moves the cursor 42 to the position of the next or previous photo. However, when the process of step S6 is executed after the process of step S5, the display control unit 15 enlarges and displays the next or previous photo itself on the display unit 16, so the cursor 42 itself is displayed on the display unit 16. Instead, the information that “the position of the cursor 42 is the position of the next or previous photo” is held.

  Thereafter, the process returns to step S2, and the subsequent processes are repeated.

  On the other hand, when the display state of the display unit 16 is the normal display state described above, the display control unit 15 determines in step S4 that the photograph is not being enlarged and the cursor 42 is moved to in step S7. Determines whether the first or last page of the two-page spread of the 3D album 31 is reached.

  Specifically, for example, as shown in FIG. 3, when the cursor 42 is placed on the area 41-A and the movement direction is the previous direction (upward in the figure), the display is performed in step S7. The control unit 15 determines that the destination of the cursor 42 has reached the beginning of the two-page spread of the 3D album 31.

  Further, for example, although not shown, the cursor 42 is arranged on the area 41-D and the moving direction is the next direction (downward in FIG. 3 with respect to the area 41-D in FIG. 3). In this case, in step S7, the display control unit 15 determines that the movement destination of the cursor 42 has reached the end of the two spread pages of the 3D album 31.

  That is, when the cursor 42 is placed on the area 41-A and the movement direction is the previous direction, as described above, the movement destination of the cursor 42 is eventually two pages before the current two spread pages. It becomes the upper area. Similarly, when the cursor 42 is arranged on the area 41-D and the movement direction is the next direction, the movement destination of the cursor 42 is eventually the area on the next two pages after the current two-page spread. Become. Therefore, when the cursor 42 is arranged on the area 41-A and the movement direction is the previous direction, or the cursor 42 is arranged on the area 41-D and the movement direction is the next direction. In step S7, the display control unit 15 determines that the destination of the cursor 42 has reached the beginning or end of the two spread pages of the 3D album 31, and in step S8, The 3D album 31 having the previous two pages as a new two-page spread is displayed on the display unit 16. At this time, in order to explicitly indicate that the page of the 3D album 31 has been turned (sent) or to enhance entertainment, it is as if the page of the 3D album 31 has been turned. An animation to be shown (hereinafter referred to as a page turning animation) is displayed on the display unit 16.

  Hereinafter, such processing in step S8 is referred to as “page turning processing during photo display”.

  An example of detailed processing of “page feed processing during photo display” is shown in the flowchart of FIG. An example of detailed processing of “page turning processing during photo display” will be described with reference to the flowchart of FIG.

  First, in step S <b> 41, the display control unit 15 reads out the next or previous four pieces of image data from the content storage unit 13.

  In step S42, the display control unit 15 displays the four photos (still images 32) corresponding to the newly read image data on the previous two pages on the previous four photos (still images 32). Animation that turns two pages of the 3D album 31 into the next or previous two pages from the previous two pages with the texture pasted on the next and previous two pages respectively (that is, the pages described above) (Feed animation) display starts.

  In step S43, the display control unit 15 adds four new photographs (four newly read images) to the last image of the page turning animation, that is, two new spread pages (next two pages). When an image including the 3D album 31 to which the still image 32) corresponding to each data is pasted is displayed on the display unit 16, the display of the page turning animation is ended.

  Specifically, for example, in the present case, the four photographs so far are a still image 32-A to a still image 32-D as shown in FIG. Further, it is assumed that the page of the 3D album 31 is sent to the next two pages. Therefore, in the process of step S41, each of the still image 32-E to the still image 32-H is obtained as the next four image data in the list. Assume that image data is read out.

  In this case, the display control unit 15 starts displaying the page turning animation in the process of step S42, and sequentially displays the images shown in FIGS. 10 to 13 on the display unit 16 in that order. When the last image (image shown in FIG. 13) is displayed on the display unit 16 in the process of S43, the display of the page turning animation is terminated.

  More specifically, for example, in the 3D object storage unit 14, as data for page turning animation, the data of the 3D album 31-1 in FIG. 10, the data of the 3D album 31-2 in FIG. 11, and the 3D in FIG. The data set of the album 31-3 and the data set of the 3D album 31-4 in FIG. 13 (actually, more data sets of the 3D album 31) are stored.

  The display control unit 15 selects the data of the 3D album 31-1 in FIG. 10, the data of the 3D album 31-2 in FIG. 11, the data of the 3D album 31-3 in FIG. The data of the 13 3D albums 31-4 are sequentially read in that order, and the images shown in FIGS. 10, 11, 12, and 13 (of the still images 32-A to 32-H) are displayed. Of each of the 3D objects 31-1 to 31-4, which are pasted as textures, and sequentially displayed on the display unit 16. I will let you.

  And the display control part 15 displays the cursor 42 in the corresponding position in step S44 of FIG. Specifically, for example, in this case, in step S44, the display control unit 15 is not shown, but the upper left still image 32-E on the two-page spread of the 3D album 31-4 in FIG. The cursor 42 is displayed at a position (a position corresponding to the area 41-A in FIG. 3). As described above, when the page of the 3D album 31 is sent to the next two pages, the cursor 42 is displayed at the position of the upper left photo of the new two-page spread (position corresponding to the area 41-A in FIG. 3). The On the other hand, when a page is sent to the previous two pages on the display unit 16 (for example, when a page turning animation is displayed in the order of FIGS. 13 to 10), a new two-page spread is displayed. The cursor 42 is displayed at the position of the lower right photograph (the position corresponding to the area 41-D in FIG. 3).

  With the above processing, the “page feed processing during photo display” is completed, the processing is returned to step S2 in FIG. 6, and the subsequent processing is repeated.

  Thus, when the display state of the display unit 16 is the normal display state and “movement of the cursor” is input from the input unit 12 (in the process of step S3, it is determined that the input is “movement of the cursor”). When it is determined in step S4 that the photograph is not being enlarged and displayed), for example, in FIG. 3, the cursor 42 is placed on the area 41-A and the movement direction is the previous direction. Alternatively, when the cursor 42 is placed on the area 41-D and the movement direction is the next direction, the movement destination of the cursor 42 is the first or last page of the two-page spread of the 3D album 31 in step S7. In step S8, “page turning process during photo display” is executed.

  On the other hand, at other times, the display control unit 15 determines in step S7 that the movement destination of the cursor 42 has not reached the beginning or end of the two-page spread of the 3D album 31, and in step S6. The cursor 42 is moved to the position of the photograph (still image 32) next to or before the photograph (still image 32) that has been arranged so far. At this time (when it is determined in step S7 that the movement destination of the cursor 42 has not reached the first or last page of the two-page spread of the 3D album 31, the process in step S6 is executed). Since the display state of 16 is a normal display state, the cursor 42 is displayed at the movement destination.

  Thereafter, the process returns to step S2, and the subsequent processes are repeated. That is, the information processing apparatus 1 waits for execution of the 3D album display process until the next input is made from the input unit 12.

  For example, assume that the above-described “enlargement / reduction display designation” is input to the main control unit 11 from the input unit 12 as the next input.

  Then, the main control unit 11 determines in step S2 that an input from the user has been made. In step S3, the main control unit 11 determines that the input is not “cursor movement”, and in step S9 in FIG. It is determined that the input is “enlargement / reduction display designation”.

  In step S10, when the current display state of the display unit 16 is the normal display state, the display control unit 15 shows a process of changing the display state of the display unit 16 from the normal display state to the enlarged display state. When display of an animation (hereinafter, such animation is referred to as page enlargement animation) is started, and the current display state of the display unit 16 is an enlarged display state, the display state of the display unit 16 is set to an enlarged display state. Display of an animation indicating the process of transition from the normal display state to the normal display state (hereinafter, such animation is referred to as page reduction animation) is started.

  Hereinafter, the page enlargement animation and the page reduction animation are collectively referred to as page enlargement or reduction animation.

  When the display control unit 15 ends the display of the page enlargement or reduction animation in step S11, the display control unit 15 switches the display state (normal display state or enlarged display state) of the display unit 16 in step S12.

  That is, when “enlarged / reduced display designation” is input from the input unit 12, a transition of the display state of the display unit 16 (transition from the enlarged display state to the normal display state, or normal display is performed in steps S 10 to S 12. In order to explicitly indicate (transition from state to enlarged display state) or to enhance entertainment, page enlargement or reduction animation is displayed, and the display state of the display unit 16 changes.

  For example, the current display state of the display unit 16 is a normal display state (that is, for example, a state where an image as shown in FIG. 14 is displayed on the display unit 16). "Is input, a page enlargement animation is displayed, showing a process of enlarging and displaying the photograph (still image 32) on which the cursor 42 is placed at that time.

  Specifically, for example, although not shown in FIG. 14, it is assumed that the cursor 42 is placed at the position of the still image 32-A.

  In this case, the display control unit 15 starts displaying the page enlargement animation in the process of step S10, and sequentially displays the images shown in FIGS. 14 to 17 on the display unit 16 in that order. When the last image (image shown in FIG. 17) is displayed in the process of S11, the display of the page enlargement animation is terminated, and the display state of the display unit 16 is switched to the enlarged display state in the process of step S12.

  On the other hand, for example, the current display state of the display unit 16 is an enlarged display state (that is, for example, a state where an image as shown in FIG. 17 is displayed on the display unit 16). When “enlarged / reduced display designation” is input, the enlarged still image 32 is reduced, and finally the process of pasting the original position of the 3D album 31 is achieved. The displayed page reduction animation is displayed.

  Specifically, for example, the display control unit 15 starts displaying the page reduction animation in the process of step S10, and causes the display unit 16 to sequentially display the images shown in FIGS. 17 to 14 in that order. When the last image (image shown in FIG. 14) is displayed in the process of step S11, the display of the page reduction animation is terminated, and the display state of the display unit 16 is changed to the normal state in the process of step S12. Switch.

  In this way, when the display state is switched in the process of step S12, the process returns to step S2 of FIG. 6, and the subsequent processes are repeated. That is, the information processing apparatus 1 waits for execution of the 3D album display process until the next input is made from the input unit 12.

  For example, it is assumed that a command indicating the end of processing (hereinafter simply referred to as “end”) is input from the input unit 12 to the main control unit 11 as the next input.

  In this case, the main control unit 11 determines in step S2 that an input from the user has been made. In step S3, the main control unit 11 determines that the input is not “cursor movement”, and in step S9 in FIG. Is determined not to be an “enlarged / reduced display function”, the input is determined to be “end” in step S13, and the 3D album display process is ended.

  On the other hand, for example, when an input other than “move cursor”, “enlargement / reduction display function”, and “end” is made as the next input from the input unit 12, for example, in step S2, the user In step S3, it is determined that the input is not “cursor movement”. In step S9 in FIG. 7, it is determined that the input is not “enlargement / reduction display function”. In step S13, after it is determined that the input is not “end”, the process returns to step S2 in FIG. 6 and the subsequent processes are repeated.

  The processing when the pasting target of the 3D album 31 is the still image 32 in the 3D album display processing has been described above.

  By the way, as described above (for example, see FIG. 3), the pasting target of the 3D album 31 can be not only the still image 32 but also the moving image 51. Accordingly, the 3D album display process naturally includes a process in the case where the pasting target of the 3D album 31 is the moving image 51. Examples of such 3D album display processing in which the moving image 51 is also pasted are shown in the flowcharts of FIGS. In the following, with reference to the flowcharts of FIGS. 18 to 21, a description will be given of processing in which the moving image 51 is to be pasted in the 3D album display processing.

  In the 3D album display processing of FIGS. 18 to 21, first, in step S101 of FIG. 18, the information processing apparatus 1 (the display control unit 15 controlled by the main control unit 11) performs the “initial stage” shown in FIG. "Image display processing" is executed.

  That is, for example, the display control unit 15 displays an image as shown in FIG. 10, that is, a 3D album in which predetermined four still images 32-A to 32-D are pasted on the first two pages of spread. An image including 31 is displayed on the display unit 16.

  However, in this case, for example, as illustrated in FIG. 3, each of the still images 32-A to 32-D is associated with each of the moving images 51-A to 51-D. Suppose that Furthermore, it is assumed that each of the moving images 51-A to 51-D is associated with each of the first to fourth sounds. That is, the first movie composed of the moving image 51-A and the first sound, the second movie composed of the moving image 51-B and the second sound, the moving image 51-C and the third sound. Each of the third movie and the fourth movie composed of the moving image 51-D and the fourth sound is associated with each of the still image 32-A to the still image 32-D. .

  In step S102, the main control unit 11 determines whether or not an input from the user has been made.

  When nothing is input from the input unit 12 (when it is determined in step S102 that no user input has been made), the display control unit 15 ends the playback movie (moving image 51) in step S103. It is determined whether there is a movie that has reached.

  At this point, as shown in FIG. 10, since the four still images 32-A to 32-D are pasted on the 3D album 31, in step S103, the playback movie It is determined that there is no movie that has reached the end, and the process returns to step S102 to determine again whether or not an input from the user has been made. That is, when four still images 32-A to 32-D are pasted on the 3D album 31 (when there is no playback movie), 3D is performed until the next input is made from the input unit 12. Execution of the album display process is awaited, and four still images 32-A to 32-D are continuously displayed on the 3D album 31.

  Incidentally, details will be described later in the description of step S107 and subsequent steps in FIG. 19, but at least one of the moving image 51-A to moving image 51-D being reproduced is pasted on the 3D album 31. is there.

  In such a case, if all of the moving images 51 pasted on the 3D album 31 are being played back, it is determined in step S103 that there is no movie that has reached the end of the playback movie, and the process proceeds to step S102. Then, it is determined again whether or not an input from the user has been made. That is, until the next input is made from the input unit 12 or the playback location of at least one playback movie (moving image 51) reaches the end, the execution of the 3D album display process is awaited. The content displayed at that time continues to be displayed (in this case, at least one of the moving images 51-A to 51-D continues to be reproduced).

  When the playback location of one predetermined moving image 51 reaches the end (when it is determined in step S103 that there is a movie that has reached the end of the playback movie), the display control unit 15 ends the playback in step S104. The playback of the movie that has reached is terminated, and the content pasted on the 3D album 31 is transitioned from the movie (moving image 51) to the original photo (still image 32).

  Specifically, for example, in FIG. 3, it is assumed that the playback location of the moving image 51-A pasted in the area 41-A of the 3D album 31 has reached the end.

  In this case, the display control unit 15 ends the reproduction of the moving image 51-A in step S104, and synthesizes the still image 32-A on the moving image 51-A in the region 41-A of the 3D album 31. The synthesized image is pasted and displayed on the display unit 16. At this time, the display control unit 15 causes the still image 32-A to be displayed semi-transparently, and gradually decreases the degree of transparency (ratio) from 100% (completely transparent) to finally 0% (non-transparent). The content pasted in the area 41-A of the 3D album 31 is smoothly transitioned from the movie (moving image 51-A) to the original photo (still image 32-A).

  In this way, when the transition from the movie that has reached the end to the original photograph is executed in step S104, the display control unit 105 determines in step S105 whether there is still a playback movie.

  That is, as a result of the processing in step S104, when the content pasted on the 3D album 31 becomes four still images 32-A to 32-D (when there is no playback movie), step In S105, it is determined that there is no playback movie, and in step S106, the setting unit 19 stops the execution of the playback rate control, resolution control, and simultaneous audio playback control that have been executed so far.

  Thereafter, the process returns to step S102, and the subsequent processes are repeated. That is, until the next input is made from the input unit 12, execution of the 3D album display process is awaited, and four still images 32 -A to 32 -D are continuously displayed on the 3D album 31.

  On the other hand, if it is determined in step S105 that there is still a playback movie, the process returns to step S102, and the subsequent processes are repeated. That is, until the next input is made from the input unit 12 or the playback location of at least one playback movie (moving image 51) reaches the end, the execution of the 3D album display process is awaited. The content displayed at that time continues to be displayed (in this case, at least one of the moving images 51-A to 51-D continues to be reproduced).

  Focusing on the processing in step S102 again, for example, the initial image is displayed on the display unit 16, that is, the 3D album 31 has four still images 32-A to 32-D. Is pasted, the user operates the input unit 12 to input “movie playback (but not all movie playback)” to the main control unit 11.

  In this case, the main control unit 11 determines in step S102 that an input from the user has been made. In step S107 of FIG. 19, the main control unit 11 determines that the input is “movie playback”, and further in step S108. It is determined that the input is not “all movie playback”.

  In step S109, the display control unit 15 searches the content storage unit 13 for data of the movie (moving image 51) corresponding to the photograph (still image 32) on which the cursor 42 (FIG. 3) is arranged, and in step S110. , Playback of the movie (moving image 51) corresponding to the searched data is started, and the content to be pasted in the area where the cursor 42 is arranged in the 3D album 31 is reproduced from the photo (still image 32). Transition to the movie (moving image 51) that has started.

  Specifically, for example, as shown in FIG. 3, “movie” is input from the input unit 12 in a state where the still image 32-A is pasted on the area 41-A where the cursor 42 is arranged. It is assumed that “play” is input.

  In this case, in step S109, the display control unit 15 searches for movie data (moving image 51-A data and first audio data corresponding thereto) corresponding to the still image 32-A, and step S110. , The reproduction of the moving image 51-A corresponding to the retrieved data is started (at this time, the audio output control unit 17 starts the reproduction of the first audio corresponding to the retrieved data), and 3D A synthesized image obtained by synthesizing the moving image 51-A on the still image 32-A is pasted on the area 41-A of the album 31 and displayed on the display unit 16. At this time, the display control unit 15 displays the moving image 51-A in a translucent manner, and gradually decreases the degree of transparency (ratio) from 100% (completely transparent), and finally 0% (non-transparent). As a result, the content pasted in the area 41-A of the 3D album 31 is smoothly transitioned from a photograph (still image 32-A) to a movie (moving image 51-A).

  Thereafter, the process returns to step S102 in FIG. 18, and the subsequent processes are repeated. That is, until the next input is made from the input unit 12 or the playback location of the playback movie (moving image 51-A in this case) reaches the end, the execution of the 3D album display process is waited and the 3D album 31 is displayed. The content being displayed at that time continues to be displayed (in this case, the moving image 51-A continues to be reproduced and each of the still image 32-B to still image 32-D continues to be displayed).

  Focusing on the processing of step S102 again, for example, the state where the initial image is currently displayed on the display unit 16, that is, four still images 32-A to 32-D are pasted on the 3D album 31. Assume that “all movie playback” is input from the input unit 12 to the main control unit 11 in the attached state.

  In this case, the main control unit 11 determines in step S102 that an input from the user has been made. In step S107 of FIG. 19, the main control unit 11 determines that the input is “movie playback”, and further in step S108. The input is determined to be “all movie playback”.

  Then, in step S111, the setting unit 19 starts execution of playback rate control, resolution control, and audio simultaneous playback control.

  Note that the outlines of the playback rate control, resolution control, and simultaneous audio playback control are as described above, and details thereof will be described later. That is, details of playback rate control will be described later with reference to FIGS. 25 to 27, resolution control with reference to FIGS. 28 to 30, and audio simultaneous playback control with reference to FIG.

  In step S112, the display control unit 15 searches each of the movie data corresponding to all the photos (still images 32) pasted on the two-page spread of the 3D album 31, and in step S110, the search is performed. Playback of all the movies corresponding to all of the data (all of the moving images 51 corresponding to each of the still images 32) is started, and the corresponding movie (moving image) from each of all the photos (still images 32). Transition to each of the images 51).

  In this case, the display control unit 15 searches movie data corresponding to each of the moving images 51-A to 51-D in step S112, and the moving images 51-A to 51 in step S110. -D starts to be reproduced (at this time, the audio output control unit 17 performs each of the first to fourth sounds corresponding to the moving images 51-A to 51-D, respectively. Start playing).

  Then, the display control unit 15 includes, in the area 41-A of the 3D album 31, a composite image obtained by combining the moving image 51-A on the still image 32-A and an area 41-B. A synthesized image obtained by synthesizing the moving image 51-B on the still image 32-B is displayed, and a synthesized image obtained by synthesizing the moving image 51-C on the still image 32-C is displayed on the region 41-C. In 41-D, a combined image obtained by combining the moving image 51-D on the still image 32-D is pasted and displayed on the display unit 16. At this time, the display control unit 15 causes each of the moving images 51-A to 51-D to be translucently displayed, and gradually decreases the degree of transparency (ratio) from 100% (completely transparent). The content pasted in each of the areas 41-A to 41-D of the 3D album 31 is changed from each of the still images 32-A to 32-D by changing to 0% (non-transparent). Each of the moving images 51-A to 51-D is smoothly transitioned.

  Thereafter, the process returns to step S102 in FIG. 18, and the subsequent processes are repeated. That is, until the next input is made from the input unit 12 or the playback location of at least one playback movie (in this case, at least one of the moving images 51-A to 51-D) reaches the end. The 3D album display process is awaited, and the 3D album 31 continues to display the content currently displayed (in this case, all the moving images 51-A to 51-D are displayed). to continue).

  During this time, the setting unit 19 performs playback rate control and resolution control for each of the moving images 51-A to 51-D, and the moving images 51-A to 51-D. Simultaneous sound reproduction control is executed for each of the first to fourth sounds corresponding to each of the first to fourth sounds.

  In this state, the user operates the input unit 12 to cause the main control unit 11 to input a command to stop all currently played movies (hereinafter, this command is referred to as “movie stop”). Suppose.

  In this case, the main control unit 11 determines in step S102 that an input from the user has been made, determines in step S107 in FIG. 19 that the input is not “movie playback”, and in step S113, determines the input. Is determined to be “movie stop”.

  Then, in step S114, the display control unit 15 stops all the playback movies, and the contents to be pasted on the 3D album 31 are transferred from those movies (moving images 51) to the corresponding original photos (still images 32). Transition.

  In other words, in this case, the display control unit 15 includes, in the region 41-A of the 3D album 31, a composite image obtained by combining the still image 32-A on the moving image 51-A and the region 41-A. B is a composite image obtained by combining the still image 32-B on the moving image 51-B, and a region 41-C is a combination image obtained by combining the still image 32-C on the moving image 51-C. In the area 41-D, a combined image obtained by combining the still image 32-D on the moving image 51-D is pasted and displayed on the display unit 16. At this time, the display control unit 15 causes each of the still images 32-A to 32-D to be displayed semi-transparently, and gradually decreases the degree of transparency (ratio) from 100% (completely transparent). The content pasted in each of the areas 41-A to 41-D of the 3D album 31 is changed from each of the moving images 51-A to 51-D by changing to 0% (non-transparent). Each of the still image 32-A to the still image 32-D is smoothly transitioned.

  In step S115, the setting unit 19 stops the execution of playback rate control, resolution control, and audio simultaneous playback control.

  Thereafter, the process returns to step S102, and the subsequent processes are repeated. That is, until the next input is made from the input unit 12, execution of the 3D album display process is awaited, and four still images 32 -A to 32 -D are continuously displayed on the 3D album 31.

  In this state, it is assumed that the user operates the input unit 12 to input “move cursor” to the main control unit 11.

  In this case, the main control unit 11 determines in step S102 that an input from the user has been made, determines in step S107 in FIG. 19 that the input is not “movie playback”, and in step S113, determines the input. Is determined not to be “movie stop”, and further, in step S116 of FIG. 20, it is determined that the input is “cursor movement”.

  In step S117, the display control unit 15 determines whether a photograph (still image 32) or a movie (moving image 51) is being enlarged.

  When the display state of the display unit 16 is the enlarged display state, the display control unit 15 determines in step S117 that the photograph or movie is being enlarged, and in step S118, the next or previous data (movie of the movie) is displayed. In this case, movie data corresponding to the next or previous photo in the list is read, and the photo (still image 32) or the movie (moving image 51) corresponding to the data is displayed. That is, a photograph (still image 32) or a playback movie (reproduced moving image 51) is displayed on almost the entire screen of the display unit 16.

  In step S119, the display control unit 15 moves the cursor 42 to the position of the next or previous photo. However, when the process of step S119 is executed after the process of step S118, the display control unit 15 enlarges and displays the next or previous still image 32 or the moving image 51 itself on the display unit 16. 42 itself is not displayed on the display unit 16 and retains information that “the position of the cursor 42 is the position of the next or previous content (still image 32 or moving image 51)”.

  In step S <b> 120, the display control unit 15 determines whether or not there is a playback movie and the playback command is for “movie playback” other than “all movie playback”.

  If it is determined in step S120 that there is a playback movie and the playback command is for “movie playback” other than “all movie playback”, the display control unit 15 determines that the playback movie ( If the playback of the moving image 51) is stopped and the playback movie is displayed on the display unit 16 (may not be displayed in an enlarged display state), the original photo (still image) from the movie (moving image 51) is displayed. Transition to image 32). Thereafter, the process returns to step S102 in FIG. 18, and the subsequent processes are repeated. That is, when there is a movie reproduced by “movie reproduction (one movie reproduction command excluding“ all movie reproduction ”)”, the reproduction of the reproduced movie is stopped by the movement of the cursor 42.

  On the other hand, when there is no playback movie itself or when there is a playback movie, the playback command is for “play all movies” (in step S120, there is a playback movie and the playback movie is played back). If it is determined that the command is not for “movie playback” other than “all movie playback”), the process returns to step S102 in FIG. 18 without executing the process of step S121, and the subsequent processes. Is repeated. That is, when there is even one movie that is being played back by “playback of all movies” and is still playing, the playback of the playback movie is continued even if the cursor 42 is moved.

  Focusing again on step S117, if the display state of the display unit 16 is the normal display state, the display control unit 15 determines in step S17 that the photograph or movie is not being enlarged and the cursor 42 is displayed in step S122. It is determined whether or not the destination of the movement reaches the beginning or end of the two-page spread of the 3D album 31.

  If it is determined in step S122 that the movement destination of the cursor 42 has not reached the first or last page of the two-page spread of the 3D album 31, the display control unit 15 has placed the cursor 42 so far in step S119. The content (still image 32 or moving image 51) is moved to the next or previous content (still image 32 or moving image 51). At this time (when it is determined in step S122 that the movement destination of the cursor 42 has not reached the first or last page of the two-page spread of the 3D album 31, the process in step S119 is executed). Since the display state of 16 is a normal display state, the cursor 42 is displayed at the movement destination. Thereafter, the process proceeds to step S120, and the subsequent processes are repeated.

  On the other hand, when it is determined in step S122 that the movement destination of the cursor 42 has reached the beginning or end of the two-page spread of the 3D album 31, that is, for example, as shown in FIG. When it is arranged on the area 41-A and its moving direction is the previous direction, or not shown in FIG. 3, the cursor 42 is arranged on the area 41-D and its moving direction. Is the next direction, the display control unit 15 causes the display unit 16 to display the 3D album 31 in which the next two pages of the previous two pages or the previous two pages are the new two pages in step S123. At this time, as described above, the display control unit 15 displays the page turning animation on the display unit 16 in order to explicitly indicate that the page of the 3D album 31 has been turned or to enhance entertainment. To display.

  That is, the processing in step S123 is basically the same processing as the “page feed processing during photo display (details are shown in FIG. 9)” in step S8 in FIG. When the content pasted on the 3D album 31 is a moving image 51 (movie) corresponding to “all movie playback”, that is, when a plurality of moving images 51 are reproduced, a page turning animation is executed. The number of movie playbacks temporarily increases (in this case, four moving images 51 are reproduced on two pages of spread pages, and therefore, the four moving images 51 of the current two pages spread and the page are sent. In other words, it is necessary to reproduce the eight moving images 51 including the four moving images 51 of the two-page spread), and the load on the information processing apparatus 1 increases abruptly.

  Therefore, in the present embodiment, the setting unit 19 specifically controls the reproduction quality of each of the moving images 51 (controls the setting) during the display of the page turning animation. The load of the information processing apparatus 1 is suppressed by performing control to lower the reproduction quality of the moving image 51 that seems to have little influence.

  The reproduction quality control executed by the setting unit 19 during the display of the page turning animation is one form of the above-described reproduction rate control and resolution control. Of these, the processing of the reproduction rate control during the display of the page turning animation is performed. This flow is different from the flow of processing in the flowchart of FIG. 25 described later.

  For this reason, the processing of the playback rate control during the display of the page turning animation is shown in the flowchart of FIG. 22 together with the processing of the display control unit 15 corresponding to the “page turning processing during photo display” described above. . Hereinafter, the process shown in FIG. 22, that is, the process of step S123 of FIG. 20, is referred to as “page feed process”. Therefore, an example of detailed processing of “page turning processing” will be described below with reference to the flowchart of FIG.

  First, in step S201, the display control unit 15 determines whether or not a movie for “all movie playback” is being played back.

  If it is determined in step S201 that the movie for “all movie playback” is not being played back, in step S202, processing similar to the “page feed processing during photo display” in FIG. The “page turning process” is finished.

  However, when the moving image 51 (movie) for “movie playback” other than “all movie playback” is being played, that is, when one moving image 51 is being played back, here, as described above, the cursor Since the reproduction of the moving image 51 is stopped by the movement of 42, the display control unit 15 changes the content to be pasted on the 3D album 31 from the moving image 51 to the corresponding still image 32. Then, “page turning processing during photo display” is executed.

  On the other hand, if it is determined in step S201 that the movie for “all movie playback” is being played back, the display control unit 15 in step S203 determines that the hidden surface movie (next or previous to the current two-page spread) is displayed. The reproduction of the moving image 51) scheduled to be pasted on the second page is started.

  Specifically, for example, it is assumed that the page turning animation to be displayed is an animation in which the images shown in FIGS. 10 to 13 are sequentially displayed in that order. However, some of the still images 32-A to 32-H are displayed on each of the 3D albums 31 of FIGS. 10 to 13, but the still images 32 are not shown here. Some of the moving image 51-A to moving image 51-H corresponding to each of -A to still image 32-H are reproduced.

  In this case, since the hidden surface is the two pages shown in FIG. 13 (two spread pages after page feed), reproduction of each of the moving images 51-E to 51-H is started in step S203. Is done.

  In step S204, the setting unit 19 performs a setting for reducing the playback rate of the movie (moving image 51) of the page turning portion. That is, the display control unit 15 reduces the playback rate of the movie (moving image 51) of the page turning portion according to the setting.

  In this case, from FIG. 11 and FIG. 12, the page turning portion is the page on the right side in FIG. 10 of the two spread pages currently (FIG. 10) and the two spread pages after page turning (FIG. 13). Since the page is the left page in FIG. 13, in step S204, the moving image 51-C (moving image 51-C corresponding to the still image 32-C) and the moving image 51-D (still image 32-D) are displayed. Corresponding moving image 51-D), moving image 51-E (moving image 51-E corresponding to still image 32-E), and moving image 51-F (moving image 51- corresponding to still image 32-F). Each playback rate of F) is lowered.

  In step S205, the display control unit 15 starts displaying a page turning animation. That is, the images shown in FIGS. 10 to 13 are sequentially displayed on the display unit 16 in that order. However, here, as described above, in the 3D album 31, in the drawing, although not shown in the region where each of the still images 32-A to 32-H is pasted, the moving image 51- Each of A to moving images 51-H is pasted as a texture.

  The display control unit 15 pastes four new moving images 51-E to 51-H on the last image (FIG. 13) of the page turning animation, that is, two new spread pages (next two pages). When an image including the attached 3D album 31 is displayed on the display unit 16, the display of the page turning animation is terminated in step S206.

  Note that while the page turning animation is displayed, the setting unit 19 may further execute (independently) resolution control and simultaneous audio reproduction control in FIG. 28 described later.

  In step 207, the display control unit 15 plays back the movie that has been reproduced on the two hidden pages (two pages spread so far) of the 3D album 31, that is, in this case, the moving image 51-A to the moving image 51. -Stop each playback of D.

  Further, in step S208, the setting unit 19 sets the current two pages of the 3D album 31 (two pages spread after page feed, which is the two pages shown in FIG. 13 in this case), A setting is made to restore the playback rate of the movie whose playback rate is lowered (in this case, the moving image 51-E and the moving image 51-F). That is, according to the setting, the display control unit 15 restores the playback rate of the movie whose playback rate is reduced among the current two-page spreads of the 3D album 31.

  Then, the display control unit 15 displays the cursor 42 at the corresponding position in step S209. Specifically, for example, in this case, in step S209, the display control unit 15 is not illustrated, but the upper left moving image 51-E on the two-page spread of the 3D album 31-1 in FIG. The cursor 42 is displayed at a position (a position corresponding to the area 41-A in FIG. 3). That is, when page feed is sent to the next two pages, the cursor 42 is displayed at the position of the upper left photograph of the new two-page spread (position corresponding to the area 41-A in FIG. 3). On the other hand, when page feed is sent to the previous two pages (for example, when page feed animation is displayed in the order of FIGS. 13 to 10), A cursor 42 is displayed at the position of the photograph (the position corresponding to the area 41-D in FIG. 3).

  With the above processing, the “page feed processing” is completed, the processing is returned to step S2 in FIG. 18, and the subsequent processing is repeated.

  For example, assume that the above-described “enlargement / reduction display designation” is input to the main control unit 11 from the input unit 12 as the next input.

  Then, the main control unit 11 determines in step S102 that an input from the user has been made, determines in step S107 in FIG. 19 that the input is not “movie playback”, and in step S113, the input is “ In step S116 of FIG. 20, it is determined that the input is not “cursor movement”, and in step S124 of FIG. 21, the input is “enlargement / reduction display designation”. Is determined.

  In step S125, the display control unit 15 executes the display of the page enlargement or reduction animation described above, and after that, switches the display state (normal display state or enlarged display state) of the display unit 16.

  That is, the process of step S125 is basically the same as the process of steps S10 to S12 of FIG. 7 described above. However, in the present embodiment, when the content pasted on the 3D album 31 is a moving image 51 (movie) corresponding to “all movie playback”, that is, when a plurality of moving images 51 are played back. Further, while suppressing the overall load on the information processing apparatus 1, the playback quality of the enlarged moving image 51 is improved, and the playback quality of the other moving images 51 (moving image 51 not enlarged) is reduced. Has been given

  That is, in the present embodiment, in order to realize such a device, the setting unit 19 displays the enlarged moving image 51 of these moving images 51 during display of the page enlargement or reduction animation. Control to increase the reproduction quality and to reduce the reproduction quality of the other moving images 51 is performed.

  Further, even when one moving image 51 is being played back by “movie playback (normal playback command other than“ all movie playback ”)”, that one moving image 51 is targeted for enlargement display. In this case, it is preferable to improve the reproduction quality of the moving image 51. On the other hand, when the one moving image 51 is not the target of the enlarged display, the moving image 51 is not displayed on the display unit 16 in the enlarged display state. Therefore, it is preferable to reduce the reproduction quality. is there.

  Therefore, when “enlargement / reduction display setting” is input from the input unit 12, the setting unit 19 reproduces the moving image 51 with respect to the moving image 51 even if there is only one moving image 51 being reproduced at that time. Perform quality control (setting control).

  As described above, the reproduction quality control executed by the setting unit 19 during the display of the page enlargement or reduction animation is one form of the above-described reproduction rate control and resolution control. The flow of these processes will be described later with reference to FIG. And the processing flow of the flowchart of FIG. 28 is different.

  For this reason, the process for controlling the reproduction quality during the display of the page enlargement or reduction animation is shown in the flowcharts of FIGS. 23 and 24 together with the processes of steps S10 to S12 of FIG. Hereinafter, the process shown in FIGS. 23 and 24, that is, the process of step S125 of FIG. 21 is referred to as “enlargement / reduction process”. Therefore, an example of detailed processing of “enlargement / reduction processing” will be described below with reference to the flowcharts of FIG. 23 and FIG.

  In the following description, for the sake of simplicity, the enlarged display target is the content pasted in the upper left area (area corresponding to the area 41-A in FIG. 3) of the two spread pages of the 3D album 31 (FIG. 3). In this example, it is assumed that the still image 32-A or the moving image 51-A). The page enlargement animation is an animation in which the images shown in FIGS. 14 to 17 described above are sequentially displayed in that order, and the page reduction animation is an animation reverse to the page enlargement animation, that is, FIG. Assume that the images shown in FIGS. 17 to 14 are animations that are sequentially displayed in that order. However, some of the still images 32-A to 32-D are displayed on each of the 3D albums 31 of FIGS. 14 to 17, but the still image 32 is not shown here. Some of the moving image 51-A to moving image 51-D corresponding to each of -A to still image 32-D may be reproduced.

  First, in step S220 of FIG. 23, the display control unit 15 determines whether or not a movie is being played back.

  If it is determined in step S220 that the movie is not being played back, each of steps S232 to S234 in FIG. 24 corresponding to each of steps S10 to S12 in FIG. 7 described above is executed, and “enlargement / reduction processing” is performed. Ends.

  On the other hand, if it is determined in step S220 in FIG. 23 that the movie is being played back, the display control unit 15 determines in step S221 whether the current display state of the display unit 16 is the normal display state. Determine.

  For example, if the image shown in FIG. 14 is currently displayed on the display unit 16, it is determined in step S221 that the current display state of the display unit 16 is the normal display state. In step S222, the setting unit 19 is determined. The setting for increasing the resolution and playback rate of the movie (moving image 51) to be enlarged is performed. That is, the display control unit 15 increases the resolution and playback rate of the movie (moving image 51) to be enlarged based on the setting.

  Specifically, in this case, the movie to be enlarged is not shown in FIG. 14, but the upper left area of the two-page spread of the 3D album 31 (the still image 32-A in FIG. 14 is pasted). In step S222, the resolution and playback rate of the moving image 51-A are increased.

  However, if the enlargement display target is not the moving image 51-A but the still image 32-A, there is no movie to be enlarged, and therefore the process proceeds to step S223 without executing the process of step S222. It is done.

  In step S223, the setting unit 19 performs a setting to lower the resolution and playback rate of a movie (moving image 51) other than the movie to be enlarged. That is, the display control unit 15 lowers the resolution and playback rate of a movie that is not enlarged based on the setting.

  Specifically, in this case, the movie that is not enlarged is not shown in FIG. 14, but is a moving image 51-B to a moving image 51-D. Therefore, in step S223, the moving image 51-B to the moving image 51-B are displayed. The resolution and playback rate of each of the moving images 51-D are lowered.

  Of the four contents pasted on the two-page spread of the 3D album 31, all three contents except for the contents to be enlarged (moving image 51-A) are photographs (still images) In the case of the image 32-B to the still image 32-D), since there is no control target of the setting unit 19, the process proceeds to step S224 without executing the process of step S223.

  In step S224, the display control unit 15 starts displaying the page enlargement animation, sequentially displays the images shown in FIGS. 14 to 17 on the display unit 16 in that order, and the last image (FIG. 17 is displayed on the display unit 16, the display of the page enlargement animation is terminated in step S225, and the display state is switched to the enlarged display state in step S226.

  On the other hand, for example, when the image shown in FIG. 17 is displayed on the display unit 16 when it is determined in step S202 that the movie is being played back, in step S221, the display unit 16 It is determined that the current display state is not the normal display state (enlarged display state), and the page reduction animation is displayed on the display unit 16 in the processing of steps S227 to S231, that is, as shown in FIGS. When the images to be displayed are sequentially displayed on the display unit 16 in that order, and the last image (the image shown in FIG. 14) is displayed on the display unit 16, the display state is switched to the normal state.

  That is, as described above, the processing flow for displaying the page reduction animation is basically the reverse of the processing flow for displaying the page enlargement animation. Specifically, first, after the page reduction animation is displayed in the processes of steps S227 and S228, the movie reduced in the process of step S229 (the movie that has been enlarged so far, The resolution and playback rate of the image 51-A) are restored (lowered), and in step S230, a movie other than the movie that has been enlarged (in this case, the moving image 51-B to the moving image 51-). Each playback rate of D) is restored (increased). In step S231, the display state is switched to the normal state.

  Note that during the page enlargement or reduction animation, the setting unit 19 may also execute (independently) audio simultaneous reproduction control of FIG.

  As described above, when the display of the page enlargement or reduction animation is performed and the display state of the display unit 16 is switched, the “enlargement / reduction process” ends, and the process returns to step S2 in FIG. The process is repeated.

  For example, as the next input from the input unit 12, “end” or the above-described various commands (“movie playback”, “all movie playback”, “movie stop”, “cursor movement”, “ It is assumed that information other than “enlargement / reduction display designation” and “end” is input to the main control unit 11.

  In this case, the main control unit 11 determines in step S102 that an input from the user has been made, determines in step S107 in FIG. 19 that the input is not “movie playback”, and in step S113, determines the input. Is determined not to be “movie stop”, and in step S116 in FIG. 20, it is determined that the input is not “cursor movement”. Further, in step S124 in FIG. It is determined that it is not “designation”. In step S126, the main control unit 12 determines whether or not the input is “end”.

  When the input is “end” (when it is determined in step S126 that the input is “end”), the 3D album display process ends.

  On the other hand, if the input is information other than the various commands described above, it is determined in step S126 that the input is not “end”, and the process returns to step S102 in FIG. The process is repeated.

  In this way, the information processing apparatus 1 executes the 3D album display process of FIGS. 18 to 21 to display not only the still image 31 but also the moving image 51 as a texture on the 3D album 31 for display. be able to.

  At this time, when a plurality of moving images 51 are simultaneously reproduced on the 3D album 31 (in the above example, four moving images 51 may be reproduced by “all movie reproduction”). As described above, the setting unit 19 can independently execute playback rate control, resolution control, and simultaneous audio playback control.

  Therefore, hereinafter, each of the reproduction rate control, resolution control, and simultaneous audio reproduction control will be described individually in that order with reference to the drawings.

  First, playback rate control will be described with reference to FIGS.

  FIG. 25 is a flowchart illustrating an example of playback rate control processing.

  In step S301 in FIG. 25, the setting unit 19 performs initial setting (sets the FPS of all movies (moving images 51) to the FPS of the source information in FIG. 4, that is, the original FPS).

  Specifically, for example, it is assumed that four moving images 51-A to 51-D are simultaneously reproduced as shown in FIG.

  In this case, the movie of interest is a movie corresponding to the moving image 51-A in which the cursor 42 (FIG. 3) is placed (the circle item is described in FIG. 4), so in step S301 In the processing, initial setting as shown in FIG. 26 is performed. That is, as shown in FIG. 26, the FPSs of all display information of the moving images 51-A to 51-D are set as the corresponding FPSs of the source information.

  As described above, the display control unit 15 reproduces the moving image 51 in accordance with the FPS and display resolution described in the display information, so that the FPS and display resolution described in the display information are the moving image. This represents the current reproduction quality of the image 51.

  Returning to FIG. 25, in step S <b> 302, the setting unit 19 determines whether an instruction to end the process is given.

  As described above, when step S106 (FIG. 18) or step S115 (FIG. 19) is executed, it is determined in step S302 that an instruction to end the process has been issued, and the playback rate control process ends. That is, the setting unit 19 stops the execution of the playback rate control.

  In other cases, in step S302, the setting unit 19 determines that the process has not been instructed, and the state of the information processing apparatus 1 at that time (such as the CPU load and the network bandwidth load shown in FIG. 4 described above) ), Whether or not the FPS of all movies (moving image 51-A to moving image 51-D in this case) can maintain the initial setting value (in this case, the FPS of display information shown in FIG. 26). Determine.

  Specifically, for example, now, the setting unit 19 monitors the CPU load as the state of the information processing apparatus 1, and when the CPU load becomes 90% or more, in step S303, the FPSs of all movies are initialized. Assume that the set value cannot be maintained.

  Accordingly, in this case, unless the CPU load is less than 90% and the end of the process is not instructed, it is determined in step S303 that the FPS of all the movies can maintain the initial setting value, and the process returns to step S302. And the subsequent processing is repeated. That is, each of the moving images 51-A to 51-D continues to be played back with the FPS with the initial setting values (original values).

  On the other hand, when the CPU load exceeds 90%, the setting unit 19 determines in step S303 that the FPSs of all the movies cannot maintain the initial setting values, and in step S304, the FPS other than the movie of interest (now In this case, the setting is made to lower the FPS of the moving image 51-B to the moving image 51-D.

  Specifically, for example, here, it is assumed that the setting unit 19 performs setting to set the FPS to a value that is ½ of the initial setting value in step S304. However, it is assumed that FPS is an integer value, and when the half of the initial setting value is not an integer value, the fractional part is rounded down. In this case, the FPS of each of the moving images 51-A to 51-D is updated to the FPS described in the display information shown in FIGS. That is, while the FPS of the moving image 51-A is maintained at the same “30” as the source information (original FPS), the FPS of the moving image 51-B is 1/2 of the source information “15”. The FPS of the moving picture 51-C is “7” of the value (however, the fractional part is rounded down), and the FPS of the moving picture 51-D is “15” of the half value of “30” of the source information. The value is lowered to “15” which is a half value of “30” of the source information.

  Returning to FIG. 25, in step S305, the setting unit 19 further determines whether or not the FPS of the movie of interest can maintain the initial setting value.

  Specifically, for example, when the CPU load is less than 80% as a result of reducing the FPS other than the movie of interest in the process of step S304, the setting unit 19 sets the FPS of the movie of interest to the initial setting value in step S305. Is determined to be maintained.

  That is, when the CPU load is 80% or more in spite of reducing the FPS other than the movie of interest in the process of step S304, the setting unit 19 cannot maintain the initial setting value of the FPS of the movie of interest in step S305. In step S306, a setting for further lowering the FPS other than the movie of interest is performed.

  Then, in step S307, the setting unit 19 determines whether or not the end of the process is instructed. If the setting unit 19 determines that the end of the process is not instructed, the setting unit 19 returns the process to step S305, and the FPS of the movie of interest is initialized. It is determined whether the set value can be maintained, and the subsequent processing is repeated.

  That is, the setting unit 19 continues to lower the FPS other than the movie of interest (in this case, the FPS of the moving image 51-B to the moving image 51-D) until the CPU load falls below 80%, and the CPU load decreases to 80%. Below that, control is performed to maintain the FPS settings of all movies at their current values. Thus, regardless of the state of the information processing apparatus 1 (CPU load or the like), the FPS of the movie of interest (moving image 51-A in this case) is a constant value (in this case, “30” which is the original FPS). ) Can be maintained.

  When step S106 (FIG. 18) or step S115 (FIG. 19) is executed, it is determined in step S307 that the end of the process has been instructed, and the playback rate control process ends. That is, the setting unit 19 stops the execution of the playback rate control.

  In the above-described example, when the FPS other than the movie of interest is lowered, the setting unit 19 maintains the value as it is or only performs control to lower the value, but the CPU load is reduced to some extent. Then, control may be performed to increase FPS other than the movie of interest (up to the original FPS (source information FPS)).

  Next, resolution control will be described with reference to FIGS.

  FIG. 28 is a flowchart illustrating an example of resolution control processing.

  In step S321 in FIG. 28, the setting unit 19 calculates the area ratio of the display areas of all movies (moving images 51).

  Here, the product of the vertical resolution and the horizontal resolution in the Size (original resolution) described in the source information (FIG. 4) of the target moving image (data) 51 is referred to as a source area, and When the product of the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the region to which the target moving image 51 is pasted in the display unit 16 is referred to as a display area, the area ratio of the display region is expressed by the following formula ( Defined by 1).

  Display area ratio = display area / source area (1)

  Specifically, for example, the source area of the moving image 51-A in FIG. 4 is “307200 (= 640 × 480)”. Further, if the area 41-A of the 3D album 31 in FIG. 4 is displayed in a range of predetermined 64 pixels × 48 pixels among all the pixels constituting the display screen of the display unit 16, the moving image 51 The display area of -A is “3072 (= 64 × 48)”.

  Therefore, in this case, in step S321, the setting unit 19 substitutes “3072” for the display area and “307200” for the source area of the right side of the above-described expression (1), respectively, and sets the expression (1 ) To calculate 0.1 (10%) as the area ratio of the display region.

  In step S322, the setting unit 19 sets the display resolution (Size of the display information in FIG. 4) of each movie based on the area ratio of the corresponding display area.

  Thus, the method for setting the display resolution of the movie (the size of the display information in FIG. 4) is not particularly limited as long as it is a method that is set based on the area ratio of the display area. Here, for example, FIG. The display resolution of the movie is set based on the table shown in FIG.

  Specifically, for example, in the above-described example, the area ratio of the display area of the moving image 51-A is calculated as 10%. Therefore, according to the table of FIG. 29, the display resolution of the moving image 51-A is the original. 1/4 of the resolution. That is, as shown in FIG. 4, the display resolution (Size of display information) of the moving image 51-A is “320 × 240”, which is ¼ of the original resolution (Size of source information = 640 × 480). Is set.

  In this way, after setting the resolution of each movie, the setting unit 19 determines whether or not the display area of the movie display area has changed in step S323.

  That is, in the above-described example, for example, when an animation such as a page turning animation is displayed, a movie display area (in the above-described example, an area corresponding to the area 41-A to the area 41-D in FIG. 3). In such a case, it is determined in step S323 that the display area of the movie display area has changed, the process returns to step S321, and the subsequent processes are repeated. That is, the display resolution of each movie is reset (updated).

  On the other hand, in the above-described example, basically, unless animation display is executed, a movie display area (in the above-described example, an area corresponding to the area 41-A to area 41-D in FIG. 3). In such a case, the setting unit 19 determines in step S323 that the display area of the movie display area has not changed, and whether or not the end of the process is instructed in step S324. Determine whether.

  If it is determined in step S324 that the end of the process is not instructed, the process returns to step S323 to determine again whether or not the display area of the movie display area has changed. That is, the setting unit 19 constantly monitors the display area of the movie display area, and resets (updates) the display resolution of each movie each time the display area changes.

  When step S106 (FIG. 18) or step S115 (FIG. 19) is executed, it is determined in step S324 that the end of the process has been instructed, and the resolution control process ends. That is, the setting unit 19 stops executing the resolution control.

  By the way, the 3D object to which the still image 32 and the moving image 51 are pasted is not limited to the form of the 3D album 31 of FIG. 3, and can take various forms. Specifically, for example, FIG. A 3D object 151 (hereinafter referred to as a 3D film 151) imitating the shape of a movie (or camera) film as shown in FIG.

  In the 3D film 151 of FIG. 30, five areas 161-A to 161-E are provided as areas to which contents are pasted. That is, in each of the five regions 161-A to 161-E, either the still image 32-A to the still image 32-E, or each of the moving image 51-A to the moving image 51-E, It is pasted as a texture independently of the pasting contents of other areas. That is, as with the 3D album 31 of FIG. 3, the 3D film 151 can be pasted with the still image 32 and the moving image 51 mixed. However, the content of interest (still image 32 or moving image 51) is the content in which the cursor 42 is arranged in the 3D album 31 of FIG. 3, but in the 3D film 151 of FIG. In the example of 30, the content is pasted in the area 161-C).

  The above-described resolution control is particularly suitable for such 3D objects having display areas with different display areas, such as the areas 161-A to 161-E of the 3D film 151 in FIG.

  That is, in the 3D album 31 of FIG. 3, since all the display areas of the areas 41-A to 41-D are the same (unless the above-described animation display or the like is performed), all the contents ( The display resolution of the content pasted in each of the areas 41-A to 41-D may be basically the same.

  On the other hand, in the 3D film 151 of FIG. 30, the display areas of the regions 161-A to 161-E are different, and the degree of importance (degree of interest for the user) is the display area. Since it corresponds to some extent, it is preferable to change the display resolution of content (content pasted in each of the regions 161-A to 161-E) according to the area of the region to which the content is pasted. As a method for realizing this, the above-described resolution control is suitable.

  Specifically, for example, as a content to be pasted on the 3D film 151 in FIG. 30, a content (still image 32-A to still image 32-D) in which the area ratio of the display region in the region 161-C is about 100%. , And the moving image 51-A to moving image 51-D), the contents pasted in the region 161-A and the region 161-E (the still image 32 in the example of FIG. 30) according to the table of FIG. The display resolution of -A or moving image 51-A or still image 32-E or moving image 51-E) is 1/16 of the original resolution. Similarly, contents pasted in the area 161-B and the area 161-D (in the example of FIG. 30, still image 32-B or moving image 51-B, or still image 32-D or moving image 51-D). The display resolution is set to 1/4 of the original resolution. Further, the display resolution of the content (still image 32-C or moving image 51-C in the example of FIG. 30) pasted in the area 161-C is the original resolution.

  Thus, the setting unit 19 can execute resolution control that can minimize the influence on the user's vision.

  Next, with reference to the flowchart of FIG. 31, the process of simultaneous audio reproduction control will be described.

  In step S341, the setting unit 19 performs, for example, the sound of the movie of interest (in the example of the 3D album 31 in FIG. 1) is set to 100%, and the sound localization is set to the center.

  In step S342, for example, the setting unit 19 sets the output level of audio other than the movie of interest to 25%, and sets the localization of those audios in the vicinity of the playback position of the corresponding moving image 51.

  Specifically, for example, in the example of the 3D album 31 in FIG. 3, the sound other than the movie of interest is the second sound corresponding to the moving image 51-B pasted in the area 41-B, the area 41- The third sound corresponding to the moving image 51-C pasted on C and the fourth sound corresponding to the moving image 51-D pasted on the area 41-D.

  Therefore, in this case, the output level of the second sound is set to 25%, and the localization is set to the area 41-B in FIG. Similarly, the output level of the third sound is set to 25%, and the localization is set to a region 41-C in FIG. Further, the output level of the fourth sound is set to 25%, and its localization is set to a region 41-D in FIG.

  In this way, after setting the output level and localization of the sound of each movie, the setting unit 19 determines whether or not the movie of interest has changed in step S343.

  That is, in the above-described example, for example, when “move cursor” is input from the input unit 12 and the arrangement position of the cursor 42 is moved, the movie of interest is also pasted at the position of the moved cursor 42. Since it changes to the moving image 51, in such a case, in step S343, it is determined that the movie of interest has changed, the processing is returned to step S341, and the subsequent processing is repeated. That is, the output level and localization of the sound of each movie are reset (updated).

  In contrast, if it is determined in step S343 that the movie of interest has not changed, the setting unit 19 determines in step S344 whether or not an instruction to end the process has been issued.

  If it is determined in step S344 that the end of the process is not instructed, the process returns to step S343, and it is determined again whether or not the movie of interest has changed. In other words, the setting unit 19 constantly monitors which movie is the movie of interest, and resets (updates) the output level and the fixed position of the sound of each movie each time the movie of interest changes. .

  Then, when step S106 (FIG. 18) or step S115 (FIG. 19) is executed, it is determined in step S344 that the end of the process has been instructed, and the process of simultaneous audio reproduction control ends. That is, the setting unit 19 stops the execution of the simultaneous audio reproduction control.

  As described above, since the setting unit 19 can execute the simultaneous sound reproduction control, the conventional problem when a plurality of movies are simultaneously reproduced, that is, a plurality of reproduced sounds are mixed, and the user The problem that it is difficult to hear the voice of can be solved. In other words, the output level and localization setting value and setting method in the simultaneous audio playback control are not limited to the above-described example of FIG. Setting values and setting methods can be applied.

  In the above example, the plurality of moving images 51 pasted on the 3D album 31 of FIG. 3 (or the 3D film 151 of FIG. 30) are different contents (movies), but are shown in FIG. As described above, one content (movie) is divided into a plurality of moving images, and each of the divided moving images is set as a moving image 51-A to a moving image 51-D to be pasted on the 3D album 31. be able to.

  That is, for example, the information processing apparatus 1 cuts out data of one movie by dividing it into predetermined time lengths, and extracts a plurality of pieces of cut out data (hereinafter such data is referred to as section data, and the section Each of the movie portions corresponding to the data is referred to as a recording section) can be stored in the content storage unit 13 (FIG. 1) as data of one moving image 51. In addition, the information processing apparatus 1 converts the data of a predetermined frame included in each recording section into the content storage unit 13 (FIG. 1) as data of the still image 32 corresponding to the recording section (moving image 51). ) Can be stored.

  Specifically, for example, as shown in FIG. 33, a predetermined movie is divided into recording sections each having a length of 30 seconds, and the first recording section (00:00:00 to 00) : 00:30 recording section data) is cut out and stored in the content storage unit 13 as data of the moving image 51-A. At this time, for example, the data of the first frame in the first recording section is associated with the moving image 51-A as the data of the still image 32-A corresponding to the moving image 51-A, and the content storage unit 13 Is remembered.

  Similarly, section data of a second recording section (recording section from 00:00:30 to 00:01:00) following the first recording section is cut out, and the content storage unit is used as data of the moving image 51-B. 13 is stored. At this time, for example, the data of the first frame in the second recording section is associated with the moving image 51-B as the data of the still image 32-B corresponding to the moving image 51-B, and the content storage unit 13 Is remembered.

  Section data of a third recording section (recording section from 00:01:00 to 00:01:30) following the second recording section is cut out and stored in the content storage unit 13 as moving image 51-C data. Is done. At this time, for example, the data of the first frame in the third recording section is associated with the moving image 51-C as the data of the still image 32-C corresponding to the moving image 51-C, and the content storage unit 13 Is remembered.

  Section data of a fourth recording section (recording section from 00:01:00 to 00:01:30) following the third recording section is cut out and stored in the content storage unit 13 as a moving image 51-D. . At this time, for example, the data of the first frame in the fourth recording section is associated with the moving image 51-D as the data of the still image 32-D corresponding to the moving image 51-D, and the content storage unit 13 Is remembered.

  Then, as illustrated in FIG. 32, the information processing apparatus 1 displays each of the still images 32-A to 32-D, that is, the first frame of each of the first to fourth sections of the movie. The 3D album 31 is pasted on two predetermined spread pages and displayed on the display unit 16.

  In this state, the user moves the cursor 42 to a desired location (by inputting “movement of the cursor”), whereby the information processing apparatus 1 corresponds to the still image 32 on which the cursor 42 is arranged. The moving image 51 (in the example of FIG. 32, the moving image 51-D corresponding to the still image 32-D, that is, the fourth section) can be reproduced on the display unit 16.

  That is, each of the still images 32-A to 32-D is pasted as a thumbnail of each of the moving images 51-A (first recording section) to 51-D (fourth recording section). Thus, the user moves the cursor 42, selects a desired thumbnail (still image 32), and performs a simple operation such as inputting “movie playback”, whereby a desired location (selected) of the movie is selected. You can watch from the thumbnail recording section.

  This thumbnail itself is also a subject of appreciation, and the user pastes it on each page while turning each page of the 3D album 31 so as to view the actual photo while turning the page of the actual album. The attached thumbnail (still image) 32 can be viewed. That is, since the user can skip the movie while watching the 3D album 31, for example, it is possible to easily grasp the rough lines of the movie while enjoying it.

  FIG. 34 shows that a user finds a desired movie from a plurality of contents stored in the information processing apparatus 1 to which the present embodiment is applied, and a desired place. 3 shows an example of the flow of operations from the start to playback (hereinafter, such operations are referred to as user operations in the present embodiment).

  In step S361 in FIG. 34, for example, the user activates the application software of the present embodiment and causes the display unit 16 to display the 3D album 31 (initial image) in FIG.

  The application software according to the present embodiment is, for example, application software that can display the 3D album 31 of FIG. 3 and the like and reproduce the content pasted on the 3D album 31. FIG. This is application software that can realize at least some of the functions of the control unit 15, the audio output control unit 17, and the setting unit 19.

  In step S362, the user designates an album to be browsed. That is, it is assumed that content to be pasted (in this case, a movie) is determined in one 3D album 31 so that a predetermined photo is already pasted on an actual album. For example, although not shown, a plurality of 3D albums 31 are stored in bookcases (3D objects) so that a plurality of actual albums are stored in actual bookcases (such images) Assume that the user designates one 3D album 31 as an album to be browsed from among them.

  That is, when an album to be browsed is designated, an initial image of the designated 3D album 31 (3D album 31 with the first two pages opened) is displayed on the display unit 16.

  Then, the user turns the page of the actual album and confirms the contents (what photo is pasted). In step S363, the user moves the cursor 42 to move the designated album. Turn the page of (3D album 31) and check the picture (still image 32) pasted on the page.

  In step S364, the user determines whether or not the confirmed photograph corresponds to a desired movie.

  In step S364, when the user determines that the confirmed photograph does not correspond to the desired movie, the process returns to step S362, and the subsequent processing is repeated. That is, another album (3D album 31) is designated, the page of the other album is turned, and it is determined whether or not the picture pasted on the album corresponds to a desired movie.

  When the user finds an album (3D album 31) on which a photo corresponding to the desired movie is pasted (when it is determined in step S364 that the photo corresponds to the desired movie), the step In S365, the cursor 42 is moved to select a photo corresponding to a desired position in the movie. In step S366, the moving image 51 (in the movie) corresponding to the selected photo (still image 32) is selected. A moving image 51 at a desired position, that is, a recording section at a desired position) is reproduced.

  Thereafter, when the user desires to reproduce another position (recording section) of the movie (when it is determined in step S367 that another position of the movie is also reproduced), the process is performed. Is returned to step S365, and the subsequent processing is repeated. That is, the user moves the cursor 42 and selects a picture corresponding to another recording section, thereby reproducing the other recording section.

  When the user reproduces all desired recording sections of the movie (when it is determined in step S367 that other positions of the movie are not reproduced), the operation is ended.

  In this way, the user can find a desired movie from a plurality of contents stored in the content and view it from a desired location by simply performing a simple operation such as the user operation of the present embodiment. be able to.

  Furthermore, the user's operation of this embodiment is a highly entertaining operation that allows the user to feel as if he / she actually reads the album (3D album 31).

  In order to compare with a simple and highly entertaining operation such as the user operation of the present embodiment, FIG. 35 shows a plurality of information stored in a user using a conventional information processing apparatus. An example of a flow of an operation until a desired movie is found from the content and played from a desired location (hereinafter, such an operation is referred to as a conventional user operation) is shown.

  In step S381 of FIG. 35, for example, the user activates the conventional image application software as described above, and displays the above-described player window on the screen.

  In step S382, the user searches for a movie to be reproduced from a list (for example, a list in which file names of a plurality of movie data included in a predetermined folder are listed).

  In step S383, the user actually reproduces the searched movie and confirms the screen (the reproduction movie). In step S384, the user determines whether the movie (reproduction movie) displayed on the screen is a desired one. To do.

  If the user determines in step S384 that the movie on the screen is not a desired one, the process returns to step S382, and the subsequent processing is repeated. That is, by searching for another movie and actually reproducing it, it is determined whether or not the other movie is desired.

  In this case, the user may not be able to make the determination in step S384 unless the movie is played back for a long time. As a result, the user operation (FIG. 34) of the present embodiment is performed until a desired movie is found. In comparison, it often takes a long time. Therefore, the user has conventionally shortened the operation time by repeating fast forward and rewind operations. However, it can be said that such a repetitive operation is obviously a complicated operation compared to a simple operation such as a movement operation of the cursor 42 (operation of step S363) in the user operation of the present embodiment.

  Even if a desired movie is found in this way (even if it is determined in step S384 that the movie (playback movie) displayed on the screen is the desired one), the user further proceeds in step S385. While confirming the screen (playback movie), a fast forward or rewind operation is performed, and it is determined in step S386 whether or not it is a desired position (recording section). That is, the user must repeat the complicated operations described above, such as repeating fast forward and rewind operations (repeating the processes in steps S385 and S386) until a desired position is found.

  Even if the user finds a desired recording section from the desired movie (even if it is determined that the desired position is determined in step S386), the user stops the playback of the movie in step S387, and An operation for fine-tuning is further required.

  As described above, the user can view the movie from a desired position (recording section) only after performing the above complicated and time-consuming series of operations.

  Thereafter, when the user further desires to reproduce another position (recording section) of the movie (when it is determined in step S388 that another position of the movie is also reproduced). The processing returns to step S385, and the subsequent processing is repeated. That is, the user further performs complicated and time-consuming operations such as fast forward and rewind repeated operations, finds the vicinity of another recording section (desired recording section), and finely adjusts the playback position. For the first time, viewing of other recording sections becomes possible.

  When the user repeats the above-described complicated and time-consuming operation and reproduces all desired recording sections of the movie (in step S388, it is determined that other positions of the movie are not reproduced). Then, the operation is terminated.

  As described above, as compared with FIG. 34 and FIG. 35, it can be seen that the user operation according to the present embodiment is an operation that is obviously simpler and requires less time than the conventional user operation.

  Further, the conventional user operation is an operation with poor entertainment that causes the player window to reproduce only a predetermined position (recording section) of one movie. On the other hand, the user's operation according to the present embodiment is a highly entertaining operation that can play a movie while giving the user the feeling of reading an album (3D album 31). .

  In the past, as described above, in a DVD, a recorded movie may be divided into a plurality of chapters in advance. In such a case, a plurality of thumbnails can be obtained using the above-described thumbnail function. There is also a method in which a list of photos showing each of the chapters is displayed, and a predetermined one of the photos is selected by the user so that reproduction is performed from the beginning of the chapter corresponding to the selected photo. Hereinafter, an image in which a list of photographs showing each of a plurality of chapters is displayed is referred to as a chapter selection image.

  By using this method, the user can easily perform an operation until a desired location of the movie is selected as compared with the conventional user operation of FIG. However, the chapter selection image displayed by this method is an image in which a plurality of photographs are simply arranged as a chapter table of contents. Therefore, it is difficult to say that the chapter image itself is entertaining, and the operation of the user selecting a predetermined chapter from the chapter selection image is also the user operation of the present embodiment of FIG. 34 described above. It is hard to say that there is entertainment.

  Further, the chapter selection image is displayed on almost the entire screen, and when one chapter is selected from the chapter selection images by the user, the chapter selection image is erased. Since it is displayed on almost the entire surface of the screen, it is difficult for the user to grasp the connection with other chapters while the recorded content is being reproduced. That is, when the user desires to play back a recording section (chapter) different from the recording section (chapter) being played back, the user again displays the chapter selection image and selects a chapter. Such an operation must be performed.

  On the other hand, in the present embodiment, as shown in FIG. 3, the moving image 51 is pasted on the second page of the 3D album 31 as if it were an actual photo. Even when the image 51 is being reproduced, other photos (still images 32 associated with the other moving images 51) are simultaneously displayed on the same screen (screen of the display unit 16). In other words, since the user can view the moving image 51 being reproduced and other photos at the same time, the user can easily grasp the connection between the moving image 51 and the moving image 51 associated with the other photo. can do. Therefore, the user performs a user operation according to the present embodiment (that is, by simply performing a simple operation such as moving the cursor 42), so that the moving image is different from the moving image 51 that is being reproduced. 51 can be reproduced easily and quickly.

  As described above, as an example of a movie viewing mode using the information processing apparatus 1 according to the present embodiment, a viewing mode capable of viewing from a desired location of the movie with a simple and entertaining operation has been described. By using the information processing apparatus 1 according to the present embodiment, the user can further view the movie in a new viewing mode that has not existed in the past as described below.

  That is, for example, in FIG. 32, the user moves the cursor 42 one by one in order to paste four thumbnails pasted on two predetermined spread pages of the 3D album 31 (in the example of FIG. 32, Four recording sections of the movie corresponding to each of the still images 32-A to 32-D) (in the example of FIG. 32, the first corresponding to each of the moving images 51-A to 51-D). The recording section to the fourth recording section) can be viewed sequentially in that order.

  Further, although not shown in the drawing, when the user finishes reproducing the last recording section of a predetermined two-page spread (in the example of FIG. 32, the moving image 51-D pasted on the lower right), the cursor 42 If one is moved, as described above, the 3D album 31 having the next two pages (not shown) as a new two-page spread can be viewed while enjoying the page turning animation. At this time, thumbnails (still images) of the next four recording sections (fifth recording section to eighth recording section) of the fourth recording section are pasted on the new two-page spread. Therefore, the user can sequentially watch the next four recording sections (moving images 51 corresponding to the respective thumbnails) by sequentially moving the cursor 42 one by one.

  Furthermore, the user can view all of the movie as if reading an actual book (album) just by performing simple operations such as sequentially moving the cursor 42 one by one. . Furthermore, at this time, the user does not need to play back all the recording sections, and only views a desired portion of the movie as if skipping and reading an actual book (album). You can also. That is, the user can skip the movie in a natural manner.

  As described above, the viewing mode of the movie using the information processing apparatus 1 according to the present embodiment is a mode capable of giving the user high entertainment with an easy operation as compared with the conventional viewing mode. I understand.

  By the way, the recording section (section data) of the movie used as each of the moving image 51-A to moving image 51-D, which is pasted on two predetermined spread pages of the 3D album 31 of FIG. 3, is shown in FIG. For example, the recording section (section data) as shown in FIG. 36 or 37 may be used.

  That is, for example, as shown in FIG. 36, the information processing apparatus 1 detects a scene change (a portion indicated by a white arrow in FIG. 36) of one movie, and follows the scene change detected immediately before. From the frame data to the data of the frame before the scene change just detected are cut out as section data of one recording section, and each of the cut out section data is set as one moving image 51 in the content storage unit. 13 (FIG. 1).

  At this time, the information processing apparatus 1 uses the data of the next frame of each detected scene change (the first frame of each of the cut out segment data) as the data of the still image 32, and the corresponding moving image It can be stored in the content storage unit 13 in association with 51 (interval data of the recording interval).

  Further, for example, as shown in FIG. 37, when the information processing apparatus 1 cuts out section data from movie data output from the digital video camera 104 (FIG. 5), the recording time is included in the movie data. Since it is recorded, a discontinuous part of the recording time (that is, a discontinuous part of the timeline) is detected, and the data of the part where the recording time is continuous is extracted as section data of one recording section. Each of the plurality of segment data cut out can be stored as one moving image 51 in the content storage unit 13.

  At this time, the information processing apparatus 1 uses, as the still image 32 data, the moving image 51 corresponding to the data of the head frame of each of the cut out section data as in the above-described FIG. 33 and FIG. It can also be stored in the content storage unit 13 in association with (recording section data).

  However, some digital video cameras 104 (FIG. 5) have a camera shake correction function, and the digital video camera 104 uses the camera shake correction function to capture movie data ( Each frame of data constituting each frame includes data referred to as camera shake correction data.

  Therefore, when the section data is cut out from the movie including the camera shake correction data, the information processing apparatus 1 selects the frame data included in each section data as shown in FIG. The content storage unit 13 extracts data of one frame including a scene with less blur, and associates the extracted data of the frame as data of the still image 32 with the corresponding moving image 51 (section data of the recording section). Can also be stored.

  As described above, the still image 32 used as the thumbnail of each recording section (moving image 51) of the movie does not need to be the first frame of the recording section, and is an arbitrary frame in the recording section. Alternatively, it may be a picture or a picture other than the frames constituting the recording section.

  As described above, the group as shown in FIG. 33, FIG. 36, or FIG. 37 has been described as the group of the moving image 51 and the still image 32 pasted on the predetermined two-page spread of the 3D album 31 of FIG. However, as described above, the set of the moving image 51 and the still image 32 is not limited to the set shown in FIG. 33, FIG. 36, or FIG. 37, and various sets can be used.

  Although not illustrated, for example, when GPS (Global Positioning System) information is included in section data of a plurality of recording sections cut out from a movie, the information processing apparatus 1 refers to the GPS information and is constant. It is also possible to detect a frame that has not moved in time and store the data of the detected frame in the content storage unit 13 as data of a still image 32 corresponding to the recording section (moving image 51).

  Alternatively, although not illustrated, for example, when the operation information is included in the section data of a plurality of recording sections cut out from the movie, the information processing apparatus 1 refers to the operation information and performs a zoom operation for a certain period of time. It is also possible to detect a frame that is not marked and store the data of the detected frame in the content storage unit 13 as data of the still image 32 corresponding to the recording section (moving image 51).

  As described above, the information processing apparatus 1 cuts out each piece of section data of a plurality of recording sections from predetermined movie data, and stores them as data of the moving image 51 (moving image 51 to be pasted on the 3D album 31). Content stored as data of a predetermined frame in a plurality of recording sections as data of a still image 32 corresponding to the recording section (a still image 32 to be pasted as a thumbnail of the recording section on the 3D album 31). It can be stored in the storage unit 13.

  In other words, such a series of processing of the information processing apparatus 1 also serves as editing of a movie, and it is not necessary to perform editing operations such as cutting or pasting a movie conventionally performed by a user.

  Furthermore, the set of the moving image 51 and the still image 32 is a set as described above, that is, a plurality of recording sections (moving image 51) divided from one movie, and a predetermined frame ( It is not limited to the set with the still image 32), and various sets are applicable.

  Specifically, for example, a digital camera 201 shown in FIG. 38 (such a camera 201 is referred to as a digital short movie camera 201 to distinguish it from the conventional digital still camera 103 and digital video camera 104). The set of the output moving image 51 and still image 32 can also be used.

  Here, with reference to FIG. 38, the function of simultaneously capturing the still image 32 and the moving image 51 of the digital short movie camera 201 will be described.

  As shown in FIG. 38, the digital short movie camera 201 is provided with a power switch 211, a shutter 212, and a photographing lens 213.

  For example, if the state of the power switch 211 changes to the ON state at time t0, the digital short movie camera 201 starts shooting from that time t0. That is, the digital short movie camera 201 shoots a predetermined shooting space (subject) in front of the shooting lens 213, converts the moving image of the shooting space (subject) into data, and stores it in an internal memory (for example, FIG. 41 described later). Are stored in the storage unit 236).

  For example, when the shutter 212 is pressed by the user's finger 221 at time t1, the digital short movie camera 201 converts the still image 32 at that time (time t1) into data and outputs the data (for example, a diagram to be described later). The data is recorded on the removable recording medium 101 mounted on the drive 238 of 41 or output to the information processing apparatus 1 directly connected to the external output terminal 237).

  At this time, the digital short movie camera 201 also converts the moving image 51 at a predetermined time T before and after the time t1 into data and outputs it to the same output destination (for example, the removable recording medium 101 in FIG. 41 described later). For example, the information is recorded in association with the still image 32, or is output to the information processing apparatus 1 as a set of data of the still image 32 and data of the moving image 51).

  Note that the time T of the moving image 32 at this time can be freely set in relation to the time length and the time t1 when the shutter 212 is operated. That is, if the time before the time t1 is described as T1 and the time after the time T2 is described, the time T is expressed as T1 + T2, and each of the time T1 and the time T2 indicates a relationship with the time t1. It will be. Therefore, as the setting of the relationship between the time T and the time t1, each of the time T1 and the time T2 can be freely set (however, within a range satisfying the relationship of T = T1 + T2).

  FIG. 39 shows recording formats of still image 32 data and moving image 51 data output from the digital short movie camera 201. As shown in FIG. 39, each of the data of the still image 32 and the data of the moving image 51 has a header, and a moving image link or a still image link for associating (linking) with each other in the header. Information is included.

  From the above, the information processing apparatus 1 uses the still image 32-A and the moving image 51-A output from the digital short movie camera 201 as shown in FIG. 40 as the contents to be pasted on the 3D album 31. Data sets, still image 32-B and moving image 51-B data set, still image 32-C and moving image 51-C data set, still image 32-D and moving image 51 Each data set with -D can be used.

  FIG. 41 shows a configuration example of such a digital short movie camera 201.

  In FIG. 41, the main control unit 231 controls the entire digital short movie camera 201. The main control unit 231 is connected to a bus 232, and a DSP (Digital Signal Processor) 234, an input unit 235, a storage unit 236, an external output terminal 237, and a drive 238 are further connected to the bus 232. Yes.

  The DSP 234 is also connected to a CCD (Charge-Coupled Device) 233 that captures an image of a predetermined shooting space via the lens 213 and outputs the image as an analog image signal. The DSP 234 is output from the CCD 233. The image signal is converted into image data of a predetermined format, subjected to predetermined image processing as necessary, and output to an output destination (for example, the storage unit 236) designated by the main control unit 231 or the like. That is, the DSP 234 outputs the data of the still image 32 or the moving image 51 to a predetermined output destination.

  The input unit 235 includes the shutter 212 and the power switch 212 described above.

  The storage unit 236 stores programs for executing various functions of the digital short movie camera 201, and stores still image 32 and moving image 51 data supplied from the DSP 234. In other words, the storage unit 236 is a temporary cache for writing to the removable recording medium 101 connected to the drive 238 and an external output of data (output to the information processing apparatus 1 connected to the external output terminal 237). Used as a temporary read area. As described above, when the state of the power switch 212 is changed to the on state, the digital short movie camera 201 starts its shooting operation. At this time, it is also used as a ring buffer for recording moving image data for a specified time (for example, 10 seconds) output from the DSP 234.

  The external output terminal 237 outputs a set of data of the moving image 51 and data of the still image 32 to an external device connected thereto (the information processing device 1 in FIG. 5 in the example of FIG. 40).

  The drive 238 stores a set of data of the moving image 51 and data of the still image 32 in the removable recording medium 101 connected thereto.

  That is, the information processing apparatus 1 can directly acquire the data set of the moving image 51 and the data of the still image 32 captured by the digital short movie camera 201 via the external output terminal 237, or removable recording. It can also be obtained via the medium 101.

  In addition, the drive 238 is loaded with a removable recording medium 101 in which a computer program is recorded as necessary, and the computer program read out from the drive 238 is installed in the storage unit 236 as necessary.

  Next, an example of processing of the digital short movie camera 201 will be described with reference to FIG.

  When the power of the digital short movie camera 201 is off and the power switch 212 is pressed, the digital short movie camera 201 starts executing the processing.

  That is, the digital short movie camera 201 turns on the power supply in step S401, and starts shooting the subject (the shooting space in front of the lens 213) in step S402, and the movie (moving image) of the subject. Are stored in the internal storage unit 236.

  In step S403, the digital short movie camera 201 determines whether the power switch 212 has been pressed.

  If it is determined in step S403 that the power switch 212 has been pressed, the digital short movie camera 201 stops shooting in step S407, turns off the power supply in step S408, and ends the process.

  On the other hand, when it is determined in step S403 that the power switch 212 is not pressed, the digital short movie camera 201 determines whether or not the shutter 212 is pressed in step S404.

  If it is determined in step S404 that the shutter 212 has not been pressed, the process returns to step S402, and the subsequent processes are repeated. That is, until the power switch 212 or the shutter 212 is next pressed, the digital short movie camera 201 continues to photograph the subject and keeps the movie (moving image) data of the subject stored in the internal storage unit 236.

  When the shutter 212 is pressed (when it is determined in step S404 that the shutter 212 has been pressed), the digital short movie camera 201 takes a picture at that time (time t1 in the example of FIG. 38) in step S405. The captured image of the subject is output as still image 32 data.

  In step S406, the digital short movie camera 201 displays a subject image captured during a predetermined time T before and after the shutter 212 is pressed (time t1 in the example of FIG. 38). ) Data.

  Thereafter, the process returns to step S402, and the subsequent processes are repeated. That is, until the power switch 212 or the shutter 212 is next pressed, the digital short movie camera 201 continues to photograph the subject and keeps the movie (moving image) data of the subject stored in the internal storage unit 236.

  Therefore, the user frequently presses the shutter 212 to cause the digital short movie camera 201 to have a plurality of substantially continuous movies (moving images 51 corresponding to time T) and photographs of the corresponding subjects (shutters). A pair with the still image 32) at each timing when 212 is pressed can be output.

  As a result, the information processing apparatus 1 regards each of the plurality of movies (moving images 51 corresponding to time T) of these substantially continuous subjects as the above-described recording sections and pastes them on the 3D album 31 in FIG. You can also. At this time, the information processing apparatus 1 uses, as thumbnails of each of these recording sections (that is, each of a plurality of movies of substantially continuous subjects output from the digital short movie camera 201) as a thumbnail of the corresponding subject. (The still image 32 output from the digital short movie camera 201 at each timing when the shutter 212 is pressed) can be pasted on the 3D album 31.

  As described above, the user uses the digital short movie camera 201 to simultaneously display the moving image 51 (short movie) in the style of shooting the still image 32 (that is, the shooting style of pressing the shutter 212). You can shoot. That is, the digital short movie camera 201 can improve the convenience of shooting the still image 32 and the moving image 51 as compared with the conventional digital still camera 103 and the digital video camera 104 (FIG. 5). .

  In addition, since the association between the still image 32 and the moving image 51 captured and output by the digital short movie camera 201 is performed in a natural manner, the user newly generates a photo as a thumbnail of the moving image 51. This eliminates the need for newly performing conventional editing work.

  As described above, as shown in FIGS. 2 and 3, the information processing apparatus 1 pastes and displays the still image 32 or the moving image 51 as the content on the 3D album 31, or the sound corresponding to the moving image 51. An example of outputting has been described.

  Incidentally, the data of such content (still image 32 or moving image 51) may include attached information.

  Specifically, for example, the still image 32 may include attached information as shown in FIG. The attached information includes the time (date and time) at the time of shooting, camera information (shooting data), sound (sound information) and moving image 51 (video information) corresponding to the still image 32, and GPS recording the shooting location. Information etc. are included. Further, if the camera that shot the still image 32 (for example, the digital still camera 103 in FIG. 5) can be connected to the network, the camera searches the GPS information for the actual shooting address, Address (map information from search) can be added as attached information. In addition, the camera can add weather information (from search to weather information) at that time as attached information from the shooting date and time and CPS information.

  For example, when the information processing apparatus 1 displays a content such as a moving image 51 or a still image 32 pasted on the 3D album 31, the attached information can be output as a character comment or sound effect. Alternatively, for example, when a predetermined input is made by the user, the information processing device 1 uses the predetermined information on the two-page spread of the 3D album 31 (for example, corresponding content is pasted). It can also be displayed as image information in a region or the like.

  As described above, the information processing apparatus 1 can output the attached information of the content (moving image 51, still image 32, etc.) at an arbitrary timing and in an arbitrary output form. The operability can be remarkably improved.

  As described above, the user uses the information processing apparatus 1 to display a photograph (still image 32) pasted on two predetermined spread pages of the 3D album 31, as shown in FIG. You can appreciate it. In addition, the user simply turns the cursor 42 (FIG. 3), turns the page of the 3D album 31 (displays a page feed animation), and pastes a photo (still image) pasted on another page. 32) can also be appreciated. Furthermore, the user can effectively view the attached information (for example, FIG. 43) of the still image 32 that is the object of appreciation.

  In this way, the information processing apparatus 1 has higher entertainment, convenience, and operability when browsing the content than conventional albums on which paper media photos are actually pasted, digital photo slideshows, and the like. Can be significantly improved.

  Further, in order to further improve the high entertainment, convenience, and operability when browsing the content, the user uses the information processing apparatus 1 configured as a personal computer, a home server, or the like as shown in FIG. In addition, the Internet or the like can be connected, and the television receiver 102 can be connected.

  Further, as shown in FIG. 3, the information processing apparatus 1 can paste not only a photograph (still image 32) but also a movie (moving image 51) on a predetermined two-page spread of the 3D album 31. Therefore, as shown in FIG. 3, the user can use the information processing apparatus 1 to view a photograph (still image 32) and a movie (moving image 51) in association with each other. In other words, the movie can be viewed (viewed) in a completely new and highly entertaining viewing mode that allows the user to feel as if viewing a photo book simply by moving the cursor 42. )can do. When a user searches for a desired part of a movie in such a new viewing mode, the user can perform an overwhelmingly faster and more flexible search than a conventional search by fast forward or rewind operation. It becomes possible to view a desired part of the movie efficiently.

  Further, when the user uses data of a photograph (still image 32) taken with the digital still camera 103 or the like (movie 51) taken with the digital video camera 104 or the like as the content to be browsed, The device 1 can be a movie (moving image 51) taken by the digital video camera 104 or the like, a photograph (still image 32) as a thumbnail of the movie, A photograph (still image 32) taken by the digital still camera 103 or the like can be easily pasted.

  That is, the information processing apparatus 1 pastes content on the 3D album 31 and displays the 3D album 31 itself. The processing itself is a conventional movie editing operation (the user records the recorded movie data on a conventional personal computer). Import, perform cut editing on the personal computer, perform operations to add titles and video effects, create a final movie, and save it to a recording medium such as a video tape or DVD (Digital Versatile Disk) The operation is substantially the same as the previous operation).

  For this reason, by using the information processing apparatus 1, the user does not need to perform a conventional movie editing operation that requires knowledge of a predetermined level or more and is complicated and time-consuming. It becomes possible to play. Furthermore, the conventional movie editing operation requires a large-scale personal storage area and a high-performance personal computer or a dedicated editing device. However, the hardware configuration itself of the information processing apparatus 1 may be a normal personal computer as shown in FIG. 5, for example, and the burden on the user is remarkably reduced.

  In particular, the user can use a digital short movie camera 201 (a digital short that can easily shoot a still image 32 and a moving image 51 simultaneously and in association with each other as a browsing content recording apparatus as shown in FIG. By using the movie camera 201), it is free from troublesome operations such as content editing and organization. In addition, the information processing apparatus 1 can remarkably improve the operability and entertainment of content browsing by using the content captured and output by the digital short movie camera 201.

  By the way, in the example described above, the information processing apparatus 1 mainly stores the content stored in its own storage unit 81 (the content storage unit 13 in FIG. 1) in FIG. Although the content is displayed on the display unit 15 in FIG. 1, these contents are displayed on the camera (for example, the digital video camera 104 or the digital still camera 103 in FIG. 5 or the digital short in FIG. 38). It is also possible to display on a display of a movie camera 201 or the like, or an externally connected display (for example, the display of the television receiver 102 in FIG. 5).

  Further, the information processing apparatus 1 uses not only the data stored locally but also the content (data) on the network connected to the communication unit 82 in FIG. Also good.

  By the way, when the above-described series of processing is executed by software, a program constituting the software is installed in a dedicated hardware, or various programs can be installed by installing various programs. For example, a general-purpose personal computer that can execute the function is installed from a network or a recording medium.

  For example, as shown in FIG. 5 or FIG. 41, the recording medium including such a program is distributed to provide a program to the user separately from the main body of the apparatus, and is a magnetic disk on which the program is recorded ( It consists of floppy disk), optical disk (including compact disk-read only memory (CD-ROM), DVD (digital versatile disk)), magneto-optical disk (including MD (mini-disk)), or semiconductor memory. In addition to the removable recording medium (package medium) 101, the hard disk included in the ROM 72 shown in FIG. Or the storage unit 236 shown in FIG.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the order, but is not necessarily performed in chronological order, either in parallel or individually. The process to be executed is also included.

It is a block diagram which shows the structural example of the information processing apparatus with which this Embodiment is applied. It is a figure which shows the example of the 3D album which the information processing apparatus of FIG. 1 displays. FIG. 2 is a diagram illustrating an example of a still image or a moving image pasted as a texture on the 3D album by the information processing apparatus of FIG. 1. FIG. 4 is a diagram illustrating an example of reproduction quality control for each of the moving images in FIG. 3 executed by the setting unit in FIG. 1. It is a block diagram which shows the detailed structural example of the information processing apparatus with which this Embodiment is applied. 3 is a flowchart illustrating an example of 3D album display processing (in the case where only a still image (photograph) is pasted on a 3D album) executed by the information processing apparatus of FIG. 1. 3 is a flowchart illustrating an example of 3D album display processing (in the case where only a still image (photograph) is pasted on a 3D album) executed by the information processing apparatus of FIG. 1. 7 is a flowchart for explaining an example of detailed processing of initial image display processing in the 3D album display processing of FIG. 6. 7 is a flowchart for explaining an example of detailed processing of page turning processing during photo display in the 3D album display processing of FIG. 6. It is a figure explaining the example of the page turning animation displayed by the 3D album display process of FIG. 6 (the page turning process during the photo display of FIG. 9). It is a figure explaining the example of the page turning animation displayed by the 3D album display process of FIG. 6 (the page turning process during the photo display of FIG. 9). It is a figure explaining the example of the page turning animation displayed by the 3D album display process of FIG. 6 (the page turning process during the photo display of FIG. 9). It is a figure explaining the example of the page turning animation displayed by the 3D album display process of FIG. 6 (the page turning process during the photo display of FIG. 9). It is a figure explaining the example of the page expansion or reduction animation displayed by the 3D album display process of FIG. It is a figure explaining the example of the page expansion or reduction animation displayed by the 3D album display process of FIG. It is a figure explaining the example of the page expansion or reduction animation displayed by the 3D album display process of FIG. It is a figure explaining the example of the page expansion or reduction animation displayed by the 3D album display process of FIG. 3 is a flowchart illustrating an example of 3D album display processing executed by the information processing apparatus of FIG. 1. 3 is a flowchart illustrating an example of 3D album display processing executed by the information processing apparatus of FIG. 1. 3 is a flowchart illustrating an example of 3D album display processing executed by the information processing apparatus of FIG. 1. 3 is a flowchart illustrating an example of 3D album display processing executed by the information processing apparatus of FIG. 1. 21 is a flowchart for explaining an example of detailed processing of page turning processing in the 3D album display processing of FIG. 20. It is a flowchart explaining the example of the detailed process of the expansion / contraction process among the 3D album display processes of FIG. It is a flowchart explaining the example of the detailed process of the expansion / contraction process among the 3D album display processes of FIG. 6 is a flowchart for explaining a processing example of playback ray control executed by a setting unit in FIG. 1. An example of each state of each moving image before the setting unit in FIG. 1 executes playback rate control (when the initial setting process in step S141 in the playback rate control process in FIG. 21 is performed). FIG. FIG. 21 is a diagram illustrating an example of a state of each moving image after the setting unit of FIG. 1 executes playback rate control according to the flowchart of the playback rate control process of FIG. 20. 3 is a flowchart illustrating an example of resolution control processing executed by a setting unit in FIG. 1. It is a figure which shows the example of the table referred when the setting part of FIG. 1 performs the resolution control of FIG. FIG. 26 is a diagram illustrating another 3D object displayed by the information processing apparatus of FIG. 1 and suitable as a resolution control target of FIG. 25. It is a flowchart explaining the process example of the audio | voice simultaneous reproduction | regeneration control which the setting part of FIG. 1 performs. FIG. 4 is a diagram showing another example of each moving image to be pasted on the 3D album of FIG. 3 and still images corresponding to them. It is a figure explaining each of each moving image of FIG. 2 is a flowchart for explaining a user operation according to the present embodiment when a user views a desired movie using the information processing apparatus of FIG. It is a flowchart compared with FIG. 35, Comprising: It is a flowchart explaining the conventional user operation in case a user views a desired movie using the conventional information processing apparatus. FIG. 4 is a diagram showing another example of each moving image to be pasted on the 3D album of FIG. 3 and still images corresponding to them. FIG. 4 is a diagram showing another example of each moving image to be pasted on the 3D album of FIG. 3 and still images corresponding to them. It is a figure explaining the principle of a digital short movie camera. It is a figure explaining using the set of the moving image and still image output from the digital short movie camera of FIG. 38 as a moving image pasted on the 3D album of FIG. 3 and a corresponding still image. It is a block diagram which shows the structural example of the digital short movie camera of FIG. 39 is a flowchart for explaining an example of processing of the digital short movie camera of FIG. 38. FIG. 36 is a diagram illustrating a configuration example of moving image data and still image data output from the digital short movie camera of FIG. 35. It is a figure explaining the example of the incidental information added to each of the data of each still image pasted as a texture on the 3D album of FIG.2 and FIG.3.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Information processing apparatus, 11 Main control part, 12 Input part, 13 Content storage part, 14 3D object storage part, 15 Display control part, 16 Display part, 17 Audio | voice output control part, 18 Audio | voice output part, 19 Setting part, 31 3D album (3D object), 32 still image (photo), 41 3D album area, 42 cursor, 51 moving image, 71 CPU, 72 ROM, 73 RAM, 77 sound card, 78 speaker, 79 graphics card, 80 display, 81 storage unit, 101 removable recording medium, 151 3D film (3D object), 161 3D album area, 201 digital short movie camera, 211 shutter, 212 power switch, t1 shutter release timing of digital short movie camera, T digital short movie camera Shooting time of movie that La is output as data

Claims (9)

Setting means for individually setting the reproduction quality including the reproduction rate and the resolution of each of the first moving image and the second moving image to be reproduced among the plurality of moving images;
Each of the first moving image and the second moving image is reproduced with the reproduction quality set by the setting means, and a first area and a second area of a predetermined 3D (3Dimensional) object are reproduced. And a display control means for executing control to display the 3D object by pasting it as a texture on each of the
The setting unit is configured to display the first area when reproduction is controlled by the display control unit based on a display area of the first region of the 3D object and an original resolution of the first moving image. When the resolution of the moving image is set and playback is controlled by the display control unit based on the display area of the second area of the 3D object and the original resolution of the second moving image When the resolution of the second moving image is set and the processing load exceeds a predetermined threshold, the first moving image and the second moving image whose reproduction is controlled by the display control means Among these, the information processing apparatus is characterized in that the reproduction rate of the remaining moving images is lowered until a load capable of maintaining the reproduction rate of the moving image of interest at a constant value is reached . The 3D object is an object imitating an album having a book shape,
The display control means displays the 3D object that imitates the album with a predetermined page opened, and displays the first moving image and the second moving image in the first of the pages. Executing a control of pasting and reproducing as a texture in each of the first region corresponding to the place where the second photo is pasted and the second region corresponding to the place where the second photo is pasted. The information processing apparatus according to claim 1. The display control means turns a page so that a next or previous spread page is displayed from a currently displayed spread page according to a user operation, and a new one of the plurality of moving images is displayed. A third area corresponding to a place where a third photo is pasted in the new spread page, and each of the third moving image and the fourth moving image to be reproduced on the spread page; Execute the control to paste and play as a texture in each of the fourth area corresponding to the place where the fourth photo is pasted,
The setting means lowers the playback rate of a moving image displayed in an area in the page to be turned when turning the page.
The information processing apparatus according to claim 2. Each of the plurality of moving images is associated with each of a plurality of still images,
The display control means displays the 3D object as an initial state, and displays each of a first still image corresponding to the first moving image and a second still image corresponding to the second moving image. , When further executing control for pasting and displaying the texture as a texture in each of the first area and the second area of the 3D object, and then instructing the reproduction of the first moving image, When the control for causing the first moving image to be pasted and displayed as a texture in the first area and the reproduction of the second moving image are instructed, the second moving image is displayed in the second area. The information processing apparatus according to claim 1, wherein each of the controls to be pasted and displayed as a texture is executed independently. The display control means includes at least one set of the set of the first still image and the first moving image, and the set of the second still image and the second moving image, A still image of a shooting space shot by the shooting device when the shutter is pressed, and a moving image of the shooting space shot by the shooting device during a predetermined period before and after the shutter is pressed. The information processing apparatus according to claim 4 , wherein a pair is used. The setting means further individually sets an output level and a localization for each of the first sound corresponding to the first moving image and the second sound corresponding to the second moving image. ,
The audio output control means for executing control for outputting each of the first voice and the second voice at the output level and the localization set by the setting means. The information processing apparatus described in 1. A setting step for individually setting the reproduction quality including the reproduction rate and resolution of each of the first moving image and the second moving image to be reproduced among the plurality of moving images;
Each of the first moving image and the second moving image is reproduced with the reproduction quality set by the processing of the setting step, and a first region and a second of a predetermined 3D (3Dimensional) object are reproduced. A display control step for performing control for pasting the texture as a texture to each of the areas and displaying the 3D object ,
In the setting step, when the reproduction is controlled by the process of the display control step based on the display area of the first region of the 3D object and the original resolution of the first moving image, The resolution of one moving image is set, and reproduction is performed by the processing of the display control step based on the display area of the second region of the 3D object and the original resolution of the second moving image. The resolution of the second moving image in the case of being controlled is set, and when the processing load exceeds a predetermined threshold, the first moving image whose reproduction is controlled by the processing of the display control step wherein one of the second moving image, until the reproduction rate of the moving image to be noted the load can be maintained at a constant value, characterized in that lowering the playback rate of the remaining moving image Broadcast processing method. A program for causing a computer to execute a moving image playback process,
A setting step for individually setting the reproduction quality including the reproduction rate and the resolution of each of the first moving image and the second moving image that are to be reproduced among the plurality of moving images;
Each of the first moving image and the second moving image is reproduced with the reproduction quality set by the processing of the setting step, and a first region and a second of a predetermined 3D (3Dimensional) object are reproduced. A display control step for performing control for pasting the texture as a texture to each of the areas and displaying the 3D object ,
In the setting step, when the reproduction is controlled by the process of the display control step based on the display area of the first region of the 3D object and the original resolution of the first moving image, The resolution of one moving image is set, and reproduction is performed by the processing of the display control step based on the display area of the second region of the 3D object and the original resolution of the second moving image. The resolution of the second moving image in the case of being controlled is set, and when the processing load exceeds a predetermined threshold, the first moving image whose reproduction is controlled by the processing of the display control step wherein one of the second moving image, the reproduction rate of the moving image of interest until the load can be maintained at a constant value, the program to reduce the reproduction rate of the remaining moving image recording Recording medium, characterized by being. A program for causing a computer to execute a moving image playback process,
A setting step for individually setting the reproduction quality including the reproduction rate and the resolution of each of the first moving image and the second moving image that are to be reproduced among the plurality of moving images;
Each of the first moving image and the second moving image is reproduced with the reproduction quality set by the processing of the setting step, and a first region and a second of a predetermined 3D (3Dimensional) object are reproduced. A display control step for performing control for pasting the texture as a texture to each of the areas and displaying the 3D object ,
In the setting step, when the reproduction is controlled by the process of the display control step based on the display area of the first region of the 3D object and the original resolution of the first moving image, The resolution of one moving image is set, and reproduction is performed by the processing of the display control step based on the display area of the second region of the 3D object and the original resolution of the second moving image. The resolution of the second moving image in the case of being controlled is set, and when the processing load exceeds a predetermined threshold, the first moving image whose reproduction is controlled by the processing of the display control step characterized in that it comprises the one of the second moving image, the reproduction rate of the moving image of interest until the load can be maintained at a constant value, lowering the playback rate of the remaining moving image Program to be.

Images