JP2006166165A - Information processing apparatus, method thereof, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable reproducing a still image having an arbitrary image size and an aspect ratio as slide show with suitable screen configuration. <P>SOLUTION: A trimming unit 164 trims the image having the maximum image size including a rectangle having the same aspect ratio as a set value from still images supplied from an image data acquiring unit 162 on the basis of a determination result supplied from a processing determining unit 163. An image size changing unit 165 changes the image size of an image supplied from the trimming unit 164 into the image size of a set value supplied from a setting value acquiring unit 161. An effect processing unit 166 applies effect processing to the image, supplied from the unit 165 having the aspect ratio and image size equal to the set values. This apparatus is applicable to equipment such as a personal computer capable of handling a still image. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information processing apparatus and method, and a program, and more particularly, an information processing apparatus and method, and a program that allow a still image having an arbitrary image size and aspect ratio to be reproduced as a slide show with an appropriate screen configuration. About.

  Many devices such as personal computers that can handle still images taken with digital cameras are equipped with a so-called slide show function that automatically displays still images in order at predetermined intervals such as every second. Has been. Some of these devices allow the user to select the music that will be the background music for the slide show according to their preference.

  Thus, the user can view the still images that are automatically displayed in sequence while listening to a favorite song without performing an operation to display the still images one by one.

  In addition, there are some which have a slide show function that sequentially displays still images with various effects, instead of displaying still images (captured still images) captured by the device as they are (for example, Non-Patent Document 1). reference).

  In this case, by selecting the still image to be played, the type of effect, and the BGM song, the user creates content with BGM that can automatically display the still image with the effect in sequence. be able to.

Further, a system that schedules and processes image data and sound data has been considered (for example, see Patent Document 1).
“Docomo Mova P506iC Photo Cocktail”, Internet <URL: http://panasonic.jp/mobile/p506ic/photo/index.html> JP-T-2001-507471

  However, for example, in the case of an information processing apparatus that operates a slide show application as described in Non-Patent Document 1 or a system as described in Patent Document 1, in order to improve user operability, The effects selected from these are applied to the still image. Therefore, the image size and aspect ratio when displaying a still image are predetermined.

  Therefore, depending on the image size and aspect ratio of the still image designated to be displayed as a slide show, the information processing apparatus may not be able to obtain an image having the image size and aspect ratio at the time of display. was there.

  FIG. 1 is a diagram illustrating still images and image clipping.

  For example, as shown in FIG. 1A, when the effect of displaying a still image with the image size and aspect ratio indicated by the frame 1 displays the still image 2, the center of the frame 1 is positioned at the center of the still image 2. Thus, the frame 1 falls within the image range of the still image 2. That is, in this case, the information processing apparatus that performs the slide show can display an image in the frame 1 that is configured by only the still image 2. That is, the information processing apparatus can display the still image 2 with the effect applied as intended by the effect producer.

  However, with this effect, when a vertically long still image 3 is displayed as shown in FIG. 1B, even if the center of the horizontally long frame 1 is positioned at the center of the still image 3, the inside of the frame 1 as shown by the oblique lines is shown. Includes a portion other than the still image 3. That is, in this case, the information processing apparatus that performs the slide show displays an image in the frame 1 including an image other than the still image 3 (for example, a black image). That is, the information processing apparatus cannot display the still image 3 with the effect as intended by the effect producer.

  Further, with this effect, when a still image 4 having a small image size is displayed with respect to the frame 1 as shown in FIG. 1C, even if the center of the frame 1 is positioned at the center of the still image 4, it is indicated by diagonal lines. Thus, the frame 1 includes a portion other than the still image 4. That is, in this case, the information processing apparatus that performs the slide show displays an image in the frame 1 including an image other than the still image 4 (for example, a black image). That is, the information processing apparatus cannot display the still image 4 with an effect as intended by the effect producer.

  In order to prevent an unnecessary image such as a black image from being displayed, the shape of the frame 1, that is, the image size and aspect ratio when displaying a still image (the still image on the image on which the effect has been applied). It is also conceivable to change the image size and aspect ratio. However, in that case, for example, the relationship between the still image and other objects displayed together with the still image may be different from the intention of the effect producer.

  In this way, the still image is displayed together with an unnecessary image such as a black image, or the image size and aspect ratio of the still image on the display image are different from those planned, so that the effect becomes a still image. However, there is a risk that the originally intended production (the production intended by the effect producer) will not be performed.

  The present invention has been made in view of such a situation. By correcting the image size and aspect ratio of a still image at the time of an effect, a still image having an arbitrary image size and aspect ratio can be displayed as a slide show with an appropriate screen configuration. It can be played back.

  An information processing apparatus according to the present invention includes a setting value acquisition unit that acquires setting values of an aspect ratio and an image size of a still image to be reproduced, included in reproduction control information for controlling reproduction of image data, and a still image of the image data From the setting value acquisition unit, the image having the aspect ratio of the setting value acquired by the setting value acquisition unit and the image size of the partial image extracted by the extraction unit are extracted. Image size changing means for changing to the image size of the set value acquired by the means, and reproduction control means for reproducing the image whose image size has been changed by the image size changing means based on the reproduction control information. And

  The reproduction control information can be vector data.

  The reproduction control information includes a set of vector data effect control information that is control information of effect processing for each piece of image data for controlling reproduction, and the setting value acquisition unit acquires a setting value for each effect control information. Can be.

  The image data further includes a determination unit that determines whether the aspect ratio and the image size of the image data match the aspect ratio and the image size of the set value, and the clipping unit determines whether the aspect ratio and the image size of the image data are determined by the determination unit. Clipping can be performed only when it is determined that the aspect ratio and image size of the setting value do not match.

  An information processing method of the present invention includes a setting value acquisition step for acquiring setting values of an aspect ratio and an image size of a still image to be reproduced, which are included in reproduction control information for controlling reproduction of image data, and a still image of image data The cut-out step of cutting out the partial image having the maximum image size, which is the image of the aspect ratio of the set value acquired by the process of the set value acquisition step, and the image size of the partial image cut out by the process of the cut-out step The image size changing step for changing to the image size of the setting value acquired by the processing of the setting value acquisition step, and the playback for reproducing the image whose image size has been changed by the processing of the image size changing step based on the playback control information And a control step.

  The program of the present invention includes a setting value acquisition step for acquiring setting values of an aspect ratio and an image size of a still image to be reproduced, included in reproduction control information for controlling reproduction of image data, and a still image of image data, Set the cut-out step to cut out the partial image with the maximum image size, which is the image with the aspect ratio of the set value acquired by the process of the set-value acquisition step, and the image size of the partial image cut out by the process of the cut-out step An image size changing step for changing to the image size of the set value acquired by the processing of the value acquisition step, and a playback control step for playing back the image whose image size has been changed by the processing of the image size changing step based on the playback control information It is characterized by including.

  In the information processing apparatus and method and the program of the present invention, the setting values of the aspect ratio and the image size of the still image to be reproduced, which are included in the reproduction control information for controlling the reproduction of the image data, are obtained, and the image data From the image, a partial image having the aspect ratio of the acquired setting value and having the maximum image size is cut out, and the image size of the cut out partial image is changed to the image size of the setting value. The image whose image size has been changed is reproduced based on the reproduction control information.

  According to the present invention, still images having an arbitrary image size and aspect ratio can be reproduced as a slide show with an appropriate screen configuration.

  Embodiments of the present invention will be described below. The correspondence relationship between the invention described in this specification and the embodiments of the invention is exemplified as follows. This description is intended to assure that embodiments supporting the claimed invention are described in this specification. Therefore, although there is an embodiment which is described in the embodiment of the invention but is not described here as corresponding to the invention, it means that the embodiment is not It does not mean that it does not correspond to the invention. Conversely, even if an embodiment is described herein as corresponding to an invention, that means that the embodiment does not correspond to an invention other than the invention. Absent.

  Further, this description does not mean all the inventions described in this specification. In other words, this description is for the invention described in the present specification and not claimed in this application, i.e., the existence of an invention that will be filed in the future or added by amendment. There is no denial.

  In the present invention, an information processing apparatus (for example, the information processing apparatus in FIG. 2) that processes image data is provided. In this information processing apparatus, setting value acquisition means (for example, setting value acquisition in FIG. 9) for acquiring setting values of the aspect ratio and image size of a still image to be reproduced included in reproduction control information for controlling reproduction of image data. And a cropping unit (for example, a trimming unit in FIG. 9) that cuts out a partial image having an aspect ratio of the set value acquired by the set value acquiring unit and having the maximum image size from the still image of the image data. An image size changing unit (for example, an image size changing unit in FIG. 9) that changes the image size of the partial image cut out by the cutout unit to the image size of the setting value acquired by the setting value acquiring unit; Reproduction control means (for example, the effect image processing unit in FIG. 8) for reproducing the image whose image size has been changed by the changing means based on the reproduction control information. Obtain.

  The reproduction control information can be vector data (for example, output vector data in FIG. 9).

  The reproduction control information includes a set of vector data effect control information (for example, FIG. 3A), which is control information for effect processing for each piece of image data for controlling reproduction, and the set value acquisition means is provided for each effect control information. A setting value can be acquired.

  The image data further includes a determination unit (for example, a processing determination unit in FIG. 9) that determines whether the aspect ratio and the image size of the image data match the aspect ratio and the image size of the setting value. The image data can be cut out only when it is determined that the aspect ratio and the image size of the image data do not match the aspect ratio and the image size of the set values.

  In the present invention, an information processing method of an information processing apparatus (for example, the information processing apparatus of FIG. 2) that processes image data is provided. In this information processing method, a setting value acquisition step (for example, step S1 in FIG. 10) for acquiring setting values of the aspect ratio and image size of a still image to be reproduced included in the reproduction control information for controlling reproduction of image data. ) And a cutout step (for example, step S4 in FIG. 10) of cutting out a partial image having an aspect ratio of the set value acquired by the process of the set value acquisition step and having the maximum image size from the still image of the image data. ), And an image size changing step (for example, step S5 in FIG. 10) for changing the image size of the partial image cut out by the processing of the cutting step to the image size of the setting value acquired by the processing of the setting value acquiring step. The image whose size has been changed by the processing of the image size changing step is reproduced based on the playback control information. Reproduction controlling step for (e.g., step S6 in FIG. 9) and a.

  Also in the program of the present invention, the embodiment (however, an example) corresponding to each step is the same as the information processing method of the present invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 2 is a diagram showing an example of the appearance of an information processing apparatus 11 to which the present invention is applied and a television receiver 12 (hereinafter referred to as TV 12) connected to the information processing apparatus 11 via a cable.

  The information processing apparatus 11 has a function of taking a still image taken with a digital camera or the like into a built-in HDD (Hard Disk Drive) via a memory card or a USB (Universal Serial Bus) cable and displaying it on the TV 12. . The information processing apparatus 11 performs, for example, a slide show in which still images with various effects are automatically and sequentially displayed (regardless of user operation) while using music selected by the user as BGM.

  FIG. 3 is a diagram illustrating an example of an effect applied to a still image. As shown in FIG. 3A, the frame image 13 after the effect is applied to the still image is composed of the still image 14 and images of other effects.

  In FIG. 3A, a still image 14 is an image provided by the user, such as a photographic image taken with a digital camera. The image size of the still image 14 is smaller than the frame image 13 as shown in FIG. 3A. The still image 14 moves in the horizontal direction from the left to the right as indicated by the arrow 15 in the frame image 13 by sequentially displaying a plurality of frame images 3 as moving images.

  In addition to the still image 14, the frame image 13 displays a circle object 16, a rectangular object 18, a rectangular object 20, and a rectangular object 22 as effects. The circle object 16 moves in the vertical direction from the top to the bottom as indicated by the arrow 17 in the frame image 13 by sequentially displaying a plurality of frame images 13 as moving images. The rectangular object 18, the rectangular object 20, and the rectangular object 22 are adjacent to each other, and a plurality of frame images 13 are sequentially displayed as moving images. It moves in the horizontal direction from right to left as indicated by arrow 23.

  Such an effect on one or several still images 14 is called an effect. The effect is usually an effect for displaying a set of still images for about several seconds. For example, the display size, shape, or movement of the still image 14, the size, shape, and the like of the object to be displayed together with the still image 14, Movement, color, etc. differ for each effect. A slide show is usually composed of a plurality of effects. That is, the total playback time of each effect played as a slide show is the slide show playback time. Usually, a slide show is a content of about several minutes.

  As described above, by displaying a still image group while producing a slide show, the information processing apparatus 11 can improve the entertainment of the still image group and improve the satisfaction of the user who views the slide show.

  The still image 14 in FIG. 3A may of course be the provided photographic image itself (unprocessed), but is usually a reduced image of the photographic image or a partial image of the photographic image 24 as shown in FIG. 3B. L is used.

  When preparing such a still image 14, the information processing apparatus 11 can display the image size and aspect of the displayed still image (for example, the photographic image 24) so that the effect creator can produce the effect as intended. The ratio is corrected, and the still image 14 is cut out from the corrected image.

  As described above, content that realizes a slide show with BGM that automatically displays still images with various effects while displaying the selected song as BGM (hereinafter referred to as slide show content as appropriate) is displayed on the TV 12. It is created by the user making various selections according to the wizard.

  For example, the user mainly performs two operations: an operation for selecting a photo album (a folder in which still image files are stored) in which still images to be reproduced by a slide show are stored, and an operation for selecting a song as BGM. The slide show content (actually “play list” as will be described later) can be created.

  That is, the information processing apparatus 11 stores, for example, a predetermined number of songs that can be used as BGM in the built-in HDD, and this song expresses an atmosphere that matches the atmosphere of the song. The effect is associated. The content of the effect is set so as to match the atmosphere of the song, for example, depending on the tempo and genre of the song.

  Therefore, when creating slide show content, the user can select an effect that matches the mood of the song simply by selecting a favorite song as BGM.

  In addition, the user can select the entire still image stored in the photo album as a reproduction target still image only by selecting a photo album instead of selecting each still image to be reproduced.

  For example, if the playback time when playing back all the still images stored in the photo album selected by the user is different from the playback time of a BGM song once, the playback time of the still image and the playback time of the song The information processing apparatus 11 automatically adjusts the number of still images to be reproduced, such as thinning out or repeatedly displaying still images stored in the photo album, so that the time is approximately the same time. Done.

  Furthermore, as described above, the information processing apparatus 11 scales the reproduction time of the selected effect in order to match the reproduction time of the image and the sound.

  This allows the user to simply select the photo album that contains the still image that he / she wants to play without being aware of the number of still images stored in one photo album or the playback time of the BGM song. Just do it.

  In accordance with the user's selection (selection of photo album and BGM music) as described above, the information processing apparatus 11 creates a playlist 25 as shown in FIG.

  When the user selects a playlist 25, a photo album and BGM music that are targeted by the playlist 25 are read out, and a playback procedure in which still images stored in the photo album are defined by the playlist 25 Will be played according to. At this time, the read song is also played back as BGM. As described above, the play list 25 is information for defining a playback procedure of still images and creating slide show content.

  Here, description contents of the playlist 25 will be described.

  As shown in FIG. 4, for example, “playlist name”, “photo album”, “use song”, “use template”, and “priority image” are described in the play list 25.

  “Playlist name” is the title of the playlist 25 and is set by the user as necessary.

  “Photo album” is information for designating a photo album storing a still image to be reproduced. When the playlist 25 is selected by the user, a photo album designated by “photo album” of the selected playlist 25 is read from the HDD, and a still image stored in the photo album is reproduced (displayed).

  “Used music” is information for designating BGM music. When the play list 25 is selected by the user, the music designated by the “use music” of the selected play list is read from the HDD and reproduced as BGM.

  The “use template” is associated with the song specified by “use song”, and is information (for example, “template name” in FIG. 5) that specifies a template in which the content of the effect is described. is there. When the playlist 25 is selected by the user, the template specified by the “use template” of the selected playlist 25 is read from the HDD, and the effect of the content described in the template is added to the still image to be played back. Applied. The template will be described later with reference to FIG.

  The “priority image” is information for designating a still image to be preferentially displayed among the still images stored in the photo album designated by the “photo album”. As mentioned above, when many still images are stored in the photo album, some of them may be thinned out according to the playback time of the BGM song. The still image to be played is not selected as a thinning target, but is selected as a still image to be reproduced with priority over other still images. The designation of “priority image” may be automatically performed by the information processing apparatus 11 or may be designated by the user himself / herself.

  FIG. 5 is a diagram illustrating a description example of a template.

  As illustrated in FIG. 5, for example, “template name”, “effect type”, “decimation method”, “atmosphere”, and “PPM (Picture Par Minutes)” are described in the template 26.

  “Template name” is the title of the template 26.

  “Effect type” is information for designating a candidate for the type (content) of an effect to be applied to a still image to be reproduced. For example, a plurality of sub-effects indicating which part of one still image is to be displayed, where to display the entire screen, which size to display, and in which direction are moved are prepared. Sub-effects are combined in accordance with the tempo of the music with which is associated, and the contents of one effect are determined. The combination of the sub-effects and the like are designated by the “effect type” of the template 26. That is, “effect type” is a list of effect candidates used when a slide show is performed according to the template 26, and a plurality of candidates are usually listed. Then, any effect included in this list is selected and used for the slide show.

  “Thinning method” is information specifying how to thin out still images stored in a photo album. According to this “thinning method”, the playback time of the still image and the playback time of the BGM song are adjusted to be approximately the same time. Note that the still image thinning may be set to ON / OFF by the user. When the still image thinning is OFF (when thinning is not performed), all the still images stored in the photo album designated by “Photo Album” in the playlist 25 become the still images to be reproduced.

  “Atmosphere” is information representing an atmosphere expressed when a still image is reproduced according to the template 26.

  “PPM” is information for designating the number of still images to be reproduced (displayed) per minute. In the information processing apparatus 11, each still image to be played back is played back at the time specified by “PPM”.

  FIG. 6 is a block diagram illustrating a configuration example of the information processing apparatus 11 of FIG.

  A CPU (Central Processing Unit) 111 performs various processes according to a program stored in a ROM (Read Only Memory) 112 or a program loaded from a HDD (Hard Disk Drive) 120 to a RAM (Random Access Memory) 113. Execute. The RAM 113 also stores data necessary for the CPU 111 to execute various processes as appropriate.

  The CPU 111, the ROM 112, and the RAM 113 are connected to each other via the bus 114. An input / output interface 115 is also connected to the bus 114.

  To the input / output interface 115, a recording / playback unit 117, an input unit 118, an output unit 119, an HDD 120, a communication unit 121, a memory card I / F (InterFace) 122, a drive 124, and a USB port 126 are connected.

  The recording / playback unit 117 compresses the television program data acquired from the signal supplied from the antenna 116 by, for example, MPEG (Moving Picture Experts Group) 2 system, and the data (video content) obtained by the compression is The data is supplied to and stored in the HDD 120 via the input / output interface 115. Further, the recording / playback unit 117 expands the video content stored in the HDD 120 and causes the output unit 119 to output the obtained television program image data to the TV 12. That is, the information processing apparatus 11 has a function of recording and playing back a television program.

  The input unit 118 is composed of, for example, an infrared light receiving unit. The input unit 118 receives a signal from a remote controller (not shown), and outputs information representing the operation contents of the user to the CPU 111.

  The output unit 119 converts the image data supplied via the input / output interface 115 into an analog signal, and outputs the obtained image signal to the TV 12 via a cable. For example, image data obtained by reproducing a still image according to a playlist, image data of video content reproduced by the recording / reproducing unit 117, and the like are supplied to the output unit 119. The output unit 119 converts music data supplied via the input / output interface 115 into an analog signal and outputs the obtained signal to the TV 12.

  The HDD 120 includes video content obtained by the recording / playback unit 117, still images captured from the memory card 123 by the memory card I / F 122, still images captured from the digital camera via the USB port 126 and the USB cable, and a drive. The music data (audio content) which is taken in from the optical disk 125 by the signal 124 and compressed by the MP3 (MPEG Audio Layer-3) method or the like is stored.

  The HDD 120 also stores a playlist created according to the selection by the user, BGM song data, a template associated with the BGM song, slideshow content, and the like.

  The communication unit 121 performs communication processing via a network.

  The memory card I / F 122 reads data stored in a memory card 123 mounted in a memory card slot formed in the housing of the information processing apparatus 11 and stores the read data in the HDD 120 or the like. For example, still image data or the like is taken into the information processing apparatus 11 via the memory card 123.

  The drive 124 drives the mounted optical disk 125 to read data stored in the optical disk 125 and write data to the optical disk 125. The optical disk 125 is a CD (Compact Disk), a DVD (Digital Versatile Disc), or the like. Data such as still images, audio contents, and video contents are also taken into the information processing apparatus 11 by the optical disk 125. The drive 124 writes the created slide show content on the optical disc 125 as appropriate.

  The information processing apparatus 11 also has a function as a game machine. The game (program) image read from the optical disk 125 by the drive 124 is also supplied to the output unit 119 via the input / output interface 115 and output to the TV 12.

  The USB port 126 communicates with an external device such as a digital camera via a USB cable, and stores the captured still image (image data) in the HDD 120.

  FIG. 7 is a block diagram illustrating a functional configuration example of the information processing apparatus 11. At least a part of each functional unit shown in FIG. 7 is realized by a predetermined program being executed by the CPU 111 of FIG.

  The information processing apparatus 11 includes a content management unit 131, a BGM / template management unit 132, a slide show content creation unit 133, a playback unit 134, a playlist creation unit 135, and an output control unit 136.

  The content management unit 131 manages various contents such as still images, video contents, audio contents, and playlists stored in the HDD 120. Information on the content managed by the content management unit 131 is output to the output control unit 136 and used for displaying a menu screen described later.

  When the playlist is created, the content management unit 131 supplies information such as the title of the photo album selected by the user to the playlist creation unit 135, and when the playlist is played back, the photo album to be played back by the playlist (Photo album specified by “Photo Album” in the playlist) is read from the HDD 120 and output to the playback unit 134. In addition, the content management unit 131 stores the slide show content created and supplied by the slide show content creation unit 133 in the HDD 120.

  The BGM / template management unit 132 manages BGM songs and templates in association with each other and stores them in the HDD 120 in advance. The BGM / template management unit 132 outputs the managed BGM song information to the output control unit 136 when the playlist is created, and the BGM song information selected by the user and the information are associated with the information. Is output to the playlist creation unit 135. Also, the BGM / template management unit 132 outputs, to the playback unit 134, the template specified by the “use template” of the playlist and the BGM song specified by the “use song” of the playlist.

  The slide show content creation unit 133 acquires output vector data equivalent to the playback result of the playback unit 134 (a sequence of a plurality of still images played back continuously according to the playlist) from the playback unit 134, and titles are output to the output vector data. A slide show content completed as content is created by adding necessary information such as. The slide show content created by the slide show content creation unit 133 is output to the content management unit 131 and stored in the HDD 120.

  When the playback of the playlist is instructed, the playback unit 134 plays the playlist instructed to play, the photo album specified by the “photo album” of the playlist, and the BGM specified by the “use song” Get songs and play playlists. In addition, the playback unit 134 supplies output vector data equivalent to the output data to the slide show content creation unit 133 in response to the request. The detailed configuration of the reproduction unit 134 will be described with reference to FIG.

  The playlist creating unit 135 describes the information of the photo album selected by the user, the information of the BGM song selected by the user, the information of the template associated with the song, and the like as shown in FIG. A list is created, and the created playlist is output to the content management unit 131 or the playback unit 134. The information of the photo album selected by the user during the creation of the playlist is supplied from the content management unit 31, and the information of the BGM song and the template information associated with the song are supplied from the BGM / template management unit 132. Will be supplied.

  Based on information supplied from the content management unit 131, BGM / template management unit 132, and playback unit 134, the output control unit 136 guides the user through the playlist creation procedure (wizard screen), information A menu screen serving as a start screen for operations performed using the processing device 11 is displayed on the TV 12.

  FIG. 8 is a block diagram illustrating a detailed configuration example of the reproduction unit 134.

  The reproduction unit 134 includes a playlist reproduction control unit 141, an output vector data generation unit 142, a slide show content reproduction control unit 143, a BGM reproduction unit 144, an extraction unit 145, an effect image processing unit 146, an internal memory 147, and a decoding processing unit 149. Consists of.

  When a playlist instructed to be played back by the user is supplied from the content management unit 131, the playlist playback control unit 141 analyzes the playlist and generates information necessary for generating output vector data. To the unit 142.

  The output vector data generation unit 142 generates output vector data that is vector data of an output slide show based on information (information such as a playlist and a template) supplied from the playlist reproduction control unit 141. The effect information and the like are composed of coordinates of points and parameters of line and surface equations connecting them, and vector format information expressed as a set of drawing information such as paint and special effects. That is, the output vector data generation unit 142 selects BGM, still images, effects, and the like to be adopted as a slide show from information specified in the playlist, and uses a vector format equivalent to the slide show output using them. Data (output vector data) is generated. In the playlist, it is not specified which specific still image is displayed in what order and what effect is displayed. The output vector data generation unit 142 determines the specific content of such a slide show by generating output vector data. The output vector data generation unit 142 supplies the generated output vector data to the BGM playback unit 144, the extraction unit 145, and the effect image processing unit 146.

  When a slide show content designated by the user, that is, when output vector data is supplied from the content management unit 131, the slide show content playback control unit 143 receives the slide show content (output vector data) as a BGM playback unit 144 and an extraction unit 145. And the effect image processing unit 146 to control the playback of the slide show content. The slide show content is content completed as a slide show, and is configured by vector format data. That is, the slide show content is obtained by storing the above-described output vector data as content.

  The BGM playback unit 144 acquires BGM songs from the BGM / template management unit 132 based on the output vector data supplied from the output vector data generation unit 142 or the slide show content 143, plays back the acquired song data, and effects This is supplied to the image processing unit 146.

  The extraction unit 145 reproduces the image by thinning out the still images stored in the photo album supplied from the content management unit 131 according to the output vector data supplied from the output vector data generation unit 142 or the slide show content 143. Extract the target still image. As a result, the still picture playback time and the BGM playback time are adjusted to be approximately the same time. The still image extracted by the extraction unit 145 is supplied to the effect image processing unit 146 as a still image to be reproduced.

  When the thinning is set to OFF, the extraction unit 145 does not perform still image thinning, and all the still images stored in the photo album supplied from the content management unit 131 are to be played back. The image is supplied to the internal memory 147 as an image and held.

  The effect image processing unit 146, based on the output vector data supplied from the output vector data generation unit 142 or the slide show content 143, is a still image to be reproduced (an image decoded as described later) held in the internal memory 147. Data still image), effects are applied to the still image, and the still image data (raster format frame image data) subjected to the effect is synchronized with the BGM data supplied from the BGM playback unit 144 Output data is generated, and the output data is supplied to the output control unit 136. Further, the effect image processing unit 146 supplies the used output vector data to the internal memory 147 at a predetermined timing and holds it.

  The internal memory 147 is a memory area secured in the RAM 113 by the processing executed by the CPU 111 in FIG. 6, and includes a buffer memory that temporarily holds a still image (image data) to be reproduced, and output vector data. Used for temporary holding. The output vector data is output to the slide show content generation unit 133 as necessary.

  The decoding processing unit 149 acquires image data (encoded image data supplied and held by the extraction unit 145) held in the buffer of the internal memory 147, and encodes the image data in a method corresponding to encoding. Perform decoding processing. When the decoding process is completed, the decoding processing unit 149 holds the decoded image data in the buffer of the internal memory 147 again.

  The reproduction of the playlist by the reproduction unit 134 having such a configuration is also performed when the user instructs the preview reproduction of the playlist that is being created. When the preview reproduction of the playlist is instructed by the user, the playlist being created is supplied from the playlist creation unit 135 to the reproduction unit 134, and the reproduction is performed by each unit in FIG.

  FIG. 9 is a diagram illustrating a detailed configuration example of the effect image processing unit 146 of FIG.

  As shown in FIG. 9, the effect image processing unit 146 includes a set value acquisition unit 161, an image data acquisition unit 162, a process determination unit 163, a trimming unit 164, an image size change unit 165, and an effect processing unit 166. is doing.

  The setting value acquisition unit 161 sets the image size and aspect ratio of the still image in the raster data (display image) after the effect processing for the effect to be processed based on the output vector data supplied from the output vector data generation unit 142. Get the setting value. That is, the setting value acquisition unit 161 acquires information on what image size and aspect ratio the still image is displayed by the effect to be processed. The setting value acquisition unit 161 supplies the setting value to the process determination unit 163, the trimming unit 164, and the image size changing unit 165.

  The image data acquisition unit 162 acquires a still image (image data) to be processed (extracted by the decoding processing unit 149) extracted by the extraction unit 145 and held in the internal memory 147. The image data acquisition unit 162 supplies the acquired still image (image data) to the processing determination unit 163, the trimming unit 164, and the effect processing unit 166.

  The process determination unit 163 determines whether the image size and the aspect ratio of the still image are equal to the set value, and determines whether to perform a process related to cropping an image to be displayed from the supplied still image. If the process determination unit 163 determines to perform image processing, the process determination unit 163 supplies the determination result to the trimming unit 164 and causes the trimming unit 164 and the image size changing unit 165 to perform image processing. If it is determined that image processing is not performed, the process determination unit 163 supplies the determination result to the effect processing unit 166.

  The trimming unit 164 includes, based on the determination result supplied from the processing determination unit 163, a portion having the maximum image size that includes a rectangle having an aspect ratio equal to the set value from the still image supplied from the image data acquisition unit 162. Trim the image. That is, the trimming unit 164 cuts out an image having a set aspect ratio from a processing target still image so that the image size is maximized. The trimming unit 164 supplies the trimmed partial image (image data) to the image size changing unit 165.

  The image size changing unit 165 changes the image size of the partial image supplied from the trimming unit 164 to the image size of the setting value supplied from the setting value acquisition unit. The image size changing unit 165 supplies the partial image whose image size has been changed to the effect processing unit 166.

  That is, the trimming unit 164 and the image size changing unit 165 prepare a partial image having the image size and aspect ratio set in the effect vector data from the effect processing target still image, and supply the partial image to the effect processing unit 166.

  The effect processing unit 166 performs effect processing indicated by the output vector data on the partial image supplied from the image size changing unit 165 or the still image supplied from the image data acquisition unit 162, and outputs raster data as output raster data. Generate some output data. That is, the effect processing unit 166 uses the supplied still image (image data) to generate an image displayed as a slide show (an image in which an effect is applied to the still image). The effect processing unit 166 supplies the output data to the output control unit 136.

  The effect image processing unit 146 configured as described above performs trimming or image size change on a still image on which effect processing is performed as necessary when effect image processing is executed to generate output data (raster data). Processing is performed to prepare a still image in which the image size and aspect ratio are adjusted to the set values, and effect processing is performed on the adjusted still image. The effect image processing executed by the effect image processing unit 146 will be described with reference to the flowchart of FIG.

  When the effect image processing is started, the setting value acquisition unit 161 acquires the setting values of the still image aspect ratio and the image size specified in the effect to be processed, based on the output vector data. In step S2, the image data acquisition unit 162 acquires image data of a processing target still image held in the internal memory 147.

  In step S3, the process determination unit 163 determines whether the image aspect ratio and the image size of the acquired image data are equal to the set values. That is, the processing determination unit 163 needs to perform image processing such as trimming or enlargement / reduction before performing the effect processing, unlike the setting value set for the output vector data in the image size and aspect ratio of the still image to be processed. It is determined whether or not there is. If it is determined that the image aspect ratio and image size of the acquired image data are not equal to the set values, the process determination unit 163 advances the process to step S4.

  In step S4, the trimming unit 164 trims a partial image having a maximum image size that includes a rectangle having an aspect ratio equal to the set value. That is, the trimming unit 164 trims (cuts out) a partial image having the maximum image size that satisfies the aspect ratio of the setting value from the still image acquired from the internal memory 147.

  In step S5, the image size changing unit 165 changes (enlarges or reduces) the image size of the partial image trimmed by the trimming unit 164 in the process of step S4 to be equal to the set value. When the process of step S5 ends, the image size changing unit 165 advances the process to step S6.

  If it is determined in step S3 that the image aspect ratio and image size of the acquired image data are equal to the set values, the process determination unit 163 advances the process to step S6.

  In step S6, the effect processing unit 166 adds the effect by performing the effect process on the processing target image, and generates output data (raster data) that produces the image. That is, the effect processing unit 166 controls the effect processing for the still image acquired from the internal memory 147 when the process determination unit 163 performs control so as not to change the image size or aspect ratio of the still image acquired from the internal memory 147. To generate output data. Conversely, when the processing determination unit 163 performs control so as to change the image size or aspect ratio of the still image acquired from the internal memory 147, the effect processing unit 166 applies to the processed partial image (still image). Performs effect processing and generates output data.

  When the output data is generated, the effect processing unit 166 ends the effect image processing.

  FIG. 11 is a diagram illustrating an example of a state in which image processing is performed on a still image acquired from the internal memory 147.

  In FIG. 11A, a still image 171 acquired from the internal memory 147 is a vertically long image, and has at least an aspect ratio different from a horizontally long image (setting value) for which the effect is required in the output vector data. In such a case, the trimming unit 164 of the effect image processing unit 156 sets the frame 172 so as to obtain a partial image that satisfies the aspect ratio setting value in the output vector data and has the maximum image size. As a line, an image inside the frame 172 is trimmed to obtain a partial image 173 shown in FIG. 11B. This processing corresponds to the processing in step S4 in FIG.

  Although the aspect ratio of the partial image 173 shown in FIG. 11B is equal to the set value, the image size may be different from the set value. Therefore, the image size changing unit 165 performs an image size changing process such as enlargement or reduction on the partial image 173 to generate an image 174 having an image size and an aspect ratio equal to the set values as shown in FIG. 11C. , And supplies it to the effect processing unit 166. This processing corresponds to the processing in step S5 in FIG.

  FIG. 12 is a diagram for explaining another example of how image processing is performed on a still image acquired from the internal memory 147.

  12A, the still image 181 acquired from the internal memory 147 has an aspect ratio equal to the aspect ratio of the set value in the output vector data, but the image size is smaller than the image size 182 of the set value in the output vector data.

  In such a case, the trimming unit 164 of the effect image processing unit 156 sets the frame 183 so as to obtain a partial image that satisfies the aspect ratio setting value in the output vector data and has the maximum image size, and uses the frame 183 as a boundary. The image inside the frame 183 is trimmed as a line, and the image 184 shown in FIG. 12B is acquired. Note that this image 184 is equivalent to the image 181 because the aspect ratio and the image size of the image 181 match. This processing corresponds to the processing in step S4 in FIG.

  The image 184 shown in FIG. 12B has an aspect ratio equal to the set value, but the image size is different from the set value. Accordingly, the image size changing unit 165 performs an image size changing process such as enlargement or reduction on the image 184 to generate an image 185 having an image size and an aspect ratio equal to the set values as shown in FIG. 12C. It is supplied to the effect processing unit 166. This processing corresponds to the processing in step S5 in FIG.

  As described above, the effect image processing unit 146 performs processing on the still image before applying the effect to the still image acquired from the internal memory 147, and the image size and aspect ratio are values required by the effect. To correct. By doing so, the information processing apparatus 1 performs effect processing on a still image having an arbitrary image size and aspect ratio as intended by the effect producer, and reproduces it as a slide show with an appropriate screen configuration. Can do. In other words, the information processing apparatus 1 provides a high-quality slide show to the user without displaying an unnecessary image or giving an unnatural effect regardless of the image size and aspect ratio of the still image. It can be provided and the satisfaction of the user can be improved.

  Next, a specific usage example of the effect image processing as described above will be described.

  First, a menu screen displayed on the TV 12 by the output control unit 136 will be described.

  13 and 14 are diagrams showing examples of menu screens.

  On the menu screen, category icons 191 to 195, which are icons representing the respective categories, are arranged and displayed in the horizontal direction of the screen, as shown by being surrounded by a dotted line in FIG. In addition, as shown by being surrounded by a dotted line in FIG. 14, a content icon (video content icon 201) representing a content belonging to the category selected by the user in the vertical direction orthogonal to the arrangement direction of the category icons 191 to 195. To 204) are arranged and displayed. The dotted lines in FIGS. 13 and 14 are given for convenience of explanation, and are not actually displayed on the menu screen.

  In the example of FIG. 13 and FIG. 14, a category icon 191 representing the “Photo” category, a category icon 192 representing the “music” category, and a category icon representing the “video” category. 193, a category icon 194 representing a “television” category, and a category icon 195 representing a “game” category are displayed arranged from the left to the right of the screen.

  In the example of FIGS. 13 and 14, “video” is selected by the user, and content icons 201 to 204 that are icons representing video content belonging to “video” are arranged in the vertical direction. Among the content icons 201 to 204, the currently selected icon is the content icon 202, and a video content title or the like represented by the content icon 202 is displayed next to the content icon 202.

  In such a menu screen, the user can basically select a category by a horizontal operation (left and right buttons) of the remote controller, and select a category by a vertical operation (up and down buttons). Content belonging to a category can be selected.

  Depending on the operation by the user, category icons 191 to 195 (category icons 191 to 195 and category icons representing other categories not shown in FIGS. 13 and 14) and content icons 201 to 205 (content icons 201 to 205). 205 and other content icons not displayed in FIGS. 13 and 14 are moved and displayed as a whole.

  For example, in the state of FIG. 13 in which “video” is selected, when the user presses the left button only once, the entire category icons 191 to 195 move to the right, and the category icon 193 is now displayed. The category icon 192 is displayed at the position, and the category icon 191 is displayed at the position where the category icon 192 is displayed.

  Similarly, the category icon 193 is displayed at the position where the category icon 194 is currently displayed, and the category icon 194 is displayed at the position where the category icon 195 is displayed. At the position where the category icon 191 is currently displayed, category icons of other categories that are arranged on the left side of the category icon 191 and are not displayed in FIGS. 13 and 14 are displayed.

  As a result, “music” is selected instead of “video”, and content icons representing audio contents belonging to “music” are arranged and displayed in the vertical direction.

  On the other hand, when the user presses the right button only once in the state shown in FIG. 13, the category icons 191 to 195 move to the left as opposed to pressing the left button, and “TV” is selected. Become.

  Further, for example, in the state of FIG. 14 where the content icons 201 to 204 are displayed, when the user presses the up button only once, the entire content icons 201 to 204 move upward, and the content icon 201 is now displayed. The content icon 202 is displayed at the displayed position, and the content icon 203 is displayed at the position where the content icon 202 is displayed.

  Similarly, the content icon 204 is displayed at the position where the content icon 203 is currently displayed, and the content icon 204 is arranged below the content icon 204 at the position where the content icon 204 is displayed. Content icons that are not displayed are displayed.

  As a result, the state where the content icon 202 is selected is switched to the state where the content icon 203 is selected. At this time, a video content title or the like represented by the content icon 203 is displayed next to the content icon 203.

  On the other hand, when the user presses the down button only once in the state shown in FIG. 13, the entire content icons 201 to 204 move downward, and the content icon 201 is selected, as opposed to pressing the up button. Become.

  By selecting a category and content as described above and operating the OK button on the remote controller, the user can display a submenu that displays a list of operations that can be performed using the currently selected content. Can be made. The user can select reproduction, copying, editing, deletion, etc. of the currently selected content from a submenu displayed when a certain content is selected.

  Next, playlist creation processing performed by the information processing apparatus 11 will be described with reference to the flowcharts of FIGS. 15 to 17.

  In step S71, the output control unit 136 displays a menu screen as described with reference to FIGS. When “Photo” is selected from the menu screen, icons representing wizards used when creating or modifying a playlist are displayed alongside content icons representing photo albums.

  FIG. 18 is a diagram showing an example of the menu screen displayed in step S71 of FIG. The same parts as those in FIG.

  FIG. 18 shows the state of the menu screen in which “Photo” is selected. Under the category icon 51, an icon 221 representing a wizard and content icons 222 to 224 representing photo albums are displayed. In FIG. 18, the icon 221 is selected, and the characters “Create / Modify Playlist” are displayed on the right side of the icon 221. In FIG. 18, a category icon 211 representing various setting categories is displayed on the left side of the category icon 191.

  When the determination button is selected by the user while the icon 221 is selected from the menu screen of FIG. 18 (when the wizard is instructed to start), the process proceeds to step S72.

  In step S72, the content management unit 131 confirms the number of playlists already created and stored in the HDD 120, and proceeds to step S73 to determine whether the number of playlists is equal to or less than a predetermined number. . That is, in this example, an upper limit is set for the number of playlists, and when the number of playlists has already been created, it is not possible to create more playlists.

  In step S73, if the content management unit 131 determines that the number of playlists is not less than or equal to the predetermined number (has reached the upper limit), the content management unit 131 notifies the output control unit 136 of this, and proceeds to step S74.

  In step S74, the output control unit 136 displays a start screen in which creation of a new playlist cannot be selected.

  Although not shown in the figure, for example, a message “Create a work from a photo stored in an album or modify a work that has already been created.” Is displayed on this start screen. Below, characters “correct” selected when correcting a playlist that has already been created are displayed.

  For example, the user can correct the playlist that has already been created by pressing the determination button of the remote controller in a state where the character “correct” is selected (a state in which the color is inverted). When the characters “correct” are selected, the playlist creation process shown in FIGS. 15 to 17 is terminated, and the playlist modification process is started. The description of the playlist correction process is omitted.

  On the other hand, in step S73, when the content management unit 131 determines that the number of playlists is equal to or less than the predetermined number, the content management unit 131 notifies the output control unit 136 of this, and proceeds to step S75.

  In step S75, the output control unit 136 displays a start screen from which new creation of a playlist can be selected.

  The configuration of the start screen in this case is basically the same as that of the above-described start screen. For example, a character “create new” is further displayed on the character “correct”. When the determination button is pressed in a state where the character “create new” is selected by the user, a new playlist creation process is started, and the process proceeds to step S76.

  In step S76, the content management unit 131 determines whether or not a photo album is stored in the HDD 120. If it is determined that the photo album is not stored, the content management unit 131 notifies the output control unit 136 of the determination. Thereafter, the process proceeds to step S77.

  In step S77, the output control unit 36 displays an error screen notifying that there is no photo album.

  In this error screen, for example, a message “There is no album that can create a playlist. Creation / modification of a playlist is terminated.” Is displayed. As described above, in the information processing apparatus 11, since the selection of the still image to be played back by the slide show is performed by selecting the photo album, the user selects the still image to be played back when there is no photo album. Can not do it. Thereafter, the processing returns to step S71, and the subsequent processing is performed.

  On the other hand, in step S76, when the content management unit 131 determines that the photo album is stored in the HDD 120, the content management unit 131 notifies the output control unit 136 of this, and information on the photo album stored in the HDD 120 (photo) Album title, icon image, etc.) are output to the output control unit 136. Thereafter, the process proceeds to step S78.

  In step S78, the output control unit 136 displays a photo album selection screen.

  For example, icons representing three photo albums are displayed on the selection screen. On the right side, for example, “Album 2”, which is the title of the photo album, and “2004/6/2 1:00:32 AM”, which is the creation date (capture date), are displayed. The user can select a predetermined photo album from this selection screen.

  When the photo album is selected, in step S79, the content management unit 131 confirms the format of the still image stored in the selected photo album, proceeds to step S80, and in the photo album selected by the user. It is determined whether there is a still image (JPEG file) compressed by JPEG (Joint Photographic Expert Group). That is, in this example, the still image to be processed is a JPEG file.

  In step S80, if the content management unit 131 determines that there is no JPEG file in the photo album selected by the user, the content management unit 131 notifies the output control unit 136 of this, and proceeds to step S81.

  In step S81, the output control unit 136 displays an error screen notifying that there is no JPEG file.

  For example, a message “There is no file that can be used to create a playlist. Please select an album again.” Is displayed on this error screen. After this screen is displayed, the process returns to step S78 to select the photo album again.

  On the other hand, in step S80, if the content management unit 131 determines that there is a JPEG file in the photo album selected by the user, the content management unit 131 notifies the output control unit 136 of this and proceeds to step S82.

  In step S82, the output control unit 136 displays a BGM song selection screen. BGM song information such as titles and icons is supplied from the BGM / template management unit 132.

  For example, icons representing three songs are displayed on the selection screen, and the title of the song is displayed on the right side thereof. The user can select a favorite song from this selection screen and use it as background music during a slide show. As described above, since the BGM song and the template are associated with each other, the selection of the song here also means the selection of the template.

  When a BGM song is selected, the output control unit 136 displays a confirmation screen for the selection contents so far (settings relating to the created playlist) in step S83.

  In this screen, for example, “Tripbook” which is the title of the photo album selected by the user, “Music1” which is the title of the BGM song selected by the user, and the playback time of “Music1” are displayed. “2:00” or the like is displayed. The user can check the contents of the setting and select whether or not to create a playlist with this setting.

  When it is instructed to create a playlist, a playlist creation process is performed in step S84. With this playlist creation process, a playlist as shown in FIG. 4 is created by the playlist creation unit 135 according to the selection by the user. Details of the playlist creation processing will be described later with reference to the flowchart of FIG. The playlist created here is one for which “playlist name” (FIG. 4) has not yet been set.

  As described above, the user can create a playlist mainly by two operations, that is, an operation of selecting a photo album and an operation of selecting a BGM song.

  When the playlist is created, in step S85 (FIG. 16), the output control unit 136 displays a selection screen that allows selection of preview playback of the playlist and storage of the playlist.

  FIG. 19 is a diagram showing an example of the selection screen displayed in step S85 of FIG.

  The selection screen of FIG. 19 includes a playback button 231 that is operated when preview playback of the playlist created in step S84, a save button 232 that is operated when saving the playlist, and subsequent processing. A cancel button 233 operated when canceling is displayed.

  In step S86, the playlist creation unit 135 determines whether or not the preview playback has been selected by operating the playback button 231 in FIG. 19, and if it is determined that the preview playback has been selected, the playlist creation unit 135 creates the process in step S84. The playlist is output to the playback unit 134.

  In step S87, preview reproduction processing is performed, and the playlist created in step S84 is reproduced. Thereby, the user can confirm what kind of still image is reproduced according to the reproduction procedure defined by the playlist. Details of the preview reproduction process will be described later with reference to the flowchart of FIG. When the preview reproduction process ends, the process returns to step S85, and the subsequent processes are performed.

  On the other hand, if the playlist creation unit 135 determines in step S86 that the preview playback of the playlist has not been selected, the process proceeds to step S88, where the save button 232 has been operated and whether or not the playlist has been selected has been selected. Determine.

  If it is determined in step S88 that play list saving has not been selected, the playlist creation unit 135 determines that the cancel button 233 has been operated, and notifies the output control unit 136 of this fact. Thereafter, the process proceeds to step S89.

  In step S89, the output control unit 136 displays a wizard cancellation confirmation screen.

  On this cancel confirmation screen, for example, a message “Cancel creation / modification of playlist. Are you sure?” Is displayed, and “Yes” and “No” are displayed below it. The user can finish creating the playlist by selecting the “Yes” character, and can continue creating the playlist by selecting the “No” character.

  In step S90, the output control unit 136 determines whether or not cancellation of playlist creation has been selected. If it is determined that cancellation has been selected, the output control unit 136 returns to step S71 and repeats the subsequent processing. If the output control unit 136 determines in step S90 that cancellation has not been selected, the output control unit 136 returns to step S85 and executes the subsequent processing.

  On the other hand, if the playlist creation unit 135 determines in step S88 that saving of the playlist has been selected, the playlist creation unit 135 notifies the output control unit 136 of the selection, and proceeds to step S91. When saving of the playlist is selected, the playlist created in the process of step S84 is output from the playlist creation unit 135 to the content management unit 131.

  In step S91, the output control unit 136 displays an input screen for a playlist title (playlist name).

  On this input screen, for example, a title input field for displaying a title input by the user is displayed, and a keyboard (software keyboard) is displayed below the title input field. For example, the user can operate the keyboard and input the title of the playlist.

  When the title of the playlist is input, in step S92, the content management unit 31 checks the input title, proceeds to step S93, and determines whether the title is appropriate.

  In step S93, if the content management unit 131 determines that the input title is not appropriate, the content management unit 131 notifies the output control unit 136 of this, and proceeds to step S94. For example, if there is already a playlist with the same title set, or if the entered title contains prohibited characters, the title is determined to be inappropriate. The

  In step S94, the output control unit 136 displays an error screen notifying that the input title is inappropriate.

  For example, if there is already a playlist with the same title set, the error screen that appears will display the message "Input names overlap or are invalid. Please change the title name." Has been.

  In addition, for example, in the error screen displayed when the input title includes prohibited characters, in addition to the same message displayed on the above error screen, The message "The following characters cannot be used" and the characters that cannot be used are displayed.

  After an error screen notifying that the title is inappropriate is displayed, the process returns to step S91 and the title is input again.

  On the other hand, if it is determined in step S93 that the input title is appropriate, the content management unit 131 proceeds to step S95 and confirms the free capacity of the HDD 120.

  In step S <b> 96, the content management unit 131 determines whether or not the HDD 120 has enough free space to store the playlist, and when determining that there is no free space, notifies the output control unit 136 of the fact. Thereafter, the process proceeds to step S97.

  In step S97, the output control unit 136 displays an error screen notifying that the free space is insufficient.

  On this error screen, for example, the message “Hard disk capacity is insufficient. Delete unnecessary titles, tracks, and photos. Playlist creation / modification ends.” Is displayed.

  After the error screen notifying that the free space is insufficient is displayed, the process returns to step S71, and the subsequent processes are performed.

  On the other hand, in step S96, when the content management unit 131 determines that the HDD 120 has enough free space for storing the playlist, the content management unit 131 proceeds to step S98 and stores the created playlist as one content belonging to “photo”. To do. Thereby, the icon of the saved playlist is displayed in “Photo” on the menu screen.

  FIG. 20 is a diagram illustrating an example of a menu screen in which a playlist is added as content belonging to “photo”.

  On the screen of FIG. 20, category icons 191 to 194 and category icons 211 are arranged in the horizontal direction, and the currently selected category is “photo”. When “PHOTO” is selected, an icon 241 representing the playlist saved in the process of step S88 in FIG. 16 is displayed below the category icon 191 as shown in FIG. On the right side of the icon 241, “Travel” which is the title of the playlist is displayed.

  In this way, the playlist is displayed on the menu screen as “photo” content in the same manner as other still image content (photo album). Therefore, the user can select a play list and play it or the like with the same feeling as other still image contents. In the screen of FIG. 20, content icons 242 and 243 displayed under the icon 241 are icons representing photo albums. Note that an icon representing a playlist is not displayed side by side with an icon representing a photo album, but a folder is displayed side by side with an icon representing a photo album, and the created playlist is displayed in the lower layer. An icon may be displayed.

  When the playlist is saved, in step S99 (FIG. 17), the content management unit 131 confirms whether or not the recording / playback unit 117 is recording the television program.

  As described above, in the information processing apparatus 11, output vector data equivalent to the reproduction result of the playlist can be saved as video content (slide show content). It is confirmed whether creation is possible. When the recording / playback unit 117 that performs MPEG2 encoding has already performed MPEG2 encoding such as recording of a television program, it is not possible to create a slide show content that is regarded as the same type of content. Of course, such a restriction may not be applied. In other words, it is possible not to perform the confirmation here.

  In step S100, the content management unit 131 determines whether or not the recording / playback unit 117 is executing recording. If the content management unit 131 determines that recording is being performed, the content management unit 131 notifies the output control unit 136 of the determination. Proceed to S101.

  In step S101, the output control unit 36 displays an error screen notifying that the slide show content cannot be created.

  For example, “This playlist has been saved. You cannot create a video while recording. Please create a video from the playlist after recording. The playlist creation / modification ends.” Message is displayed. The “video” in this message means “slide show content”.

  After the error screen notifying that the slide show content cannot be created is displayed, the process returns to step S71, and the subsequent processes are performed. The user selects a playlist icon displayed as content belonging to “Photo” from the menu screen, and displays a slideshow content from a submenu (a list of operations that can be performed using the playlist) displayed at that time. Can be created. Of the messages displayed on this error screen, “Please create a video from the playlist after recording is complete” indicates that.

  On the other hand, in step S100, if the content management unit 131 determines that the recording / playback unit 117 is not recording, that is, it is possible to create a slide show content, the content management unit 131 proceeds to step S102 and is stored in the HDD 120. Check the number of video content (including television programs and slideshow content). In other words, in this example, an upper limit is set for the number of video contents that can be stored in the HDD 120, and when video content is already stored in the upper limit, storage of video content beyond that is not possible. It is supposed to be impossible.

  In step S103, the content management unit 131 determines whether or not the number of video contents is equal to or less than a predetermined number. If it is determined that the number is not less than or equal to the predetermined number (has reached an upper limit), this is output. The control unit 136 is notified, and the process proceeds to step S104.

  In step S104, the output control unit 136 displays an error screen notifying that slide show content cannot be created (saved).

  For example, a message “The title is full. Please delete unnecessary titles, tracks, and photos. Playlist creation / modification ends.” Is displayed on this error screen.

  After the error screen notifying that the video content cannot be created is displayed, the process returns to step S71, and the subsequent processes are performed.

  On the other hand, in step S103, if the content management unit 131 determines that the number of video contents is equal to or less than the predetermined number, the content management unit 131 notifies the output control unit 136 of this, and proceeds to step S105.

  In step S105, the output control unit 136 displays a selection screen for selecting whether or not to save the slide show content.

  FIG. 21 is a diagram showing an example of the selection screen displayed in step S105 of FIG.

  In the screen of FIG. 21, a message “Playlist saved. If you want to save slideshow content continuously, select“ Save slideshow content ”.” Is displayed.

  Further, at the bottom of the screen of FIG. 21, a GUI button 251 on which “save slideshow content” is displayed, which is selected when saving the slideshow content, and the process is terminated without saving the slideshow content “ A GUI button 252 on which “End” is displayed is displayed. The user can save the slideshow content in the HDD 120 by operating the remote controller and selecting the GUI button 251 on which the characters “save slideshow content” are displayed.

  In step S106, the content management unit 131 determines whether or not the character “save slideshow content” has been selected from the selection screen of FIG. 21, and the character “save slideshow content” has not been selected. That is, if it is determined that the character “END” has been selected from the selection screen of FIG. 21, this is notified to the output control unit 136, and the process proceeds to step S107.

  In step S107, the output control unit 136 displays a wizard cancellation confirmation screen. The cancel confirmation screen displayed here is the same screen as the screen displayed in step S89 of FIG.

  In step S108, it is determined whether the cancellation of the wizard is selected from the cancellation confirmation screen. If it is determined that the cancellation is selected, the process returns to step S71, and the subsequent processing is performed. If it is determined in step S108 that canceling the wizard has not been selected, the process returns to step S105 to select again whether to save the slideshow content.

  On the other hand, if it is determined in step S106 that the character “save slideshow content” has been selected from the selection screen of FIG. 21, the content management unit 131 proceeds to step S109.

  In step S109, slide show content creation processing is performed. The slide show content created by the slide show content creation process is output from the slide show content creation unit 133 to the content management unit 131 and stored in the HDD 120. Details of the slide show content creation processing will be described later with reference to the flowchart of FIG.

  In step S <b> 110, the output control unit 136 displays a save completion screen notifying that the slide show content has been saved.

  For example, a message notifying that the slide show content created in step S109 has been saved as one of the contents belonging to “video” is displayed on the save completion screen.

  As a result, an icon representing the slide show content is added and displayed on the “video” of the menu screen.

  FIG. 22 is a diagram illustrating an example of a menu screen to which an icon representing a slide show content is added as an icon of content belonging to “video”.

  On the screen of FIG. 22, category icons 192 to 195 are arranged in the horizontal direction and displayed, and the currently selected category is “video”. At this time, an icon 261 representing the slide show content is displayed under the category icon 193 as shown in FIG.

  On the right side of the icon 261, “Travel 1”, which is the title of the slide show content, is displayed. That is, the slide show content represented by the icon 261 in FIG. 22 is created from the reproduction result of the playlist represented by the icon 241 in FIG. 20, and the playlist title represented by the icon 241 in FIG. The same title is set.

  As described above, the slide show content created from the reproduction result of the play list is displayed on the menu screen as content belonging to “video”, like other video content such as a television program. Therefore, the user can select the slide show content with the same feeling as other video content, and play it. In the screen of FIG. 22, content icons 262 and 263 displayed under the icon 261 are icons representing video content of a television program.

  Note that the user writes (records) slide show content on the optical disc 125 or transmits it to other devices via the communication unit 121 as well as video content of other television programs. Is also possible. Therefore, the user can view the slide show content by attaching the optical disc 125 on which the slide show content is recorded to another player or the like.

  In the series of processes relating to the slide show as described above, the effect image process described with reference to the flowchart of FIG. 10 described above is executed. As a result, the information processing apparatus 11 can perform effect processing on a still image having an arbitrary image size and aspect ratio as intended by the producer of the effect, and reproduce it as a slide show with an appropriate screen configuration. In other words, the information processing apparatus 1 provides a high-quality slide show to the user without displaying an unnecessary image or giving an unnatural effect regardless of the image size and aspect ratio of the still image. It can be provided and the satisfaction of the user can be improved.

  Next, the playlist creation process performed in step S84 of FIG. 15 will be described with reference to the flowchart of FIG.

  In step S131, the playlist creation unit 135 acquires identification information such as the title of the photo album selected by the user, and proceeds to step S132, in which the identification information of the BGM song selected by the user and the song correspond to the song information. Get the identification information of the attached template. When a photo album is selected by the user, the title and the like are supplied from the content management unit 131. Further, when a BGM song is selected by the user, the song identification information and the template identification information associated with the song are supplied from the BGM / template management unit 132.

  In step S133, the playlist creating unit 135 describes the identification information of the photo album acquired in step S131 as “photo album” (FIG. 4), and the identification information of the BGM song and template acquired in step S132. Playlists are created by describing them as “use music” and “use template”, respectively. After the playlist is created, the process returns to step S84 in FIG. 15, and the subsequent processes are performed.

  If “priority image” is selected by the user, the description is also made. The “playlist name” is described in the playlist when the title is input by the user (when it is determined that the title is appropriate in step S93 in FIG. 16).

  The playlist created by the playlist creation unit 135 by such processing is supplied to the playback unit 134 when the user gives an instruction for preview playback of the playlist. In addition, when instructed to save, the data is supplied to the content management unit 131.

  Next, the preview reproduction process performed in step S87 in FIG. 16 will be described with reference to the flowchart in FIG. This preview reproduction process is performed based on the playlist.

  In step S151, the playlist reproduction control unit 141 (FIG. 8) acquires the playlist supplied from the playlist creation unit 135, analyzes it, and outputs information necessary for generating output vector data as output vector data. This is supplied to the generation unit 142.

  In step S152, the output vector data generation unit 142 generates output vector data based on the playlist (information supplied from the playlist reproduction control unit 141). The output vector data generation unit 142 supplies the generated output vector data to the BGM playback unit 144, the extraction unit 145, and the effect image processing unit 146.

  In step S153, the BGM playback unit 144 acquires and plays back the BGM data based on the output vector data in which the playback time of the effect (image) is corrected and matches the playback time of the BGM (audio) in this way, It is supplied to the effect image processing unit 146 and the like. In step S154, the extraction unit 145 corrects the playback time of this effect (image) and outputs image data (still image to be played back) from the photo album based on the output vector data that matches the playback time of BGM (sound). ) Is extracted and stored in the internal memory 147.

  In step S155, the effect image processing unit 146 executes the effect image processing described with reference to the flowchart of FIG. 10 as a subflow, and the playback time of this effect (image) is corrected to the BGM (audio) playback time. Based on the matched output vector data, image data is acquired from the internal memory 147, and effect image processing is performed on the image data to generate output data. That is, the effect image processing unit 146 performs the effect image processing of FIG. 10, performs processing such as trimming or image size change on the still image acquired from the internal memory 147, and the aspect ratio and the image size are requested by the effect. An image equal to the set value is acquired, effect processing is performed on the image, and output data is generated. In FIG. 10, the effect image processing unit 146 has been described so as to end the effect image processing after finishing the process of step S6. In this case, however, the output vector data generation unit 142 performs the effect image processing as a sub-flow. Therefore, after all the processes are completed, the process returns to step S155, and the processes after step S156 are executed.

  In step S156, the effect image processing unit 146 outputs the generated output data to the output control unit 136.

  The playlist reproduction control unit 141 determines in step S157 whether or not to end the preview reproduction process. If it is determined that the preview reproduction process does not end, the playlist reproduction control unit 141 returns the process to step S153 and repeats the subsequent processes. If it is determined in step S157 that the preview reproduction process is to be terminated, the playlist reproduction control unit 141 advances the process to step S158. In step S158, the effect image processing unit 146 stores the output vector data used for generating the output data in the internal memory 147, ends the preview reproduction process, returns the process to step S87 in FIG. 15, and the subsequent processes. Is executed.

  As described above, since the effect image processing unit 146 generates output data using a still image in which the image size and the aspect ratio are adjusted in the preview reproduction process, the information processing apparatus 11 has an arbitrary image size and aspect ratio. A still image can be subjected to effect processing as intended by the producer of the effect and reproduced as a slide show with an appropriate screen configuration. In other words, the information processing apparatus 1 provides a high-quality slide show to the user without displaying an unnecessary image or giving an unnatural effect regardless of the image size and aspect ratio of the still image. It can be provided and the satisfaction of the user can be improved.

  Next, the slide show content creation process performed in step S109 of FIG. 17 will be described with reference to the flowchart of FIG. As described above, the slide show content is generated from the output vector data in which the playback time of the effect (image) is corrected and matched with the playback time of the BGM (audio). The slide show content generation process is executed as a continuation of the playlist creation process.

  That is, when the slide show content creation processing is started based on a user instruction or the like, the slide show content creation unit 133 acquires output vector data held in the internal memory 147 of the playback unit 134 in step S171.

  When the output vector data is acquired, the slide show content creation unit 133 creates slide show content by adding other information such as a title to the obtained output vector data in step S172. The created slide show content is supplied to the content management unit 131.

  In step S173, the content management unit 131 supplies the slide show content to the HDD 120 for storage, ends the slide show content creation processing, returns the processing to step S109 in FIG. 17, and executes the subsequent processing.

  When the slide show content is stored in this way, one icon representing the slide show content is added to “video” on the menu screen.

  Next, a playlist reproduction process performed by the information processing apparatus 11 will be described with reference to a flowchart of FIG.

  This process is a process performed when reproduction of a playlist created by the series of processes as described above is instructed by the user from the menu screen. That is, the playlist reproduction process is basically the same as the preview reproduction process described with reference to the flowchart of FIG.

  That is, in step S191, the playlist reproduction control unit 141 (FIG. 8) acquires a playlist selected by the user from the menu screen, analyzes it, and outputs information necessary for generating output vector data as output vector data. This is supplied to the generation unit 142. This process corresponds to step S151 in FIG.

  In step S192, the output vector data generation unit 142 generates output vector data based on the playlist (information supplied from the playlist playback control unit 141), and outputs the output vector data to the BGM playback unit 144, the extraction unit 145, and the effects. This is supplied to the image processing unit 146. This process corresponds to step S152 in FIG.

  In step S193, the BGM playback unit 144 acquires and plays back BGM data based on the output vector data, and supplies it to the effect image processing unit 146 and the like. This process corresponds to step S153 in FIG. In step S 194, the extraction unit 145 extracts image data (reproduction target still image) from the photo album based on the output vector data, and stores the extracted image data in the internal memory 147. This process corresponds to step S154 in FIG.

  In step S195, the effect image processing unit 146 executes the effect image processing described with reference to the flowchart of FIG. 10 as a subflow, and the playback time of this effect (image) is corrected to the BGM (audio) playback time. Based on the matched output vector data, image data is acquired from the internal memory 147, and effect image processing is performed on the image data to generate output data. That is, the effect image processing unit 146 performs the effect image processing of FIG. 10, performs processing such as trimming and image size change on the still image acquired from the internal memory 147, and the aspect ratio and the image size are requested by the effect. An image equal to the set value is acquired, effect processing is performed on the image, and output data is generated. In FIG. 10, the effect image processing unit 146 has been described so as to end the effect image processing after completing the process of step S <b> 6. Therefore, after all the processes are completed, the process returns to step S195, and the processes after step S196 are executed. This process corresponds to step S155 in FIG.

  In step S197, the playlist reproduction control unit 141 determines whether or not to end the playlist reproduction process. If it determines that the playlist reproduction process does not end, the playlist reproduction control unit 141 returns the process to step S193 and repeats the subsequent processes. If it is determined in step S197 that the playlist reproduction process is to be terminated, the playlist reproduction control unit 141 terminates the playlist reproduction process.

  Next, a slide show content playback process performed by the information processing apparatus 11 will be described with reference to a flowchart of FIG.

  This process is a process that is performed when a user gives an instruction from the menu screen to reproduce the slide show content created by the series of processes as described above. In other words, this slide show content reproduction process is basically the same as the playlist reproduction process described with reference to the flowchart of FIG.

  However, in the case of this slide show content reproduction process, slide show content (output vector data) is used without using a playlist.

  Accordingly, in step S211, the slide show content playback control unit 143 (FIG. 8) acquires the slide show content selected by the user from the menu screen, and acquires output vector data included therein. Then, the slide show content reproduction control unit 143 supplies the acquired output vector data to the BGM reproduction unit 144, the extraction unit 145, and the effect image processing unit 146. This process corresponds to steps S191 and S192 in FIG.

  In step S212, the BGM playback unit 144 acquires and plays back the BGM data based on the output vector data, and supplies it to the effect image processing unit 146 and the like. This process corresponds to step S193 in FIG. In step S 213, the extraction unit 145 extracts image data (a still image to be reproduced) from the photo album based on the output vector data, and stores the extracted image data in the internal memory 147. This process corresponds to step S194 in FIG.

  In step S214, the effect image processing unit 146 executes the effect image processing described with reference to the flowchart of FIG. 10 as a subflow, and the playback time of the effect (image) is corrected to the BGM (audio) playback time. Based on the matched output vector data, image data is acquired from the internal memory 147, and effect image processing is performed on the image data to generate output data. That is, the effect image processing unit 146 performs the effect image processing of FIG. 10, performs processing such as trimming and image size change on the still image acquired from the internal memory 147, and the aspect ratio and the image size are requested by the effect. An image equal to the set value is acquired, effect processing is performed on the image, and output data is generated. In FIG. 10, the effect image processing unit 146 has been described so as to end the effect image processing after completing the process of step S <b> 6, but in this case, the output vector data generation unit 142 performs the effect image processing as a sub-flow. Therefore, after all the processes are completed, the process returns to step S214, and the processes after step S215 are executed. This process corresponds to step S195 in FIG.

  In step S <b> 215, the effect image processing unit 146 outputs the generated output data to the output control unit 136. This process corresponds to step S196 in FIG.

  The slide show content reproduction control unit 143 determines whether or not to end the slide show content reproduction process in step S216. If it is determined that the slide show content reproduction process does not end, the process returns to step S212, and the subsequent processing is repeated. If it is determined in step S216 that the slide show content playback process is to be terminated, the slide show content playback control unit 143 ends the slide show content playback process.

  Thereby, the user can view the slide show content with the same feeling as other video content such as a television program.

  As described above, the information processing apparatus 11 can perform effect processing on a still image having an arbitrary image size and aspect ratio as intended by the effect producer, and can reproduce it as a slide show with an appropriate screen configuration. . In other words, the information processing apparatus 1 provides a high-quality slide show to the user without displaying an unnecessary image or giving an unnatural effect regardless of the image size and aspect ratio of the still image. It can be provided and the satisfaction of the user can be improved.

  Note that the music to be BGM may be prepared in advance in the information processing apparatus 11, or the user can select the music imported into the information processing apparatus 11 from a music CD or the like as BGM. Of course it is good.

  When music is imported from the music CD to the information processing apparatus 11, attribute information such as the tempo and genre of the music imported from the music CD or from a predetermined server connected via the network is also stored in the information processing apparatus 11. In accordance with the atmosphere of the song that is captured and determined from the attribute information, an effect template that matches the captured song is associated. The association between the song and the template is performed based on, for example, the attribute information of the song and the “atmosphere” information of the template of FIG.

  Thereby, the user can select the music which he himself took in the information processing apparatus 11 as BGM. In addition, since the template is automatically associated with the imported music, the user can select the template only by selecting the music to be BGM.

  Note that the template itself associated with the song is not prepared in advance in the information processing apparatus 11, but is downloaded from a server connected via a network, the optical disk 125, or the like. It may be a thing.

  The series of processes described above can be executed by hardware, but can also be executed by software.

  When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a network or a recording medium into a general-purpose personal computer or the like.

  As shown in FIG. 6, this recording medium is not only composed of a memory card 123 and an optical disc 125 on which a program is recorded, which is distributed to provide a program to the user separately from the apparatus main body. The ROM 112 on which a program is recorded and the hard disk included in the HDD 120 provided to the user in a state of being incorporated in the apparatus main body in advance.

  In the present specification, each step includes not only processing performed in time series according to the described order but also processing executed in parallel or individually, although not necessarily performed in time series.

FIG. 4 is a diagram for describing still images and image clipping. It is a figure which shows the example of the external appearance of the information processing apparatus to which this invention is applied, and a television receiver. It is a figure which shows the example of an effect. It is a figure which shows the example of a play list. It is a figure which shows the example of a template. It is a block diagram which shows the structural example of information processing apparatus. It is a block diagram which shows the function structural example of information processing apparatus. It is a block diagram which shows the structural example of the reproducing part of FIG. It is a figure which shows the structural example of the effect image process part of FIG. It is a flowchart explaining an effect image process. It is a figure explaining the example of a mode that image processing is performed with respect to a still image. It is a figure explaining the other example of a mode that image processing is performed with respect to a still image. It is a figure which shows the example of a menu screen. It is a figure which shows the other example of a menu screen. It is a flowchart explaining the play list creation process of information processing apparatus. 16 is a flowchart subsequent to FIG. 15 for explaining the playlist creation processing of the information processing apparatus. FIG. 17 is a flowchart following FIG. 16 for explaining the playlist creation processing of the information processing apparatus. It is a figure which shows the example of a display screen. It is a figure which shows the other example of a display screen. It is a figure which shows the other example of a display screen. It is a figure which shows the other example of a display screen. It is a figure which shows the other example of a display screen. It is a flowchart explaining the detail of a play list creation process. It is a flowchart explaining the detail of a preview reproduction process. It is a flowchart explaining the detail of a slide show content creation process. It is a flowchart explaining the playlist reproduction processing of the information processing apparatus. It is a flowchart explaining the slide show content reproduction processing of the information processing apparatus.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Information processing apparatus, 2 Television receivers, 131 Content management part, 132 BGM / template management part, 133 Slide show content creation part, 134 Playback part, 135 Playlist creation part, 136 Display control part, 141 Playlist reproduction control part , 142 output vector data generation unit, 143 slide show content playback control unit, 144 BGM playback unit, 145 extraction unit, 146 effect image processing unit, 147 internal memory, 149 decode processing unit, 161 set value setting unit, 162 image data acquisition unit , 163 processing determination unit, 164 trimming unit, 165 image size changing unit, 166 effect processing unit

Claims (6)

An information processing apparatus for processing image data,
Setting value acquisition means for acquiring setting values of the aspect ratio and image size of a still image to be reproduced, included in the reproduction control information for controlling reproduction of image data;
A cutout unit that cuts out a partial image having an aspect ratio of the set value acquired by the set value acquisition unit from the still image of the image data and having a maximum image size;
Image size changing means for changing the image size of the partial image cut out by the cutout means to the image size of the setting value acquired by the setting value acquiring means;
An information processing apparatus comprising: reproduction control means for reproducing the image whose image size has been changed by the image size changing means based on the reproduction control information. The information processing apparatus according to claim 1, wherein the reproduction control information is vector data. The reproduction control information includes a set of effect control information of vector data which is control information of effect processing for each of image data for controlling reproduction,
The information processing apparatus according to claim 1, wherein the setting value acquisition unit acquires the setting value for each effect control information. Determination means for determining whether the aspect ratio of the image data and the image size match the aspect ratio of the setting value and the image size;
The cutout unit performs the cutout only when the determination unit determines that the aspect ratio and the image size of the image data do not match the aspect ratio and the image size of the set value. Item 4. The information processing apparatus according to Item 1. An information processing method of an information processing apparatus for processing image data,
A setting value acquisition step for acquiring setting values of an aspect ratio and an image size of a still image to be reproduced included in reproduction control information for controlling reproduction of image data;
A cut-out step of cutting out a partial image having the maximum image size, which is an image having an aspect ratio of the set value acquired by the process of the set value acquisition step from the still image of the image data;
An image size changing step of changing the image size of the partial image cut out by the processing of the cutting step to the image size of the setting value acquired by the processing of the setting value acquiring step;
And a reproduction control step of reproducing the image whose image size has been changed by the processing of the image size changing step based on the reproduction control information. In a program that causes a computer to perform processing related to image data,
A setting value acquisition step for acquiring setting values of an aspect ratio and an image size of a still image to be reproduced included in reproduction control information for controlling reproduction of image data;
A cut-out step of cutting out a partial image having the maximum image size, which is an image having an aspect ratio of the set value acquired by the process of the set value acquisition step from the still image of the image data;
An image size changing step of changing the image size of the partial image cut out by the processing of the cutting step to the image size of the setting value acquired by the processing of the setting value acquiring step;
And a reproduction control step of reproducing the image whose image size has been changed by the processing of the image size changing step based on the reproduction control information.

Images