JP2009290403A - Reproduction device, editing device, and content editing method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a reproduction device, an editing device, an editing method and a program for editing contents, capable of setting contents by properly combining a music content to a content mainly including photographed images. <P>SOLUTION: In registering a music content in an editing list, a music folder 81 presenting a music object is displayed together with the editing list, a position to which the music object moves is converted into date/time based on a time axis, as for the music object (music X) whose domain has moved to the editing list from the music menu, and the music content is registered with the date/time as a reproduction timing of the music content. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a playback device for playing back and editing a plurality of contents including photographed images, an editing device for editing, a content editing method, and a program for editing content.

  In recent years, it has become an environment where content data of various categories such as image data, music data, and text (text) data can be easily obtained through the Internet or the like. Various devices and methods for handling such multi contents have been developed. Among them, combining music with images has been performed since the analog era, and various methods have been proposed for how to link music data to image data in the digital data era.

For example, Patent Document 1 discloses a content reproduction apparatus that compares image data metadata (for example, shooting date and time, location, and weather) with audio data metadata to search for images and audio. Patent Document 2 discloses an audio playback device that acquires audio-related data about music or the like that the user listens to when electronic data such as electronic diary data is created by the user, and pastes the data to the electronic data. It is disclosed. Also, this audio playback device searches for audio data in accordance with a specified operation for audio-related data pasted on electronic data and plays back music or the like indicated by the audio-related data, or from a music sales site. It can be obtained. Furthermore, in Patent Document 3, in order to select music that matches the user's memories as music to be played back together with the image data, music that was frequently played when the image was shot or music that was hit at that time was recorded. A data reproducing apparatus for reproducing is disclosed.
JP 2006-244002 A JP 2007-11452 A JP 2008-11395 A

  When combining self-photographed image content and music content, it is certain to select images and music while checking one by one, but since it is complicated, it is disclosed in the above-mentioned patent document. In addition, various methods for automatically combining have been proposed.

  The date / time information seems to be most easily used in the automatic combination, but the date / time information of the image content and the date / time information of the music content are different even if they are the same date / time information. That is, since the daily method for image content corresponds to shooting date / time information, it can be important information for determining the timing for reproducing the image content. On the other hand, the date and time information of the music content may be the date when the music is released or the date when it is downloaded (data creation date). For this reason, the date / time information of the music content is often not information that is directly related to personal memories such as the shooting date / time information of the image content. Therefore, when determining the content and timing of the music content to be combined with the image content, it is not possible to rely only on the date / time information attached to the music content. There is a need for a method for combining music with a photographed image at an appropriate timing without relying on date information attached to the music content.

  The present invention has been made in view of such circumstances, and provides a playback device, an editing device, an editing method, and a content editing program capable of appropriately setting music content in combination with content centered on a photographed image. The purpose is to provide.

  In order to achieve the above object, a playback device according to a first aspect of the present invention is a playback device that plays back multi-contents composed of a plurality of types of content including at least captured images. Using the time assigned to each of the other contents as a reference for playback timing as a reference, the content playback unit that plays back the data of these contents and the area divided for each content are arranged in a line and intersect with each other Create a screen with the direction as the time axis, and display an edit list in which the objects representing each data of the above multi-contents are arranged at the corresponding locations on the screen based on the type of the content and the playback timing of the content And re-playing the above multi-content on this edit list. A content editing unit for editing timing, and when the content editing unit registers music content in the editing list, the content editing unit displays a music menu representing the music object together with the editing list. For the music object moved from the music menu to the music content area in the edit list, the moved position of the music object is converted into the date and time based on the time axis, and the date and time is converted to the reproduction timing of the music content. The music is registered as a standard.

In the playback apparatus according to a second aspect of the present invention, in the first aspect, the content editing unit attaches a leading time of the time zone as a time attached to the music content.
According to a third aspect of the present invention, there is provided a playback apparatus according to the first aspect, wherein the content editing unit takes the earliest shooting time among the shooting times of the shot image content belonging to the time zone as the time attached to the music content. Time corresponding to time is attached.

  According to a fourth aspect of the present invention, there is provided a reproducing apparatus for reproducing multi-contents composed of a plurality of types of content data including at least two types of content of a photographed image and music. Using the date and time assigned to each of the other content data as the reference for playback timing as the reference for playback timing, the content playback unit that plays back the data of these contents and the editing screen are divided into regions for each content type. Content in which objects representing the data of the plurality of types of content are arranged in the area to which each content belongs in the order of the date and time attached to each content, and the reproduction timing of the content data is edited on this editing screen An editing unit, and the content editing unit When registering music content on the collection screen, the date and time attached to the music content is the date and time corresponding to the position where the music object is placed, the date and time when the music file was created, or the specified date and time. At least one of them is registered with the selected date and time.

  An editing method according to a fifth aspect of the present invention is a content editing method for editing the reproduction timing of multi-content composed of a plurality of types of content including at least the content of a photographed image, and reproducing the photographing date and time of the content of the photographed image Using the time assigned to each of the other contents as a reference for the playback timing, and the step of playing back the data of these contents, and editing the playback timing of the multi-content prior to the playback of the multi-content The step of editing the playback timing of the multi-content, creating a screen in which the areas divided for each content are arranged in a line and the direction intersecting with the time-axis is set as a time axis. Object that represents each data of An edit list arranged at a corresponding location on the screen based on the type of content and the playback timing of the content, and editing the playback timing of the multi-content on the edit list. The step of registering the music content in the edit list displays a music menu representing the music object together with the edit list, and the music object moved from the music menu to the music content area of the edit list. The music object is moved to a date and time based on the time axis, and the music is registered using the date and time as a reference for the reproduction timing of the music content.

  A program according to a sixth aspect of the present invention is a content editing program for causing a computer to execute playback of multi-contents including at least a plurality of types of content including captured image content and editing of the playback timing. For the content, the shooting date and time is used as a reference for playback timing, and for other content, the time assigned to each content is used as the reference for playback timing. A step of editing the multi-content playback timing, wherein the step of editing the multi-content playback timing is such that the areas divided for each content are arranged in a line, and the direction intersecting with the time axis is a time axis. Create a screen and Display an edit list in which objects representing each data of the content are arranged at corresponding locations on the screen based on the type of the content and the playback timing of the content, and playback of the multi-content on the edit list The step of editing the timing, and the step of registering the music content in the edit list displays a music menu representing the music object together with the edit list, and the music in the edit list is displayed from the music menu. For a music object whose content area has been moved, converting the moved position of the music object into a date and time based on the time axis, and registering the music using the date and time as a reference for the playback timing of the music content, Is executed on the computer.

  An editing apparatus according to a seventh aspect of the present invention is an editing apparatus for editing a reproduction procedure when reproducing a multi-content including at least a plurality of types of contents including a photographed image. The area divided for each content is arranged in one row. Create a screen with the time axis aligned and intersected with it, and place the objects representing each of the multi-content data at the corresponding locations on the screen based on the content type and the playback timing of the content. A content editing unit that displays the edited list and edits the playback timing of the multi-content on the editing list, and the content editing unit registers music content in the editing list. A music menu showing the music object, along with the edit list above For the music object that has been moved from the music menu to the music content area of the edit list, the moved position of the music object is converted into the date and time based on the time axis, and the date and time is converted to the music content. The music is registered as a reference for playback timing.

An editing apparatus according to an eighth invention in the seventh invention, deletes, moves and adds the content on the edit list.
In the seventh invention, when the music content is moved from the music menu onto the edit list in the seventh invention, the editing device according to the ninth invention is added to the music content at the beginning of the time zone on the edit list. Give time.
The editing apparatus according to a tenth aspect of the present invention is the editing apparatus according to the seventh aspect, wherein when the music content is moved from the music menu onto the edit list, the music content belongs to the time zone on the edit list. A time corresponding to the earliest shooting time among the shooting times of the shot image content is added.

  According to the present invention, it is possible to provide a playback device, an editing device, an editing method, and a content editing program that can appropriately set music content in combination with content centered on a photographed image.

  A preferred embodiment will be described below using a playback apparatus to which the present invention is applied according to the drawings. A playback apparatus according to an embodiment of the present invention is configured by a personal computer that can be connected to the Internet, can store moving images and still images, and has a playback function for these images and a playback function for music data. . Also, the playback apparatus according to the present embodiment can acquire content such as images and music from an external database via the Internet, and can play back content acquired from the outside together with images taken by the user. Hereinafter, the term “content” is used as a generic term for data such as images, sounds, music, characters, and the like used in the playback apparatus of the present embodiment. A set of these contents is called multi-content.

  FIG. 1 is a block diagram showing a configuration of a playback apparatus 1 according to the present embodiment, and the playback apparatus 1 is configured by a personal computer. The playback apparatus 1 includes a control unit (CPU (Central Processing Unit)) 10, a RAM (Random Access Memory) 20, a storage unit 21, a display IF (Interface) unit 22, an audio playback IF unit 23, and a communication IF unit 24. The operation unit 25 and the bus 26 are included. Further, the playback apparatus 1 can be connected to the database 41 via a communication network such as the communication IF unit 24 and the network 32 and an external server 40.

  The control unit (CPU) 10 operates according to a control program stored in the program storage unit 21 a of the storage unit 21 and performs overall control of the playback device 1. Inside the control unit 10, a content management unit 11, a recording / playback unit 15, an image processing unit 16, a screen creation unit 17, and an audio processing unit 18 are provided.

  The content management unit 11 is a function for managing editing, reproduction, and search of multi-contents. The content management unit 11 is executed by a control program stored in the program storage unit 21a, but a part thereof may be configured by hardware. The content management unit 11 includes a content editing unit 12, a content reproduction unit 13, and a content search unit 14.

  The content editing unit 12 executes an editing process that determines the current multi-content playback procedure and the like, and performs an edit screen creation / switching process in this editing process. The content reproduction unit 13 includes a timer for proceeding with content reproduction, and controls content reproduction according to a combination of edited contents. The content search unit 14 searches the external database 41 via the network 32, the server 40, etc. for content related to the shooting date / time and location of the still image. The contents in this case are music, blogs, map data, etc. suitable for the shooting date / time and location.

  The recording / reproducing unit 15 includes a recording unit and a reproducing unit. The recording unit records content such as images, music, maps, and blogs searched by the content search unit 14 and input through the communication IF unit in the content storage unit 21b. At the time of recording, compression processing is appropriately performed on images and sounds. The playback unit in the recording / playback unit 15 reads the designated content from the content storage unit 21b in accordance with an instruction from the content management unit 11, and performs an appropriate expansion process. Since the image data for the edit screen is stored in the storage unit 21, the image data for the edit screen is also read out.

  The image processing unit 16 performs gamma processing on the still image data and moving image data read from the content storage unit 21b and decompressed, and performs image processing such as sharpness. The screen creation unit 17 creates various editing screens on the RAM 20 using the image data for the editing screens according to the instruction of the content editing unit 12. Also, a content playback screen is created according to an instruction from the content management unit 11. On the content reproduction screen, an image-processed still image moving image is synthesized.

  The audio processing unit 18 is a processing unit for processing the audio data instructed to be reproduced by the content reproduction unit 13 and outputting the audio from the speaker device 31 through the audio reproduction IF unit 23. The recording / playback unit 15, the image processing unit 16, the screen creation unit 17, and the audio processing unit 18 are configured by hardware, but some may be executed by software.

  The operation unit 25 connected to the control unit 10 includes a user interface such as a keyboard and a mouse, and inputs various operation commands to the control unit 10. The RAM 20 is a volatile memory, and temporarily stores data for processing at the time of image processing or the like. The storage unit 21 includes a control program storage unit 21a and various content storage units 21b, and is configured by a large-capacity storage device such as a flash memory or a hard disk.

  The content storage unit 21b stores various content data such as still images, moving images, music, texts, images such as maps, and the like. Here, the still image and the moving image include those acquired from the external database 41 in addition to those captured by the user himself / herself. Images such as music, text, and maps are mainly acquired from the external database 41, but may be created by the user himself or herself.

  The display IF unit 22 is connected to an external monitor device 30, and converts a signal so that the image generated by the image processing unit 16 or the screen creation unit 17 in the control unit 10 is displayed on the monitor device 30. The audio reproduction IF unit 23 is connected to an external speaker device 31, and performs signal conversion so that the audio generated by the audio processing unit 18 in the control unit 10 is output from the speaker device 31.

  The communication IF unit 24 can access an external database 41 through the network 32 and the server 40. The content retrieval unit 14 retrieves various contents from the database 41, acquires them through the communication IF unit 24, and stores them in the content storage unit 21b.

  The control unit 10, the RAM 20, the storage unit 21, the display IF unit 22, the audio reproduction IF 23, and the communication IF unit 24 are connected to a bus 26, and data and control commands of each unit are transmitted through the bus 26.

  As described above, the playback apparatus according to an embodiment of the present invention has a function equivalent to that of a commercially available personal computer, and is connected to an external database through the network 32 or the like. In this playback apparatus, a program for executing the operation described below is stored in the program 21a. Before explaining the flowchart related to this program, reproduction and editing in the reproduction apparatus 1 will be described with reference to FIGS.

  In the multi-content playback in this embodiment, the timer of the content playback unit 13 advances the past time at an appropriate speed, and the images that have become the shooting date and time are sequentially played back in the time of this timer. At the same time, music, text or background images are played back to make the screen gorgeous. First, an edit list used in editing performed prior to reproduction will be described with reference to FIGS. There are roughly two types of edit lists. One is a collective display list shown in FIG. 2, and the other is a time list shown in FIGS. The batch display list is a list that is displayed continuously for each content at a time regardless of the date and time of each content, and the hourly list is a list that is arranged corresponding to the date and time information that is played back for each content. is there.

  In the playback apparatus 1 according to the present embodiment, the editing list is opened by operating the operation unit 25 to call a menu screen (not shown) and selecting an editing screen in the menu screen. If the batch display list or the hourly list was opened last time when the editing list was terminated, the opened list is opened the next time the editing list is opened.

  As shown in FIG. 2, the batch display list as an edit list displays date information 51 at the top (in the example of FIG. 2, August 31, 2007 is shown). The date information 51 is time information managed by the timer of the content reproduction unit 13. Below the date information 51, a table arranged for each content is displayed. As contents shown on the horizontal axis, still images 55 (indicated as PHOTO in FIG. 2), moving images 56 (indicated as MOVIE in FIG. 2), music 57 (indicated as MUSIC in FIG. 2), text (blog) 58 (Indicated as TEXT in FIG. 2) and a background image 59 (indicated as BACKGROUND in FIG. 2).

  In the column of the still images 55, as shown in FIG. 2, the images of photo1, photo2,... In the moving image 56 column, movie1, movie2,..., And representative images of moving images to be reproduced are arranged in a reduced image order in the date and time information. In the music 57 row, music1, music2,..., And a reduced image of the image such as a CD jacket of music to be played back and a song title are arranged in order of date and time information.

  In the column of the text 58, the head part of the text such as a blog is arranged in the order of date and time information. The background image 59 is, for example, a map of a travel destination. In this column, a background image to be reproduced, such as imageA, imageB,. Note that the date / time information uses the date / time such as the shooting date / time for the still image 55 and the moving image 56, but the music 57 and the background image 59 do not use the downloaded date / time information as it is, and the still image to be reproduced and displayed. Change to 55. This change will be described with reference to FIGS.

  A display switching box 52 for switching between the batch display list and the hourly list is provided on the lower left side of the content table composed of reduced images of content. When the display switching box 52 is checked in the state of FIG. 2, the editing screen is switched to the hourly list shown in FIG. In addition, a playback icon 53 (indicated as PLAY in FIG. 2) is arranged on the lower right side of the content table. By clicking the playback icon 53, the screen can be switched from the editing screen to the playback screen.

  Thus, in the batch display list, a plurality of contents to be reproduced and displayed can be known at a glance. In addition, since the still image 55, the moving image 56, and the like are displayed as reduced images, the contents can be intuitively understood. Furthermore, the order of playback for each content can be seen at a glance. When it is desired to change the order of reproduction, it is possible to move the content selected by the mouse or the like by drag and drop.

  Next, the hourly list that is another one of the edit lists will be described with reference to FIG. Similar to the collective display list of FIG. 2, date information 51 is displayed on the upper left side of the hourly list screen. In addition, a display switching box 52 is arranged on the left side of the lowermost row in the same manner as the collective display list, and a reproduction icon 53 is arranged on the right side like the collective display list. When the display switching box 52 is checked while the hourly list screen of FIG. 3 is displayed, the screen is switched to a batch display list screen.

  Also in the hourly list shown in FIG. 3, a plurality of contents are displayed in a table format. In this display, in the hourly list, the horizontal column is divided into categories, and the vertical direction is a content map composed of a time series in which each of the contents is played back. That is, as in the case of the collective display list, a still image 55, a moving image 56, music 57, text 58, and a background image 59 are arranged in the horizontal direction. Unlike the batch display list, the time zone 61 is displayed in the vertical direction.

  In the example of FIG. 3, the time zone 61 displays the time in units of one hour. At 0 o'clock, music, text, and background image A are started to be played, and at 8 o'clock, six still images (photo1 to photo6) are displayed. ) One movie (movie1), one piece of music (music2), one text, and one background image (imageB) are started to be played from the playback start time 62 displayed at the bottom of the content. Also, at 9 o'clock, the playback starts from the playback start time 62 displayed at the bottom of the content, each of three still images (photo7 to photo9), one moving image (movie2), and one text.

  As described above, in the time-based list, the content type is displayed in the horizontal direction, the time axis is in the vertical direction, and the content is arranged in the reproduction order for each same time zone. For this reason, the reproduction order for each content can be understood at a glance, and it is possible to intuitively understand what kind of reproduction is performed. Also, unnecessary contents can be deleted or added on the hourly list, and the reproduction timing can be easily changed. For example, deletion may be performed by selecting a content and then deleting with a deletion key, and addition may be performed by dragging and dropping from a folder or the like in which other content is stored. Furthermore, on the hourly list, it is possible to change the reproduction timing by moving by an operation such as drag and drop.

  In the hourly list shown in FIG. 3, the time zone 61 is set as one hour unit. However, the time zone 61 is not limited to this, and can be changed as appropriate in units of two hours or 30 minutes. Of course, the time zone with a lot of contents may be further subdivided into only that time zone.

  In the example of the hourly list shown in FIG. 3, even when the content does not exist (in the example of the figure, from 1 to 7 o'clock), the time zone is displayed. A blank part is generated. The time zone in which no content exists may be omitted so that the whole can be seen over a long time (see FIG. 4). In the example shown in FIG. 4, the reproduction procedure for three days can be overlooked at a glance by omitting the time zone in which no content exists.

  As described above, in the editing screen based on the batch display list or the hourly list, the captured images such as still images and moving images stored in the content storage unit 21b and the recording / reproducing unit 15, music acquired via the network 32, An edit list is automatically generated for texts such as blogs, images such as maps, and the like based on date and time information. For this reason, the user does not have to collect and edit each content individually, and it is only convenient to modify the automatically created edit list according to the user's intention. .

  Next, the circle display used in the present embodiment and used when the content is reproduced and displayed based on the creation date and time of the content will be described with reference to FIG. This circle display is displayed on the monitor device 30 and is used when selecting the date and for reproducing and displaying the content. First, the year circle TY for displaying the year in a circle is displayed on the display screen of the monitor device 30. Each year has been displayed from 2002 along this year circle TY. When 2007 is selected from the displayed year, the month circle TM is displayed with 2007 as the center. Although FIG. 5 shows only up to 2007, this year can be changed as appropriate.

  The month from January to December is displayed along the month circle TM, and if August (displayed as Aug. in FIG. 5) is selected from the display of this month, the day circle TD is centered on August. Is displayed. A dot representing the day is displayed along the day circle TD. When a dot corresponding to the 31st is selected from the dot display, a time circle TT is displayed centering on the 31st.

  As described above, when the year is selected sequentially, the circles are displayed in the order of month, day, and time. In the example shown in FIG. 5, August 31, 2007 is selected. Moreover, since the selected date is displayed in the center of each circle in a horizontal row, the selected date can be easily confirmed. In this embodiment, the selected date is simply a number, but this is not restrictive, and the number is displayed with a frame, or the color is changed not only with a framed display. Or may be changed to various display methods.

  Next, multi-content playback in the present embodiment will be described with reference to FIGS. When reproducing multi-contents, the past date to be reproduced is selected as described above, and the reproduction operation is started. When started, the cursor TC representing the current time on the playback screen moves the time circle TT at a predetermined speed. As the moving speed, for example, the past six hours are actually moved in one minute, but may be changed as appropriate. Various contents created on the specified date are displayed as content thumbnail images along the periphery of the time circle TT.

  In the present embodiment, an example will be described in which contents are sequentially reproduced in order to recall memories of a trip (Okinawa) on August 31, 2007. In the example shown in FIG. 6 and FIG. 7, August 31, 2007 is selected, and playback starts at 0:00 on August 31, 2007. Various contents created on August 31 are displayed as thumbnails along the periphery of the time circle TT. That is, the content has information on the created date and time, and a thumbnail image is arranged at a position corresponding to the time based on this information. Specifically, thumbnail images from photo1 to photo13 are displayed along the time circle TT from 8:00 to 11:00. Also, thumbnails of movies 1, 2, music 1, 2, text 1, 2, 3, image A, B are displayed at corresponding time positions.

  FIG. 6 shows an example of 8:30 on August 31, 2007. Photo4 (still image), movie1 (moving image), text 2, and imageB (map) are reproduced and displayed as multi-contents. The cursor TC indicates the timer time, that is, the current time in the playback state. Here, the thumbnails of text 1 and music 1 are hidden by photo 4. The photo 4 photographed at 8:22 on August 31, 2007 is gradually enlarged as the cursor TC approaches 8:20. The reproduction display of the photo (still image) gradually increases in size and density as it approaches the shooting time. Then, as the distance from the photographing time increases, the size is gradually reduced, and the density is also reduced, and faded out. movie1 (moving image) is played back at 8:06.

  Text 2 (blog information) is also displayed from 8:15. The blog may be another person's blog or the person's blog may be displayed. This blog information is retrieved from the external server 40. A map image of Okinawa is displayed as the background image (imageB). In this example, on a trip to Okinawa, map data is retrieved from an external server 40 based on GPS (Global Positioning System) information recorded as a shooting location in content such as images, and the map image is used as a background image. ing. The background image is displayed by moving slowly to the left on the screen. This is to change the screen.

  Thus, FIG. 6 shows a playback screen at 8:20 am. As shown in FIG. 3, at 8 o'clock, the photo 1 to photo 6 are edited as the still image 55, the movie 1 is edited as the movie 56, and the music 2 is played as the music 2, and at 8 o'clock. Is edited so that text 2 is displayed, and is edited so that imageB is displayed as a background image. Playback and display are performed along this editing list.

  Further, when the cursor TC advances and reaches 9:15 as shown in FIG. 7, the reproduction display of photo 4 is finished, and photo 7 and 8 are displayed. Since movie2 which is the moving picture 56 is from 9:35, the reproduction is not yet started in the state shown in FIG. When the time starts from 0:00 on August 31 and reaches 24:00, the slide show for displaying a combination of multi-contents may be ended, or may proceed on September 1 as it is.

  As described above, when the current time indicated by the cursor TC moving on the time circle TT approaches the reproduction start time 62 attached to each content, the reproduction operation is started from the thumbnail image according to the characteristic of each content. I am doing so.

  In the description of the present embodiment, the contents are sequentially switched and displayed according to the movement of the cursor TC on the time circle TT on a daily basis. However, the present invention is not limited to this, for example, monthly basis, that is, the daily circle TD. The content may be sequentially switched and reproduced in accordance with the movement of the upper cursor TC.

  A list icon 64 for confirming the contents of the edit list is arranged at the lower right of the reproduction screen shown in FIGS. When the list icon 64 is clicked during the reproduction operation, the screen is switched to the edit preview screen.

  Next, the edit preview screen will be described with reference to FIGS. This edit preview screen includes a single display and a multi display. The single display displays each content one by one, and the multi display displays the contents displayed in each time zone at once. This display switching is performed by clicking either the single display box 72a in the second row from the top of the edit preview screen or the multi-display box 72b adjacent thereto.

  First, the case of single display will be described with reference to FIGS. A display content type column 71 is arranged at the top of the edit preview screen. The display content type column 71 indicates the type of content displayed on the content display surface 73. 8 is a still image (noted as PHOTO), FIG. 9 is a moving image (noted as MOVIE), FIG. 10 is a music (noted as MUSIC), and FIG. 11 is a text. Yes (denoted as TEXT), in the example of FIG. 12, it is a background image (denoted as BACKGROUND).

  In the next level, a single display box 72a, a multi display box 72b, and a setting icon 72c are displayed side by side. The single display box 72a and the multi display box 72b are as described above. The setting icon 72c is an icon for setting a time width for multi-display, and a setting method will be described later with reference to FIG. This time width is the width of the time zones 61 arranged in the vertical direction in FIG. 3, and is shown at one hour intervals in the example of FIG. 3, but can be reset to other time widths.

  A content display surface 73 is provided substantially at the center of the edit preview screen, and a still image 55, a moving image 56, and the like as the content are displayed here. This display feed operation is performed by clicking the feed icon 74f arranged in the lower row. The example of FIGS. 8 to 12 is an example of the 8 o'clock range in FIG. 3, and at first, the photo 1 that is a still image (reproduction start time 8: 5) is displayed on the content display surface 73.

  Next, when the forward icon 74f is clicked, movie1 (reproduction start time 8: 6) is displayed as shown in FIG. Here, a representative image (still image) of a moving image is displayed on the content display surface 73, and then the moving image is reproduced. Of course, the moving image may not be reproduced. Next, when the advance icon 74f is clicked, music2 (reproduction start time 8:10) as music is displayed on the content display surface 73 as shown in FIG. Here, a still image such as a CD jacket of music 2 is displayed on the content display surface 73, and audio is output from the speaker device 31, but only a still image such as a CD jacket is displayed and no audio is output. Of course, it doesn't matter.

  Next, when the feed icon 74f is clicked, a blog sentence that is text is displayed as shown in FIG. Next, when the forward icon 74f is clicked, the background image "imageB" is displayed as shown in FIG.

  As described above, in the single display, each time the feed icon 74f is clicked, the feed is sequentially played according to the order of the date / time information (playback start time 62) attached to the content. Further, each time the return icon 74d is clicked, the playback is sequentially performed in order according to the date and time information attached to the content. Further, when the auto play icon 74e is clicked, the content display is automatically switched and a slide show is possible.

  Below the content display surface 73, operation icons 74a to 74i corresponding to the display content are arranged in a horizontal row. The back icon 74a is an icon for returning to the edit list screen shown in FIGS. The full size display icon 74b is an icon for displaying the content to be displayed on the content display surface 73 in the full size of the screen. The content editing screen icon 74c is an icon for switching to a content editing screen (not shown).

  The left rotation icon 74g and the right rotation icon 74h are icons for rotating the image display, respectively, and the trimming icon 74i is an icon for displaying the content screen ratio at 4: 3.

  In addition, when playing back a moving picture as shown in FIG. 9 or music as shown in FIG. 10, in addition to the above-described icons for operation, a play icon 74j for starting movie playback or music playback is displayed. A stop icon 74k for stopping movie and music playback is arranged.

  When displaying text as shown in FIG. 11, in addition to the above-mentioned icons for operation, a character size icon 74m for setting the character size of the displayed text, a character font A font icon 74n for setting (font) and a movement icon 74p for moving the display position of the text in the screen are arranged.

  A content check box 76 for designating the type of content to be displayed is arranged below the operation icon display column. In the example of single display shown in FIG. 8 to FIG. 12, the still image (PHOTO), moving image (MOVIE), music (MUSIC), text (TEXT), and background image (BACKGROUND) are checked. All the contents are sequentially displayed on the content display surface 73. If you want to check only still images and moving images, check only these two, and uncheck the other three. That is, by clicking the check box of the category desired to be played out of the five categories displayed in the display content type column 76, the contents belonging to an arbitrary category can be time-sequentially, individually or in a mixed category. Playback display is possible.

  Next, a case where multi-display is selected on the edit preview screen will be described with reference to FIGS. When the multi display is selected, the content display surface 73 displays the content checked in the content check box 76 in the set time zone. In the example shown in FIG. 13, the 8 o'clock range on August 31 is selected, and the still image, the text, and the background image are checked in the content check box 76, so that the photos 1 to 6, the text, and imageB are checked. Is displayed. Since music and moving images are not checked in the content check box 76, moving images and music are not displayed.

  When the feed icon 74f is clicked on the screen shown in FIG. 13, the content is switched from 8 o'clock to 9 o'clock, and the time zone is sent each time the feed icon 54f is clicked. When the return icon 74d is clicked, the display is switched to the previous day display, and the time zone is returned each time the return icon 54d is clicked.

  When the setting icon 72c is clicked on the edit preview screen, a time zone switching screen 86 is displayed as shown in FIG. In this embodiment, the time zone is selected from 5 minutes, 10 minutes, 30 minutes, 60 minutes, and 120 minutes. Of course, the time zone may be changed as appropriate.

  By clicking the back icon 74a on the multi-view edit preview screen, it is possible to return to the edit list screen shown in FIGS. In addition, by clicking the reproduction icon on the menu screen, it is possible to return to the reproduction screen shown in FIGS.

  Next, music registration in the hourly list shown in FIG. 3 will be described with reference to FIGS. When playing back and displaying music as a background for still images and moving images, it is effective to create a shooting atmosphere.

  Basically, still images and moving images are played back in order of shooting date and time attached to these image data. On the other hand, in the case of music, for example, in the case of downloaded music, the download date is often attached. For this reason, according to the date information attached to the music, it is not possible to link and play back a captured image such as a still image or a moving image. Therefore, in this embodiment, when editing music on the edit list, information on the date and time of reproduction is attached.

  FIG. 15 shows a state where the time list shown in FIG. 3 is displayed and the music X is pasted on the music 57 column. The music folder screen (window) is displayed on the edit list screen. The music folder 81 is in the user's playback device (personal computer). In the music folder 81, music files created in formats such as MP3 and WMA, music M,..., Music X, music Y, and music Z. Etc. are stored.

  In the example shown in FIG. 3, two music files, music1 and music2, are arranged as music. In the example shown in FIG. 15, the music file music X is moved from the music folder 81 into the column of the music 57 in the hourly list by a drag and drop operation. Of course, the movement may be performed by another operation.

  When the music X is moved from the music folder 81 to the music 57 column in the hourly list, a registration screen 83 for selecting a registration destination is displayed as shown in FIG. The registration screen 83 displays three options as registration destinations: (1) registration on the date of the file, (2) registration on the drag and drop date, and (3) registration by designating the date.

  Here, the second “register on the day of drag and drop” is displayed as a default. If the default is selected, the date and time of the drag and drop destination is registered as date and time information at the time of reproduction. FIG. 17 shows a case where the default is selected, and 9:00 on August 31 is registered as date / time information at the time of playback of the music X, and this date / time becomes the playback start time. Since the contents are displayed for each time zone in the hourly list, by default, when a music file is moved, the first time in that time zone is registered. In addition to registering the start time, for example, a time corresponding to the earliest shooting time among the shot images (still images and moving images) belonging to the time zone may be registered.

  Next, music registration in the collective display list shown in FIG. 2 will be described with reference to FIGS. 18 shows a state in which the collective display list shown in FIG. 2 is displayed and the musicX stored in the music folder 81 is pasted to the music 57 column.

  In the example shown in FIG. 2, seven music files of music1 to music7 are arranged as music. In the example shown in FIG. 18, the music file musicX is moved from the music folder 81 into the column of music 57 in the batch display list by a drag and drop operation. Of course, the movement may be performed by another operation.

  When musicX is moved from the music folder 81 to the music column in the hourly list, a registration screen 84 for selecting a registration destination is displayed as shown in FIG. The registration screen 84 displays three options: (1) registration on the date of the file, (2) registration on the date of drag and drop, and (3) registration by designating the date. In the case of batch display, since the playback start time is not immediately known and the relationship with other still images and movies is unclear, (2) “Register on the day of drag and drop” The display is disabled, so that it cannot be substantially selected. Therefore, either (1) or (3) can be selected.

  Here, the third “Register by specifying date” is displayed as a default. When this default is selected, a date and time designation screen 85 as shown in FIG. 20 is displayed. The date and time designation screen 85 displays the date and time before the change. The date and time before the change is usually the date downloaded via the Internet. In addition, the date and time designation screen 85 displays the date and time after the change, so that the date and time can be selected from a pull-down menu. When the user clicks OK arranged in the lower part of the date / time designation screen 85, the date / time designation ends.

  In the example shown in FIG. 20, since 9:00 on August 31, 2007 was designated, when the designation of the date and time ended, as shown in FIG. 21, in the column of music 57, between music2 and music3, musicX is arranged.

  In this way, by opening the editing screen for the hourly list or the batch display list and moving the desired music file from the music folder 81 (music menu) into the music 57 row, music and still images can be easily obtained. Can be linked to playback. In particular, in the case of the hourly list, the date and time information of the destination can be used as the date and time information of the music as it is, which is very simple. Although music files such as musicX are stored in the music folder 81, they may be moved by drag and drop or the like even when they are directly arranged on the desktop or the like.

  In the present embodiment, an example has been described in which only data related to music 57 is moved from a folder other than the edit list and is registered in the edit list. However, not only music but also other contents can be registered in the edit list by the same method.

  Next, a procedure for performing the above-described editing and reproduction will be described using the flowchart shown in FIG. When the program for editing and displaying in this embodiment is started, it is first determined whether or not an editing mode is instructed (S11). If the result of determination in this step is that editing mode has not been instructed, multi-playback execution processing is performed (S24).

  In the multi-play execution process, content is played according to the edit list shown in FIGS. As described with reference to FIGS. 5 to 7, the multi-playback execution process determines the start date and time of playback and starts playback. As the cursor TC moves on the time circle TT, The still image 55 and the moving image 56 are sequentially reproduced in order, and the music 57, the text 58, and the background image 59 are sequentially reproduced according to the reproduction date and time information linked to the shooting date and time. These multi-playback execution processes are executed by the content playback unit 13 or the like.

  If the result of determination in step S11 is that there is an instruction for edit mode, it is next determined whether or not it is an instruction for batch list display (S12). Since either the batch display list or the hourly list is displayed in the edit mode, it is determined in this step whether or not the batch list is displayed. If the collective display list was previously displayed in the edit mode, the collective display list shown in FIG. 2 is displayed (S13). The batch display list display process is performed by the content editing unit 12 or the like.

  If the collective display list is displayed in step S13, or if the result of determination in step S12 is not an instruction for collective display list, it is next determined whether or not the list is displayed by time (S14). If the result of this determination is that the hourly list is displayed, that is, if the hourly list is displayed in the previous editing mode, the hourly list shown in FIG. 3 is displayed (S15). ). The time list display process is performed by the content editing unit 12 or the like.

  If the hourly list is displayed in step S15, or if the result of determination in step S14 is not an instruction for hourly list, it is next determined whether or not it is an instruction for music registration (S16). In this step, it is determined whether or not the music file has been moved from the music folder 81. If the result of this determination is that there is a music registration instruction, the music file is registered on the editing screen as described with reference to FIGS. 15 to 21 (S17). This music registration process is performed by the content editing unit 12 or the like.

  If the music registration process in step S17 is performed or if the result of determination in step S16 is that there is no music registration instruction, it is determined whether or not it is an editing preview instruction (S18). The edit preview is executed by clicking the edit preview icon from the menu screen on the edit screen, and is executed by clicking the edit preview icon from the menu screen on the playback screen. In this step, the edit preview icon is displayed. Determine whether it was clicked.

  If the result of determination in step S18 is that there is an edit preview instruction, it is next determined whether or not it is a single playback display instruction (S19). This step is performed by determining whether or not the single display box 72a is clicked. If the result of determination is single reproduction display, reproduction processing by single reproduction display shown in FIGS. 8 to 12 is performed (S20). The single reproduction process is performed by the content editing unit 12 or the like.

  When the single reproduction process is performed, or when the instruction is not a single reproduction instruction in step S19, it is determined whether or not there is a multi reproduction instruction (S21). This step is performed by determining whether or not the multi display box 72b is clicked. If the result of determination is multi-playback display, playback processing by multi-playback display shown in FIGS. 13 and 14 is performed (S22). The multi-playback process is performed by the content editing unit 12 or the like.

  When the multi-playback process of step S22 is performed, or if the result of determination in step S21 is not a multi-playback instruction, or if the result of determination in step S18 is not an edit preview instruction, or multi-playback execution process in step S24 Then, it is determined whether or not there is an end instruction (S23). That is, it is determined whether or not an instruction to end the editing and reproduction program has been issued. If the result of this determination is that no termination instruction has been given, processing returns to step S11 and the aforementioned steps are executed. On the other hand, if an end instruction has been given, this flow ends.

  As described above, in one embodiment of the present invention, when music content is registered in the edit list (see FIGS. 2, 3 and 4), a music menu (music folder 81) representing music objects is displayed. ) Is displayed together with the edit list, and for the music object moved from the music menu to the music content area of the edit list (see musicX in FIG. 15), the moved position of the music object is converted into the date and time based on the time axis. Thus, the music is registered using the date and time as the reference of the reproduction timing of the music content. For this reason, music content can be appropriately combined and set.

  In one embodiment of the present invention, an image (user image) acquired by a user (individual) by photographing and an image acquired from an external database 41 (provided image provided by a business operator) are combined. Explained about playing. However, the present invention is not limited to this, and it is needless to say that it may be reproduced in combination with image data acquired by photographing by another photographer different from the user (individual).

  In the embodiment of the present invention, the slide show has been described as a representative example of the image reproduction. However, the present invention is not limited to this. For example, it is applied to the reproduction order in normal one-frame reproduction, and the personal image data is reproduced. The provided image taken at or near the same location as the location where the personal image data was taken may be played back before and after the time.

  Furthermore, in one embodiment of the present invention, the provided image data is obtained via the network 32. However, the present invention is not limited to this, and various external devices other than the playback device 1, such as a camera, a personal computer, image editing, and the like. You may make it acquire from an apparatus, an external memory, etc.

  Furthermore, in one embodiment of the present invention, part or all of the processing of the CPU 11 may be configured by hardware. Conversely, the hardware of the image creation unit may be configured by software. The specific configuration is a design matter. As a recording medium for storing a program, a flash memory is used in the present embodiment. However, the present invention is not limited to this. For example, an optical recording medium such as a CD-ROM or DVD, a magnetic recording medium such as an MD, a tape medium, Of course, a semiconductor memory such as an IC card may be used. Further, the content editing unit 12 may be a content editing device or an editing device configured by hardware.

  Furthermore, in one embodiment of the present invention, a reduced image is displayed as an object representing each piece of multi-content data in the collective display list or hourly list. However, the present invention is not limited to this. The file name may be displayed.

  In the description of an embodiment of the present invention, an example in which the reproducing apparatus 1 is applied to a personal computer has been described. However, the present invention is not limited thereto, and for example, a television or the like that can be connected to the Internet may be used. In any case, the present invention can be applied to any device that can store and reproduce multi-contents.

  Further, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

It is a block diagram which shows the structure of the reproducing | regenerating apparatus concerning one Embodiment to which this invention is applied. It is a figure which shows the structure of the collective display list in one Embodiment of this invention. It is a figure which shows the structure of the hourly list in one Embodiment of this invention. It is a figure which shows the structure of the other hourly list in one Embodiment of this invention. It is explanatory drawing of the circle display in one Embodiment of this invention. It is a figure which shows the reproduction display of the multi-contents on the display screen of the reproducing | regenerating apparatus concerning one Embodiment of this invention, and is a screen at 8:20 on August 31. It is a figure which shows the reproduction | regeneration display of the multi content on the display screen of the reproducing | regenerating apparatus concerning one Embodiment of this invention, and is a screen at 9:15 on August 31. It is a figure which shows the edit preview screen in the single display in one Embodiment of this invention. It is a figure which shows the edit preview screen in the single display in one Embodiment of this invention. It is a figure which shows the edit preview screen in the single display in one Embodiment of this invention. It is a figure which shows the edit preview screen in the single display in one Embodiment of this invention. It is a figure which shows the edit preview screen in the single display in one Embodiment of this invention. It is a figure which shows the edit preview screen in the multi display in one Embodiment of this invention. It is a figure which shows the edit preview screen in the multi display in one Embodiment of this invention. It is a figure which shows the music registration screen in the hourly list in one Embodiment of this invention. It is a figure which shows the music registration screen in the hourly list in one Embodiment of this invention. It is a figure which shows the music registration screen in the hourly list in one Embodiment of this invention. It is a figure which shows the music registration screen in the collective display list in one Embodiment of this invention. It is a figure which shows the music registration screen in the collective display list in one Embodiment of this invention. It is a figure which shows the music registration screen in the collective display list in one Embodiment of this invention. It is a figure which shows the music registration screen in the collective display list in one Embodiment of this invention. It is a flowchart which shows the operation | movement of the main flow of the reproducing | regenerating apparatus concerning one Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Playback apparatus, 10 ... Control part (CPU), 11 ... Content management part, 12 ... Content editing part, 13 ... Content reproduction part, 14 ... Content search part, 15 ... Recording / playback unit, 16 ... Image processing unit, 17 ... Screen creation unit, 18 ... Audio processing unit, 20 ... RAM, 21 ... Storage unit, 21a ... Program storage , 21b ... content storage unit, 22 ... display IF unit, 23 ... sound reproduction IF unit, 24 ... communication IF unit, 25 ... operation unit, 26 ... bus, 30. ..Monitor device, 31... Speaker device, 32... Network, 40 ..Server, 41 ..Database, 51 .. Date information, 52.・ Play icon, 55 ... Still image, 56 ... Movie 57 ... music, 58 ... text, 59 ... background image, 61 ... time zone, 62 ... playback start time, 64 ... list icon, 71 ... display content type column, 72a ... Single display box, 72b ... Multi display box, 72c ... Setting icon, 73 ... Content display screen, 74a ... Back icon, 74b ... Full size display icon, 74c ...・ Contents editing screen icon, 74d ... Return icon, 74e ... Auto play icon, 74f ... Feed icon, 74g ... Left rotation icon, 74h ... Right rotation icon, 74i ... Trimming icon 74j ... Play icon, 74k ... Stop icon, 74m ... Character size icon, 74n ... Font icon 76 ... Content check box, 81 ... Music folder, 83 ... Registration screen, 84 ... Registration screen, 85 ... Date and time designation screen, 86 ... Time zone switching screen, TC ... Cursor, TT ... Time circle, TD ... Day circle, TM ... Month circle, TY ... Year circle

Claims (10)

In a playback device that plays back multi-contents composed of a plurality of types of content including at least captured images,
A content playback unit that plays back the data of the content with respect to the content of the captured image, using the shooting date and time as the reference of the playback timing, and the other content as the reference of the playback timing,
The screen is created by arranging the areas divided for each content in a line, and the direction intersecting with the time axis is created as a time axis. Objects representing each data of the multi-content are represented by the type of the content and the playback timing of the content. A content editing unit that displays an edit list arranged at a corresponding place on the screen and edits the playback timing of the multi-content on the edit list;
With
When registering music content in the edit list, the content editing unit displays a music menu representing the music object together with the edit list, and displays the music content of the edit list from the music menu. With respect to the music object moved in the region, the music object is registered by converting the moved position of the music object into a date and time based on the time axis and using the date and time as a reference for the reproduction timing of the music content. A playback device.   2. The playback apparatus according to claim 1, wherein the content editing unit attaches a head time of the time zone as a time attached to the music content.   The content editing unit attaches a time corresponding to the earliest shooting time among shooting times of shot image content belonging to the time zone as a time to be attached to the music content. The reproducing apparatus as described. In a playback device for playing back multi-contents composed of data of a plurality of types of content including at least two types of content of photographed images and music,
A content playback unit that plays back the data of the content with respect to the content of the captured image, using the shooting date and time as the reference of the playback timing, and the data of other content with the date and time attached to each as the reference of the playback timing;
The editing screen is divided into areas for each type of content, and objects representing the data of the plurality of types of content are arranged in the area to which each content belongs in the order of the date and time attached to each content. A content editing section for editing the playback timing of content data on the screen;
With
When the content editing unit registers music content on the editing screen, the date and time attached to the music content is the date and time corresponding to the position where the music object is placed, or the music file is created. Register with at least one selected date / time or date / time specified,
A reproducing apparatus characterized by that. A content editing method for editing the reproduction timing of multi-contents including at least a plurality of types of content including photographed image content,
For the content of the above-mentioned photographed image, the step of reproducing the data of the content with the shooting date and time as the reference of the reproduction timing and the other content as the reference of the reproduction timing,
Prior to playing the multi-content, editing the multi-content playback timing;
With
The step of editing the playback timing of the multi-content is as follows:
Create a screen with the time domain in the direction intersecting with the area divided by content above in one row,
Display an edit list in which objects representing each data of the multi-content are arranged at corresponding positions on the screen based on the type of the content and the playback timing of the content,
Edit the multi-content playback timing on this edit list.
Has steps,
The step of registering music content in the edit list is as follows:
The music menu showing the music object is displayed with the above edit list,
With respect to the music object moved from the music menu to the music content area of the edit list, the moved position of the music object is converted into a date and time based on the time axis, and the date and time is converted to a reference for the reproduction timing of the music content. Register that music as,
A content editing method characterized by that. A content editing program for causing a computer to execute multi-content playback including at least a photographed image content and edit the playback timing,
For the content of the above-mentioned photographed image, the step of reproducing the data of the content with the shooting date and time as the reference of the reproduction timing and the other content as the reference of the reproduction timing,
Prior to playing the multi-content, editing the multi-content playback timing;
With
The step of editing the playback timing of the multi-content is as follows:
Create a screen with the time domain in the direction intersecting with the area divided by content above in one row,
Display an edit list in which objects representing each data of the multi-content are arranged at corresponding positions on the screen based on the type of the content and the playback timing of the content,
Edit the multi-content playback timing on this edit list.
Has steps,
The step of registering music content in the edit list is as follows:
The music menu showing the music object is displayed with the above edit list,
With respect to the music object moved from the music menu to the music content area of the edit list, the moved position of the music object is converted into a date and time based on the time axis, and the date and time is converted to a reference for the reproduction timing of the music content. Register that music as,
A program for editing content, which causes a computer to execute the above. In an editing apparatus for editing a playback procedure when playing multi-contents including at least a plurality of types of content including photographed images,
The screen is created by arranging the areas divided for each content in a line, and the direction intersecting with the time axis is created as a time axis. Objects representing each data of the multi-content are represented by the type of the content and the playback timing of the content. A content editing unit that displays an edit list arranged at a corresponding place on the screen and edits the playback timing of the multi-content on the edit list;
With
When registering music content in the edit list, the content editing unit displays a music menu representing the music object together with the edit list, and displays the music content of the edit list from the music menu. For a music object whose area has been moved, converting the position of the music object to a date and time based on the time axis, and registering the music using the date and time as a reference for the playback timing of the music content. A feature editing device.   8. The editing apparatus according to claim 7, wherein the content is deleted, moved, or added on the editing list.   8. The editing apparatus according to claim 7, wherein when the music content is moved from the music menu onto the edit list, a time at the beginning of a time zone on the edit list is attached to the music content. .   When moving the music content from the music menu onto the edit list, the music content corresponds to the earliest shooting time among the shooting times of the shot image content belonging to the time zone on the edit list. 8. The editing apparatus according to claim 7, wherein time is given.