JP2006040134A - Reproduction device, camera, combination condition display method and combination condition setting method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a reproduction device for displaying and setting, in a visually understandable manner, combination conditions, for example, for simultaneously reproducing music and images. <P>SOLUTION: The reproduction device is provided with an image display device with a touch panel and an image reproducing function for reproducing an image on the display device. Also, the reproduction device is provided with a music reproducing function for reproducing music, and an operation mode for simultaneously displaying the image with special video effects and enjoying music. Then, the reproduction device provides a user interface for display/setting suitable for the touch panel operation by displaying the combination of music, image and video effects as the icon image of a cube whose three visual faces each express them. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a user interface technique for setting / displaying playback conditions when, for example, music and images are played back simultaneously.

  In recent years, compression / encoding technology for music data and image data has been improved, and the capacity and price of semiconductor memory have been increased. Therefore, a portable digital recording / reproducing apparatus capable of reproducing both music and images Has begun to spread.

  Since this type of playback apparatus can record data in various formats such as music and images on the same recording medium, the way of enjoying it is diversified. For example, music and images are not only reproduced separately, but also enjoyed in any combination at the same time.

And in order to support such a way of enjoying, we provide a mechanism to register a combination of music and images in advance, and by calling one of them according to the mood, time zone, environment etc. at that time In addition, a method for realizing simultaneous reproduction by combining desired music and images without performing complicated combination work each time has been proposed (see, for example, Patent Document 1).
JP 2002-305705 A

  By the way, recently, in a portable type electronic device, a case where a touch panel is used as a user interface is increasing. Therefore, it is desirable that the operation is visually easy to understand using an icon, for example.

  Therefore, even when registering multiple combination conditions such as music and images described above, it is not a method suitable for keyboard operation, for example, to fill a list, but suitable for visually easy-to-understand touch panel operation. A method was strongly desired.

  The present invention has been made in consideration of such circumstances, for example, a playback apparatus, a camera, and a camera capable of visually displaying and setting combination conditions when simultaneously playing music and images. An object is to provide a combination condition display method and a combination condition setting method.

  In order to achieve the above-described object, a playback apparatus according to the present invention includes first setting means for setting music to be played back, second setting means for setting a group of images to be played back, and image processing for video effects. A third setting means for setting a pattern of the first and a group of images set by the second setting means while performing the image processing of the pattern set by the third setting means and displaying the first image Remix reproduction means for reproducing music set by the setting means, and object display means for displaying a combination of music, group and image processing pattern set by the first to third setting means as an object of a predetermined shape It is characterized by comprising.

  The camera of the present invention further includes the reproducing device, an imaging unit, and a recording unit that records an image captured by the imaging unit, and the second setting unit of the reproducing device records in the recording unit. A group composed of a combination of arbitrary images in the processed images is a processing target.

  The combination condition display method of the present invention is a combination condition display method for displaying on a display means a reproduction condition comprising a combination of music, an image group and an image processing pattern, wherein the reproduction condition is a music, an image group and an image. A combination condition display method comprising displaying a processing pattern in a perspective view of a cube represented on each of first to third side surfaces.

  Further, the combination condition setting method of the present invention is a combination condition setting method for setting a reproduction condition composed of a combination of music, an image group and an image processing pattern, wherein the music, the image group and the image processing pattern are respectively set, The set playback conditions are displayed in a perspective view of a cube in which music, an image group, and an image processing pattern are represented on first to third sides, respectively.

  According to the present invention, for example, a playback device, a camera, a combination condition display method, and a combination condition setting method capable of visually displaying and setting combination conditions when music and images are simultaneously reproduced can be provided. be able to.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is an external view of a playback apparatus according to the present embodiment. The playback apparatus 1 is an audio player with a camera. As shown in FIG. 1A, a shooting window 101 for capturing subject light from a subject and an auxiliary toward the subject are provided on the front of the housing. An illumination window 102 for irradiating light is provided.

  Further, an image display device 15 with a touch panel is arranged on the rear surface of the housing of the playback device 1 as shown in FIG. When the operation mode of the playback apparatus 1 is the shooting mode, the subject image is displayed on the display surface as a so-called through image, and when an arbitrary detection area of the touch panel is touched (contact operation), the operation is recognized as a so-called release instruction. Then, the photographing process is executed. When the operation mode is the image reproduction mode, for example, one photographed image is displayed on the display surface, and the photographed image to be displayed is switched and controlled according to a predetermined operation on the touch panel. The playback apparatus 1 is also provided with an operation mode in which music can be enjoyed at the same time while displaying an image with a special video effect. The reproducing apparatus 1 is configured to visually set and display the combination of music, images, and video effects in an easy-to-understand manner, which will be described in detail later.

  Further, a power button 103 for turning on / off the power is provided on the upper surface of the housing of the reproducing apparatus 1 as shown in FIG.

  FIG. 2 is a device configuration diagram of the playback apparatus 1 of the present embodiment.

  The playback apparatus 1 is controlled by the CPU 11 as a whole, and various programs describing the control procedure are stored in the ROM 12. The photographing window 101 shown in FIG. 1A is provided with a lens 131 of the camera device 13, and subject light that has passed through the lens 131 is incident on the image sensor 132 and forms a subject image on the imaging surface. Form an image.

  The image pickup element 132 is configured by arranging a plurality of pixels that perform photoelectric conversion in a two-dimensional matrix to form an image pickup surface, and further arranging a color filter on the image pickup surface, and a subject image formed on the image pickup surface. The signal charge corresponding to is accumulated. The imaging device 132 is subjected to various controls such as exposure and readout by the imaging unit 133, and the output is converted into a digital signal by the imaging unit 133 and then input as an image signal to the image processing unit 14 via the system bus. The The imaging unit 133 also controls the light emission of the strobe 134, and the auxiliary light emitted by the strobe 134 illuminates the subject through the illumination window 102 shown in FIG.

  The image processing unit 14 that has received the image signal from the camera device 13 via the system bus performs predetermined processing by performing ISO sensitivity setting, auto white balance, luminance / color signal generation, gamma processing, and the like on the image signal. A color image signal of the format is generated. This color image signal is converted into a form suitable for display output, supplied to the image display device 15 with a touch panel, displayed in real time on the image display unit 151 as a through image, and converted (compressed) into a form suitable for recording. Encoded) and recorded as a captured image on the hard disk 16 via the system bus.

  The state of the touch panel 152 of the image display device with a touch panel 15 on which the through image is displayed in real time on the image display unit 151 is monitored by the detection unit 17, and when a touch panel operation is performed, the touched position is detected by the detection unit 17. The detected position information is notified to the CPU 11. For example, when a touch at an arbitrary position corresponding to the release operation described above is notified from the detection unit 17, the CPU 11 records the entire apparatus to record an image being displayed on the hard disk 16 as a through image on the image display unit 151. Control. In addition to the notification from the detection unit 17, the CPU 11 controls the entire apparatus such as power on / off according to a control signal from the operation unit 18 including the power button 103 shown in FIG. Execute.

  The captured image recorded on the hard disk 16 as described above is read out by the image processing unit 14 in the image reproduction mode, subjected to decompression decoding, and displayed on the image display unit 151 of the image display device 15 with a touch panel. . The switching of the captured image to be displayed on the image display unit 151 is executed by a notification from the detection unit 17 to the CPU 11, that is, by an operation on the touch panel 152 of the image display device 15 with a touch panel.

  Further, the playback device 1 can be detachably attached to a stand device 2 called a cradle or the like, and when attached to the stand device 2, a connector 104 provided on the peripheral wall of the housing is connected to the stand device 2 side. The connector 201 is fitted and both are electrically connected. The stand device 2 is provided with a USB terminal 202, a video output terminal 203, and a DC input terminal 204. The USB terminal 202 is a personal computer (PC) 3, and the video output terminal 203 is a television device (TV) 4. The AC adapter 5 can be connected to each DC input terminal 204.

  The USB terminal 202 is connected to the interface (IF) unit 19 of the playback device 1 via the connectors 201 and 104, and the playback device 1 can communicate with the PC 3 under the control of the IF unit 19. It becomes. For example, a captured image recorded on the hard disk 16 can be transferred to the PC 3, or music data compressed and encoded from the PC 3 can be received and recorded on the hard disk 16. The playback apparatus 1 has a music playback mode as an operation mode. In this music playback mode, the audio processing unit 20 reads out music data from the hard disk 16, performs decompression decoding and analogization, and outputs the music data to the audio output terminal 105. To do. The user can view this music by connecting headphones or the like to the audio output terminal 105.

  The video output terminal 203 is connected to the image processing unit 14 of the playback apparatus 1 via the connectors 201 and 104. In response to the notification from the CPU, the image processing unit 14 supplies a color image signal to the TV 4 instead of supplying a color image signal to the image display unit 151 of the image display device 15 with a touch panel. At this time, the image processing unit 14 converts the color image signal into a form (NTSC) suitable for display output on the TV 4.

  Further, the DC input terminal 204 is connected to the power supply circuit 21 of the reproducing apparatus 1 via the connectors 201 and 104. When the power supply circuit 21 detects that the AC adapter 5 is connected via the stand device 2, the power supply circuit 21 switches the power supply from the battery 22 to the AC adapter 5 and controls the charging of the battery 22 with the power from the AC adapter 5.

  FIG. 3 is a diagram showing a hierarchical relationship between a menu presented by the playback apparatus 1 and main states of the playback apparatus 1 formed by the menu.

  As shown in FIG. 3, the playback device 1 first presents three items, which are a photo menu a1, a music menu a2, and a remix (music image) menu a3, as options. Note that the CPU 11 of the playback apparatus 1 holds a state when the power is turned off by the power button 103, and also restores the held state when the power is turned on by the power button 103. have. Therefore, when the power is turned on, a screen at the previous power-off time is usually presented.

  The photo menu a1 is a menu selected when capturing an image, reproducing the captured image, and organizing the captured image. The music menu a2 is a menu that is selected when playing music or searching for music. The remix (music image) menu a3 is a menu selected when music is reproduced together with an image reproduced with a special video effect, or when a combination of music, image, and video effect is set (remix creation). These menus are selected by touching the corresponding detection areas on the touch panel 152 so as to touch the display areas on the image display unit 151 of the image display device 15 with a touch panel. Hereinafter, a case where the remix menu a3 related to settings and display control specific to the playback apparatus 1 is selected will be described. Hereinafter, a combination of music, images, and video effects may be simply referred to as a remix.

  When the remix menu a3 is selected, the playback device 1 presents a menu for shifting to either the remix creation mode a31 or the remix playback image playback mode a32. The remix creation mode a31 is a mode for creating a combination of music, images, and video effects, that is, a remix, and the remix playback mode a32 is a mode for playing back any of the created remixes. When the remix creation mode a31 is selected, the playback device 1 displays the initial screen for remix creation shown in FIG. 4 on the image display unit 151 of the image display device 15 with a touch panel.

  The cube (cube) displayed on the remix creation screen represents the image (b1), the video effect (b2), and the music (b3) on each of the three visible surfaces. That is, the contents of the remix are visually presented by one cube. FIG. 4 shows a state in which nothing is set yet. When one of the three display areas of the cube is touched, that is, when the corresponding detection area on the touch panel 152 is touched, the image display unit 151 is touched. The display shifts to a corresponding item selection screen. Here, it is assumed that the surface of the image (b1) is first touched. FIG. 5 shows an image selection screen.

  This playback apparatus 1 has a function of managing a group composed of a plurality of images as an album, and selects a remix image for each album. “Sea”, “friends”, “flower” and the like shown in FIG. 5 are album names, and the user selects a target album from the albums displayed as a list by icon images by touching the display area. . The icon image that indicates each album contains the representative images in the images registered in that album, and the photos are stacked in a thickness corresponding to the number so that the approximate amount can be grasped sensuously. These figures are also displayed.

  When the image is selected, the display on the image display unit 151 returns to the image shown in FIG. 4 with the representative image fitted in the display area of the image (b1). Next, it is assumed that the surface of the video effect (b2) is touched. FIG. 6 shows a video effect selection screen.

  In the reproducing apparatus 1, when an image is reproduced, various image processing patterns to be applied for video effects are prepared in advance, and these image processing patterns are presented to the user as templates. These image processing programs and icon images indicating each pattern are all stored in the ROM 12. Then, the user selects an image processing pattern template to be applied to the image display of the album selected in FIG. 5 on this screen. Specifically, for example, template NO. 3 is a video effect (flashback) in which a plurality of images are displayed in a stacked manner with halftone, and the template No. 3 in the lower center. Reference numeral 4 denotes a video effect (cinema film) in which an image is switched to a film of a movie.

  When the video effect is selected, the display of the image display unit 151 further returns to the image shown in FIG. 4 in a state where the icon image indicating the template is fitted in the display area of the video effect (b2). Finally, it is assumed that the surface of music (b3) is touched. FIG. 7 shows a music selection screen. Here, it is assumed that “video effect” corresponding to the icon surrounded by a broken line at the center of the lower row is selected.

  The music is transferred in album units from the PC 3 connected via the stand device 2 and recorded on the hard disk 16. Therefore, first, a list of jacket images attached to this album is displayed, and the user is allowed to select an album containing the target music. When one of the jacket images is selected, secondly, a list of music information stored in the selected album is displayed. FIG. 8 shows an example of displaying a list of music information. In the example shown in FIG. 8, the performer, song name, genre, and performance time are displayed in four rows from the top, and the user selects the target music based on these pieces of information.

  Thus, selection of all of the image, the video effect, and the music is completed, one remix is newly created, and management information thereof is recorded on the hard disk 16. Multiple remixes can be registered. On the other hand, a remix playback mode a32 is provided to play back the remix created in this way.

  When the remix playback mode a32 is selected, the playback device 1 displays a cubic icon image representing each remix as an option on the image display unit 151 of the image display device 15 with a touch panel. As shown in FIG. 9, on each face (b1 to b3) of the cube, images indicating the selected image, video effect, and music are represented. That is, this icon image allows the user to visually grasp the contents of each remix combination. The objects c1 and c2 displayed on the left and right are so-called scroll operation buttons for forward or backward remix, and the user operates the objects c1 and c2 to display the icon image of the target remix. By touching the object c3 that is the playback button, the remix playback can be started. In addition, other icons are displayed on the left and right of the screen. Thus, it can be seen that there are other remix icons that can be selected.

  As the remix icon image, for example, as shown in FIG. 10, the music display may be replaced with an album jacket image. Any other display may be used as long as it can indicate what is selected as a combination of remixes.

  Next, with reference to the flowcharts of FIGS. 11 to 13, an operation principle related to the remixing of the reproducing apparatus 1 will be described. FIG. 11 shows a basic flow related to remixing.

  As shown in FIG. 11, for the remix, the playback device 1 first performs a remix creation process whose flow is shown in FIG. 12 (step A1), and then performs a remix playback process whose flow is shown in FIG. (Step A2).

  When creating a remix, the CPU 11 first displays a cube for creating a remix (step B1). When an album icon surface is selected, representative images of each album are read from the hard disk 16 and displayed in a list (step). B2). When one of them is selected, the CPU 11 sets the album as a remix component (step B3), and redisplays the cube for remix creation with the representative image inserted. (Step B4).

  Next, when the template icon plane is selected, the CPU 11 reads out icon images indicating image processing patterns for video effects from the hard disk 16 and displays them as a list (step B5). When one of them is selected, the CPU 11 sets the image processing pattern for the video effect as a remix component (step B6), and the cube for remix creation with the icon image fitted therein. (Cube) is displayed again (step B7).

  Finally, when the music icon surface is selected, the CPU 11 reads out the jacket images of each album from the hard disk 16 and displays them in a list, and further displays a list of information on the music stored in the selected album (step B8). . When one of them is selected, the CPU 11 sets the music as a remix component (step B9), and records the remix management information on the hard disk 16.

  Here, an example in which setting is performed in the order of image, video effect, and music has been described. However, the setting is not limited to this, and the setting may be performed in any order.

  On the other hand, during remix playback, the CPU 11 reads out the remix management information recorded on the hard disk 16, displays the combined contents of each remix as cubes (step C1), and any cube is selected. Then, the remix image, video effect, and music playback conditions are set (step C2). Then, the reproduction process is executed in response to the touch panel operation on the reproduction button (step C3).

  As described above, in the present embodiment, a combination of images, video effects, and music is expressed visually in a cube (cube) in an easy-to-understand manner, and a display / setting user interface suitable for touch panel operation is provided.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

External view of playback apparatus according to an embodiment of the present invention Device configuration diagram of the playback apparatus of the embodiment The figure which shows the hierarchical relationship of the main state of the menu which the reproducing | regenerating apparatus of the embodiment shows, and the reproducing | regenerating apparatus formed with this menu The figure which shows the initial screen which the reproducing | regenerating apparatus of the embodiment displays at the time of remix creation mode The figure which shows the selection screen of the image which the reproducing | regenerating apparatus of the embodiment displays in the remix creation mode The figure which shows the selection screen of the video effect which the reproducing | regenerating apparatus of the embodiment displays at the time of remix creation mode The figure which shows the 1st selection screen of the music which the reproducing | regenerating apparatus of the embodiment displays at the time of remix creation mode The figure which shows the 2nd selection screen of the music which the reproducing | regenerating apparatus of the embodiment displays at the time of remix creation mode The figure which shows the screen which displays the cube (cube) showing a remix as an option at the time of the reproducing | regenerating apparatus of the embodiment at the remix reproduction mode. The figure which shows the modification of the screen which displays the cube (cube) showing a remix as an option at the time of the reproducing | regenerating apparatus of the embodiment at the remix reproduction mode. The flowchart which shows the basic flow regarding the remix which the reproducing | regenerating apparatus of the same embodiment carries out execution control The flowchart which shows the flow of the remix creation process which the reproducing | regenerating apparatus of the embodiment carries out execution control The flowchart which shows the flow of the remix reproduction | regeneration processing which the reproduction | regeneration apparatus of the embodiment controls execution

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Playback apparatus, 2 ... Stand apparatus, 3 ... Personal computer (PC), 4 ... Television apparatus (TV), 5 ... AC adapter, 11 ... CPU, 12 ... ROM, 13 ... Camera apparatus, 14 ... Image processing part , 15 ... Image display device with touch panel, 16 ... Hard disk, 17 ... Detection unit, 18 ... Operation unit, 19 ... Interface (IF) unit, 20 ... Audio processing unit, 21 ... Power supply circuit, 22 ... Battery, 101 ... Shooting window , 102 ... Lighting window, 103 ... Power button, 104 ... Connector, 105 ... Audio output terminal, 131 ... Lens, 132 ... Imaging element, 133 ... Imaging section, 134 ... Strobe, 151 ... Image display section, 152 ... Touch panel, 201 ... Connector, 202 ... USB terminal, 203 ... Video output terminal, 204 ... DC input terminal.

Claims (9)

First setting means for setting music to be played;
Second setting means for setting a group of images to be reproduced;
Third setting means for setting an image processing pattern for video effects;
Remix for reproducing music set by the first setting means while displaying each image of the group set by the second setting means by performing image processing of the pattern set by the third setting means Reproduction means,
And an object display means for displaying a combination of music, group and image processing pattern set by the first to third setting means as an object of a predetermined shape.   The object display means displays, as the object, a perspective view of a cube in which the music, group, and image processing pattern set by the first to third setting means are respectively shown on the first to third sides. The reproducing apparatus according to claim 1.   2. The playback apparatus according to claim 1, wherein the object display unit displays the group representative image set by the second setting unit in the object.   2. The playback apparatus according to claim 1, wherein the object display means displays a jacket image attached to the music set by the first setting means in the object.   2. The playback apparatus according to claim 1, wherein the object display means displays an icon corresponding to the image processing pattern set by the third setting means in the object. A playback device according to any one of claims 1 to 5,
Imaging means;
Recording means for recording an image picked up by the image pickup means,
2. The camera according to claim 1, wherein the second setting means of the playback apparatus targets a group composed of a combination of arbitrary images in the images recorded in the recording means. A combination condition display method for displaying a reproduction condition consisting of a combination of music, an image group and an image processing pattern on a display means,
A combination condition display method, wherein the reproduction conditions are displayed in a perspective view of a cube in which music, an image group, and an image processing pattern are represented on first to third sides, respectively. A combination condition display method of an image reproduction device for displaying a combination of a plurality of reproduction conditions at the time of image reproduction,
A combination condition display method for an image reproduction apparatus, wherein the plurality of reproduction conditions are displayed in a perspective view of a legislature representing each reproduction condition on each side. A combination condition setting method for setting a reproduction condition including a combination of music, an image group, and an image processing pattern,
Set the music, image group and image processing pattern,
The combination condition setting method, characterized in that the set reproduction condition is displayed in a perspective view of a cube representing music, an image group, and an image processing pattern on the first to third sides.

Images