JP5548249B2 - Menu screen display apparatus and method - Google Patents

Description

  The present invention relates to a menu screen display technique.

  In recent years, so-called digital home appliances have been diversified. For example, in order to record a television program, a hard disk recorder, a DVD (digital multipurpose disk) recorder, a composite device of these, or the like can be used. As for music playback, in addition to playback of conventional CDs (compact discs), there are a variety of methods such as playback of compressed data recorded on various memory cards and hard disks.

  Digital home appliances, particularly devices that play video and music, are supposed to be used by multiple people at the same time, and are often installed in a common space in the home, such as a living room, unlike PCs (personal computers). Since the operation panel and controller of a digital home appliance have a small number of buttons and a small display area, the operation content may be displayed in an area other than the main body, for example, a television screen. The television screen is viewed from a certain distance, and fine character strings and small pointer movements that are made on the PC screen are not suitable for display on the television screen. Accordingly, the user interface of a digital home appliance using a television screen is strongly required to have good visual quality and easy operation. Particularly for non-PC users, it is not always easy to use the operation method that is normally used on a PC.

  Also, in the multimedia playback device, it is important that the sense of the virtual world provided to the user by the content is not damaged as much as possible by the user interface.

  The present inventor has made the present invention based on the above recognition, and an object of the present invention is to provide a user with an intuitive user interface in a multimedia playback apparatus.

  One embodiment of the present invention is an apparatus capable of reproducing digital content. The apparatus includes an operation unit that obtains an instruction related to content reproduction via a user operation, data of a plurality of function icons that symbolize a type of content reproduction function, a plurality of content icons that symbolize content, and content items. And a storage unit that holds data of a semi-transparent folder icon that symbolizes a display unit of content, and image data of a menu screen related to content reproduction is output to the display device and acquired by the operation unit A display output unit that reproduces an item of content acquired from the storage unit according to a user instruction, and a content item acquired from the storage unit is associated with a type of content playback function and a plurality of folder icons, The first array of function icons on the screen and multiple folder icons on the screen A second sequence in which sequence, a display control unit for generating image data of a menu screen including, a. For each of the plurality of folder icons, the display control unit acquires one of the content icons symbolizing the related content from the storage unit as a folder pasted image, and the folder pasted image is included in the folder icon in the second array of the menu screen. As shown, the folder pasted image and the folder icon are displayed in a superimposed manner.

Here, “content” refers to information content including moving images, still images, sounds, texts, and programs that are played, displayed, or executed through a plurality of types of information transmission means, and may include information for entertainment purposes in particular. The term “content” abstractly indicates the entire playback target, whereas “content item” refers to data such as moving image data, still image data, audio data, text data, program data, etc. Each file unit may be indicated. In addition, “acquisition of content item” may indicate an operation of acquiring data such as a list of content names or a list of file names as “content item”. “Playback” may indicate playback of an image or sound, or may indicate execution of a program.
Also, “semi-transparent” means that the user can visually recognize the folder pasted image that is transmitted through the superimposed folder icon and displayed below the folder icon.

  According to this aspect, since the menu screen is configured in a state where the folder pasted image related to the content can be seen through the translucent folder icon, the user can intuitively view the content item by selecting the folder icon. Can understand.

  Another aspect of the present invention is a method for displaying a menu screen on a content playback apparatus. In this method, data of a plurality of function icons symbolizing the type of content playback function, data of a plurality of content icons symbolizing content, a content item, and a translucent folder icon symbolizing a content display unit are displayed. A first array in which a plurality of function icons are arranged in a specific direction on the screen, a plurality of function icons are associated with a type of content reproduction function and a plurality of folder icons, A step of generating image data of the menu screen in a two-dimensional array including a second array in which the folder icons are arranged in a direction intersecting the first array on the screen; and a display device for displaying the image data of the menu screen related to content reproduction And outputting to. In the generating step, for each of the plurality of folder icons, one of the content icons symbolizing the related content is acquired as a folder paste image, and the folder paste image is included in the folder icon in the second array of the menu screen. The folder pasted image and the folder icon are displayed in a superimposed manner.

  Also in this aspect, the user can intuitively understand that the content item can be browsed by selecting the folder icon.

  According to the present invention, an intuitive user interface can be provided to a user in a multimedia playback device.

1 is a diagram illustrating a basic configuration of a multimedia playback system. It is a functional block diagram which shows the structure of a multimedia reproduction apparatus. It is a figure which shows the structure of the menu screen produced | generated by a multimedia reproduction apparatus. It is a figure which shows typically the process in which the content of a menu screen changes. It is a figure which shows typically the process in which the content of a menu screen changes. It is a figure which shows typically the transition of a screen when a content item is selected. It is a figure which shows typically the transition of a screen when a content item is selected. It is a figure which shows typically the process in which the content of a menu screen changes. It is a figure which shows an example of the view matched with the item of a content, and each item. It is a figure which shows typically the process in which the content of a menu screen changes in another Example. It is a figure which shows typically the process in which the content of a menu screen changes in another Example. It is a flowchart which shows the operation | movement process of a multimedia reproduction apparatus.

  The multimedia playback system in the present invention example is a composite device that can play back or execute a plurality of contents such as still images, moving images, music, broadcasts, and games. The screen of the television receiver is used as the display screen, and the display contents on the screen and the operation buttons of the controller are used as the operation means. If a plurality of contents are reproduced on a PC, it is necessary to use an individual program such as a viewer corresponding to the type of contents. These individual programs are produced by different vendors, and usually do not have a common interface, and there is no sense of unity in each operation method. Further, even if these are integrated into a common interface such as a so-called portal screen, it is merely a collection, and since it takes time to start each program, the operation comfort in switching programs cannot be obtained.

  The multimedia playback system according to the present embodiment integrates a plurality of content playbacks under a common interface and gives a common operability to the user. In addition, by providing an intuitive user interface that virtualizes the menu screen as having a three-dimensional space and gives the user a view of the world as if the user has entered and operated in this three-dimensional space, Improve the sense of immersion in the world.

  FIG. 1 shows a basic configuration of a multimedia playback system. The multimedia playback system 10 functions mainly with the multimedia playback device 20. A television receiver 30 and a controller 42 are connected to the multimedia playback device 20. The television receiver 30 has a function of displaying or outputting video and audio output from the multimedia playback device 20 and is externally connected to the multimedia playback device 20. The controller 42 is a device that acquires various instructions related to content playback when operated by a user, and functions as a part of the multimedia playback system 10. The controller 42 may be realized by a game controller as shown in the figure, or may be realized by a remote controller used for controlling various functions of the multimedia playback device 20.

  Information is input to the multimedia playback device 20 through various recording media and various cables. For example, content held in the external devices 37 and 39 connected to the LAN 35 is input to the multimedia playback device 20 via the network cable 34. The input content is played back after being stored or buffered in the multimedia playback device 20.

  The multimedia playback device 20 has a data reading function and a writing function for an optical disk 36 such as a DVD and a CD, and a data reading function and a writing function for a removable memory card 38. The multimedia playback device 20 may read data such as movies and music albums from the optical disk 36, and may read data such as shot images and shot videos from the memory card 38.

  The multimedia playback device 20 causes the television receiver 30 to display a menu screen for instructing content playback. In the menu screen, items of content held in the multimedia playback device 20 and items of content held in the external devices 37 and 39 are displayed, and each content is displayed by the multimedia playback device 20 based on a user instruction. Can be played.

  FIG. 2 is a functional block diagram showing the configuration of the multimedia playback apparatus. The multimedia playback device 20 includes an operation unit 40, an input / output unit 44, a display output unit 46, a display control unit 48, a storage unit 80, and a game execution unit 82. The multimedia playback device 20 can be realized by a hardware configuration such as a CPU, a hard disk, a RAM, a ROM, and a drawing circuit. The software can be a data input function, a data holding function, an image processing function, a drawing function, and the like. FIG. 2 shows functional blocks realized by the cooperation of these programs. Therefore, these functional blocks can be realized in various forms by a combination of hardware and software.

  The operation unit 40 includes a direction determination unit 92 that acquires an instruction regarding any one of the four directions of up, down, left, and right through the operation of the controller 42 by the user, content reproduction, reproduction stop, menu screen call, and the like. An instruction determination unit 94 that acquires an instruction through an operation of the controller 42 by a user, an input / output unit 44, a display output unit 46, a display control unit 48, based on instructions acquired by the direction determination unit 92 and the instruction determination unit 94, An operation control unit 95 that controls each unit of the game execution unit 82.

  The input / output unit 44 is a network control unit 86 that processes the input of content held in the external device and the output of various data via the network cable 34, the input of data stored in the optical disc 36, and the data writing to the optical disc 36. A disk control unit 88 for controlling data loading and a memory card control unit 90 for inputting / outputting data to / from the memory card 38. The network control unit 86 detects an external device connected to the LAN 35. The network control unit 86, the disk control unit 88, and the memory card control unit 90 are the item names of contents held in the external devices 37 and 39, the optical disk 36, and the memory card 38, the icon data corresponding to the content items, the data size, etc. Are acquired and stored in the storage unit 80. Data input through each unit constituting the input / output unit 44 is sent to the display output unit 46, the display control unit 48, the storage unit 80, and the game execution unit 82.

  The storage unit 80 includes contents of external devices 37 and 39 input via the network cable 34, contents such as music and movies read from the optical disk 36, and contents such as still images and videos read from the memory card 38. Is stored. In the storage unit 80, data of a plurality of function icons symbolizing the type of the playback function, content played back by the display output unit 46 and content executed by the game execution unit 82, and each stored in the storage unit 80 Data of a plurality of content icons symbolizing content items and data of a semi-transparent folder icon symbolizing a content display unit are further stored. In addition, content icons symbolizing items of content stored in the external devices 37 and 39, the optical disk 36, and the memory card 38 are displayed by the network control unit 86, the disk control unit 88, and the memory card control unit 90. 36, obtained from the memory card 38 and stored in the storage unit 80. These function icons, content icons, and folder icons are used for displaying items on the menu screen.

  The function icon, content icon, and folder icon may be an uncompressed image such as a bitmap image or a compressed image such as JPEG, or may be an object configured by pasting a texture on a polygon. In the latter case, the position in the vertical axis direction of the screen in the virtual three-dimensional space in the screen can be changed by manipulating the Z value.

  The display output unit 46 decodes the content encoded data and reproduces it, a reproduction screen generation unit 96, an output buffer 100 that temporarily accumulates reproduction data to be output to the television receiver 30, and the television receiver 30. Includes an on-screen buffer 102 that temporarily stores image data for on-screen display output to be output before output, and a synthesis processing unit 98 that combines the reproduction data and the image data.

  The reproduction screen generation unit 96 decodes encoded content data such as movies and music received from the input / output unit 44 or the storage unit 80 based on a user instruction acquired by the operation unit 40 and stores the decoded content data in the output buffer 100. . In the on-screen buffer 102, for example, image data of the menu screen and the background screen generated by the display control unit 48 is stored as image data for on-screen display. The composition processing unit 98 synthesizes the reproduction data stored in the output buffer 100 and the image data of the menu screen and the background image stored in the on-screen buffer 102, converts them into analog signals, and converts them into the television receiver 30. Output to.

  The display control unit 48 includes a menu management unit 104 that manages the types of playback functions and content items corresponding to the respective playback functions as menu items, a content control unit 106 that controls playback or execution of each content, and icons on the menu screen. An effect processing unit 108 that processes the operation, a menu screen generation unit 110 that generates image data of the menu screen, and a background generation unit 112 that generates a background image to be displayed on the background of the menu screen or the playback screen are included.

  The menu management unit 104 stores content items stored in the storage unit 80 and content items input via the input / output unit 44, and stores the currently selected playback function and content. The playback function here includes, for example, a still picture playback function, a music playback function, a video playback function, a broadcast display function, and a game execution function, and further includes various setting functions and a network device selection function. Further, the menu management unit 104 performs an operation of associating the content item with the content reproduction function type and a plurality of folder icons. Based on a user instruction acquired by the operation unit 40, the content control unit 106 switches the playback function, starts and stops playback of the content, inputs data by the input / output unit 44, reads data from the storage unit 80, and game execution unit 82. Control the processing by.

  The menu screen generation unit 110 generates a menu screen that includes an array in which a plurality of function icons are arranged in a horizontal direction and an array in which a plurality of folder icons are arranged in a vertical direction. These two arrays intersect near the center of the screen to form a cross array. The menu screen generation unit 110 highlights the function icon and the folder icon displayed at the crossing position of the cross array and in the vicinity thereof so that they can be distinguished from other icons in appearance. Further, for each of the plurality of folder icons, the menu screen generation unit 110 acquires one of the content icons symbolizing the related content from the storage unit 80 as a folder pasted image so that the folder pasted image is included in the folder icon. The folder pasted image and the folder icon are displayed in a superimposed manner.

  The effect processing unit 108 processes the scroll display of the function icon, the folder icon, and the content icon array, and the highlighted function icon, the folder icon, and the content icon. Icon highlighting is expressed in a format different from that of other icons, for example, display and change in a color different from that of other icons, enlarged display of an icon, and movement of the icon. The background generation unit 112 generates a background image in which a decoration object that is deformed in a virtual three-dimensional space configured in the screen is drawn as the background of the menu screen and the playback screen.

  The game execution unit 82 executes a game program read from the optical disc 36 by the disc control unit 88 or a game program read from the storage unit 80. The game execution unit 82 processes the operation of the game program based on a user instruction acquired by the operation unit 40 and sends the video and audio of the game to the display output unit 46.

  FIG. 3 shows a configuration of a menu screen generated by the multimedia playback device 20. In the menu screen 50, a two-dimensional array in which a function icon array 70 in which a plurality of function icons are arranged in the horizontal direction and a folder icon array 72 in which a plurality of folder icons 120 and a folder pasted image 122 are arranged in the vertical direction is displayed. Is done. The function icon array 70 includes a photo icon 52, a music icon 54, a moving image icon 56, a game icon 62, and a setting icon 60 as marks that symbolize the type of playback function of the multimedia playback device 20. The folder icon array 72 includes folder icons for sorting a plurality of contents stored in the storage unit 80 into predetermined display units and displaying them on the menu screen. The menu screen composed of the function icon array 70 and the folder icon array 72 is an on-screen display, and is displayed superimposed on the front of the content video. When the content video currently being played back is displayed in the background area 160, the effect processing unit 108 colors the entire area of the function icon array 70 and the folder icon array 72 for facilitating the appearance distinction from the background image. It is also possible to make appearance distinction by adjusting the brightness of the content video.

  The folder icon 120 is texture data representing a translucent case such as a real world CD or DVD, and the folder pasted image 122 is displayed when, for example, the content icons of the content related to the folder icon are sorted in order of name. It is the first one. The user may be able to select a content icon to be displayed as a folder pasted image. The content icon is, for example, a thumbnail of a jacket image attached to the case.

  The function icons located in the area where the function icon array 70 and the folder icon array 72 intersect (intersection area 76) are enlarged and displayed in a different color from the other function icons as shown in the figure. The intersection area 76 is deferred at a predetermined position on the menu screen 50, and the function icon array 70 as a whole moves in the left / right direction in response to a user's instruction in the left / right direction via the operation unit 40. Color and icon size change. Therefore, the user can select a desired reproduction function only by giving a left / right direction instruction, and a determination instruction such as a mouse click operation normally performed on the PC is not necessary.

  The effect processing unit 108 realizes the movement of the function icons in the left-right direction by scrolling the entire area of the function icon array 70 in the left-right direction. The effect processing unit 108 displays the function icons in the same color and size while moving the function icons to the left and right, but changes the color and size of only the function icons located in the intersection area 76. The effect processing unit 108 may change elements such as brightness, saturation, and hue of the function icon as the color change, or may change the color by blinking display. Thus, since the function icon located in the intersection area | region 76 is displayed with the display mode different from another function icon, the user can select a medium easily.

  The effect processing unit 108 does not display the folder icon array 72 when the function icon is moving in the left-right direction and no function icon is located in the intersection area 76. When one of the function icons is positioned in the intersection area 76, the effect processing unit 108 expands and displays the folder icon array 72 so as to extend up and down from the intersection area 76, or displays the expanded folder icon array 72. The menu screen 50 may be faded in. This fade-in gradually makes an unclear image obtained by blurring the icons of the folder icon array 72 in an expanded state gradually clear. That is, the strength of the filter applied to the icon is gradually decreased as time elapses. Or, when the folder icon and the folder attached image are objects configured by pasting texture onto a polygon, the folder icon array in an expanded state is obtained by gradually increasing or decreasing the Z value of the polygon from the initial value. The display may be such that 72 is lowered or raised from the front of the screen vertical axis or from the direction of the eyelid to the level at which the menu screen is defined. Alternatively, by gradually increasing the α value of the texture from the initial value, the expanded folder icon array 72 may be displayed so as to gradually become opaque from the transparent state. Furthermore, a display may be made such that the folder icon array 72 expanded from the right end or the left end of the screen moves to the intersection area 76. A plurality of the above display modes may be combined.

  The user can recognize the content corresponding to the playback function only by scrolling the function icon to the left and right with the intersection area 76 as the target point. On the other hand, when there is an instruction in the left-right direction while the folder icon array 72 is displayed, the effect processing unit 108 displays the expanded folder icon array 72 in such a manner that the folder icon array 72 is stored toward the intersection area 76. Alternatively, the expanded folder icon array 72 is faded out from the menu screen 50. The fade-out method is the same as in the case of fade-in.

  An attention area 77 located in the vicinity of the center of the menu screen 50 is an area where an icon to be operated by the user is to be displayed. The menu screen generation unit 110 displays the function icon array 70 so that the intersection region 76 is positioned near the attention region 77, that is, immediately above the attention region 77. The attention area 77 constitutes a part of the folder icon array 72.

  While the operation unit 40 acquires an instruction in the vertical direction by the user, each folder icon 120 and the folder pasted image 122 are moved in the vertical direction in accordance with the instruction. The effect processing unit 108 realizes vertical movement of the folder icon 120 and the folder pasted image 122 by scrolling the entire area of the folder icon array 72 in the vertical direction.

  The effect processing unit 108 displays each folder icon 120 and the folder pasted image 122 in the same size while moving them up and down, but only the folder icon located in the attention area 77 and the folder pasted image 122 are sized as the attention icon. To enlarge. The effect processing unit 108 may further change elements such as the brightness, saturation, and hue of the icon of interest, or may display the blinking display. Other folder icons 120 and folder pasted images 122 are displayed in a size smaller than the icon of interest. Folder information 74 related to the view of the folder icon 120 is displayed near the attention area 77, that is, on the right side.

  The menu screen generation unit 110 displays the function icon array 70 slightly above the center in the vertical direction of the menu screen 50, and displays the folder icon array 72 slightly to the left of the center in the horizontal direction of the menu screen 50.

  The photo icon 52 symbolizes a still image reproduction function, and is an icon to be selected when reproducing a still image. The image to be reproduced is mainly a still image taken with a digital camera, and is read from the memory card 38, for example. The folder pasted image 122 developed and displayed when the photo icon 52 is located in the intersection area 76 is, for example, a still image thumbnail. If there is no appropriate image to be used as the folder pasted image, the photo icon 52 may be used instead of the folder pasted image. As the folder information 74, view information such as month, year, album, alphabetical order of all the still images, and the number of still images are displayed, and shooting information such as shooting date and file size is displayed as content information. .

  The music icon 54 symbolizes a music playback function, and is an icon to be selected when playing music data. The music data to be reproduced is generated, for example, by encoding data read from the optical disc 36 in a specific compression format. The folder pasted image 122 developed and displayed when the music icon 54 is located in the intersection area 76 is, for example, a thumbnail of a jacket image of a song distributed together with the music data by a vendor or a part of the music data according to a predetermined process. For example, a thumbnail of a generated visual effect image. If there is no appropriate image to be used as the folder pasted image, the music icon 54 may be used instead of the folder pasted image. View information such as genre, album, artist, year of recording, chronological order, all music, and the number of music data are displayed as folder information 74, and information such as a song name, album title, and playback time is displayed as content information. .

  The moving image icon 56 is an icon that represents a moving image reproduction function and should be selected when a moving image is reproduced. A moving image to be reproduced is a recorded video shot by a digital video camera, a video read from the optical disk 36 or an external device, and is encoded in a specific compression format. The folder pasted image 122 developed and displayed when the moving image icon 56 is located in the intersection area 76 is, for example, a thumbnail of a jacket image distributed together with a moving image by a vendor or a thumbnail of an arbitrary frame constituting the moving image. . The thumbnail may be a moving image. If there is no appropriate image used as a folder pasted image, the moving image icon 56 may be used instead of the folder pasted image. The folder information 74 displays the genre, artist, month, year, 50-sound order of the moving image, the number of moving images, such as all images, and the content information includes moving image name, recording date, playback time, etc. Information is displayed.

  The game icon 62 symbolizes a game execution function and is an icon to be selected when executing a game program. The execution target is a game program stored in the storage unit 80 or a game program read from the optical disc 36. The folder pasted image 122 displayed when the game icon 62 is positioned in the intersection area 76 is, for example, a thumbnail of a jacket image distributed together with the game program by a vendor, an icon symbolizing the game program, and a video provided in the game These are thumbnails of arbitrary frames constituting an image, thumbnails of game character images, and the like. The thumbnail may be a moving image. If there is no appropriate image used as a folder pasted image, the game icon 62 may be used instead of the folder pasted image. View information such as genre, alphabetical order, all programs, and the number of programs are displayed as the folder information 74, and information such as the title of the game program and the program installation date is displayed as the content information.

  The setting icon 60 symbolizes various setting functions, and is an icon to be selected when changing various settings of the multimedia playback device 20.

  The background image generated by the background generation unit 112 is displayed in the background area 160 as the background of the menu screen. The background generation unit 112 generates a single background image by superimposing the decoration object 162 that is deformed according to a predetermined rule in the virtual three-dimensional space in the screen and the background object that is the other part. The background generation unit 112 may generate a background image that changes according to a predetermined condition without using the decoration object 162.

  FIG. 4 schematically shows a state in which the content of the menu screen 50 transitions. When the operation unit 40 obtains a selection instruction by the user from the state of FIG. 3, the effect processing unit 108 displays the folder pasted image 122 superimposed on the folder icon 120 in the attention area 77 from the folder icon 120. It operates so as to pull out in the direction crossing the array 72. In FIG. 4, the folder pasted image 122 is drawn rightward. The effect processing unit 108 moves and displays the folder pasted image 122 in the right direction, while moving the function icon array 70 and the folder icon array 72 slightly in the left direction while maintaining the intersection between the two. Only the folder pasted image may be moved to the right, and the function icon array 70 and the folder icon array 72 may not be moved.

  FIG. 5 is a continuation of the transition of the menu screen 50 from FIG. 3 and shows the result of the user's instruction to select the folder icon 120. As shown in FIG. 5, since the function icon array 70 has moved to the left, a part of the setting icons 60 is not displayed on the menu screen 50. Also, the attention area 77 is displayed away from the center of the menu screen 50 in the left direction. The folder pasted image 122 extracted from the folder icon 120 is located on the right side of the attention area 77. This position becomes a second attention area 79 anew.

  A content icon array 78 is arranged on the right side of the folder icon array 72. A content icon 124 symbolizing a content item associated with the folder icon 120 in the attention area 77 is acquired from the storage unit 80 and displayed on the menu screen 50. The content icon array 78 may be expanded and displayed so as to be drawn up and down from the position of the second attention area 79 after the folder pasted image 122 is pulled out in the right direction, but has been expanded in parallel with the folder icon array 72. The content icon array 78 is preferably displayed so as to fade in as the folder pasted image 122 moves to the right. In the latter case, the time until the content icon array 78 is displayed can be shortened. Further, since there is little movement on the menu screen 50, it is difficult to draw the user's attention, and the user's attention is easily collected in the second attention area 79.

  The fade-in gradually makes an unclear image obtained by blurring the icons of the content icon array 78 in a state of being developed vertically. That is, the strength of the filter applied to the icon is gradually decreased as time elapses. Alternatively, if the content icon is an object configured by pasting a texture on a polygon, the expanded content icon array 78 is displayed on the screen vertical axis by gradually increasing or decreasing the Z value of the polygon from the initial value. The menu screen may be displayed so as to descend or ascend to the level defined from the front or the heel direction. Alternatively, by gradually increasing the α value of the texture from the initial value, display may be performed such that the expanded content icon array 78 gradually becomes opaque from the transparent state. Furthermore, a display may be made such that the content icon array 78 expanded from the right end or the left end of the screen moves to the right side of the folder icon array 72. A plurality of the above display modes may be combined.

  In the stage of FIG. 5, the folder pasted image 122 extracted from the folder icon 120 is represented as one of the content icons 124. This is because the folder pasted image 122 is selected from the content icons of the content originally associated with the folder icon 120. When any content icon 124 is selected in the content icon array 78, the corresponding content item is reproduced.

  The content icon 124 located in the second attention area 79 is also highlighted by the effect processing unit 108 as in the attention area 77. When the operation unit 40 obtains a vertical direction instruction from the user, the effect processing unit 108 moves the content icon array 78 up and down, and the content icon 124 that has entered the second region of interest 79 is highlighted. Further, on the right side of the content icon 124, for example, a song title and performance time are displayed as information 140 regarding the corresponding content item.

  After the folder pasted image 122 is pulled out from the folder icon 120 according to the user's selection instruction, or during that time, the effect processing unit 108 displays the function icons 52 to 62 included in the function icon array 70 and the folder icon array 72, the user An image obtained by applying a predetermined filter that gives a processing effect that makes an image inconspicuous to the folder icon 120 other than the folder icon selected by the folder icon 120 and the folder pasted image 122 superimposed on the folder icon 120 Is preferably displayed instead of the icon or image before the folder icon is selected. This filter provides, for example, an effect of reducing the image size, an effect of reducing the luminance value of the pixel to make the display thin, an effect of unfocusing by blurring, and the like, and these may be used in combination. Instead of applying the filter, if the target function icon, folder icon, and folder pasted image are objects that are configured by pasting texture onto a polygon, the texture alpha value is reduced to make it semi-transparent. Alternatively, the Z value may be manipulated to move the object in the depth direction of the screen vertical axis.

  When applying a filter that makes an image inconspicuous, by replacing the image obtained by applying the filter to the target function icon, folder icon, and folder pasted image with the image before applying the filter, A menu screen after selecting the folder icon may be generated. Alternatively, what is obtained by applying a filter that makes an image inconspicuous with respect to the entire menu screen 50 generated by the menu screen generation unit 110 before selecting the folder icon is used as the menu screen after selecting the folder icon. Also good.

  In the example of FIG. 5, the icons and folder pasted images included in the function icon array 70 and the folder icon array 72 are smaller in size than those in FIG. And it is displayed thinly. By displaying in this way, an icon that is not selected by the user at the present time and need not be noticed by the user for the time being can be made inconspicuous, and thus the user's attention is concentrated on the second attention area 79. Can be made. In order to indicate that the function icon (music icon 54 in FIG. 4) located in the intersection area 76 is currently selected, the size may not be changed before and after the folder icon selection. Alternatively, the function icon located in the intersection area 76 and the folder icon located in the attention area 77 may be displayed with a reduced size together with other icons when the folder icon is selected.

  In addition, when a selection instruction is made by the user in this way, icons other than the selected one are displayed in a small and unfocused manner so that the icons other than the selected icon can be viewed from the user's viewpoint. A visual effect of moving to the back side of the vertical axis can be obtained. By doing so, it is possible to give the user a sense that the menu is operated in a three-dimensional space virtually configured in the menu screen 50, and to enhance the user's immersive feeling.

  When the operation unit 40 obtains the content reproduction decision corresponding to the content icon 124 displayed in the second attention area 79, the menu screen generation unit 110 hides the menu screen image data, and the content control unit 106 is selected. Start playback of the content.

  FIG. 6 is a diagram schematically showing screen transition when a content item is selected. The background generation unit 112 hides the function icon array 70, the folder icon array 72, and the content icon array 78 when transitioning from the menu screen 50 to the content playback screen 51, but has already been displayed on the menu screen 50. The decoration object 162 continues to be displayed on the content reproduction screen 51 as it is. As a result, it is possible to express a seamless sequence between the menu screen and the content playback screen. Therefore, it becomes difficult for the user to see the disconnection between the two screens, and it becomes easier to concentrate on the content item to be played. The background generation unit 112 displays the content icon 124 of the selected content item in the lower left corner of the content reproduction screen 51, and displays information 146 of the selected content item on the right side thereof. When the reproduction of the content is started, the background generation unit 112 operates the decoration object 162 in the background area 160 according to parameters obtained from the output feature amount of the content being reproduced.

  When the operation unit 40 obtains a content reproduction decision by the user, the background generation unit 112 enters the back of the three-dimensional space from the user's viewpoint when the menu screen 50 transitions to the content reproduction screen 51. The background image is changed by using a video that provides a visual effect that returns to the near side or a visual effect. For example, the size is changed by multiplying the control parameter of the decoration object 162 by a coefficient, or the background screen sinks in the depth direction or moves so as to rise to the front. By doing so, the user can give a view of the world that moves in the virtual three-dimensional space to the heel or the near side, and makes it easy for the user to be immersed in the content.

  In addition, the background generation unit 112 extracts the color tone of the content icon 124 corresponding to the content item that the user has decided to reproduce, and the decoration object 162 or background that configures the background image so as to have the same color tone as that color tone. You may adjust the color of the object. Since the color tone of each content is reflected in the background image, especially when the thumbnail of the frame of the moving image content is used as the content icon, the atmosphere of the screen when the menu screen 50 is displayed and the content reproduction screen 51 Continuity with the atmosphere can be achieved. Therefore, even when the menu screen is switched to the content reproduction screen, the user is easily immersed in the content.

  Furthermore, when the reproduction instruction from the user is acquired by the operation unit 40, the background generation unit 112 may change the color tone of the decoration object 162 or the background object constituting the background image.

  The background generation unit 112 may deform the decoration object 162 in accordance with the output feature amount of the content or the button operation of the controller 42 by the user during the reproduction of the content. For example, when reproducing music content or moving image content, the decoration object 162 is deformed using the spectrum of audio data as a parameter. Or you may change the control parameter of the decoration object 162 according to button operation, such as determination, cancellation, and a movement by a user. In this way, by using the same decoration object on the menu screen and the content reproduction screen, it is possible to provide continuity to both world views. As a result, even when the menu screen is switched to the content reproduction screen, the user is easily immersed in the content.

  When an operation panel display instruction from the user is acquired by the operation unit 40 during content reproduction, the reproduction screen generation unit 96 operates an operation panel for operating content reproduction, stop, pause, fast forward, rewind, and the like. The image 148 is faded into the content reproduction screen 51 (see FIG. 7). The method used for fade-in is the same as described above. Also at this time, the decoration object 162 continues to operate according to the control parameter.

  When the user instructs the menu screen to be called via the operation unit 40 during content reproduction, the menu screen is displayed so as to be superimposed on the content reproduction screen. On the menu screen displayed here, the state when the content is determined to be reproduced is reproduced.

  FIG. 8 schematically shows a state in which an option menu is displayed in accordance with a user instruction. When an instruction for displaying an option menu from the user is acquired by the operation unit 40, the menu screen generation unit 110 generates an option menu 142. The effect processing unit 108 displays the option menu 142 so as to fade in the menu screen 50. In the fade-in, an unclear image obtained by blurring the image of the option menu 142 in which items are arranged in the vertical direction is gradually made clear. That is, the strength of the filter applied to the image is gradually decreased with time. Or, if the option menu 142 is an object configured by pasting a texture on a polygon, the option menu 142 can be displayed in front of the screen vertical axis or on the side of the screen by gradually increasing or decreasing the Z value of the polygon from the initial value. You may display so that it may fall or rise from the direction to the level where the menu screen is defined. Alternatively, display may be made such that the option menu 142 gradually becomes opaque from the transparent state by gradually increasing the α value of the texture from the initial value. Further, the display may be such that the option menu 142 moves from the right end or the left end of the screen to the right side of the folder icon array 72. A plurality of the above display modes may be combined.

  At this time, the effect processing unit 108 is obtained by applying a predetermined filter that gives a processing effect that makes an image inconspicuous to the icons included in the function icon array 70, the folder icon array 72, and the content icon array 78. The image is displayed instead of the icon or image before the option menu 142 is displayed. This filter provides, for example, an effect of reducing the image size, an effect of reducing the luminance value of the pixel to make the display thin, an effect of unfocusing by blurring, and the like, and these may be used in combination. Instead of applying the filter, if the target function icon, folder icon, and folder pasted image are objects that are configured by pasting texture onto a polygon, the texture alpha value is reduced to make it semi-transparent. Alternatively, the Z value may be manipulated to move the object in the depth direction of the screen vertical axis.

  When any selection instruction by the user among items displayed in the option menu 142 is acquired by the operation unit 40, the menu screen generation unit 110 generates a second option menu 144. The effect processing unit 108 displays the second option menu 144 on the right side of the option menu 142 so that the second option menu 144 gradually becomes clear from the blurred state and fades in the menu screen 50. At this time, the effect processing unit 108 is obtained by applying a predetermined filter that gives a processing effect that makes an image inconspicuous to the icons included in the function icon array 70, the folder icon array 72, and the content icon array 78. The image is displayed instead of the icon or image before the second option menu 144 is displayed.

  The option menu 142 and the second option menu 144 are on-screen displays, and are displayed superimposed on the front of the content video or background image. The effect processing unit 108 may color the entire area of the option menu 142 and the second option menu 144 to facilitate the appearance distinction from the background image, and adjust the brightness of the content video. A distinction in appearance may be facilitated by a method such as

  In this way, each time the folder or option menu is moved down the hierarchy, the icon displayed before that is displayed in a smaller and more unclear image so as to be less noticeable. In other words, icons that are less relevant to the current operation are displayed so as to sink in the vertical direction of the screen vertical axis in a virtual three-dimensional space on the screen. Conversely, as you move up the hierarchy, the icons are larger and displayed as clearer images.

  When “switch view” in the option menu 142 is selected, the view of the content associated with the folder icon is changed. In FIG. 8, since the content icon located in the second attention area 79 is music data, four views of “genre”, “album”, “artist”, and “all” are displayed in the second option menu 144 as view types. It is shown. If the content icon located in the second region of interest 79 is, for example, photo data, view types of “Month”, “Year”, “Album”, “50 alphabetical order”, and “All” are the second options. It may be displayed on the menu 144.

  FIG. 9 is a diagram illustrating an example of content items and views. In this specification, a folder icon has a role as a display unit of a content item corresponding to a certain content reproduction function. The view represents how to classify or cut out content items.

  In the table 150, a content column 152 represents the name of a content item (that is, music data) of music data, and a genre column 154, an artist column 156, an album column 158, and a recording year column 159 are content items in the content column 152, respectively. He has written genres, artists, recording albums and recording years. Here, genre, artist, and album correspond to “view”. Therefore, when the genre view is selected, the menu management unit 104 associates content items with different folder icons for each genre. That is, the content items “aaa”, “bbb”, and “eeee” are associated with the “J-POP” folder icon, and the content items “fff”, “ggg”, and “hhh” are associated with the “Country” folder icon. These folder icons are displayed on the menu screen 50 as the folder icon array 72 shown in FIG. When a different view, such as an album view, is selected by the user, the menu management unit 104 associates the content item with a different folder icon for each album. For example, the content items “fff”, “ggg”, and “hhh” are now associated with the folder icon “F”. Therefore, in this case, the folder icons “A”, “I”, “U”, “D”, “O”, “K” are displayed as the folder icon array 72 shown in FIG. Is displayed. When the artist view is selected by the user, the menu management unit 104 associates the content item with a different folder icon for each artist. For example, the content items “ggg” and “hh” are now associated with the folder icon “F”. The same applies to the recording year view. As described above, the same content items “fff”, “ggg”, and “hhh” are associated with a common folder icon or another folder icon depending on the view.

  It should be noted that depending on the type of content playback function, there may be only one content associated with the folder icon. For example, when the optical disc 36 in which only a piece of video data is stored is inserted into the multimedia playback device 20, a single folder icon is displayed below the moving image icon 56, and the icon is placed in the attention area. Even so, only one content icon is displayed in the second attention area 79.

  Also, in this specification, it should be noted that the separation of the content item associated with the folder icon is independent of the storage location of the content item. The menu management unit 104 searches for content in the storage unit 80, the external devices 37 and 39, the optical disc 36, etc., and executes an operation of associating each content item with a folder icon according to the view selected at that time.

  Note that the type of view is not limited to the above. For example, you can define “genre” or “photographer” as a view of folder icons associated with photo content or video content, or view the recorded month or year as a view of folder icons associated with music content. May be defined.

  Although FIGS. 3-9 demonstrated the case where the music icon 54 was selected as a function icon, when the other function icon is selected, it is the same.

  FIG. 10 schematically shows a menu screen when the photo icon 52 is moved from the function icon array 70 to the intersection area 76. A photo icon 52 is highlighted, and a folder icon 130 and a folder pasted image 132 are superimposed on the lower part thereof. The folder pasted image 132 is a thumbnail of any photo data associated with the folder icon 130. Unlike the square folder icon 120 of FIGS. 3 to 5, the folder icon 130 is a horizontally long rectangle in accordance with the thumbnail of photo data. On the right side of the folder icon 130, a view and the number of data are displayed as folder information 134. In FIG. 10, since “all” is selected as the view, all the photo data is associated with one folder icon 130, and therefore only one folder icon 130 is displayed as the folder icon array 72.

  FIG. 11 schematically shows a process of transition of the menu screen shown in FIG. When the operation unit 40 receives a view switching instruction from the user, the menu management unit 104 classifies content items according to the switched view and associates them with a plurality of folder icons 130. In FIG. 11, it is assumed that the view of “month” is selected. Therefore, the menu screen generation unit 110 displays a plurality of folder icons 130 associated with the content items classified by shooting month in the vertical direction of the intersection region 76. And a folder icon array 72 is formed. One content icon of the content item associated with the folder icon 130 is selected and displayed as a folder pasted image 132 superimposed on the folder icon 130. The folder icon 130 and the folder pasted image 132 in the attention area 77 are highlighted, and the view and the number of data are displayed as folder information 134 on the right side. Also on the right side of the other folder icons 130, view information, that is, the month of shooting is displayed.

  Character information 136 regarding the view may be displayed superimposed on the folder icon 130. For example, “12 2005” is displayed as the view information by the menu screen generation unit 110 on the folder icon 130 in the attention area 77. As a result, the user can easily recognize the nature of the content associated with the folder icon 130.

  FIG. 12 is a flowchart showing an operation process of the multimedia playback apparatus. When the user turns on the multimedia playback device 20, the network control unit 86 detects an external device on the LAN 35 via the network cable 34 (S6), and detects an item of content from the external device and the storage unit 80 ( S8). The menu screen generation unit 110 acquires items such as function icons and content icons from the storage unit 80, generates a menu screen, and causes the display output unit 46 to display the menu screen on the television receiver 30 (S10). When the operation unit 40 acquires a left or right direction instruction from the user (S12Y), the effect processing unit 108 moves the function icon in either the left or right direction according to the instruction (S14) and is positioned in the intersection area 76. The function icon is highlighted (S16), and the folder icon and the folder pasted image corresponding to the reproduction function are acquired from the storage unit 80 and the external device, and are expanded and displayed in the vertical direction (S18). S14 is skipped while there is no left / right instruction from the user (S12N).

  When the operation unit 40 obtains an up / down direction instruction from the user (S20Y), the effect processing unit 108 moves the folder icon in either the up / down direction in response to the instruction (S22), and the attention is immediately below the intersection area 76. The folder icon and the folder pasted image located in the area 77 are highlighted (S24), and the information 140 related to the folder is displayed on the right side (S26). S22 is skipped while there is no instruction in the vertical direction by the user (S20N).

  When the operation unit 40 acquires an instruction for selecting a folder by the user (S28Y), the effect processing unit 108 moves the folder pasted image from the folder icon in the right direction according to the instruction (S30), and relates to the selected folder. The content icon of the attached content item is expanded and displayed in the vertical direction (S32). Further, the content icon located in the second attention area 79 is highlighted, and the information 140 regarding each content item is displayed on the right side (S34). Until the user's instruction to select a folder is obtained, the processes of S12 to S26 are repeated (S28N).

  Until the operation unit 40 obtains a content reproduction determination instruction by the user, the processing of S12 to S34 is repeated (S36N). When the operation unit 40 obtains a content reproduction decision instruction (S36Y), the content control unit 106 enters the attention area 77. The reproduction of the highlighted content is started (S38). Further, the background generation unit 112 displays an effect having a visual effect that enters the heel side from the user's viewpoint according to the transition from the menu screen to the content reproduction screen (S40). When the operation unit 40 obtains an instruction to call the menu screen by the user during content reproduction (S42Y), the process jumps to S10 and executes the processes of S10 to S40 again. If there is no instruction to call the menu screen by the user, the content reproduction is continued (S42N). When the operation unit 40 obtains an instruction to stop the content reproduction by the user during the content reproduction, the content control unit 106 stops the content reproduction. (S44Y).

  As described above, the multimedia playback apparatus 20 according to the present embodiment displays a menu image composed of an array of playback functions and an array of folder icons on the menu screen 50. Although the function icon array 70 and the folder icon array 72 that are actually displayed are each in one row or one column, different folder icons or content icons corresponding to different playback functions are displayed one after another by scrolling up, down, left, or right. Therefore, it is possible to give the user a feeling as if many contents are arranged in a matrix over the entire screen. The user can select a content in such a manner as to focus on the desired content while freely moving a matrix in which a large number of contents are arranged. However, since the number of icons actually displayed on the screen is small, no complicated impression is given to the user.

  Further, when the folder icon is selected, the folder pasted image that has been displayed in a superimposed manner is pulled out from the folder icon, so that the user can be given a feeling of taking out a disc from a CD or DVD package in the real world.

  When the user selects a folder icon or selects an option menu display, the unselected icon is converted into an image so that it is not visually noticeable, and is displayed on the menu screen. Therefore, the user can easily recognize the hierarchy and operation selected by the user in the menu screen. In addition, when selecting a folder icon or displaying an option menu, other screen displays can be reduced or unfocused and displayed on the menu screen, allowing the user to feel the depth in the vertical axis direction of the screen. You can feel as if you are operating a menu in a virtual three-dimensional space.

  In addition, since the content item associated with the folder icon can be easily changed by switching the view, the user can search the content item to be reproduced from various points of view, thereby realizing a quicker and less stressful search.

  In the above, this invention was demonstrated based on the Example. This embodiment is an exemplification, and it will be understood by those skilled in the art that various modifications can be made to each component and combination of processing processes, and such modifications are within the scope of the present invention. Hereinafter, modifications will be described.

  In the embodiment, the menu screen is configured so that the intersecting region 76 is located immediately above the attention region 77. In the modified example, the menu screen is configured so that, for example, the intersection area 76 is positioned directly below or around the attention area 77 if the user can easily confirm the function icon while placing the viewpoint on the attention icon. May be.

  In the embodiment, the function icon array 70 and the folder icon array 72 are displayed on the menu screen 50 in the horizontal direction and the vertical direction, respectively. In a modification, the function icon array 70 and the folder icon array 72 may be arranged using the depth of the screen. For example, the function icon array 70 and the folder icon array 72 may be arranged so as to be pasted on a virtual spherical surface in the screen, and the icons rotate along the spherical surface in accordance with the user's up / down / left / right directions. Good. Alternatively, the icon located in the attention area is displayed so that it is closest to the screen along the vertical axis, and the other icons are displayed so that they are on the back side of the screen vertical axis. Accordingly, the icon moved to the attention area may be displayed in a manner that jumps forward. By combining the display mode with the depth of the function icon array 70 or the folder icon array 72 and the display mode for reducing or unfocusing other than the selected icon, a menu operation is performed in a virtual three-dimensional space. A feeling like being can be planted by the user.

  In the embodiment, the multimedia playback device 20 is configured such that the intersection area 76 and the attention area 77 are located near the center of the menu screen 50. In a modified example, the display position of the intersection area 76 and the attention area 77 may be set freely by the user.

  In the embodiment, the multimedia playback device 20 displays a menu screen for content playback instructions on the externally connected television receiver 30. In a modification, the multimedia playback device may be a portable composite device that includes a display that is integrated with the device. In addition, a multimedia playback device may be realized by causing a personal computer to execute a computer program that exhibits various functions described in the embodiments.

  20 multimedia playback device, 40 operation unit, 46 display output unit, 48 display control unit, 50 menu screen, 70 function icon array, 72 folder icon array, 78 content icon array, 80 storage unit, 96 playback screen generation unit, 110 Menu screen generation unit, 112 background generation unit, 120 folder icon, 122 folder pasted image.

Claims (9)

A device for displaying a menu screen on a content playback device,
A storage unit that stores data of function icons that symbolize functions that can be executed on the content reproduction apparatus, data of content icons that symbolize content items, and data of folder icons that contain at least one content icon When,
A display control unit that acquires data of a function icon, a content icon, and a folder icon from the storage unit, and generates image data of a menu screen that includes at least one each of the function icon, the content icon, and the folder icon;
A display output unit for outputting the image data of the menu screen to the content reproduction device;
An operation unit that accepts a selection operation by a user of the function icon, content icon, or folder icon on the menu screen displayed on the content reproduction device;
The display control unit displays at least a part of the content icons included in the corresponding folder so as to be superimposed on the folder icon for the folder icon containing the content icon, and the folder icon and the folder Other content icons and / or other folder icons not included in the
When the user selects the folder icon through the operation unit, the display control unit displays a content icon included in the folder corresponding to the folder icon in the vicinity of the folder icon ,
The display control unit, when displaying a content icon included in the folder icon in the vicinity of the folder icon, hides the content icon superimposed on the folder icon. Display device.   The menu screen display device according to claim 1, wherein the display control unit displays the content icons arranged in a first area on the menu screen.   3. The menu screen display device according to claim 2, wherein the display control unit displays the function icons arranged in a second area different from the first area on the menu screen. 4. .   4. A menu screen display device according to claim 1, wherein the folder icon is translucent. The display control unit arranges and displays the content icons included in the folder icon in a third area located in the vicinity of the folder icon and displays a predetermined number or more of contents in the folder corresponding to the folder icon. if it contains, menus according to any one according to a user operation of claims 1 to 4, characterized in that scroll display an array of content icons in the third region through the operation unit Screen display device. The display controller, according to any one of claims 1 to 5, characterized in that to display in the vicinity of the folder icon a common attribute as folder information between a plurality of content icons that are included in the Folder icon Menu screen display device. When the display control unit arranges and displays the content icons included in the folder icon in a third area located in the vicinity of the folder icon, the display control unit displays the folder icon and the content icons in the third area. The menu screen display device according to claim 5 , wherein the menu screen display device emphasizes and displays other icons. The display control unit highlights the folder icon and the content icon in the third area by displaying the folder icon and the content icon in the third area and other icons with different brightness. The menu screen display device according to claim 7 , wherein: A method for displaying a menu screen on a content playback device,
A step of reading from the memory function data that symbolizes a function that can be executed on the content reproduction apparatus, data of content icons that symbolize content items, and data of folder icons that contain at least one content icon When,
A menu screen that includes at least one each of the function icon, the content icon, and the folder icon, and the folder icon that includes the content icon is at least part of the content included in the corresponding folder. Display the icon superimposed on the folder icon, and generate image data for the menu screen that displays the folder icon and other content icons and / or other folder icons not included in the folder in the same arrangement And steps to
Outputting the image data of the menu screen to the content reproduction device;
Receiving a selection operation by the user of the function icon, content icon or folder icon on the menu screen displayed on the content playback device;
When the folder icon is selected by the user via a predetermined operation device, displaying a content icon included in the folder corresponding to the folder icon in the vicinity of the folder icon;
When displaying a content icon included in the folder icon in the vicinity of the folder icon, hiding the content icon superimposed on the folder icon;
A menu screen display method characterized by comprising:

Images