JP4271181B2 - User interface system and server for realizing user interface - Google Patents

Description

  The present invention relates to a user interface system, a user interface realization server, and a user interface method for realizing a user interface in an information processing system, and in particular, it is possible to link a virtual space screen (virtual screen) and an actual folder. The present invention relates to a user interface system, a user interface realization server, and a user interface method.

  In general, in various widely used operating systems (OS), files and data are managed using a concept called a folder. For example, when using a Windows (registered trademark) or Macintosh OS, the user performs operations such as saving, moving, and deleting files using an application (file management tool) such as Explorer.

Further, in order to allow the user to perform an intuitive operation, for example, Patent Document 1 discloses an actual television device, a video recorder, or the like in response to an operation on a virtual image space. A system in which a user interface for operating a device is realized is described.
Japanese Unexamined Patent Publication No. 7-98640

  A user who is familiar with an information processing apparatus such as a personal computer (PC) on a daily basis (hereinafter also referred to as an expert user) can easily manage files using an application such as Explorer. However, with the widespread use of information processing devices such as PCs, users who do not use information processing devices on a daily basis (hereinafter also referred to as non-PC users) use information processing devices rather than cases where skilled users use information processing devices. There are far more cases to use. Many non-PC users are unfamiliar with the operation of the information processing apparatus itself, and cannot easily manage files even when using an application such as Explorer.

  On the other hand, it is common to convert information such as photographs and video taken (for example, information on general entertainment items and life infrastructure) into electronic data, and the required file management level and file management of non-PC users. A gap with the level is starting to arise. Therefore, it is desirable to realize a user interface that allows simple file management even for non-PC users who are unfamiliar with the operation of the information processing apparatus. For example, it is desirable to replace a file or data with an image (for example, an icon) representing what is seen daily and use it for an input / output interface so that the file can be easily managed.

  Further, when an information processing apparatus such as a PC is shared between homes and friends, there is a case where it is desired to manage files by using a shared folder in which files and data are shared and stored. However, in recent years, there have been an increasing number of cases where family members and friends live apart. Therefore, family members and friends who are living separately exchange e-mails using an information processing device such as a PC connected to a communication network such as the Internet, or communicate using an electronic bulletin board system. There is. In addition, file management may be performed using a shared folder between family members and friends who are living separately.

  By using the system described in Patent Document 1, even if it is a non-PC user, it is possible to easily perform remote operation of a device such as a television device or a video recorder by operating in a virtual image space. However, file management cannot be easily performed by non-PC users. In addition, file management cannot be performed by sharing files and data between separated family members and friends.

  Therefore, the present invention provides a user interface system, a user interface realization server, a user interface method, and a user interface program that can easily manage files even for a user unfamiliar with the operation of the information processing apparatus. With the goal. It is another object of the present invention to provide a user interface system, a user interface realization server, a user interface method, and a user interface program that can share files and data between separated families and friends.

  The user interface system according to the present invention is a user interface system that uses a virtual space screen as a user interface screen, and is a location association means for associating a real folder storing files or data with a predetermined location on the virtual space screen. And a virtual space screen generating means for generating screen information of a virtual space screen in which an icon representing a file or data contained in a real folder as a concrete object is displayed at a location associated with the place associating means, Virtual space screen display means for displaying a virtual space screen based on the screen information generated by the virtual space screen generation means, and the location association means is an operation for newly creating, moving, changing or deleting a file or data Is performed, the file or data to be operated for new creation, movement, modification, or deletion The virtual space screen generation unit identifies which location on the virtual space screen corresponds to the actual folder to be stored, and the virtual space screen generation unit changes the icon display according to the location associated with the location correlation unit The screen information of the screen is regenerated, and the virtual space screen display means displays the virtual space screen based on the screen information regenerated by the virtual space screen generation means.

  The user interface system is a user interface system that uses a virtual space screen as a user interface screen, and a location association unit that associates a real folder storing files or data with a predetermined location on the virtual space screen; Virtual space screen generation means for generating screen information of a virtual space screen in which an icon representing a file or data contained in an actual folder as an object is displayed at a location associated with the location association means; Based on the screen information generated by the space screen generation means, a virtual space screen display means for displaying the virtual space screen, and a new creation, movement, change or deletion operation of the file or data on the virtual space screen, The position where the icon is newly created, moved, changed, or deleted is relative to any real folder. A real folder specifying means for specifying whether to store the file or data to be newly created, moved, or changed in the real folder specified by the real folder specifying means, or from the real folder specified by the real folder specifying means Real folder update means for deleting a file or data to be deleted may be provided.

  The user interface system is a user interface system that uses a virtual space screen as a user interface screen, and includes a user terminal and a user interface realization server that realizes the virtual space screen. Alternatively, a location associating means for associating a real folder for storing data with a predetermined place on the virtual space screen, and a location associating means for representing an icon that represents a file or data contained in the real folder as an object. The virtual space screen generating means for generating the screen information of the virtual space screen displayed at the location associated with the virtual space screen generating means, and transmitting the screen information of the virtual space screen generated by the virtual space screen generating means to the user terminal via the communication network Virtual space screen transmission means, and the user terminal Including virtual space screen display means for displaying a virtual space screen based on the screen information received from the user interface realization server, and the location associating means performs new creation, movement, change or deletion of files or data. The real folder storing the file or data to be newly created, moved, changed or deleted corresponds to a location on the virtual space screen, and the virtual space screen generating means The virtual space screen display unit regenerates the screen information of the virtual space screen whose icon display has been changed according to the location associated by the place association unit, and the virtual space screen display unit regenerates the screen information based on the screen information regenerated by the virtual space screen generation unit. The virtual space screen may be displayed.

  The user interface system is a user interface system that uses a virtual space screen as a user interface screen, and includes a user terminal and a user interface realization server that realizes the virtual space screen. Alternatively, a location associating means for associating a real folder for storing data with a predetermined place on the virtual space screen, and a location associating means for representing an icon that represents a file or data contained in the real folder as an object. The virtual space screen generating means for generating the screen information of the virtual space screen displayed at the location associated with the virtual space screen generating means, and transmitting the screen information of the virtual space screen generated by the virtual space screen generating means to the user terminal via the communication network Virtual space screen transmission means and files on the virtual space screen Or a real folder specifying means for specifying which real folder corresponds to the position where the icon is newly created, moved, changed or deleted when a new data creation, movement, change or deletion operation is performed. The file or data to be newly created, moved or changed is stored in the actual folder specified by the real folder specifying means, or the file or data to be deleted is deleted from the real folder specified by the real folder specifying means. The user terminal may be configured to include virtual space screen display means for displaying a virtual space screen based on the screen information received from the user interface realization server.

  The user interface system is a user interface system that uses a virtual space screen as a user interface screen, and a location association unit that associates a real folder storing files or data with a predetermined location on the virtual space screen; Virtual space screen generation means for generating screen information of a virtual space screen in which an icon representing a file or data contained in an actual folder as an object is displayed at a location associated with the location association means; Virtual space screen display means for displaying a virtual space screen based on the screen information generated by the space screen generation means may be provided.

  Virtual space table storage means for storing a virtual space correspondence table (address correspondence table) in which a real folder for storing files or data and a place on the virtual space screen is associated is provided, and the place association means includes a virtual space Based on the virtual space correspondence table stored in the table storage means, an actual folder storing files or data may be associated with a predetermined location on the virtual space screen.

  When a new creation, movement, change, or deletion operation of a file or data is performed, the location association unit is configured to create a virtual folder in which an actual file or data to be operated for new creation, movement, modification, or deletion is stored. The location on the space screen is identified, and the virtual space screen generation unit generates screen information of the virtual space screen in which the display of the file or data is changed according to the location associated with the location association unit. The virtual space screen display means may be configured to display the virtual space screen based on the screen information regenerated by the virtual space screen generation means.

  When a file or data is newly created, moved, changed, or deleted on the virtual space screen, the actual folder where the icon is newly created, moved, changed, or deleted is identified. To store the file or data to be newly created, moved, or changed in the real folder specified by the real folder specifying means, or to delete from the real folder specified by the real folder specifying means Real folder update means for deleting the target file or data may be provided.

  Virtual space table storage means for storing a virtual space correspondence table in which a real folder for storing files or data and locations on the virtual space screen are associated with each other is provided, and the real folder specifying means is stored in the virtual space table storage means. Based on the virtual space correspondence table, it may be configured to identify which real folder corresponds to the place where the file or data is newly created, moved, changed or deleted.

  The location association unit associates a link program for linking to an actual file or data with a predetermined location on the virtual space screen, and the virtual space screen generation unit follows the location associated with the location association unit. You may be comprised so that the screen information of the virtual space screen for displaying the link program contained in an actual folder may be produced | generated.

  When a link program is newly created, moved, changed, or deleted, the location association unit is configured to display the actual folder in which the link program to be operated for new creation, move, change, or delete is stored in the virtual space screen. The virtual space screen generation unit re-generates the screen information of the virtual space screen in which the display of the link program is changed according to the location associated by the location association unit, The space screen display means may be configured to display the virtual space screen based on the screen information regenerated by the virtual space screen generation means. By using a link program (such as a shortcut) instead of the file or data, the physical storage area for storing the actual file or data can be reduced.

  When a file or data is newly created, moved, changed, or deleted on the virtual space screen, the actual folder where the icon is newly created, moved, changed, or deleted is identified. Save the link program corresponding to the file or data to be newly created, moved, or changed in the real folder specified by the real folder specifying means and the real folder specified by the real folder specifying means. Real folder updating means for deleting a link program corresponding to a file or data to be deleted from a folder may be provided.

  An icon association unit that associates an actual file or data with an icon that is virtually displayed as an object that can be seen in daily life, and the virtual space screen generation unit includes a virtual that includes an icon associated with the icon association unit. You may be comprised so that the screen information of a space screen may be produced | generated.

  An icon table storage unit that stores an icon correspondence table in which a file or data type and an icon type are associated with each other is provided, and the icon association unit stores an actual file based on the icon correspondence table stored in the icon table storage unit. Or you may be set as the structure which matches data with an icon.

  When a plurality of files or a plurality of data are operated, an album realizing unit that realizes an album including a plurality of files or a plurality of data to be operated is provided, and the album realizing unit displays a virtual space screen of the plurality of files or a plurality of data to be operated. The virtual space screen generating means realizes an album by instructing the linking to the virtual space screen generating means, and the virtual space screen generating means displays an icon in which a plurality of files or data to be operated are linked according to the instruction of the album realizing means. The virtual space screen may be configured to generate screen information.

  A plurality of operation determination means for determining whether or not an operation of a plurality of files or a plurality of data having the same extension has been performed within a predetermined period, and the album realization means uses a plurality of operation determination means to When it is determined that the operation of the file or the plurality of data is performed within a predetermined period, the virtual space screen generation unit is instructed to link the operation target plurality of files or the plurality of data to the virtual space screen. It may be. If an album realization means that realizes the album function is provided, a collection of simple file data (multiple files and plural data with the same extension) can be made into an album, and the plural files and data can be easily and easily understood by the user. Can be viewed.

  When a file or data browsing operation is performed, an album display unit that collectively displays a plurality of files or a plurality of data linked to the virtual space screen as an album may be provided.

  When an e-mail transmission operation or an electronic bulletin board writing operation is performed, the virtual space screen generating means includes data identifying means for identifying that the operation target data is electronic mail data or electronic bulletin board data. When the e-mail data or the electronic bulletin board data is identified, the screen information of the virtual space screen that displays the identified electronic mail data or electronic bulletin board data at a predetermined location on the virtual space screen is generated. May be. If it is configured to store data such as e-mails and electronic bulletin boards in a predetermined folder location, the data of the electronic mails and electronic bulletin boards are automatically stored on the virtual space screen without being conscious of the user. Can be displayed in position.

  The data identification means may be configured to identify that the operation target data is e-mail data or electronic bulletin board data based on the protocol or extension of the operation target data.

  When electronic mail data or electronic bulletin board data is displayed on the virtual space screen, data storage means for storing electronic mail data or electronic bulletin board data in a predetermined actual folder may be provided.

  A user interface system according to the present invention is a user interface system that uses a virtual space screen as a user interface screen, and includes a user terminal and a user interface realizing server that realizes the virtual space screen. According to the operation instruction of the file or data from the user terminal, according to the location that the real folder storing the file or data is associated with a predetermined location on the virtual space screen and the location that is associated with the location association unit A virtual space screen generating means for generating screen information of a virtual space screen for displaying files or data contained in a real folder, and the virtual space screen generating information generated by the virtual space screen generating means via a communication network. To the user terminal via And a spatial screen transmission unit, the user terminal, based on the screen information received from the user interface implemented server, characterized in that it comprises a virtual space image display means for displaying a virtual space screen.

  A user interface realization server according to the present invention is a user interface realization server that realizes a virtual space screen as a user interface screen, and a location that associates a real folder storing files or data with a predetermined location on the virtual space screen Virtual space screen generation that generates screen information of the virtual space screen in which the association means and icons representing the files or data contained in the actual folder as objects are expressed in the locations associated with the location association means And a virtual space screen transmitting means for transmitting the screen information of the virtual space screen generated by the virtual space screen generating means to the user terminal via the communication network, and the location associating means is a new file or data When a create, move, change or delete operation is performed, a new create, move, change or delete operation is performed. The location of the actual folder in which the file or data to be manipulated is stored corresponds to the location on the virtual space screen, and the virtual space screen generation means follows the location associated with the location association means, The screen information of the virtual space screen in which the icon display is changed is generated again.

The user interface realization server is a user interface realization server that realizes a virtual space screen as a user interface screen, and corresponds to a location that associates a real folder storing files or data with a predetermined location on the virtual space screen. Attaching means,
Virtual space screen generation means for generating screen information of a virtual space screen in which an icon representing a file or data contained in an actual folder as an object is displayed at a location associated with the location association means; and a virtual space Virtual space screen transmission means for transmitting screen information of the virtual space screen generated by the screen generation means to the user terminal via the communication network, and operations for newly creating, moving, changing or deleting a file or data on the virtual space screen Is performed, the actual folder specifying means for specifying which real folder corresponds to the position where the icon is newly created, moved, changed or deleted, and the new actual folder specified by the real folder specifying means. Save the file or data to be created, moved or changed, or delete it from the real folder specified by the real folder specifying means. It may be configured to include the reality folder update means that you want to delete the work object of files or data.

  Further, the user interface realization server is a user interface realization server that uses a virtual space screen as a user interface screen, and in accordance with a file or data operation instruction from a user terminal, a real folder for storing a file or data is virtually A virtual for generating screen information of a virtual space screen for displaying a file or data included in an actual folder according to a location associated with a predetermined location on the space screen and a position associated with the location associated device You may comprise so that a space screen production | generation means and the virtual space screen transmission means which transmits the screen information of the virtual space screen which the virtual space screen production | generation means produced | generated to the user terminal via a communication network may be provided.

  A user interface method according to the present invention is a user interface method that uses a virtual space screen as a user interface screen, the step of associating a real folder storing files or data with a predetermined location on the virtual space screen, Based on the generated screen information, the step of generating screen information of a virtual space screen in which icons representing the files or data contained in the folder are displayed in places associated with the location association means, and the generated screen information When a step for instructing display of the virtual space screen and an operation for newly creating, moving, changing or deleting a file or data are performed, the file or data to be newly created, moved, changed or deleted is stored. Step to identify where the real folder corresponds to the virtual space screen And regenerating the screen information of the virtual space screen whose file or data display has been changed according to the specified location, and displaying the virtual space screen based on the regenerated screen information. Features.

  The user interface method is a user interface method that uses a virtual space screen as a user interface screen, the step of associating a real folder storing files or data with a predetermined location on the virtual space screen, Based on the generated screen information, the step of generating the screen information of the virtual space screen in which the icon representing the file or data contained in the folder as an object is displayed in the location associated with the location association means, When a step of instructing display of the virtual space screen and a new creation, movement, change or deletion operation of a file or data are performed, the file or data to be newly created, moved, changed or deleted is stored. Steps to identify where the real folder corresponds on the virtual space screen And regenerating screen information of the virtual space screen whose file or data display has been changed according to the specified location, and instructing display of the virtual space screen based on the regenerated screen information. It may be configured.

  The user interface method is a user interface method using a virtual space screen as a user interface screen, and a step of associating a real folder storing files or data with a predetermined location on the virtual space screen, Generating virtual space screen information for displaying the files or data contained in the actual folder according to the location, and displaying the virtual space screen based on the generated screen information. It may be configured.

  When a plurality of files or a plurality of data are operated, a step for instructing to link the plurality of files or a plurality of data to be operated to the virtual space screen, and an icon for linking the plurality of files or a plurality of data to be operated according to the instructions To generate an album including a plurality of files or data to be operated, by generating screen information of a virtual space screen on which is displayed.

  The user interface method according to the present invention is a user interface method using a virtual space screen as a user interface screen, and the user interface realizing server that realizes the virtual space screen follows a file or data operation instruction from the user terminal. A step of associating a real folder storing files or data with a predetermined location on the virtual space screen, and the user interface realizing server displaying the file or data contained in the real folder according to the associated location Generating screen information of the virtual space screen, a step of transmitting the screen information of the generated virtual space screen to the user terminal via the communication network, and a user terminal of the user interface realizing server Based on et received screen information, characterized by comprising a step of displaying a virtual space screen.

  According to the present invention, an actual folder is associated with a predetermined location on the virtual space screen, and a virtual space screen is generated according to the associated location. Then, the generated virtual space screen is displayed. Therefore, the user can be provided with a virtual space screen that is a concrete representation of a file or data that is originally invisible as a user interface screen. Therefore, even a user unfamiliar with the operation of the information processing apparatus can easily manage files.

  For example, as a user interface, a virtual home in which files and data are expressed as objects is realized. In this virtual home, all files and data can be represented by things that are familiar in daily life such as space, information, things, and shapes. Normally, invisible data is made concrete and expressed on the virtual space screen, so that a complicated file operation can be simplified for a non-PC user who is unfamiliar with the operation.

  In addition, according to the present invention, in order to link the operation on the virtual space screen with the actual file operation, the location corresponding to the link between the address (location) on the virtual space screen and the address in the real space is supported. Attaching means (address management unit). The location association means (address management unit) has the file name and the actual folder address as the real space information, and holds the image icon type, the location address on the virtual screen, and the position information on the virtual screen as the virtual space screen information. It can be centrally managed.

Embodiment 1 FIG.
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.

  The user interface system according to the present embodiment concretely represents a file or data (including a link program (for example, a shortcut) for linking to an actual file or data) that is originally invisible as a user interface. A virtual home that is expressed in a simple manner is realized. Specifically, a virtual screen including an icon (hereinafter referred to as “icon”) that represents a file or data as an object is displayed by the user interface system. That is, the user interface system according to the present embodiment described below realizes a system for displaying a virtual screen (virtual space screen) as a user interface screen and performing file management.

  In this embodiment, as an example, a case where a virtual home is realized and file management within a family is performed will be described. However, an application example of a user interface system is not limited to the case shown in this embodiment. . For example, the user interface system may be applied when file management is performed between friends of a predetermined group.

  FIG. 1 is a block diagram showing an example of the configuration of a virtual home implementation system (user interface system) according to the present invention. Specifically, the virtual home realization system is realized using an information processing apparatus such as a personal computer. As shown in FIG. 1, the virtual home realization system includes a virtual screen display unit 201, a database 202, a virtual screen creation unit 203, an album function unit 204, a mail / bulletin board automatic processing unit 205, an address management / data determination unit 206, a virtual A screen correspondence table 207, an image data / icon list 208, an address correspondence table 209, and an image icon assignment table 210 are included.

  Specifically, the virtual screen display unit 201 is realized by a CPU of an information processing device that operates according to a control program and a display device such as a display device. The virtual screen display unit 201 has a function of displaying a virtual screen on a display device in accordance with the screen information created by the virtual screen creation unit 203. In addition, the virtual screen display unit 201 has a function of determining whether or not the position of the icon on the virtual screen has moved according to the operation of the user (in this example, a family member).

  Specifically, the database 202 is a database device such as a magnetic disk device or an optical disk device. The database 202 stores various files and data (including link programs (for example, shortcuts)) shared among family members. In the present embodiment, folders are formed in the database 202 according to a predetermined hierarchical structure. Each folder stores images, document files, and the like. Each folder also stores e-mail, electronic bulletin board data, and the like.

  Specifically, the virtual screen creation unit 203 is realized by a CPU of an information processing apparatus that operates according to a control program. The virtual screen creation unit 203 has a function of generating screen information for displaying a virtual screen in accordance with an instruction from the address management / data determination unit 206. In the present embodiment, the virtual screen creation unit 203 uses the image data and icons included in the image data / icon list 208 to generate screen information of the virtual screen.

  Specifically, the album function unit 204 is realized by a CPU of an information processing apparatus that operates according to a control program. When the album function unit 204 performs an operation for moving or saving a plurality of files or a plurality of data (including an operation of a link program (for example, a shortcut)) in the same time period (for example, within a predetermined time), And a function of generating an album that enables batch editing or batch browsing of a plurality of data (for example, images). In this case, for example, the album function unit 204 instructs the virtual screen creation unit 203 to generate a virtual screen in which a plurality of files and data are linked on the virtual screen. The virtual screen creation unit 203 generates a virtual screen in which a plurality of files and a plurality of data are linked in accordance with an instruction from the album function unit 204, thereby realizing automatic album generation.

  Specifically, the mail / bulletin board automatic processing unit 205 is realized by a CPU of an information processing apparatus that operates according to a control program. The mail / bulletin board automatic processing unit 205 automatically selects a location address on a predetermined virtual screen indicating the location on the virtual screen for the data of the electronic mail or the bulletin board among the data moved or stored by the user. The function to be assigned to is provided. In this case, the virtual screen creation unit 203 displays e-mail data and bulletin board data icons at predetermined locations on the virtual screen according to the location address on the virtual screen automatically assigned by the mail / bulletin board automatic processing unit 205. The screen information of the virtual screen is generated. The mail / bulletin board automatic processing unit 205 has a function of automatically storing e-mail and bulletin board data in a predetermined folder (actual folder) of the database 202.

  Specifically, the address management / data discrimination unit 206 is realized by a CPU of an information processing apparatus that operates according to a control program. The address management / data determination unit 206 has a function of managing each file and data stored in the database 202. Further, the address management / data discrimination unit 206 uses the address (real folder address) of the actual folder (folder on the database 202) for storing files or data as the location address (location on the virtual screen). Address).

  In the present embodiment, the address management / data determination unit 206 has a function of collectively assigning management information for managing each file and data to each file and data. For example, the address management / data determination unit 206 assigns an actual folder address indicating an actual storage destination or a location address on the virtual screen as management information. Further, the address management / data determination unit 206 assigns, as management information, extension information indicating an extension of each file or data and icon information indicating an icon assigned to each file or data. The address management / data determination unit 206 also displays position information (for example, position information and position range on the screen) on the virtual screen indicating the position of each file or data icon on the virtual screen (screen representing the virtual home). Is granted. Further, the address management / data determination unit 206 stores each file and data in the database 202 according to the management information given at once.

  Further, the address management / data determination unit 206 is a file or data type (for example, an image, e-mail data, or electronic bulletin board data based on the protocol or extension of each file or data. A function of identifying

  The virtual home correspondence table 207 is a table in which location addresses on the virtual screen are associated with position information on the virtual screen. Specifically, the virtual screen correspondence table 207 is stored in a storage device such as a magnetic disk device or a memory.

  The image data / icon list 208 is a list including image data and icons used for the virtual screen. Specifically, the image data / icon list 208 is stored in a storage device such as a magnetic disk device or a memory.

  The address correspondence table 209 is a table including an actual folder address and a location address on the virtual screen in association with each other. Specifically, the address correspondence table 209 is stored in a storage device such as a magnetic disk device or a memory.

  The image icon assignment table 210 is a table including icons assigned to files and data (for example, image data). In the present embodiment, the image icon assignment table 210 includes file and data types (for example, image data (extension is jpg)) and icon types (for example, camera icons) in association with each other. Specifically, the image icon assignment table 210 is stored in a storage device such as a magnetic disk device or a memory.

  In the present embodiment, it is assumed that various control programs for realizing a virtual home are stored as a user interface in the storage device included in the information processing apparatus that implements the virtual home implementation system. Specifically, the storage device included in the information processing apparatus includes, for example, an actual folder that stores files or data in a computer (information processing apparatus, specifically, a CPU of the information processing apparatus) on the virtual space screen. A process for associating with a predetermined location, a process for generating screen information of a virtual space screen for displaying an icon in which a file or data contained in a real folder is concretely expressed and displayed in an associated place, and generation Various control programs such as a user interface realization program for executing processing for displaying a virtual space screen are stored based on the screen information.

  Next, the operation will be described. FIG. 2 is a flowchart illustrating an example of processing for performing file management in accordance with a user operation on a virtual screen. When a member (user) of a family performs a management operation of a file or data shared between family members, first, an operation unit (for example, a keyboard, a mouse, etc.) provided in the information processing apparatus is operated, An instruction to start virtual home software, which is software for performing file operations on the virtual screen, is given (step S101). Then, the information processing apparatus activates the virtual home software in accordance with the user's activation operation.

  Further, the virtual screen display unit 201 of the virtual home realization system displays the virtual screen on the display device (step S102). In this case, for example, when the virtual home software is activated, the virtual screen creation unit 203 performs virtual processing based on the management information from the address management / data determination unit 206 and the image data and icons included in the image data / icon list 208. Generate screen information for the screen (initial screen). Then, the virtual screen display unit 201 displays a virtual screen according to the screen information generated by the virtual screen creation unit 203.

  FIG. 3 is an explanatory diagram illustrating an example of a virtual screen displayed by the virtual home implementation system. As shown in FIG. 3, the virtual screen display unit 201 displays a display screen that virtually represents a house where a family lives as a virtual screen with a three-dimensional image. The user performs operations for managing files and data shared by family members by performing a moving operation of icons (including shortcut icons) and the like from the virtual screen shown in FIG. In other words, file management can be easily performed by performing an operation as if the bag is moving an object in the residence.

  As shown in FIG. 3, the virtual screen display unit 201 displays a virtual screen field 31, an information field 32, a switching field 33, and a selection field 34. The virtual screen field 31 is a field for displaying a virtual screen representing a virtual house. The information field 32 is a field for displaying information on a file or album selected by the user. The switching field 33 is a field for performing a switching operation of a folder displayed in the selection field 34. The selection field 34 displays the information selected in the switching field 33. When “external input” is selected, the selection field 34 displays a folder in the external device and a file stored in the folder. When “virtual screen” is selected, a location (for example, “desk”) on the virtual screen and an icon linked to the location are displayed. The “linked icon” here refers to an icon that is displayed at a location on the virtual screen (for example, an icon that is virtually placed on the desk) or an icon that is not displayed on the screen but is associated with it. Icon (for example, an icon virtually stored in the bookshelf). A file may be displayed instead of an icon.

  In this embodiment, the user can also manage files using a file management tool such as Explorer. In this embodiment, when a file move or delete operation on an actual folder is performed using a file management tool, the operation content is reflected in the virtual space, and the position of the icon on the virtual screen according to the operation content Is changed. In addition, when an icon movement operation is performed on the virtual screen, a file is moved or deleted on an actual folder according to the operation content.

  Further, the user connects an external device such as a digital camera to the virtual home realization system in order to import files and data (step S103). In this case, for example, the user connects a cable for importing files and data from the digital camera to the information processing apparatus to the output terminal of the digital camera and to the USB terminal of the information processing apparatus. When the virtual home implementation system is implemented using a television receiver, the user connects the digital camera to the set top box of the television receiver.

  When an external device such as a digital camera is connected, the address management / data determination unit 206 detects an external input (external device is connected) (step S104). Further, the address management / data discrimination unit 206 detects an accessible external folder based on the detected external input. The address management / data discrimination unit 206 then instructs the virtual screen display unit 201 to display the screen of the external folder based on the external input (step S105). Then, the virtual screen display unit 201 displays a selection field including the file stored in the folder in the external device shown in FIG. 3 on the virtual screen in accordance with the instruction of the address management / data determination unit 206 (step S106). .

  Note that the virtual screen display unit 201 may display a selection field including the file name of each file in the folder of the external device, as shown in FIG. Further, as shown in FIG. 3B, the virtual screen display unit 201 may display a selection field for displaying each file in the external folder as a small image such as a thumbnail.

  In this embodiment, as an example, a case where a file in an external folder of an external device such as a digital camera is moved or saved is described. However, an icon on the virtual screen is moved, edited, or deleted. The operation for this is the same. FIG. 4 is an explanatory diagram illustrating another example of the virtual screen displayed by the virtual home implementation system. When an icon on the virtual screen is operated, as shown in FIG. 4, the virtual home display unit 201 displays a selection field including an icon in a place on the virtual screen (in this example, “bookcase”) on the virtual screen. indicate. Then, the user selects a file to be moved, saved, or deleted from the selection field on the virtual home screen shown in FIG.

  When the user wants to save a file or data in an external device such as a digital camera in the virtual home realization system, the user operates the information processing apparatus to select a file to be saved. For example, as shown in FIG. 3, the user selects a file “aaa.jpg” to be saved by performing a mouse click or the like from a selection field on the virtual screen.

  In addition, the user operates the information processing apparatus to designate the storage destination of the file to be stored (step S107). For example, as illustrated in FIG. 5, the user selects “move selected file to virtual screen” by performing a mouse click or the like from a selection field on the virtual screen. Then, as shown in FIG. 6, the user designates a place (for example, “desk”) on the virtual screen where the file is to be saved by performing a mouse click or the like. If all the files in the external folder are to be saved, the user selects “Move all to virtual screen” by clicking the mouse from the selection field of the virtual screen as shown in FIG. To do.

  The address management / data determination unit 206 determines which virtual screen location the position on the virtual screen selected by the user corresponds to (step S108). In this case, the address management / data determination unit 206 determines which virtual screen location corresponds to the selected position on the screen based on the virtual screen correspondence table 207 stored in the storage device. For example, the address management / data determination unit 206 specifies that the selected position (X, Y) = (1240, 750) on the screen corresponds to the place “¥ living ¥ desk”.

  Also, the virtual home realization system displays on the virtual screen whether or not the file can be saved in the designated location (step S109). Then, the user operates the information processing apparatus to input an instruction indicating that the file may be saved in the designated location according to the screen display. If it is acceptable to save, the user inputs “Yes” according to the screen display. If “No” is input, the virtual home implementation system performs the storage location designation process again according to the user's operation.

  The address management / data determination unit 206 determines an icon corresponding to the file to be saved (step S110). In this case, the address management / data determination unit 206 determines an icon corresponding to the file to be saved based on the image icon assignment table 210 stored in the storage device included in the information processing apparatus. For example, the address management / data determination unit 206 identifies the corresponding image icon “camera icon” from the image icon assignment table 210 based on the extension “.jpg” of the file to be saved.

  Further, the virtual home realization system displays on the virtual screen whether or not the file can be saved using the specified icon (step S111). Then, the user operates the information processing apparatus to input an instruction to save the file using the specified icon according to the screen display. For example, as shown in FIG. 6, the virtual home realization system displays whether or not a “camera icon” may be displayed on the virtual screen. Then, the user inputs “Yes” according to the screen display. If “No” is input, the virtual home implementation system performs icon designation processing in accordance with the user's operation.

  The address management / data determination unit 206 determines to which real folder the location on the virtual screen identified in step S108 corresponds (step S112). In this case, the address management / data determination unit 206 determines to which real folder address the specified location address on the virtual screen corresponds, based on the address correspondence table 209 stored in the storage device. For example, the address management / data discrimination unit 206 specifies that the specified location address “¥ living ¥ desk” on the virtual screen corresponds to the actual folder address “C: \ myhome \ desk”.

  The address management / data discrimination unit 206 saves the file to be saved in the designated folder, and executes address management according to the save destination (step S113). In this case, the address management / data determination unit 206 stores the file to be stored in the actual folder identified in step S112. For example, the address management / data discriminating unit 206 stores the file “aaa.jpg” to be stored in the folder whose actual folder address in the database 202 is “C: \ myhome \ desk”.

  In addition, the address management / data determination unit 206 passes each piece of management information specified for the stored file to the virtual screen creation unit 203 (step S114). For example, the address management / data discriminating unit 206 determines the specified actual folder address “C: \ myhome \ desk”, the location address “¥ living ¥ desk” on the virtual screen, the icon “camera icon”, the screen position (X , Y) = (1240, 750) is passed to the virtual screen creation unit 203.

  The virtual screen creation unit 203 creates screen information for displaying a virtual screen based on the management information from the address management / data determination unit 206 (step S115). In this case, the virtual screen creation unit 203 creates screen information of the virtual screen using image data and icons included in the image data / icon list 208.

  Then, the virtual screen display unit 201 updates the virtual screen displayed on the display device based on the screen information recreated by the virtual screen creation unit 203. In this case, the virtual screen display unit 201 displays a “camera icon” at a designated position on the virtual screen (steps S116 and S117). The user can confirm that the selected file is virtually stored on the virtual home by looking at the virtual screen.

As described above, according to the present embodiment, the virtual home implementation system associates an actual folder on the database 202 with a location on the virtual screen. Then, a virtual screen is generated and displayed according to the associated position. Therefore, as a user interface, it is possible to provide a user with a virtual home in which files and data that are originally invisible are expressed as objects. Therefore, even a user who is not familiar with the operation of an information processing apparatus such as a PC can easily manage files.
Embodiment 2. FIG.
Next, a second embodiment of the present invention will be described with reference to the drawings.

  FIG. 7 is a block diagram illustrating another example of the configuration of the user interface system. In this embodiment, when a family lives away for reasons such as single assignment or child advancement to a university, a virtual home that is a user interface that virtually represents the interior of a residence using a user interface system A case where the above is realized will be described. In the present embodiment, the family shared folder and the family shared space are linked, and files and data are shared between family members living apart from each other, and file management is performed by a simple method.

  As shown in FIG. 7, the virtual home realization system (user interface system) includes a plurality of client terminals 10 and a virtual home realization server 20. Each client terminal 10 and the virtual home realization server 20 are connected via a communication network 100 such as the Internet.

  Specifically, the client terminal 10 is an information processing apparatus such as a personal computer. The client terminal 10 is a terminal used by each member of the family (parents, children, and grandparents). In the present embodiment, one or more members of the family are living in a remote location, and the client terminal 10 exists at each location where the family member lives (for example, a single assignment destination or advancement destination). To do. The client terminal 10 is equipped with a browser and a mailer and has a function of connecting to a network.

  In the present embodiment, the client terminal 10 transmits various data to the virtual home realization server 20 via the communication network 100 in accordance with a user input operation. For example, when a file or icon movement operation is performed by the user, the client terminal 10 uses the virtual home realization server 20 to store the position information (for example, the position (X, Y) on the virtual screen) of the moved file or icon. Send to. Further, the client terminal 10 receives screen information (for example, Web page information) of a virtual screen, which is a user interface, from the virtual home realization server 20 via the communication network 100. Further, the client terminal 10 displays a virtual screen on a display device such as a display device according to the received screen information.

  Further, the client terminal 10 has a function of transmitting / receiving electronic mail via the communication network 100. The client terminal 10 has a function of writing data to the electronic bulletin board via the communication network 100 using the electronic bulletin board system.

  Specifically, the virtual home realization server 20 is an information processing apparatus such as a WWW server. The virtual home realization server 20 is operated by, for example, a service provider that provides a service that implements a user interface on a virtual screen (also referred to as a virtual home provision service).

  FIG. 8 is a block diagram showing an example of the configuration of the virtual home realization server (server storage unit) 20. As shown in FIG. 8, the virtual home realization server 20 includes a virtual screen display instruction unit 201A, a database 202, a virtual screen creation unit 203, an album function unit 204, a mail / bulletin board automatic processing unit 205, and an address management / data determination unit 206. A virtual screen correspondence table 207, an image data / icon list 208, an address correspondence table 209, an image icon assignment table 210, and a client data input / output unit 211.

  Specifically, the virtual screen display instruction unit 201A is realized by a CPU of an information processing apparatus that operates according to a control program. The virtual screen display instruction unit 201A has a function of determining whether the position of the file or icon displayed by the client terminal 10 has moved based on the icon position information received by the client data input / output unit 211. The virtual screen display instruction unit 201 </ b> A has a function of instructing the client data input / output unit 211 to transmit screen information of the user interface to the client terminal 10.

  Specifically, the database 202 is a database device such as a magnetic disk device or an optical disk device. The database 202 stores various files and data shared among family members. In the present embodiment, folders are formed in the database 202 according to a predetermined hierarchical structure. For example, the database 202 stores images and document files in each folder. In addition, for example, the database 202 stores e-mail and bulletin board data in each folder.

  Specifically, the virtual screen creation unit 203 is realized by a CPU of an information processing apparatus that operates according to a control program. The virtual screen creation unit 203 has a function of generating screen information for displaying a virtual screen in accordance with an instruction from the address management / data determination unit 206. In the present embodiment, the virtual screen creation unit 203 uses the image data and icons included in the image data / icon list 208 to generate screen information of the virtual screen.

  Specifically, the album function unit 204 is realized by a CPU of an information processing apparatus that operates according to a control program. The album function unit 204 batch edits or batches a plurality of files and a plurality of data (for example, images) when a plurality of files and a plurality of data are moved or stored in the same time period (for example, within a predetermined time). It has a function to generate albums that can be viewed. In this case, for example, the album function unit 204 instructs the virtual screen creation unit 203 to generate a virtual screen in which a plurality of files and data are linked on the virtual screen. Then, according to the instruction, the virtual screen creation unit 203 generates a virtual screen in which a plurality of files and a plurality of data are linked, whereby automatic album generation is realized.

  Specifically, the mail / bulletin board automatic processing unit 205 is realized by a CPU of an information processing apparatus that operates according to a control program. The mail / bulletin board automatic processing unit 205 automatically selects a location address on a predetermined virtual screen indicating the location on the virtual screen for the data of the electronic mail or the bulletin board among the data moved or stored by the user. The function to be assigned to is provided. In this case, the virtual home screen creation unit 203 displays e-mail data and bulletin board data icons at predetermined locations on the virtual screen according to the location address on the virtual screen automatically assigned by the mail / bulletin board automatic processing unit 205. The screen information of the virtual screen to be generated is generated. The mail / bulletin board automatic processing unit 205 has a function of automatically storing e-mail and bulletin board data in a predetermined folder (actual folder) of the database 202.

  Specifically, the address management / data discrimination unit 206 is realized by a CPU of an information processing apparatus that operates according to a control program. The address management / data determination unit 206 has a function of managing each file and data stored in the database 202.

  In the present embodiment, the address management / data determination unit 206 has a function of collectively assigning management information for managing each file and data to each file and data. For example, the address management / data determination unit 206 assigns an actual folder address indicating an actual storage destination or a location address on the virtual screen as management information. Further, the address management / data determination unit 206 assigns, as management information, extension information indicating an extension of each file or data and icon information indicating an icon assigned to each file or data. The address management / data determination unit 206 also assigns position information on the virtual screen (for example, position information or position range on the screen) indicating the position of each file or data icon on the virtual screen. Further, the address management / data determination unit 206 stores each file and data in the database 202 according to the management information given at once.

  Further, the address management / data determination unit 206 is a file or data type (for example, an image, e-mail data, or electronic bulletin board data based on the protocol or extension of each file or data. A function of identifying

  The virtual screen correspondence table 207 is a table including a location address on the virtual screen and position information on the virtual screen in association with each other. Specifically, the virtual screen correspondence table 207 is stored in a storage device such as a magnetic disk device or a memory.

  The image data / icon list 208 is a list including image data and icons used for the virtual screen. Specifically, the image data / icon list 208 is stored in a storage device such as a magnetic disk device or a memory.

  The address correspondence table 209 is a table including an actual folder address and a location address on the virtual screen in association with each other. Specifically, the address correspondence table 209 is stored in a storage device such as a magnetic disk device or a memory.

  The image icon assignment table 210 is a table including icons assigned to files and data (for example, image data). In the present embodiment, the image icon assignment table 210 includes file and data types (for example, image data (extension is jpg)) and icon types (for example, camera icons) in association with each other. Specifically, the image icon assignment table 210 is stored in a storage device such as a magnetic disk device or a memory.

  Specifically, the client data input / output unit 211 is realized by a network interface unit of the information processing apparatus. The client data input / output unit 211 has a function of receiving various data from the client terminal 10 via the communication network 100. For example, the client data input / output unit 211 receives icon position information from the client terminal 10. Further, the client data input / output unit 211 has a function of transmitting screen information of the user interface to the client terminal 10 via the communication network 100 in accordance with an instruction from the virtual screen display instruction unit 201A.

  Next, the operation will be described. FIG. 9 is a flowchart illustrating another example of processing for managing files in accordance with a user operation on a virtual screen. When any member (user) of the family wants to perform a management operation of files and data shared among the family members, first, the client terminal 10 is operated to perform a virtual screen display operation. In this case, the client terminal 10 transmits a virtual screen transmission request to the virtual home realization server 20 via the communication network 100 in accordance with a user operation.

  Upon receiving the virtual screen transmission request, the virtual screen creation unit 203 of the virtual home realization server 20 is based on the management information from the address management / data discrimination unit 206 and the image data and icons included in the image data / icon list 208. To generate a virtual screen. In addition, the virtual screen display instruction unit 201A instructs the client data input / output unit 211 to transmit the virtual screen generated by the virtual screen creation unit 203 to the client terminal 10. Then, the client data input / output unit 211 transmits a virtual screen to the client terminal 10 via the communication network 100 in accordance with an instruction from the virtual screen display instruction unit 201A. Then, the client terminal 10 displays the virtual screen received from the virtual home realization server 20 on a display device such as a display device.

  FIG. 10 is an explanatory diagram illustrating an example of a display screen of a virtual screen displayed by the client terminal 10. As illustrated in FIG. 10, the client terminal 10 displays a display screen that virtually represents a house in which a family lives in a three-dimensional manner. The user performs an operation of managing files and data shared by family members by performing an icon moving operation from the virtual screen shown in FIG. In other words, file management can be easily performed by performing an operation as if the bag is moving an object in the residence.

  When the user wants to move an icon on the virtual home, the user operates the client terminal 10 to instruct to move the icon to be moved. In the present embodiment, the user selects the camera icon on the virtual home shown in FIG. 10, and instructs to move from the desk position to the bookshelf position. The client terminal 10 selects a camera icon according to the user's operation, and moves from the desk position to the bookshelf position (step S201). In addition, the client terminal 10 transmits information indicating that the camera icon has been moved to the virtual home realization server 20 via the communication network 100.

  The client data input / output unit 211 of the virtual home realization server 20 receives information indicating that the camera icon has been moved from the client terminal 10 via the communication network 100. Then, based on the information received by the client data input / output unit 211, the virtual screen display instruction unit 201A outputs notification information indicating that the camera icon has been moved on the virtual screen to the virtual screen creation unit 203 (step) S202).

  The virtual screen creation unit 203 performs camera icon movement processing according to the notification information from the virtual screen display instruction unit 201A (step S203). In this case, the virtual screen creation unit 203 inquires of the address management / data discrimination unit 206 which icon and file (data) in the virtual screen and the actual folder configuration correspond to the camera icon to be moved.

  The address management / data determination unit 206 specifies which icon and file the camera icon to be moved corresponds to in response to a request from the virtual screen creation unit 203. For example, the address management / data determination unit 206 specifies which icon and file the camera icon to be moved corresponds to based on the virtual screen correspondence table 207, the address correspondence table 209, and the image icon assignment table 210. In the present embodiment, the address management / data discrimination unit 206 identifies that the camera icon to be moved corresponds to the folder address in the actual folder structure corresponding to the file in “C \ myhome \ desk \”, and the identification result Is returned to the virtual screen display instruction unit 201A. Further, the address management / data determination unit 206 specifies that the camera icon to be moved corresponds to the icon of the place “¥ living ¥ desk” on the virtual screen, and returns the specification result to the virtual screen display instruction unit 201A.

  Further, based on the information received from the client terminal 10, the virtual screen display instruction unit 201A outputs notification information indicating that the camera icon has been moved to a specific screen position range to the address management / data determination unit 206 ( Step S204).

  The address management / data determination unit 206 determines which virtual screen location corresponds to the specific image position range to which the camera icon is moved (step S205). In this case, the address management / data discriminating unit 206 determines to which virtual screen the position range on the moved screen corresponds to the virtual screen correspondence table 207 stored in the storage device. . For example, the address management / data determination unit 206 specifies that the moved position range on the screen corresponds to the place “¥ living ¥ book shelf”.

  Further, the address management / data determination unit 206 changes the actual folder storing the file to be moved (step S206). In step S206, for example, the address management / data determination unit 206 determines to which real folder the location on the virtual screen identified in step S205 corresponds. In this case, the address management / data determination unit 206 determines which real folder corresponds to the specified location on the virtual screen based on the address correspondence table 209 stored in the storage device. For example, the address management / data determination unit 206 specifies that the specified location “¥ living ¥ bookshelf” on the virtual screen corresponds to the actual folder “C: \ myhome \ shodana”. The address management / data determination unit 206 moves the file corresponding to the camera icon from the currently stored real folder “C: \ myhome \ desk” to the folder “C: \ myhome \ shodana”.

  Further, the address management / data discrimination unit 206 executes address management according to the contents after the actual folder is changed (step S207). In this case, for example, the address management / data determination unit 206 reflects the contents of the actual folder change on the virtual screen. For example, the address management / data determination unit 206 specifies a location on the virtual screen corresponding to the actual folder after the movement based on the address correspondence table 209. Then, the address management / data discrimination unit 206 changes the location of the icon of the camera icon to the identified location on the virtual screen.

  When the address management process is executed, the address management / data determination unit 206 outputs notification information (including management information) indicating that the address of the file to be moved has been changed to the virtual screen creation unit 203 (step S208). . Then, based on the management information from the address management / data discrimination unit 206, the virtual screen creation unit 203 recreates the screen information of the icon of the file to be moved on the virtual screen (step S209). In this case, the virtual screen creation unit 203 creates screen information of the virtual screen using the image data included in the image data / icon list 208.

  In the present embodiment, when the storage destination of a file or data is “desk” or the like, this indicates that an object (a virtual representation of an icon) is visible on the virtual screen. On the other hand, when the storage destination is “book shelf” or “warehouse”, it indicates that the object is put in a drawer or the like and cannot be seen. For example, when a user wants to place a file he / she wants to see on the virtual screen at any time, the user performs an operation of placing an icon at the position of “desk” or “table”. Also, if you want to place a file on your virtual screen that you rarely see, you can put the icons in the “bookcase” or “warehouse”.

  In this embodiment, since the operation of putting the camera icon on the “bookcase” is performed, in step S209, the virtual screen creation unit 203 creates a virtual screen in which the camera icon is deleted from the virtual screen.

  Note that it may be possible to individually set in advance whether the object (file or icon) is visible or invisible when it is moved to any position on the virtual screen.

  The virtual screen display instruction unit 201A instructs the client data input / output unit 211 to transmit a virtual screen from which the camera icon has been deleted (step S210). Then, the client data input / output unit 211 transmits the virtual screen created by the virtual screen creation unit 203 to the client terminal 10 via the communication network 100. Then, the client terminal 10 displays a virtual screen from which the camera icon is deleted based on the received virtual screen (step S211).

  In addition, the user can perform file management using a file management tool such as Explorer instead of operating from the virtual screen. In this case, when an actual file move operation or save operation is performed using the file management tool, the operation content is reflected in the virtual space, and the position of the icon on the virtual screen is changed according to the operation content.

  FIG. 11 is a flowchart illustrating an example of processing for performing file management in accordance with an operation using the file management tool. The user operates the client terminal 10 and issues a file move instruction and a save instruction using the file management tool. In the present embodiment, the user instructs to save the file “aaa.jpg” in the actual folder “C: \ myhome \ desk \” using the file management tool. Then, the client terminal 10 transmits a file save instruction to the virtual home realization server 20 via the communication network 100 in accordance with an operation by the user (step S301). In this case, for example, the client terminal 10 transmits a save instruction including the file name and the actual folder address of the save destination to the virtual home realization server 20.

  The client data input / output unit 211 of the virtual home realization server 20 receives a file storage instruction from the client terminal 10 via the communication network 100. Then, the address management / data determination unit 206 determines which virtual screen location the actual folder instructed to store corresponds to (Step S302). In this case, based on the address correspondence table 209, the address management / data determination unit 206 determines which virtual screen location the actual folder instructed to store corresponds to. For example, the address management / data discriminating unit 206 specifies that the actual folder “C: \ myhome \ desk” instructed to be stored corresponds to the location “¥ living ¥ desk” on the virtual screen.

  Further, the address management / data determination unit 206 determines an icon corresponding to the file to be saved (step S303). In this case, the address management / data determination unit 206 determines an icon corresponding to the file to be saved based on the image icon assignment table 210. For example, the address management / data determination unit 206 identifies the corresponding image icon “camera icon” from the image icon assignment table 210 based on the extension “.jpg” of the file to be saved.

  Further, the address management / data determination unit 206 determines to which virtual screen the position on the virtual screen identified in step S302 corresponds (step S304). In this case, the address management / data determination unit 206 determines, based on the virtual screen correspondence table 207, which position range on the screen corresponds to the specified location on the virtual screen. For example, the address management / data determination unit 206 specifies that the place “¥ living ¥ desk” on the virtual screen corresponds to the position range on the screen (1000 <X <1500, 500 <Y <800).

  In addition, the address management / data determination unit 206 determines the screen position of the icon based on the specified position range on the screen. In this case, the address management / data determination unit 206 selects a non-overlapping screen position (X, Y) based on the address management information of files and data already registered. Then, the address management / data discrimination unit 206 determines the selected screen position as the icon image position (step S305).

  Further, the address management / data determination unit 206 executes address management according to the changed content (step S306). In this case, for example, the address management / data determination unit 206 stores the file “aaa.jpg” to be stored in the actual folder “C: \ myhome \ desk” instructed to be stored. In addition, the address management / data determination unit 206 reflects the contents of the actual folder change on the virtual screen. For example, the address management / data determination unit 206 changes the location of the icon corresponding to the file “aaa.jpg” to the location “¥ living ¥ desk” on the virtual screen identified in step S302.

  When the address management process is executed, the address management / data determination unit 206 outputs various data (management information) specified for the file to be saved to the virtual screen creation unit 203 (step S307). For example, the address management / data discriminating unit 206, the actual folder address “C: \ myhome \ desk” identified in steps S302 to S304, the location address “¥ Living ¥ desk” on the virtual screen, and the icon “camera icon” The screen position is output to the virtual screen creation unit 203.

  The virtual screen creation unit 203 creates screen information of the virtual screen again based on the management information from the address management / data determination unit 206 (step S308). In this case, the virtual screen creation unit 203 creates screen information of the virtual screen using image data and icons included in the image data / icon list 208. In this embodiment, since the operation of placing the camera icon on the “desk” has been performed, in step S308, the virtual screen creation unit 203 displays the screen information of the virtual screen that displays the camera icon at the position of the desk on the virtual screen. Recreate.

  The virtual screen display instruction unit 201A instructs the client data input / output unit 211 to transmit the screen information of the virtual screen that displays the camera icon at the desk position (step S309). Then, the client data input / output unit 211 transmits the screen information of the virtual screen created by the virtual home creation unit 203 to the client terminal 10 via the communication network 100. Further, the client terminal 10 displays a virtual screen that displays the camera icon at the desk position based on the received screen information of the virtual screen (step S310).

  The user can also easily create album data by performing a move operation or a save operation of a plurality of files having the same extension in the same time zone. For example, the user creates album data by performing an operation of moving or saving a plurality of files having the same extension from the virtual screen to the same location on the virtual screen within the same time zone (for example, within a predetermined time). it can. In addition, for example, the user creates album data by performing an operation of moving or saving a plurality of files having the same extension to the same actual folder in the same time zone using a file management tool such as Explorer. it can.

  FIG. 12 is a flowchart showing an example of processing for creating album data in accordance with an operation using the file management tool. In the present embodiment, as an example, a case where album data is created according to an operation using a file management tool will be described. However, the same applies to a case where album data is created by an operation from a virtual screen.

  The user operates the client terminal 10 and issues a move instruction and a save instruction for a plurality of files using the file management tool. In this embodiment, the user instructs to save 10 files “aaa1.jpg” to “aaa10.jpg” in the actual folder “C: \ myhome \ desk \” using the file management tool. . Then, the client terminal 10 transmits an instruction to save a plurality of files to the virtual home realization server 20 via the communication network 100 according to an operation by the user (step S401). In this case, for example, the client terminal 10 transmits to the virtual home realization server 20 a storage instruction including the file names of a plurality of files and the actual storage destination folder.

  The client data input / output unit 211 of the virtual home realization server 20 receives an instruction to save a plurality of files from the client terminal 10 via the communication network 100. Then, the address management / data determination unit 206 determines which virtual screen location the actual folder instructed to store corresponds to (Step S402). In this case, based on the address correspondence table 209, the address management / data determination unit 206 determines which virtual screen location the actual folder instructed to store corresponds to. For example, the address management / data discriminating unit 206 specifies that the actual folder “C: \ myhome \ desk” instructed to be stored corresponds to the location “¥ living ¥ desk” on the virtual screen.

  In addition, the address management / data determination unit 206 determines an icon corresponding to the file to be saved (step S403). In this case, the address management / data determination unit 206 determines an icon corresponding to the file to be saved based on the image icon assignment table 210. For example, the address management / data determination unit 206 identifies the corresponding image icon “camera icon” from the image icon assignment table 210 based on the extension “.jpg” of the file to be saved.

  Further, the address management / data determination unit 206 determines which virtual screen position the location on the virtual screen identified in step S302 corresponds to (step S404). In this case, the address management / data determination unit 206 determines, based on the virtual screen correspondence table 207, which position range on the screen corresponds to the specified location on the virtual screen. For example, the address management / data determination unit 206 specifies that the place “¥ living ¥ desk” on the virtual screen corresponds to the position range on the screen (1000 <X <1500, 500 <Y <800).

  In addition, the address management / data determination unit 206 determines the screen position of the icon based on the specified screen position range. In this case, the address management / data determination unit 206 selects a non-overlapping screen position (X, Y) based on the address management information of files and data already registered. Then, the address management / data determination unit 206 determines the selected screen position as the screen position of the icon (step S405).

  Further, the address management / data determination unit 206 executes address management according to the changed content (step S406). In this case, for example, the address management / data discriminating unit 206 stores a plurality of files “aaa1.jpg” to “aaa10.jpg” to be stored in the actual folder “C: \ myhome \ desk” instructed to be stored. . In addition, the address management / data determination unit 206 reflects the contents of the actual folder change on the virtual screen. For example, the address management / data discriminating unit 206 displays the location on the virtual screen where the icons linked with the plurality of files “aaa1.jpg” to “aaa10.jpg” are displayed in the location “ Change to "Living Room \ Desk".

  When the address management process is executed, the address management / data determination unit 206 outputs various data (management information) specified for the file to be saved to the virtual screen creation unit 203 (step S407). For example, the address management / data discrimination unit 206 displays the actual folder “C: \ myhome \ desk” identified in steps S402 to S404, the location “¥ Living ¥ desk” on the virtual screen, the icon “camera icon”, the screen The position is output to the virtual screen creation unit 203.

  Based on the management information from the address management / data discrimination unit 206, the virtual screen creation unit 203 identifies a plurality of stored files and a group of files having the same extension “.jpg”. In addition, the virtual screen creation unit 203 specifies that these multiple files have been stored in the same time zone based on the management information. Then, the virtual screen creation unit 203 outputs notification information indicating that a plurality of files having the same extension have been operated to the album function unit 204 (step S408).

  The album function unit 204 instructs the virtual screen creation unit 203 to generate a virtual screen including an icon in which a plurality of files are linked. For example, the album function unit 204 embeds a function that allows a user to click a camera icon representing a plurality of files having the same extension “.jpg” on the virtual screen to view a plurality of images in a photo album format. Is instructed to the virtual screen creation unit 203 (step S409).

  The virtual screen creation unit 203 creates the screen information of the virtual screen again based on the management information from the address management / data determination unit 206 (step S410). In this case, the virtual screen creation unit 203 creates screen information of the virtual screen using image data and icons included in the image data / icon list 208. Further, the virtual screen creation unit 203 generates a virtual screen including an icon in which a plurality of files “aaa1.jpg” to “aaa10.jpg” are linked in accordance with an instruction from the album function unit 204.

  The virtual home display instruction unit 201A instructs the client data input / output unit 211 to transmit screen information of a virtual screen in which a camera icon linked with a plurality of files is displayed at a desk position (step S411). Then, the client data input / output unit 211 transmits the screen information of the virtual screen created by the virtual screen creation unit 203 to the client terminal 10 via the communication network 100.

  Based on the screen information of the virtual screen received from the virtual home realization server 20, the client terminal 10 displays a virtual screen that displays the camera icon at the desk position (step S412). When the user wants to view a plurality of images at once, the user clicks the camera icon on the virtual screen with a mouse. Then, the client terminal 10 collectively displays (album display) a plurality of images “aaa1.jpg” to “aaa10.jpg” in accordance with a user operation. In the case of the album function, a plurality of files are linked to one icon.

  As described above, according to the present embodiment, the virtual home realization server 20 associates the actual folder on the database 202 with the location of the virtual home. In addition, the virtual home realization server 20 generates a virtual screen according to the associated location. Then, the client terminal 10 displays the virtual screen generated by the virtual home realization server 20. Therefore, as a user interface, it is possible to provide a user with a virtual screen in which files and data that are originally invisible are expressed as objects. Therefore, even a user unfamiliar with the operation of the information processing apparatus can easily manage files.

  In addition, according to the present embodiment, a shared folder used between family members (friends) and a shared space between family members (friends) (virtual home space) are linked, and the virtual home space is easily used between family members (friends). it can. According to the present embodiment, the family shared folder can be accessed from anywhere via the communication network 100 using each client terminal 10. Therefore, files and data can be shared between family members and friends who are living separately. Further, according to the present embodiment, even parents, children, or friends who are separated in the real world can be expressed as if they live in the same house on the virtual home space. . In addition, the virtual home realization system can be expected as a tool for enhancing communication between family members living apart.

  In each of the embodiments described above, when the user operates the information processing apparatus or the client terminal 10 to perform an e-mail operation or an electronic bulletin board data write operation, the user particularly stores Even if the folder is not specified, the folder may be set to be automatically stored in a predetermined location. In this case, for example, the virtual home realization system and the virtual home realization server 20 determine the data type based on the data protocol, or in the case of direct access to the mobile USB, use the mobile USB function to store the data in a predetermined storage location. Store automatically.

  For example, the virtual home realization system or the virtual home realization server 20 determines that the data is electronic mail data or electronic bulletin board data based on the data protocol. Then, the mail / bulletin board automatic processing unit 205 automatically assigns a predetermined address on the virtual screen, which is a place on the virtual screen, for the data of the electronic mail and the electronic bulletin board. Then, the mail / bulletin board automatic processing unit 205 automatically stores e-mail and bulletin board data in a predetermined actual folder according to the assigned location address on the virtual screen. For example, the mail / bulletin board automatic processing unit 205 stores newly arrived mail on a desk on the virtual screen in accordance with preset setting information. Further, the mail / bulletin board automatic processing unit 205 stores bulletin board data in the refrigerator on the virtual screen in accordance with preset setting information.

In the second embodiment described above, the same virtual screen may be displayed in common on the client terminals 10 at two remote locations. In this case, when the virtual screen is changed by one of the client terminals 10, the other one of the client terminals 10 may similarly display the changed virtual screen. Moreover, you may enable it to superimpose a voice call simultaneously using the client terminal 10 between the distant points. In this way, a plurality of users can perform an operation of turning albums between distant points, and can have a conversation with each other while viewing the photos.
In the first and second embodiments described above, only the screen information on the virtual screen of the changed part is created and the virtual screen in which only the changed part is updated is displayed. A method of recreating all virtual screens including the part may be used.

  The present invention is useful when applied to an information processing apparatus such as a personal computer that realizes a user interface suitable for a user unfamiliar with computer operation. Moreover, it is useful for applying to a file management system in which files and data can be shared between separated family members and friends.

It is a block diagram which shows an example of a structure of the virtual home implementation system (user interface system) by the 1st Embodiment of this invention. It is a flowchart which shows an example of the process which performs file management according to operation by the user on a virtual screen. It is explanatory drawing which shows an example of the virtual screen which a virtual home implementation system displays. It is explanatory drawing which shows the other example of the virtual screen which a virtual home implementation system displays. It is explanatory drawing which shows the example of operation which selects "Move selected file to a virtual screen" from the selection field of a virtual screen. It is explanatory drawing which shows the example of the operation | movement which designates the place on the virtual screen which wants to store a file. It is a block diagram which shows the other example of a structure of the virtual home implementation system (user interface system) by the 2nd Embodiment of this invention. It is a block diagram which shows an example of a structure of a virtual home realization server (server storage part). It is a flowchart which shows the other example of the process which performs file management according to operation by the user on a virtual screen. It is explanatory drawing which shows an example of the virtual screen which a client terminal displays. It is a flowchart which shows an example of the process which performs file management according to operation using a file management tool. It is a flowchart which shows an example of the process which produces album data according to operation using a file management tool.

Explanation of symbols

201 Virtual screen display unit 202 Database 203 Virtual screen creation unit 204 Album function unit 205 Mail / bulletin board automatic processing unit 206 Address management / data discrimination unit 207 Virtual screen correspondence table 208 Image data / icon list 209 Address correspondence table 210 Image icon assignment table

Claims (6)

A user interface system using a virtual space screen as a user interface screen,
Multiple user terminals;
A user interface realization server for realizing the virtual space screen;
With
The user interface realizing server is:
A database in which folders for storing files or data are formed according to a predetermined hierarchical structure;
Virtual space table storage means for storing a virtual space correspondence table in which addresses of the folders and addresses indicating locations on the virtual space screen are associated with each other;
On the basis of the virtual space correspondence table, and location correlating means for correlating said folder address indicating a predetermined location of the virtual space screen,
A screen of the virtual space screen in which an icon representing the file or data stored in the folder as a concrete object is displayed at the location indicated by the address on the virtual space screen associated with the folder by the location association means. Virtual space screen generation means for generating information;
Virtual space screen transmission means for transmitting the screen information of the virtual space screen generated by the virtual space screen generation means to the user terminal via a communication network;
Creating new files or data in a virtual space screen, moving the particular when the operation of changing or deleting is executed, the icon is newly created, move, or change or delete position, corresponding to any of the folders A reality folder identification means to
The newly created folder, which is the real folder specific means were identified, move, save the operation target file or data of the change, or the real folder from the folder in which the specific means identified the operation target of the deleted files or data A reality folder update means for deleting
Including
Said user terminal,
Virtual space screen display means for displaying the virtual space screen based on the screen information received from the user interface realization server ;
Operation information transmitting means for transmitting operation information to the user interface realization server to the effect that a new creation, movement, change or deletion of a file or data has been performed,
The operation information transmission unit displays operation information indicating that an operation for newly creating, moving, changing or deleting a file or data indicated by the icon is performed in accordance with an operation instruction for the icon displayed on the virtual space screen. A user interface system, characterized by being transmitted to the user interface realizing server . A user interface system using a virtual space screen as a user interface screen,
And a plurality of user terminals,
A user interface realization server for realizing the virtual space screen;
With
The user interface realizing server is:
A database in which folders for storing files or data are formed according to a predetermined hierarchical structure;
Virtual space table storage means for storing a virtual space correspondence table in which addresses of the folders and addresses indicating locations on the virtual space screen are associated with each other;
On the basis of the virtual space correspondence table, and location correlating means for correlating said folder address indicating a predetermined location of the virtual space screen,
A screen of the virtual space screen in which an icon representing the file or data stored in the folder as a concrete object is displayed at the location indicated by the address on the virtual space screen associated with the folder by the location association means. Virtual space screen generation means for generating information;
Virtual space screen transmission means for transmitting the screen information of the virtual space screen generated by the virtual space screen generation means to the user terminal via a communication network;
Including
Said user terminal,
Virtual space screen display means for displaying the virtual space screen based on the screen information received from the user interface realization server ;
Operation information transmission means for transmitting operation information to the user interface realization server to the effect that a new creation, movement, change or deletion of a file or data has been performed,
The location correlating means, when you receive the operation information from the user terminal, on the basis of the virtual space correspondence table, a folder to which the operation target file or data is stored, either in the virtual space screen Identify the location,
The virtual space screen generation unit regenerates the screen information of the virtual space screen in which the icon display is changed according to the location indicated by the address on the virtual space screen associated with the folder by the location association unit,
When the virtual space screen display means receives the screen information regenerated by the virtual space screen generation means from the user interface realization server , the virtual space screen display means displays the virtual space screen based on the received screen information ,
The operation information transmission unit displays operation information indicating that an operation for newly creating, moving, changing or deleting a file or data indicated by the icon is performed in accordance with an operation instruction for the icon displayed on the virtual space screen. A user interface system, characterized by being transmitted to the user interface realizing server . The user interface realizing server is:
Icon table storage means for storing an icon correspondence table in which a file or data type is associated with an icon type;
Based on the icon correspondence table, comprising icon association means for associating a file or data with an icon,
  The virtual space screen generation unit generates screen information of a virtual space screen on which the icon associated with the icon association unit is displayed.
  The user interface system according to claim 1 or 2, wherein The folder formed in the database is a shared folder for storing files or data used between predetermined members according to a predetermined hierarchical structure,
The virtual space screen transmission unit is configured to display an icon representing a file or data stored in the shared folder as an object, and an address on the virtual space screen associated with the shared folder by the location association unit. The screen information of the virtual space screen displayed at the indicated location is transmitted to the user terminal of the predetermined member among the plurality of user terminals via a communication network.
  The user interface system according to any one of claims 1 to 3, wherein the user interface system is provided. A user interface realization server that realizes a virtual space screen as a user interface screen,
A database in which folders for storing files or data are formed according to a predetermined hierarchical structure;
Virtual space table storage means for storing a virtual space correspondence table in which addresses of the folders and addresses indicating locations on the virtual space screen are associated with each other;
On the basis of the virtual space correspondence table, and location correlating means for correlating said folder address indicating a predetermined location of the virtual space screen,
A screen of the virtual space screen in which an icon representing the file or data stored in the folder as a concrete object is displayed at the location indicated by the address on the virtual space screen associated with the folder by the location association means. Virtual space screen generation means for generating information;
Virtual space screen transmission means for transmitting the screen information of the virtual space screen generated by the virtual space screen generation means to the user terminal via a communication network;
With
The location associating means has been operated to newly create, move, change or delete the file or data indicated by the icon in accordance with the operation instruction of the icon displayed on the virtual space screen on the user terminal. When operation information indicating that you received from the user terminal, on the basis of the virtual space correspondence table, whether the folder to which the operation target file or data is stored, corresponding to any location in the virtual space screen Identify,
The virtual space screen generation means regenerates the screen information of the virtual space screen with the icon display changed according to the location indicated by the address on the virtual space screen associated with the folder by the location association means. User interface realization server. A user interface realization server that realizes a virtual space screen as a user interface screen,
A database in which folders for storing files or data are formed according to a predetermined hierarchical structure;
Virtual space table storage means for storing a virtual space correspondence table in which addresses of the folders and addresses indicating locations on the virtual space screen are associated with each other;
On the basis of the virtual space correspondence table, and location correlating means for correlating said folder address indicating a predetermined location of the virtual space screen,
A screen of the virtual space screen in which an icon representing the file or data stored in the folder as a concrete object is displayed at the location indicated by the address on the virtual space screen associated with the folder by the location association means. Virtual space screen generation means for generating information;
Virtual space screen transmission means for transmitting the screen information of the virtual space screen generated by the virtual space screen generation means to the user terminal via a communication network;
Operation information indicating that a file or data indicated by the icon is newly created, moved, changed, or deleted in accordance with an operation instruction for the icon displayed on the virtual space screen on the user terminal. If you received from the terminal, on the basis of the virtual space correspondence table, the icon is newly created, moved, changed or deleted positions, and the real folder specifying means for specifying whether to correspond to any of the folders,
The newly created folder, which is the real folder specific means were identified, move, save the operation target file or data of the change, or the real folder from the folder in which the specific means identified the operation target of the deleted files or data A reality folder update means for deleting
A user interface implementation server characterized by comprising: