JP5747874B2 - Information processing apparatus, information processing system, control method thereof, and program - Google Patents

Description

  The present invention relates to a content metadata management method in an online album service provided on the Internet.

  In recent years, services that allow an unspecified number of users to browse images by uploading (publishing) images taken using an imaging device to an online album site that is made public on the Internet have become widespread. For example, CANON iMAGE GATEWAY (registered trademark) can be listed as an online album site, and Facebook (registered trademark) can be listed as a social network service.

  In a website having an online album function for sharing and enjoying images with a large number of unspecified users, as a part of communication between users, for example, a function of adding a comment caption to an image is common. When comments and captions can be added to an image, a large amount of comments and captions may be added to one image. Therefore, a display time that is easy for the user to view when displaying images in a slide show. A technique for displaying each image in a slide show is disclosed (for example, Patent Document 1).

  Also, search for multiple albums for images posted on the online album site, and even if the searched images are images posted by other users, they are related to the album of the user who performed the search. A technique for displaying is disclosed (for example, Patent Document 2).

JP 2010-154398 A JP 2007-316939 A

  Online album sites that share images with an unspecified number of users are often posted in the order in which they are uploaded to the storage, and users who view images need to know how much time they have for a single album theme. It is difficult to grasp whether an image was taken in the flow. Further, in order to solve the above problem, among the metadata associated with each image (for example, data in Exif format), information of “shooting date / time” indicating the time when the image was shot by the shooting device is used. A method of sorting images uploaded to a server for posting on an online album and displaying them in chronological order can be considered. For example, a plurality of images taken by a plurality of photographing devices can be combined into one online album. When posting on the site together, if there is a shooting device with a different time zone setting, the information of the “shooting date” will be misaligned, and further, images taken with a shooting device that has not been set with time will be displayed. When posting, there is a problem that the information of "shooting date" is not set, and the user confirms the image property information one by one before uploading Te, make modifications, if necessary, must be the work of, there is a risk that the work of album creation and editing is very complicated.

In view of this, the present invention provides a mechanism that allows a user to edit and manage time information associated with an image with an intuitive instruction by accepting designation of a time axis in which images are displayed in a list based on corresponding time information. The purpose is to provide.

The information processing apparatus according to the present invention has already received a time in a time map display area in which a selection accepting unit that accepts selection of an object representing an original image displayed on a display screen and a time axis that can identify a predetermined time interval are arranged. the object corresponding to the original image that corresponds to the information, and display control means for controlling so as to list arranged for each of the time axis based on the time information of the original image, said display said time on the screen Designation accepting means for accepting designation of a movement position which is a position on the time axis in the map display area, and is a position for moving the object whose selection has been accepted by the selection accepting means, and the object in the time map display area It is time information to be placed on, and the designation of the movement position is accepted by the designation accepting means. The time information of the original image corresponding to said object, characterized in that and an update processing control means for executing processing for updating based on the Majo report when the moving position according to the time axis .

  According to the present invention, it is possible to provide a mechanism that allows a user to edit and manage time information associated with an image by an intuitive instruction.

It is a figure showing the whole information processing system composition concerning this embodiment. It is a figure which shows the hardware constitutions of each apparatus which comprises the information processing system concerning this embodiment. It is a figure which shows the example of a screen structure displayed on the display part of the client terminal 100 concerning this embodiment. It is a figure which shows the example of a screen structure displayed on the display part of the client terminal 100 concerning this embodiment. It is a figure which shows the example of a screen structure displayed on the display part of the client terminal 100 concerning this embodiment. It is a figure which shows the example of a screen structure displayed on the display part of the client terminal 100 concerning this embodiment. It is a figure which shows the example of a screen structure displayed on the display part of the client terminal 100 concerning this embodiment. It is a figure which shows the example of a screen structure displayed on the display part of the client terminal 100 concerning this embodiment. It is a figure which shows the example of a screen structure displayed on the display part of the client terminal 100 concerning this embodiment. It is a figure which shows the example of a data table structure of the image data memorize | stored and managed by the website server 200 concerning this embodiment. It is a flowchart figure which shows the process outline | summary of the information processing system concerning this embodiment. It is a flowchart figure which shows the process outline | summary in the client terminal 100 concerning this embodiment. It is a figure which shows the example of a data table structure of the image data memorize | stored and managed by the website server 200 concerning this embodiment. It is a figure which shows the example of a data table structure of the image data memorize | stored and managed by the website server 200 concerning this embodiment. It is a figure which shows the example of a data table structure of the image data memorize | stored and managed by the website server 200 concerning this embodiment. It is a figure which shows an example of a structure of the time information matching table in embodiment of this invention. It is a flowchart which shows the flow of the update process of imaging | photography date information using the information of a timeline view display area in embodiment of this invention.

  Hereinafter, the present embodiment will be described with reference to the drawings. FIG. 1 is a diagram showing an example of a system configuration for realizing the present embodiment. In the information processing system of FIG. 1, the client terminal 100 and the website server 200 are in a state where they can be connected via the network 1.

  In the present embodiment, the client terminal 100 includes an Internet browser for accessing the Internet. Further, in the present embodiment, the website server 200 stores an image uploaded upon accepting selection from the client terminal 100 in a predetermined storage area of a storage unit (for example, HDD), and an album data table created by the user. I remember it. The album data table stored in the website server 200 will be described later with reference to FIG.

  Next, the hardware configuration of the information processing apparatus applicable to the client terminal 100 and the website server 200 shown in FIG. 1 will be described using FIG. FIG. 2 is a block diagram illustrating a hardware configuration of an information processing apparatus applicable to the client terminal 100 and the website server 200.

  In FIG. 2, reference numeral 201 denotes a CPU that comprehensively controls each device and controller connected to the system bus 204. Further, the ROM 202 or the external memory 211 is necessary to realize a BIOS (Basic Input / Output System) or an operating system program (hereinafter referred to as an OS), which is a control program of the CPU 201, or a function executed by each server or each PC. Stores various programs to be described later.

  A RAM 203 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program or the like necessary for execution of processing from the ROM 202 or the external memory 211 into the RAM 203 and executing the loaded program.

  An input controller 205 controls input from a keyboard (KB) 209 or a pointing device such as a mouse (not shown). A video controller 206 controls display on a display device such as a CRT display (CRT) 210. In FIG. 2, although described as CRT 210, the display device is not limited to the CRT, but may be another display device such as a liquid crystal display. These are used by the administrator as needed.

  A main controller 207 is connected to an HDD, a flexible disk (FD), or a PCMCIA card slot via an adapter for storing a boot program, various applications, font data, user files, editing files, various data, and the like. The access to the external memory 211 such as a compact flash (registered trademark) memory is controlled.

  A communication I / F controller 208 is connected to and communicates with an external device via a network, and executes communication control processing on the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the CRT 210 by executing, for example, outline font development (rasterization) processing on a display information area in the RAM 203. In addition, the CPU 201 enables a user instruction with a mouse cursor (not shown) on the CRT 210.

  Various programs to be described later for realizing the present invention are recorded in the external memory 211 and executed by the CPU 201 by being loaded into the RAM 203 as necessary. Furthermore, definition files and various information tables used when executing the program are also stored in the external memory 211, and a detailed description thereof will be described later.

  Next, the website provided by the website server 200 in the present embodiment will be described with reference to FIG. FIG. 3 is a configuration example of a website top screen displayed on the display unit of the client terminal 100 that has accessed the website server 200. The top screen 300 is an online album introduction screen provided by the website server 200, and upon receiving a press of the new album creation button 301, the image data upload screen of FIG. 4 is displayed. Reference numerals 302 and 303 denote display areas for introducing albums created by the online album service provided on this website. In 302 and 303, for example, albums related to topics that are featured on the website are picked up, or albums created by users called “moderators” who are familiar with the industry of each topic are displayed. In the album display areas 302 and 303, a thumbnail image of the cover of each album, an album title, and an album creator (member user name of the website) are displayed.

  Next, with reference to FIG. 11 and FIG. 12, in the present embodiment, the website server 200 is accessed to create and edit an album. First, the client terminal 100 accesses an Internet site provided from the website server 200 and executes user login. In the user login, when an input of a user ID (for example, a unique character string, an e-mail address, etc.) and a password are accepted and the user ID and password are transmitted to the website server 200, the website server 200 has a predetermined In the user data table (not shown) stored in the storage unit, the transmitted user ID is registered in the data table, and the password stored in association with the user ID matches the transmitted password. If the user ID and password match the values registered in the user data table, the member top page (FIG. 3) is transmitted to the client terminal 100. Here, the website server 200 does not necessarily store the user data table, and a user authentication server may be prepared separately.

  In S101, when receiving the screen information of the top page (FIG. 3) transmitted from the website server 200, the CPU 201 of the client terminal 100 reads the screen information (HTML information) with an Internet browser and displays it on the display unit.

  Here, the screen information is displayed on the display unit using the browser function. For example, by storing an application having a screen display function in the client terminal 100 and starting the application. The screen information may be displayed on the display unit.

  In step S102, when the client terminal 100 accepts pressing of a new top page album creation button (301 in FIG. 3), the client terminal 100 includes a screen acquisition request in the website server 200 to acquire a screen for creating a new album. Send album creation instructions.

  In S103, when the website server 200 receives the album new creation instruction transmitted from the client terminal 100, the screen information of the album creation screen (FIG. 4) is returned to the client terminal 100 in S104.

  In S105, when the CPU 201 of the client terminal 100 receives the screen information of the album creation screen (FIG. 4) transmitted from the website server 200, the CPU 201 reads the screen information (HTML information) with the Internet browser and displays it on the display unit.

  In the album creation screen 400 of FIG. 4, selection and upload of images to be posted on the online album are executed. When the user presses a “select from storage” button 401, a list of images that have already been uploaded to the website server 200 with the currently logged-in user name and saved in a predetermined storage unit is displayed on the client terminal 100. An image is displayed on the display unit, and an image is selected for creating an album from an image list screen (not shown) (album posted image selection reception). On the image list screen, images can be selected one by one or a plurality of images can be selected.

  As shown in FIG. 15, the image uploaded to the website server 200 is stored in the data table in a format in which the image name is associated with the name of the album to be posted (the image is used).

  It can be confirmed that the image name 1501, 1502-1 and 1502-2, and the album name in which the image is used are stored in association with each other. For example, “IMG — 00001” is used only for the album “Kyoto Travel” and “IMG — 00002” is used for multiple types of albums “Kyoto Travel” and “Japanese Cherry”. .

  Returning to FIG. 11, in S <b> 106, the client terminal 100 accepts selection of an acquisition source of images to be posted on the album. Specifically, as described above with reference to FIG. 4, a selection is made to create an album from images that have already been uploaded to the website server 200 and stored in a predetermined storage unit of the website server 200. Or select an image stored in a predetermined storage unit of the client terminal 100 or an external storage device (for example, a USB memory, an external HDD, an SD card, etc.) connected to the client terminal 100 Then, the selection of whether to instruct the website server 200 to upload is accepted.

  When the pressing of the “select from storage” button (401 in FIG. 4) is accepted in S106, the website server 200 advances to the storage image list screen in S108, and is currently logged in to a predetermined storage unit of the website server 200. The image list screen of the images already uploaded to the website server 200 with the user name and stored is returned to the client terminal 100.

  In S109, when the client terminal 100 receives the screen information of the storage image list screen (not shown) transmitted from the website server 200, the client terminal 100 reads the screen information (HTML information) by the Internet browser and displays it on the display unit. Then, selection of images to be posted on the online album is accepted from the image list screen.

  In S <b> 110, the client terminal 100 transmits an album creation instruction to the website server 200 as an image to be posted on the online album in step S <b> 107 or step S <b> 109 or in both methods. This process is executed by accepting the pressing of the “Create Album” button 404 in FIG. The data structure transmitted from the client terminal 100 to the website server 200 at this time is album creation information shown in FIG.

  The album creation information in FIG. 14 includes album title 1401, image name 1402 selected from S107 or S109, selection source information 1403 indicating which is selected from S107 or S109, and metadata 1404 of the selected image. Information.

  In step S <b> 111, when the website server 200 receives an album creation instruction from the client terminal 100, the website server 200 determines whether the image selected by the client terminal 100 includes a locally uploaded image. If this is an image selected through the processing of S108 and S109, it is an image already stored in a predetermined storage unit of the website server 200, so there is no need to save it again. This is because an image selected from a predetermined storage unit of the terminal 100 or an external storage device and transmitted as an image to be posted on the album needs to be stored in a predetermined storage unit of the website server 200.

  At this time, among the album creation information (FIG. 14) included in the album creation instruction received from the client terminal 100 in S111, the selection source information 1403 is used to determine which data is local (a predetermined storage unit of the client terminal 100 or It is possible to determine whether the image is an image (selected from the external storage device) or the image originally stored in the storage. Save to storage.

  In S112, when there is an image selected from the predetermined storage unit of the client terminal 100 or the external storage device, the process proceeds to S113, and the corresponding image is stored in the predetermined storage unit of the website server 200.

  In S114, when the image transmitted based on the album creation instruction transmitted from the client terminal 100 is stored in the predetermined storage unit of the website server 200 or uploaded successfully, the album editing screen of FIG. 5 is displayed. The screen information is transmitted to the client terminal 100. If the upload has not been performed normally (for example, a session timeout or a case where the data capacity per image is too large), an error screen (not shown) is displayed in S116 and this process is performed. Exit.

  When the pressing of the “Upload from PC” button 402 in FIG. 4 is accepted, an image selection screen (not shown) is activated in S107, and selection of an image to be uploaded from the client terminal 100 is accepted. Alternatively, the thumbnail of the image stored in the client terminal 100 or an external storage device connected to the client terminal 100 is moved by drag and drop into the area “403 Drag and drop image” in 403 of FIG. By doing so, it is also possible to start uploading an image for which selection has been accepted. When the image is moved to the area 403 by drag and drop, the upload process starts for each data of the image, and the user can check the processing status with the upload meter 405. For the image for which the upload process has been completed, a thumbnail is generated and displayed in the upload image display area 406. In this case, since the images moved by drag and drop are uploaded one by one, unlike the processing method of each step (S110 to S114) in FIG. 11, a predetermined storage unit of the website server 200 Image storage is performed every time.

  Next, image metadata management / editing processing on the album editing screen in the present embodiment will be described with reference to FIG.

  In S201, the client terminal 100 reads the screen information (HTML information) of the album editing screen (FIG. 5) transmitted from the website server 200 in S115 of FIG. 11 with an Internet browser and displays it on the display unit. In S202, selection of the display method of the online album created this time is accepted.

  In the present embodiment, the “timeline view” that arranges the images to be posted on the album in time series using the shooting date / time information among the metadata of the images to be posted on the album (for example, metadata in Exif format). There are two display methods: a display method and a “map view” in which images to be posted on an album are plotted on a map using GPS information among metadata. In this application, a metadata management / editing method when displaying an image in the “timeline view” will be described.

  FIG. 5 is an example of an album editing screen displayed in the “timeline view” format. The album editing screen 500 includes an album title 501 and a thumbnail 502 of the cover image of the album at the upper left of the screen. The album title can be edited by, for example, displaying a command dialog (not shown) by double-clicking in the area 501 or by right-clicking the mouse and selecting a “edit title” command. Alternatively, a text box for inputting an album title is provided on the album creation screen in FIG. 4 (407 in FIG. 4), and when an image selection is received and an album creation instruction is transmitted in S111, the album title is simultaneously transmitted. But you can.

  As the thumbnail of the cover image 502, an image having the oldest shooting date is displayed as an initial setting among images selected as a blank or album posting image by default. When changing from there, by accepting pressing of “set cover image” in 503, a cover image selection dialog is displayed, and the thumbnail of the cover image in 502 can be changed.

  When an “add image” button 504 is accepted, the image is selected and uploaded in the form of adding to an image already posted in the album. In this case, the album creation screen (FIG. 4) is displayed again, but the “Create Album” button 404 is changed to an “Add Image to Album” button.

  Reference numeral 506 denotes an area where an image for which no parameter is set is displayed in the shooting date / time item of the metadata. For example, when the time setting is not set in the setting of a photographing device (for example, there is a camera) for photographing an image, the photographing date / time parameter of the image photographed by the photographing device is not set or “2000 / There is an unset state, such as “01/01 00:00”. These images are displayed in the display area 506 as images for which shooting date / time information is not set.

  Reference numeral 507 denotes a timeline view display area (time map display area), which includes date and time information 508 written on the screen and a thumbnail display unit 509. In the timeline view display area of 507, the vertical axis indicates 9, 10, 11..., Indicating 9 o'clock, 10 o'clock, and 11 o'clock, respectively. In other words, the image displayed in the 9 o'clock row is an image taken at 9 o'clock, and is also lined up at 10 o'clock and 11 o'clock. The date / time information 508 indicates the date when the image was taken, and in this figure, it is between 2011/07/01 and 07/03.

  The thumbnail of each image displayed in the thumbnail display unit 509 is generated when the image is stored in a predetermined storage unit of the website server 200, and is associated with the actual image data and metadata. Memory management. The thumbnails are displayed in order based on the time information corresponding to the original image that is the actual data of the image. That is, for example, four thumbnails are displayed in the thumbnail display section of FIG. It is assumed that these thumbnails are displayed while being shifted in order from the left in order of time indicated by time information corresponding to each original image (for example, shooting date / time information in the metadata).

  Reference numeral 510 denotes a map view switching button. By accepting pressing of this button, an album can be displayed in a “map view” format, which is another display method of the present embodiment.

  Reference numeral 511 denotes a timeline view switching button. By accepting pressing of this button, an album can be displayed in a “timeline view” format.

  Reference numeral 512 denotes a save button, which is a button that accepts a press to reflect the edited information when the shooting date / time of each image is edited by a shooting date / time editing tool dialog described later.

  Reference numeral 513 denotes a confirmation button. When a specific image is selected and this button is pressed, previewing can be performed in a slide show format.

  Reference numeral 514 denotes a completion button, which is a button for receiving a press when all edits of the online album being edited on the edit screen are saved and finished. When the pressing of the completion button 514 is accepted, an end dialog shown in FIG. 9 is displayed.

  Returning to FIG. 12, the display method when the album edit screen is displayed in S201 is a setting performed when the user uses this website. Which of “timeline view” and “map view” is selected? Decide by setting whether to use the default (initial setting) display method.

  In S202, the client terminal 100 accepts selection of a display method, and when “timeline view” display is selected, the process proceeds to S203. If display of the map view is selected, the process proceeds to S211.

  In step S <b> 204, the client terminal 100 accepts selection of an image for editing image shooting date / time information. The selection here refers to an instruction to move the mouse over a specific image, move the cursor, and click. For example, in FIG. 6, selection of a specific image is accepted from an area displayed from images in which the shooting date / time parameter of 506 is not set.

  Next, in S205, the selected image is dragged and dropped onto another date and time line (movement position designation reception). In FIG. 6, the thumbnail of “IMAGE A” 601 is selected and dragged and dropped to the 10 o'clock row of “2011/07/02”. In FIG. 7, “IMAGE A” 701 is dragged and dropped from the row “2011/07/02 9 o'clock” to “2011/07/02 13 o'clock”. In S205, it is determined whether the area where the image is dropped is an area where metadata can be edited on the browser.

  Specifically, it is determined whether or not the dropped area is a timeline view display area 507. The client terminal 100 acquires the coordinate position of the selected image dropped on the browser, and the coordinates of the timeline view display area 507 in the editing screen displayed on the browser that is also held by the client terminal 100. It is determined whether it is within the range. If it is within the range of the timeline view display area 507, the process proceeds to step S206. If it is out of the range of the timeline view display area 507 (for example, within the display area of 506), drop processing is regarded as an error and the selection is accepted in S204. Return. The image selected at this time returns to the display position of the original time zone.

  Here, the drag and drop processing method is used as the thumbnail image moving means, but the image moving method is not limited to this. For example, after an instruction to select an image, a designation instruction and a selection instruction for moving the image may be accepted, and the image may be moved to a destination designated by the designation instruction. Further, for example, by accepting a selection operation, a flick operation, and a swipe operation by a long touch operation, the image may be moved so as to slide on the screen in the flick and swipe directions. In this case, for example, the length of the moving distance can be adjusted by the strength of the flick and swipe operations. In other words, the length of the movement distance is defined based on the accepted flick and swipe operation strength (the length of time the finger is in contact with the screen, the pressure when the finger is placed on the screen, etc.) The moving distance varies depending on the strength of the flick and swipe operations. The position as the movement destination is the position (movement position) of the movement destination that has received designation from the user.

  Further, for example, when one thumbnail image is dragged, another time corresponding to time information indicating a time within a certain period before and after the time indicated by the time information of the original image corresponding to the dragged thumbnail image. It is determined whether there is another thumbnail image arranged on the map display area, and if it is determined that it exists, the thumbnail image corresponding to the original image is matched with the drag operation of the thumbnail image. The other thumbnail image may be selected, and the other thumbnail image may be arranged in accordance with the drop operation of the thumbnail image. In this case, the thumbnail images to be arranged are arranged in the timeline view display area, for example, in order from the left in the order of 50 notes based on the selected file names. The time information here is, for example, information on the shooting date and time in the metadata shown in FIG.

  For the selection of the plurality of images, for example, selection is accepted by an operation of clicking images sequentially while accepting pressing of a specific key (for example, shift key) on the keyboard. Further, by receiving a range selection operation using a mouse, a plurality of images included in the selection range of the range selection may be handled as selected images.

  Further, for example, when a plurality of thumbnail images are dragged, the time information of the original image corresponding to the plurality of dragged thumbnail images from the first time and the last time, for a certain time before and after When there is another thumbnail image corresponding to another original image corresponding to time information indicating the time within, the drag operation of the another thumbnail image is performed in accordance with the drag operation of the plurality of thumbnail images, The drop operation of another thumbnail image may be performed in accordance with the drop operation of a plurality of thumbnail images.

  That is, a plurality of images corresponding to near time information can be moved together by moving some of the images. By doing in this way, it is possible to perform image arrangement and information update without selecting all images to be arranged. In addition, when selecting a plurality of images, it is possible to reduce the number of selection omissions of the user.

  In addition, when a plurality of thumbnail images are selected in sequence and designation of a position on the timeline view display area (on the time map display area) is received at the coordinate position of the movement destination, the thumbnail display unit Then, the thumbnail images are arranged sequentially from the left in the selected order (example: 509 in FIG. 5). In this way, even when it is difficult to recognize the detailed time (shooting time) corresponding to each image on the timeline view display area, the shooting order of each image can be recognized. The time information of the original image corresponding to each thumbnail image arranged in order from the left is rewritten to a time shifted by a predetermined time. For example, it is rewritten at a time shifted by 1 minute, such as 09: 00, 09: 01, 09: 02. It is assumed that the predetermined time is stored and managed in a storage area such as the external memory 211 of the website server 200, for example.

  The “selecting a plurality in order” means, for example, that thumbnail images are selected one by one in order by a click operation or the like. In general, when a plurality of thumbnail images are selected by a range selection performed by moving the mouse cursor on the display screen with the mouse button pressed, in the order in which the selection range is entered in the range selection. The thumbnail images may be selected, and the thumbnail images may be arranged in order from the left on the thumbnail display unit in the selected order.

  For example, the thumbnail images selected after the second are displayed over the first selected image, grouped, and the grouped thumbnail images displayed by dragging the grouped images are displayed. It is assumed that selection of a plurality of thumbnail images that have been grouped is received, and designation of the movement destination positions of the plurality of thumbnail images that have been grouped is received by dropping thumbnail images that are grouped and displayed in an overlapping manner. Grouping is managed and executed, for example, by temporarily generating a data table (group image table) (not shown) for specifying images included in the group by the CPU 201 of the website server 200. The grouping (generation of the group image table) starts when the second thumbnail image is selected, and ends when a drop operation of the grouped thumbnail images is accepted.

  In addition, for example, a selection of a plurality of images is accepted, and a drag and drop operation for all the selected plurality of images is accepted by a drag and drop operation of one of the selected images. Shall.

  When there is a thumbnail image that has already been arranged in the thumbnail display section to which the thumbnail image is to be moved, the thumbnail image to be moved is arranged after the thumbnail image that has already been arranged. However, the arrangement method of the thumbnail images is not limited to this. For example, the moving thumbnail image may be arranged before the already arranged thumbnail image.

  For example, when selection of a plurality of thumbnail images is accepted and the images are arranged on the timeline view display area, the plurality of thumbnail images are grouped, and one representative thumbnail image in the group is displayed on the forefront. The number of images included in the group may be displayed (number of images displayed) on the representative thumbnail image or in the vicinity of the arrangement location or on the upper surface. As the representative thumbnail, for example, an image taken most recently in the group is extracted based on date information and displayed. In this case, for example, the position information (GPS coordinates in the metadata) of all original images corresponding to the plurality of thumbnail images is rewritten at a time corresponding to the position where the grouped thumbnail images are arranged. Shall be.

  In S206, a dialog screen for selecting whether or not to change the metadata is displayed on the display unit of the client terminal 100. If YES is selected, the editing tool dialog shown in FIG. 8 is displayed in S207.

  FIG. 8 is a user interface diagram showing a display example of a shooting information editing tool dialog displayed when a specific image is selected and dragged and dropped to another date and time line on the album editing screen in the timeline view. It is. Reference numeral 801 denotes an editing tool dialog (input screen), which is displayed (input screen display) around the dragged and dropped image 802 (upward in FIG. 8). The editing tool dialog in the timeline view described in this embodiment is a dialog for editing shooting date / time information in image metadata. When the editing tool dialog is displayed, as an initial setting, the time when the image is dropped (for example, 10 o'clock in the case of FIG. 8) is displayed (for example, “2011 /” in the case of 801 in FIG. 07/02 10:00 "), from that state, it is possible to edit the shooting date and time in detail by accepting a user operation.

  In this figure, the box for editing the date is a pull-down box, and the time can be selected for each box. As another editing method, it is possible to edit the time by directly accepting input from the user in a text box type (for example, input by typing), and the editing method is not particularly limited.

  Reference numeral 802 denotes a tool box for sending various commands to the currently selected image (moved by drag and drop). For example, by accepting the pressing of “Move Confirmation”, the movement to the dropped time zone is confirmed. When the pressing of “set as cover” is accepted, it is set as an album cover thumbnail 502. When pressing of “detail” is received, detailed information of the image (for example, shooting information stored in the metadata) is displayed. When “rotate” is pressed, the selected image is rotated 90 degrees to the right or left. When pressing “Remove from line” is accepted, the selected image is removed from the dropped time zone and returned to the area 506 or the image is returned to the row of the original time zone.

  Returning to FIG. 12, in S207, the client terminal 100 edits the shooting date and time in the image metadata, and receives an instruction to end editing (for example, pressing the Enter key). In S208, the client terminal 100 detects the shooting date and time. The editing tool dialog 801 in FIG. 8 is closed.

  In S209, when the selection of the next image to be edited on the album editing screen (FIG. 5) is accepted, the process returns to S204 of the flowchart. When the editing of the shooting date and time is to be ended (NO), the information of the edited shooting date and time in the metadata of the image is received by accepting the pressing of the save button 512 in FIG. Is reflected (update process control) in the image data table of the storage (S210).

  In this way, for example, after a printed photo is scanned and converted into data, date and time information as information indicating the shooting time can be associated with the image by an intuitive instruction for the converted image. It becomes possible.

  FIG. 10 is a diagram illustrating an example of a data table configuration of image metadata. The image metadata includes, for example, information of “photographing model”, “photographing date / time”, “GPS coordinates”, “photographing mode”, and “image serial number”. For the image whose shooting date / time is edited in S207, the “shooting date / time” parameter in the figure becomes the set parameter when edited, and the parameter is rewritten by accepting pressing of the save button in S209. It is done.

  It should be noted that here, for the image whose GPS coordinates have been edited in S207 (S207, S208), by receiving the pressing of the save button 512 in FIG. The shooting date and time parameters are rewritten (S210), but the information to be rewritten does not necessarily have to be metadata.

  That is, for example, an association table of images and shooting date / time information as shown in FIG. 16 may be provided in the storage area of the website server, and the shooting date / time information in the association table may be rewritten.

  Here, the editing tool dialog 801 is displayed around the dragged and dropped image (upward in FIG. 8), and the shooting date / time information is edited in the metadata of the image. The shooting date / time information may be automatically updated based on the timeline view display area where the thumbnail image has been dropped.

  Hereinafter, with reference to FIG. 16, an example of the configuration of the shooting date / time information association table in the embodiment of the present invention will be described. FIG. 16 is a diagram showing an example of the configuration of the shooting date / time information association table in the embodiment of the present invention.

  As shown in FIG. 16, the shooting date / time information association table 1600 includes a user ID 1601, an image name 1602, shooting date / time information 1603, and the like. The shooting date / time information association table 1600 is stored in a storage area such as the external memory 211 of the website server.

  The user ID 1601 is identification information for identifying which user the image indicated by the image name 1602 belongs to. Here, it is assumed that the user ID 1601 is the same as the user ID used for logging in to the website server.

  An image name 1602 is the name of the image. The shooting date / time information 1603 is shooting date / time information associated with an image. The above is an example of the configuration of the shooting date / time information association table in the embodiment of the present invention shown in FIG.

  For example, when the thumbnail image selected in step S204 in FIG. 12 is moved (dropped) to the timeline view display area (image display area) (YES in step S206), the CPU 201 of the client terminal 100 displays the thumbnail image. The shooting date / time information (1603 in FIG. 16) is updated based on the image display area subjected to the drop process (movement process). That is, the shooting date / time information 1603 associated with the image indicated by the image name 1602 is rewritten.

  Hereinafter, with reference to FIG. 17, processing for updating the shooting date / time information using the information of the timeline view display area in the embodiment of the present invention will be described. FIG. 17 is a flowchart showing a flow of update processing of shooting date / time information using information in the timeline view display area in the embodiment of the present invention.

  The processes in steps S2001 to S2005 in FIG. 17 are the same as the processes in steps S201 to S205 in FIG. 12, respectively, and thus description thereof is omitted here. Step S2010 corresponds to step S211, and step S2011 corresponds to step S212.

  The CPU 201 of the client terminal 100 drops the thumbnail image that has been selected in step S2004 into the timeline view display area 507 displayed on the display screen (step S2005). Information on the timeline view display area of the drop destination (image move destination), that is, information on the time of the timeline view display area of the image move destination (set on the vertical axis, for example, 9 o'clock, Information indicating time such as 10:00 and 11:00) and date / time information 508 are acquired (step S2006), and the date / time information is temporarily stored as shooting date / time information corresponding to the moved image. That is, the existing shooting date / time information associated with the image is edited.

  When the CPU 201 of the client terminal 100 accepts selection of the next image to be edited on the album editing screen (FIG. 5) (YES in S2008), the process returns to S2004 of the flowchart. If selection of an image is not accepted (NO in S2008), the process proceeds to step S2012.

  The CPU 201 of the client terminal 100 determines whether or not the save button 513 in FIG. 5 has been pressed (step S2012), and determines that the save button 513 has not been pressed (NO in step S2012), for example, a browser screen When the “return” button (not shown) is pressed, the process is terminated.

  If it is determined that the save button 513 has been pressed (YES in step S2012), the date and time information of the destination of the thumbnail image moved by the drag and drop process in step S2005 is stored in the image data table of the storage (the website server 200 here). Transmit to reflect (S2009).

  The destination to which the thumbnail image is moved is information indicating the destination point of the moved thumbnail image. For example, the center point of the thumbnail image is set as the movement destination position. Note that the destination may be information on the destination point of the thumbnail image. For example, the end point of the thumbnail image may be used as the destination point.

  In addition, by separately displaying a mark for identifying the position of the thumbnail image on the timeline view display area and the original image corresponding to the thumbnail image or the thumbnail image on the display screen, by moving the mark, The time information of the original image corresponding to the thumbnail image displayed separately on the display screen or the time information of the original image displayed on the display screen is used as the time information of the row to which the position of the point to which the mark is moved belongs. You may make it rewrite.

  In step S2017, the CPU 201 of the client terminal 100, in addition to the date / time information, for example, information specifying the original image of the image dropped (moved) in step S2005 (for example, the image name of the thumbnail image (thumbnail image 1303)). The user ID is transmitted to the website server 200.

  The CPU 201 of the website server 200 receives the date and time information, the image name of the thumbnail image, and the user ID transmitted in step S2009, and specifies the original image (original image 1302) corresponding to the thumbnail image indicated by the thumbnail image name. Then, the date information corresponding to the original image is updated to the received date information (step S2013). The above is the description of the update processing of the shooting date / time information using the information of the timeline view display area in the embodiment of the present invention of FIG.

  Next, a data configuration example of an online album stored and managed by the web server 200 in the embodiment of the present invention will be described with reference to FIG. FIG. 13 is a data table showing a data configuration example of an online album stored and managed by the website server 200 in the present embodiment. In the data table of FIG. 13, actual image data 1302, image thumbnails 1303, and image metadata 1304 are stored in association with the album title 1301, respectively.

  As described above, according to the present invention, it is possible to provide a mechanism that allows a user to edit and manage time information associated with an image by an intuitive instruction.

That is, the information processing apparatus according to the present invention includes a selection receiving unit that receives a selection of an object indicating an original image displayed on a display screen, and a time map display area in which a time axis that can identify a predetermined time interval is arranged. Display control means for controlling an object corresponding to the original image already associated with the time information to be arranged and displayed for each time axis based on the time information of the original image, and on the display screen; a position according to the time axis in the time map display area, a designation accepting means for accepting a designation of the selection receiving means is a position for moving the object receives the selection by the mobile position, the said object time map Time information for placement on the display area, wherein the designation accepting means accepts designation of the movement position. Further comprising a time data of the original image corresponding to the attached said object, and updating processing control means for executing processing for updating based on the Majo report when the moving position according to the time axis, the And

  As described above, a recording medium that records a program that implements the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by executing the reading.

  In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk or the like can be used.

  Further, by executing the program read by each device, not only the functions of the above-described embodiments are realized, but also an OS (operating system) running on the computer is actually executed based on the instructions of the program. It goes without saying that a case where the function of the above-described embodiment is realized by performing a part or all of the process and the process is included.

  Furthermore, after the program read from the recording medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is based on the instructions of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Further, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device. For example, in the description of the above-described embodiment, information that is stored and managed by the website server 200 (such as the image data data tables shown in FIGS. 10, 13, 14, 15, and 16) is stored in the client. Storage management is performed at the terminal 100, and the display screen is displayed on the display unit using the application function of the client terminal 100 without using the browser function, so that communication with the website server or the external server is not performed. The processing shown in the flowcharts of the drawings may be performed by the client terminal 100 as a mobile terminal such as a smartphone, for example.

  Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network by a communication program, the system or apparatus can enjoy the effects of the present invention.
In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

  In addition, each process realized by the above-described software can be realized as firmware or hardware configuration, and each process can be realized as each means. The technical scope of the present invention is realized by such firmware or hardware configuration. Is also included.

1 Network 100 Client terminal 200 Website server 201 CPU
202 ROM
203 RAM
204 System Bus 205 Input Controller 206 Video Controller 207 Memory Controller 208 Communication I / F Controller 209 Input Device (KB)
210 Display (CRT)
211 External memory

Claims (20)

Selection accepting means for accepting selection of an object indicating the original image displayed on the display screen;
In a time map display area in which a time axis capable of identifying a predetermined time interval is arranged, an object corresponding to the original image already associated with the time information is set for each time axis based on the time information of the original image. Display control means for controlling to arrange and display a list;
A designation accepting unit that accepts designation of a movement position that is a position related to the time axis in the time map display area on the display screen and that moves the object that has been selected by the selection accepting unit;
Time information for arranging the object on the time map display area, the time information of the original image corresponding to the object for which the designation of the movement position has been accepted by the designation accepting unit, on the time axis. Update process control means for executing a process for updating based on time information of the moving position,
An information processing apparatus comprising: The selection accepting unit accepts selection of a plurality of the objects in order,
The designation accepting unit accepts designation of a movement position which is a position on the time map display area on the time axis and is a position to move a plurality of objects which are sequentially selected by the selection accepting unit;
The update processing control means, based on the time information of the movement position on the time axis, the time information of a plurality of original images corresponding to a plurality of objects received the designation of the movement position by the designation reception means, 2. The information processing apparatus according to claim 1, wherein processing for updating by shifting a predetermined time in the order in which the selection is received by the selection receiving unit is executed. And object display means for displaying a plurality of objects together into a single object which has received the sequentially selected by the selection accepting means,
With
The designation accepting unit accepts designation of a movement position related to the time axis, which is a position to move one object in which the plurality of objects are collected, so that the plurality of objects collected in the one object are The information processing apparatus according to claim 1, wherein designation of a movement position related to the time axis is received. In accordance with the time information corresponding to the original image indicated by the object that has received the selection, the selection receiving means is configured to correspond to time information within a predetermined time from the time information in accordance with the object selection reception processing. Accepts the selection of an object that represents the original image of
The designation accepting unit is a position on the display screen on the time map display area, and is a destination to which the object indicating the selection and the other original image that has been selected by the selection accepting unit is moved. The information processing apparatus according to claim 1, wherein a designation of a movement position is received. The selection receiving means receives a selection of the object by receiving a drag operation on the object,
5. The designation accepting unit according to claim 1, wherein the designation accepting unit accepts designation of a moving position by accepting an operation of dropping the object for which the drag accepting operation has been accepted by the selection accepting unit with respect to the moving position. The information processing apparatus according to claim 1.   The information processing apparatus according to claim 1, wherein the time map display area is an area adjacent to a time notation arranged on the display screen. In the vicinity of the object, an input screen display control means for controlling to display an input screen which is a screen for inputting time information of the original image corresponding to the object,
The update processing control means executes processing for updating time information of the original image corresponding to the object to time information input on the input screen displayed by the input screen display control means. The information processing apparatus according to any one of claims 1 to 6. The original image, an object corresponding to the original image, and a website server that stores time information of the original image are communicably connected,
The display screen is a screen displayed by a browser function of the information processing apparatus,
The update processing control means issues a confirmation instruction for confirming that the time information corresponding to the movement position received by the designation reception means is updated as the time information of the original image corresponding to the object to be moved to the movement position. 8. The time information of the original image is updated by transmitting an instruction for updating the time information of the original image to the website server when received. The information processing apparatus according to any one of claims.   The display control means is based on the original image time information updated by the process for updating the time information to the time information corresponding to the moving position, which is executed by the update process control means. The information processing apparatus according to any one of claims 1 to 8, wherein an object corresponding to an image is controlled to be arranged and displayed on the time map display area on a display screen. The selection receiving means receives a selection of the object by receiving a long touch operation on the object,
The said designation | designated reception part receives the designation | designated of the said movement position by receiving swipe operation in the state which received selection of the said object by the said selection reception part, The one of Claim 1 thru | or 9 characterized by the above-mentioned. The information processing apparatus described. The display control means controls to display a thumbnail image as the object on the time map display area,
The object is arranged and displayed on the time map display area in order according to time information of an original image corresponding to the object that is the thumbnail image. The information processing apparatus according to item 1. 12. The apparatus according to claim 1, further comprising: a moving unit that moves and arranges the object whose selection has been received by the selection receiving unit to the moving position whose specification has been received by the designation receiving unit. The information processing apparatus according to item. The time information is time information indicating a shooting time which is a time when the original image was shot,
The information processing apparatus according to any one of claims 1 to 12, wherein the time information is information on a shooting date and time included in metadata of the original image.   14. The object according to claim 1, wherein the object is a thumbnail image or a mark for specifying a position on the time map display area according to time information of the original image. The information processing apparatus described.   The display control means controls to display an object corresponding to an original image not associated with the time information in an area on a display screen different from the time map display area. The information processing apparatus according to any one of 14. A selection receiving step in which a selection receiving unit of the information processing apparatus receives a selection of an object indicating the original image displayed on the display screen;
In the time map display area in which the display control means of the information processing device arranges a time axis that can identify a predetermined time interval, an object corresponding to the original image already associated with the time information is displayed as the time of the original image. A display control step for controlling to arrange and display for each time axis based on information; and
The designation receiving means of the information processing device is a position related to the time axis in the time map display area on the display screen, and is a position for moving the object that has received the selection in the selection receiving step. A designation acceptance process for accepting designation;
The update processing control means of the information processing apparatus is time information for placing the object on the time map display area, and the original corresponding to the object that has received the designation of the movement position in the designation accepting step An update process control step for executing a process for updating the time information of the image based on the time information of the moving position according to the time axis;
A method for controlling an information processing apparatus, comprising: Information processing device
Selection accepting means for accepting selection of an object indicating the original image displayed on the display screen;
In a time map display area in which a time axis capable of identifying a predetermined time interval is arranged, an object corresponding to the original image already associated with the time information is set for each time axis based on the time information of the original image. Display control means for controlling to arrange and display a list;
A designation accepting unit that accepts designation of a movement position that is a position related to the time axis in the time map display area on the display screen and that moves the object that has been selected by the selection accepting unit;
Time information for arranging the object on the time map display area, the time information of the original image corresponding to the object for which the designation of the movement position has been accepted by the designation accepting unit, on the time axis. A program for an information processing apparatus that functions as an update process control unit that executes a process for updating based on time information of the moving position. An information processing system including an original image, an object corresponding to the original image, a website server that stores time information of the original image, and an information processing device,
The information processing apparatus includes:
Selection accepting means for accepting selection of an object indicating the original image displayed on the display screen;
In accordance with the screen information received from the website server, an object corresponding to the original image already associated with the time information is displayed in the time map display area in which a time axis capable of identifying a predetermined time interval is arranged. Display control means for arranging and displaying a list for each time axis based on the time information of
A designation accepting unit that accepts designation of a movement position that is a position related to the time axis in the time map display area on the display screen and that moves the object that has been selected by the selection accepting unit;
Time information for arranging the object on the time map display area, the time information of the original image corresponding to the object for which the designation of the movement position has been accepted by the designation accepting unit, on the time axis. Update processing control means for instructing the website server to update based on the time information of the moving position,
With
The website server is
In a time map display area in which a time axis capable of identifying a predetermined time interval is arranged, an object corresponding to the original image already associated with the time information is arranged for each time axis based on the time information of the original image. Screen information to be displayed as a list, and screen transmission means for transmitting to the information processing device;
In accordance with an instruction from the update processing control unit, the time information of the original image corresponding to the object for which the designation of the moving position has been received by the designation receiving unit is updated based on the time information of the moving position on the time axis. Updating means to
An information processing system comprising: An information processing system control method including an original image, an object corresponding to the original image, a website server that stores time information of the original image, and an information processing device,
In the information processing apparatus,
A selection receiving step for receiving selection of an object indicating the original image displayed on the display screen;
In accordance with the screen information received from the website server, an object corresponding to the original image already associated with the time information is displayed in the time map display area in which a time axis capable of identifying a predetermined time interval is arranged. A display control step of arranging and displaying a list for each time axis based on the time information of
A designation accepting step for accepting designation of a movement position, which is a position on the display screen on the time axis in the time map display area, and is a position for moving the object for which selection has been accepted in the selection accepting step;
Time information for placing the object on the time map display area, the time information of the original image corresponding to the object for which the designation of the movement position has been accepted in the designation accepting step, as the time axis An update process control step for instructing the website server to update based on time information of the moving position,
Including
In the website server,
In a time map display area in which a time axis capable of identifying a predetermined time interval is arranged, an object corresponding to the original image already associated with the time information is arranged for each time axis based on the time information of the original image. A screen transmission step of transmitting screen information to be displayed in a list to the information processing apparatus;
According to the instruction by the update process control step, the time information of the original image corresponding to the object that has received the movement position designation in the designation receiving step is updated based on the time information of the movement position on the time axis. Update process to
A method for controlling an information processing system comprising: A program that can be executed by an information processing system including an original image, an object corresponding to the original image, a website server that stores time information of the original image, and an information processing device,
The information processing apparatus;
Selection accepting means for accepting selection of an object indicating the original image displayed on the display screen;
In accordance with the screen information received from the website server, an object corresponding to the original image already associated with the time information is displayed in the time map display area in which a time axis capable of identifying a predetermined time interval is arranged. Display control means for arranging and displaying a list for each time axis based on the time information of
A designation accepting unit that accepts designation of a movement position that is a position related to the time axis in the time map display area on the display screen and that moves the object that has been selected by the selection accepting unit;
Time information for arranging the object on the time map display area, the time information of the original image corresponding to the object for which the designation of the movement position has been accepted by the designation accepting unit, on the time axis. In order to update based on the time information of the moving position, function as an update processing control means for instructing the website server,
The website server,
In a time map display area in which a time axis capable of identifying a predetermined time interval is arranged, an object corresponding to the original image already associated with the time information is arranged for each time axis based on the time information of the original image. Screen information to be displayed as a list, and screen transmission means for transmitting to the information processing device;
In accordance with an instruction from the update processing control unit, the time information of the original image corresponding to the object for which the designation of the moving position has been received by the designation receiving unit is updated based on the time information of the moving position on the time axis. An information processing system program that functions as an updating unit that performs the processing.

Images