JP6485529B2 - Information processing apparatus, control method and program thereof, and information processing system, control method and program thereof - Google Patents

Description

  The present invention relates to an information processing apparatus capable of presenting a user with input candidates for comments to be added to uploaded image data, a control method thereof, a program, an information processing system, a control method thereof, and a program.

  There is a system that provides an online storage album in which an album of image data is created for each user on the online storage, and uploading of image data from the user and a comment attached thereto are stored in association with each other.

  The user uploads image data to such an online storage album, adds a comment, and registers it. Then, it is possible to easily share the image data by communicating the URL of the online storage album and the user ID to other users.

  In such a situation, comments given to image data are important. This is because the comment of the image data is used as a reference when other users do not know the situation in which the image data was captured. In addition, the comment may indicate a feeling or the like when the user has taken a picture, and is a clue to know the impression of the user who has taken the picture.

  Therefore, the user adds a comment to each image data when uploading the image data.

  Various inventions have been made to support the creation of comments on image data to be uploaded to an online storage album or the like. For example, a mechanism for automatically giving a comment to an image to be uploaded is disclosed. The image data is analyzed, a subject included in the image data is specified, a number of condition settings for giving information related to the specified subject to the image data are received from the user, and a comment is generated based on the setting.

JP 2013-97631 A

  When a comment is given to the specified subject based on the condition setting received from the user, mechanical information such as date / time, place, and weather, or information registered in advance is given. That is, the intention and emotion of the user who has taken the image are not reflected. Therefore, in order to give original comments instead of mechanical information, the user has to go back to his / her memory based on such date / time and place information and input again by himself / herself. .

  Furthermore, the user often has ambiguous memories at the time of shooting, making it difficult to give original comments to image data.

The present invention, which was made in view of the above problems, and an object thereof is to enable viewing readily associates the posted contribution data and the image data transmitted.

The present invention includes a management unit that manages association information of the first user information and second user, a post data posted by the first user, any at least position information or time information First acquisition means for acquiring post data including one of them, and second image data that is transmitted by the second user and includes at least one of position information and date / time information. an acquisition means, the position information or time information of the contribution data to be acquired by the first acquisition means, based on the position information or time information of the image data acquired by the second acquisition unit, the post data and the image and correlation means for attaching corresponding data, display control means for viewable display control by associating the posted data and the image data associated by said associating means, Characterized in that it obtain.

According to the present invention, an effect that may be to view the posted contribution data and the image data transmitted readily correlated.

It is a system configuration figure showing an example of composition of online photo storage server 103 and SNS contribution cooperation system of the present invention. 2 is a block diagram illustrating an example of a hardware configuration of a client terminal 101, an online photo storage server 103, and an SNS server 104. FIG. It is a schematic diagram which shows an example of schematic structure of the imaging device 102 which concerns on embodiment of this invention. 2 is a block diagram illustrating an example of a hardware configuration of a mobile terminal 105. FIG. 2 is a functional configuration diagram showing a module configuration of an online photo storage server 103. FIG. It is a flowchart explaining the imaging | photography process for the image data production | generation which corresponds to the advance preparation of this embodiment. It is a flowchart explaining the posting process to SNS which corresponds to prior preparation of this embodiment. FIG. 8 is a flowchart for explaining post processing to the SNS corresponding to advance preparation of the present embodiment following FIG. 7. It is a flowchart explaining the link process of the upload image and SNS contribution data which are the image data which upload to the online photo storage server 103. FIG. 10 is a flowchart for explaining in detail processing in which the client terminal 101 shown in FIG. 9 accepts login from the user to the online album. It is a flowchart which shows the detailed description of the SNS post | mailbox data correlation process of FIG. FIG. 12 is a flowchart showing a detailed description of the SNS post data association process of FIG. 9 following FIG. 11. FIG. 6 is a flowchart for displaying a screen on which the client terminal 101 can display an uploaded image and a comment that are actually uploaded. It is a block diagram which shows an example of a structure of the imaging device EXIF table 1400 data table for memorize | storing the image data produced | generated by imaging | photography of the imaging device 102. FIG. It is a block diagram which shows an example of a structure of the authentication table 1500 which memorize | stores the information for logging in to SNS which the SNS server 102 preserve | saved. It is a block diagram which shows an example of a structure of the SNS posting data table 1600 which has stored the SNS posting data whose SNS is "Txxxx" and the account is "abc123". It is a block diagram which shows an example of a structure of the SNS contribution data table 1700 which has memorize | stored the SNS contribution data whose SNS is "Txxxxxxxx" and an account is "tyu444h". It is a block diagram which shows an example of a structure of the SNS contribution data table 1800 which has memorize | stored the SNS contribution data whose SNS is "fxxxx" and an account is "890xyz". It is a block diagram which shows an example of a structure of the SNS image EXIF table 1900 which stores the imaging | photography date information and GPS information which the image data contributed to SNS contains. It is a block diagram which shows an example of a structure of the online album table 2000 which stores the data finally registered as a comment in an online album. It is a schematic diagram which shows an example of the screen which can receive selection of the upload image from a user. It is a schematic diagram which shows an example of the screen which can add and edit a comment to a several uploaded image from a user, respectively. FIG. 10 is a schematic diagram illustrating an example of a screen displayed on the client terminal 101 when an online album is actually accessed after uploading an uploaded image. It is a schematic diagram which shows an example of the screen which can receive the input of information from a user beforehand in order to use a SNS contribution comment link function. It is a block diagram which shows an example of a structure of the authentication table 2500 which stores the user name 2502 and the password 2503 required for login to the online album which can use a SNS contribution comment link function. It is a block diagram which shows an example of a structure of the registration SNS data table 2600 which stores the information of the cooperated SNS account received in FIG. FIG. 25 is a configuration diagram illustrating an example of a configuration of an initial information table 2700 that stores a time setting 2701, a distance setting 2702, and an account number 2703, which are references for associating an uploaded image with SNS posting data, accepted in FIG. It is a block diagram which shows an example of a structure of the SNS contribution data link result table 2800 which is the table which linked | related the specified SNS contribution data and the upload image.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a system configuration diagram showing an example of the configuration of an online photo storage server 103 (online storage server) and an SNS posting cooperation system (information processing system) according to the present invention.

  FIG. 1 illustrates a client terminal 101 (client terminal) such as one or a plurality of PCs or tablets, a portable terminal 105 such as a smartphone, one or more online photo storage servers 103, and one or more SNS servers 104 (SNS. Server) via the Internet 110.

  The online photo storage server 103 accepts login from the client terminal 101 or the like and accepts upload of image data for each user.

  The SNS server 104 provides a social networking service (SNS) that can accept posts for each user by the client terminal 101 and the mobile terminal 105 and display those posts for each user.

  FIG. 2 is a block diagram illustrating an example of a hardware configuration of the client terminal 101, the online photo storage server 103, and the SNS server 104.

  Hereinafter, the hardware configuration of the client terminal 101, the online photo storage server 103, and the SNS server 104 illustrated in FIG. 1 will be described with reference to FIG.

  In FIG. 2, a CPU 201 is a CPU, and comprehensively controls each device and controller connected to the system bus 204. Further, the ROM 202 or the external memory 211 is necessary to realize a BIOS (Basic Input / Output System) or an operating system program (hereinafter referred to as an OS), which is a control program of the CPU 201, or a function executed by each server or each PC. Various programs to be described later are stored.

  A RAM 203 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program necessary for execution of processing from the ROM 202 or the external memory 211 into the RAM 203 and executing the loaded program.

  An input controller 205 controls input from a keyboard 209 or a pointing device such as a mouse (not shown).

  A video controller 206 controls display on a display device such as the display 210. A memory controller 207 is an external storage device (hard disk (HD), flexible disk (FD), or PCMCIA card slot that stores boot programs, various applications, font data, user files, editing files, various data, etc.). The access to the external memory 211 of a card type memory or the like connected via the USB is controlled.

  A communication controller 208 connects and communicates with an external device via a network (for example, the Internet 110 shown in FIG. 1), and executes communication control processing in the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the display 210 by executing outline font rasterization processing on a display information area in the RAM 203, for example. Further, the CPU 201 can accept a user instruction with a mouse cursor (not shown) on the display 210.

  Various programs to be described later for realizing the present invention are recorded in the external memory 211 (storage means), and are executed by the CPU 201 by being loaded into the RAM 203 as necessary. Furthermore, definition files and various information tables used when executing the program are also stored in the external memory 211, and a detailed description thereof will be described later.

  FIG. 3 is a schematic diagram illustrating an example of a schematic configuration of the imaging apparatus 102 according to the embodiment of the present invention.

  In FIG. 3, the photographing apparatus 102 is a so-called digital camera or the like, and includes a photographing lens 301, an imaging element (hereinafter referred to as “CCD”) 302, an analog-digital converter (hereinafter referred to as “ADC”) 303, Image processing unit 304, controller 310, buffer memory 311, flash ROM 312, interface circuit (hereinafter referred to as “I / F circuit”) 313, card holder 314, memory card 315, display driver 316, USB driver 318, operation unit 320 , And a GPS device 327.

  The lens 301 includes an objective lens, a zoom lens, a focus lens, and the like. The zoom lens and the focus lens are driven in the optical axis direction by a driving mechanism (not shown). The CCD 302 is composed of a CCD image sensor that forms an optical image incident through the lens 301, converts it into an electrical signal (analog signal), and outputs the electrical signal. The ADC 303 has a function of converting an electrical signal (analog signal) output from the CCD 302 into a digital signal.

  The image processing unit 304 includes a preprocessing unit 305, a YC processing unit 306, an electronic zoom processing unit 307, a compression unit 308, and an expansion unit 309. The image processing unit 304 generates image data from the digital signal output from the ADC 303, and performs various image processing. It has a function to perform.

  The pre-processing unit 305 has a function of performing white balance processing for adjusting the white balance of an image based on input image data and image gamma correction processing. The white balance process is a process of adjusting the color of an image so as to be close to the actual color, or adjusting the color to an appropriate color that matches a light source (such as a fluorescent lamp or sunlight). The gamma correction process is a process for adjusting the contrast of an image. Note that the pre-processing unit 305 can also perform image processing other than white balance processing and gamma correction processing.

  The YC processing unit 306 has a function of separating an image based on input image data into luminance information “Y”, luminance signal and blue color difference information “Cb”, and luminance signal and red color difference information “Cr”. Have The electronic zoom processing unit 307 has a function of trimming a part of an image (for example, a central part) with a predetermined size and enlarging the trimmed image to the size of the original image by signal processing. The electronic zoom processing unit 307 can, for example, cut out a central 3024 × 768 dot image from a photographed 1600 × 3200 dot image and enlarge it to a size of 1600 × 3200 dot while performing data interpolation.

  The compression unit 308 has a function of compressing image data by a compression format such as JPEG (Joint Photographic Expert Group). The decompression unit 309 has a function of decompressing compressed image data. For example, when compressing image data using the JPEG method, first, a discrete cosine transform process is performed (DCT process) that digitizes the ratio of high-frequency components and low-frequency components of image data. Next, a quantization process is performed for expressing the gradation or gradation of the image by a numerical value (quantization bit number). Finally, the image data is compressed by the Huffman encoding process. Specifically, the signal character string of the image data is segmented every predetermined bit, and a shorter code is given to a character string having a high appearance frequency. Note that the compression unit 308 and the decompression unit 309 can be omitted in the case of a method of recording image data without performing compression processing. Further, the image data compression format is not limited to the JPEG format, and the same processing can be performed even in a GIF (Graphical Interchange Format) format.

  The controller 310 is connected to the image processing unit 304, the buffer memory 311, the flash ROM 312, the I / F circuit 313, the display driver 316, the USB driver 318, the operation unit 320, and the GPS device 327. In addition, as a functional configuration, the controller 310 has a control unit (not shown) that outputs a control signal for controlling the operation of each unit in accordance with an input signal from the operation unit 320, and a recognition unit (recognizing a user). (Not shown).

  The buffer memory 311 temporarily stores image data when the image processing unit 304 performs image processing. The flash ROM 312 stores various setting information of the photographing apparatus 102. The I / F circuit 313 converts the image data output from the controller 310 into a data format that can be recorded on the memory card 315. The I / F circuit 313 converts image data read from the memory card 315 into a data format that can be processed by the controller 310.

  The card holder 314 includes a mechanism that allows the memory card 315 that is a storage medium to be attached to and detached from the photographing apparatus 102, and includes an electrical contact that enables data communication with the memory card 315. Further, the card holder 314 has a structure corresponding to the type of storage medium used in the photographing apparatus 102. The memory card 315 is a card-type storage medium that incorporates a semiconductor storage element such as a flash memory and is detachable from the card holder 314. The memory card 315 can record image data shot by the shooting device 102. In the present embodiment, the configuration of only the photographing apparatus 102 will be described. However, a storage unit provided in an information processing apparatus or the like that can communicate with the photographing apparatus 102 may be used in place of the memory card 315. The communication method between the imaging device 102 and the information processing device is not particularly limited. It may be wired or wireless. In this case, the photographing apparatus 102 includes a communication interface controller, and communicates with the information processing apparatus through the communication interface controller.

  The display driver 316 converts the image data output from the controller 310 into a signal that can be displayed on the liquid crystal display 317. Specifically, the display driver 316 performs processing for converting digital image data output from the controller 310 into an analog image signal, and then sets the image size to a size suitable for the size of the displayable area of the liquid crystal display 317. Perform the conversion process.

  The operation unit 320 includes a power switch 321, a mode dial 322, a shooting button 323, a cursor key 324, a zoom button 325, and a browse (playback) button 326. The operation unit 320 accepts an operation input from the user and receives a signal corresponding to the operation content. Is output to the controller 310. Note that the operation unit 320 includes operation buttons other than the illustrated operation buttons, but a description thereof will be omitted.

  The mode dial 322 is a rotatable dial for switching the mode of the photographing operation. The user can select a plurality of shooting operation modes by rotating the mode dial 322.

  The shooting operation mode is, for example, an Auto mode, a night view mode, a landscape mode, a portrait mode, or a user that easily displays the shooting settings (white balance, shutter speed, etc.) held by the shooting apparatus 102 in advance. Is a manual mode in which shooting settings can be arbitrarily set.

  The browse button 326 is a button for switching to a browse mode (image reproduction mode) for browsing captured image data. When the browse button 326 is pressed, the shooting mode is changed to the browsing mode. Note that the method for switching to the viewing mode is not limited to pressing the viewing button 326, and may be a transition method using a touch panel (not shown) on the liquid crystal display 317.

  In the browsing mode, the controller 310 reads setting information and image data from the memory card 315 mounted on the card holder 314 via the I / F circuit 313. The setting information includes the number of images recorded on the currently installed memory card 315 and the capacity of the recorded image data. The read image data is, for example, image data or thumbnail data for one image. Note that the image data read from the memory card 315 is compressed in a predetermined compression format as described above.

  The image data read from the memory card 315 is input to the display driver 316 via the I / F circuit 313 and the controller 310. The display driver 316 displays the input image data on the liquid crystal display 317.

  The cursor key 324 is a key for the user to perform a predetermined instruction or function selection for the photographing apparatus 102. The user can perform operation inputs such as various setting information and user recognition information with respect to the imaging apparatus 102 with the cursor key 324. The cursor key 324 can display a menu screen on the liquid crystal display 317 and can select a predetermined function of the photographing apparatus 102.

  The GPS device 327 is a device that can receive radio waves sequentially transmitted by GPS (Global Positioning System) satellites, demodulate them, extract signals, and transmit the signals to the controller 310.

  FIG. 4 is a block diagram illustrating an example of a hardware configuration of the mobile terminal 105.

  The CPU 401 comprehensively controls each device and controller connected to the system bus 404.

  Further, the ROM 402 or the flash memory 414 has a BIOS (Basic Input / Output System), an operating system program (hereinafter referred to as an OS), which is a control program of the CPU 401, and a function necessary for realizing the functions executed by the portable terminal, which will be described later. Various programs to be stored are stored. The RAM 403 functions as a main memory, work area, and the like for the CPU 401.

  The CPU 401 implements various operations by loading a program or the like necessary for execution of processing into the RAM 403 and executing the program.

  The input controller 405 controls input from the touch panel 410, the microphone 411, the camera 412, and the GPS receiver 416. The touch panel 410 controls input related to a user's touch operation, the microphone 411 controls audio input, the camera 412 controls captured still images and moving images, and the GPS receiver 416 receives GPS. Controls the input of the signal that is received and demodulated by receiving the radio waves sequentially transmitted by the artificial satellite. The output controller 406 controls output to the touch panel 410 and the speaker 413.

  The touch panel 410 detects the touch operation from the user and displays the video sent from the output controller 406 described above. The touch panel 410 is a component in which a display and a position input device are integrated. Touch operations (hereinafter referred to as multi-touch) for a plurality of locations can also be detected.

  A memory controller (MC) 407 controls access to a flash memory 414 that stores a boot program, browser software, various applications, font data, user files, editing files, various data, and the like. In the present embodiment, the flash memory is described, but a storage medium such as a hard disk (HD), a flexible disk (FD), or a card type memory connected to a PCMCIA card slot via an adapter may be used.

  The communication I / F controller 409 is connected to and communicates with an external device via a network, and executes communication control processing on the network. For example, Internet communication using TCP / IP is possible.

  The sensor controller 408 controls input from the sensor 415 included in the mobile terminal 105. Various sensors exist in the sensor 415 of the portable terminal 105, such as an orientation sensor and an acceleration sensor.

  Note that the CPU 401 can perform display on the touch panel 410 by executing, for example, outline font development (rasterization) processing on a display information area in the RAM 403.

  Various programs and the like used for the portable terminal 105 of the present invention to execute various processes to be described later are recorded in the flash memory 414 and executed by the CPU 401 by being loaded into the RAM 403 as necessary. . Further, definition files and various information tables used by the program according to the present invention are stored in the flash memory 414.

  The GPS receiver 416 is a GPS radio wave receiver that receives radio waves sequentially transmitted by GPS (Global Positioning System) satellites, demodulates them, extracts signals, and transmits them to the input controller 405.

  Next, a functional configuration diagram showing module configurations of the client terminal 101, the online photo storage server 103, and the SNS server 104 will be described with reference to FIG. Note that the module configuration of the apparatus in FIG. 5 is an example, and there are various configuration examples depending on the application and purpose.

  In this embodiment, the client terminal 101 includes a communication control unit 509, a screen display unit 510, and an input reception unit 511.

  A communication control unit 509 of the client terminal 101 controls communication with the online photo storage.

  The screen display unit 510 of the client terminal 101 has a function of displaying a screen on the display 210.

  The input reception unit 511 of the client terminal 101 is a function that can receive input from the user.

  In this embodiment, the online photo storage server 103 includes a communication control unit 501, a character string analysis unit 502, an image data analysis unit 503, a date / position information determination unit 504, an SNS post data specifying unit 505, an image storage unit 506, a screen generation. Part 507 is provided.

  The communication control unit 501 of the online photo storage server 103 is a module that performs communication with the client terminal 101 and the SNS server 104. A screen request from the client terminal 101 is received, or a screen generated by the online photo storage server 103 is transmitted to the client terminal 101. Further, the module is capable of receiving SNS posting data from the SNS server 104.

  The character string analysis unit 502 is a module that can analyze the comment portion of the SNS post data.

  The image data analysis unit 503 of the online photo storage server 103 analyzes the image capture date / time and location of the image data by analyzing uploaded images and EXIF (Exchangeable image file format) information of image data posted to the SNS. To analyze.

  The date / position information determination unit 504 of the online photo storage server 103 compares the position information and date information included in the uploaded image with the position information and date information of the image data included in the SNS post data and SNS post data.

  The SNS post data specifying unit 505 of the online photo storage server 103 specifies the SNS post data associated with the uploaded image.

  The image storage unit 506 of the online photo storage server 103 stores the uploaded image and the comment attached thereto in the external memory 211 together.

  The screen generation unit 507 of the online photo storage server 103 generates a screen on which an online album to be transmitted to the client terminal 101 can be displayed.

  In this embodiment, the SNS server 104 includes a communication control unit 512, an SNS post data acquisition unit 513, and an SNS post data storage unit 514.

  The communication control unit 512 of the SNS server 104 can communicate the SNS post data with the mobile terminal 105 and can perform various communications with the online photo storage server 103.

  The SNS post data acquisition unit 513 of the SNS server 104 has a function of acquiring SNS post data stored in the SNS server 104.

  The SNS post data storage unit 514 of the SNS server 104 can store the SNS post data that has received a post.

  The overall flow of the SNS post comment link function to the online photo storage post image in this embodiment will be described below.

  In FIG. 6, a photographing process for generating image data corresponding to advance preparation of the present embodiment will be described.

  This processing is performed by the photographing apparatus 102, and when a photographing button (not shown) provided in the photographing apparatus 102 is pressed, photographing processing is performed and image data generated thereby is stored.

  In step S601, the controller 310 of the photographing apparatus 102 detects that a photographing button (not shown) is pressed.

  In step S <b> 602, the controller 310 of the photographing apparatus 102 performs photographing processing for the subject in the photographing possible area. Image data (image data) is generated by photographing processing.

  In step S603, the controller 310 of the photographing apparatus 102 acquires date information and position information on which the photographing process is performed in step S602.

  In step S604, the date / time information and the position information acquired by the controller 310 of the photographing apparatus 102 in step S603 are added to the image data generated for photographing.

  In step S605, the controller 310 of the imaging apparatus 102 stores the imaging apparatus EXIF table 1400 data table illustrated in FIG. 14 in the memory card 315 in the imaging apparatus 102 with the date and time information and position information added in step S604. FIG. 15 is a table illustrating a correspondence relationship between image data, date / time information, and position information of the imaging apparatus EXIF table 1400 of FIG. 14. A file name 1401 indicates the file name of the image data. The image data date / time information 1402 stores date / time information when the image data was generated. The GPS information 1403 stores position information such as GPS (Global Positioning System) information on which shooting has been performed.

  In FIG. 7 and FIG. 8, the posting process to the SNS corresponding to the advance preparation of the present embodiment will be described. This process is performed by the mobile terminal 105 and the SNS server 104, and shows a series of flows in which a user's post to the SNS is stored in the SNS server 104. In addition, the apparatus for a user to post to SNS is not limited to this.

  First, FIG. 7 will be described.

  In step S <b> 701, the CPU 401 of the mobile terminal 105 displays a screen on which a user name and password for logging in to the SNS can be received from the user.

  In step S702, the CPU 401 of the mobile terminal 105 receives an input of information for logging in to the SNS from the user.

  In step S <b> 703, the CPU 401 of the mobile terminal 105 receives an instruction from the user such as pressing an authentication request button, and transmits an SNS login request to the SNS server 104. In the login request, a user name that uniquely identifies the user and a password associated with the user name are transmitted.

  In step S704, the CPU 201 of the SNS server 104 receives the login request transmitted from the portable terminal 105 in step S703.

  In step S <b> 705, the CPU 201 of the SNS server 104 acquires the authentication table 1500 from the external memory 211. For example, the authentication table 1500 shown in FIG. The user ID 1501 is an ID that can uniquely identify an SNS account. The user name 1502 indicates a name registered in the SNS by the user, and is created by the user so as not to suffer from other users. A password 1503 indicates a password necessary for login associated with the user name 1502.

  In step S706, the CPU 201 of the SNS server 104 determines whether there is a registration of the user name included in the login request received in step S704, based on the authentication table 1500 acquired in step S705. If it is determined that there is a user registration and the password received in step S704 matches the password 1503, the process proceeds to step S707. On the other hand, if it is determined that there is no user registration or the password received in step S704 and the password 1503 are not matched, the process proceeds to step S708.

  In step S <b> 707, the CPU 201 of the SNS server 104 generates login OK data indicating information on successful login of the user determined to match as a result of collating the password received in step S <b> 704 with the password 1503.

  In step S708, login NG data indicating information indicating that the login of the user that has not been determined to match as a result of the CPU 201 of the SNS server 104 not registering or matching the password received in step S704 with the password 1503 has failed. Is generated. After generating login NG information, the process proceeds to step S709.

  In step S <b> 709, the CPU 201 of the SNS server 104 transmits the login result information generated in step S <b> 707 or step S <b> 708 to the mobile terminal 105.

  In step S <b> 710, the CPU 401 of the mobile terminal 105 receives the login result transmitted from the SNS server 104.

  In step S711, the CPU 401 of the mobile terminal 105 determines whether or not the login request received in step S703 has been received based on the login result received in step S710. If the login request is accepted, the process proceeds to step S712. If the login request is not accepted, the process proceeds to step S713.

  In step S712, the CPU 401 of the mobile terminal 105 displays a screen on which login is successful based on the login result received in step S710.

  In step S713, the CPU 401 of the mobile terminal 105 displays a screen on which login failed based on the login result received in step S710.

  Next, the description will be shifted to FIG.

  In step S714, the CPU 401 of the mobile terminal 105 displays a screen that can accept input from the user for posting to the SNS.

  In step S715, the CPU 401 of the mobile terminal 105 receives an input from the user on the screen displayed in step S714.

  In step S716, the CPU 401 of the mobile terminal 105 receives a posting instruction from the user. In this embodiment, the instruction is determined based on whether or not a posting button (not shown) on the display screen is pressed.

  In step S717, the CPU 401 of the mobile terminal 105 acquires date information and position information of the mobile terminal 105 at the time when the posting instruction is received in step S716.

  In step S718, the CPU 401 of the mobile terminal 105 transmits the SNS post data (SNS post data) received in step S715 to the SNS server 104 including the date information and the position information acquired in step S717.

  In step S719, the CPU 201 of the SNS server 104 receives the SNS posting data including the date information and the position information when transmitted from the portable terminal 105 in step S718.

  In step S720, the CPU 201 of the SNS server 104 performs storage processing for storing the SNS post data received in step S719 in the external memory 211. The storage format is as shown in FIGS.

  The SNS post data table 1600 in FIG. 16 stores SNS post data with an SNS of “Txxxx” and an account of “abc123”.

  The SNS ID 1601 indicates an ID for uniquely identifying the SNS post data posted by the user.

  A date and time 1602 indicates date and time information when the SNS posting data is posted.

  The GPS 1603 stores GPS information indicating the position information where the SNS posting data is posted.

  An image file 1604 indicates the file name of the image data included in the SNS post data.

  The posted text 1605 stores a comment part included in the SNS posted data.

  The SNS post data table 1700 in FIG. 17 stores SNS post data with an SNS of “Txxxx” and an account of “tyu444h”.

  The SNS post data table 1800 in FIG. 18 stores SNS post data with an SNS of “fxxxxx” and an account of “890 xyz”.

  In step S721, the CPU 201 of the SNS server 104 transmits a result of successful posting of the SNS posting data stored in step S720.

  In step S722, the CPU 401 of the mobile terminal 105 receives the posting result transmitted in step S721.

  In step S723, the CPU 401 of the mobile terminal 105 generates and displays a screen that notifies the user of the posting result based on the posting result received in step S722.

  Next, a series of flow of image upload to the online photo storage server 103 that provides an online album will be described.

  FIG. 9 shows a flow of a link process between an upload image that is image data to be uploaded to the online photo storage server 103 and the SNS post data.

  In step S <b> 801, the CPU 201 of the client terminal 101 performs processing for accepting login to the online album from the user. This process will be described in detail later with reference to FIG. When the login is accepted from the user, the process proceeds to step S802.

  In step S802, the CPU 201 of the client terminal 101 acquires from the online photo storage server 103 a screen for accepting an instruction to switch to a mode in which uploading of uploaded images can be accepted from the user, and displays the screen (not shown).

  In step S <b> 803, the CPU 201 of the client terminal 101 determines whether an instruction to switch to a mode in which uploading of uploaded images can be received from the user has been received. This determination is made by accepting pressing of an image data upload button (not shown). The determination method is an example and is not limited to this. If it is determined that the user has received an instruction to switch to a mode in which uploading of uploaded images can be accepted, the process proceeds to step S804. If it is not determined that an instruction to switch to a mode in which uploading of uploaded images can be received from the user is received, this processing is terminated.

  In step S804, the CPU 201 of the client terminal 101 displays a screen that can accept selection of an upload image from the user. For example, FIG. 21 is an image diagram of a screen that can accept selection of an upload image from the user.

  In step S805, the CPU 201 of the client terminal 101 accepts selection of an upload image. In FIG. 21, when selection of the add image button 2101 is accepted, a screen on which an upload image can be selected is displayed (not shown). When an upload image selection is received from the user on the screen, the upload image is displayed in the image display area 2102. As a result, the user can visually confirm the uploaded image to be uploaded.

  In step S806, the CPU 201 of the client terminal 101 first accepts a selection as to whether or not to use the SNS post comment link function, which is a process for associating the uploaded image with the SNS post data. After accepting the selection, together with the selection result and the image data selected in step S805, the online photo storage server 103 sends a request for a screen that allows a user to add and edit a comment to each of a plurality of uploaded images. Send to.

  For example, in FIG. 21, an automatic link selection reception area 2103 is an item for receiving designation as to whether or not to link an uploaded image and SNS posting data. In this embodiment, when the selection of “link” is accepted, a function for linking the uploaded image and the SNS post data is used. On the other hand, if the selection of “no link” is accepted, the function for linking the uploaded image and the SNS post data is not used. Unless any selection is accepted, the upload image confirmation 2104 is grayed out and cannot be selected. When the selection of the upload image confirmation 2104 is accepted, the online photo storage server 103 is requested to request a screen on which comments can be added and edited from the user. Note that the method of accepting selection of whether to perform automatic linking is merely an example, and the present invention is not limited to this.

  In step S807, the CPU 201 of the online photo storage server 103 requests the screen transmitted in step S806, the selection result of whether or not to use the SNS post comment link function, and the image of the upload image selected in step S805. Data and receive.

  In step S808, the CPU 201 of the online photo storage server 103 reads the image data received in step S807 into the RAM 203.

  In step S809, the CPU 201 of the online photo storage server 103 determines whether to use the SNS post comment link system based on the selection result of whether to use the SNS post comment link system received in step S807. If it is determined that the SNS post comment link system is used, the process proceeds to step S810. If it is not determined that the SNS post comment link system is used, the process proceeds to step S811.

  In step S810, the CPU 201 of the online photo storage server 103 performs processing for associating SNS posting data with an uploaded image. An example of a data table as a result of processing for associating SNS post data with an upload image is an SNS post data link result table 2800 shown in FIG.

  In FIG. 28, ID 2001 is an ID for uniquely identifying an uploaded image. An image title 2002 is a title attached to the uploaded image.

  An image file name 2003 indicates the file name of the uploaded image.

  The shooting date 2004 stores information indicating the date and time when the uploaded image was shot.

  The image GPS information 2005 stores location information of the uploaded image taken.

  The related SNS 2006 stores the SNS and the SNS account that have been linked in step S810, and information that uniquely identifies the SNS post data of the account.

  The account reference number 2007 stores the number of times the SNS account is referenced. When it is determined in step S1021 that there is no SNS post data that is not referenced, the account reference number 2007 is incremented by one. “99” is a number assigned in the sense that the SNS post data can be specified when the SNS post data specified in step S1022 and the upload image are linked. “3” indicates that three accounts have been referred to, and that “3” in the priority number 2601 of the registered SNS data table 2600 in FIG. 26 has been referred to. That is, the SNS 2602 refers to “Txxxx” and the user name 2603 refers to “tyu444h”.

  The other person flag 2008 stores information indicating whether or not the SNS account associated with the uploaded image belongs to another person. This is created based on information attached to the other person flag 2604 of the registered SNS data table 2600 in FIG.

  A registered comment sentence 2009 stores a comment of SNS post data associated with an uploaded image.

  Details will be described later with reference to FIG. After the processing is completed, the process proceeds to step S812.

  In step S811, the CPU 201 of the online photo storage server 103 has not determined to use the SNS post comment link system, so the process advances to step S812 while leaving the comment column of the uploaded image blank.

  In step S812, the CPU 201 of the online photo storage server 103 generates a screen on which comments can be added and edited by the user to each of a plurality of uploaded images. (Screen generation means) For example, an upload image confirmation screen 2200 as shown in the screen example of FIG. 22 is generated.

  An image data display area 2201 in FIG. 22 indicates an area for displaying an uploaded image. This is acquired from the image file name 2003 in the SNS post data link result table 2800 shown in FIG.

  A comment area 2202 indicates an area in which a comment associated with the uploaded image is displayed in an editable manner. When SNS posting data is linked to the uploaded image in step S810, the SNS posting data is displayed. This is acquired from the registered comment sentence 2009 in the SNS post data link result table 2800 shown in FIG.

  The comment citation source information 2203 indicates information of SNS posting data associated with the uploaded image. In the present embodiment, the name, account, and posting date / time of the SNS to be linked are described. This is acquired from the related SNS 2006 of the SNS post data link result table 2800 shown in FIG.

  Further, based on the related SNS 2006 in the SNS post data link result table 2800, it is determined whether there is an upload image with the related SNS 2006 overlapping (determination means). If there is an upload image, the upload image in FIG. As shown by the parts 2 and 3, the uploaded images overlapping the related SNS 2006 are displayed small, and the fact that the same comment is given is displayed and notified. As a result, the user can recognize that the same comment is registered as it is.

  In step S813, the CPU 201 of the online photo storage server 103 transmits the screen generated in step S812 to the client terminal 101. (Screen transmission means)

  In step S814, the CPU 201 of the client terminal 101 receives the screen transmitted in step S813. (Screen receiving means)

  In step S815, the CPU 201 of the client terminal 101 causes the display 210 to display the screen received in step S814. (Screen display means)

  In step S816, the CPU 201 of the client terminal 101 accepts editing of a comment for each uploaded image on the screen displayed in step S815.

  In step S817, the CPU 201 of the client terminal 101 transmits the comment (comment) accepted for editing in step S816 to the online photo storage server 103.

  In step S818, the CPU 201 of the online photo storage server 103 receives the comment transmitted in step S817.

  In step S819, the CPU 201 of the online photo storage server 103 registers the comment received in step S818 as a comment associated with the uploaded image. For example, registration is performed by overwriting the registered comment sentence 2009 in the SNS post data link result table 2800 shown in FIG. 28 (comment registration means). The result of overwriting is an online album table 2000 shown in FIG. This finally becomes data registered as a comment in the online album.

  FIG. 10 is a flowchart for explaining the details of the login acceptance process to the online album provided by the online photo storage server 103. Note that the method for logging in to the online album is not limited to this.

  In step S <b> 901, the CPU 201 of the client terminal 101 displays a screen that allows the user to input information for logging in to the online photo storage server 103.

  In step S902, the CPU 201 of the client terminal 101 receives an input of information for logging in to the online photo storage server 103 from the user.

  In step S <b> 903, the CPU 201 of the client terminal 101 receives an instruction from the user, such as pressing an authentication request button, and transmits a login request to the online photo storage server 103. Here, the login request includes a user name that is registered by the user in the online album and a password associated therewith. An online album is an album on the Internet that can display image data and comments stored for each user account.

  In step S904, the CPU 201 of the online photo storage server 103 receives the login request transmitted from the client terminal 101 in step S903.

  In step S <b> 905, the CPU 201 of the online photo storage server 103 acquires the authentication table 2500 from the external memory 211. For example, the authentication table 2500 shown in FIG. The management number 2501 is a number that can uniquely identify the account of the online album. A user name 2502 indicates a name registered by the user in the online album, and is created by the user so as not to suffer from other users. A password 2503 indicates a password associated with the user name 2502.

  In step S906, the CPU 201 of the online photo storage server 103 determines whether the user name and password included in the login request received in step S904 are registered based on the authentication table 2500 acquired in step S905. . If it is determined that there is a user registration and the password received in step S904 matches the password 2503, the process proceeds to step S908. If there is no user registration or the password received in step S904 and the password 2503 are collated and it is determined that they do not match, the process proceeds to step S907.

  In step S907, the CPU 201 of the online photo storage server 103 indicates information indicating that the user has failed to log in as a result of checking that the user has not registered or the password received in step S904 does not match the password 2503. , Login NG data is generated. After generating login NG data, the process proceeds to step S909.

  In step S908, the CPU 201 of the online photo storage server 103 has succeeded in the login of the user who has been determined to match as a result of collating the password not registered in step S906 or the password received in step S904 with the password 2503. The login OK data indicating the information is generated. After the login OK data is generated, the process proceeds to step S909.

  In step S909, the CPU 201 of the online photo storage server 103 transmits the login result data generated in step S907 or step S908 to the client terminal 101.

  In step S <b> 910, the client terminal 101 receives the login result transmitted from the online photo storage server 103.

  In step S911, the CPU 201 of the client terminal 101 determines whether or not the login request received in step S903 has been received based on the login result received in step S910. If the login request is accepted, the process proceeds to step S913. If the login request is not accepted, the process proceeds to step S912.

  In step S912, the CPU 201 of the client terminal 101 displays a screen on which login was successful based on the login result received in step S910.

  In step S913, the CPU 201 of the client terminal 101 displays a screen on which login failed, based on the login result received in step S910.

  FIG. 11 is a flowchart showing a detailed description of the process of associating the SNS post data with the image data in step S810.

  In step S1001, the CPU 201 of the online photo storage server 103 reads the initial setting of the SNS post comment link function. For example, the data tables in FIGS. 26 and 27 are read.

  FIG. 26 shows a registered SNS data table 2600 which is a table showing the priority order of SNS accounts associated with online albums. The priority number 2601 uniquely indicates the priority order of registered SNS accounts. The SNS 2602 indicates the type of registered SNS. A user name 2603 indicates a user ID used when logging in to the SNS 2602. The other person flag 2604 (account information) stores information indicating whether the account is an account of another person. In FIG. 26, “1” is a flag indicating that it is an account of another person, and “0” is a flag indicating that it is not a flag of another person (self). When the field for entering account information in the screen example of FIG. 24 corresponds to the “reference to other user posting” field, “1” indicating that the account is for another person is stored. The registered SNS data table 2600 is an example, and the present invention is not limited to this.

  FIG. 27 shows an initial information table 2700 which is a data table serving as a reference for associating uploaded images with SNS post data. A time setting 2701 indicates a setting of a reference time when searching for SNS post data associated with an uploaded image. In FIG. 27, since “5 min.” Is set, the setting is such that SNS posted data whose difference from the shooting date and time of the image data is within 5 minutes is searched. The distance setting 2702 indicates a setting of a distance as a reference when searching for SNS post data associated with an uploaded image. In FIG. 27, since it is “500 m”, the setting is to search for SNS posted data whose difference from the image data shooting location is within 500 m. The number of accounts 2703 indicates the upper limit number of SNS accounts used by the user in the SNS post comment link function. This is generated based on the registered SNS data table 2600. Thereby, the upper limit frequency | count which acquires SNS contribution data from SNS can be grasped | ascertained. The initial information table 2700 is an example, and the present invention is not limited to this.

  Note that the initial information table 2700 is generated by receiving input from a user in advance from a screen such as the initial setting registration screen 2400 of FIG. The date / time error allowable range 2402 is associated with the time setting 2701 and the GPS error allowable range 2403 is associated with the distance setting 2702, and when the update button 2404 is pressed, the update is performed. Further, the linked SNS 2401 and the registered SNS data table 2600 are linked to each other and updated when the update button 2404 is pressed.

  In step S <b> 1002, the CPU 201 of the online photo storage server 103 specifies an SNS and an SNS account that request SNS posting data.

  In the specific method, when the process of step S1002 is performed subsequent to step S1001, the SNS account with the highest priority is specified based on the priority number 2601 and the user name 2603 of the registered SNS data table 2600 of FIG.

  In FIG. 26, the SNS account with the highest priority is “abc123”.

  On the other hand, when the process of step S1002 is performed subsequent to step S1024, an account that is not an account for which SNS post data has already been acquired in step S1007 is specified by the user name 2603 of the registered SNS data table 2600 of FIG.

  For example, if the SNS post data “abc123” has already been acquired in step S1007, the user name 2603 of the registered SNS data table 2600 in FIG. 26 identifies “890xyz”, which is the next highest priority number account. .

  In step S1003, the CPU 201 of the online photo storage server 103 transmits an SNS post data acquisition request to the SNS server 104 that holds the SNS account specified in step S1002. (SNS post data request means)

  The acquisition request is a request for SNS posting data of the account with the user name 2603 shown in FIG. 26 identified in step S1002.

  In step S1004, the CPU 201 of the SNS server 104 receives the SNS post data acquisition request transmitted in step S1003.

  In step S1005, the CPU 201 of the SNS server 104 searches for and acquires all the SNS post data of the account based on the acquisition request for a plurality of SNS post data for the user name 2603 received in step S1004.

  For example, SNS post data tables 1600, 1700, and 1800, which are data tables of SNS post data for each account as shown in FIGS. A description will be given by taking FIG. 16 as an example. The SNS post data table 1600 is stored for each user, and the SNS ID 1601 is an ID that uniquely indicates the SNS post data of the user. The date 1602 indicates date information posted by the user to the SNS. GPS1603 shows the positional information which the user contributed to SNS. The image file 1604 describes the file name of the image data when the user makes a post with the image data attached to the SNS. The posted text 1605 indicates the content posted by the user to the SNS.

  In step S1006, the CPU 201 of the SNS server 104 transmits the plurality of SNS post data acquired in step S1005 to the online photo storage server 103. (SNS post data transmission means)

  In step S1007, the CPU 201 of the online photo storage server 103 receives the SNS post data transmitted in step S1006. (SNS post data receiving means)

  In step S1008, the CPU 201 of the online photo storage server 103 determines whether there is image data that does not refer to the SNS post data specified in step S1002 from the image data read in step S808. If it is determined that there is image data that does not refer to SNS post data, the process proceeds to step S1009. If it is not determined that there is image data that does not refer to SNS post data, the process proceeds to step S1023. .

  In step S <b> 1009, the CPU 201 of the online photo storage server 103 acquires image data date / time information 1402 and GPS information 1403 included in an upload image for linking SNS post data. (EXIF information acquisition means)

  In step S1010, the CPU 201 of the online photo storage server 103 acquires the date 1602 and GPS 1603 included in the SNS post data received in step S1007.

  In step S1011, the CPU 201 of the online photo storage server 103 refers to the image data date / time information 1402 of the uploaded image acquired in step S1009 and the date / time 1602 of the SNS post data acquired in step S1010, and the time setting read in step S1001. It is determined whether or not the condition 2701 is satisfied. If it is determined that the condition is satisfied, the process proceeds to step S1022. If it is not determined that the condition is satisfied, the process proceeds to step S1012. (SNS post data identification means)

  For example, a method of specifying the SNS post data associated with “P1000054.JPG” in the table of FIG. 14 from the SNS post data table 1600 of FIG.

  In step S1009, image data date / time information 1402 which is date / time information of “P1000054.JPG” and GPS information 1403 which is GPS information are acquired.

  In step S1010, date 1602 which is date information of “1” of SNS ID 1601 of the SNS post data table 1600 and GPS 1603 which is GPS information are acquired.

  In step S1011, the image data date / time information 1402 of “P1000054.JPG” is compared with the date / time 1602 acquired in step S1010, and it is determined whether or not the difference is within the range of the time setting 2701 in FIG. In this case, since it is within the range of the time setting 2701, the SNS posting data associated with “P1000054.JPG” is specified as the SNS posting data with the SNS ID 1601 of “1”.

  Next, the SNS post data linking process will be described in detail with reference to FIG.

  In step S1012, the CPU 201 of the online photo storage server 103 refers to the GPS information 1403 of the uploaded image acquired in step S1009 and the GPS 1603 of the SNS post data acquired in step S1010, and the conditions of the distance setting 2702 read in step S1001 It is determined whether it is within. (SNS post data identification means)

  Note that the image data date / time information 1402 and date / time 1602 of the uploaded image are within 24 hours. This is to prevent SNS post data from a completely different date when SNS post data is determined under GPS conditions.

  If it is determined that the condition is satisfied, the process proceeds to step S1022. If it is not determined that the condition is satisfied, the process proceeds to step S1013.

  In step S1013, the CPU 201 of the online photo storage server 103 acquires image data included in the SNS post data. For example, an SNS image EXIF table 1900 which is a data table of image data as shown in FIG. 19 is acquired.

  In step S1014, the CPU 201 of the online photo storage server 103 acquires date information and GPS information included in the image data acquired in step S1013. The shooting date 1902 and GPS information 1903 of the SNS image EXIF table of FIG. 19 are acquired.

  In step S1015, the CPU 201 of the online photo storage server 103 refers to the image data date / time information 1402 of the uploaded image acquired in step S1009 and the shooting date / time 1902 of the image data acquired in step S1014, and sets the time read in step S1001. It is determined whether or not the condition 2701 is satisfied. If it is determined that the condition is satisfied, the process proceeds to step S1022. If it is not determined that the condition is satisfied, the process proceeds to step S1016. (SNS post data identification means)

  In step S1016, the CPU 201 of the online photo storage server 103 refers to the GPS information 1403 of the uploaded image acquired in step S1009 and the GPS information 1903 of the image data acquired in step S1014, and the distance setting 2702 read in step S1001. It is determined whether or not the condition is satisfied. (SNS post data identification means)

  Note that the image data date / time information 1402 and the shooting date / time 1902 of the uploaded image are within 24 hours. This is to prevent SNS post data from a completely different date when SNS post data is determined under GPS conditions.

  If it is determined that the condition is satisfied, the process proceeds to step S1022. If it is not determined that the condition is satisfied, the process proceeds to step S1017.

  In step S1017, the CPU 201 of the online photo storage server 103 acquires a comment included in the SNS post data. Here, it is a process performed in order to detect the SNS posting data which could not be detected by the date and GPS conditions based on the comments included in the SNS posting data.

  In step S1018, the CPU 201 of the online photo storage server 103 analyzes the comment word (character string) acquired in step S1017 (position information analysis unit). The comment analysis method uses conventional technology. For example, when there is a comment “I am in Tokyo Tower”, “Tokyo Tower” is analyzed as a word.

  In step S1019, based on the result analyzed by the CPU 201 of the online photo storage server 103 in step S1018, the position information associated with the SNS post data is specified and acquired (position information specifying means). The position information is specified using a conventional technique. For example, by transmitting the word analyzed in step S1018 to the API of the map information service provided via the Internet, it is possible to acquire location information where the place name or landmark indicated by the word exists. The location information of Tokyo Tower is specified from the word “Tokyo Tower” analyzed in Step S1018. After identifying the location information of Tokyo Tower.

  In step S1020, the CPU 201 of the online photo storage server 103 refers to the GPS information 1403 of the uploaded image acquired in step S1009 and the location information of the SNS post data acquired in step S1019, and the distance setting 2702 read in step S1001 is read. It is determined whether or not the condition is satisfied. If it is determined that the condition is satisfied, the process proceeds to step S1022. If it is not determined that the condition is satisfied, the process proceeds to step S1021. (SNS post data identification means)

  In step S1021, the CPU 201 of the online photo storage server 103 determines whether there is SNS post data that is not referred to in the SNS post data received in step S1007. If it is determined that there is SNS post data that has not been referenced, the process returns to step S1010. If it is not determined that there is SNS post data that is not referenced, the process returns to step S1008.

  In step S1022, the SNS post data specified by the CPU 201 of the online photo storage server 103 and the image data are stored in association with each other. (SNS post data identification means)

  A data table in which the identified SNS post data and the uploaded image are linked is the SNS post data link result table 2800 shown in FIG. The SNS name, the user name 1502, and the SNS ID 1601 information of the specified SNS post data are stored in the related SNS 2006. The comment of the specified SNS posting data is stored in the registered comment sentence 2009.

  In step S1023, the CPU 201 of the online photo storage server 103 determines whether the account reference number 2007 in the online album table 2000 for all image data has reached the account number 2703 in the initial information table 2700. If it is determined that the account reference number 2007 in the online album table 2000 for all the image data has reached the account number 2703 in the initial information table 2700, the process is terminated. If it is not determined that the account reference number 2007 of the online album table 2000 for all the image data has reached the account number 2703 of the initial information table 2700, the process proceeds to step S1024.

  In step S1024, the CPU 201 of the online photo storage server 103 determines whether there is an SNS account at the next level.

  It is determined whether or not there is data of the priority number 2601 of the registered SNS data table 2600 of FIG. 26, which is the next number after the number of the account reference number 2007 of the SNS post data link result table 2800. For example, when the account reference number 2007 is “3”, it is determined whether or not there is data having a priority number 2601 of “4”.

  If it is determined that there is an account of the next level SNS, the process returns to step S1002. If it is not determined that there is a next level SNS account, the process is terminated.

  FIG. 13 is a flowchart for displaying a screen on which the client terminal 101 can display an uploaded image and a comment that are actually uploaded.

  In step S <b> 1101, the CPU 201 of the client terminal 101 receives a request to display a screen that can be displayed together with an uploaded image and a comment that are actually uploaded.

  In step S1102, the CPU 201 of the client terminal 101 transmits the screen display request received in step S1101 to the online photo storage server 103.

  In step S1103, the CPU 201 of the online photo storage server 103 receives the screen display request transmitted in step S1102.

  In step S1104, the CPU 201 of the online photo storage server 103 acquires the online album table 2000.

  In step S1105, the CPU 201 of the online photo storage server 103 generates a screen to be displayed based on the table acquired in step S1104. For example, the screen example of FIG. 23 is generated. In the upload image display area 2301, image data of the image file name 2003 in the online album table 2000 is displayed. The comment field 2302 displays a registered comment sentence 2009 in the online album table 2000 that is a comment finally registered by the user. The shooting information 2303 displays the shooting date and time when the uploaded image is uploaded based on the information of the shooting date and time 2004 in the online album table 2000.

  In step S1106, the CPU 201 of the online photo storage server 103 determines whether the SNS post data associated with the uploaded image is an account of another person based on the other person flag 2008 of the online album table 2000, and is the account of the other person. In some cases, a process for creating a link to the SNS posting data of the account is performed.

  For example, in FIG. 23, the SNS link 2304 is displayed.

  The SNS post data associated with the ID 2001 of the upload image indicates that the other person's account is indicated by the other person flag 2008. Since it is another person's account, based on related SNS2006, the SNS link 2304 which is a button of the link to the SNS contribution data of the said account is produced | generated.

  In step S 1107, the CPU 201 of the online photo storage server 103 transmits the screen generated in step S 1105 to the client terminal 101.

  In step S1108, the CPU 201 of the client terminal 101 receives the screen transmitted in step S1107.

  In step S1109, the CPU 201 of the client terminal 101 displays the screen received in step S1108.

  As described above, according to the present embodiment, there is an effect that it is possible to present to the user input candidates for comments to be given to uploaded image data.

  The present invention can be implemented as a system, apparatus, method, program, storage medium, or the like, and can be applied to a system including a plurality of devices. You may apply to the apparatus which consists of one apparatus.

  Note that the present invention includes a software program that implements the functions of the above-described embodiments directly or remotely from a system or apparatus. The present invention also includes a case where the system or the computer of the apparatus is achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Examples of the recording medium for supplying the program include a flexible disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, and CD-RW. In addition, there are magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R), and the like.

  As another program supply method, a browser on a client computer is used to connect to an Internet home page. The computer program itself of the present invention or a compressed file including an automatic installation function can be downloaded from the homepage by downloading it to a recording medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. Let It is also possible to execute the encrypted program by using the downloaded key information and install the program on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. In addition, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can also be realized by the processing.

  Further, the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are realized by the processing.

The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed as being limited thereto. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

101 Client Terminal 102 Imaging Device 103 Online Photo Storage Server 104 SNS Server 105 Portable Terminal 201 CPU
202 ROM
203 RAM
204 System Bus 205 Input Controller 206 Video Controller 207 Memory Controller 208 Communication I / F (Interface) Controller 209 Input Device 210 Display 211 External Memory 300 Imaging Device 301 Optical System (Lens)
302 Image sensor (CCD)
303 Camera Signal Processing Unit 310 System Controller 317 Display 320 Operation Unit

Claims (12)

Management means for associating and managing information of the first user and information of the second user;
The first a post data posted by a user, a first acquisition means for acquiring post data including at least one of position information or the date and time information,
The second an image data sent by the user, a second acquisition means for acquiring image data including at least one of position information or the date and time information,
And the position information or time information of the contribution data to be acquired by the first acquisition means, based on the position information or time information of the image data acquired by the second acquisition unit, giving correspondence between the post data and the image data Correspondence means;
Display control means for enabling the display control view in association with the post data and the image data associated by said associating means,
An information processing apparatus comprising: The information processing apparatus according to claim 1, wherein the first acquisition unit acquires the posted data from another information processing apparatus using the information of the first user . The management means manages the second user information and the plurality of first user information in association with each other,
Said associating means, according to the image data acquired by the second acquisition unit, characterized Rukoto associating the posted contribution data from said plurality of first user managed by said management means Item 3. The information processing apparatus according to item 1 or 2. The management means manages the priority order of the information of the plurality of first users,
The information processing apparatus according to claim 3 , wherein the association unit associates post data posted by the first user with the image data in accordance with a priority order managed by the management unit . Said associating means, the difference between the date and time information of the contribution data to be acquired by the first acquisition unit, date and time information of the image data acquired by the second acquisition unit is within a predetermined range, the contribution data an information processing apparatus according to claim 1, wherein the this associating the said image data. Said associating means comprises a difference between the location information of the contribution data to be acquired by the first acquisition means, the position information of the image data acquired by the second acquisition unit is within a predetermined range, the contribution data an information processing apparatus according to claim 1, wherein the this associating the said image data. Position information specifying means for specifying position information corresponding to the posted data from a character string included in the posted data; and
Said associating means includes a position information identified by the position information specifying unit, by using the position information of the image data acquired by the second acquisition unit, that associates with the posted data and the image data The information processing apparatus according to claim 1, wherein: Before Symbol display control means, when said projecting draft data is determined to be associated with the plurality of image data, 1 to claim, characterized in that identifiably displayed controlling the plurality of images data 8. The information processing apparatus according to 7. Wherein the display control unit, before SL information processing apparatus according to claim 1 to 8, characterized in that the display control links to post data acquired by the first acquisition unit. The first acquisition means acquires post image data that includes at least one of photographed position information and date / time information that is posted together with post data,
Said associating means, wherein when it is not possible to associate the image data and projecting draft data acquired by the second acquisition unit, time information or position information included in the post image data acquired by the first acquisition means was used to identify the corresponding post image data of the image data, the information processing according to claim 1 to 9, wherein the post data posted with the posted data, that associating the said image data apparatus. A management step of managing information of the first user and information of the second user in association with each other;
A first acquisition step of acquiring post data posted by the first user and including at least one of position information and date and time information;
A second acquisition step of acquiring image data transmitted by the second user and including at least one of position information and date and time information;
And the position information or time information of the contribution data acquired in the first acquisition step, based on the position information or time information of the image data acquired in the second acquisition step, applying corresponding and the post data and the image data A corresponding process;
A display control step of viewable display control by associating the posted data and the image data associated by said associating step,
An information processing apparatus control method comprising: Management means for associating and managing information of the first user and information of the second user;
First acquisition means for acquiring post data that is post data posted by the first user and includes at least one of position information and date and time information;
The second an image data sent by the user, a second acquisition means for acquiring image data including at least one of position information or the date and time information,
And the position information or time information of the contribution data to be acquired by the first acquisition means, based on the position information or time information of the image data acquired by the second acquisition unit, giving correspondence between the post data and the image data Correspondence means;
A program which can be read and executed by an information processing apparatus, which functions as display control means for controlling display so as to be associated with post data and image data associated with each other by the association means.

Images