JP5503597B2 - Mobile terminal, communication method and program using mobile terminal - Google Patents

Description

  The present invention relates to a mobile terminal, a communication method using the mobile terminal, and a program.

I would like to say thank you for the day at joint parties, social gatherings, seminars, etc., and keep in touch with the people I met that day. However, it is troublesome to search on Facebook after returning home, or to send an e-mail by entering an address from a business card, and the face and name may not match only with a business card.
Patent Documents 1 to 5 disclose techniques related to the present invention.

JP 2010-152477 A JP 2009-175887 A JP 2009-113084 A JP 2005-267146 A Japanese Patent Laid-Open No. 2005-191911

  The problem to be solved by the present invention is completely new. That is, an object of the present invention is to carry out the connection between a person and an address with a simple and intuitive operation, and to carry out message exchange with a person visually using the associated address. The object is to provide a communication method and program using a terminal and a portable terminal.

  The portable terminal according to the present invention includes an imaging unit capable of imaging a nearby region, a display unit capable of displaying a photograph taken by the imaging unit, and an address from the portable terminal present in the nearby region. Between the acquisition unit for acquiring the image, the photograph displayed on the display unit, the person reflected in the displayed photograph and the address acquired by the acquisition unit, and the portable terminal existing in the vicinity region Messages are exchanged between the creation unit for creating the communication screen including the photograph for exchanging messages using the address and the mobile terminal existing in the vicinity area via the communication screen. And a communication unit for performing.

  In the present invention, since the address is acquired from the mobile terminal existing in the vicinity area, it is not necessary to input the address, and the acquired address is associated with the person shown in the photograph. And addresses can be linked with simple and intuitive operations, and messages can be exchanged visually with people using the linked addresses.

In the present invention, the acquisition unit detects the mobile terminal existing in the vicinity area by transmitting the position information of the mobile terminal to a system capable of detecting the mobile terminal existing in the vicinity area of the mobile terminal. This may be requested or notified to the mobile terminal existing in the vicinity area, and the address of the mobile terminal existing in the vicinity area may be acquired from the system.
Here, as for location information, a method of specifying by GPS using the GPS communication function of the mobile terminal, a method of specifying by the position of the base station nearest to the mobile terminal, a wireless base of a store or a venue by the wireless LAN communication function of the mobile terminal A method of specifying by the position of the station may be acquired by, for example, or a combination of these methods may be acquired.
Thereby, an address can be easily acquired from a portable terminal existing in the vicinity region.

The present invention provides a QR code that allows the acquisition unit to input a mobile terminal that exists in the vicinity of the mobile terminal, and allows the input mobile terminal to transmit an address to the mobile terminal without inputting an address. You may comprise so that an address may be acquired from the portable terminal which displayed on the said display part and input the said QR code.
Thereby, an address can be easily acquired from a portable terminal existing in the vicinity region.

In the present invention, the display unit includes a touch screen, and the creation unit displays an object associated with the address acquired by the acquisition unit together with the photograph on the touch screen, and the object is displayed on the touch screen. The person shown in the photo may be tapped to link the person shown in the photo with the address acquired by the acquisition unit.
Thereby, it is possible to easily and reliably connect the person shown in the photograph and the address.

The present invention further includes a display control unit that visually connects the person who issued the message and the person shown in the photograph when the message is exchanged, and displays the communication screen on the display unit. You may comprise so that it may comprise.
This makes it easier for the person who sent the message to visually understand.

  In the communication method using the mobile terminal according to the present invention, an address is acquired from a mobile terminal existing in the vicinity area, a photograph of the vicinity area captured by the imaging section is displayed on the display section, and is reflected in the displayed photograph. Create a communication screen including the photograph for connecting a person and the acquired e-mail address, and exchanging messages using the address between the mobile terminal existing in the vicinity area, and the vicinity Messages are exchanged with the mobile terminal existing in the area via the communication screen.

  The program according to the present invention includes a step of acquiring an address from a portable terminal existing in a nearby area on a portable terminal, and a photograph of the neighboring area captured by the imaging unit is displayed on the display unit and is reflected in the displayed photograph. Linking a person and the acquired address; creating a communication screen including the photograph for exchanging messages using the address with a mobile terminal existing in the vicinity area; And a step of exchanging messages with the mobile terminal existing in the vicinity area via the communication screen.

  In the present invention, a person and an address can be associated with each other with a simple and intuitive operation, and messages can be exchanged visually with a person using the associated address.

It is a figure which shows the structure of the whole system which concerns on one Embodiment of this invention. It is a block diagram which shows the structure of the portable terminal shown in FIG. It is a figure which shows the transition of a screen until it shares a photograph and performs message exchange between the portable terminal which a photographer has, and the portable terminal which a sharer has. It is an example of the TOP screen It is an example of a user screen. It is an example of a camera screen. It is an example of a photo sharing setting screen. It is an example of a photo sharing screen. It is an example of a photo sharing screen. It is an example of a concrete TOP screen. It is an example of a screen on which a shared photo list is displayed. It is a display example of the thumbnail of the photograph shared by the photographer. It is an example of a photograph screen. It is an example of a message input screen. It is a flow which shows operation | movement of the whole system. It is a flow which shows operation | movement of the whole system. It is the operation | movement flow of the whole system in case a portable terminal is a mobile telephone etc. which do not have an application program. It is an example of the photograph sharing screen in the case of FIG. It is an example of the photograph sharing screen in the case of FIG. It is an example of the photograph sharing screen in the case of FIG. It is an example of the photograph sharing screen in the case of FIG. It is an operation flow of the entire system when a mobile terminal or the like simply has an e-mail address. It is an example of the mail in the case of FIG. It is an example of the screen for registration in the case of FIG. It is an example of the web page only for a user in the case of FIG. It is an example of the photograph screen in the case of FIG. It is a flow which shows the operation | movement of a part of system in the case of using a facebook account. It is a figure which shows the modification of dragging of a name tag on a photograph sharing screen. It is a figure which shows the modification of dragging of a name tag on a photograph sharing screen. It is a figure which shows the modification of dragging of a name tag on a photograph sharing screen. It is a figure which shows the modification of dragging of a name tag on a photograph sharing screen. It is a figure which shows the modification of the balloon display from the message column in a photograph screen. It is a figure which shows the modification of the balloon display from the message column in a photograph screen.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[System configuration]
FIG. 1 is a diagram showing a configuration of the entire system according to an embodiment of the present invention.
As shown in FIG. 1, a plurality of portable terminals 100 and 101 exist in the vicinity area 1. The mobile terminals 100 and 101 can be connected to the communication network 2.

  Examples of the mobile terminals 100 and 101 include a smartphone and a mobile phone. Here, it is assumed that the mobile terminal 100 is owned by a photographer, and the other mobile terminals 101 are owned by a sharer. A photographer refers to a person who takes a picture and distributes it to a sharer. A sharer refers to a person who receives a photograph from the photographer and participates in a conversation.

The vicinity area 1 is an area in the vicinity of the photographer, and refers to an area where a plurality of people related to the photographer gather. In other words, the neighborhood area 1 is an area where a group photo may be taken. As the neighborhood area 1, for example, areas where joint photographers are participating, seminars, social gatherings, areas where graduation ceremonies and reunions are held, new employees gather, and entrance An area where a ceremony is held, project members in the company gather, an area where families gather.
[Configuration of mobile terminal]
FIG. 2 is a block diagram illustrating the configuration of the mobile terminals 100 and 101.

  The mobile terminal 100 includes a control unit 111 including a CPU (Central Processing Unit), a ROM (Read Only Memory) 112, a RAM (Random Access Memory) 113, an input / output interface 115, a bus 114 that connects them, and a camera 116. And a touch screen 117.

The control unit 111 appropriately accesses the RAM 113 and the like as necessary, and comprehensively controls each block of the electronic device 100 while performing each calculation process. The control unit 111 controls display on the touch screen 117 according to a touch operation or a drag operation on the touch screen 117.
The ROM 112 is a non-volatile memory in which an OS to be executed by the control unit 111, firmware such as programs and various parameters, are fixedly stored.
The RAM 113 is used as a work area for the control unit 111 and temporarily holds the OS, various application programs being executed, and various data being processed.
A touch screen 117, a network 118, and the like are connected to the input / output interface 115.

The network 118 is connected to the communication network 2 by radio. The touch screen 117 includes, for example, a touch panel as an input device and a liquid crystal panel as a display unit.
[Overall system flow]

FIG. 3 is a diagram showing screen transitions until a message is exchanged between the portable terminal 100 owned by the photographer and the portable terminal 101 owned by the sharer, and a message is exchanged. Here, a case is shown in which both the mobile terminal 100 and the mobile terminal 101 have application programs for sharing photos and exchanging messages. 4 to 14 show examples of each screen. 15 and 16 are flowcharts showing the operation of the entire system such as a portable terminal.
-TOP screen (photo list screen) 300 (common screen for photographers and sharers)
The TOP screen 300 is the first screen when this application program is opened. A list of shared photos is displayed on the TOP screen 300.
FIG. 4 is an example of the TOP screen 300.

  The TOP screen 300 displays a list of shared photos 301. In these photographs 301, a mark 302 is displayed when a new person is added or when there is a new message. These can be scrolled, and when one of the photographs 301 is tapped on the screen, the photograph is opened, and messages are exchanged using a photograph (communication screen) described later.

  Below the list of photos 301, a share button 303, a camera button 304, and a user setting button 305 are arranged.

  Here, when the camera button 304 is tapped (step 1501), the camera screen 320 is displayed.

Note that when the user setting button 305 is tapped, the user setting on the user screen 310 is performed.
・ User screen 310 (common screen for photographer and sharer)

On the user screen 310, user settings are made. In the user settings, the user sets the application owner's user name, user photo, email address, SNS account, and so on.
FIG. 5 is an example of the user screen 310.

The user screen 310 includes items such as a user name 311, a user photo 312, the number of shared photos 313, an e-mail address 314, a Facebook account 315, and a twitter address 316. In the user name 311, a name displayed on the photograph is set. In the user photo 312, a face photo displayed when the user is photographed is set. The number of shared photos 313 displays the photos shared by the user and the number of shared photos. In the e-mail address 314, an e-mail address for receiving a message update is set. In the Facebook account 315, a Facebook account for sharing a photo in Facebook is set. In the twitter address 316, a twitter address for exchanging messages by twitter is set.
Below these items, a registration button 317 is arranged. When the registration button 317 is tapped, information set for the item is registered, and the screen returns to the TOP screen 300.
・ Camera screen 320
On the camera screen 320, the user takes a picture with the camera function in the application program or selects a picture stored in the portable terminal.
FIG. 6 is an example of the camera screen 320.

On the camera screen 320, the screen input to the camera 116 on the spot or the selected photograph 321 is displayed. Here, the input photo is a photo taken by the camera 116 on the spot (step 1501) and saved (step 1502), and the selected photo is a photo already taken and saved by the camera 116, Or it is a photograph obtained through memory or communication, and is a photograph selected by the user. The selectable photos 322 are displayed side by side below the photo 321 (step 1503). These photos 322 can be scrolled, and when one of the photos is selected by tapping (step 1504), it is displayed as a photo 321 (steps 1505 and 1506). A share button 323 is arranged on the camera screen 320. When the share button 323 is tapped (step 1507), the photo sharing setting screen 330 is displayed (steps 1508 and 1509).
・ Photo sharing setting screen 330
On the photo sharing setting screen 330, the user inputs the title of the photo, sets the sharing method, and instructs the start of sharing.
FIG. 7 is an example of the photo sharing setting screen 330.

  The photo sharing setting screen 330 includes items such as a photo list selection 331, a photo title 332, a message 333 from the photographer, and a public setting 334. In the photo list selection 331, a photo list corresponding to the genre of photos (alumni, work, school, etc.) is selected. In the photo title 332, the title of the photo is input. In the message 333 from the photographer, a message from the photographer is input. In the public setting 334, whether to upload a photo to Facebook is set, and whether to open a conversation to twitter is set. A registration button 335 is disposed at the bottom of the photo sharing setting screen 330. After the above input (steps 1510-1514), when the registration button 335 is tapped (step 1515), the share acceptance preparation is started (step 1516).

When the share acceptance preparation is started, the mobile terminal 100 requests the external service to acquire location information (step 1517), and the location information is obtained from the external service to the mobile terminal 100 (step 1518). . The position information, the photo, and the set value are uploaded from the portable terminal 100 to the front DB server (step 1519), and a web page of the photo is created by the front DB server and uploaded to the web server (step 1520). The Web server transmits a photo sharing URL to the mobile terminal 100 (step 1521). If the URL is set, the photo URL information is transmitted to the external service Facebook (step 1522). The front DB server notifies the mobile terminal 100 that sharing is in progress, and the photo sharing screen 340 is displayed by the application of the mobile terminal 100 (step 1523).
For example, the front DB server holds photographer information of a photograph shared by the photographer portable terminal 100, position information where the photograph is shared, and a photograph shared by the sharer terminal in the nearby region 1 You can search.
As for location information, a method of specifying by GPS using the GPS communication function of the mobile terminal, a method of specifying by the position of the base station nearest to the mobile terminal, and a wireless base station of a store or a venue by using the wireless LAN communication function of the mobile terminal The method of specifying by the position may be acquired by, for example, or a combination of these methods may be acquired.
・ Photo sharing button 303

  When the photographer taps the registration button 335 on the photo sharing setting screen 330 shown in FIG. 7, sharing by the photographer is started. In response to this, for example, the TOP screen 300 shown in FIG. 10 is displayed on the sharer's portable terminal 101 in the vicinity of the photographer's portable terminal 100, and when the photograph sharing button 303 is tapped here (step 1601). The sharer's portable terminal 101 requests the external service to acquire position information (step 1602), and the sharer's portable terminal 101 obtains the position information (step 1603). The position information of the terminal 101 is transmitted. The front DB server notifies the sharer's mobile terminal 101 of the information of the photo shared at the same position of the position information (step 1605).

Then, on the mobile terminal 101, as shown in FIG. 11, a shared photo list 350 is displayed. In the shared photo list 350, a photographer name, a title, and a thumbnail of the photo of a photographer who is sharing in the vicinity area are displayed. A user who wants to share selects a photo 351 to be shared from the shared photo list 350 by looking at the thumbnail, photographer, and photo title, for example, by tapping (step 1606). The selected information is transmitted from the sharer's portable terminal 101 to the front DB server (step 1607).
・ Photo sharing screen 340

After the operation on the sharer side, the sharer display name of the share applicant is transmitted from the front DB server to the inside of the photographer's mobile terminal 100 (step 1524). On the photo sharing screen 340, the name tag of the sharer who wants to share is displayed (step 1525). When the name tag of the sharer that the photographer may share is dragged into the photo (step 1526), the sharer It is set inside the portable terminal 100 (step 1527).
8 and 9 are examples of the photo sharing screen 340. FIG. FIG. 8 is a screen before a sharer applicant is input, and FIG. 9 is a screen after a sharer applicant is input.

On the photo sharing screen 340, a photo 341 to be shared and a photographer photo 342 are displayed. As the photographer photograph 342, a photograph of a photographer registered on the user screen 310 is displayed in the photograph 341. Adjacent to the photograph 341, a name tag 343 of a sharer applicant is arranged. A direct input field 344 and a QR code 345 are arranged below the photograph 341. In the direct input field 344, a user who cannot use the application program inputs an e-mail address, an SNS account, and a display name, thereby creating a name tag 343. The user of the mobile phone takes a QR code 345 and shares the photo.
That is, there are the following three methods for sharing photos by the sharer.
1) A user having this application program activates the user's application program and requests sharing.
2) Have the mobile phone user take a QR code with the mobile phone and send an e-mail.
3) Have other users register an e-mail address, Facebook account or twitter address and name in the direct entry field 344.

  As shown in FIG. 9, when the name tag 343 is dragged to the place of the person shown in the photograph (step 1526) and the completion button 346 is pressed (step 1528), the photographer's mobile terminal 100 is connected to the front DB server. The information on the registered sharer is transmitted (steps 1529 and 1530). In addition, when the completion button 346 is pressed (step 1528), a communication for terminating the shared state is transmitted to the front DB server (steps 1529 and 1530), or when a predetermined time has passed (step 1531), The photo sharing information is deleted from the DB server (step 1532), and it is not searched from the sharer terminal 101 as a photo shared at the same place.

Share notification is sent to the application program of the person tagged in the photo (registered sharer's portable terminal 101) (step 1608). Then, on the sharer's portable terminal 101, for example, as shown in FIG. 12, the thumbnail of the photograph 301 shared by the photographer is displayed (update mark 301a is displayed). When the user taps the photo 301 (step 1609), the information is transmitted to the front DB server (step 1610), and the photo is downloaded from the front DB server to the mobile terminal 101 of the sharer (step 1611).
Photo screen (communication screen) 360
On the photo screen 360, people who share the photo exchange messages.
FIG. 13 is an example of the photo screen 360.

  When the photograph screen 360 is reached, a photograph 361 is displayed. A person tag 362 indicating a person on the name plate is displayed in the photograph 361. Below the photo 361, a name plate 363 for displaying a person name in the photo is displayed. When the name plate 363 is tapped, the person tag 362 in the photograph 361 shines.

  Below the name plate 363, a message field 364 is provided for people who share photos to exchange messages. In the message field 364, the content of the conversation is displayed in a form as if a person in the photograph 361 is speaking using a balloon 368. Next to the message field 364, a scroll button 365 for scrolling the message field and viewing the message is arranged.

  Below the message column 364, a message button 366, a share button 367, and the like are arranged. When the message button 366 is pressed, a message input screen 370 as shown in FIG. 14 is opened. When the share button 367 is pressed, the photo sharing screen 340 shown in FIG. 8 is displayed, and a sharer can be added to the photo and the position of the person tag can be edited.

  Then, the sharer including the photographer inputs a message on the message input screen 370 (steps 1612 and 1535) and transmits it (steps 1613, 1536 and 1537), and the message is notified to each sharer via the front DB server. And displayed (steps 1614, 1533, 1534).

The above embodiment is a case where both the mobile terminal 100 and the mobile terminal 101 have an application program for sharing photos and exchanging messages. However, as already described, the mobile terminal 101 has an application program. The present invention can also be applied to a case where the mobile terminal 101 simply has a mail address when the mobile phone 101 is not a mobile phone.
[When the mobile terminal 101 is a mobile phone or the like that does not have an application program]
FIG. 17 shows an operation flow of the entire system in that case.

  A user of the mobile terminal 101 such as a mobile phone that does not have an application program photographs the QR code 345 displayed on the photo sharing screen 340 of the photographer's mobile terminal 100 in step 1523 on the camera of the mobile terminal 101 (step 1701). The QR code 345 is used to access the photo sharing URL to the Web server (step 1702). Then, a photo sharing screen is transmitted from the Web server to the mobile terminal 101 (step 1703).

  An example of the photo sharing screen is shown in FIGS. In the screen 410 shown in FIG. 18, the display name input screen 411 is opened on the mobile browser. Therefore, the name to be displayed on the photograph is input to the display name input screen 411 (step 1704), and the mail creation button 412 is pressed. Then, the mail screen 420 shown in FIG. 19 is activated, the display name 411 is entered in the subject 422, and a message to the photographer is entered in the message field 423 if necessary. The e-mail address for registration in the shared photo is input to the destination 421, and the e-mail is transmitted as it is. This mail is transmitted to the mail server (step 1705), and the mail address and display name are provisionally registered from the mail server to the front DB server (step 1706).

  Then, the sharer display name of the share applicant is transmitted from the front DB server to the inside of the photographer's portable terminal 100 (step 1524). On the photo sharing screen 340, the name tag of the sharer who wants to share is displayed (step 1525). When the name tag of the sharer that the photographer may share is dragged into the photo (step 1526), the sharer It is set inside the portable terminal 100 (step 1527).

  Thereafter, when the completion button 346 is pressed (step 1528), the information on the registered sharer is transmitted from the photographer's portable terminal 100 to the front DB server (steps 1529 and 1530), and the front DB server uses the mobile phone. A mail for the registered user is created, and the mail is transmitted to the portable terminal 101 via the mail server (steps 1707 and 1708). FIG. 20 shows an example of the mail. When “view photo” 431 is opened on the mail screen 430 (step 1709), the photo is downloaded from the Web server (steps 1710 and 1711).

When the user clicks and opens the “participate in conversation” 432 (step 1712), the mail address for message registration is notified from the Web server via the mail server (steps 1713, 1714, 1715). Messages are exchanged using this mail address for message registration. That is, when a message mail is written and transmitted (steps 1716 and 1717), a message is posted from the mail server to the front DB server (step 1718), and the message is notified to each sharer via the front DB server and displayed. (Steps 1533, 1534). When a message including a photographer is input from a sharer (step 1535) and transmitted (steps 1536 and 1537), the message is notified from the front DB server via the mail server to the portable terminal 101 and displayed (step). 1719, 1720). FIG. 21 shows an example of a screen 440 on which a message is displayed. When the sharer's message is sent by e-mail, the message 441 is displayed. By replying to this e-mail, it is possible to participate in a conversation with a photograph.
[When mobile terminal 101 or the like simply has an email address]
FIG. 22 shows an operation flow of the entire system in that case.

  In step 1523, the e-mail address and display name are entered in the direct input field 344 displayed on the photo sharing screen 340 of the photographer's mobile terminal 100 (step 1801). Then, the value is set in the portable terminal 100 (step 1538). In the photo sharing screen 340, the name tag of the sharer who wants to share is displayed (step 1525), and when the name tag of the sharer that the user may share is dragged into the photo (step 1526), the sharer carries the mobile phone. It is set inside the terminal 100 (step 1527).

  Thereafter, when the completion button 346 is pressed (step 1528), the information on the registered sharer is transmitted from the photographer's portable terminal 100 to the front DB server (steps 1529 and 1530), and the front DB server uses the mobile phone. A mail for the registered user is created, and the mail is transmitted to the mobile terminal 101 via the mail server (steps 1802 and 1803).

FIG. 23 shows an example of the mail. When “view photo” 451 is opened on the mail screen 450 (step 1804), the photo is downloaded from the Web server (steps 1805 and 1806).

  When the user clicks and opens “Join conversation” 452 (step 1807), a member registration screen is displayed from the Web server (steps 1808 and 1809). FIG. 24 shows an example of the member registration screen, where a user name and password are set. When the user name and password are input (step 1810), the user ID is registered in the front DB server (step 1811), a user-dedicated page is created on the web server (step 1812), and the user is stored in the mobile terminal 101. A dedicated web page is displayed (step 1813). FIG. 25 is an example of a Web page dedicated to the user. On this Web page 470, a list of photos 471 shared by the user is displayed.

Here, when a message mail is written and transmitted (steps 1814 and 1815), a message is notified to each sharer via the front DB server and displayed (steps 1533 and 1534). When a message is input from the sharer including the photographer (step 1535) and transmitted (steps 1536 and 1537), the front DB server notifies the mobile terminal 101 of the update via the mail server (step 1816, 1817). When a specific photo page is opened from the photo list of FIG. 25 on the mobile terminal 101 (step 1818), a photo screen containing a message from the Web server is displayed (steps 1819 and 1820). FIG. 26 shows an example of the photograph screen. On this photo screen 480, a photo 481, a list of sharers 482, and a message 483 are displayed. Message writing 484 is also performed.
[When using a facebook account]
FIG. 27 is a flowchart showing the operation of a part of the system in that case.

The photographer's mobile terminal 100 logs in to his Facebook, downloads the shared photo, and displays the photo sharing screen shown in FIG. 8 (steps 1901 and 1902). Here, when the Facebook account of the exchange A who has a Facebook account is input to the direct input field 344 of the mobile terminal 100 (step 1903), a person is searched on the facebook (steps 1904 and 1905), and the mobile terminal 100 is searched. Displays the searched account. Here, when an account of the exchange A having the Facebook account is selected, the exchange A is added as a friend to the photographer's facebook account, and this is displayed as a name tag 343 on the photo sharing screen 340 shown in FIG. 1906, 1907, 1908). Thereafter, the same friend approval as in the ordinary facebook is performed (steps 1909 and 1910).
[Effects of Embodiment]

In the system according to the present embodiment, it is not necessary to input an address each time by sharing a photograph using the position information system from the mobile terminal 101 existing in the vicinity of the mobile terminal 100, and as such Since the address acquired in step 1 is linked to the person shown in the photo on the photo sharing screen 340, the link between the person and the address can be performed easily and intuitively, and the photo screen (communication screen) Messages can be exchanged visually with a person using the address linked at 360.
[Modification]
The present invention is not limited to the above-described embodiment, and can be implemented with various modifications, which also belong to the technical scope of the present invention.

  For example, the dragging of the name tag on the photo sharing screen 340 may be performed as follows. As shown in FIG. 28, when the name plate is dragged into the photograph, a drag point such as ◯ is displayed during the dragging as shown in FIG. When it is dropped on the face portion, the drag point disappears and a tag (such as a luggage tag) is displayed from the drag point toward the outside of the photograph as shown in FIG. As shown in FIG. 31, the name tag can also be moved by drag and drop, so that it can be arranged at an appropriate place. By configuring in this way, it is possible to specify the exact position of the face. In addition, it is possible to arrange the tag orientation in an easy-to-understand manner as to which person is pointing. This configuration can be applied to other functions such as tapping a face to open an address book. For example, when a face is tapped, the telephone number or mail address of the person with that face may be displayed below the photograph. Or you may make it call directly to the telephone number of the person of the face, or you may send mail.

  As shown in FIG. 32, on the photo screen 360, the content of the conversation may be displayed in the message field 364 as if a person in the photo 361 is speaking using a balloon 368. That is, the person who is speaking the message is linked to the person in the photograph, and a balloon 368 is displayed from the face portion of the person who wrote the message. When the message is scrolled, the balloon 368 yuan changes as shown in FIG. Thereby, the speaker of the message can be visually intuitionally realized.

  As shown in FIGS. 8 and 9, etc., not only the sharer but also the photographer's photograph is displayed in the upper left, for example. In this case, in the case of a portable terminal having two cameras and capable of taking a self-portrait, put the subject on the screen with the back camera (normal camera), put the face of the photographer of the selfie camera, The photographer may be configured so that the photographer also appears in the photograph when the image is enlarged / reduced, moved by dragging and dropping, and placed at an appropriate place and photographed. If you have a single-camera mobile device that does not have a self-portrait, put the subject on the screen with the back camera, shoot first, put the photographer in the camera, zoom in and out on the selfie camera frame, It may be configured to move by dropping, place it at an appropriate location, and take a second shot so that the photographer also appears in the photo. Instead of placing a photographer on the upper left of the photo, a person (photographer) may be added to both sides around the middle person or background, making a single photo.

  When creating a shared screen, a group photo may be created from a social graph (Facebook, mixi, etc.). For example, you may select a person with a specific keyword (hobby, work, etc.) from Facebook and mixi friends (My Miku) and automatically create a photo that matches that keyword. For example, when creating a hospital-related common screen, keywords are set (eg, work-hospital), the background of the hospital and costumes are automatically displayed, and people close to you in the group photo (people with deep connections) ) Near and distant people (people with few connections) should be displayed far away.

  The photo sharer may be specified by voice recognition. For example, take a picture with the photographer terminal, arrange the sharer terminal and the photographer terminal, put the same sound (voice) into both terminals, send sound data from both terminals to the server, and both terminals are close May be configured to start sharing photos.

  Ordinarily, even if you tell us your Facebook, twitter, etc. account at a party or business card exchange, you have to search for people on the SNS on your home PC, etc., and register your friends and followers. Thus, by inputting the SNS account on the photo sharing screen 340 shown in FIG. 8, friend registration and follower registration can be performed on the spot.

In addition to exchanging messages, voice, coupons, stickers, and the like can be exchanged in a visually intuitive manner using the photo screen 360 in the same manner as messages.
In the above description, the front server stores user information, photos and tag information, message information, etc., and communicates with mobile terminals to upload, update, and download user authentication, photos, and tag information. Is.
The mail server mainly transmits and receives e-mails to mobile phone users. In cooperation with the front server, the mail server distributes photos to mobile phone users and sends messages posted to the photos. Receive email messages from mobile phone users and automatically post them in photo messages.
The WEB server cooperates with the front server to perform user registration / authentication, photo browsing, and message writing through communication via the Internet.
The external server has user information and provides a service to act as a proxy for user authentication. Also, the location information is determined from the GPS from the mobile terminal, the connected mobile phone base station, and the radio base station. There are services that provide services, and by using these services, it is possible to identify the location of the mobile terminal or to authenticate as a user of the application.

DESCRIPTION OF SYMBOLS 1 Neighboring area 2 Communication network 100, 101 Portable terminal 111 Control part 112 ROM (Read Only Memory)
113 RAM (Random Access Memory)
114 Bus 115 Input / output interface 116 Camera 117 Touch screen 118 Network

Claims (10)

An imaging unit capable of imaging a nearby region;
A display unit capable of displaying a photograph taken by the imaging unit;
An acquisition unit for acquiring an address from a mobile terminal existing in the vicinity region;
Displaying the photograph on the display unit, linking a person shown in the displayed photograph and the address acquired by the acquisition unit, and a message using the address between the mobile terminal existing in the neighboring area A creation unit for creating a communication screen including the photo for exchanging
A mobile terminal comprising: a communication unit that exchanges messages with the mobile terminal existing in the vicinity region via the communication screen ;
The acquisition unit can receive a QR code (registered trademark) that can be input by a mobile terminal that exists in the vicinity of the mobile terminal and can transmit an address from the input mobile terminal to the mobile terminal without inputting an address. A mobile terminal that obtains an address from a mobile terminal that is displayed on the display unit and has received the QR code (registered trademark) . An imaging unit capable of imaging a nearby region;
A display unit capable of displaying a photograph taken by the imaging unit;
An acquisition unit for acquiring an address from a mobile terminal existing in the vicinity region;
Displaying the photograph on the display unit, linking a person shown in the displayed photograph and the address acquired by the acquisition unit, and a message using the address between the mobile terminal existing in the neighboring area A creation unit for creating a communication screen including the photo for exchanging
A communication unit for exchanging messages with the mobile terminal existing in the vicinity area via the communication screen;
A portable terminal comprising:
The display unit includes a touch screen,
The creation unit displays the object associated with the address acquired by the acquisition unit together with the photo on the touch screen, and allows the person who is reflected in the photo to tap the object on the touch screen. A portable terminal that associates a person shown in the photograph with an address acquired by the acquisition unit. An imaging unit capable of imaging a nearby region;
A display unit capable of displaying a photograph taken by the imaging unit;
An acquisition unit for acquiring an address from a mobile terminal existing in the vicinity region;
Displaying the photograph on the display unit, linking a person shown in the displayed photograph and the address acquired by the acquisition unit, and a message using the address between the mobile terminal existing in the neighboring area A creation unit for creating a communication screen including the photo for exchanging
A communication unit for exchanging messages with the mobile terminal existing in the vicinity area via the communication screen;
A portable terminal comprising:
A portable terminal comprising: a display control unit configured to visually connect a person who issued the message and a person shown in a photograph when the message is exchanged, and to display the communication screen on the display unit. It is a portable terminal given in any 1 paragraph among Claims 1-3,
The acquisition unit requests a system capable of detecting a mobile terminal existing in the vicinity area of the mobile terminal to transmit the position information of the mobile terminal to detect the mobile terminal existing in the vicinity area. A portable terminal that obtains the address of a portable terminal existing in the vicinity area from the system. Get an address from a mobile device in the vicinity,
Display a photograph of the vicinity area imaged by the imaging unit on the display unit, and link the person shown in the displayed photo and the acquired address,
Create a communication screen including the photo for exchanging messages using the address with the mobile terminal existing in the vicinity area,
A communication method using a mobile terminal for exchanging messages via the communication screen with a mobile terminal existing in the vicinity area,
The display unit displays a QR code (registered trademark) that allows a mobile terminal existing in the vicinity of the mobile terminal to be input and allows the input mobile terminal to transmit an address to the mobile terminal without inputting an address. And the said portable terminal is a communication method using the portable terminal which acquires an address from the portable terminal which input the said QR code (trademark) . Get an address from a mobile device in the vicinity,
Display a photograph of the vicinity area imaged by the imaging unit on the display unit, and link the person shown in the displayed photo and the acquired address,
Create a communication screen including the photo for exchanging messages using the address with the mobile terminal existing in the vicinity area,
A communication method using a mobile terminal for exchanging messages via the communication screen with a mobile terminal existing in the vicinity area,
The display unit includes a touch screen,
Displaying an object associated with the address acquired from the mobile terminal existing in the vicinity area together with the photograph on the touch screen, and tapping the object on the touch screen to a person shown in the photograph, Link the person shown in the photo with the address obtained from the mobile device in the vicinity
A communication method using a portable terminal. Get an address from a mobile device in the vicinity,
Display a photograph of the vicinity area imaged by the imaging unit on the display unit, and link the person shown in the displayed photo and the acquired address,
Create a communication screen including the photo for exchanging messages using the address with the mobile terminal existing in the vicinity area,
A communication method using a mobile terminal for exchanging messages via the communication screen with a mobile terminal existing in the vicinity area,
When exchanging the message, the person who issued the message and the person shown in the photograph are visually linked, and the communication screen is displayed on the display unit.
A communication method using a portable terminal. Obtaining an address from a mobile terminal existing in the vicinity area;
Displaying a photograph of a nearby region imaged by the imaging unit on the display unit, and linking a person shown in the displayed photo with the acquired address;
Creating a communication screen including the photo for exchanging messages using the address with a mobile terminal existing in the vicinity area;
Exchanging messages via the communication screen with a mobile terminal located in the vicinity area; and
Is a program that causes a mobile terminal to execute,
The display unit displays a QR code (registered trademark) that allows a mobile terminal existing in the vicinity of the mobile terminal to be input and allows the input mobile terminal to transmit an address to the mobile terminal without inputting an address. Step to
The program which makes a portable terminal perform the step which acquires an address from the portable terminal which input the said QR code (trademark) . Obtaining an address from a mobile terminal existing in the vicinity area;
Displaying a photograph of a nearby region imaged by the imaging unit on the display unit, and linking a person shown in the displayed photo with the acquired address;
Creating a communication screen including the photo for exchanging messages using the address with a mobile terminal existing in the vicinity area;
Exchanging messages via the communication screen with a mobile terminal located in the vicinity area; and
Is a program that causes a mobile device to execute
The display unit includes a touch screen, and the program further includes:
Displaying an object associated with an address acquired from a mobile terminal existing in the vicinity area together with the photograph on the touch screen;
  Tapping the object on the touch screen with a person appearing in the photograph to link the person appearing in the photograph with an address obtained from a mobile terminal existing in the neighboring area;
A program that causes a mobile device to execute. Obtaining an address from a mobile terminal existing in the vicinity area;
Displaying a photograph of a nearby region imaged by the imaging unit on the display unit, and linking a person shown in the displayed photo with the acquired address;
Creating a communication screen including the photo for exchanging messages using the address with a mobile terminal existing in the vicinity area;
Exchanging messages via the communication screen with a mobile terminal located in the vicinity area; and
Is a program that causes a mobile terminal to execute,
A step of visually connecting the person who issued the message and the person shown in the photograph when the message is exchanged, and displaying the communication screen on the display unit;
  A program that causes a mobile device to execute.