JP2015028686A - Method of generating social time line, social net work service system, server, terminal, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To convey a current feeling to a friend real time by assuring a training state to flow in a time line real time.SOLUTION: In a training support SNS system, a contribution of a training person (oneself) is uploaded to a time line TL (steps S502, S510), a comment which a friend has contributed, if any, is uploaded to the time line TL likewise (steps S504, S512), in response to occurrence of a feeling stamp representing a feeling of the training person (step S506), the feeling stamp is synchronized with a picture photographed with a wearable camera and is uploaded automatically to the time line TL (steps S512, S514).

Description

  The present invention relates to a method for creating a social timeline, a social network service system, a server, a terminal, and a program.

  In recent years, the population of training such as running and jogging is increasing. Recently, there are SNSs (social network service systems) that support training, and it has become common to enjoy training while sharing information with friends. In such an SNS site, a wristwatch-type wrist terminal equipped with GPS can be worn for training, and the time and course can be registered on the website.

Conventionally, there has been a wristwatch type terminal for training (see, for example, Patent Document 1).
In addition, there is a website that can connect a plurality of users 'terminals to a network and view a plurality of users' participant information, exercise data, courses, distances, geographical positions, results, and the like ( For example, see Patent Document 2).
Furthermore, there are some which display an avatar in training SNS (for example, refer patent document 3), and there are also what generate | occur | produces and displays a timeline in SNS (for example, refer patent document 4).

Special table 2012-524640 gazette Special table 2011-516210 gazette Special table 2011-518360 gazette JP-T 2009-521752

  However, with the technology described in the prior literature, training records can be shared via SNS, commented on, cheered on, and competed, but to share emotions with friends in real time, operations such as tweets There was a problem that it was necessary.

  The present invention has been made in order to solve the above-described problems, and an object thereof is to quickly know a user's situation.

  The invention according to claim 1 is a social network service system including a terminal and a server connected to the terminal directly or via a communication terminal, wherein the terminal acquires emotion information acquisition means for acquiring emotion information; Transmission means for transmitting emotion information acquired by the emotion information acquisition means to the server, the server based on the emotion information received by the reception means and reception means for receiving the emotion information. A social network service system comprising: timeline creation means for creating a timeline including an object representing emotion; and display control means for enabling browsing of the timeline created by the timeline creation means Is to provide.

  The invention according to claim 8 is a method for generating a social timeline in a social network service system including a terminal and a server and a camera connected to the terminal directly or via a communication terminal, wherein the terminal Performing an acquisition process of acquiring emotion information and a transmission process of transmitting the acquired emotion information to the server, the camera executing a process of capturing an image under control from the terminal, The server receives the emotion information and the captured image, creates a timeline including the object representing the emotion based on the received emotion information and the received captured image, and the created The present invention provides a method characterized by executing display control processing that enables browsing of a timeline.

  The invention according to claim 9 is an emotion for acquiring emotion information in a terminal including a terminal and a server that receives information transmitted from the terminal directly or via a communication terminal and generates a social timeline. Information acquisition means, and transmission means for transmitting emotion information acquired by the emotion information acquisition means to the server, the emotion information acquisition means includes stamp selection means for selecting a stamp image corresponding to emotion The transmitting means provides a terminal characterized in that the stamp image selected by the stamp selecting means is transmitted to the server, thereby uploading the stamp image to the social timeline.

  The invention according to claim 12 is a server in a social network service system including a terminal and a server connected to the terminal directly or via a communication terminal, receiving means for receiving emotion information from the terminal, A timeline creating means for creating a timeline including an object representing emotion based on emotion information received by the receiving means; and a display control means for enabling browsing of the created timeline. Provide a server.

  The invention according to claim 15 obtains emotion information from a terminal computer in a system including a terminal and a server that receives information transmitted from the terminal directly or via a communication terminal and generates a social timeline. A social timeline by sending the stamp image selected by the stamp selection means to the server as an object representing emotion. The present invention provides a program characterized in that it functions as a means for improving the performance of the program.

According to a sixteenth aspect of the present invention, there is provided a receiving unit for receiving emotion information from a terminal of a server computer in a social network service system including a terminal and a server connected to the terminal directly or via a communication terminal. , Timeline creation means for creating a timeline including objects representing emotions based on emotion information received by the reception means;
The present invention provides a program characterized by functioning as display control means for enabling browsing of a created timeline.

  According to the present invention, the user's situation can be quickly known.

It is a block diagram which shows the whole structure of the SNS system which concerns on one embodiment of this invention. It is a figure explaining the image of the SNS system concerning the embodiment. It is a schematic block diagram which shows the structure of the server which concerns on the same embodiment. It is a schematic block diagram which shows the structure of the wrist terminal which concerns on the same embodiment. It is a schematic block diagram which shows the structure of the smart phone terminal which concerns on the embodiment. It is a schematic block diagram which shows the structure of the wearable camera which concerns on the same embodiment. It is a flowchart which shows operation | movement of the wrist terminal according to a user's operation. It is an appearance image figure of a wrist terminal and a wearable camera concerning the embodiment. It is a flowchart which shows the detail of the measurement process step of FIG. It is a flowchart which shows the detail of the emotion information acquisition step of FIG. It is an example of the feeling stamp which concerns on the same embodiment. It is a flowchart which shows operation | movement of the wearable camera which concerns on the embodiment. It is a figure for demonstrating the display form of the smart phone terminal or PC which concerns on the embodiment. It is a flowchart which the server which concerns on the embodiment produces a timeline. 3 shows a timeline display example according to the embodiment. 3 shows a timeline display example according to the embodiment. 3 shows a timeline display example according to the embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the specification, a smartphone is abbreviated as a smartphone, a personal computer is abbreviated as a PC, and a social network service system is abbreviated as an SNS. In addition, the timeline refers to a content that is displayed in a chronological order as a list of contents posted by yourself or friends, replies to each post, other information, and the like in SNS. A social timeline is a timeline that you can share with others, not just yourself. Among the information displayed in a list, information that appeals visually, such as pictures, images, and figures, is collectively referred to as an object.

FIG. 1 is a block diagram showing the overall configuration of a training support system according to an embodiment of the present invention.
The SNS site 10 including the server 11 is a member's smartphone terminals 1-1, 1-2, 1-3,..., List terminals 2-1, 2-2, 2-3,. And the PC 3-1. The wrist terminals 2-1, 2-2, 2-3,... Are wristwatch-type wrist terminals that can be worn on the wrist, and are wirelessly connected to the smartphone terminals 1-1, 1-2, 1-3. Is possible.
Further, the wrist terminals 2-1, 2-2, 2-3,... Connected. Hereinafter, the smartphone terminal 1-1, 1-2, 1-3,..., As a representative, the smartphone terminal 1, the wrist terminal 2-1, 2-2, 2-3,. 2, PC 3, 3-2,... Are represented as PC 3 and wearable cameras 4-1, 4-2, 4-3,.

  The smartphone terminal 1 functions as a communication terminal, and installs an application program and operates to cooperate with the SNS site 10. Further, a relatively light application program is installed in the wrist terminal 2 and operates so as to cooperate with the smartphone terminal 1. That is, the smartphone terminal 1 mediates between the wrist terminal 2 and the SNS site 10, and can be replaced by a small PC, a tablet, a wireless router, or the like. A route is also provided in which the wrist terminal 2 and the server 11 are directly connected and information can be exchanged via Wi-Fi or a telephone line without going through the smartphone terminal 1. The wearable camera 4 may be configured to be connected not only to the wrist terminal 2 but also to the smartphone terminal 1 or the server 11.

FIG. 2 is a diagram for explaining a usage image of the SNS system according to the present embodiment. Via the SNS site 10, a wrist terminal 2, a wearable camera 4, a smartphone terminal 1, and a PC 3 worn by members who train directly or indirectly are connected. Thereby, for example, a member who is training the course shape created on the SNS site 10 by wearing the wrist terminal 2 and the wearable camera 4, or the person who is training by wearing the wrist terminal 2 and the wearable camera 4. Can be sent to other members' smartphones or to the member's smartphone terminal 1 or PC 3. A cloud service can be used as the SNS site 10.
The smartphone 1 includes a display unit 340, the wrist terminal 2 includes a display unit 206, the PC 3 includes a display unit 400, and the wearable camera 4 includes a lens 404. FIG. 8 is a drawing of this image.

FIG. 3 is a block diagram illustrating a schematic configuration of the server 11.
In the figure, reference numeral 102 denotes a CPU which controls the entire system. A program memory 110 stores various control programs. The CPU 102 performs various processes by executing programs in the program memory 110. The program memory 110 includes an OS (control program) 111 for controlling the whole, a course shape generation program 112, a speech-to-character conversion program 113, a biological information analysis program 114, a face recognition program 115, a timeline creation program 116, a photograph A selection program 117 and the like are stored. A member management unit 106 manages members as an SNS system. Friends relations, communities, bulletin boards, etc. are also managed here, and they manage the so-called SNS function in general. A history memory 108 stores a training history so that the user can perform training a plurality of times and compare the results later.

  Reference numeral 120 denotes a collection information memory for storing various types of information collected by the wrist terminal 2, and includes a position information storage area 121, a time information storage area 122, a time information storage area 123, an emotion information storage area 124, a point information storage area 125, A biological information storage area 126 is included. Logically, there is a storage area corresponding to each member. Physically, each member can be managed by attribute code. A course shape memory 130 graphically creates and stores a course shape in which the user has run (moved) using various information collected by the wrist terminal 2, particularly position information. The course shape is created by the course shape creation program 112 in the program memory 110. Either the user can run a course already prepared in the server 11 or the wrist terminal 2, or a course shape can be created from the trajectory that the user ran, so that it can be used.

  Reference numeral 140 denotes an emotion image memory in which a large number of feeling stamps are stored. The feeling stamp is an illustration image, and images representing various emotions such as “good”, “smooth”, “fun”, “smooth”, “tired”, and “suffering” are prepared.

Reference numeral 150 denotes a voice memory that stores voice data spoken by the user to the microphone of the wrist terminal 2, and the voice data is converted into character data by the voice-character conversion program 113 stored in the program memory 110. Is stored in the comment memory 160. The comment input by voice is stored in the comment memory 160, but in the SNS function, a comment posted by the user (self) to the SNS site 10 or a comment posted by a friend (other user) to the SNS site 10. Is also remembered. The input means may be voice or key. A comment can be input not only from the list terminal 2 but also from the smartphone terminal 1 and the PC 3. The input comment is displayed as a timeline as will be described later. This is done by the CPU 102 executing the timeline creation program 116. The timeline TL is displayed and controlled so that it can be viewed by members, but this timeline creation program 116 executes so that the display can be created and viewed on the smartphone 1 or the PC 3.
Reference numeral 170 denotes an image memory for storing image data (photographs) taken by the wearable camera 4. When the timeline creation program 116 uploads a photograph to the timeline, the image stored in the image memory 170 is used.

FIG. 4 is a schematic block diagram showing the configuration of the wrist terminal 2.
In the figure, reference numeral 202 denotes a CPU which controls the entire wrist terminal 2. A program memory 210 stores a control program 211, an application program 212, and the like in advance. The control program 211 is a basic control program for controlling the entire wrist terminal, and the application program 212 is a program for cooperating with the smartphone terminal 1 and the server 11.

  A display unit 206 includes an LCD and a drive circuit for driving the LCD. A display control unit 204 controls display on the display unit 206. An input control unit 220 controls input signals from various keys and switches. The display unit 206 is provided with a touch panel 222, which is basically operated by touching the display screen of the display unit 206 of the wrist terminal 2. The input control unit 22 also performs input control of the touch panel 222. Reference numeral 230 denotes a microphone, which can input voice. The input voice data is stored in the voice memory 240. Although the voice data is stored in the voice memory 240 as it is, the voice data is sent to the server 11 and stored in the voice memory 150. Then, the voice data is converted into character data by the voice-character conversion program 113, and as character data. Stored in the comment memory 160.

  Reference numeral 250 denotes a GPS unit that measures the current position using a known GPS (Global Positioning System). That is, the GPS unit 250 obtains position data composed of latitude and longitude indicating the current position by receiving radio waves transmitted from a plurality of positioning satellites (GPS satellites) with an antenna, and uses the obtained position data. To the CPU 202 as position information indicating the person's action place. The so-called absolute position is measured.

  Reference numeral 252 denotes a sensor that detects acceleration, azimuth, altitude, and the like, and includes a 3-axis geomagnetic sensor, a 1-axis acceleration sensor, a 1-axis gyro, and the like. Therefore, it is possible to measure the traveling direction of the wrist terminal 2 using a 3-axis geomagnetic sensor, a 1-axis acceleration sensor, a 1-axis gyro, and the like in addition to the GPS unit 250, thereby further improving accuracy. By combining the GPS 250 and the sensor 252, the movement trajectory and time of the wrist terminal 2 can be accurately traced. Various collection information from the sensor 252 is temporarily stored in the buffer memory 280 and then stored in the collection information memory 120 of the server 11.

Reference numeral 254 denotes a biological sensor for measuring a pulse (heartbeat), blood pressure, body temperature, and the like. The measured biological information is stored in the biological information storage area 126 in the collected information memory 120 of the server 11, the words once stored in the buffer memory 280.
Reference numeral 256 denotes an environmental sensor for measuring temperature, atmospheric pressure, humidity, ultraviolet ray amount, noise, and the like. The measured environment information is temporarily stored in the buffer memory 280 and then stored in the environment information storage area 127 in the collected information memory 120 of the server 11.
Reference numeral 258 denotes a wireless I / F (interface) for performing close proximity wireless communication, for example, a Bluetooth (registered trademark) link with the smartphone terminal 1, and 260 is a communication I for performing a link with the server 11 by Wi-Fi or the like. / F.

  A camera control unit 290 is wirelessly connected to the wearable camera 4 and controls the wearable camera 4. The wearable camera 4 includes a lens 404 on the front surface. The surroundings are photographed under the control of the camera control unit 290. The captured image data is stored in the image memory 272. It captures still images in conjunction with the selection of feeling stamps, which will be described later, but it can also be operated by remote control using voice commands, and can continue to shoot movies throughout training like a drive recorder. .

FIG. 5 is a schematic block diagram showing the configuration of the smartphone terminal 1.
In the figure, reference numeral 340 denotes a display unit, which includes an LCD and a drive circuit for driving the LCD. A display control unit 354 controls the display state of the display unit 340. Reference numeral 356 denotes an input control unit that controls various keys, switches, and the touch panel 350. A CPU 302 controls the entire smartphone terminal 1. A program memory 310 stores a control program 311 and an application program 312 in advance. The control program 311 is a basic control program for controlling the entire smartphone terminal 1, and the application program 312 is a program for cooperating with the wrist terminal 2, cooperation, and the server 11. The application program 312 can be downloaded later. Reference numeral 358 denotes a wireless I / F that establishes a link with the wrist terminal 2 using, for example, near-field wireless communication such as Bluetooth (registered trademark). It is.

FIG. 6 is a schematic block diagram showing the configuration of the wearable camera 4. The wearable camera 4 has a hat shape as shown in FIG. 2 or FIG. 8, but the internal configuration is not significantly different from a general hands-free camera. Reference numeral 410 denotes an image sensor having a CCD or a CMOS, which captures a subject image incident from the lens 404. An imaging control unit 412 controls the timing, exposure, shutter speed, focus, and the like of the image sensor 410. A CPU 420 controls the wearable camera 4 as a whole, and performs a control operation according to a program stored in the program memory 430.
The program memory 430 stores a control program 432 for controlling the whole and a shooting control program 434 for controlling shooting in particular. This shooting control program 434 also has a part of functions related to shooting control of the server 11 on the wearable camera 4 side. In other words, the wearable camera 4 itself can receive various biological information and emotion information, and can determine the shooting timing instructed by the server 11 or the wrist terminal 2 by itself based on the information.
Reference numeral 440 denotes an image memory that stores image data captured by the image sensor 410. Reference numeral 442 denotes an SD card, which can uniquely store a photograph taken by the wearable camera 4 and reproduce the photograph with another reproducing apparatus.

  Reference numeral 450 denotes a wireless I / F, which performs proximity proximity communication with the wrist terminal 2. The wearable camera 4 is remotely operated from the wrist terminal 2, the smartphone terminal 1, or the server 11 via the wireless I / F 450. During the training, the wrist terminal 2 and the wearable camera 4 synchronize and exchange information with each other wirelessly. However, the wrist terminal 2 and the wearable camera 4 minimize power, and the timing of both does not shift. Wireless communication is performed while intermittently synchronizing with interrupts.

FIG. 8A shows a front view of the wrist terminal 2, FIG. 8B shows a perspective view, shows an example of displaying the time on the display unit 206, and a MENU icon is displayed. By selecting this MENU icon, the menu screen display step S10 of FIG. 7 starts.
FIG. 8C shows a perspective view of the wearable camera 4. The lens 404 is attached to the front of the hat shape. For example, if the lens 404 is attached to the lower part of the brim of the hat so as to face the user, the user's face can be photographed at all times, and analysis of the user's emotions at that time Can be used for

Next, the usage method and operation of the present embodiment will be described with reference to the drawings.
<Training mode>
<Operation of wrist terminal 2>
The user wears wrist terminal 2 on his arm and wearable camera 4 on his head, and starts training. The course, distance, target time, etc. may be set in advance, or may be run arbitrarily.
FIG. 7 is a flowchart showing the operation of the wrist terminal 2 in accordance with the user's operation.

First, in the flowchart of FIG. 7, step S <b> 10 is a state in which a menu screen is displayed on the display unit 206 of the wrist terminal 2. Here, either the training mode or the replay mode can be selected (step S12).
If the replay mode is selected, the process proceeds to step S24 to execute the replay process. The replay process is for reproducing the training situation, and will not be described in detail in the present embodiment. Of course, other options may be prepared. If the training mode is selected in this state, the process proceeds to the start screen display (step S14).

When starting, the START menu is selected from the menu display (step S16). Then, it progresses to step S18 and starts a measurement process.
If the STOP menu is selected during training, that is, during measurement (step S20), it is determined that the training has ended, and the process proceeds to step S22 to display the training result.

FIG. 9 is a flowchart for explaining details of the measurement process in step S18 in FIG.
During training, the sensor 252, the biosensor 254, and the environment sensor 256 appropriately measure and collect information (step S100). That is, the current time and current position are acquired by the GPS 250. The current time may be obtained from the built-in clock.
Further, the sensor 252 obtains the traveling direction and acceleration, and corrects the current position.
The biological sensor 254 acquires biological information such as body temperature and pulse.
Environmental information such as ambient temperature and humidity around the wrist terminal 2 is acquired by the environmental sensor 256.
At the same time, the running time (time information) from the start is calculated and recorded.

  The collected information is sent to the server 11 sequentially or collectively through the buffer memory 280, and the position information storage area 121, the time information storage area 122, the time information storage area 123, and the biological information storage area, respectively. 126 and the environment information storage area 127, respectively.

In step S106, it is determined whether emotion information has been input. If NO, the process proceeds to step S110.
If YES, emotion information is acquired in step S108. The emotion information acquisition process will be described later. Emotion information is stored in the emotion information area 124 of the server 11. Emotion information is stored in the emotion information storage area 124 of the server.

In step S <b> 114, shooting is performed by the wearable camera 4 under the control of the camera control unit 290 of the wrist terminal 2. Specifically, when a feeling stamp is selected, the photograph is recorded on the spot with the feeling stamp and set. The captured image data is recorded as a buffer in the image memory 272 and then stored in the image memory 170 of the server 11.
In addition, when the moving image is always photographed, sequential photographing is continued in parallel with the measurement operation in step S100.

  FIG. 10 is a flowchart showing details of the emotion information acquisition process in step S108 in FIG. As will be described below, the emotion information of the user is obtained by any one of information collected by the biometric sensor 252, data captured by the wearable camera 4, and selection of a feeling stamp.

In step S204, the user's emotion is determined from the biological information collected by the biological sensor 254. Various methods for determining a user's stress level from biological information such as a pulse have been proposed (see, for example, Japanese Patent No. 4641811 and Japanese Patent No. 5046286), and will not be described in detail here.
The biological information analysis program 114 selects a feeling stamp suitable for the determination result from FIG. 11 described later (step S208). The selected feeling stamp becomes an emotion image of the user and is stored in the emotion image memory 140.

  In step S206, when the wearable camera 4 has photographed the user's face in step S114, the photographed image data is stored in the image memory 170 of the server 11 using the image memory 272 as a buffer, and face recognition is performed. Emotion is judged by the program 115. Various techniques for determining the emotion of a person have been proposed as face recognition techniques, and will not be described in detail here. The face recognition program 115 selects a feeling stamp appropriate for the determination result from FIG. 11 described later (step S208). The selected feeling stamp becomes an emotion image of the user and is stored in the emotion image memory 140.

  In step S208, a feeling stamp is selected based on the result of the above-described biometric information analysis program 114 determining the user's emotion or the result of the face recognition program 115 determining the user's emotion. FIG. 11 shows an example of a feeling stamp. The user himself / herself may select any feeling stamp during training. For example, a plurality of feeling stamps are prepared as shown in the figure, and A1 to A9 are feeling stamps expressing different emotions. Many feeling stamps other than this are prepared, and when the user himself / herself selects, the feeling stamp screen is displayed by scrolling the display unit 206, and the feeling stamp most suitable for his / her feeling is selected. Or, as mentioned above, “Kirikae” is generated by voice command, and it switches to the feeling stamp screen, and when it says “Energetic” “Fair” “Fun” “Fair” “Fatigue” “Hard” etc., the corresponding feeling A stamp is selected.

When the biometric information analysis program 114 or the face recognition program 115 selects the feeling stamp based on the result of determining the user's emotion, the selection is performed at the timing when it is determined that the determination result of the user's emotion is a preset emotion state. Is done.
The selected feeling stamp is a user's emotion image as described above, and is recorded in the emotion image memory 140.

<Operation of wearable camera 4>
FIG. 12 is a flowchart for explaining the operation of the wearable camera 4. First, before starting training, wearable camera 4 is set to a standby mode (step S100). This may be set by an operation switch (not shown) of the wearable camera 4 main body, or may be set by remote operation from the wrist terminal 2 like a remote control. Basically, the wearable camera 4 and the wrist terminal 2 are in a wireless synchronization relationship, and are remotely controlled from the wrist terminal 2 with the wrist terminal 2 as a master and the wearable camera 4 as a slave.

  When the standby mode is set, shooting is started under the control of the CPU 420. For example, a plurality of images may be captured per second as in continuous shooting, or approximately one image may be captured per minute (step S402). The photographed image is held in the image memory 440 for a certain period of time using a FIFO (First In First Out) method.

Since automatic shooting during training, there is a high possibility of out-of-focus and blurring. Therefore, a plurality of photographs are taken, and the optimum photograph can be selected from them. In the specification, an image (image data) taken by the wearable camera 4 is called a photograph.
The optimal photo selection is performed by the photo selection program 117. Several techniques for selecting photos with less blur and blur are not described in detail. Needless to say, the photos used in the drawings are merely examples for explaining the present embodiment, and have nothing to do with the actual place, course, etc. There is no meaning.
Note that, as described above, the wearable camera 4 itself receives various biological information and emotion information and can determine the photographing timing instructed by the server 11 or the wrist terminal 2 by itself based on the information.
Further, when the lens 404 is installed so as to photograph the user's own face as described with reference to FIG. 8, the photographing information of the user's face can be used as emotion information.

Next, when the feeling stamp is selected by the wrist terminal 2 by any of the above-described several methods, the information is received (step S404), and for example, the photograph taken in step S402 is received. A total of 11 timings and 5 photos before and after that are stored in the image memory 440. In addition, the stored photo or an arbitrary photo can be stored in the SD card 442 and can be viewed on another playback device.
The stored photograph is transmitted to the wrist terminal 2 (step S408), temporarily stored in the image memory 272 of the wrist terminal 2, and further sent to the server 11 and stored in the image memory 170.

<Timeline display>
Next, timeline display will be described.
FIG. 14 is a flowchart of the server 11 for creating a timeline according to the user's behavior, and FIG. 13 shows a display example of the timeline of the PC 3 or the smartphone terminal 1-2.
FIG. 13 (a) shows a display image of the display unit 340 of the smartphone terminal 1, and the course C and the current position N of the training user are displayed in the upper half. In the lower half, a timeline TL is displayed. FIG. 13B shows an example in which the smartphone 1 is displayed horizontally, in which the course C and the current position N are displayed on the left half, and the timeline TL is displayed on the right half.

In FIG. 13B, in addition to the current position N of the user, the position NA of the friend A running on the same course is indicated by an icon. That is, it is a display example after the user meets the friend A. Since it is premised that the friend A is wearing the same wrist terminal 2 and training, the positions of each other can be known through the SNS site 10. Therefore, it is possible to compete, to compete for time, or to become a pacemaker. Of course, the time can be compared and displayed, but the icon display form can be changed, or when the other party (friend A) is approaching, the icon can be flashed to indicate that it is being chased.
Further, since the past training data is stored in the history data storage unit 108 in the server 11, the past training results and the training results of the friend A are read out, and training or competition with the virtual partner is performed. It is also possible to do.

An example of the timeline is shown in FIGS. 15A, 15B, and 15C.
The timeline display will be described below with reference to the flowchart executed by the CPU 102 of the server 11 in FIG. 14 and the display examples of the timelines in FIGS. 15A, 15B, and 15C.
First, in step S502, it is waited whether there is no comment contribution from the user himself. If “NO” here, the process proceeds to a step S504 to wait for a comment post from a friend. A friend is another user who has a specific friend relationship within the SNS system 10. If “NO” here, the process proceeds to a step S506 to wait for a feeling stamp to be generated in the wrist terminal 2. As described above, the feeling stamp selects and transmits one of the feeling stamps shown in FIG. 11 expressing the feeling based on the emotion information of the user during training.
If “NO” here as well, it is determined in step S508 whether the STOP menu has been selected, that is, whether the training has ended. If “NO” again, the process returns to step S502 to continue the loop.

When a comment from the user is detected in step S502, the comment is temporarily stored in the comment memory 160. Then, the process proceeds to step S510, and the timeline posted by the user is flowed as shown in FIG. 15A (1). This process is performed by the timeline creation program 116. The time stamp is automatically given. This display can be viewed on the member's smartphone terminal 1 or the PC 3.
FIG. 15A (1) shows a comment posted by the user himself (to himself) to go jogging to the Imperial Palace tomorrow. In response to this, when a comment “Be careful” is posted from an arbitrary terminal of the friend A, the presence of the comment of the friend is detected in step S504, and the timeline is displayed as shown in FIG. 15A (2). Similarly, the comment “Good luck!” Of friend B is also displayed as shown in FIG. 15A (3). 15A (4) and 15 (5) show the state where he / she made a comment “The course is here” and uploaded the map. Photos can be posted along with the comment text. In FIG. 15A (6), “I may also go” indicates the comment of friend A, and “I wish I can meet” in FIG. 15A (7) indicates my comment. Since it is well known that any photo can be uploaded to the timeline and a friend can create any icon, it will not be described in detail.

  Now, when a user (self) who wears the wrist terminal 2 and the wearable camera 4 and trains selects the START menu from the menu screen of the wrist terminal 2 and starts training, the timeline is displayed as shown in FIG. 15B (8). A “START” comment is automatically transmitted from the server 11. In the same figure, what is expressed by a double line in a comment balloon indicates that it is not a user's post but automatic transmission of the server 11.

  Then, a feeling stamp A9 that matches the emotion information of the user at that time is selected from the emotion image memory 120, and the photograph is taken by the wearable camera 4 at that time and is uploaded to the timeline together with the photograph stored in the image memory 170 (FIG. 14). Step S506, FIG. 15B (9)). As described above, the feeling stamp is automatically determined based on the result of the biological information analysis program 114 or selected by the user himself / herself.

  That is, when training is started, feeling stamps are automatically uploaded to the timeline according to the emotions of the user at the same time, and photographs taken with the wearable camera 4 are also uploaded together. As an example, 11 photographs are taken before and after the feeling stamp generation timing, and the photograph selection program 117 automatically selects and uploads the photograph with the least blur and blurring. Therefore, the generation timing of the feeling stamp and the timing of shooting with the wearable camera 4 are synchronized.

In FIG. 15B (10), the comment “Friendly course” of friend C is uploaded, and in FIG. 15B (11), feeling stamp A1 and photograph P2 are being trained smoothly.
In FIG. 15B (12), the feeling stamp A2 and the photograph P3, which are automatically or manually selected from the feelings when approaching the uphill, are uploaded.
In FIG. 15B (13), the comment “Please do your best” of friend C is displayed.
In FIG. 15C (14), a feeling stamp A3 and a photograph P4 that are relieved after going up the hill are uploaded.

In FIG. 15C (15), the comment “Good luck” of friend B is displayed, and in FIG. 15C (16), friend A meets the user (self) and displays the comment “Join”. At this time, as shown in FIG. 15C (17), the feeling stamp A6 indicating the greeting is increased, and the photograph P5 showing the friend A photographed at that time is also increased.
In FIG. 15C (16), a feeling stamp A7, which is impressed by seeing the cherry blossoms in full bloom, and a photograph P6 in which the cherry trees are reflected are uploaded.
When the training is finished, the STOP menu is selected from the menu display, and the training mode is finished in step S508 of FIG.
At this time, “GOAL” is automatically transmitted from the server 11 as shown in FIG.
In FIG. 15C (20), a feeling of joy stamp A4 when reaching the goal and a photograph P7 of the goal photographed at that time are uploaded.

  As a modified example, when it becomes difficult, it can request “a friend asks for support”. For this purpose, for example, when a “Cheer1 Me” (not shown, voice input) button on the wrist terminal 2 is pressed, a message is sent to the friend's smartphone terminal 1 via the smartphone terminal 1 and the server 11. The side (friend) who receives the message can return a support message (or support stamp) by operating the “Cheer” command on the application program. Therefore, the training user can receive support in real time. In FIG. 15A, FIG. 15B, and FIG. 15C, a support message may be interrupted up during the timeline. Whether it is difficult or not is not only self-reported, but it is automatically determined from the biological information collected by the biological sensor 254, such as the speed has fallen and the heart rate has risen, and the running user himself / herself is notified. May be. When the value reaches a certain value, a message “Would you like to support me?” Is displayed on the display unit 202 of the terminal 2.

When the training is completed, the “STOP” menu is selected from the menu screen.
The various information collected by the wrist terminal 2 may be sent to the server 11 in real time via a telephone line or via a smartphone when the smartphone is held together, or once every 10 minutes and once per hour. It may be sent periodically such as times. In addition, after the training is completed, the server 11 may be connected to the server 11 wirelessly or by wire and may be sent collectively. Basically, it is not necessary to connect to the SNS site 10 during training. After the training is completed, for example, the information collected during the training by the wrist terminal 2 can be uploaded to the server 11 by connecting to the PC 3. . The server 11 can execute the replay process (step S24 in FIG. 7) based on the collected information.

  Note that the present invention is not limited to the above-described embodiment, and training is understood in a broad sense. That is, it can be applied to walking, sightseeing, walking, walking, jogging, marathon, cycling, mountain climbing, marine sports, etc., and it can also be applied to pet walking, elderly people, and elderly people. Training and workout are synonymous.

  In addition, although a wristwatch type wrist terminal that is worn on the arm and trained has been described as an example, the wrist-type wrist terminal is not limited thereto, and may be worn on the head, attached to the waist, or held by hand. The same applies to the wearable camera, and it can be worn on the waist or in glasses.

<Effects of Embodiment and Modified Examples that can be Inferred>
It is possible to determine the emotion and physical condition of the user from the collected information of the biometric sensor and reflect it on the facial expression and type of an object such as a feeling stamp.
The collection information of the biosensor, the determination result, and the object can be recorded as daily life activity history (life log), or can be posted to SNS and shared.
When a user takes a predetermined action such as sending an e-mail or writing a comment, the emotion and physical condition of the user at that time can be determined and reflected in the expression and type of the object.
Based on the user's biometric information when the action is taken, it can be automatically reflected in the expression and type of the object.
Based on changes in biological information before and after taking action, it is possible to determine temporal changes in the user's emotions and physical condition and reflect them in the expression and type of the object.
By simply looking at the facial expression of an object, it is possible to convey the emotion and state of the other party in an easy-to-understand manner and with interest.

For each imaging scene of the wearable camera, the emotion and physical condition of the user at that time can be determined and reflected in the expression and type of the object.
By simply processing the photographed image, it is possible to determine the emotion and physical condition of the user and reflect them in the expression and type of the object.
In association with captured moving image data and scenes, it can be reflected in the expression and type of objects for each scene.
An object can be combined with the playback image of the wearable camera.
You can check what kind of training scene you were, how you were impressed when you achieved each scene and record, what emotions and mental state you were, what your emotions and mental state were, You can communicate and share with friends and others.

As mentioned above, although embodiment of this invention was described, this invention is not limited to these, The invention described in the claim and its equal range are included.
The claims appended at the time of filing this application will be appended below.
<Appendix>

[Claim 1]
In a social network service system including a terminal and a server connected to the terminal directly or via a communication terminal,
The terminal
Emotion information acquisition means for acquiring emotion information;
Transmitting means for transmitting emotion information acquired by the emotion information acquiring means to the server;
With
The server
Receiving means for receiving the emotion information;
Timeline creating means for creating a timeline including an object representing emotion based on emotion information received by the receiving means;
Display control means for enabling browsing of the timeline created by the timeline creating means;
A social network service system characterized by comprising:
[Claim 2]
The emotion information acquisition means has a biological sensor,
The social network service system according to claim 1, wherein the timeline creating unit creates an object representing emotion by analyzing the biological information acquired by the biological sensor.
[Claim 3]
The emotion information acquisition means includes an object selection means for selecting an object corresponding to the emotion,
The social network service system according to claim 1, wherein the timeline creation unit uses the object selected by the object selection unit as an object representing emotion.
[Claim 4]
4. The social network service system according to claim 3, wherein the object representing the emotion is a feeling stamp.
[Claim 5]
The system further comprises a camera for taking an image,
The server includes image receiving means for directly or indirectly receiving an image taken by the camera,
The social network service system according to any one of claims 1 to 4, wherein the timeline creation means includes means for uploading the received image together with the object to the timeline.
The terminal includes a position information transmission unit that acquires current position information and transmits the current position information to the server,
The server includes current position map creation means for receiving the current position information and illustrating the current position of the terminal on a topographic map,
6. The social network service system according to claim 1, wherein the timeline creating means includes means for uploading the current position map together with the timeline.
[Claim 7]
The server receives the current position information of the other terminal together with the current position information of the terminal,
7. The social network service system according to claim 6, wherein the current position map creating means includes means for illustrating a current position of the other terminal on the topographic map.
A method for generating a social timeline in a social network service system including a terminal and a server and a camera connected to the terminal directly or via a communication terminal,
The terminal performs an acquisition process of acquiring emotion information and a transmission process of transmitting the acquired emotion information to the server,
The camera executes a process of taking an image under control from the terminal,
The server is configured to receive the emotion information and the captured image, create a timeline including an object representing an emotion based on the received emotion information and the received captured image, and the creation And a display control process for enabling browsing of the selected timeline.
[Claim 9]
In a terminal in a system including a terminal and a server that receives information transmitted from the terminal directly or via a communication terminal and generates a social timeline,
Emotion information acquisition means for acquiring emotion information;
Transmitting means for transmitting emotion information acquired by the emotion information acquiring means to the server;
With
The emotion information acquisition means includes a stamp selection means for selecting a stamp image corresponding to the emotion,
The terminal according to claim 1, wherein the transmitting means transmits the stamp image selected by the stamp selecting means to the social timeline by transmitting the stamp image to the server.
[Claim 10]
9. The terminal according to claim 8, wherein the stamp selecting means includes means for displaying a plurality of stamp images corresponding to emotions, and means for causing the user to select the stamp images.
[Claim 11]
The image processing apparatus further includes means for capturing an image, and the transmission means transmits the stamp image selected by the stamp selection means and the captured image to the server to upload the stamp image and the captured image to the social timeline. The terminal according to claim 8 or 9, characterized in that.
[Claim 12]
In a server in a social network service system including a terminal and a server connected to the terminal directly or via a communication terminal,
Receiving means for receiving emotion information from the terminal;
Timeline creating means for creating a timeline including an object representing emotion based on emotion information received by the receiving means;
Display control means for enabling browsing of the created timeline;
A server characterized by comprising:
[Claim 13]
Further comprising position information receiving means for receiving current position information from the terminal;
13. The timeline creating means comprises means for creating a current position map showing a current position of a terminal on a topographic map based on the received current position information together with the timeline. Server.
[Claim 14]
14. The server according to claim 13, wherein the timeline creation means further comprises means for showing the current position of the other terminal on the topographic map together with the current position of the terminal.
[Claim 15]
A terminal computer in a system including a terminal and a server that receives information transmitted from the terminal directly or via a communication terminal and generates a social timeline;
Emotion information acquisition means for acquiring emotion information,
Stamp selection means for selecting a stamp image corresponding to the acquired emotion information;
A program that causes a stamp image selected by the stamp selection means to function as a means for uploading to the social timeline by transmitting to the server as an object representing emotion.
[Claim 16]
A server computer in a social network service system including a terminal and a server connected to the terminal directly or via a communication terminal;
Receiving means for receiving emotion information from the terminal;
Timeline creation means for creating a timeline including an object representing emotion based on emotion information received by the reception means;
Display control means that enables browsing of the created timeline,
A program characterized by functioning as

1-1, 1-2 Smartphone terminals 2-1, 2-2, 2-3 List terminal 3-1 PC
4-1, 4-2, 4-3 Wearable Camera 10 SNS Site 11 Server 102 CPU
106 Member Management Unit 108 History Data Memory 110 Program Memory 111 OS (Control Program)
112 Course shape creation program 113 Voice-to-character conversion program 114 Biometric information analysis program 115 Face recognition program 116 Timeline creation program 120 Collection information memory 121 Location information area 122 Time information area 123 Time information area 124 Emotion information area 125 Point information area 126 Biometric information storage area 127 Environmental information storage area 130 Course shape memory 120 Emotion image memory 150 Voice memory 160 Comment memory 170 Image memory 202 CPU
204 Display control unit 206 Display unit 210 Program memory 211 Control program 212 Application program 220 Input control unit 222 Touch panel 230 Audio memory 240 Comment memory 250 GPS
252 Sensor 254 Biosensor 256 Environmental sensor 258 Wireless I / F
260 Communication I / F
272 Image memory 280 Buffer memory 290 Camera control unit 300 Display screen 302 CPU
310 Program memory 311 Control program 312 Application program 340 Display unit 354 Display control unit 356 Input unit 358 Wireless I / F
360 Communication I / F
404 Lens 410 Imaging device 412 Imaging control unit 420 CPU
430 Program memory 440 Image memory 450 Wireless I / F
A1-A9 Feeling stamp C Course shape N Current position NA Friend's current position TL Timeline

Claims (16)

In a social network service system including a terminal and a server connected to the terminal directly or via a communication terminal,
The terminal
Emotion information acquisition means for acquiring emotion information;
Transmitting means for transmitting emotion information acquired by the emotion information acquiring means to the server;
With
The server
Receiving means for receiving the emotion information;
Timeline creating means for creating a timeline including an object representing emotion based on emotion information received by the receiving means;
Display control means for enabling browsing of the timeline created by the timeline creating means;
A social network service system characterized by comprising: The emotion information acquisition means has a biological sensor,
The social network service system according to claim 1, wherein the timeline creating unit creates an object representing emotion by analyzing the biological information acquired by the biological sensor. The emotion information acquisition means includes an object selection means for selecting an object corresponding to the emotion,
The social network service system according to claim 1, wherein the timeline creation unit uses the object selected by the object selection unit as an object representing emotion.   4. The social network service system according to claim 3, wherein the object representing the emotion is a feeling stamp. The system further comprises a camera for taking an image,
The server includes image receiving means for directly or indirectly receiving an image taken by the camera,
The social network service system according to claim 1, wherein the timeline creation unit includes a unit that uploads the received image together with the object to the timeline. The terminal includes a position information transmission unit that acquires current position information and transmits the current position information to the server,
The server includes current position map creation means for receiving the current position information and illustrating the current position of the terminal on a topographic map,
6. The social network service system according to claim 1, wherein the timeline creating means includes means for uploading the current position map together with the timeline. The server receives the current position information of the other terminal together with the current position information of the terminal,
7. The social network service system according to claim 6, wherein the current position map creating means includes means for illustrating a current position of the other terminal on the topographic map. A method for generating a social timeline in a social network service system including a terminal and a server and a camera connected to the terminal directly or via a communication terminal,
The terminal performs an acquisition process of acquiring emotion information and a transmission process of transmitting the acquired emotion information to the server,
The camera executes a process of taking an image under control from the terminal,
The server is configured to receive the emotion information and the captured image, create a timeline including an object representing an emotion based on the received emotion information and the received captured image, and the creation And a display control process for enabling browsing of the selected timeline. In a terminal in a system including a terminal and a server that receives information transmitted from the terminal directly or via a communication terminal and generates a social timeline,
Emotion information acquisition means for acquiring emotion information;
Transmitting means for transmitting emotion information acquired by the emotion information acquiring means to the server;
With
The emotion information acquisition means includes a stamp selection means for selecting a stamp image corresponding to the emotion,
The terminal according to claim 1, wherein the transmitting means transmits the stamp image selected by the stamp selecting means to the social timeline by transmitting the stamp image to the server.   9. The terminal according to claim 8, wherein the stamp selecting means includes means for displaying a plurality of stamp images corresponding to emotions, and means for causing the user to select the stamp images.   The image processing apparatus further includes means for capturing an image, and the transmission means transmits the stamp image selected by the stamp selection means and the captured image to the server to upload the stamp image and the captured image to the social timeline. The terminal according to claim 8 or 9, characterized in that. In a server in a social network service system including a terminal and a server connected to the terminal directly or via a communication terminal,
Receiving means for receiving emotion information from the terminal;
Timeline creating means for creating a timeline including an object representing emotion based on emotion information received by the receiving means;
Display control means for enabling browsing of the created timeline;
A server characterized by comprising: Further comprising position information receiving means for receiving current position information from the terminal;
13. The timeline creating means comprises means for creating a current position map showing a current position of a terminal on a topographic map based on the received current position information together with the timeline. Server.   14. The server according to claim 13, wherein the timeline creation means further comprises means for showing the current position of the other terminal on the topographic map together with the current position of the terminal. A terminal computer in a system including a terminal and a server that receives information transmitted from the terminal directly or via a communication terminal and generates a social timeline;
Emotion information acquisition means for acquiring emotion information,
Stamp selection means for selecting a stamp image corresponding to the acquired emotion information;
A program that causes a stamp image selected by the stamp selection means to function as a means for uploading to the social timeline by transmitting to the server as an object representing emotion. A server computer in a social network service system including a terminal and a server connected to the terminal directly or via a communication terminal;
Receiving means for receiving emotion information from the terminal;
Timeline creation means for creating a timeline including an object representing emotion based on emotion information received by the reception means;
Display control means that enables browsing of the created timeline,
A program characterized by functioning as

Images