JP2011129969A - Communication device, communication method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To overcome the problem with a conventional communication, wherein nonverbal communication cannot be performed hitherto, thereby it is difficult to pass information on human emotions, such as puzzled feelings and excited feelings, to one's party. <P>SOLUTION: A communication device includes a touch panel and allows two-way communication. The communication device includes: an acceptance unit for accepting communicating party identification information, namely information for identifying a terminal of a communicating party; a reception unit for receiving a communication request from the terminal of the communicating party; a touch information acquisition unit for accepting the communicating party identification information, receiving a communication request from the terminal of the communicating party, accepting user's input to the touch panel after establishment of communication, and acquiring touch information, namely information on an input trajectory; an output unit for output of the touch information onto a screen to which the touch panel is attached; and a transmission unit for transmitting the touch information to the terminal of the communicating party. The communication device transmits information obtained by touching the touch panel, thus passing feelings to one's party. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a communication device or the like that transmits touch information input by touch in a communication device including a touch panel.

  In a conventional communication device, there is a communication device provided with a touch panel (for example, see Non-Patent Document 1).

"iPhone (registered trademark)", [online], [searched on November 30, 2009], Internet <URL: http://www.apple.com/jp/iphone/iphone-3gs/?cid=MAR- JP-OVER-IPHONE>

  However, in conventional communication systems, it is difficult to communicate non-verbal communication with human gestures, behaviors and touches, and it is difficult to convey emotional information and feelings of people in communication, such as embarrassment and highness. Met. Also, when there are many people on the train or the like, it was difficult to convey their feelings to the other party without using voice or letters.

  The communication device of the first aspect of the invention is a communication device that includes a touch panel and is capable of two-way communication, a receiving unit that receives communication partner identification information that is information for identifying a communication partner terminal, and a communication A receiving unit that receives a communication request from a partner terminal and a communication partner identification information, or a communication request from a communication partner terminal, and after communication is established, a user input to the touch panel is accepted and input. A touch information acquisition unit that acquires touch information that is information related to the trajectory, an output unit that outputs the touch information to a screen on which the touch panel is mounted, and a transmission unit that transmits the touch information to a communication partner terminal. It is a communication device provided.

  With this configuration, it is possible to convey feelings to the other party in real time by transmitting information touched on the touch panel in real time.

  In the communication device according to the second aspect of the present invention, in contrast to the first aspect, the receiving unit also receives touch information from the communication partner terminal, and the output unit is a locus indicated by the touch information received by the receiving unit. Is a communication device that also outputs.

  With this configuration, by receiving and outputting information touched on the touch panel, the feeling of the other party can be conveyed in real time.

  The communication device according to the third aspect of the present invention, in contrast to the first or second aspect, detects that the communication device has shaken, acquires a shake information that is information related to the shake, and a transmission. The unit is a communication device that also transmits shaking information.

  With this configuration, it is possible to convey an honest feeling such as an increase in emotion to the other party in real time by shaking the communication device that is held. In addition, you can make your opponent feel the gesture and behavior. Further, further expressions can be added to the touched information.

  Further, in the communication device of the fourth invention, in contrast to the third invention, the receiving unit further includes a shaking information output unit that receives shaking information from a communication partner terminal and outputs shaking information. Device.

  With such a configuration, by receiving and outputting shaking information, it is possible to convey the feelings of the other party in real time, such as an uplifting feeling. In addition, you can make your opponent feel the gesture and behavior. Further, further expressions can be added to the touched information.

  The communication device according to the fifth aspect of the present invention further comprises an attribute value storage unit capable of storing the lifetime of touch information as compared with any of the first to fourth aspects, and the output unit outputs to the screen. It is a communication device that erases the touch information that has been made according to the lifetime.

  With this configuration, touch information can be easily and continuously input.

  In addition, the communication device according to the sixth aspect of the invention is a communication device according to the fifth aspect, wherein the output unit outputs the locus indicated by the touch information received by the receiving unit and then erases the locus according to the lifetime. is there.

  With this configuration, touch information can be easily and continuously output.

  In the communication device of the seventh invention, the attribute value storage unit stores blur condition information indicating a blur condition of the touch information when the touch information is output, in any one of the first to sixth inventions. The output unit is a communication device that blurs and outputs the touch information output on the screen according to the blur condition information.

  With this configuration, touch information can be drawn as if there is a person's warmth, and can be output with rich emotions. In addition, touch can be expressed, and the user can feel the connection.

  According to the eighth aspect of the present invention, in contrast to the seventh aspect of the invention, the output unit is a communication device that blurs and outputs the touch information received by the receiving unit according to the blur condition information.

  With this configuration, touch information can be drawn as if there is a person's warmth, and can be output with rich emotions. In addition, touch can be expressed, and the user can feel the connection.

  The communication device according to the ninth aspect of the present invention provides the position on the touch panel indicated by the touch information received by the receiving unit and the touch information acquired by the touch information acquiring unit with respect to any of the second to eighth aspects of the invention. The output unit further includes a determination unit that determines whether or not the indicated position matches, and when the output unit determines that the determination unit matches, the touch information corresponding to the matched position is compared with other information, It is a communication device that outputs in a different manner.

  With this configuration, a connection with a communication partner can be realized.

  Further, the communication device of the tenth aspect of the invention further comprises an image storage unit capable of storing an image as compared with any one of the first to ninth aspects, and the transmission unit communicates with a communication partner terminal. It is a communication device that transmits an image to a communication partner terminal after starting.

  With this configuration, the communication partner can communicate while feeling himself / herself.

  Further, the communication device of the eleventh aspect of the invention further comprises a camera as compared with any of the first to tenth aspects of the invention, and the transmission unit captures images during communication with the communication partner terminal. It is a communication device that also transmits live video.

  With this configuration, communication can be performed while having the communication partner feel the current situation of himself / herself.

  The communication device according to the twelfth aspect of the present invention is a communication device including a touch panel, a reception unit that receives a mail address of a mail recipient and a mail transmission instruction, and a user input to the touch panel for input. A touch information acquisition unit that acquires touch information that is information about the trajectory that has been performed, an output unit that outputs the touch information to a screen on which the touch panel is mounted, and a reception unit that receives a transmission instruction, includes touch information And a transmission unit that transmits a mail to a transmission destination indicated by a mail address.

  With this configuration, information such as characters and figures traced with a finger can be included in the e-mail. That is, touch information can be included in a non-real-time message that the partner can display at an arbitrary timing.

  In addition, the communication device of the thirteenth invention further includes a receiving unit that receives a mail with respect to the twelfth invention, and the receiving unit is an open instruction that is an instruction to open the mail received by the receiving unit When the open instruction is received, the output unit is a communication device that configures and outputs a trajectory from touch information included in the mail.

  With this configuration, it is possible to output information such as characters and figures traced with a finger included in an e-mail. That is, touch information can be included in a non-real-time message that the partner can display at an arbitrary timing.

  The communication device of the fourteenth invention is a communication device including a touch panel, a server device identifier storage unit that can store a server device identifier that identifies the server device, a reception unit that receives a transmission instruction, Information including touch information, a touch information acquisition unit that receives user input to the touch panel and acquires touch information that is information about the input locus, an output unit that outputs the touch information to a screen on which the touch panel is mounted, and touch information Is transmitted to the server device identified by the server device identifier.

  With this configuration, information such as characters and figures traced with a finger can be registered in a so-called bulletin board system.

  Further, in the communication device of the fifteenth invention, in response to the fourteenth invention, the reception unit also receives an acquisition instruction that is an instruction to acquire information stored in the server device, and the reception unit acquires When receiving the instruction, the information processing apparatus further includes a reception unit that receives information indicated by the acquisition instruction from the server device, and the output unit is a communication device that forms a locus from the information received by the reception unit and outputs the locus.

  With this configuration, information such as characters and figures traced with registered fingers can be output to a so-called bulletin board system.

  According to the communication system according to the present invention, it is possible to convey feelings to the other party by transmitting the information touched on the touch panel.

Conceptual diagram of the communication system in the first embodiment Block diagram of the first communication device Flow chart for explaining the operation of the first communication device A flowchart for explaining the operation of the touch information output process The figure which shows the example of the image etc. of the image storage part The figure which shows the same blur condition information management table The figure which shows the example of input screens, such as the user ID The figure which shows the example of a screen of the 1st communication apparatus The figure which shows the example of a screen of the 1st communication apparatus The figure which shows the example of a screen of the 2nd communication apparatus The figure which shows the output example of the shaking information output part The figure which shows the example of a screen of the 1st communication apparatus The figure which shows the example of a screen of the 1st communication apparatus Conceptual diagram of the communication system in the second embodiment Block diagram of the communication system Flow chart for explaining the operation of the first communication device A flowchart for explaining the operation of the mail output process The figure which shows the example of a screen of the 1st communication apparatus The figure which shows the example of the data structure of the same mail Figure showing transition of output of the same mail Block diagram of a communication system in the third embodiment Flow chart for explaining the operation of the first communication device Overview of the computer system in the above embodiment Block diagram of the computer system The figure which shows the example of the blur condition information management table | surface in the said embodiment. The figure which shows the example of the touch information drawn using the blur condition information management table

Hereinafter, embodiments of a communication system, a communication apparatus, and the like will be described with reference to the drawings. In addition, since the component which attached | subjected the same code | symbol in embodiment performs the same operation | movement, description may be abbreviate | omitted again.
(Embodiment 1)

  In this embodiment, a communication system 1 including a touch panel and a communication device that transmits touch information input by touch in real time will be described. Here, the communication system 1 in which the first communication device 11 and the second communication device 12 can transmit and receive touch information input by touch will be described. That is, the first communication device 11 and the second communication device 12 can perform bidirectional touch communication.

  Further, in the present embodiment, a communication system 1 that detects shaking of a communication device, configures shaking information, and can also transmit and receive shaking information will be described.

  In the present embodiment, touch information has attribute values such as lifetime and blur condition information.

  Also, in the present embodiment, a communication system 1 that transmits an image stored in a communication device at the start of communication or constantly transmits an image captured by a camera of the communication device will be described.

  FIG. 1 is a conceptual diagram of a communication system 1 in the present embodiment. The communication system 1 includes a first communication device 11 and a second communication device 12. The first communication device 11 and the second communication device 12 can communicate with each other via an IP telephone network, a telephone network, the Internet, or the like.

  FIG. 2 is a block diagram of the first communication device 11 in the present embodiment. The first communication device 11 includes a touch panel 1101, an image storage unit 1102, an attribute value storage unit 1103, a reception unit 1104, a reception unit 1105, a touch information acquisition unit 1106, a shake information acquisition unit 1107, a determination unit 1108, an output unit 1109, a shake. An information output unit 1110 and a transmission unit 1111 are provided.

  Here, the second communication device 12 has the same configuration as the first communication device 11. However, the first communication device 11 and the second communication device 12 may have different configurations.

  The touch panel 1101 may be of any type, such as a resistive film method, a surface acoustic wave method, an infrared method, or a capacitance method. The touch panel 1101 may be a surface type or a projection type.

  The image storage unit 1102 can store images. The image is, for example, a picture of yourself or an image of the current location taken with a camera. It goes without saying that the content and data format of the image are not limited. The image storage unit 1102 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. The process of storing the image in the image storage unit 1102 does not matter. For example, an image may be stored in the image storage unit 1102 via a recording medium, and an image transmitted via a communication line or the like may be stored in the image storage unit 1102. Alternatively, an image input via the input device may be stored in the image storage unit 1102.

  The attribute value storage unit 1103 can store attribute values of touch information. Touch information is information composed of user input to the touch panel, and is information about an input locus. Touch information is usually one or more pieces of coordinate information. One piece of coordinate information or a plurality of pieces of coordinate information is touch information. Note that the user's input is normally input to the touch panel 1101 with a finger, but may be input with a pen or the like. The attribute value is, for example, lifetime, blur condition information, thickness, color, or the like. The lifetime is information indicating the time from when the touch information is displayed until it disappears. The lifetime is, for example, 10 seconds. The blur condition information is information indicating the blur condition of the touch information when the touch information is output. The blur condition information may be, for example, “0”, “1”, “5”, or “A”, “B”, “X”, etc., and may be information indicating the degree of blur.

  The attribute value storage 1103 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. The process in which the attribute value is stored in the attribute value storage unit 1103 does not matter. For example, the attribute value may be stored in the attribute value storage unit 1103 via a recording medium, and the attribute value received by the receiving unit 1105 from the communication partner terminal is stored in the attribute value storage unit 1103. Alternatively, the attribute value input via the input device may be stored in the attribute value storage unit 1103.

  The accepting unit 1104 accepts communication partner identification information that is information for identifying a communication partner terminal. The accepting unit 1104 may accept information other than the communication partner identification information. The communication partner identification information is, for example, unique information for identifying the telephone number or IP address of the communication partner terminal, the first communication device 11, or the like. When the receiving unit 1104 receives the communication partner identification information, for example, the first communication with the communication partner terminal (second communication device 12) identified by the communication partner identification information after being authenticated by an external authentication server (not shown). It is assumed that communication with the device 11 can be started. That is, when the reception unit 1104 receives the communication partner identification information, for example, communication between the communication partner terminal identified by the communication partner identification information and the first communication device 11 can be started. The method for starting communication between the first communication device 11 and the second communication device 12 does not matter. In addition, reception here means reception of information input from an input device such as a keyboard, mouse, touch panel, reception of information transmitted via a wired or wireless communication line, an optical disk, a magnetic disk, a semiconductor memory, etc. This is a concept including reception of information read from the recording medium. The input means may be anything such as a numeric keypad, keyboard, mouse or menu screen. The accepting unit 1104 can be realized by a device driver for input means such as a numeric keypad and a keyboard, control software for a menu screen, and the like.

  The receiving unit 1105 receives a communication request from a communication partner terminal (communication device). The receiving unit 1105 may receive touch information from a communication partner terminal. Further, the receiving unit 1105 may receive shaking information from a communication partner terminal. Further, the reception unit 1105 may receive attribute values (lifetime, blur condition information, etc.) from the communication partner terminal. The receiving unit 1105 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

  The touch information acquisition unit 1106 receives communication partner identification information or receives a communication request from a communication partner terminal, and after communication is established, accepts a user input to the touch panel 1101 and is information on an input locus. Get touch information. The touch information acquisition unit 1106 can be usually realized by an MPU, a memory, or the like. The processing procedure of the touch information acquisition unit 1106 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The shaking information acquisition unit 1107 detects that the communication apparatus has shaken, and acquires shaking information that is information relating to shaking. The shake information acquisition unit 1107 is, for example, a gyro sensor, a tilt sensor, an acceleration sensor, a digital compass, or the like. Further, the shake information acquisition unit 1107 may acquire shake information, which is the degree of shake, from changes in signal values from GPS satellites, Wi-Fi hotspots, and mobile phone base stations. Further, “detecting shaking” includes detecting the degree of shaking. The shake information is, for example, angular velocity, acceleration, or moving distance and velocity. The shaking information acquisition unit 1107 may be realized by a gyro sensor and its driver software.

  The determination unit 1108 determines whether the position on the touch panel indicated by the touch information received by the reception unit 1105 matches the position indicated by the touch information acquired by the touch information acquisition unit 1106. More specifically, the determination unit 1108 is coordinate information indicating the position of the current finger (may be a pen) indicated by the touch information acquired by the touch information acquisition unit 1106 and touch information received by the reception unit 1105. Then, it is determined whether or not any coordinate information indicating the currently displayed locus matches. The determination unit 1108 can usually be realized by an MPU, a memory, or the like. The processing procedure of the determination unit 1108 is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The output unit 1109 outputs touch information. In addition, it is preferable that the output unit 1109 outputs touch information to a screen on which the touch panel 1101 is mounted. That is, the trajectory that the user of the communication partner touched with a finger is output on the screen of the touch panel 1101 of the own communication device. For example, the output unit 1109 sequentially receives coordinate information (x, y) that is touch information from the touch information acquisition unit 1106, and the point indicated by the coordinate information is set as a center (center of gravity) to have a predetermined size. Are formed (for example, a circle or a square), and the figure is output on the screen. For example, the output unit 1109 sequentially receives coordinate information (x, y) as touch information from the touch information acquisition unit 1106 and draws a line connecting the coordinate information (x, y). The output method of touch information does not matter.

  Further, it is preferable that the output unit 1109 also outputs a locus indicated by the touch information received by the receiving unit 1105. For example, the output unit 1109 sequentially receives coordinate information (x, y) from touch information having two or more pieces of coordinate information received by the reception unit 1105, with the point indicated by the coordinate information as the center (center of gravity). A figure having a predetermined size (for example, a circle or a square) is formed, and the figure is output on the screen. Further, the output unit 1109 may draw a line connecting coordinate information (x, y) that is touch information received by the receiving unit 1105.

  Further, it is preferable that the output unit 1109 erases the touch information output on the screen according to the lifetime. That is, the output unit 1109 deletes the touch information after the time indicated by the lifetime has elapsed after the touch information is output. In addition, it is preferable that the output unit 1109 deletes the locus according to the lifetime after outputting the locus indicated by the touch information received by the receiving unit 1105. For example, the output unit 1109 forms a figure of a predetermined size with the point indicated by the coordinate information as the center (center of gravity), and after the figure is output on the screen, the time indicated by the lifetime has elapsed. If detected, the figure is erased from the screen.

  The output unit 1109 blurs and outputs the touch information output on the screen according to the blur condition information. When the output unit 1109 outputs a graphic with the point indicated by the coordinate information indicated by the touch information as the center (center of gravity) on the screen, for example, the density of the points is changed according to the blur condition information from the center of the graphic. Configure a figure and output the figure. For example, when the blur condition information is “0”, the output unit 1109 configures and outputs a figure painted with a set color (for example, black). Further, for example, when the blur condition information is “3”, the output unit 1109 is painted in the set color around the center, and the degree of painting decreases stepwise toward the outside, and the middle toward the outside. Create and output a figure that reduces the degree of painting after the hit. Also, for example, when the blur condition information is “5”, the output unit 1109 forms a figure that is painted in the set color only around the center, and the degree of painting decreases stepwise toward the outside. ,Output. In such a case, the blur condition information can take an integer from “0” to “5”.

  In addition, the output unit 1109 may express the degree of blurring by arranging and diffusing a plurality of images around the coordinates indicated by the touch information, for example. That is, when a graphic is output on the screen centered on the point indicated by the coordinate information, the output unit 1109 uses, for example, a diffusion coefficient proportional to the blur condition information after the graphic is arranged at the point indicated by the coordinate information, A plurality of the same figures are rearranged and drawn around the point indicated by the coordinate information. Further, the output unit 1109 redraws the rearranged figure so as to resemble the movement of particles in physics. For example, when the blur condition information is “0”, the output unit 1109 outputs one circular figure with a dark center and a set color. Further, for example, when the blur condition information is “3”, the output unit 1109 uses one random circular figure with a set color and three similar figures in the vicinity using random numbers. Deploy. Further, these three figures are redrawn using random numbers while shifting the positions in arbitrary directions. With such a drawing method, it is possible to draw naturally as if the warmth of a person is there. FIG. 25 shows a blur condition information management table in such a case. In FIG. 25, each record has attribute values of “blurring condition information”, “display example”, and “graphic configuration”. FIG. 26 shows an example of touch information drawn using the blur condition information management table of FIG.

  The output unit 1109 may output the touch information received by the receiving unit 1105 in a blurred manner according to the blur condition information. Note that the output unit 1109 may output the touch information in accordance with the blur condition information received by the reception unit 1105, or may output the touch information in accordance with the blur condition information stored in advance. In addition, when the output unit 1109 outputs the received touch information, it is preferable to use attribute values (lifetime, color, thickness, etc.) such as the received blur condition information. The attribute value stored in the attribute value storage unit 1103 set in step 1103 may be used. In addition, when using the received attribute value, there exists an effect that a partner's feeling is transmitted more.

  When the output unit 1109 determines that the determination unit 1108 matches, the output unit 1109 outputs the touch information corresponding to the matched position in a different manner compared to other information. Note that “output in a different manner” means, for example, that the position (or the periphery) shines. It does not matter how to shine, such as flashing or flashing. “Output in a different manner” means, for example, outputting touch information so that attribute values such as color and thickness of touch information at that position are different from other touch information. Further, “outputting the trajectory indicated by the touch information” is equivalent to outputting the touch information. Further, the output is a concept including display on a display, projection using a projector, transmission to an external display device, and the like.

  The output unit 1109 may or may not include an output device such as a display. The output unit 1109 can be realized by driver software of an output device or driver software of an output device and an output device.

  The shake information output unit 1110 outputs shake information. Here, the output includes vibration activation, symbol deformation, symbol output, light output, and the like. That is, the output of shaking information may be anything as long as it is an output that expresses shaking. For example, the shake information output unit 1110 continuously deforms a pattern (such as a graphic or a character) according to the magnitude of the shake information (for example, angular velocity) (this output is also the output of the shake information). One embodiment). It is preferable that the greater the shaking information, the greater the shaking of the symbol. For example, the shake information output unit 1110 changes the intensity according to the magnitude of the shake information (for example, angular velocity) and operates the vibration. Further, the shake information output unit 1110 outputs light by changing the luminous intensity according to the magnitude of the shake information (for example, angular velocity), for example. Note that the shake information output unit 1110 enables output in which touch information and shake information are merged. That is, by adding dynamic information such as shaking information to static touch information basically, output in which the two pieces of information are fused becomes possible. This increases the degree of feeling transmission. The shaking information output unit 1110 may be considered as including or not including an output device. The shake information output unit 1110 can be implemented by output device driver software, or output device driver software and an output device.

  The transmission unit 1111 transmits touch information to a communication partner terminal. In addition, it is preferable that the transmission unit 1111 also transmits shaking information. In addition, it is preferable that the transmission unit 1111 also transmits a part or all of the attribute values of the attribute value storage unit 1103 to the communication partner terminal. In addition, it is preferable that the transmission unit 1111 transmits the image stored in the image storage unit 1102 to the communication partner terminal after the start of communication with the communication partner terminal. Furthermore, it is preferable that the transmission unit 1111 also transmits video captured by the camera during communication with the communication partner terminal. The transmission unit 1111 normally transmits immediately after the touch information acquisition unit 1106 acquires the touch information. Therefore, touch information can be transmitted in real time. Further, “after the start of communication” usually means immediately after the communication is established.

  The transmission unit 1111 is usually realized by wireless or wired communication means, but may be realized by broadcasting means.

  Next, operation | movement of the 1st communication apparatus 11 is demonstrated using the flowchart of FIG.

  (Step S301) The receiving unit 1104 determines whether or not communication partner identification information (ID) has been received. If ID is received, it will go to step S302, and if ID is not received, it will return to step S301.

  (Step S <b> 302) The transmission unit 1111 performs preprocessing for starting communication for communicating with the second communication device 12 identified by the ID. Note that the pre-communication process is a process for connecting a call by, for example, sending an ID to a predetermined device (for example, a SIP server).

  (Step S303) The transmission unit 1111 reads the image stored in the image storage unit 1102, and transmits the image to the second communication device 12 identified by the ID.

  (Step S304) The touch information acquisition unit 1106 determines whether or not the touch panel 1101 has accepted a touch. If a touch is accepted, the process goes to step S305. If no touch is accepted, the process goes to step S308. The determination in this step may be determination as to whether or not the touch information acquisition unit 1106 has acquired touch information.

  (Step S305) The touch information acquisition unit 1106 configures touch information having one or more pieces of coordinate information.

  (Step S306) The output unit 1109 performs touch information output processing. The touch information output process will be described with reference to the flowchart of FIG.

  (Step S307) The transmission unit 1111 transmits the touch information configured in step S305 to the second communication device 12. The process returns to step S304.

  (Step S308) The shaking information acquisition unit 1107 determines whether or not shaking has been detected. The detection of shaking is usually acquisition of shaking information. If a shake is detected, the process goes to step S309, and if no shake is detected, the process goes to step S311.

  (Step S309) The shake information acquisition unit 1107 configures shake information corresponding to the shake detected in Step S308. Note that this step may be omitted if no processing is necessary from the acquired shaking information.

  (Step S <b> 310) The transmission unit 1111 transmits the shake information configured in step S <b> 309 to the second communication device 12. The process returns to step S304.

  (Step S <b> 311) The receiving unit 1105 determines whether touch information or the like has been received from the second communication device 12. If touch information or the like is received, the process proceeds to step S312. If touch information or the like is not received, the process proceeds to step S313. Touch information or the like is, for example, touch information and attribute values, or touch information.

  (Step S312) The receiving unit 1105 performs output processing of the touch information received in Step S311. The process returns to step S304.

  (Step S313) The receiving unit 1105 determines whether an image is received from the second communication device 12. If an image is received, the process goes to step S314; otherwise, the process goes to step S315.

(Step S314) The output unit 1109 outputs the image received in step S313. The transmission unit 1111 normally outputs an image on the touch panel screen.
The process returns to step S304.

  (Step S <b> 315) The receiving unit 1105 determines whether shake information has been received from the second communication device 12. If shake information is received, the process goes to step S316, and if not received, the process returns to step S304.

  (Step S316) The shake information output unit 1110 outputs the shake information received in step S315. The process returns to step S304.

  In the flowchart of FIG. 3, the video acquired by the camera may be constantly transmitted to the second communication device 12 during communication.

  In the flowchart of FIG. 3, the video may be constantly received from the second communication device 12 and output. In such a case, it is preferable to output the video on the screen of the touch panel.

  In the flowchart of FIG. 3, after the shake information acquisition unit 1107 configures the shake information, the shake information output unit 1110 may output the shake information.

  Further, in the flowchart of FIG. 3, the process is ended by power-off or a process end interrupt.

  Next, the touch information output process in step S306 will be described with reference to the flowchart of FIG.

  (Step S401) The output unit 1109 acquires the lifetime from the attribute value storage unit 1103 or the reception unit 1105.

  (Step S <b> 402) The output unit 1109 acquires blur condition information from the attribute value storage unit 1103 or the reception unit 1105.

  (Step S403) The output unit 1109 acquires other attribute values (thickness, color, etc.) from the attribute value storage unit 1103 or the reception unit 1105. Other attribute values may not exist.

  (Step S404) The output unit 1109 substitutes 1 for the counter i.

  (Step S405) The output unit 1109 determines whether or not the i-th coordinate information exists in the touch information. If the i-th coordinate information exists, the process goes to step S406, and if the i-th coordinate information does not exist, the process goes to step S411.

  (Step S406) The output unit 1109 forms a predetermined figure. At that time, the output unit 1109 forms a blurred figure according to the blur condition information.

  (Step S407) The output unit 1109 outputs the figure configured in step S406 so that the position indicated by the i-th coordinate information is the center (center of gravity).

  (Step S408) The output unit 1109 obtains the time from a clock (not shown) (which may be an external server device).

  (Step S409) The output unit 1109 associates the i-th coordinate information with the time and temporarily stores them in the buffer. Note that the output unit 1109 may temporarily store the i-th figure in association with the time in the buffer.

  (Step S410) The output unit 1109 increments the counter i by 1. The process returns to step S405.

  (Step S411) The touch information acquisition unit 1106 acquires touch information (usually one coordinate information) indicating the position where the user is currently touching.

  (Step S412) The determination unit 1108 determines whether or not the position on the currently output graphic (or a point) is coincident with the position indicated by the touch information acquired in step S411. If they match, go to step S413, and if they do not match, go to step S414. Note that the currently output coordinate information on the graphic is stored in the buffer.

  (Step S413) The output unit 1109 highlights the point (point figure) that matches in step S412. Highlighting includes increasing the brightness and outputting the point or the periphery of the point, changing the color to a prominent color (such as red), and outputting the point or the periphery of the point.

  (Step S414) The output unit 1109 substitutes 1 for the counter i.

  (Step S415) The output unit 1109 determines whether or not the i-th output figure (coordinate information) exists. If the i-th output graphic exists, the process returns to step S416, and if it does not exist, the process returns to the upper process.

  (Step S416) The output unit 1109 acquires the time from a clock (not shown) (which may be an external server device).

  (Step S417) The output unit 1109 uses the stored time and the time acquired in step S416 to determine whether or not the lifetime has already elapsed. If the lifetime has elapsed, the process goes to step S418, and if the lifetime has not elapsed, the process returns to the upper process.

  (Step S418) The output unit 1109 deletes the i-th output figure (coordinate information).

  (Step S419) The output unit 1109 increments the counter i by 1. The process returns to step S415.

  In the flowchart of FIG. 4, it is assumed that the coordinate information stored in the buffer is stored in the order of the output time series.

  In the flowchart of FIG. 4, the process of outputting touch information may be another process, for example, a process of connecting the intervals indicated by the coordinate information with a line.

  Hereinafter, a specific operation of the communication system 1 in the present embodiment will be described. A conceptual diagram of the communication system 1 is shown in FIG.

  Now, the user of the first communication device 11 is Ichiro Ota and the user of the second communication device 12 is Hanako Yamamoto. The image storage unit 1102 of the first communication device 11 stores the image of FIG. 5A (own photo image) and the user name “Ichiro Ota”. In addition, the image storage unit 1102 of the second communication device 12 stores the image shown in FIG. 5B (your photo image) and the user name “Hanako Yamamoto”. In addition, Ichiro Ota and Hanako Yamamoto are lovers, for example.

  In the attribute value storage unit 1103 of the first communication device 11, the lifetime “10 seconds” and the blur condition information “3” are stored. Further, the attribute value storage unit 1103 of the first communication device 11 holds the blur condition information management table shown in FIG. The blur condition information management table includes “blur condition information” and “figure” in pairs. That is, the blur condition information management table holds graphics corresponding to the blur condition information “0” to “4”. Such a figure is a figure output for touch information. That is, here, the touch information is one or more pieces of coordinate information (x, y), and the output of touch information (output of the trajectory of touch information) is centered on the point indicated by the coordinate information. This is the output of the figure.

  The attribute value storage unit 1103 of the second communication device 12 stores a lifetime “6 seconds” and blur condition information “4”. Further, the attribute value storage unit 1103 of the second communication device 12 manages the blur condition information management table shown in FIG.

  Currently, Ichiro Ota is working, for example. Suppose you want to communicate with your lover Hanako Yamamoto without using voice (touch communication). In this situation, it is assumed that Ichiro Ota inputs his user ID “dijon777” and password from the first communication device 11 and is authenticated by an authentication device (not shown) (see FIG. 7).

  Next, Ichiro Ota inputs the user ID (communication partner identification information) “dijon7778” of the second communication device 12 (Hanako Yamamoto) to the first communication device 11 and starts communication.

  Next, the reception unit 1104 receives the user ID “dijon7778”. Then, the transmission unit 1111 performs preprocessing for starting communication for communicating with the second communication device 12 identified by the ID “dijon7778”. Such a process is a known process for connecting a call.

  Next, the transmission unit 1111 of the first communication device 11 reads the image (FIG. 5A) and the name “Ichiro Ota” stored in the image storage unit 1102 of the first communication device 11 and is identified by the ID. To the second communication device 12. Then, the transmission unit 1111 of the second communication device 12 reads the image (FIG. 5B) and the name “Hanako Yamamoto” stored in the image storage unit 1102 of the second communication device 12 and is identified by the ID. Transmit to the second communication device 12.

  Then, the receiving unit 1105 of the first communication device 11 and the receiving unit 1105 of the second communication device 12 receive images from the other communication device. And the output part 1109 of both communication apparatuses outputs the received image, respectively. The first communication device 11 has the screen shown in FIG. The received image and name are displayed on the screen shown in FIG.

  Next, it is assumed that Ichiro Ota has described a heart shape on the touch panel of the first communication device 11 with his / her finger while viewing the face image of Hanako Yamamoto. And the touch information acquisition part 1106 acquires information from a touch panel by the touch of Ichiro Ota, and comprises the touch information which is a set of coordinate information.

  Next, the output unit 1109 of the first communication device 11 performs touch information output processing. That is, the output unit 1109 reads the lifetime “10 seconds” and the blur condition information “3” from the attribute value storage unit 1103.

  Next, the output unit 1109 sequentially acquires coordinate information in the touch information, and is a figure centered on the point indicated by the coordinate information, and a blurred circle corresponding to the blur condition information “3” in FIG. Output the figure. Then, the output unit 1109 sequentially acquires time from a clock (not shown). Then, the output unit 1109 associates the time with the coordinate information and sequentially temporarily stores them in the buffer. And as shown in FIG. 9, the handwritten heart is displayed on the screen of the 1st communication apparatus 11 on the face image of Hanako Yamamoto.

  Then, the output unit 1109 acquires the time, and determines whether or not the lifetime “10 seconds” has already elapsed using the time and the time previously stored in the buffer. Then, the output unit 1109 erases the circular figure corresponding to the coordinate information for which the lifetime “10 seconds” has elapsed. As a result, Ichiro Ota can input touch messages one after another.

  Next, the transmission unit 1111 transmits the configured touch information (touch information forming a heart shape) to the second communication device 12. The transmission unit 1111 also transmits the lifetime “10 seconds” and the blur condition information “3”.

  Next, the receiving unit 1105 of the second communication device 12 receives touch information and the like from the first communication device 11. Also, the lifetime “10 seconds” and the blur condition information “3” are received. Then, according to the touch information output process described above, the output unit 1109 displays the touch information according to the lifetime “10 seconds” and the blur condition information “3”, and then deletes the touch information. FIG. 10 shows such a state. In FIG. 10, a heart figure is drawn on the face image of Ichiro Ota.

  Next, it is assumed that Hanako Yamamoto rocks the second communication device 12 that is held in order to express the love of wanting to meet Ichiro Ota. Then, the shaking information acquisition unit 1107 detects shaking. Then, the shake information acquisition unit 1107 configures shake information (for example, “5”) corresponding to the detected shake.

  Next, the transmission unit 1111 of the second communication device 12 transmits the configured shake information to the first communication device 11. Note that the shake information output unit 1110 of the second communication device 12 may output shake information.

  Then, the receiving unit 1105 of the first communication device 11 receives the shake information “5” from the second communication device 12.

  Next, the shake information output unit 1110 of the first communication device 11 outputs the received shake information “5”. In other words, the shaking information output unit 1110 displays the displayed heart figure by continuously deforming it. An output example of the shake information output unit 1110 is shown in FIG. In FIG. 11, when touch information indicating a heart shape input by the other party and life time and blur condition information are received and output according to the blur condition information, when the other user shakes the communication device, the shake information is received. This shows that the heart figure of its own communication device shakes according to the shake information. In FIG. 11, in particular, it can be recognized that the lines in the heart figure are greatly shaken. The heart shape disappears according to the lifetime.

  Next, it is assumed that the receiving unit 1105 of the first communication device 11 receives touch information from the second communication device 12 and outputs the trajectory of Hanako Yamamoto indicated by the touch information. It is assumed that Ichiro Ota placed his finger on the finger trajectory output on the screen of the first communication device 11.

  Then, the touch information acquisition unit 1106 of the first communication device 11 acquires touch information (here, one coordinate information) indicating the position where Ichiro Ota is currently touching.

  Next, the determination unit 1108 determines whether or not the currently output position on the graphic matches the position indicated by the acquired touch information. Then, it is assumed that the determination unit 1108 determines that the position touched by Ichiro Ota matches the position on the graphic (trajectory) being output.

  Next, the output unit 1109 highlights the matched point (point figure). An example of such highlighting is shown in FIG. In FIG. 12, a locus (A) is a locus obtained by outputting Hanako Yamamoto's finger locus according to attribute values (such as blur condition information and lifetime) received from the second communication device 12. Further, the locus (B) is a highlighted portion. In the locus (B), the point and the periphery of the point are displayed in such a manner that the locus (B) shines brighter than in other places.

  Further, it is assumed that Yamamoto Hanako touches one point on the touch panel 1101 of the second communication device 12. Then, the 2nd communication apparatus 12 comprises touch information, and transmits touch information etc. to the 1st communication apparatus 11 as mentioned above.

  Next, the receiving unit 1105 of the first communication device 11 receives the touch information from the second communication device 12 and outputs the point where the finger of Hanako Yamamoto indicated by the touch information has been placed. An example of such output is shown in FIG.

  Next, it is assumed that Ichiro Ota touches the part of FIG. Then, the touch information acquisition unit 1106 of the first communication device 11 acquires touch information indicating the position where Ichiro Ota is currently touching.

  Next, the determination unit 1108 of the first communication device 11 determines whether or not the position of the currently output point matches the position indicated by the acquired touch information. Assume that the determination unit 1108 determines that the position touched by Ichiro Ota matches the position of the output point.

  Next, the output unit 1109 highlights the matched points. An example of such highlighting is shown in FIG. In FIG. 13 (b), the dots and the surroundings of the dots are displayed in a shining manner.

  As described above, according to the communication device of the present embodiment, it is possible to transmit feelings to the other party in real time by transmitting information touched on the touch panel in real time.

  Further, according to the communication device in the present embodiment, it is possible to convey an honest feeling such as an increase in emotion to the other party in real time by shaking the held communication device.

  Moreover, according to the communication apparatus in this Embodiment, a partner can be made to feel a gesture and behavior.

  Moreover, according to the communication apparatus in this Embodiment, the touch information output on the screen can be erase | eliminated according to a lifetime, Therefore Information can be continuously input and transmitted to a touch panel.

  Moreover, according to the communication apparatus in the present embodiment, emotion can be expressed well by outputting touch information output on the screen in a blurred manner according to the blur condition information. Moreover, further expressions can be added to the touched information.

  Note that in this embodiment, the received shake information is applied to the received touch information, and the locus (graphics, characters, etc.) output by the touch information is shaken or shined ( Output that represents the image of shaking), or by applying the received shaking information to the touch information (trajectory) that is input and displayed by itself, the trajectory output by the touch information, You can perform output that shakes or shines (output that represents the image of shaking), or the shaking information that you input is applied to the touch information (trajectory) that is input and displayed by you. Then, an output (an output representing an image of shaking) may be performed such that the locus output by touch information is shaken or lit.

  In addition, it is preferable that the communication device in this embodiment has a telephone function. Then, it is preferable to use a telephone function when transmitting voice to convey emotions and information, and to convey emotion and information using touch information when voice cannot be transmitted.

  Furthermore, the processing in the present embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded and distributed on a recording medium such as a CD-ROM. This also applies to other embodiments in this specification. Note that the software that implements the information processing apparatus according to the present embodiment is the following program. That is, the program includes a receiving unit that receives communication partner identification information that is information for identifying a communication partner terminal, a receiving unit that receives a communication request from the communication partner terminal, and the communication partner identification information. A touch information acquisition unit that receives or receives a communication request from a communication partner terminal and establishes communication, receives a user input to the touch panel, and acquires touch information that is information about the input locus; and It is a program for functioning as an output unit that outputs touch information to a screen on which the touch panel is mounted, and a transmission unit that transmits the touch information to the terminal of the communication partner.

  In the above program, the receiving unit also receives touch information from a communication partner terminal, and the output unit outputs a locus indicated by the touch information received by the receiving unit, and causes the computer to function. It is preferable that it is a program.

  In the above program, the communication device further includes a shaking information acquisition unit that detects shaking of the communication device and acquires shaking information that is information relating to the shaking, and the transmission unit functions as a transmitter that also transmits the shaking information. It is preferable that the program is for causing the program to occur.

  In the above program, the receiving unit is preferably a program for causing a computer to function, further including a shaking information output unit that receives shaking information from a communication partner terminal and outputs the shaking information. It is.

  In the above program, the lifetime of the touch information is stored in a storage medium, and the output unit is a program for causing the computer to function as erasing the touch information output to the screen according to the lifetime. Is preferred.

  In the above program, it is preferable that the output unit is a program for causing a computer to function as a unit that erases the locus according to the lifetime after outputting the locus indicated by the touch information received by the receiving unit. It is.

  In the program, the storage medium stores blur condition information indicating a blur condition of touch information when outputting touch information, and the output unit outputs the touch information output to the screen according to the blur condition information. It is preferable that the program is a program for causing a computer to function as a dim output.

  In the above-mentioned program, it is preferable that the output unit is a program for causing a computer to function as the touch information received by the reception unit blurringly output according to the blur condition information.

  The program further includes a determination unit that determines whether the position on the touch panel indicated by the touch information received by the reception unit matches the position indicated by the touch information acquired by the touch information acquisition unit, The output unit is a program for causing a computer to function as if touch information corresponding to the matched position is output in a different manner compared to other information when it is determined that the determination unit matches. It is preferable to be.

  In the above program, an image is stored in a storage medium, and the transmission unit causes the computer to function as transmitting the image to the communication partner terminal after starting communication with the communication partner terminal. It is preferable that it is a program.

In the above program, the camera further includes a camera, and the transmission unit is a program for causing a computer to function as transmitting an image captured by the camera during communication with the communication partner terminal. That is preferred.
(Embodiment 2)

  In the present embodiment, a communication system 2 including a communication device that can send touch information in a mail will be described. A communication system 2 including a communication device that can reproduce touch information in an e-mail will be described. In other words, the communication system 3 can realize the transmission / reception of touch information and the reply to the information including the touch information by specifying the other party by non-real time communication.

  FIG. 14 is a conceptual diagram of the communication system 2 in the present embodiment. The communication system 2 includes a first communication device 21, a mail server device 22, and a second communication device 23. Here, for example, mail including touch information input from the first communication device 21 is accumulated in the mail server device 22 and reproduced by the second communication device 23. The mail server device 22 may be a so-called normal mail server. Further, in FIG. 14, the mail server device 22 from which the first communication device 21 reads mail and the mail server device 22 from which the second communication device 23 reads mail are the same, but may be different mail server devices 22. Needless to say.

  FIG. 15 is a block diagram of the communication system 2 in the present embodiment. Here, the structure of the 1st communication apparatus 21 and the 2nd communication apparatus 23 is the same.

  The first communication device 21 includes a touch panel 1101, an image storage unit 1102, an attribute value storage unit 1103, a reception unit 2101, a touch information acquisition unit 1106, a shake information acquisition unit 1107, a determination unit 1108, a reception unit 2102, an output unit 2103, a shake. An information output unit 1110 and a transmission unit 2104 are provided.

  The mail server device 22 includes a mail storage unit 221, a mail reception unit 222, a mail storage unit 223, and a mail transmission unit 224.

  The accepting unit 2101 accepts a mail address of a mail sending partner and a mail transmission instruction. Needless to say, the reception unit 2101 may receive other instructions and information such as an open instruction that is an instruction to open a mail received by the reception unit 2102. The other information is information indicating the content of e-mail, for example. Also, the input means such as a mail address and various instructions may be anything such as a numeric keypad, a keyboard, a mouse or a menu screen. The accepting unit 2101 can be realized by a device driver for input means such as a numeric keypad and a keyboard, control software for a menu screen, and the like.

  The receiving unit 2102 receives mail. The receiving unit 2102 normally issues an instruction to the mail server device 22 and receives mail from the mail server device 22 when the receiving unit 2101 receives an open instruction. The receiving unit 2102 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

  The output unit 2103 outputs touch information to a screen on which the touch panel 1101 is mounted. When the output unit 2103 receives an open instruction, the output unit 2103 configures and outputs a locus from touch information included in the mail. Needless to say, the output unit 2103 may output a character string or an image included in the mail. Here, the output is a concept including display on a display, projection using a projector, transmission to an external display device, and the like. The output unit 2103 may be considered as including or not including an output device such as a display. The output unit 2103 can be realized by output device driver software, or output device driver software and an output device.

  When the reception unit 2101 receives a transmission instruction, the transmission unit 2104 transmits an email including touch information to a transmission destination indicated by the email address. The transmission unit 2104 preferably includes the image stored in the image storage unit 1102 in the mail (or attached to the mail) and transmits the image to the transmission destination. In addition, when the mail includes touch information, the transmission unit 2104 preferably transmits the attribute value of touch information (for example, lifetime or blur condition information) stored in the attribute value storage unit 1103. The transmitting unit 2104 is usually realized by a wireless or wired communication unit, but may be realized by a broadcasting unit.

  The mail storage unit 221 can store mail transmitted from the first communication device 21, the second communication device 23, and the like. The mail storage unit 221 is preferably a nonvolatile recording medium, but can also be realized by a volatile recording medium.

  The mail receiving unit 222 receives mail from the first communication device 21, the second communication device 23, and the like. The mail may include touch information, an image, an attribute value of touch information, and the like. The mail receiving unit 222 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

  The mail storage unit 223 stores the mail received by the mail receiving unit 222 in the mail storage unit 221. The mail storage unit 223 can usually be realized by an MPU, a memory, or the like. The processing procedure of the mail storage unit 223 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The mail transmission unit 224 reads the mail corresponding to the open instruction from the mail storage unit 221 in response to the open instruction from the first communication device 21, the second communication device 23, or the like, and the first communication device 21 or the second communication device 23. Send to etc. The mail transmission unit 224 is usually realized by a wireless or wired communication unit, but may be realized by a broadcasting unit.

  Next, operations of the first communication device 21 and the second communication device 23 will be described with reference to the flowchart of FIG. In the flowchart of FIG. 16, the description of the same steps as those in the flowchart of FIG. 3 is omitted.

  (Step S1601) The transmission unit 2104 associates the touch information with the time and stores at least temporarily in the buffer. Note that the transmitting unit 2104 acquires time from a clock (not shown). The process returns to step S304.

  (Step S1602) The transmission unit 2104 associates the shake information acquired by the shake information acquisition unit 1107 with the time, and stores at least temporarily in the buffer. Note that the transmitting unit 2104 acquires time from a clock (not shown). The process returns to step S304.

  (Step S1603) The accepting unit 2101 determines whether or not the mail address of the mail recipient is accepted. If the e-mail address is accepted, the process goes to step S1604, and if the e-mail address is not accepted, the process goes to step S1605.

  (Step S1604) The transmission unit 2104 temporarily stores at least the mail address received in step S1603 in a buffer. The process returns to step S304.

  (Step S1605) The accepting unit 2101 determines whether or not the text of the mail has been accepted. If the mail text is accepted, the process goes to step S1606, and if the mail text is not accepted, the process goes to step S1607.

  (Step S1606) The transmission unit 2104 temporarily stores at least the text of the mail received in step S1605 in a buffer. The process returns to step S304.

  (Step S1607) The accepting unit 2101 determines whether or not a mail transmission instruction has been accepted. If a mail transmission instruction is accepted, the process proceeds to step S1608, and if a mail transmission instruction is not accepted, the process proceeds to step S1612.

  (Step S 1608) The transmission unit 2104 reads an image from the image storage unit 1102.

  (Step S1609) The transmission unit 2104 reads one or more attribute values from the attribute value storage unit 1103.

  (Step S1610) The transmission unit 2104 configures a mail to be transmitted using one or more pieces of information among images, touch information, attribute values, mail text, and the like. In such a case, the transmission unit 2104 normally composes a mail including the other party's mail address, its own mail address, and the like.

  (Step S1611) The transmission unit 2104 transmits the mail configured in step S1610 to the destination indicated by the destination mail address. The process returns to step S304.

  (Step S1612) The accepting unit 2101 determines whether or not a mail open instruction has been accepted. If a mail open instruction is accepted, the process proceeds to step S1613. If a mail open instruction is not accepted, the process returns to step S304. The mail open instruction usually has an identifier of the mail to be opened.

  (Step S1613) The receiving unit 2102 receives a mail corresponding to the open instruction from the mail server device 22. Such processing is a known technique.

  (Step S1614) The output unit 2103 performs mail output processing. The process returns to step S304. The mail output process will be described with reference to the flowchart of FIG.

  In the flowchart of FIG. 16, the first communication device 21 and the second communication device 23 may transmit one or more pieces of information among images, attribute values, mail text, shaking information, touch information, and the like.

  In the flowchart of FIG. 16, it is usually preferable that the attribute value and the shake information can be transmitted only when touch information is transmitted. However, only the shake information may be transmitted.

  Further, in the flowchart of FIG. 16, the process is terminated by powering off or a process termination interrupt.

  Next, the mail output process in step S1614 will be described using the flowchart of FIG. In the flowchart of FIG. 17, description of the same steps as those in the flowchart of FIG. 3 is omitted.

  (Step S1701) The output unit 2103 extracts and outputs an image included in the mail. The output unit 2103 understands (holds) the mail data structure in advance. Needless to say, the mail may not include an image.

  (Step S1702) The output unit 2103 retrieves and outputs the body text (character string, etc.) included in the mail. Needless to say, the mail may not include the text.

  (Step S1703) The output unit 2103 determines whether or not the head of time-series information in the mail (the head of unprocessed data) is touch information. If it is touch information, go to Step S306, and if it is not touch information, go to Step S1704. The time-series information is information that is associated with information indicating time and order and has order. The time-series information is, for example, touch information or shaking information.

  (Step S1704) The output unit 2103 determines whether or not the head of time-series information in the mail (the head of unprocessed data) is shaking information. If it is shaking information, go to step S1705, and if it is not shaking information, go to step S1706.

  (Step S1705) The shake information output unit 1110 outputs shake information. It is assumed that the output shaking information is deleted or the processing pointer is moved.

  (Step S1706) The output unit 2103 determines whether time-series information (touch information, shaking information, etc.) in the mail does not exist (whether processing has been completed). If it does not exist, the process returns to the upper process, and if it exists, the process returns to step S1703.

  In the flowchart of FIG. 17, it is assumed that after touch information is output, the touch information is deleted or the processing pointer is moved in the same manner as the shake information.

  Hereinafter, a specific operation of the communication system 2 in the present embodiment will be described. The conceptual diagram of the communication system 2 is FIG.

  Now, the user of the first communication device 21 is Ichiro Ota, and the user of the second communication device 22 is Hanako Yamamoto. The image storage unit 1102 of the first communication device 21 stores the image of FIG. 5A and the user name “Ichiro Ota”. In addition, the image storage unit 1102 of the second communication device 22 stores the image of FIG. 5B and the user name “Hanako Yamamoto”. In addition, Ichiro Ota and Hanako Yamamoto are lovers, for example.

  In the attribute value storage unit 1103 of the first communication device 21, the lifetime “10 seconds” and the blur condition information “3” are stored. The attribute value storage unit 1103 of the first communication device 21 holds a blur condition information management table shown in FIG.

  In this situation, Ichiro Ota started a mailer to create a mail addressed to Hanako Yamamoto on the first communication device 21.

  And Ichiro Ota has entered Hanako Yamamoto's email address. Next, the reception unit 2101 receives the mail address of Hanako Yamamoto. Then, the transmission unit 2104 temporarily stores the accepted mail address of Hanako Yamamoto in the buffer.

  It is assumed that Ichiro Ota has written a figure on the touch panel 1101 with a finger. Then, the touch information acquisition unit 1106 configures touch information having one or more pieces of coordinate information. Next, the output unit 1109 performs the touch information output process described above. It is assumed that, for example, the heart graphic shown in FIG. 18 is output on the screen by such output.

  Next, the transmission unit 2104 associates the touch information acquired by the touch information acquisition unit 1106 with the time, and stores at least temporarily in the buffer.

  Next, it is assumed that Ichiro Ota's feeling that he wanted to meet Hanako Yamamoto increased and unexpectedly rocked the first communication device 21.

  Next, the shaking information acquisition unit 1107 detects shaking. Then, the shaking information acquisition unit 1107 configures shaking information “3” corresponding to the detected shaking.

  Then, the transmitting unit 2104 associates the shaking information “3” acquired by the shaking information acquisition unit 1107 with the time, and stores at least temporarily in the buffer.

  Then, the heart shape is erased from the screen of the first communication device 21 in 10 seconds according to the lifetime.

  Next, it is assumed that Ichiro Ota has written the word “like” on the touch panel 1101 with a finger. Then, the touch information acquisition unit 1106 configures touch information having one or more pieces of coordinate information. Next, the output unit 1109 performs the touch information output process described above. With this output, the word “like” is output on the screen.

  Next, the transmission unit 2104 associates the touch information acquired by the touch information acquisition unit 1106 with the time, and stores at least temporarily in the buffer.

  Next, it is assumed that Ichiro Ota's feeling that he would like to meet Hanako Yamamoto also increased, and unexpectedly shook the first communication device 21 more violently.

  Next, the shaking information acquisition unit 1107 detects shaking. Then, the shaking information acquisition unit 1107 configures shaking information “5” corresponding to the detected shaking.

  Then, the transmission unit 2104 associates the time of the shake information “5” acquired by the shake information acquisition unit 1107 with the time, and stores at least temporarily in the buffer.

  Then, the heart shape is erased from the screen of the first communication device 21 in 10 seconds according to the lifetime.

  Next, it is assumed that Ichiro Ota has input the text “Genki?” Using a software keyboard (not shown). The accepting unit 2101 accepts the mail text “How are you?”. Then, the transmitting unit 2104 temporarily stores at least the text of the received mail “Genki?” In the buffer.

  Next, Ichiro Ota inputs a mail transmission instruction. The accepting unit 2101 accepts a mail transmission instruction.

  Next, the transmission unit 2104 reads an image from the image storage unit 1102. Further, the transmission unit 2104 reads the lifetime “10” and the blur condition information “3” from the attribute value storage unit 1103.

  Next, the transmission unit 2104 composes an e-mail to be transmitted using the image, touch information, lifetime “10”, blur condition information “3”, and the main text of the e-mail “Genki?”. FIG. 19 shows an example of the data structure of the constructed mail. In FIG. 19, the time is added as an example of time-series information. The touch information “(x1, y1), 200901202130155” indicates that the user touched the position (x1, y1) on the touch panel 1101 at “2009/12/02 13:01:55”. In FIG. 19, the lifetime and blur condition information exist for each touch information, but one lifetime and blur condition information may exist for a plurality of touch information. The presence of lifetime and blur condition information for each touch information is preferable because the ability to express a touch information group to be transmitted and received is improved.

  Next, the transmitting unit 2104 transmits the configured mail (FIG. 19) to the destination indicated by the destination mail address.

  Then, the mail is transmitted to the mail server device 22 and stored.

  Next, Hanako Yamamoto inputs an instruction to open a mail from Ichiro Ota to the second communication device 23.

  Next, the accepting unit 2101 of the second communication device 23 accepts a mail open instruction. The receiving unit 2102 receives mail from the mail server device 22 from Ichiro Ota corresponding to the open instruction.

  Next, the output unit 2103 performs mail output processing. FIG. 20 is a diagram showing transition of mail output. First, the output unit 2103 outputs the image of FIG. Next, the output unit 2103 reads the first touch information and time such as “(x1, y1), 20000091202130155” in FIG. 19 and outputs a heart graphic (see FIG. 20A). Next, the shaking information output unit 1110 reads “anglerate =“ 3 ”, 200909130130245” in FIG. 19 and shakes and outputs the heart figure according to the shaking information “3” (see FIG. 20B).

  Next, according to the lifetime “10”, the output unit 2103 erases each point when 10 seconds have elapsed from the output, and as a result, erases the heart graphic.

  Next, the output unit 2103 reads the second touch information such as “(X1, Y1), 200909130130351” and the time in FIG. 19 and outputs the character “like” (see FIG. 20D). Next, the shaking information output unit 1110 reads “anglerate =“ 5 ”, 200909120130520” in FIG. 19 and vigorously shakes and outputs the character “like” according to the shaking information “5” (FIG. 20E). reference).

  Next, according to the lifetime “10”, the output unit 2103 deletes each point when 10 seconds have elapsed from the output, and as a result, deletes the character “like”.

  Next, the output unit 2103 outputs the text “Genki?” On the screen (see FIG. 20F). In the above description, it is assumed that the heart figure and the character “like” are output in a blurred manner according to the blur condition information “3”.

  As described above, according to the present embodiment, it is possible to send a mail including touch information. Therefore, it is easy to convey the sender's feelings. In addition, since the shaking information can be transmitted and the shaking information can be output, the emotion of the sender can be transmitted more easily. Further, the lifetime can be transmitted, and the touch information can be erased according to the lifetime, so that the touch information can be output one after another.

  Note that the software that implements the information processing apparatus according to the present embodiment is the following program. In other words, this program allows the computer to receive the mail address of the mail recipient and the mail transmission instruction, and accepts the user's input to the touch panel, and acquires touch information that is information about the input locus. An information acquisition unit; an output unit that outputs the touch information to a screen on which a touch panel is mounted; and a transmission destination indicated by the mail address when the reception unit receives a transmission instruction, including an email including the touch information. It is a program for making it function as a transmission part which transmits to.

The program further includes a receiving unit that receives mail, the receiving unit also receives an open instruction that is an instruction to open the mail received by the receiving unit, and the output unit receives the opening instruction. In addition, it is preferable that the program is a program for causing a computer to function as a trajectory configured and output from touch information included in the mail.
(Embodiment 3)

  In this embodiment, a communication system that realizes a so-called electronic bulletin board in which a plurality of users can upload information having touch information to the server device, and a plurality of users can browse the uploaded information and reply to the information. 3 will be described. That is, the communication system 3 can realize transmission / reception of touch information, a reply to information including touch information, and the like by non-real-time communication among a plurality of users. Note that the electronic bulletin board system in the present embodiment includes an augmented reality space (AR) system, an online MUD system, and the like that allow users to post information.

  The conceptual diagram of the communication system 3 is the same as FIG. The communication system 3 includes a first communication device 31, a server device 32, and a second communication device 33.

  FIG. 21 is a block diagram of the communication system 3 in the present embodiment.

  The first communication device 31 includes a touch panel 1101, an image storage unit 1102, an attribute value storage unit 1103, a server device identifier storage unit 3101, a touch information acquisition unit 1106, a shake information acquisition unit 1107, a determination unit 1108, a shake information output unit 1110, A reception unit 3102, a reception unit 3103, an output unit 3104, and a transmission unit 3105 are provided. Here, it is assumed that the second communication device 33 has the same configuration as the first communication device 31.

  The server device 32 includes an information storage unit 3201, an information reception unit 3202, an information storage unit 3203, and an information transmission unit 3204. The server device 32 is a known electronic bulletin board system server device, and thus detailed description thereof is omitted.

  The server device identifier storage unit 3101 can store a server device identifier for identifying the server device 32. The server device identifier is, for example, the IP address of the server device 32. The server device identifier storage unit 3101 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. There is no limitation on the process in which the server device identifier is stored in the server device identifier storage unit 3101. For example, the server device identifier may be stored in the server device identifier storage unit 3101 via a recording medium, and the server device identifier transmitted via a communication line or the like is stored in the server device identifier storage unit 3101. Alternatively, the server device identifier input via the input device may be stored in the server device identifier storage unit 3101.

  The accepting unit 3102 accepts a transmission instruction. The accepting unit 3102 also accepts an acquisition instruction that is an instruction to acquire information stored in the server device 32. The accepting unit 3102 may accept other instructions and information. Input means such as a transmission instruction and an acquisition instruction may be anything such as a numeric keypad, a keyboard, a mouse, or a menu screen. The receiving unit 3102 can be realized by a device driver for input means such as a numeric keypad or a keyboard, control software for a menu screen, and the like.

  When the reception unit 3102 receives an acquisition instruction, the reception unit 3103 receives information indicated by the acquisition instruction from the server device 32. The receiving unit 3103 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

  The output unit 3104 outputs touch information. The output unit 3104 normally outputs touch information to a screen on which the touch panel 1101 is mounted. The output unit 3104 forms a trajectory from the information received by the receiving unit 3103 and outputs it. The operation of the output unit 3104 is the same as the operation of the output unit 2103. You may think that the output part 3104 and the output part 2103 differ only in whether the data to be processed is bulletin board data or mail. Here, the output is a concept including display on a display, projection using a projector, transmission to an external display device, and the like. The output unit 3104 may or may not include an output device such as a display. The output unit 3104 can be realized by output device driver software, or output device driver software and an output device.

  The transmission unit 3105 transmits information including touch information to the server device 32 identified by the server device identifier. The transmitting unit 3105 is usually realized by a wireless or wired communication unit, but may be realized by a broadcasting unit.

  The information storage unit 3201 can store information input by the user. The information input by the user is information transmitted from the first communication device 31, the second communication device 33, or the like. The information storage unit 3201 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium.

  The information receiving unit 3202 receives information and instructions transmitted from the first communication device 31, the second communication device 33, and the like. This information is information uploaded to the electronic bulletin board by the user, information on a reply to the information, and the like. The information receiving unit 3202 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

  The information storage unit 3203 stores the information received by the information reception unit 3202 in the information storage unit 3201. The information storage unit 3203 can usually be realized by an MPU, a memory, or the like. The processing procedure of the information storage unit 3203 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The information transmission unit 3204 transmits information to the first communication device 31, the second communication device 33, etc. according to the acquisition instruction transmitted from the first communication device 31, the second communication device 33, etc. The information transmission unit 3204 is usually realized by a wireless or wired communication means, but may be realized by a broadcasting means.

  Next, operation | movement of the 1st communication apparatus 31 is demonstrated using the flowchart of FIG. In the flowchart of FIG. 22, the description of the same steps as those in the flowcharts of FIGS.

  (Step S2201) The reception unit 3102 determines whether or not a text to be uploaded to the bulletin board has been received from the user. If a text is accepted, the process goes to step S2202, and if no text is accepted, the process goes to step S2203. Note that the text is usually a character string, but may be an image, a moving image, a voice, or the like.

  (Step S2202) Transmission section 3105 temporarily stores the text accepted in step S2201. Go to step S304.

  (Step S2203) The reception unit 3102 determines whether a transmission instruction has been received from the user. When the transmission is a reply to other information, the transmission instruction includes an identifier of the other information. Further, it is assumed that identifiers of other information can be obtained when information is received. If the transmission instruction is accepted, the process goes to step S1608, and if the transmission instruction is not accepted, the process goes to step S2206.

  (Step S2204) The transmission unit 3105 configures information to be transmitted using one or more pieces of information among images, touch information, attribute values, texts, and the like. An example of the structure of the configured information is shown in FIG.

  (Step S2205) The transmission unit 3105 transmits the information configured in step S2204 to the server device 32 identified by the server device identifier stored in the server device identifier storage unit 3101. Go to step S304.

  (Step S2206) It is determined whether an acquisition instruction has been received from the user. If an acquisition instruction is accepted, the process proceeds to step S2207;

  (Step S2207) The receiving unit 3103 receives information that can be identified by the acquisition instruction from the server device 32.

  (Step S2208) The output unit 3104 outputs the information received in step S2207. Go to step S304. The output process here is the same as the output process shown in the flowchart of FIG. Note that the output target is mail in the flowchart of FIG. 17 and information on the bulletin board in the flowchart of FIG.

  Note that the processing is ended by powering off or interruption for aborting the processing in the flowchart in FIG.

  Hereinafter, the specific operation of the communication system 3 in the present embodiment is different from the specific operation of the communication system 2 described in the second embodiment in that the mail is replaced with the electronic bulletin board. The operation is similar. The communication system 3 is different from the existing electronic bulletin board system in that information including touch information is processed, but the information is uploaded to the electronic bulletin board system, downloaded and played back, or returned. Since the points are the same, detailed description is omitted.

  As described above, according to the present embodiment, a plurality of users can upload information having touch information to the server device, a plurality of users can browse the uploaded information, and reply to the information.

  In the present embodiment and the second embodiment, the example in which touch information can be included in the application of mail or electronic bulletin board has been described. However, non-real-time information that can include touch information is not limited to mail or electronic bulletin boards, and can be used in other communication systems having non-real-time properties such as blogs and news systems.

  Note that the software that implements the information processing apparatus according to the present embodiment is the following program. That is, this program stores a server device identifier for identifying a server device, receives a transmission instruction from a receiving unit, receives a user's input to the touch panel, and acquires touch information that is information about the input locus. A touch information acquisition unit; an output unit that outputs the touch information to a screen on which the touch panel is mounted; and a transmission unit that transmits information including the touch information to a server device identified by the server device identifier. It is a program to make it function.

  In the program, the reception unit also receives an acquisition instruction that is an instruction to acquire information stored in the server device. When the reception unit receives the acquisition instruction, the information indicated by the acquisition instruction is It is preferable that the information processing apparatus further includes a receiving unit that receives from a server device, and the output unit is a program that causes a computer to function as a path that is configured and output from information received by the receiving unit.

  FIG. 23 shows the external appearance of a computer that executes the program described in this specification and realizes the communication apparatus and the like of the above-described embodiment. The above-described embodiments can be realized by computer hardware and a computer program executed thereon. FIG. 23 is an overview diagram of the computer system 340, and FIG. 24 is a diagram showing an internal configuration of the computer system 340. As shown in FIG.

  23, the computer system 340 includes a computer 341 including an FD drive 3411 and a CD-ROM drive 3412, a keyboard 342, a mouse 343, a monitor 344, and a microphone 345.

  24, in addition to the FD drive 3411 and the CD-ROM drive 3412, the computer 341 stores an MPU 3413, a bus 3414 connected to the CD-ROM drive 3412 and the FD drive 3411, and a program such as a bootup program. A RAM 3416 for temporarily storing application program instructions and providing a temporary storage space; and a hard disk 3417 for storing application programs, system programs, and data. Although not shown here, the computer 341 may further include a network card that provides connection to the LAN.

  A program that causes the computer system 340 to execute functions such as the communication system of the above-described embodiment is stored in the CD-ROM 3501 or the FD 3502, inserted into the CD-ROM drive 3412 or the FD drive 3411, and further stored in the hard disk 3417. May be forwarded. Alternatively, the program may be transmitted to the computer 341 via a network (not shown) and stored in the hard disk 3417. The program is loaded into the RAM 3416 at the time of execution. The program may be loaded directly from the CD-ROM 3501, the FD 3502, or the network.

  The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 341 to execute the functions of the communication system according to the above-described embodiment. The program only needs to include an instruction portion that calls an appropriate function (module) in a controlled manner and obtains a desired result. How the computer system 340 operates is well known and will not be described in detail.

  In the above program, in the step of transmitting information, the step of receiving information, etc., processing performed by hardware, for example, processing performed by a modem or an interface card in the transmitting step (only performed by hardware). Not included).

  Further, the computer that executes the program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

  Further, in each of the above embodiments, it goes without saying that two or more communication units existing in one apparatus may be physically realized by one medium.

  In each of the above embodiments, each process (each function) may be realized by centralized processing by a single device (system), or by distributed processing by a plurality of devices. May be.

  The present invention is not limited to the above-described embodiments, and various modifications are possible, and it goes without saying that these are also included in the scope of the present invention.

  As described above, the communication system according to the present invention has an effect that it can convey feelings to the other party by transmitting information touched on the touch panel, and is useful as a communication system or the like.

1, 2, 3 Communication system 11, 21, 31 First communication device 12, 22, 23, 33 Second communication device 22 Mail server device 32 Server device 221 Mail storage unit 222 Mail reception unit 223 Mail storage unit 224 Mail transmission unit DESCRIPTION OF SYMBOLS 1101 Touch panel 1102 Image storage part 1103 Attribute value storage part 1104, 2101, 3102 Reception part 1105, 2102, 3103 Reception part 1106 Touch information acquisition part 1107 Information acquisition part 1108 Judgment part 1109, 2103, 3104 Output part 1110 Information output part 1111, 2104, 3105 Transmission unit 3101 Server device identifier storage unit 3201 Information storage unit 3202 Information reception unit 3203 Information storage unit 3204 Information transmission unit

Claims (17)

A communication device including a touch panel and capable of bidirectional communication,
A receiving unit that receives communication partner identification information that is information for identifying a communication partner terminal;
A receiving unit that receives a communication request from a communication partner terminal;
Touch that receives the communication partner identification information or receives a communication request from a terminal of the communication partner and establishes communication, and then receives a user input to the touch panel and acquires touch information that is information about the input locus. An information acquisition unit;
An output unit that outputs the touch information to a screen on which the touch panel is mounted;
A communication apparatus comprising: a transmission unit that transmits the touch information to the communication partner terminal. The receiver is
Receive touch information from the other party ’s device,
The output unit is
The communication device according to claim 1, which also outputs a trajectory indicated by the touch information received by the receiving unit. It further comprises a shaking information acquisition unit that detects that the communication device has shaken, and acquires shaking information that is information relating to the shaking,
The transmitter is
The communication apparatus according to claim 1, wherein the shake information is also transmitted. The receiver is
Receive shaking information from the other party's terminal,
The communication apparatus according to claim 3, further comprising a shake information output unit that outputs the shake information. An attribute value storage unit that can store the lifetime of the touch information;
The output unit is
The communication apparatus according to claim 1, wherein the touch information output on the screen is erased according to a lifetime. The output unit is
The communication device according to claim 5, wherein after outputting the locus indicated by the touch information received by the receiving unit, the locus is erased according to the lifetime. The attribute value storage unit
Stores the blur condition information indicating the blur condition of the touch information when outputting the touch information,
The output unit is
The communication apparatus according to claim 1, wherein the touch information output on the screen is output in a blurred manner according to the blur condition information. The output unit is
The communication apparatus according to claim 7, wherein the touch information received by the receiving unit is output in a blurred manner according to the blur condition information. A determination unit that determines whether or not a position on the touch panel indicated by the touch information received by the reception unit matches a position indicated by the touch information acquired by the touch information acquisition unit;
The output unit is
The communication apparatus according to claim 2, wherein, when the determination unit determines that they match, the touch information corresponding to the matched position is output in a different manner as compared with other information. An image storage unit capable of storing images;
The transmitter is
The communication apparatus according to claim 1, wherein the image is transmitted to the communication partner terminal after communication with the communication partner terminal is started. A camera,
The transmitter is
The communication device according to any one of claims 1 to 10, wherein the communication device also transmits an image captured by the camera during communication with the communication partner terminal. A communication device comprising a touch panel,
An accepting unit that accepts an email address of an email recipient and an email transmission instruction;
A touch information acquisition unit that receives user input to the touch panel and acquires touch information that is information related to the input locus;
An output unit that outputs the touch information to a screen on which the touch panel is mounted;
A communication apparatus comprising: a transmission unit configured to transmit a mail including the touch information to a transmission destination indicated by the mail address when the reception unit receives a transmission instruction. It further includes a receiving unit for receiving mail,
The reception unit
Also accepts an open instruction that is an instruction to open an email received by the receiving unit,
The output unit is
13. The communication apparatus according to claim 12, wherein when receiving the open instruction, a trajectory is formed from touch information included in the mail and output. A communication device comprising a touch panel,
A server device identifier storage unit capable of storing a server device identifier for identifying the server device;
A reception unit for receiving a transmission instruction;
A touch information acquisition unit that receives user input to the touch panel and acquires touch information that is information related to the input locus;
An output unit that outputs the touch information to a screen on which the touch panel is mounted;
A communication device comprising: a transmission unit that transmits information including the touch information to a server device identified by the server device identifier. The reception unit
Accepting an acquisition instruction that is an instruction to acquire information stored in the server device;
When the reception unit receives an acquisition instruction, the reception unit further includes a reception unit that receives information indicated by the acquisition instruction from the server device,
The output unit is
The communication apparatus according to claim 14, wherein a trajectory is formed from information received by the receiving unit and output. A communication method realized by a reception unit, a reception unit, a touch information acquisition unit, an output unit, and a transmission unit,
A reception step of receiving communication partner identification information, which is information for identifying a communication partner terminal, by the reception unit;
A receiving step of receiving a communication request from a communication partner terminal by the receiving unit;
The touch information acquisition unit receives the communication partner identification information or receives a communication request from the communication partner terminal, and after communication is established, accepts a user input to the touch panel. A touch information acquisition step of acquiring certain touch information;
An output step of outputting the touch information to a screen on which the touch panel is mounted by the output unit;
A communication method comprising a transmission step of transmitting the touch information to the communication partner terminal by the receiving unit. Computer
A receiving unit that receives communication partner identification information that is information for identifying a communication partner terminal;
A receiving unit that receives a communication request from a communication partner terminal;
Touch that receives the communication partner identification information or receives a communication request from a terminal of the communication partner and establishes communication, and then receives a user input to the touch panel and acquires touch information that is information about the input locus. An information acquisition unit;
An output unit that outputs the touch information to a screen on which the touch panel is mounted;
A program for causing the touch information to function as a transmission unit that transmits to the terminal of the communication partner.