KR20160123074A - Device and Method for Communication Based on Receiver Contexts - Google Patents

Abstract

The present invention relates to a first device performing communication with a second communication. The present invention provides the device comprising: a display unit which displays a contact list having at least one contact item; a control unit which selects the contact item corresponding to the second device among at least one contact item, obtains state information of the second device, and determines a communication method about the second device based on the state information; and a communication unit which performs communication with the second device by using the communication method. The present invention can broaden communication methods by developing various applications which can perform communication.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a communication method and a communication device,

And methods and devices for performing communications.

With the development of various applications capable of performing communication as well as communication and text messages in the method of performing communication, the selection of communication methods has been widening.

A device and method for performing communication are provided. The present invention also provides a program for causing a computer to execute a method of performing communication, the recorded computer readable recording medium being provided.

A first device for performing communication with a second device according to an embodiment, comprising: a display for displaying a contact list including at least one contact item; A controller for selecting a contact item corresponding to a second device from among at least one contact item, acquiring state information of the second device, and determining a communication method for the second device based on the state information; A communication unit for communicating with a second device using a communication method; . ≪ / RTI >

In addition, the communication method can be performed using at least one of a call, a voice message, a text message, a messenger application, and an SNS application.

In addition, the status information may include information about the availability of at least one communication method for the second device.

Further, the control unit determines one of the available communication methods indicated by the status information as a communication method.

The display unit may display at least one of a list of communication methods selected according to status information of the selected second device and status information of the selected second device.

Further, the display unit may display a communication history as a history of communication with the second device.

The second device communicates with the first device according to an exemplary embodiment of the present invention. The second device communicates with the first device using the first communication method. A control unit for obtaining status information on the second device and determining a second communication mode of the second device for outputting the received information using the communication based on the status information; And an output unit for outputting information received using the determined second communication scheme; . ≪ / RTI >

Further, the second communication method may be performed using at least one of a call, a voice message, a text message, a messenger application, and an SNS application.

The status information may also include information about the availability of at least one communication scheme for the second device.

A collection unit for collecting environmental data around the second device; And the control unit may determine the status information of the second device based on at least one of the environment data and the data stored in the second device.

When the status information indicates that the first communication method can be used, the control unit determines the second communication method with the same communication method as the first communication method, and instructs the status information to indicate that the first communication method can not be used The second communication method can be determined to be one of the available communication methods indicated by the status information.

When the first communication method and the second communication method are different, the control unit converts the information received from the first device into a format usable in the second communication method, and the output unit receives the information transmitted by the first device And output the converted information.

A user input for receiving an input to a second device; And the control unit may change the second communication method based on the input received through the user input unit.

Further, the display unit may display a communication history as a history of communication with the second device.

A computing device according to an embodiment includes a control unit for determining status information of a second device based on at least one of data stored in a second device and environment data surrounding a second device; And a communication unit for receiving at least one of data stored in the second device and environment data around the second device, and transmitting the status information to the first device; And the status information may include information about availability of at least one communication scheme for the second device.

In addition, the data stored in the second device includes at least one of a job of a second device user, a location of a house, a location of a company, a schedule, and a date of anniversary, and environmental data around the second device includes a GPS location of a second device Wi-Fi access point information, Wi-Fi signal search result, connected base station location, surrounding brightness, and surrounding noise.

A method for a first device to communicate with a second device in accordance with an embodiment, the method comprising: displaying a contact list including at least one contact item; Selecting a contact item corresponding to a second device from at least one contact item; Obtaining status information of the second device; Determining a communication method for the second device based on the status information; And communicating with a second device using a communication scheme; . ≪ / RTI >

A method for a second device to communicate with a first device according to an embodiment, the method comprising: performing communication from a first device using a first communication scheme; Obtaining status information for a second device; Determining a second communication mode of the second device for outputting the received information using the communication based on the status information; And outputting the received information using the determined second communication scheme; . ≪ / RTI >

A communication method according to an embodiment includes receiving at least one of data stored in a second device and environment data around a second device; Determining status information of the second device based on at least one of the received data; And transmitting status information to the first device; And the status information may include information about availability of at least one communication scheme for the second device.

There is provided a computer-readable recording medium storing a program for causing a computer to execute a communication method according to an embodiment.

1 is a diagram illustrating an example in which a first device and a second device perform communication according to an embodiment.
2 is a block diagram illustrating a device according to one embodiment.
3 is a block diagram briefly illustrating a structure of a first device according to an embodiment.
4 (a) to 4 (c) are views showing examples of a method of displaying different user interfaces according to a communication method.
5 is an illustration of an example of how a mobile device displays a contact list according to one embodiment.
6 is a diagram illustrating an example of a method of displaying status information of a second device.
7 is a diagram illustrating an example of a method of displaying a list of communication methods selected according to state information of a second device.
8 (a) to 8 (b) are diagrams showing another example of a method of displaying a list of communication methods selected according to status information of a second device.
Figures 9 (a) through 9 (e) illustrate a method of selecting a communication scheme according to an embodiment.
10 is a flow diagram illustrating a method by which a first device communicates with a second device.
11 is a diagram showing an example of a system in which a first device and a second device acquire status information using a server.
12 is a block diagram briefly showing a structure of a server according to an embodiment.
13 is a diagram showing an example of a table used for determining the state information of the second device.
14 is a diagram illustrating an example of a method for obtaining data used to determine status information of a second device.
15 is a flowchart showing an example of a system for obtaining a user's status information using a server.
16 (a) and 16 (b) are flowcharts illustrating an example of a method by which a sender and a receiver exchange status information using a server.
17 is a block diagram briefly illustrating a structure of a second device according to an embodiment.
18 (a) and 18 (b) are diagrams illustrating an example of a method by which a second device determines a second communication mode and outputs the received information.
19 is a flowchart illustrating a method by which a second device communicates with a first device.
20 is a diagram showing an example of a system in which a first device and a second device communicate with each other.
21 is a diagram showing an example of a method of displaying a communication history.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. However, the embodiments may be embodied in various different forms and are not limited to the embodiments described herein. In the drawings, the same reference numbers are used throughout the specification to refer to the same or like parts.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . It is also to be understood that when an element is referred to as "comprising ", it does not exclude other elements unless specifically stated to the contrary.

In this specification, the term " touch " or " touch input " may include not only a direct contact but also a case where the device senses the user's body close to the device (e.g., within 2 cm).

Further, in this specification, " drag " means moving the touched point to the device while the user touches the device.

Also, in this specification, the term " status information ", " device status information ", or " status information of the user of the device " means at least one of the behavior of the user of the device and environmental factors surrounding the user of the device.

In this specification, the term " availability of communication method " means whether or not each communication method can be used according to at least one of the behavior of the user of the device and the environmental factor of the user of the device.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating an example in which a first device and a second device perform communication according to an embodiment. The communication method used to perform the communication may include at least one of a call, a voice message, a video call, a text message, a messenger application, and an SNS application. Communication between the first device 1000 and the second device 2000 may be performed using a communication network of a server or a communication company, or may be performed using a local communication such as Bluetooth or infrared rays.

2 is a block diagram illustrating a device according to one embodiment. 1 is a device according to one embodiment only, and a device may include fewer components or may include more components than those shown in FIG.

Referring to FIG. 1, a device 100 includes a controller 110, a mobile communication module 120, a sub communication module 130, a camera module 140, a GPS module 150, an input / output module 160, A sensor module 170, a storage unit 180, and a display unit 190. The sub-communication module 130 includes at least one of a wireless LAN module 131 and a short-range communication module 132. The camera module 140 includes at least one of a first camera 141 and a second camera 142 Output module 160 may include at least one of a button 161, a microphone 162, a speaker 163, a vibration motor 164 and a touch panel 165. The input /

The control unit 110 stores a ROM 112 storing a control program for controlling the device 100 and a signal or data input from the outside of the device 100, A RAM 113 used as a storage area for the operation and a GPU 114 for processing graphics of the device 100. [ The CPU 111 may include a plurality of processors such as a single core, a dual core, a triple core, or a quad core. The CPU 111, the ROM 112, the RAM 113, and the GPU 114 may be interconnected via an internal bus (BUS).

The control unit 110 includes a mobile communication module 120, a sub communication module 130, a camera module 140, a GPS module 150, an input / output module 160, a sensor module 170, a storage unit 180, And the display unit 190 can be controlled.

The mobile communication module 120 may connect the device 100 to an external device through mobile communication using at least one (one or more) antennas (not shown) under the control of the controller 110. [ The mobile communication module 120 may communicate with a mobile phone (not shown), a smart phone (not shown), a tablet PC (not shown) or other device (not shown) And can transmit / receive a radio signal for making a call, a video call, a text message (SMS) or a multimedia message (MMS) transmission.

The sub communication module 130 may include at least one of a wireless LAN module 131 and a local area communication module 132. For example, it may include only the wireless LAN module 131, only the short range communication module 132, or both the wireless LAN module 131 and the short range communication module 132.

The wireless LAN module 131 can connect to the Internet at a place where a wireless access point (not shown) is installed under the control of the controller 110. [ The wireless LAN module 131 can support the wireless LAN standard IEEE802.11x of the IEEE Institute of Electrical and Electronics Engineers (IEEE). The short-range communication module 132 can wirelessly perform short-range communication between the device 100 and the image forming apparatus (not shown) under the control of the controller 110. [ The short-distance communication method may include Bluetooth, infrared data association (IrDA), Zig-bee method, and the like.

The device 100 may include at least one of a mobile communication module 120, a wireless LAN module 131, and a short-range communication module 132 according to performance.

The camera module 140 may include at least one of a first camera 141 and a second camera 142 for capturing still images or moving images under the control of the controller 110. [ In addition, the first camera 141 or the second camera 142 may include an auxiliary light source (not shown) for providing the light amount required for photographing. The first camera 141 may be disposed on the front side of the device 100 and the second camera 142 may be disposed on the rear side of the device 100. [ Alternatively, the first camera 141 and the second camera 142 may be disposed adjacent to each other (e.g., spacing greater than 1 cm and smaller than 8 cm) to capture a three-dimensional still image or a three-dimensional moving image.

The GPS module 150 receives radio waves from a plurality of GPS satellites (not shown) on the earth orbit and uses the time of arrival from the GPS satellite (not shown) to the device 100 The position of the device 100 can be calculated.

The input / output module 160 may include at least one of a plurality of buttons 161, a microphone 162, a speaker 163, a vibration motor 164, and a touch panel 165.

Button 161 may be formed on the front, side, or back of the housing of device 100 and may include a power / lock button (not shown), a volume button (not shown), a home button, a back button, and a search button 161.

The microphone 162 may receive a voice or a sound according to the control of the controller 110 to generate an electrical signal.

The speaker 163 outputs a sound corresponding to various signals of the mobile communication module 120, the sub communication module 130, the multimedia module 140 or the camera module 150 under the control of the controller 110, Can be output to the outside. The speaker 163 can output sound corresponding to the function performed by the device 100. [ The speaker 163 may be formed in one or more locations at appropriate locations or locations of the housing of the device 100.

The vibration motor 164 can convert an electrical signal into a mechanical vibration under the control of the control unit 110. [ For example, the device 100 in the vibration mode may operate the vibration motor 164 when a voice call is received from another device (not shown). The vibration motor 164 can operate in response to the touching operation of the user touching the touch panel 165 and the continuous movement of the touch input on the touch panel 165. [

The touch panel 165 may transmit an analog signal corresponding to at least one touch input to the user interface to the control unit 110. [ The touch panel 165 may receive at least one touch input via a user's body (e.g., a finger) or touchable input means (e.g., a stylus pen). In addition, the touch panel 165 may receive continuous movement of at least one touch input. The touch panel 165 may transmit an analog signal corresponding to the continuous movement of the touch input to the control unit 110. [

The touch input is not limited to the input through contact between the touch panel 165 and the user's body or touchable input means, but may be a non-contact input (for example, a space between the touch panel 165 and the body is 1 mm or less) . ≪ / RTI > The interval that can be detected by the touch panel 165 can be changed according to the performance or structure of the device 100. [

The touch panel 165 may be implemented using, for example, a resistive method, a capacitive method, an infrared method, or an ultrasound wave method. The touch panel 165 can transmit the result of converting the received analog signal to a digital signal (for example, an X coordinate and a Y coordinate) to the controller 110. The control unit 110 can control the touch panel 165 using the digital signal received from the touch panel 165. [ For example, the control unit 110 may select an application execution icon (not shown) displayed on the touch panel 165 or execute an application in response to the touch input.

The sensor module 170 includes at least one sensor for detecting the state of the device 100. [ For example, the sensor module 170 may include a proximity sensor that detects whether a user is accessing the device 100, a light sensor (not shown) or device 100 that detects the amount of light around the device 100, (Not shown) that detects motion of the device 100 (e.g., rotation of the device 100, acceleration or vibration applied to the device 100). The sensor of the sensor module 170 may be added or deleted depending on the performance of the device 100.

The storage unit 180 may include a mobile communication module 120, a sub communication module 130, a camera module 140, a GPS module 150, an input / output module 160, And may store signals or data input / output corresponding to operations of the display unit 170 and the display unit 190. [ The storage unit 180 may store control programs and applications for controlling the device 100 or the control unit 110. [

The term " storage unit " may include a storage unit 180, a ROM 112 in the control unit 110, a RAM 113, or a memory card (not shown) mounted in the device 100. The storage unit may include a nonvolatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

The display unit 190 displays and outputs information processed by the device 100 to the display panel 191. For example, the display unit 190 may display a user interface for selecting a virtual image, a user interface for setting an operation of a virtual image, and a user interface for purchasing an item of a virtual image.

Meanwhile, when the display panel 191 and the touch panel 165 have a layer structure and are configured as a touch screen, the display unit 190 may be used as an input device in addition to the output device. The display panel 191 of the display unit 190 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display ), A three-dimensional display (3D display), and an electrophoretic display (electrophoretic display). The device 100 may include two or more display units 190 according to the implementation of the device 100. In this case, the two or more display units 190 may be arranged to face each other using a hinge.

3 is a block diagram briefly illustrating a structure of a first device according to an embodiment. The first device 1000 may include a communication unit 1001, a control unit 1002, and a display unit 1003. The communication unit 1001 may correspond to the mobile communication module 120 and the sub communication module 130 of FIG. The control unit may correspond to the control unit 110 of FIG. The display unit 1003 may correspond to the display unit 190 of FIG.

The communication unit 1001 communicates with the second device 2000 and can transmit or receive information. The communication method used to perform the communication may include at least one of a call, a voice message, a video call, a text message, a messenger application, and an SNS application. The communication unit 1001 may perform communication using one of a 2G network, a 3G network, an LTE network, Wifi, Bluetooth, infrared, and ZigBee, but is not limited thereto. When the first device 1000 performs communication with the second device 2000, the communication methods used in the respective devices may be different from each other. For example, the user of the first device 1000 performs communication using the voice through the microphone 162 and the speaker 163, and the user of the second device 2000 uses the text on the touch screen Communication can be performed. The communication unit 1001 can also receive status information of the second device 2000. [ The status information of the second device 2000 may include information on the availability of at least one communication method for the second device 2000. [ For example, the status information of the second device 2000 may indicate that the user of the second device 2000 is callable, unavailable, text available, or text unavailable, but is not limited thereto.

The display unit 1003 can display a contact list including at least one contact item. The contact list may be predefined by the user of the first device 1000. Or the contact list may be automatically generated using at least one of information stored in the first device 1000 and information received through the communication unit 1001 of the first device 1000. [ The display unit 1003 can also be used as an input device when the display panel 191 and the touch panel 165 have a layer structure and are configured as a touch screen. When the user of the first device 1000 performs an input to select a contact item corresponding to the second device 2000 from the contact item using the touch screen, the touch screen displays information on the received input to the control unit 1002, Lt; / RTI > In the step of performing communication with the second device 2000, the display unit 1003 can display different user interfaces according to the communication method.

The control unit 1002 can control the communication unit 1001 and the display unit 1003. The control unit 1002 analyzes and processes the information received by the communication unit 1001 and controls the display unit 1003 to display the received information. The control unit 1002 can receive and analyze information inputted by the user using the microphone 162, the touch panel 165 or the camera module 140 and can control and transmit the information through the communication unit 1001 have. When the first device 1000 receives an input from the first device 1000 to select a contact item corresponding to the second device 2000 among the contact items using the touch screen, The status information of the device 2000 can be obtained. The status information of the second device 2000 may be stored in the first device 1000 or may be received by the control unit 1002 under the control of the communication unit 1001. [

Upon receipt of the status information of the second device 2000, the control unit 1002 can determine the communication method for the second device 2000. The control unit 1002 can determine one of the available communication methods indicated by the status information of the second device 2000 as a communication method. For example, when the status information of the second device 2000 indicates a callable status, the control unit 1002 can determine the call as a communication mode. When the state information of the second device 2000 indicates a call disabled state, the control unit 1002 can determine a text message or a messenger application as a communication method.

4 (a) to 4 (c) are views showing examples of a method of displaying different user interfaces according to a communication method. The mobile device 400 according to one embodiment may correspond to the first device 1000. According to FIG. 4 (a), the mobile device 400 can conduct a call with the second device 2000. When the first device 1000 performs a call with the second device 2000, a user interface associated with the call may be displayed on the screen of the first device 1000. [ The call user interface may include information associated with the contact item corresponding to the second device 2000. [ For example, the call user interface may include at least one of a phone number of the second device 2000, a picture or name of the user of the second device 2000 stored in the contact item corresponding to the second device 2000 . The call user interface may include one or more buttons needed to perform the call. For example, the call user interface may include one or more of a recording button, a keypad mode on / off button, a call termination button, an ambient noise blocking button, a speakerphone button, and a Bluetooth button.

According to FIG. 4 (b), the mobile device 400 can communicate with the second device 2000 using a text message. When performing communication using the text message with the second device 2000, the text message user interface 420 can be displayed. The text message user interface 420 may include a portion for inputting text and a portion for displaying a history of sending and receiving a message. The text message user interface 420 may be displayed on all or part of the screen of the mobile device 400. The mobile device 400 can perform communication with the second device 2000 and simultaneously communicate with the second device 2000 or the second device 2000 using a text message. When a call and a text message are used at the same time, the text message user interface 420 can be displayed superimposed on the call user interface.

4 (c), the mobile device 400 may display the virtual keyboard 430 to perform communication using a text message. The virtual keyboard 430 may be displayed when the mobile device 400 receives a touch input for the portion of the text message user interface 420 where the text is entered.

5 is an illustration of an example of how a mobile device displays a contact list according to one embodiment. The mobile device 500 may correspond to the first device 1000. A contact list can contain at least one contact item. In this case, information about the corresponding user of the second device 2000 and the corresponding second device 2000 may be stored in each contact item. For example, the displayed contact item may include at least one of a photo display area 520, a telephone number display area 540, and a status information display area 560 of the user of the corresponding second device 2000 . The status information may include information about the availability of at least one communication method for the corresponding second device 2000. The status information of the second device 2000 may be updated when a contact item corresponding to the second device 2000 is selected. The mobile device 500 can acquire the state information of each second device 2000 corresponding to the contact items on the contact list at predetermined time intervals. The mobile device 500 may update the status information of each second device 2000 corresponding to the contact items displayed on the mobile device 500 in the contact list. The acquired or updated status information may be displayed in the status information display area 560. [ The mobile device 500 may not include the status information display area 560. [ The mobile device 500 can automatically determine the communication method using the status information of the second device 2000 without displaying the status information of the second device 2000. [

6 is a diagram illustrating an example of a method of displaying status information of a second device. The contact item 600 corresponds to each contact item in Fig. 5, and the status information display area 620 can correspond to the status information display area 560 in Fig. The images 621 to 625 shown in Fig. 6 are examples of the status information that can be displayed in the status information display area 620. Fig. Each image may indicate a state of talkable 621, no call 622, text available 623, and text unavailable 624. The image 625 may indicate that the status information of the second device 2000 is unknown. The status information of the second device 2000 may be represented using colors. For example, the second device 2000 may display the status information display area 620 in green to indicate the availability status. The second device 2000 may indicate the call disabled state by displaying the status information display area 620 in red. The contact item 600 may display status information using both methods. The contact item 600 may provide a quick view 640 that can simply identify the state information. For example, when the status information display area 620 indicates the ready state 621, the first device 1000 can display the ready state by displaying the quick view 640 in green.

7 is a diagram illustrating an example of a method of displaying a list of communication methods selected according to state information of a second device. The contact item 700 may correspond to each contact item in Fig. The status information display area 720 may correspond to the status information display area 560 of FIG. The icons 740 to 748 may constitute a list of communication methods selected according to the status information of the second device 2000. The list of selected communication methods may include icons corresponding to one or more communication methods. For example, icon 740 may correspond to a call, icon 742 may correspond to a text message, icon 744 may correspond to a picture transfer, icon 746 may correspond to a voice message, and icon 748 may correspond to a constant transmission. The first device 1000 may select one or more communication methods using the result of analyzing the state information of the second device 2000, arrange and display the communication methods. There may be a priority among the selected communication methods. In this case, the highest priority communication method may correspond to the icon 740. For example, if the state information of the second device 2000 indicates a talkable state and a text unavailable state, the highest priority communication scheme may be a call, and the icon 740 may correspond to a call have. The communication method corresponding to the icon far from the icon 740 may be a communication method having a lower priority. For example, if the status information of the second device 2000 indicates a talkable state and a text unavailable state, the text message may be a low priority communication method. Thus, the text message may correspond to an icon that is far from the icon 740, or may not be displayed due to unselected communication method. The user of the first device 1000 can select one of the displayed communication methods and the first device 1000 can communicate with the second device 2000 using the selected communication method.

8 (a) to 8 (b) are diagrams showing another example of a method of displaying a list of communication methods selected according to status information of a second device. The method of arranging the circle icons shown in FIG. 7 in a semicircular form with the status information display area 720 as a center and displaying them is only one embodiment, and the present invention is not limited thereto. 8 (a), the icons may be arranged three-dimensionally at the top of the status information display area 720. [ The communication method with the highest priority may correspond to the largest icon in the center. A lower priority communication scheme may correspond to an icon that is far from the center. When the first device 1000 receives an operation input for swiping left and right from a list of communication methods arranged in a cubic order from a user of the first device 1000, the icon located at the center can be moved in the direction of the swipe operation , The size can also be reduced. The adjacent icon in the opposite direction of the swipe operation can move to the center and the size can also be increased. Referring to FIG. 8 (b), a list of the selected communication methods can be arranged and displayed on the right side of the status information display area 720. The list of selected communication schemes may be represented using one or more of an icon and text. The user of the first device 1000 can select one of the displayed communication methods and the first device 1000 can communicate with the second device 2000 using the selected communication method. Figures 7, 8 (a) - 8 (b) are only one embodiment of a method by which the first device 1000 displays a list of selected communication schemes, and are not now limited.

Figures 9 (a) through 9 (e) illustrate a method of selecting a communication scheme according to an embodiment. 9A, an exemplary list of the communication methods that the first device 1000 can use to communicate with the second device 2000 includes a call 740, a character, a location transfer 741, But is not limited to, at least one of a message 742, an email transmission 743, a picture transfer 744, a video call 745, a voice message 746 and a schedule transfer 748. [ 7, the position transmission 741, the video call 745, and the e-mail transmission 743 can be performed using the display method according to the embodiment shown in Fig. 7, Since the communication method has a low priority, the communication method can not be selected because the communication method is not selected.

Referring to FIG. 9 (b), in the embodiment shown in FIG. 9 (a), three communication methods with lower priority may not be displayed. The number of communication methods displayed on the first device 1000 is not limited and a list of communication methods including one or more communication methods can be displayed on the first device 1000. [ In one embodiment, the first device 1000 may receive an input of a user of the first device 1000 that selects a communication scheme that the first device 1000 does not select. In this case, the first device 1000 can perform communication using the communication method selected by the user of the first device 1000. When the user of the first device 1000 performs the touch and drag input in the direction of the arrow 900 shown in Fig. 9B, the positions of the icons can be moved along the direction of the arrow. FIG. 9 (c) is a diagram illustrating the result of the icons moving in a clockwise direction in response to a user's input of the first device 1000. FIG. In the embodiment of FIG. 9 (c), an icon corresponding to the e-mail transmission 743, which is the communication method not selected by the first device 1000, is displayed. Since the first device 1000 selects the communication method based on the status information of the second device 2000, the status information of the second device 2000 at present is a status in which the user of the second device 2000 can not view the mail . For example, the user of the second device 2000 may be in a state where it is difficult for the outside of the company to check in-house e-mail. The user of the first device 1000 may select an icon corresponding to the email transmission 743 to send the email. In this case, the first device 1000 may provide a notification that the user of the second device 2000 may be in a state where it is difficult to confirm the e-mail. 9D is a diagram showing an example of a notification window that can be displayed on the first device 1000 when the user of the second device 2000 can not confirm e-mail. The notification window 920 provides a notification that the user of the second device 2000 is in a state in which it is difficult to confirm the e-mail. In this case, the user of the first device 1000 selects the " Yes " button 922 to cause the first device 1000 to send an e-mail, or the & 1000) to cancel the email transmission. When the user of the first device 1000 selects the "Yes" button 922, the notification window 940 of FIG. 9 (e) may be displayed on the first device 1000. Since the user of the second device 2000 wants to send an e-mail even though the e-mail can not be confirmed, it may be an important or urgent matter. Accordingly, the first device 1000 may send a push notification informing that the first device 1000 is an urgent matter, in addition to transmitting the e-mail to the second device 2000 according to the selection of the user of the first device 1000. [

In another embodiment, if the status information of the second device 2000 indicates a call disabled status, the first device 1000 may not have selected a call in the communication mode. When the user of the first device 1000 selects a call, the first device 1000 determines that the user of the second device 2000 can not receive a call using the notification window 920 of FIG. 9 (d) You can provide reminders. If the user of the first device 1000 selects a call, the first device 1000 may display the notification window 940 of FIG. 9E to select whether to transmit the push notification. When the user of the first device 1000 selects the push notification, the first device 1000 can send a push notification to the second device 2000 while making a call request.

10 is a flow diagram illustrating a method by which a first device communicates with a second device. In step 1010, the first device 1000 can display the contact list including at least one contact item using the display unit 1003. [ The contact list may be predefined by the user of the first device 1000. The contact list may be automatically generated by using at least one of information stored in the first device 1000 by the first device 1000 and information received through the communication unit 1001. [

At step 1020, a user of the first device 1000 may select a contact item corresponding to the second device 2000 from the displayed contact list. The display unit 1003 can also be used as an input device when the display panel 191 and the touch panel 165 have a layer structure and are configured as a touch screen. When the first device 1000 receives a user input from the user of the first device 1000 to select a contact item corresponding to the second device 2000 from the contact item using the touch screen, To the control unit 1002. [0100]

In step 1030, the control unit 1002 may obtain the status information of the second device 2000 corresponding to the selected contact item in step 1020. [ The status information of the second device 2000 may be stored in the first device 1000 or may be received by the control unit 1002 under the control of the communication unit 1001. [ The status information of the second device 2000 may be updated when a contact item corresponding to the second device 2000 is selected. The first device 1000 can acquire the state information of each second device 2000 corresponding to the contact items on the contact list at a predetermined time interval. The first device 1000 may update the status information of each second device 2000 corresponding to the contact items displayed in the first device 1000 in the contact list.

In step 1040, the display unit 1003 may display a list of one or more communication methods selected based on the status information of the second device 2000 and the status information of the second device 2000. The first device 1000 may select one or more communication methods using the result of analyzing the state information of the second device 2000, arrange and display the communication methods. The selected communication methods may be prioritized, and the communication method with the highest priority may be emphasized. For example, if the state information of the second device 2000 indicates a talkable state and a text unavailable state, the communication system with the highest priority may be a call. In this case, the first device 1000 can place the call button at the front of the list and display it. The communication method disposed at a position remote from the call button on the list displayed on the first device 1000 may be a communication method with a lower priority. For example, if the status information of the second device 2000 indicates a talkable state and a text unavailable state, the text message may be a low priority communication method. Accordingly, the text message may be displayed at a position distant from the call button, or may not be displayed because the first device 1000 is not selected.

In step 1050, the control unit 1002 can determine a communication method for performing communication with the second device 1000. [ The control unit 1002 can determine one of the available communication methods indicated by the status information of the second device 2000 as a communication method. For example, when the status information of the second device 2000 indicates a callable status, the call is determined to be a communication mode. In this case, when the status information of the second device 2000 indicates the call disabled status, it is possible to determine the text message or the messenger application as the communication mode. In another embodiment, the first device 1000 selects a communication method from the list of communication methods displayed by the first device 1000 in step 1040 using the touch screen from a user of the first device 1000 Upon receiving the input, the touch screen may transmit information about the received input to the control unit 1002. The control unit 1002 can determine the communication method selected by the user of the first device 1000 as a communication method used to perform communication with the second device 2000. [ For example, if the user of the first device 1000 briefly touches the contact item corresponding to the second device 2000 in the contact list displayed on the first device 1000, So that communication can be performed. When the user of the first device 1000 touches and holds the contact item corresponding to the second device 2000 in the contact list displayed on the first device 1000, the list of the communication methods selected by the first device 1000 Lt; / RTI > In this case, communication with the second device 2000 can be performed using the communication method selected by the user of the first device 1000.

In operation 1060, the first device 1000 may perform communication with the second device 2000 using the communication method determined in operation 1050. In the step of performing communication with the second device 2000, the display unit 1003 can display different user interfaces according to the communication method.

11 is a diagram showing an example of a system in which a first device and a second device acquire status information using a server. 11, each device transmits information of a plurality of mobile device users 1100-1 through 1100-N including a user of the first device 1000 and a user of the second device 2000 to the server 3000, Lt; / RTI > The server 3000 can store the status information of each user 1100-1 to 1100-N using the result of processing the received information. The information transmitted by the devices of the users 1100-1 through 1100-N to the server includes environment data for generating status information or status information of each user 1100-1 through 1100-N, To < RTI ID = 0.0 > 1100-N. ≪ / RTI > For example, in the process of the first device 1000 acquiring the status information of the second device 2000, the status information of the second device 2000 is generated in the second device 2000, A method in which the data is generated in the second device 2000 and stored in the server 3000 and then transmitted to the first device 1000 in the server 3000 and a method in which the data is generated and stored in the server 3000 May be obtained using at least one of the methods transmitted to the first device 1000. When the state information of the second device 2000 is stored in the server 3000, the first device 1000 may acquire state information of each second device 2000 corresponding to the contact items on the contact list And can perform communication with the server 3000. When the status information of the second device 2000 is stored in each second device 2000, the first device 1000 may determine the status information of each second device 2000 corresponding to the contact items on the contact list, Lt; RTI ID = 0.0 > 2000 < / RTI >

12 is a block diagram briefly showing a structure of a server according to an embodiment. Referring to FIG. 12, the server 3000 may include a communication unit 3001 and a control unit 3002. The communication unit 3001 can receive at least one of the data stored in the second device 2000 and the environment data around the second device 2000. The data stored in the second device 2000 may include at least one of a schedule information of a user of the second device 2000, a contact list, a contact record, a home address, and a work address. The environmental data around the second device 2000 may include GPS data, a Wi-Fi wireless access device identifier, a list of scanned Wi-Fi wireless access devices, acceleration data detected by an acceleration sensor, voice data sensed by a sound sensor, The time data, and the date data received from the mobile communication terminal. According to another embodiment, the server 3000 may receive status information of the second device 2000. The communication unit 3001 can transmit the status information of the second device 2000 to the first device 1000. [ The communication unit 3001 can transmit the status information of the second device 2000 to the first device 1000 upon receiving the request of the first device 1000. [

The control unit 3002 can determine the status information of the second device 2000 based on at least one of the status information and the environment data of the second device 2000 received by the communication unit 3001. [ A specific method by which the control unit 3002 determines the state information of the second device 2000 is described below with reference to FIG. 13 to FIG.

13 is a diagram showing an example of a table used for determining the state information of the second device. Determining the status information of the second device 2000 may be, but is not limited to, the server 3000 or the second device 2000. 13, the sender 1301 may correspond to a user of the first device 1000, and the receiver 1302 may correspond to a user of the second device 2000. [ 13, the table used to determine the status information of the recipient 1302 includes a 'when' field 1300, a 'where' field 1320, a 'what' field 1340, Field 1360 and a " why " Information on the date and time may be recorded in the 'when' field 1300 and may include information on a city / day / month / year, for example, and may include information on 'weekdays', 'weekends' ',' Holiday ',' holiday 'may be recorded but not limited thereto. In the 'Where' field 1320, information about a place can be recorded, for example, 'home', 'work', 'school', 'hotel', 'movie theater', 'street', ' Hospital "may be recorded, but is not limited thereto. In the 'what' field 1340, information about the behavior can be recorded, and for example, 'during work', 'during a meeting', 'during study', 'during driving', 'during sleep' But is not limited thereto. Information about the relationship may be recorded in the 'with whom' field 1360, for example, 'family', 'friend', 'colleague', 'professor' may be recorded, but is not limited thereto. In the 'why' field 1380, information on a schedule and an event may be recorded.

14 is a diagram illustrating an example of a method for obtaining data used to determine status information of a second device. The date and time information used in the 'when' field 1300 may be obtained using the date and time information stored in the second device 2000 or the server 3000. Information about the location used in the 'where' field 1320 may be obtained using the GPS device of the second device 2000. However, since the reliability of the GPS device is low in the room, the position in the room can be obtained through the beacon or Wi-Fi wireless access point information. Also, if personal information such as a user's home or work address of the second device 2000 is pre-entered, the meaning of the place corresponding to the address as well as the address in the 'where' field can be clearly recorded. Information about the behavior used in the 'what' field 1340 may be obtained using at least one of a plurality of sensors and GPS included in the second device 2000. For example, the second device 2000 may acquire noise around the second device 2000 using a microphone or a sound sensor. If there is little noise, the second device 2000 or the server 3000 can know that the user of the second device 2000 is in a quiet place. If 'work' is recorded in the 'Where' field, the second device 2000 or the server 3000 can know that the user of the second device 2000 is in the office. If a noise similar to a person's voice is continuously detected and a 'job' is recorded in the 'where' field, the second device 2000 or server 3000 determines that the user of the second device 2000 is in a meeting Able to know. Also, if the GPS data indicates that the second device 2000 is on the highway and is moving at a speed of 100 km per hour, the second device 2000 or the server 3000 can know that the user of the second device 2000 is in operation. The information about the personal information and the relationship used in the 'with whom' field 1360 may include information about the behavior of the user of the second device 2000, such as the personal routine, Information can be obtained by using at least one of the information. For example, if the user of the second device 2000 is at work, the second device 2000 or the server 3000 may determine that the user of the second device 2000 may be present with co-workers. If the user of the second device 2000 is in a meeting, the second device 2000 or the server 3000 may determine that the user of the second device 2000 is with a co-worker or a superior. If the schedule of the user of the second device 2000 is confirmed, if there is an appointment with the professor, the second device 2000 or the server 3000 determines that the user of the second device 2000 can be present with the professor . The schedule and event information used in the 'why' field 1380 can be obtained using the schedule information stored in the second device 2000.

15 is a flowchart showing an example of a system for obtaining a user's status information using a server. In Fig. 15, the user device 1500 may correspond to a first device or a second device. At step 1501, the user device 1500 may send the location data of the user device 1500 to the server 1550. [ The location data may be obtained using the GPS device of the user device 1500. However, since the reliability of the GPS device is low in the room, the user device 1500 can acquire the position in the room through information of a beacon or a Wi-Fi wireless access device (AP). The server 1550 may correspond to the server 3000 of FIG. 12, but is not limited thereto, and may be any computing device equipped with a processor.

In step 1551, the server 1550 acquires and analyzes information on the date and time, and analyzes the location data of the user device 1500 received in step 1501 to obtain the state information of the user device 1500 Information for analysis can be obtained. For example, the server 1550 may record the results of analyzing date, time, and location data in the 'When' field 1300 and the 'Where' field 1320 of FIG.

At step 1502, the user device 1500 may send the personal information, the relationship, and the voice data stored in the user device 1500 to the server 1550. The user's personal information and relationship data of the user device 1500 can be obtained using at least one of the user's behavior routine, schedule and personal information such as social distance with a particular person, which can be obtained through the contact record. The relationship data of user device 1500 may include at least one of contact list, contact record, and schedule data stored in user device 1500. [ The voice data may be obtained using a microphone or a sound sensor of the user device 1500.

At step 1552, the server 1550 may analyze the data received at step 1502. [ For example, the server 1550 may analyze the schedule information and the contact record of the user to the 'what' field 1340, the 'who and' field 1360 and the 'why' field 1380 in FIG. 13 Can be recorded. The server 1550 may record the result of analyzing the voice data of the user device 1500 in the 'what' field 1340 of FIG.

In step 1553, the user's behavior can be inferred using the data collected and analyzed in steps 1551 to 1552. For example, if 'weekday' and '3:00 pm on March 23, 2015' are recorded in the 'when' field 1300, 'work' is recorded in the 'where' field 1320, If the result of analyzing the voice data indicates that the noise corresponding to the voice of the person is constantly heard or if the personal information is analyzed in step 1552 and the conference is scheduled from 2:00 pm to 4:00 pm on March 23, 2015, 1550 can know that the user is currently in a meeting in the meeting room of the workplace, and can record the 'what' field 1340 in FIG.

In step 1554, the status information of the user can be obtained by using the table of FIG. 13 completed in steps 1551 to 1553. For example, if the user is in a meeting, the status information of the user may be in a 'no call' state and a 'text available' state. Also, if the user is in operation, the status information of the user may be a 'call enabled' state and a 'text unavailable' state. The determined user's status information may be stored in the server 1550.

In step 1555, the user device 1500 can transmit status information of the user acquired in step 1554. In one embodiment, the user device 1500 may receive and store status information of the user device 1500 obtained at the server. In another embodiment, the user device 1500 may obtain status information on its own.

16 (a) and 16 (b) are flowcharts illustrating an example of a method by which a sender and a receiver exchange status information using a server. The server 1620 may correspond to the server 3000 of FIG. 12, but is not limited thereto, and may be any computing device equipped with a processor. The originator device 1600 may correspond to the first device 1000 of Figure 1 and the recipient device 1640 may correspond to the second device 2000 of Figure 1. [ In steps 1601 and 1641, the originator device 1600 and the recipient device 1640 may transmit data for each device. Steps 1601 and 1641 may correspond to steps 1501 and 1502 in Fig. The server 1620 may determine the status of the originator device 1600 and the recipient device 1640 based on the analysis of the received data. In one embodiment, the originator device 1600 and the recipient device 1640 may themselves obtain status information of each device. In this case, the data transmitted in steps 1601 and 1641 may be status information of each device.

At step 1602, the originator device 1600 may execute an application 1660 for communication. The application 1660 may include a contact list and a link to a communication application corresponding to each communication method. An example of the execution of the application 1660 has been described with reference to Figs. The application 1660 may be installed in the originator device 1600 and the recipient device 1640 and may be installed only in the originator device 1600. [ If the application 1660 is installed only on the sender device 1600, the recipient device 1700 can communicate with the sender using the existing communications application corresponding to the communication method selected by the sender. In step 1621, the originator device 1600 can obtain status information of the device corresponding to each contact item on the contact list of the originator device 1600 from the server 1620. [

 Referring to FIG. 16 (a), in step 1603, the caller may select a contact item corresponding to the recipient device 1640 on the contact list displayed on the calling device 1600. In one embodiment, the status information of the recipient device 1640 corresponding to the selected contact item in step 1603 may be updated.

In step 1604, the originator device 1600 can perform communication using the optimal communication method based on the result of analyzing the state information of the recipient device 1640 corresponding to the contact item selected in step 1603. For example, if the status information of the recipient device 1640 indicates a talkable state, the originator device 1600 determines the call as a communication mode. If the status information of the recipient device 1640 indicates a call disabled status, the originator device 1600 may determine a text message or messenger application as a communication mode.

Referring to FIG. 16 (b), the caller device 1600 may receive a user input in step 1605, in which the caller touches the contact item displayed on the caller device 1600 for more than a predetermined amount of time. In this case, the originator device 1600 may display a list of communication methods for the recipient device 1640 in step 1606. [ The list of communication methods for the recipient device 1640 may be a list of communication methods selected according to the status information of the recipient device 1640. [ The list of selected communication methods may include icons corresponding to one or more communication methods. The originator device 1600 may select, arrange, and display one or more communication methods based on the results of analyzing the status information of the recipient device 1640. The selected communication methods may be prioritized, and the communication method with the highest priority may be emphasized and displayed. For example, if the state information of the recipient device 1640 indicates a talkable state and a text unavailable state, the highest priority communication scheme may be a call, and the caller device 1600 may send a call button to another communication Can be displayed larger than the button of the method. In one embodiment, only a predetermined number of high priority communication schemes can be selected and displayed. For example, only three high priority communication schemes can be arranged and displayed in a list. The remaining communication schemes may not be displayed.

At step 1607, the communication mode for the recipient device 1640 may be selected. In one embodiment, the originator device 1640 may receive the caller's input selecting the communication method not selected and displayed in step 1606. [ In this case, the originator device 1600 may display a warning message and a push notification window. This can correspond to the contents described in Figs. 9 (d) and 9 (e). Therefore, the contents described above with respect to the method of selecting the communication method can be applied to the method according to the embodiment of FIG. 16 (b), even if omitted below. In step 1608, communication can be performed using the communication method selected in step 1607.

17 is a block diagram briefly illustrating a structure of a second device according to an embodiment. The second device 2000 may include a communication unit 2001, a control unit 2002, and an output unit 2003. The communication unit 2001 may correspond to the mobile communication module 120 and the sub communication module 130 of FIG. The control unit may correspond to the control unit 110 of FIG. The output unit 2003 may correspond to the display unit 190, the speaker 163, and the vibration motor 164 of Fig.

The communication unit 2001 communicates with the first device 1000 and can transmit or receive information. The communication method used to perform the communication may include at least one of a call, a voice message, a video call, a text message, a messenger application, and an SNS application. The communication unit 2001 may perform communication using one of a 2G network, a 3G network, an LTE network, a Wifi, a Bluetooth, an infrared ray, and ZigBee, but is not limited thereto. When the second device 2000 performs communication with the first device 1000, the communication methods used in the respective devices may be different from each other. For example, the user of the second device 2000 performs communication using the voice through the microphone 162 and the speaker 163, and the user of the first device 1000 uses the text on the touch screen Communication can be performed. The communication unit 2001 may also transmit data necessary for determining the status information of the second device 2000 to the server 3000 and may receive the status information of the second device 2000 determined by the server 3000 . The status information of the second device 2000 may include information on the availability of at least one communication method for the second device 2000. [ For example, the status information of the second device 2000 may indicate that the user of the second device 2000 is callable, unavailable, text available, or text unavailable, but is not limited thereto. In one embodiment, the second device 2000 may itself obtain status information of the second device 2000 without using the server 3000. [

The control unit 2002 can control the communication unit 2001 and the output unit 2003. [ The control unit 2002 analyzes and processes information received by the communication unit 2001 and controls the output unit 2003 to output the received information. The control unit 2002 can receive and analyze the information input by the user using the microphone 162, the touch panel 165 or the camera module 140 and can process and control the communication unit 2001 have. The control unit 2002 can determine the second communication method of the second device 2000 based on the status information of the second device 2000. [ When the state information of the second device 2000 indicates that the first communication method of the first device 1000 can be used to perform communication with the first device 1000, Communication can be performed using the communication method as the second communication method. When the state information of the second device 2000 indicates that the first communication method of the first device 1000 can not be used, the second device 2000 selects one of the available communication methods indicated by the state information of the second device 2000 2 communication method. When the first communication method and the second communication method are different, the controller 2002 can convert the information received from the first device 1000 into a format usable in the second communication method. In one embodiment, the second communication scheme may be a communication scheme selected by the user of the second device 2000. [

The output unit 2003 can output information transmitted by the first device 1000 received by the communication unit 2001 and processed by the control unit 2002 in a format usable in the second communication method. For example, when the second communication method is a call, the output unit 2003 can output a voice. When the second communication method is a text message, the output unit 2003 can output text.

18 (a) and 18 (b) are diagrams illustrating an example of a method by which a second device determines a second communication mode and outputs the received information. The second device 1800 may correspond to the second device 2000 of FIG. 18 (a), an example of a call user interface of a second device 1800 is shown. The call user interface may include information stored in a contact item corresponding to the first device 1000. [ For example, the call user interface may include at least one of a phone number of the first device 1000, a picture or name of the user of the first device 1000 stored in the contact item corresponding to the first device 1000 . The call user interface may display one or more buttons needed to perform the call. For example, the call user interface may include one or more of a recording button, a keypad mode on / off button, a call termination button, an ambient noise blocking button, a speakerphone button, and a Bluetooth button. In addition, according to one embodiment, the communication user interface of the second device 1800 may include a communication mode selection icon 1802-1806. Icon 1802 may indicate a call, icon 1804 a video call, and icon 1806 a Text to Speech (TTS). For example, when the second device 1800 receives a call request, the second device 1800 determines the second communication method based on the status information of the second device 1800, Can be used to output the received information. However, in one embodiment, the user of the second device 1800 can directly select the communication method. For example, when the first device 1000 requests a video call, the user of the second device 1800 may select a call icon 1802 to perform a call if the user does not want to make a video call. When the user of the second device 1800 wants to make a video call again, the user can select a video call icon 1804 to perform a video call. In addition, when the user of the second device 1800 does not wish to make a call, the character-to-speech conversion icon 1806 can be selected. The character-to-speech conversion technique is not different from a conventionally known technology and is not described here. When the character-to-speech conversion is selected, the second device 1800 can output the result of converting the voice information received from the first device 1000 into text, which is a format usable in a text message. Also, the second device 1800 may transmit the result of converting the text message input by the user of the second device 1800 to voice to the first device 1000. The Speech to Text (STT) technique is the same as known in the art and is not described here.

Referring to Figure 18 (b), an example of a text message user interface of the second device 1800 is shown. The text message user interface may include information stored in the contact item corresponding to the first device 1000. [ For example, the text message user interface may include at least one of a phone number of the first device 1000, a picture or name of the user of the first device 1000 stored in the contact item corresponding to the first device 1000 have. The text message user interface may display one or more buttons required to perform the call. For example, a keyboard button for entering text may be displayed in the text message user interface. In addition, in accordance with one embodiment, the text message user interface of the second device 1800 may include communication mode selection icons 1802-1806. Icon 1802 may indicate a call, icon 1804 a video call, and icon 1806 a voice-to-character conversation. For example, when the second device 1800 receives a text message, the second device 1800 determines the second communication method based on the status information of the second device 1800, Can be used to output the received information. However, in one embodiment, the user of the second device 1800 can directly select the communication method. For example, when the second device 1800 receives a text message and the user of the second device 1800 selects the text-to-speech conversion icon 1806, the second device 1800 transmits the received text message Can be output. Also, the second device 1800 can transmit the result of converting the voice inputted by the user of the second device 1800 to text to the first device 1000.

19 is a flowchart illustrating a method by which a second device communicates with a first device. In step 1910, the second device 2000 can perform communication with the first device 1000. [ For example, the communication unit 2001 of the second device 2000 can receive voice information from the first device 1000. [

In step 1920, the second device 2000 may collect ambient data. For example, the second device 2000 may collect GPS information, Wi-Fi information, voice data, and the like. In step 1930, the second device 2000 can obtain the status information of the second device 2000. The status information of the second device 2000 may be determined by the server 3000 or may be determined by the second device 2000. [

In step 1940, the second device 2000 may determine a second communication method for communicating with the first device 1000. [ When the state information of the second device 2000 indicates that the first communication method of the first device 1000 can be used, communication can be performed using the same communication method as the first communication method as the second communication method have. When the state information of the second device 2000 indicates that the first communication method of the first device 1000 can not be used, the second device 2000 selects one of the available communication methods indicated by the state information of the second device 2000 2 communication method.

In step 1950, the second device 2000 can output information received from the first device 1000 using the communication method determined in step 1940. When the first communication method and the second communication method are different, the controller 2002 can convert the information received from the first device 1000 into a format usable in the second communication method. The output unit 2003 can output the information received from the first device 1000 converted by the control unit 2002. [

20 is a diagram showing an example of a system in which a first device and a second device communicate with each other. 20, the voice mode 1000-1 and the text mode 1000-2 of the first device 1000 and the voice mode 2000-1 and the text mode 2000-2 of the second device 2000, ) Are shown. According to one embodiment, the first device 1000 and the second device 2000 are capable of switching between the voice mode and the text mode during communication.

In step 2020, since both the first device 1000 and the second device 2000 are in the voice mode, the call can be performed. In the case of step 2040, since the first device 1000 is in the voice mode 1000-1 and the second device 2000 is in the text mode 2000-1, (2000) can use a messenger application. The second device 2000 can output the result of converting the voice information received from the first device 1000 into text and output the result of converting the text information inputted by the user of the second device 2000 into voice To the first device (1000). In this process, the text information can be translated using a translator. For example, the second device 2000 can perform translation using a translator before outputting the result of converting the voice information received from the first device 1000 into text. The second device 2000 can perform translation using the translator before converting the text information input to the second device 2000 to speech. Accordingly, even though the user of the first device 1000 and the user of the second device 2000 use different languages, the first device 1000 and the second device 2000 can provide interpretation and translation services have.

Since the second device 2000 is in the voice mode 2000-1 and the first device 1000 is in the text mode 1000-1 in the case of step 2060, (1000) can use a messenger application. The first device 1000 can output the result of converting the voice information received from the second device 2000 into text and convert the result of converting the text information input by the user of the first device 1000 into voice To the second device (2000). In this process, the first device 1000 and the second device 2000 can provide an interpretation and translation service using the result of converting the text information using the translator.

In the case of step 2080, since the first device 1000 and the second device 2000 are in the text mode, the first device 1000 and the second device 2000 can perform communication using the messenger application. In this process, the first device 1000 and the second device 2000 can provide the translation service using the result of converting the text information using the translator.

21 is a diagram showing an example of a method of displaying a communication history. The mobile device 2100 may correspond to the first device 1000 and the second device 2000. The mobile device 2100 may store the result of performing the communication. For example, the result of performing a call may be a talk time or a recorded voice, and the result of performing a communication with a text messenger may be the content of the received text, but is not limited thereto. In addition, the result using the SNS application may be information about the notification provided by each application. The results of performing the communication may be stored in the mobile device 2100, arranged in chronological order, and displayed. For example, the received information may be arranged on the left side, such as the communication history item 2102, and the outgoing information may be arranged on the right side, such as the communication history item 2104, but is not limited thereto.

One embodiment may also be implemented in the form of a recording medium including instructions executable by a computer, such as program modules, being executed by a computer. Computer readable media can be any available media that can be accessed by a computer, and can include both volatile and nonvolatile media such as RAM, removable and non-removable media. In addition, the computer-readable medium can include both computer storage media and communication media. Computer storage media may include both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism, and may include any information delivery media. For example, computer storage media may be embodied in ROM, RAM, flash memory, CD, DVD, magnetic disk, magnetic tape, or the like. According to one embodiment, there is provided a method of performing communication with a first device (1000), the method comprising: displaying a contact list including at least one contact item; Selecting a contact item corresponding to the second device 2000, obtaining state information of the second device 2000, determining a communication method for the second device 2000 based on the state information, And a method for performing communication with the second device 2000 using the communication method can be recorded.

1000: first device
2000: Second device
3000: Server

Claims (33)

A first device for performing communication with a second device,
A display unit for displaying a contact list including at least one contact item;
A controller for selecting a contact item corresponding to the second device from among the at least one contact item, obtaining state information of the second device, and determining a communication method for the second device based on the state information; And
A communication unit for performing communication with the second device using the communication method; . The method according to claim 1,
In the communication method,
A call, a voice message, a text message, an instant messaging application, and an SNS application. The method according to claim 1,
Wherein the status information includes information about availability of at least one communication scheme for the second device. The method according to claim 1,
Wherein,
And determines one of the available communication methods indicated by the status information as a communication method. The method according to claim 1,
The display unit includes:
And displays at least one of a list of communication methods selected according to status information of the selected second device and status information of the selected second device. The method according to claim 1,
The display unit includes:
And displays a communication history which is a history of communicating with the second device. A second device for communicating with a first device,
A communication unit for performing communication using the first communication method from the first device;
A control unit for obtaining status information about the second device and determining a second communication mode of the second device for outputting the received information using the communication based on the status information; And
An output unit outputting the received information using the determined second communication scheme; . 8. The method of claim 7,
The second communication method includes:
Each being performed using at least one of a currency, a voice message, a text message, an instant messaging application, and an SNS application. 8. The method of claim 7,
Wherein the status information comprises information about availability of at least one communication scheme for the second device. 8. The method of claim 7,
A collecting unit for collecting environmental data around the second device; Further comprising:
Wherein,
The status information of the second device based on at least one of the environment data and the data stored in the second device. 8. The method of claim 7,
Wherein,
Determines the second communication method in the same communication method as the first communication method when the status information indicates that the first communication method can be used,
And determines the second communication mode to one of the available communication modes indicated by the status information when the status information indicates that the first communication mode can not be used. 12. The method of claim 11,
When the first communication method and the second communication method are different,
Wherein,
Converting information received from the first device into a format usable in the second communication method,
The output unit includes:
The first device receiving the information transmitted by the first device, and outputting the converted information. 13. The method of claim 12,
A user input for receiving an input to the second device; Further comprising:
Wherein the control unit changes the second communication method based on the input received through the user input unit. 8. The method of claim 7,
A display unit for displaying a communication history as a history of communicating with the second device; Lt; / RTI > A control unit for determining status information of the second device based on at least one of data stored in the second device and environment data surrounding the second device; And
A communication unit for receiving at least one of data stored in the second device and environment data around the second device, and transmitting the status information to the first device; Lt; / RTI >
Wherein the status information comprises information about availability of at least one communication scheme for the second device. 16. The method of claim 15,
Wherein the data stored in the second device includes at least one of a job of the second device user, a location of a house, a location of a company, a schedule and an anniversary,
The environment data of the second device may include at least one of a GPS position of the second device, Wi-Fi access point information, Wi-Fi signal search result, connected base station position, surrounding brightness, Device. A method for a first device to perform communication with a second device,
Displaying a contact list including at least one contact item;
Selecting a contact item corresponding to the second device from among the at least one contact item;
Obtaining status information of the second device;
Determining a communication method for the second device based on the status information; And
Performing communication with the second device using the communication method; / RTI > 18. The method of claim 17,
In the communication method,
A call, a voice message, a text message, an instant messaging application, and an SNS application. 18. The method of claim 17,
Wherein the status information includes information about availability of at least one communication scheme for the second device. 18. The method of claim 17,
The method of claim 1,
Determining, by a communication scheme, one of the available communication schemes indicated by the status information. 18. The method of claim 17,
Displaying status information of the selected second device; And displaying a list of communication methods selected according to status information of the selected second device; ≪ / RTI > 18. The method of claim 17,
Displaying a communication history as a history of performing the communication; ≪ / RTI > A method for a second device to communicate with a first device,
Performing communication using the first communication method from the first device;
Obtaining status information for the second device;
Determining a second communication mode of the second device for outputting the received information using the communication based on the status information; And
Outputting the received information using the determined second communication method; / RTI > 24. The method of claim 23,
In the communication method,
A call, a voice message, a text message, an instant messaging application, and an SNS application. 24. The method of claim 23,
Wherein the status information includes information about availability of at least one communication scheme for the second device. 24. The method of claim 23,
The step of obtaining the status information includes:
Collecting environmental data around the second device; And
Determining status information of the second device based on at least one of the environment data and the data stored in the second device; ≪ / RTI > 24. The method of claim 23,
Wherein the determining of the second communication scheme comprises:
Determining the second communication method in the same communication method as the first communication method when the status information indicates that the first communication method can be used; And
Determining the second communication mode as one of the available communication modes indicated by the status information when the status information indicates that the first communication mode can not be used; / RTI > 28. The method of claim 27,
When the first communication method and the second communication method are different,
Receiving information transmitted by the first device;
Converting the received information into a format usable in the second communication scheme; And
Outputting the converted information; / RTI > 29. The method of claim 28,
Receiving an input to the second device;
Changing the second communication method based on the received input; ≪ / RTI > 24. The method of claim 23,
Displaying a communication history as a history of performing the communication; ≪ / RTI > Receiving at least one of data stored in a second device and environment data around the second device;
Determining status information of the second device based on at least one of the received data; And
Transmitting the status information to a first device; Lt; / RTI >
Wherein the status information includes information about availability of at least one communication scheme for the second device. 32. The method of claim 31,
Wherein the data stored in the second device includes at least one of a job of the second device user, a location of a house, a location of a company, a schedule and an anniversary,
The environment data of the second device may include at least one of a GPS position of the second device, Wi-Fi access point information, Wi-Fi signal search result, connected base station position, surrounding brightness, / RTI > 32. A computer-readable recording medium storing a program for causing a computer to execute the method according to any one of claims 17 to 32.

Images