KR20160072753A - Electronic apparatus and method for controlling a group action - Google Patents

Abstract

Disclosed are an electronic apparatus and a method for controlling a group action thereof, and more specifically, to an electronic apparatus and a method for controlling a group action thereof which generate a group action corresponding to a state change of an external device and control the external device. According to some embodiments of the present invention, the electronic apparatus generates a group action corresponding to state information of an external device received via a server, and changes a state of the external device using the generated action group.

Description

TECHNICAL FIELD [0001] The present invention relates to a group action control method for an electronic apparatus and an electronic apparatus,

The present invention relates to an electronic device and a method for controlling group actions of an electronic device, and in particular, to a method and apparatus for generating and modifying a group action corresponding to a state change of an external device, And a group action control method for the electronic device.

Recently, various services and functions provided by electronic devices are gradually expanded and multitasking is also possible. Various applications corresponding to the Internet of things (IoT) environment have been developed in electronic devices.

The IoT environment refers to an environment in which things are connected to the Internet using various communication technologies. Objects around the user can communicate with each other through the Internet, and communication between the user and objects can also be possible.

In an IoT environment, it is common that control (e.g., start of operation, termination of operation, power on / off, etc.) between an electronic device carried by a user and an object is performed using an application installed in the electronic device . In an IoT environment composed of an electronic device and a plurality of objects, it takes a lot of time to register the electronic device and each object using the application installed in the electronic device. Also, complicated and complicated steps may be required to control each of the registered objects in the electronic device.

A group action control method of an electronic device according to an exemplary embodiment of the present invention includes executing an application in an external device and an electronic device connectable with a server, requesting external device status information corresponding to the external device to the server, Displaying the external device status information received from the server on the application screen and generating a group action corresponding to the displayed external device status information, And status information of the manually changed external device.

According to another aspect of the present invention, there is provided a group action control method for an electronic device, the method comprising: executing an application in an electronic device connectable to an external device and a server; when the status of the electronic device changes, Displaying a recommendation group action list corresponding to a status change of the electronic device received from the server on the application screen, receiving a selection of one recommendation group action in the recommendation group action list, And executing the selected recommendation group action, wherein the recommendation group action corresponds to a state of an external apparatus that is changed by a user's input.

The electronic device according to an exemplary embodiment of the present invention includes a touch screen, a communication unit connected to the server, and a control unit for controlling the touch screen and the communication unit. The control unit controls the external device connected to the server Requesting external device status information from the external device, and generating a group action using the external device status information received from the server and displayed on the touch screen, and the external device status information is stored in the external And includes status information of the device.

An electronic device capable of generating a group action corresponding to a state change of an external device and changing the state of the external device with the generated group action, and a group action control method of the electronic device.

An electronic device capable of generating a group action corresponding to external device status information received through a server and changing the state of the external device through the generated group action, and a group action control method of the electronic device.

There is provided an electronic device capable of receiving a recommendation group action corresponding to the status of an external device from a server analyzing status information of the external device and changing the status of the external device through the received recommendation group action and a group action control method of the electronic device .

An electronic device capable of receiving a group action corresponding to a state change of the electronic device and changing the state of the external device, and a group action control method of the electronic device.

According to various embodiments of the present invention, an electronic device capable of generating a group action corresponding to a state change of an external device and changing the state of the external device with the generated group action is provided by the group action control method of the electronic device .

1 is a schematic diagram showing the connection of an electronic device, an external device and a server according to an embodiment of the present invention.
2A is a schematic block diagram illustrating an electronic device according to an embodiment of the present invention.
2B is a schematic block diagram illustrating an external apparatus according to an embodiment of the present invention.
2C is a schematic block diagram illustrating a server according to an embodiment of the present invention.
3 is a schematic flowchart showing a method of controlling group actions of an electronic device, an external device, a server, and an electronic device according to an embodiment of the present invention.
4 is a schematic flowchart showing a method of controlling group actions of an electronic device, an external device, a server, and an electronic device according to another embodiment of the present invention.
5 is a schematic flowchart showing a method of controlling group actions of an electronic device, an external device, a server, and an electronic device according to another embodiment of the present invention.
6A to 6F are views showing examples of screens of an electronic device according to an embodiment of the present invention.
7A to 7E are views showing examples of screens of an electronic device according to another embodiment of the present invention.
8A to 8G are views showing examples of screens of an electronic device according to another embodiment of the present invention.

Hereinafter, exemplary embodiments according to the present invention will be described in detail with reference to the contents described in the accompanying drawings. In addition, a method of manufacturing and using the present invention will be described in detail with reference to the description of the attached drawings. Like reference numbers or designations in the various drawings indicate components or components that perform substantially the same function.

Terms including ordinals such as " first, " " second, " and the like can be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. The term " and / or " includes any combination of a plurality of related listed items or any of a plurality of related listed items.

An application refers to an operating system (OS) for a computer or software that is executed on a mobile OS and used by a user. For example, the application may be a word processor, a spreadsheet, a contacts application, a calendar application, a memo application, an alarm application, a social network system (SNS) application, a chatting application, A map application, a music player, or a video player. An application according to an embodiment of the present invention may mean software executed in an external device (e.g., a server, etc.) connected wirelessly or in a wired manner with an electronic device or an electronic device. Also, an application according to an embodiment of the present invention may mean software executed in an electronic device corresponding to a received user input.

In an embodiment of the present invention, the state of the external device 200 may mean the context of the external device 200. [ The status information corresponding to the status of the external device 200 may be context information of the external device 200. [ The status change of the external device 200 may have the same meaning as the status information change of the external device 200. [

The content can be displayed in the application being executed. For example, a video file or an audio file played in a video player, an music file played in a music player, a photo file displayed in a photo gallery, a web page file displayed in a web browser, and the like may be included. The content may include a video file, an audio file, a text file, an image file, or a web page displayed or executed in an application. In the embodiment of the present invention, the term " video " The content may also include a video file, an audio file, a text file, an image file, or a web page that is executed in response to a received user input (e.g., a touch, etc.).

The content includes an application screen to be executed and a user interface constituting an application screen. In addition, the content may include one content or a plurality of contents.

A widget is a mini application that is one of the graphical user interfaces (GUIs) that more smoothly supports interaction between a user and an application or an OS. Examples include weather widgets, calculator widgets, and clock widgets.

Herein, a group action may mean a set of actions of one or more external devices, and at least one action included in the group action may include a control instruction for changing the state of the corresponding external device have. When a group action is generated, group action information corresponding to the group action may be generated and stored. The group action information may include information on whether to perform a set operation (for example, state change) of the external devices corresponding to the set state. For example, the group action information includes a group action title, an external device identifier (ID), an external device name, status change information (e.g., On ↔ Off) For a limited period of 5 minutes), and the like, but the present invention is not limited thereto.

The terms used in the present application are used to illustrate the embodiments and are not intended to limit and / or limit the present invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, number, step, operation, element, component, or combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof. Like reference numerals in the drawings denote members performing substantially the same function.

1 is a schematic diagram showing the connection of an electronic device, an external device and a server according to an embodiment of the present invention.

Referring to FIG. 1, the electronic device 100, the server 300, and the external device 200 may be connected to each other wirelessly using respective communication units (see FIG. 2). For example, in an infra-structure mode that is wirelessly interconnected via an ad-hoc mode or an access point (AP). The electronic device 100 and the external device 200 may be connected to the server 300 wirelessly. Also, the electronic device 100 can be directly connected to the external device 200 wirelessly.

The wireless communication may be performed using, for example, Wi-Fi, Bluetooth, Bluetooth low energy, ZigBee, Wi-Fi Direct, UWB, ), Near Field Communication (NFC), and the like, but the present invention is not limited thereto. Also, the display device 100, the tablet device 200, and the external device 300 can be connected to each other via a connector.

The electronic device 100 receives a status corresponding to a status change (e.g., power on / off, channel change, etc.) of the display device 201 that is one of the external devices 200 through the application 600 Change information can be received through the server 300. [ The electronic device 100 also responds to the status change (e.g., power on / off, channel change, etc.) of the display device 201 that is one of the external devices 200 through the application 600 The status change information may be received directly from the display device 201. [

The electronic device 100 can change the state of the display device 201 that is one of the external devices 200 (for example, power on) through the application 600 (see FIG. 6C) and the server 300. Further, the electronic device 100 may directly change the state of the display device 201, which is one of the external devices 200, through the application 600 (see FIG. 6C) (for example, power on).

2A is a schematic block diagram illustrating an electronic device according to an embodiment of the present invention.

2, the electronic device 100 may be connected to the external device 200 in a wired or wireless manner using the mobile communication unit 120, the sub communication unit 130, and the connector 165. [ The electronic device 100 includes a cellular phone (not shown), a smartphone (not shown), an MP3 player, a video player, a tablet PC, a wearable device wearable on the body, . The display device 201 may be an analog TV, a digital TV, a 3D TV, a smart TV, an LED TV, an OLED TV, a plasma TV, a monitor, a curved TV having a screen with a fixed curvature, A bended TV having a screen with a fixed curvature, and / or a curvature-variable TV capable of changing the curvature of the current screen by a received user input, but the present invention is not limited thereto Will be readily apparent to those of ordinary skill in the art.

The electronic device 100 may be an electronic device having a touch screen and capable of transmitting data (or content) to the outside via the communication unit 120 or 130 or receiving it from the outside. The electronic device 100 may be an electronic device having an input pen and a touch screen and capable of transmitting data (or content) to the outside through the communication unit 120 or 130 or receiving it from the outside. The electronic device 100 may be an electronic device capable of transmitting data to the external device and receiving data from the external device or receiving data from the external device using an interaction (e.g., a touch or a touch gesture) input from the touch screen 190 . In addition, the electronic device 100 may transmit data (or content) to the outside via the communication unit 120 or 130 with a display unit (for example, there is no touch panel and only a display panel, not shown) May refer to a receivable device. The electronic device 100 may have one or more touch screens. In addition, the electronic device 100 may have a plurality of screens divided into one touch screen.

The electronic device 100 includes a control unit 110, a mobile communication unit 120, a sub communication unit 130, a multimedia unit 140, a camera 150, a GPS 155, an input / output unit 160, 170, a storage unit 175, and a power supply unit 180. The electronic device 100 includes a touch screen 190 and a touch screen controller 195.

The control unit 110 includes a processor 111, a ROM 112 storing a control program for controlling the electronic device 100, and a ROM 112 for storing a signal or data input from the outside of the electronic device 100, (RAM) 113, which is used as a storage area for various operations performed in the apparatus 100.

The control unit 110 controls the overall operation of the electronic device 100 and the signal flow between the internal components 120 to 195 of the electronic device 100 and performs the function of processing the data. The control unit 110 controls the power supply to the internal components 120 to 195 using the power supply unit 180. In addition, when the user's input or set conditions are satisfied, the controller 110 can execute an OS (Operating System) or an application stored in the sensor of the sensor unit 170 and the storage unit 175.

The processor 111 may include a graphics processing unit (GPU) (not shown) for graphics processing. The processor 111 may be implemented as a system on chip (SoC) including a core (not shown) and a GPU (not shown). The processor 111 may include single core, dual core, triple core, quad core, and cores thereof. In addition, the processor 111, the ROM 112, and the RAM 113 may be interconnected by a bus.

The control unit 110 includes a mobile communication unit 120, a sub communication unit 130, a multimedia unit 140, a camera 150, a GPS 155, an input / output unit 160, a sensor unit 170, 175, a power supply 180, a touch screen 190, and a touch screen controller 195.

The control unit 110 according to an embodiment of the present invention executes an application in an electronic device connectable to an external device and a server, requests external device status information corresponding to the external device through the server, Displays the external device status information on the application screen, and generates a group action corresponding to the displayed external device status information.

The control unit 110 may control the external device status information to include the identifier, name, operation information, spatial information, environment information, available resource information, operation history information, or failure information of the external apparatus.

When the status of the electronic device is changed, the controller 110 may control the server to request status information of the external device corresponding to the status change of the electronic device.

When the status of the electronic device is changed, the controller 110 may control the server to transmit status change information corresponding to the status change of the electronic device.

The control unit 110 may control the change of the position of the electronic device to be detected in the electronic device or through the connection of the electronic device and the external device.

If the server is not connected to the server, the control unit 110 may control the external apparatus to request status information of the external apparatus.

When the external device status information is displayed on the application screen, the controller 110 may control the icons corresponding to the external devices displayed on the screen to be displayed in a priority order.

The control unit 110 may control to generate a group action different from the group action in response to the user's selection of the selection box included in the displayed external apparatus status information.

The control unit 110 may control the generated group action to include group action information including an identifier corresponding to the external apparatus.

When storing the generated group action, the controller 110 may control the stored group action to include group action information including a group action title.

In case of storing the generated group action, the controller 110 may control to provide at least one of visual, auditory, and tactile feedback in response to the storage of the group action.

The control unit 110 according to another embodiment of the present invention executes an application in an electronic device connectable to an external device and a server and requests status information of the external device to the server when the status of the electronic device changes Displays a recommendation group action list corresponding to the status change of the electronic device received from the server on the application screen and receives the selection of one recommendation group action from the recommendation group action list to execute the selected recommendation group action .

The control unit 110 may control to transmit a control packet corresponding to the execution of the recommendation group action to the server.

In the embodiment of the present invention, the term " control unit " includes a processor 111, a ROM 112 and a RAM 113. [

The mobile communication unit 120 may be connected to an external device through a mobile communication network using one or more antennas under the control of the controller. The mobile communication unit 120 is connected to the mobile communication unit 120 through a voice communication, a video call, a text message (SMS) communication with a cellular phone (not shown) having a connectable telephone number, a smart phone (not shown), a tablet PC, , A multimedia message (MMS), and a wireless signal for data communication.

The sub communication unit 130 may communicate with at least one of the wireless LAN 131 and the local communication unit 132 (for example, one of the wireless LAN 131 and the local communication unit 132 or the local communication unit 132 )). ≪ / RTI >

The wireless LAN 131 may be connected to the AP wirelessly at a place where an access point (AP) is installed according to the control of the controller. The wireless LAN 131 supports the IEEE 802.11x standard of the Institute of Electrical and Electronics Engineers (IEEE). The short-range communication unit 132 can perform short-range communication between the electronic device 100 and the external device wirelessly without the AP under the control of the control unit. Local area communication includes bluetooth, bluetooth low energy, infrared data association (IrDA), Wi-Fi, UWB (Ultra Wideband) and NFC .

The electronic device 100 may include at least one of a mobile communication unit 120, a wireless LAN 131, and a local communication unit 132 according to performance. For example, the electronic device 100 may be one of the mobile communication unit 120, the wireless LAN 131, and the short-range communication unit 132, or the mobile communication unit 120, the wireless LAN 131, As shown in FIG. The electronic device 100 can be connected to an external accessory (e.g., a wireless speaker, a wireless headset, etc.) using one of the mobile communication unit 120 and the sub communication unit 130. [

In the embodiment of the present invention, the term " communication unit " includes a mobile communication unit 120 and a sub communication unit 130. [

The multimedia unit 140 may include a broadcast receiving unit 141, an audio reproducing unit 142, or a moving picture reproducing unit 143. The broadcast receiving unit 141 receives a broadcast signal (for example, a TV broadcast signal, a radio broadcast signal or a data broadcast signal) and a broadcast additional information (for example, a broadcast signal) from an external broadcast station through an antenna (not shown) (Electric Program Guide) or an Electric Service Guide (ESG)). In addition, the control unit can reproduce the received broadcast signal and broadcast supplementary information using a touch screen, a video codec (not shown) and an audio codec (not shown).

The audio playback unit 142 may be an audio source (for example, mp3, wma, ogg, or wav) that is stored in the storage unit 175 of the electronic device 100 under control of the control unit, Audio files including audio files) can be played back using an audio codec.

According to an embodiment of the present invention, the audio reproducing unit 142 may generate auditory feedback (e.g., output of an audio source stored in the storage unit) corresponding to generation of a group action or execution of a group action under the control of the controller It can be played through a codec.

According to an embodiment of the present invention, the audio reproducing unit 142 generates audible feedback corresponding to the continuous movement of the touch or touch detected on the touch screen 190 according to the control of the controller (for example, Etc.) can be reproduced through the audio codec.

The moving picture reproducing unit 143 may be a digital moving picture source (for example, a file having the file extension mpeg, mpg, mp4, avi , mov, or mkv) can be played back using a video codec. A multimedia application that can be installed in the electronic device 100 may play an audio source or a video source using an audio codec and / or a video codec. In addition, a multimedia application that can be installed in the electronic device 100 can reproduce a video source using a hardware codec (not shown) and / or a software codec (not shown).

According to the embodiment of the present invention, the motion picture reproducing unit 143 generates visual feedback (for example, output of the motion picture source stored in the storage unit) corresponding to the generation of the group action or the execution of the group action under the control of the control unit It can be played through a codec.

It will be readily understood by those skilled in the art that various types of video codecs and audio codecs capable of reproducing audio / video files having various file extensions are produced and sold.

The multimedia unit 140 may include an audio reproducing unit 142 and a moving picture reproducing unit 143 except for the broadcast receiving unit 141 corresponding to the performance or structure of the electronic device 100. [ The control unit 110 may include an audio reproducing unit 142 or a moving picture reproducing unit 143 of the multimedia unit 140.

In the embodiment of the present invention, the term " audio codec " may include one or more audio codecs. In the embodiment of the present invention, the term " video codec " may include one or more video codecs.

1A) of the front (100a of FIG. 1A) and the second camera 152 of the rear (not shown) of the front (100a in FIG. 1A) One can be included. For example, the camera 150 may include one or both of the first camera 151 and the second camera 152. Also, the first camera 151 or the second camera 152 may include an auxiliary light source (for example, a flash 153) that provides an amount of light required for photographing.

The control unit may include an additional camera (for example, a first camera 151 and a second camera 151) positioned adjacent to the first camera 151 and the first camera 151 on the front side (for example, the distance between the first camera 151 and the first camera 151 is greater than 30 mm and smaller than 80 mm) For example, a third camera (not shown) may be used to capture a three-dimensional still image or a three-dimensional moving image. The control unit is further provided with an additional camera (e.g., a camera) positioned adjacent to the second camera 152 and the second camera 152 on the rear side (for example, the interval between the second camera 152 and the second camera 152 is greater than 30 mm and smaller than 80 mm) For example, a fourth camera (not shown)) to capture a three-dimensional still image or a three-dimensional moving image. Also, the cameras 151 and 152 can perform wide angle, telephoto, and close-up photographing using an additional lens (not shown) that can be detachably attached to a separate adapter (not shown).

GPS 155 periodically receives signals (e.g., orbital information of GPS satellites, time information of satellites, navigation messages, etc.) from a plurality of GPS satellites 156 (see Fig. 5C) on earth orbit. In the outdoor environment, the electronic device 100 calculates the positions of the plurality of GPS satellites 156a to 156d and the electronic device 100 using signals received from the plurality of GPS satellites 155a to 155d, The distance can be calculated using the time difference. The position, time, or moving speed of the electronic device 100 can be calculated through triangulation. Additional GPS satellites may be required for orbital correction or time correction. The portable device 100 can calculate the position, time, or moving speed of the portable device 100 even in a room where signals are received from a plurality of GPS satellites 156 via the GPS 155. [

In the case of indoor, the electronic device 100 can detect the position or moving speed of the electronic device 100 using a wireless AP (not shown). The location of the electronic device 100 in the room can be detected by a cell-ID method using the ID of the wireless AP, an enhanced cell-ID method using the ID of the wireless AP and the received signal strength (RSS) An AoA (Angle of Arrival) method using an angle received at the electronic device 100 of a signal transmitted from the AP may be used.

Also, the electronic device 100 can detect the position or the moving speed of the portable device 100 located in the room by using a wireless beacon (not shown). It will be readily understood by those skilled in the art that the indoor position of the electronic device 100 can be detected through various methods as well as the above method.

The input / output unit 160 includes at least one of a button 161, a microphone 162, a speaker 163, a vibration motor 164, a connector 165, a keypad 166, and an input pen 167 One can be included.

Referring to FIG. 1, the button 161 includes a home button 161a, a menu button 161b, and a return button 161c located at a lower portion of the front face 100a. The button 161 may include a power / lock button 161d of the side 100b and at least one volume button 161e. The button 161 of the electronic device 100 may include only the home button 161a, the power / lock button 161d, and the volume button 161e. The button 161 of the electronic device 100 may be implemented as a touch button on a bezel outside the touch screen 190 as well as a physical button. The buttons 161 of the electronic device 100 may also be displayed on the touch screen 190 in the form of text, images, or icons.

The microphone 162 receives voice or sound from outside according to the control of the control unit and generates an electrical signal. The electric signal generated by the microphone 162 may be converted from an audio codec and stored in the storage unit 175 or output through the speaker 163. [ The microphone 162 may be positioned on the front face 100a, the side face 100b, and the rear face of the electronic device 100, respectively. In addition, one or more microphones 162 may be located only on the side surface 100b of the electronic device 100. [

The speaker 163 may transmit various signals (for example, a radio signal, a broadcast signal, and a broadcast signal) of the mobile communication unit 120, the sub communication unit 130, the multimedia unit 140 or the camera 150 using an audio codec, , An audio source, a moving picture file, a picture photographing, or the like) to the outside of the electronic device 100.

The speaker 163 can output sound corresponding to the function performed by the electronic device 100 (e.g., a touch operation sound corresponding to a telephone number input, or a photo shooting button operation sound). One or more speakers 163 may be located on the front face 100a, the side face 100b and the rear face of the electronic device 100. [ Referring to FIGS. 1 and 2A, a plurality of speakers 163a and 163b may be disposed on a front surface 100a of the electronic device 100. FIG. Speakers 163a and 163b may be disposed on the front surface 100a and the rear surface of the electronic device 100, respectively. One speaker 163a may be placed on the front face 100a of the electronic device 100 and a plurality of speakers 163b and further speakers (not shown) may be located on the rear face thereof. Further, the speaker 163a, 163b may be positioned on the side surface 100b. The electronic device 100 in which an additional speaker (not shown) is located on the side surface 100b can provide the user with a different sound effect from the front side 100a and the electronic device (not shown) where the speaker is located on the rear side .

According to an embodiment of the present invention, the speaker 163 may output auditory feedback in response to the generation of the group action or the execution of the group action under the control of the control unit.

The vibration motor 164 can convert the electrical signal into mechanical vibration under the control of the control unit. The vibration motor 164 may include a linear vibration motor, a bar type vibration motor, a coin type vibration motor, or a piezoelectric element vibration motor. For example, when a voice call request is received from another electronic device (not shown), the vibration motor 164 of the electronic device 100 in the vibration mode may operate under the control of the control unit. The vibration motor 164 may be located on the electronic device 100 in one or more than two. The vibration motor 164 may also cause the entire electronic device 100 to vibrate or only a portion of the electronic device 100 to vibrate.

According to the embodiment of the present invention, the vibration motor 164 can output tactile feedback in response to the generation of the group action or the execution of the group action under the control of the control unit. In addition, the vibration motor 164 can provide various tactile feedbacks (e.g., intensity of vibration and duration of vibration) that are stored or received externally based on control commands of the control unit.

The connector 165 may be used as an interface for connecting the electronic device 100 to an external device (not shown) or a power source (not shown). According to the control of the control unit, the electronic device 100 transmits data stored in the storage unit 175 to an external device (not shown) via a wired cable connected to the connector 165, or transmits data Lt; / RTI > The electronic device 100 may receive power from a power source (not shown) via a wired cable connected to the connector 165 or may charge a battery (not shown). The electronic device 100 may also be connected to an external accessory (e.g., a speaker (not shown), a keyboard dock (not shown), etc.) through the connector 165.

The keypad 166 may receive key input from a user for control of the electronic device 100. The keypad 166 includes a physical keypad (not shown) formed on the front surface 100a of the electronic device 100, a virtual keypad (not shown) displayed on the touch screen 190, (Not shown). The fact that the physical keypad (not shown) formed on the front surface 100a of the electronic device 100 can be excluded depending on the performance or structure of the electronic device 100 can be easily handled by those skilled in the art .

The input pen 167 is connected to the home screen 191 of the touch screen 190 of the electronic device 100 or to a screen (e.g., a memo screen, a note pad screen, a calendar screen, etc.) displayed in a handwriting / You can touch or select the displayed (configurable) object (eg, menu, text, image, video, graphic, icon, and shortcut). The input pen 167 is used to display content displayed on a touch screen 190 of the electronic device 100 or a screen displayed on a handwriting / drawing application (for example, a memo screen, a note screen, a calendar screen, For example, a text file, an image file, an audio file, a video file, or a web page). The input pen 166 may also be used to perform handwriting (for example, a handwriting) on a handwriting application (e.g., a memo screen or the like) displayed on the touch screen 190 of the electronic device 100 or a screen handwriting, or drawing, painting or sketching.

The input pen 167 can touch a touch screen of a capacitive type, a resistive type, or an electromagnetic resonance (EMR), or input a character or the like using a displayed virtual keypad. The input pen 167 may include a haptic pen (not shown) in which a stylus pen or an incorporated vibrating element (e.g., an actuator or a vibration motor) vibrates. The input pen 167 also receives vibration information corresponding to the sensing information detected by a sensor (e.g., an acceleration sensor, not shown) built in the input pen 167 as well as control information received from the electronic device 100 The device can be operated (e.g., vibrated).

When the input pen 167 is drawn out from the insertion port (not shown), the control unit may execute a set handwriting / drawing application to display a screen (not shown) of the handwriting / drawing application on the touch screen 190.

The input pen 167 may include a user's finger (e.g., including a thumb). For example, in an application displayed on a capacitive touch screen or a resistive touch screen, a handwriting or a drawing can be input by the user's finger.

When a handwriting or a drawing is input by a user's finger in an application displayed on a capacitive touch screen or a resistive touch screen, the control unit controls one of the fingers including the thumb to touch the touch screen 190 and the touch screen controller (Not shown).

(E.g., a circular or polygonal cross-section) or structure (e.g., a battery (not shown)) of an input pen (not shown) and input pen 167 of the electronic device 100, It will be readily understood by those skilled in the art that changes may be made depending on the performance or structure of the apparatus 100. [

The sensor unit 170 includes at least one sensor for detecting the state of the electronic device 100. [ For example, the sensor unit 170 includes a proximity sensor 171 for detecting whether or not the user accesses the electronic device 100, an illuminance sensor 172 for detecting the amount of light around the electronic device 100, And a gyro sensor 173 for detecting the direction using the rotational inertia of the apparatus 100. [ The sensor unit 170 includes an acceleration sensor (not shown) for detecting accelerations of three axes (for example, x axis, y axis, and z axis) applied to the electronic device 100, A gravity sensor for detecting the altitude, or an altimeter for measuring the altitude by measuring the atmospheric pressure.

The sensor unit 170 can measure the motion acceleration and the gravitational acceleration of the electronic device 100, respectively. When the electronic device 170 does not move, the sensor unit 170 can measure only gravitational acceleration. For example, if the front of the electronic device 100 is up, the gravitational acceleration is in the positive direction, and if the back side of the electronic device 100 is up, the gravitational acceleration may be in the negative direction . The sensor unit 170 may further include a fingerprint sensor (not shown) for detecting a fingerprint of a user or a heartbeat sensor (not shown) for detecting a heartbeat of a user.

At least one sensor included in the sensor unit 170 detects the state of the electronic device 100, generates an electrical signal corresponding to the detection, and transmits the electrical signal to the control unit. It will be readily understood by those skilled in the art that sensors included in the sensor unit 170 can be added or deleted depending on the performance of the electronic device 100. [

The storage unit 175 includes a mobile communication unit 120, a sub communication unit 130, a multimedia unit 140, a camera 150, a GPS 155, an input / output unit 160, a sensor unit 170, and the touch screen 190. The touch screen 190 may be a touch screen or a touch screen. The storage unit 175 stores a control program for controlling the electronic device 100 or the control unit, a graphical user interface (GUI) associated with an application provided from a manufacturer or downloaded from the outside, images for providing a GUI, , Databases, or related data.

The storage unit 175 according to the embodiment of the present invention may store the device information of the electronic device 100, the device information of the external device 200, or the device information of the server 300.

The storage unit 175 may store the external device status information, the recommended group action, and the recommended group action list received from the server 200.

The storage unit 175 may store the generated group action or another group action generated by changing the group action.

The storage unit 175 may store a control packet corresponding to the group action execution.

The storage unit 175 stores the first touch to the fifth touch, the first touch location to the fifth touch location eleventh touch and the twelfth touch, the eleventh touch location information and the twelfth touch location information, Touch, the twenty-first touch position information, and the twenty-second touch position information.

The storage unit 175 stores user-recognizable visual feedback (e.g., a video source or the like) output on the touch screen 190 in response to the generation of the group action or the execution of the group action, (E. G., A haptic pattern, etc.) output from the vibration motor 164 and recognizable audible feedback (e. G., A sound source, etc.).

The storage unit 175 may store a feedback providing time (for example, 300 msec) of the feedback provided to the user.

The term " storage unit " in the embodiment of the present invention includes a storage unit 175, a control unit ROM 112, a RAM 113 or a memory card (not shown) mounted on the electronic device 100 , micro SD card, memory stick). The storage unit may include a nonvolatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

The power supply unit 180 may supply the components 120 to 175 located inside the electronic device 100 under the control of the control unit. The power supply unit 180 may supply power to the electronic device 100 from an external power source (not shown) through a cable (not shown) connected to the connector 165 under the control of the controller. In addition, the power supply unit 180 can supply power to one or more batteries (not shown) under the control of the control unit. One or more batteries (not shown) may be positioned between the touch screen 190 and the back surface 100c, which are located on the front surface 100a.

The power supply unit 180 may wirelessly charge one or more batteries (not shown) (for example, a magnetic resonance type, an electromagnetic wave type, or a magnetic induction type) under the control of the control unit.

The touch screen 190 includes a touch panel (not shown) for receiving touch input and a display panel (not shown) for screen display. The touch screen 190 can provide a GUI (Graphical User Interface) corresponding to various services (e.g., voice call, video call, data transmission, broadcast reception, photo shooting, have. The touch screen 190 transmits an analog signal corresponding to a single touch or a multi-touch input through the home screen 191 or the GUI to the touch screen controller 195. The touch screen 190 can receive a single touch or a multi-touch input through the user's body (e.g., a finger including a thumb) or the input pen 167. [

A display panel (not shown) has a plurality of pixels and displays the image through the pixels. For example, a display panel (not shown) includes a liquid crystal display (LCD), an organic light emitting diode (LED), and an LED. A display panel (not shown) may display various images and a plurality of objects according to various operating states of the electronic device 100, an application, a service execution, and the like.

In the embodiment of the present invention, the touch is not limited to the contact between the touch screen 190 and the user's body or the input pen 167, and includes non-contact. For example, non-contact may include hovering between the touch screen 190 and the user's body or input pen 167 with a spacing of 50 mm or less. It will be readily understood by those skilled in the art that the noncontact interval that can be detected on the touch screen 190 can be changed according to the performance or structure of the electronic device 100. [

The touch screen 190 may be implemented by, for example, a resistive method, a capacitive method, an infrared method, or an acoustic wave method.

The touch screen 190 may include electromagnetic resonance (EMR). The electromagnetic resonance type touch screen further includes a separate electromagnetic resonance type touch panel (not shown) for receiving an input of an input pen (not shown) having a resonance circuit resonating with an electromagnetic resonance type loop coil .

The touch screen 190 according to the embodiment of the present invention can display visual feedback in response to generation of a group action or execution of a group action under the control of the control unit.

The touch screen controller 195 converts an analog signal corresponding to the single touch or multi-touch received from the touch screen 190 into a digital signal and transmits the digital signal to the control unit. The control unit may calculate the X and Y coordinates corresponding to the touch position on the touch screen 190 using the digital signal received from the touch screen controller 195. [

The control unit can control the touch screen 190 using the digital signal received from the touch screen controller 195. For example, the control unit may display a shortcut icon (e.g., 193a in FIG. 1) displayed on the touch screen 190 in a manner different from other shortcut icons (e.g., 193b to 193h) The application screen can be displayed on the touch screen 190 by executing an application (e.g., telephone) corresponding to the selected shortcut icon (193a in Fig. 1).

The touch screen controller 195 may be implemented with one or more touch screen controllers 195. In response to the performance or structure of the electronic device 100, the touch screen controller 195 may be included in the control unit.

The touch screen controller 195 converts an analog signal corresponding to the touch received from the touch screen of the electromagnetic resonance type to a digital signal separately from the analog signal corresponding to the single touch or multi touch received from the touch screen 190, Lt; / RTI > The control unit may calculate the X and Y coordinates corresponding to the touch position on the touch screen of the electromagnetic resonance type using the digital signal received from the touch screen controller 195. [ In addition, in the case of an electromagnetic resonance type touch screen, an electromagnetic resonance type touch screen controller (not shown) can be used.

Although the electronic device 100 shown in Figs. 1 and 2A is shown only for one touch screen, it may have a plurality of touch screens. Each touch screen is located in a respective housing (not shown), and each housing (not shown) can be interconnected by a hinge (not shown). Also, a plurality of flexible touch screens may be located in one housing (not shown). The plurality of flexible touch screens may include a single display panel and a plurality of touch panels. The plurality of flexible touch screens may include one touch panel corresponding to the plurality of display panels. The plurality of flexible touch screens may include a plurality of touch panels corresponding to the plurality of display panels.

It should be appreciated that the components of the electronic device 100 shown in FIG. 2 may be readily added to and / or removed from at least one of ordinary skill in the art to enable at least one component to be added or removed in response to the capabilities of the electronic device 100 It will be understood.

2B is a schematic block diagram illustrating an external apparatus according to an embodiment of the present invention.

Referring to FIG. 2B, the external device 200 may be connected to the electronic device 100, another external device, or a server by using a communication unit 230 in a wired or wireless manner.

The external device 200 may include a display device 201, a robot cleaner 202, a washing machine 203, an air conditioner 204, a lamp 205, or an auto door lock 206. In addition, the external device 200 may include a curtain (not shown), a sensor (not shown) including a temperature sensor, a window (not shown), a refrigerator (not shown), a fan garage, a home theater (not shown), a wireless sound bar (not shown), a wireless headset (not shown), a wireless earphone (not shown), a wireless headphone a headphone (not shown), a monitor (not shown), a wearable device (not shown), a bookmark (not shown), a mobile phone (not shown) or a smartphone (not shown). The external device 200 refers to a device that can be connected to the electronic device 100 using the communication unit 230. The external device 200 detects the internal or external state of the external device 200 using the function unit 260 or the sensor unit 270 under the control of the control unit 210 and transmits the detected state to the communication unit 230 To the electronic device 100 via the Internet. The external device 200 may be meant to include a set of respective external devices 201-206.

The external device 200 may perform a unique function of the external device 200. [ For example, the inherent functions of the external device 200 include a broadcast reception function of a television, an automatic cleaning function of a robot cleaner, a washing function of a washing machine, a cooling function of an air conditioner, a lighting function of a lamp, A refrigeration / refrigeration function, or an audio output of an audio device, and the like. It will be readily understood by those skilled in the art that the inherent functions of the external device 200 are not limited to the functions described above.

The external device 200 may include a control unit 210, a communication unit 230, a function unit 260, a sensor unit 270, a storage unit 275, a power supply unit 280 and a display unit 290 .

The controller 210 stores a signal or data input from the outside of the ROM 212 and the external device 200 storing a control program for controlling the processor 211 and the external device 200, And RAM (RAM) 213 used as a storage area for various operations performed in the apparatus 200.

The control unit 210 controls the overall operation of the external device 200 and the signal flow between the internal components 220 to 290 of the external device 200 and processes the data. The control unit 210 controls the power supply to the internal components 220 to 290 using the power supply unit 280. In addition, when the user's input or set conditions are satisfied, the control unit 210 can execute an OS (Operation System) or an application stored in the sensor of the sensor unit 270, the storage unit 275, and the like.

The processor 211 may include a graphics processing unit (GPU) (not shown) for graphics processing. The processor 211 may be implemented as a system on chip (SoC) including a core (not shown) and a GPU (not shown). The processor 211 may include single core, dual core, triple core, quad core, and cores thereof. In addition, the processor 211, the ROM 212, and the RAM 213 may be interconnected by a bus.

The control unit 210 may control the communication unit 230, the functional unit 260, the sensor unit 270, the storage unit 275, the power supply unit 280, and the display buffer 290.

The control unit 210 according to the embodiment of the present invention can control the state and state change of the external device 200 through the sensor unit 270 and a separate sensor (not shown).

The control unit 210 can control the server 200 to transmit the external device status information corresponding to the detected status change through the server unit information stored in the communication unit 230 and the storage unit 275. [

The control unit 210 can control the server 300 to receive a control packet corresponding to the group action execution through the communication unit 230. [

The control unit 210 may control the storage unit 275 to store the server device information, the external device status information, or the control packet corresponding to the group action execution.

The term " control unit 210 of the external device " in the embodiment of the present invention includes a processor 211, a ROM 212, and a RAM 213. [

In the embodiment of the present invention, the control unit 210 of the external device 200 may mean a control unit of each of the external devices 201 to 206. [

The external device 200 may include a mobile communication unit (not shown).

A mobile communication unit (not shown) of the external device 200 is connected to a mobile phone (not shown) having a connectable telephone number, a smart phone (not shown), a tablet PC, a tablet device or other electronic device And can transmit / receive wireless signals for voice calls, video calls, SMS messages, multimedia messages (MMS), and data communications.

The communication unit 230 may include at least one of a wireless LAN 231 and a short range communication unit 232. For example, it may include only one of the wireless LAN 231 and the local communication unit 232, or may include both the wireless LAN 231 and the local communication unit 232.

The wireless LAN 231 may be connected to the AP wirelessly at a place where an access point (AP) is installed according to the control of the controller. The wireless LAN 231 supports the wireless LAN standard (IEEE802.11x) of the Institute of Electrical and Electronics Engineers (IEEE). The short-range communication unit 232 can perform short-range communication between the electronic device 100 and the external device wirelessly without the AP under the control of the controller. Local area communication includes bluetooth, bluetooth low energy, infrared data association (IrDA), Wi-Fi, UWB (Ultra Wideband) and NFC .

The communication unit 230 may transmit environment information or state information detected (or stored) by the function unit 260 to the server 300 under the control of the control unit 210. [ The communication unit 230 periodically (for example, one second (sec), can change the environment information or status information) detected by the function unit 260 under the control of the control unit 210 to the server 300 ). In addition, the communication unit 230 can receive a transmission request of the environment information or the status information detected (or stored) from one of the server 300 and the electronic device 100. [

The external device 200 can be connected to another external device (for example, a wireless speaker, a wireless headset, etc.) using the communication unit 230.

The multimedia unit 240 may include a broadcast receiver 241, an audio player 242, or a moving picture player 243. The broadcast receiving unit 241 receives a broadcast signal (for example, a TV broadcast signal, a radio broadcast signal, or a data broadcast signal) transmitted from an external broadcast station through an antenna (not shown) under the control of the controller 210, (E. G., An Electric Program Guide (EPS) or an Electric Service Guide (ESG)). In addition, the control unit can reproduce the received broadcast signal and broadcast supplementary information using a touch screen, a video codec (not shown) and an audio codec (not shown).

The audio playback unit 242 may be an audio source (for example, a file extension of mp3, wma, ogg, or wav) stored in the storage unit 275 of the external device 200 under control of the control unit, Audio files including audio files) can be played back using an audio codec.

The audio reproducing unit 242 controls the moving of the external device 300 and the audible feedback corresponding to the output of the content to the external device 300 according to the control of the controller 210 according to the embodiment of the present invention The output of the audio source stored in the audio codec, etc.) can be reproduced through the audio codec.

The moving picture reproducing unit 243 may be a digital moving picture source which is stored in the storage unit 275 of the external device 200 or received from outside according to the control of the control unit (for example, file extension mpeg, mpg, mp4, avi , mov, or mkv) can be played back using a video codec. A multimedia application that can be installed in the external device 200 can reproduce an audio source or a moving picture file using an audio codec and / or a video codec. In addition, a multimedia application that can be installed in the external device 200 can reproduce a moving image file using a hardware codec (not shown) and / or a software codec (not shown).

The moving picture reproducing unit 243 may control the movement of the external device 300 and the visual feedback corresponding to the content output to the external device 300 under the control of the controller 210. For example, The output of the video source stored in the video codec).

It will be readily understood by those skilled in the art that various types of video codecs and audio codecs are produced and sold.

The multimedia unit 240 may include an audio playback unit 242 and a moving image playback unit 243 except for the broadcast receiver 241 corresponding to the performance or structure of the external device 200. [ The audio reproducing unit 242 or the moving picture reproducing unit 243 of the multimedia unit 240 may be included in the control unit 210. [

In the embodiment of the present invention, the term " audio codec " may include one or more audio codecs. In the embodiment of the present invention, the term " video codec " may include one or more video codecs.

The external device 200 may include at least one of a front camera (not shown) and a rear camera (not shown) that photographs a still image or a moving image under the control of the controller 210 . For example, the external device 200 may include one or both of a first camera (not shown) and a second camera (not shown).

The external device 200 may include a GPS (not shown). The GPS (not shown) periodically receives information (e.g., accurate position information and time information of the GPS satellites receivable in the external device 200) from a plurality of GPS satellites (not shown) on the earth orbit do.

The function unit 260 may perform functions different from those of the external device 200 and other devices. The functions include TV receiving function, automatic cleaning function of robot cleaner, washing function of washing machine, cooling function of air conditioner, illumination function of lamp, lock function of automatic locking device, refrigerator / freezing function of refrigerator, , And the like.

When the external device 200 is the display device 201, the function unit 260 is included in the broadcast signal received through the display panel (not shown) and the tuner (not shown) under the control of the control unit 210 Video can be displayed on the screen. In addition, the function unit 260 may output the audio included in the received broadcast signal through a speaker (not shown) under the control of the control unit 210.

When the external device 200 is the robot cleaner 202, the function unit 260 can suck dust on the floor through a motor (not shown) and a filter (not shown) under the control of the controller 210 have. In addition, the function unit 260 may include a wheel (not shown) for autonomous driving while avoiding peripheral obstacles.

When the external device 200 is the washing machine 203, the function unit 260 controls the washing machine 200 to transfer the laundry stored in the washing tub through the lid, the washing tub (not shown) and the motor (not shown) You can wash it. Further, the function unit 260 may include a vibration reduction member (for example, a balancer) that attenuates the vibration of the washing tub which is vibrated by rotation.

When the external device 200 is the air conditioner 204, the function unit 260 controls the compressor 210 (not shown) and the condenser 210 constituting the refrigerating cycle under the control of the controller 210 (Not shown), an expansion valve (not shown), and an evaporator (not shown) may be used to cool the ambient temperature. In addition, the function unit 260 may include a refrigerant (not shown) and a tube (not shown) through which the refrigerant moves. The same can be applied to the case where the external device is a refrigerator.

If the external device 200 is a light bulb 205, the function unit 260 may change the brightness of the bulb on / off or the bulb mounted on the socket under the control of the controller 210.

When the external device 200 is the automatic locking device 206, the function unit 260 may selectively lock or unlock the door under the control of the control unit 210. In addition, the function unit 260 may output a warning sound through a speaker (not shown) in an abnormal situation under the control of the control unit 210. [

If the external device 200 is an audio device (not shown), the function unit 260 may output the audio stream received through the communication unit 230 under the control of the control unit 210. In addition, the function unit 260 can output audio according to the control of the control unit 210. [

When the external device 200 is a sensor (not shown), the function unit 260 can perform a unique function of the sensor. (E.g., temperature, slope, moving speed, etc.) or status information (e.g., power on, standby, operation, and the like) detected by the function unit 260 may be stored in the storage unit 275. In addition, a sensor (not shown) may transmit environment information or status information to the electronic device 100 through the communication unit 230 under the control of the control unit 260.

For example, in the case of the illuminance sensor, the function unit 260 can detect the ambient illuminance. In the case of a temperature sensor, the function unit 260 can detect the temperature. In the case of the humidity sensor, the function unit 260 can detect the ambient humidity. In the case of the acceleration sensor, the function unit 260 can detect accelerations of three axes (for example, x axis, y axis, and z axis). In the case of a gyro sensor, the direction can be detected by using rotational inertia. It will be readily understood by those skilled in the art that the function unit 260 can be implemented by various sensors as well as the above-described sensors.

The sensor unit 270 can detect the state of the inside or the outside of the external device 200 under the control of the control unit 210. The sensor unit 270 may detect a state change inside or outside the external device 200 under the control of the control unit 210. [ When the external device 200 is not a sensor, the external device 200 may include both the functional unit 260 and the sensor unit 270. Also, when the external device 200 is a sensor, the sensor unit 270 of the external device 200 may be replaced by the function unit 260.

The storage unit 275 stores signals or data input / output corresponding to the operations of the communication unit 230, the functional unit 260, the sensor unit 270, and the display unit 290 under the control of the control unit 210 Can be stored. The storage unit 275 stores a control program for controlling the external device 200 or the control unit, a graphical user interface (GUI) related to an application provided by the manufacturer or downloaded from the outside, images for providing a GUI, , Databases, or related data.

The storage unit 275 stores data related to the operation of the function unit 260 or environment information (e.g., temperature, acceleration, illuminance, etc.) detected by the sensor unit 270 or status Information (e.g., power on, operation, etc.).

The storage unit 275 may store server device information, external device status information, or control packets corresponding to group action execution.

The power supply unit 280 may supply the components 230 to 290 located in the external device 200 under the control of the control unit. The power supply unit 280 can supply power to the external device 200 from an external power source (not shown) via a cable (not shown) connected to a connector (not shown) under the control of the controller have. Also, the power supply unit 280 can supply power to one or more batteries (not shown) under the control of the control unit.

The power supply unit 280 may wirelessly charge one or more batteries (not shown) (for example, a magnetic resonance type, an electromagnetic wave type, or a magnetic induction type) under the control of the control unit.

The display unit 290 displays a GUI (Graphical User Interface) corresponding to various services (e.g., voice call, video call, data transmission, broadcast reception, Graphical User Interface). A display panel (not shown) has a plurality of pixels and displays the image through the pixels. For example, a display panel (not shown) includes a liquid crystal display (LCD), an organic light emitting diode (LED), and an LED. The display panel (not shown) may display various images and a plurality of objects according to various operation states of the external device 200, an application, a service execution, and the like.

The display unit 290 may include a touch screen (not shown) including a display panel (not shown) and a touch panel (not shown). The touch screen 290 may be implemented by, for example, a resistive method, a capacitive method, an infrared method, or an acoustic wave method.

The display unit 290 may output the visual feedback corresponding to the execution of the group action under the control of the control unit 210 according to the embodiment of the present invention.

1, 2A and 2B, the electronic device 100 and the external device 200 can be realized by a plurality of electronic devices (for example, tablet devices 1 and 2) of the same type. And will be readily understood by those skilled in the art.

It should be noted that the components of the external device 200 shown in FIG. 2B can be easily added to or removed from at least one of ordinary skill in the art by adding or removing at least one component corresponding to the performance of the external device 200 It will be understood.

2C is a schematic block diagram illustrating a server according to an embodiment of the present invention.

Referring to FIG. 2C, the server 300 is wirelessly connected to at least one of the electronic device 100 and the external device 200 through the communication unit 330. The server 300 may request status information from the external device 200. [ The server 300 can receive status information from the external device 200. [ The server 300 may receive a request corresponding to the transmission of the status information from the electronic device 100. [ The server 300 may send state information to the electronic device 100. In an embodiment of the present invention, the server 300 may refer to a computing device capable of storing received status information and sending / receiving status information to the electronic device 100 and the external device 200. The server 300 may include a gateway or a home server. The refrigerator or the display device may serve as a gateway.

The server 300 may include a control unit 310, a communication unit 330, a storage unit 375, a power supply unit 380, and a display unit 370.

The control unit 310 includes a processor 311. The control unit 310 may include a ROM 312 storing a control program for controlling the processor 311 and the server 300. The control unit 310 stores signals or data input from the outside of the processor 311, the ROM 312 and the server 300, or is used as a storage area corresponding to various jobs performed in the server 300 RAM (RAM) 313.

The control unit 310 controls the power supplied from the power supply unit 390 to the internal components 330 to 390.

The control unit 310 may control the communication unit 330, the storage unit 375, the power supply unit 380, and the display unit 370.

The control unit 310 can receive the external device status information from the external device 200 through the communication unit 330. The control unit 210 may transmit the received external device status information to the electronic device 100 through the communication unit 330. [

The control unit 310 may generate a group action, a recommendation group action, and a recommendation group action list using the external device status information received through the communication unit 330, and may transmit the list to the electronic device 100.

The control unit 310 analyzes the external device status information received through the communication unit 330 using management software and transmits a recommendation group action or a recommended group action list to the electronic device 100 through the communication unit 330 .

The control unit 310 can receive a control packet corresponding to the group action execution from the electronic device 100 through the communication unit 330. [

The control unit 310 may transmit the control packet received through the communication unit 330 to the external device 200.

The control unit 310 can receive status information of the changed external device in response to the control packet transmitted through the communication unit 330. [

The communication unit 330 can wirelessly connect the electronic device 100 and the external device 200 under the control of the control unit 310. [ The communication unit 330 may include at least one of a wireless local area network (LAN) 331 and a local area communication unit 332. For example, only one of the wireless LAN 331 and the local communication unit 332, or both the wireless LAN 331 and the local communication unit 332.

The wireless LAN 331 may be connected to the AP wirelessly at a place where an access point (AP) is installed according to the control of the controller. The wireless LAN 331 supports the IEEE 802.11x standard of the Institute of Electrical and Electronics Engineers (IEEE). The short-range communication unit 332 can perform short-range communication with the electronic device 100 and the external device 200 wirelessly without an AP according to the control of the controller.

The short range communication unit 332 may further include other short range communication (for example, near field communication (NFC), not shown) and bluetooth low energy (not shown) as well as the Bluetooth 331.

The communication unit 330 may receive environment information or status information from the external device 200 under the control of the control unit 310. [ The communication unit 330 may receive a request corresponding to transmission of environment information or status information from the electronic device 100 under the control of the control unit 310. [ The communication unit 330 may transmit environment information or status information to the electronic device 100 under the control of the control unit 310.

The server 300 may include a speaker (not shown) for outputting audio.

The storage unit 375 may store various data and control programs for driving and controlling the server 300 under the control of the control unit 310. [ The storage unit 375 may store input / output signals or data corresponding to driving of the communication unit 330, the power supply unit 380, and the display unit 390.

The storage unit 375 may store an external device state corresponding to the external device 200 and an electronic device state corresponding to the electronic device 100. [ The storage unit 375 may store the external device status information received from the external device 200 and the electronic device status information received from the electronic device 100. [ The storage unit 375 may store a control packet corresponding to the execution of the group action that can change the state of the external device 200. [

The storage unit 375 may store the electronic device 100, the external device 200, and management software (not shown) that manages the respective status information. The storage unit 375 may store the changed status information of the received external device in response to the control packet transmitted to the external device 200. [

The storage unit 375 may include a nonvolatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

The power supply unit 380 supplies power from the external power source to the components 330 to 380 inside the server 300 under the control of the controller 310. [

The display unit 390 displays an image or text corresponding to the information received from the electronic device 100 or the external device 200 (for example, environment information, status information, control commands, etc.) under the control of the control unit 310. [ Can be displayed. The display unit 390 may include a liquid crystal display (LCD) method, an organic light emitting diode (OLED) method, a plasma display panel (PDP) method, or a vacuum fluorescent display (VFD) method. It will be readily understood by those skilled in the art that the displayable video and / or text information may be different depending on the display mode.

It is to be appreciated that the components (e.g., 330 to 280) shown in the server 300 of Figures 1 and 2C can be added or deleted in response to the capabilities of the server 300, And will be readily understood by those of ordinary skill in the art.

3 is a schematic flowchart showing a method of controlling group actions of an electronic device, an external device, a server, and an electronic device according to an embodiment of the present invention.

6A to 6F are views showing examples of screens of an electronic device according to an embodiment of the present invention.

In step S310 of FIG. 3, the state of the external apparatus is changed.

Referring to FIG. 6A, various external devices 200 that can be connected to the server 300 can be located around the user. For example, the external device 200 may include a display device 201, a robot cleaner 202, a washing machine 203, an air conditioner 204, a lamp 205, an auto door lock 206 may be included. It will be easily understood by those skilled in the art that there are various external apparatuses capable of transmitting status information or changed status information at the time of transmission through the communication unit without being limited to the above external apparatuses.

In the embodiment of the present invention, the control unit 210 of the external device 200 may mean a control unit of each of the external devices 201 to 206. [

In an embodiment of the present invention, the state of the external device 200 may mean the context of the external device 200. [ The status information corresponding to the status of the external device 200 may be context information of the external device 200. [ The status change of the external device 200 may have the same meaning as the status information change of the external device 200. [

The status information of the external device 200 includes an identifier (ID), an external device name, operation information of the external device (for example, busy, standby, power on / off ), Data transfer, etc.), spatial information of the external device (e.g., location, direction of movement, speed of movement, etc.), environmental information of the external device (e.g., temperature, humidity, (E.g., a remaining battery level, a display resolution, a processor clock speed, a memory resource, etc.), history information corresponding to an operation of an external device (e.g., operation time, Or failure information of the external device (for example, a failure area, a failure occurrence time, an A / S action, an A / S date, etc.).

The context information of the electronic device 100 may include an identifier, an electronic device name, operation information of the electronic device (e.g., busy, standby, power on / off, (E.g., temperature, humidity, illuminance, noise, etc.) of the external device, information on the environment of the external device (e.g., temperature, humidity, (E. G., Operating time, standby time, etc.) corresponding to the operation of the electronic device, or information on available resources of the electronic device (e. G., Battery level, display resolution, processor clock speed, memory resource, (For example, a failure site, a failure occurrence time, an A / S action, an A / S date, etc.). The status information of the electronic device 100 may also include user information corresponding to a user carrying the electronic device 100 (e.g., a user identifier (ID), a password, a user name, Fingerprint, iris, pulse, blood pressure, body temperature, etc.).

The state of the external device 200 located in the user's surroundings (e.g., living room, kitchen, room, office, etc.) may be changed by inputting to the user. The state and state change of the external device 200 can be detected through the sensor unit 270 of the external device 200 or a sensor (not shown) that detects the movement of the mechanical / electronic switch.

The state of the external device 200 located in the vicinity by the predetermined condition (for example, sunset, rain, etc.) can be automatically changed. The external device 200 can change the state of the external device 200 in response to detection of a state change of the user (for example, going out or the like) or a change of state of the electronic device 100. [

In addition, the user can manually change the state of the external device 200 located in the vicinity of the user in response to a change in state (for example, going out of the user, sleeping in the user, etc.). The manual change of the external device 200 by the user is performed by the user directly by changing the state of the external device 200 (for example, by pressing the power button of the external device 200) The status of the external device 200 may be changed using the application of the external device 200. [

Before the user leaves the house, the user manually turns off the power of the display device 201, starts cleaning the robot cleaner 202, starts washing the washing machine 203, turns off the power of the air conditioner 204 , Turning off the power of the lamp 205 or locking the auto door lock 206. Further, before the user leaves the house, the user can change the state of the external devices 201 through 206 in various combinations that are familiar to the user. For example, various combinations may include a status change order of an external device or a status change number of an external device (for example, a status change of only one external device, a status change of only two external devices, a status change of only three external devices, Only five external devices, only five external devices, or all external devices).

When the user comes out of the house from the house, the space situation (e.g., location information) in the state information of the electronic device 100 may be changed. Further, when the user moves from the living room to the bedroom, the location information (e.g., the space situation) among the status information of the electronic device 100 may be changed.

Each control unit of the external apparatuses 201 to 206 can store the changed status information of the external apparatuses 201 to 206 in each storage unit. Status information stored in a storage unit of some of the external apparatuses 201 to 206 is described as an example. Table 1 below shows examples of the status information stored in the storage unit 275 of the display device 201.

Device Name condition Change time Television Off 09:05 Television On 06:01 Television Off 00:38

Table 2 below shows an example of status information stored in the storage unit 275 of the light bulb 205.

Device Name condition Change time Lighter Off 09:06 Lighter On 06:00 Lighter Off 00:39

Here, the stored status information may include a plurality of items indicating an external device identifier, an external device name, and a status change time, and the present invention is not limited thereto. The present invention will be readily understood by those skilled in the art.

Status information can also be stored in the storage units of the remaining external devices in the same manner as in Table 1 or Table 2.

The electronic device 100 may request the server 300 to start monitoring (e.g., by user input) monitoring the status change of the external device 200 using the application 610 (see FIG. 6C) have. The control unit of the server 300 may start monitoring the status of the external device 200 in response to " start monitoring ". The control unit of the server 300 can inform the external device 200 of " start monitoring ". The controller 210 of the external apparatus 200 may transmit the external apparatus status information corresponding to the status change of the external apparatus to the server 300. [

In addition, the electronic device 100 may terminate the monitoring (e.g., by user input) of the status change of the external device 200 to the server 300 using the application 610 (see FIG. 6C) You can also request it.

In step S320 of FIG. 3, the changed status information from the external device is transmitted to the server.

Referring to FIG. 6A, the controller 210 of the external device 200 may transmit status information corresponding to the changed status to the server 300. FIG. The control unit 210 of the external device 200 may transmit the changed status information to the server 300. [ The status information corresponding to the status of the external device 200 may be context information of the external device 200. [ The changed status information may be status information including only changed items among the items included in the status information, or status information including at least a part of the changed and unchanged items. The control unit 210 of the external device 200 can transmit the changed status information to the server 300 using the server information stored in the storage unit 275. [ The stored server information may include a server identifier, a server name, or server connection information (e.g., SSID, IP address, MAC address, channel number or security key, etc.).

The control unit 210 of the external device 200 periodically (for example, 5,000 ms, changeable) transmits the status information of the transmission time point, the status information of the transmission reply time point by the external request, And transmits the status information to at least one of the server 300 and the server 300. [

The control unit 210 of the external device 200 may store the changed status information in the storage unit 275. [ In addition, the controller 210 of the external device 200 may store the transmission status information corresponding to the transmitted status information in the storage unit 275. The stored transmission status information includes a transmission identifier (ID) for history management, an external device name, a transmission start time, a transmission end time, an ID of a receiving device, a MAC address of the receiving device, .

The control unit 210 of the external device 200 may transmit status information (or status information) corresponding to the changed status to the electronic device 100 as well as the server 300. [

When the status of the electronic device 100 is changed, the control unit may transmit status information (or status information) corresponding to the changed status of the electronic device 100 to the server 300. The control unit of the electronic device 100 may store the changed status information in the storage unit. The changed state information of the electronic device 100 stored in the storage unit may include a change identifier (ID) for history management, a state change time, a pre-change position, a post-change position, and the like.

The control unit 310 of the server 300 may store the status information received from the external device 200 or the status information received from the electronic device 100 in the storage unit 375. [

Table 3 below shows an example of status information received from each of the external apparatuses 201 to 206 and stored in the storage unit 375 of the server 300.

External device name condition Change time Auto door lock Off 09:05 Lighter Off 09:04 Air conditioner Off 09:03 Washing machine On 09:03 Robotic vacuum cleaner On 09:01 Television Off 09:01 ... ... ... Television On 06:01 Lighter On 06:00

Here, the stored status information may include a plurality of items indicating an external device identifier, an external device name, and a status change time, and the present invention is not limited thereto. Will be readily understood by those with knowledge.

The state information stored in the storage unit 375 of the server 300 may be stored as one in Table 3 or may be stored in each of the external apparatuses 201 to 206 as shown in Table 1.

In step S330 of Fig. 3, the application is executed in the electronic device.

6B, a user can select a shortcut icon 193a corresponding to an application (for example, an OIC Agent) to be selected from the shortcut icons 193a to 193h displayed on the screen of the electronic device 100, ). The control unit can detect the first touch 301 using the touch screen 190 and the touch screen controller 195. [ The control unit may calculate the first touch position 301a (e.g., X1 and Y1 coordinates) corresponding to the first touch 301 using the electric signal received from the touch screen controller 195. [

The control unit may store the first touch position information corresponding to the first touch position 301a in the storage unit. The stored first touch location information may include a touch identifier (ID), a touch location, a touch detection time, or touch information (e.g., touch pressure, touch direction, touch duration, etc.) for history management.

Referring to FIG. 6C, the control unit of the electronic device 100 may display an application 600 corresponding to the first touch 301 on the screen.

The application 600 includes an application name field 610 that includes an application name 611, an identifier (e.g., icons 621a through 621f) corresponding to the external device 200, a changed state 622 And a display area 620 for displaying the display area 620. [ The application 600 may include an interaction area 630 for displaying the interaction of the application and the user.

The application name field 610 may include a menu 612 and an icon 612 corresponding to a refresh. The display area 620 of the application 600 may include at least one or both of the subtitle 620a and a selection box 623 (see FIG. 6D) that receives the user's selection 620a and 623.

If a check mark is included in the selection box 623, the status of the external device 200 may have already been changed or may be scheduled to be changed. If there is a check box including a check mark in the status information of the external apparatus received at the server 300, it may mean that the status of the corresponding external apparatus 200 has already been changed. If there is a selection box including check marks in the status information of the external device transmitted from the electronic device 100 to the server 300, it means that the status of the corresponding external device 200 is to be changed.

If the number of icons corresponding to the external device 200 displayed in the display area 620 is larger than the number of icons that can be displayed on the screen, the control unit displays a scroll bar (not shown), a scrollable direction (Not shown) corresponding to the icon.

In the electronic device 100, the application may be executed without the first touch 301 of the user. For example, when the changed state information is received from the external device 200, the control unit 310 of the server 300 determines whether the state of the application 600 corresponding to the state change of the external device 200 You can request execution.

The control unit 310 of the server 300 may request the execution of the application 600 corresponding to the state change of the external device 200 with the electronic device 100 have. The control unit 310 of the server 300 responds to the status change of the external device 200 by the electronic device 100 when the status information of the external device 200 and the electronic device 100 is changed The execution of the application 600 may be requested. The control unit 310 of the server 300 may transmit a control command (for example, a control packet) corresponding to the execution of the application 600 to the electronic device 100 through the communication unit 330. [

In step S340 of FIG. 3, status information of the external device is requested to the server.

6C and 6D, the controller of the electronic device 100 may request the state information of the most recently changed external device 200 to the server 300 in response to the first touch 301 . For example, the most recent may include the previous 30 minutes (changeable) based on the time of the status request. The control unit of the electronic device 100 can request the server 300 from the most recent status information of the external device 200 through the application 600 executed in response to the first touch 301. [

The control unit of the electronic device 100 may request status information of the external devices (e.g., 201 to 206) corresponding to the status change of the electronic device 100 (for example, have. The external device corresponding to the change of state of the electronic device 100 may change the state of the electronic device 100 before the change of the position of the electronic device 100 (for example, Quot;) < / RTI >

The control unit of the electronic device 100 may control the state of the electronic device 100 prior to the position change to the last position through the application 600 in response to the state change of the electronic device 100 (e.g., (E. G., 201-206) at a location in the home (e. G., In a house).

When the electronic device 100 and the server 300 are not connected (for example, the address of the server is changed), the control unit of the electronic device 100 uses each of the external devices 201 to 206 ) To request status information.

In step S350 of FIG. 3, the status information of the requested external device is received from the server.

The control unit of the electronic device 100 may receive the status information transmitted from the server 300 through the communication unit 130 in response to the status information request. The received status information may include status information of the most recently changed external device 200, status change of the electronic device 100 (e.g., change of location out of the house from home), or electronic device 100 (E. G., 201 to 206) corresponding to a state change (e. G., A change of location outside the house from the inside of the house). The position change information of the electronic device 100 may be used as the generation position information of the group action.

The received status information may include status information of the external device 200 corresponding to the changed order based on the status information request time of the electronic device 100. [

When the electronic device 100 and the server 300 are not connected (for example, the address of the server is changed), the control unit of the electronic device 100 transmits the status information Information may be received through the communication unit 230. [

The control unit of the electronic device 100 may store the status information received through the communication unit 230 in the storage unit.

In step S360 of FIG. 3, the group action is displayed.

Referring to FIG. 6D, the control unit of the electronic device 100 may display the received (or stored) status information from the server 300. The control unit of the electronic device 100 may display the status information received (or stored) from the server 300 through the application 600. [ In addition, the control unit of the electronic device 100 may process the received (or stored) status information from the server 300 and display the information in the application 600. For example, the processing may include displaying the external device 200 as an icon, and displaying the changed status intuitively (displayed before / after the change). The control unit can display the status information received from the server 300 in accordance with the change time of the external device 200. [ In addition, the control unit may prioritize the status information received from the server 300 according to the power consumption amount (for example, in order of increasing power consumption, not shown) or the user's preference (not shown) It can also be displayed.

6C, the control unit of the electronic device 100 displays icons 621a to 621f, changed states 622a to 622f, and selection boxes 623a to 622f corresponding to the external device in the display area 620 of the application 600, 623f can be displayed.

If the number of icons displayed in the display area 620 is larger than the number of icons (for example, six) that can be displayed in the display area 620, the control unit displays scroll bars (or hovering) (E.g., not shown), a symbol corresponding to the scrollable direction (e.g., ↑, ↓, or △, ▽, not shown).

The control unit of the electronic device 100 can display a selectable button 631 corresponding to the " group action creation " in the interaction area 630 of the application 600. [

When the user makes the second touch 302 on the button 631 of the interaction area 630, the control unit can generate a new group action. The control unit can detect the second touch 302 using the touch screen 190 and the touch screen controller 195. [ The control unit may calculate the second touch position 302a (e.g., X2 and Y2 coordinates) corresponding to the second touch 302 using the electric signal received from the touch screen controller 195. [

The controller may store the second touch position information corresponding to the second touch position 302a in the storage unit. The stored second touch location information may include a touch identifier (ID), a touch location, a touch detection time, or touch information (e.g., touch pressure, touch direction, touch duration, etc.) for history management.

The group action may mean a set of actions of one or more external devices, and at least one action included in the group action may include a control command for changing the state of the corresponding external device. When a group action is generated, group action information corresponding to the group action may be generated and stored. The information on the group action may include information about whether or not to perform a set operation (e.g., a status change) of the external devices corresponding to the set status.

For example, the information on the group action includes a group action title, an external device identifier (ID), an external device name, status change information (e.g., On ↔ Off) For example, a time limit of 5 minutes), and the like, but the present invention is not limited thereto.

The control unit of the electronic device 100 can collectively change the states of the plurality of external devices 200 corresponding to the group action through execution of the generated group action. The control unit can automatically change states of the plurality of external devices 200 corresponding to the group action through the execution of the group action.

When the displayed group action is stored in step S360 of FIG. 3, the process proceeds to step S370 of FIG.

In step S370 of FIG. 3, the group action is stored.

The control unit of the electronic device 100 may display a keypad 166 and a new group action title input window (not shown) on the screen in response to the second touch. The user can enter a new group action title using the keypad 166. [ The entered new group action title may be " go out ". When a new group action is input, the user can select a confirmation (ok, not shown) displayed on the screen. The generation position of the group action having the outgoing as the group action title may be the entrance. When the electronic device 100 arrives at the porch, the server 300 may recommend to the electronic device 100 a group action with outgoing to the group action title.

Referring to FIG. 6E, the control unit of the electronic device 100 may change the subtitle 620a into a new group action title 620b. When a new group action title 620b is selected by the user, the new group action title 620b may be modified by the keypad 166. [

The control unit of the electronic device 100 may display a selectable button 632 corresponding to " group action storage " in the interaction area 630 of the application 600. [

If there is no item to be changed among the items 621 to 623 displayed in the display area 620, the user places a third touch 303 on the button 632 of the interaction area 630. The control unit of the electronic device 100 can detect the third touch 303 using the touch screen 190 and the touch screen controller 195. [ The control unit of the electronic device 100 calculates a third touch position 303a (e.g., X3 and Y3 coordinates) corresponding to the second touch 302 using the electric signal received from the touch screen controller 195 .

The control unit of the electronic device 100 may store the third touch position information corresponding to the third touch position 303a in the storage unit. The stored second touch location information may include a touch identifier (ID), a touch location, a touch detection time, or touch information (e.g., touch pressure, touch direction, touch duration, etc.) for history management.

The control unit of the electronic device 100 may provide feedback corresponding to the storage of the group action to the user. Feedback provided at the electronic device 100 may be provided to the user in one of visual feedback, auditory feedback, and tactile feedback. The control unit may provide the user with a combination of visual feedback, auditory feedback, and tactual feedback, or a combination of visual feedback, auditory feedback, and tactile feedback via electronic device 100.

The visual feedback may be displayed to distinguish the visual effect (e.g., an animation effect such as a fade applied to a separate image or a separate image) corresponding to the storage of the group action from the object displayed in the application 600 . The auditory feedback can be output from the speaker 163 as a sound corresponding to the storage of the group action. The tactile feedback may be output from the vibration motor 164 in correspondence with the storage of the group action.

(E.g., at least one of visual feedback, auditory feedback, and tactile feedback) corresponding to the storage of the group action, in the configuration (not shown) of the electronic device 100. [

The user may enter and / or change the feedback providing time (e.g., 300 msec, changeable) at which at least one feedback is provided to the user.

The control unit of the electronic device 100 may store in the storage unit the group action information including the group action title corresponding to the group action corresponding to the third touch 303 (for example, going out). The group action information includes a group action title, an external device identifier (ID), an external device name, status change information of the external device (for example, On ↔ Off, Unlock ↔ Lock, 5 minutes). ≪ / RTI > Also, the group action information may include group action information without a group action title (e.g., going out).

In step S370 of FIG. 3, when the group action is stored, the group action control method of the electronic device ends.

Returning to step S360 of FIG. 3, if the situation information is changed to generate another group action in step S360 of FIG. 3, the process proceeds to step S380 of FIG.

In step S380 of FIG. 3, the changed group action is stored.

Referring to FIG. 6F, the user places a fourth touch 304 on the selection box 623e. The control unit of the electronic device 100 may display the selection box 623e empty in response to the fourth touch 304. [ The control unit of the electronic device 100 can detect the fourth touch 304 using the touch screen 190 and the touch screen controller 195. [ The control unit may calculate the fourth touch position 304a (e.g., X4 and Y4 coordinates) corresponding to the fourth touch 304 using the electric signal received from the touch screen controller 195. [ Since the detection of the fourth touch 304 by the control unit is substantially similar to the first touch 301 to the third touch 303 (for example, the touch name is different), redundant explanations are omitted.

When the blank-in selection box 623e is again selected by the user, the control unit of the electronic device 100 can display a check mark in the selected selection box 623e again. Further, when a plurality of selection boxes (for example, 623c and 623d) are selected by the user, the control unit of the electronic device 100 can display the selection boxes 623c and 623d in a blank state corresponding to the selection.

When the selection box 623e corresponding to the situation information to be changed is selected by the user, the control unit of the electronic device 100 displays a button 633 corresponding to " generation of the changed group action " in the interaction area 630 can do. After the button 633 is displayed, a selection box may be selected by the user.

In the case of generating the changed group action, the user makes the fifth touch 305 on the button 633 of the interaction area 630. The control unit can detect the fifth touch 305 using the touch screen 190 and the touch screen controller 195. [ Since the detection of the fifth touch 305 by the control unit is substantially similar to the first touch 301 to the fourth touch 304 (e.g., the touch name is different), redundant explanations are omitted.

When the changed group action is stored in step S380 of FIG. 3, the process proceeds to step S370 of FIG.

Steps S360 through S370 of FIG. 3 are substantially the same as steps S380 through S370 of FIG. 3, so redundant explanations are omitted.

In step S370 of FIG. 3, when the changed group action is stored, the group action control method of the electronic device ends.

4 is a schematic flowchart showing a method of controlling group actions of an electronic device, an external device, a server, and an electronic device according to another embodiment of the present invention.

7A to 7E are views showing examples of screens of an electronic device according to another embodiment of the present invention.

In step S410 of FIG. 4, the user arrives at the entrance.

Referring to FIG. 7A, an electronic device 100 carried by a user arrives at a front door. The application 600 of the electronic device 100 may be running before the entrance.

The control unit of the electronic device 100 controls the entrance of the electronic device 100 by receiving positional information via the GPS 155 or by connecting the server 300 and the electronic device 100 via the communication unit 130. [ You can decide to arrive. The control unit may be connected to the server 300 using the server information stored in the storage unit and the communication unit 130. [

The control unit of the electronic device 100 can determine the arrival of the porch by connecting with the automatic locking device 206 which is one of the external devices through the communication unit 130. [ The controller of the electronic device 100 may execute the application 600 in response to the entrance of the electronic device (the application 600 is not executed, 100) carried by the user.

Electronic device 100 and automatic locking device 206 may be connected wirelessly when electronic device 100 is proximate or in contact with automatic locking device 206. [ The automatic locking device 206 may receive an identifier (ID) of the electronic device from the electronic device 100. [ In response to receipt of an identifier (ID) of the electronic device, the automatic locking device 100 may be changed in status (e.g., lock to unlock). The changed state information of the automatic locking device 206 may be transmitted to the server 300. [ The identifier of the electronic device 100 may be included in the changed status information of the automatic locking device 206 and transmitted to the server 300. [

The server 300 may receive the changed status information of the automatic locking device 206. [ The control unit 310 of the server 300 may determine the arrival of the electronic device 100 on the basis of the changed status information of the received automatic locking device 206. [

In addition, the control unit of the electronic device 100 may receive the identifier (ID) of the automatic locking device from the automatic locking device 206. [ In addition, the control portion of the electronic device 100 may receive the position (e.g., spatial information) of the automatic locking device from the automatic locking device 206. [ The control unit of the electronic device 100 determines the status change of the electronic device 100 using the identifier of the received automatic locking device and the spatial information of the automatic locking device 206 .

Entrance of the electronic device 100 may mean alteration of the spatial information in the status information of the electronic device 100. [ The application 600 of the electronic device 100 is able to determine the state of the electronic state 100 in response to the connection of the automatic locking device 206 when the electronic device 100, A change can be detected. The application 600 of the electronic device 100 may automatically detect the state information of the electronic state 100 in response to the entrance of the electronic device 100. [

The control unit of the electronic device 100 may store the changed status information in the storage unit in response to the arrival of the porch. The changed state information of the stored electronic device 100 may include a change identifier (ID) for history management, a state change time, a pre-change position, a post-change position, and the like.

In step S420 of FIG. 4, the entrance of the electronic device is transmitted to the server.

When the electronic device 100 and the server 300 are connected to each other at the entrance, the control unit of the electronic device 100 may transmit the status information corresponding to the arrival of the electronic device 100 to the server 300. The control unit of the electronic device 100 may transmit the changed status information to the server 300 through the communication unit 130. [ The changed status information may be status information that includes only changed items in the status information, or status information that includes changed items. The control unit can transmit the changed status information to the server 300 using the server information stored in the storage unit.

The control unit of the electronic device 100 may store the transmission status information corresponding to the status information transmitted to the server 300 in the storage unit. The stored transmission status information includes a transmission identifier (ID) for history management, an electronic device name, a transmission start time, a transmission end time, an ID of a receiving device, a MAC address of the receiving device, .

In step S430 of FIG. 4, a recommendation group action is received from the server.

A recommended group action (or a recommended group action list) corresponding to the arrival of the porch of the electronic device 100 is received from the server 300 through the communication unit 130. [ When the electronic device 100 arrives at the porch, the control unit 310 of the server 300 transmits a recommendation group action to the electronic device 100 considering the generation location of the group action (e.g., around the porch or porch) . In addition, if there are a plurality of recommended group actions corresponding to the arrival of the porch of the electronic device 100, a recommended group action list can be received from the server 300 through the communication unit 130. [

The control unit of the electronic device 100 may store the received recommendation group action (or recommended group action list) in the storage unit.

In step S440 of FIG. 4, the recommended group action is displayed.

Referring to FIGS. 7B and 7C, the control unit of the electronic device 100 may display a received recommendation group action (or a recommended group action list) on the screen. The control unit of the electronic device 100 may display one of the received recommendation group action list 720 and the recommendation group action 750 (see FIG. 7C). The control unit of the electronic device 100 may also process the received (or stored) recommended group action (or recommended group action list) from the server 300 and display it in the display area 620 of the application 600. For example, the processing may include displaying an external device as an icon, and displaying the changed status intuitively (displayed before / after the change).

The displayed recommended group action list 720 may include a subtitle 720a corresponding to the recommended group action list, titles 721a through 721f corresponding to the recommended group action, and selection boxes 722a through 722f.

If the number of titles displayed in the recommended group action list 720 is larger than the number of titles that can be displayed in the display area, the control unit displays a scroll bar (not shown), an icon corresponding to the scrollable direction Not shown) can be displayed.

In the case of selecting the recommended group action title, the user makes the eleventh touch 701 in the selection box 722b corresponding to the return group 721b, which is the recommended group action title. The control unit can detect the eleventh touch 701 using the touch screen 190 and the touch screen controller 195. [ The control unit may calculate an eleventh touch position 701a (e.g., X11 and Y11 coordinates) corresponding to the eleventh touch 701 using the electric signal received from the touch screen controller 195. [

The control unit of the electronic device 100 may store the 11th touch position information corresponding to the 11th touch position 701a in the storage unit. The eleventh touch location information to be stored may include a touch identifier (ID), a touch position, a touch detection time, or touch information (e.g., touch pressure, touch direction, touch duration, etc.) for history management.

The control unit of the electronic device 100 may selectably display the selection box 722b corresponding to the returning touch 721b corresponding to the eleventh touch 701. [

The control unit of the electronic device 100 may display the text 731 corresponding to " selection of recommended group action title " in the interaction area 730 of the application 600. [ The control unit may not display the text 731 displayed corresponding to the eleventh touch 701. [

The control unit of the electronic device 100 may display the group action 750 corresponding to the return of the recommended group action title by the eleventh touch 701. [ The control unit may display a recommendation group action 750 corresponding to the eleventh touch 701. [

The displayed recommendation group action 750 includes a title 750a corresponding to the recommendation group action, external device icons 751a to 751f corresponding to the recommendation group action, scheduled statuses 752a and 752d to 752f, and a selection box 753a To 753f).

If the number of icons corresponding to the external device 200 displayed in the recommendation group action 750 is larger than the number of icons that can be displayed in the display area, the control unit displays a scroll bar (not shown), a scroll bar An icon (not shown) corresponding to a possible direction may be displayed. It will be readily understood by those skilled in the art that the selection of the selection boxes 753a through 753f by the user can be changed.

The control unit of the electronic device 100 can display a selectable button 732 in association with the " group action execution " in the interaction area 730 of the application 600. [

In another embodiment of the present invention, the recommendation group action (or recommendation group action list) received in the electronic device 100 may be provided by a user (e.g., a mother, a dad, a child, a grandfather, (E. G., Shared) electronic devices (not shown). When each electronic device (not shown) having user information corresponding to the family is connected to the server 300, each electronic device (not shown) having user information corresponding to the family is transmitted from the server 300 A recommendation group action (or a recommendation group action list) can be received. (Or a recommended group action list) is received from an electronic device (not shown) carried by the family, a recommendation group action (or a recommended group action list) is received from the electronic device 100 carried by the user So that redundant descriptions are omitted.

7C, if the received recommendation group action is one, the control unit of the electronic device 100 can directly display the recommendation group action 750, except for the recommended group action list 720, (620).

Since the display of only the recommendation group action 750 is substantially similar to the display of the recommendation group action 750 selected in the recommendation group action list 720 (display of the recommended group action list according to the number of recommended group actions) Is omitted.

In step S450 of FIG. 4, a recommendation group action is executed.

Referring to FIG. 7D, the user makes a twelfth touch 702 on the button 732 corresponding to the execution of the recommendation group action. The control unit of the electronic device 100 can detect the twelfth touch 702 using the touch screen 190 and the touch screen controller 195. [ The detection of the twelfth touch 702 by the control unit of the electronic device 100 is substantially similar to the eleventh touch 701 (for example, the touch name is different), so redundant description is omitted. The control of the electronic device 100 corresponding to the twelfth touch 702 may execute the displayed recommendation group action.

The control unit of the electronic device 100 generates a control command (e.g., a control packet) for changing the state of the external devices 201, 204 to 206 included in the recommendation group action 750 in response to the twelfth touch 702, Lt; / RTI >

The control unit of the electronic device 100 may transmit the generated control command to the server 300 through the communication unit 130. [ The control unit can generate control commands corresponding to the external apparatuses 201 and 204 to 206, respectively (for example, a control command corresponding to the external apparatus 201). In addition, the control unit of the electronic device 100 may generate a single integrated control command corresponding to both the external apparatus 201, 204 to 206, and the control command. The structure of the control command transmitted through the communication unit 130 may have a hierarchical structure.

The control packet corresponding to the control command includes a MAC header (MAC header, not shown) corresponding to a destination (e.g., a server) address and a length, a payload corresponding to a change in status information of an external apparatus, And a CRC (cyclical redundancy check, not shown) corresponding to transmission error detection.

The control unit of the electronic device 100 may store the control command generated in correspondence with the recommendation group action or the recommendation group action in the storage unit.

In the step S460 of FIG. 4, the state of the external apparatus is changed corresponding to the recommended group action.

Referring to FIG. 7E, the control unit 310 of the server 300 may receive a control command corresponding to the recommended group action transmitted from the electronic device 100 through the communication unit 330. FIG. The received control command may be stored in the storage unit 375 under the control of the control unit 310.

The control unit 310 can transmit the status information to the external devices 201 and 204 to 206, respectively, which are status change targets, using the stored external device information and the received control command. The control unit 310 may transmit one integrated control command to the external apparatuses 201 and 204 to 206, respectively. The control units of the external apparatuses 201 and 204 to 206 can extract the control commands corresponding to the external apparatuses 201 and 204 to 206 from the received integrated control command and change the state thereof.

The control unit of the external devices 201, 204 to 206 can receive the control command through the communication unit 230. [ The control unit of the external apparatuses 201, 204 to 206 may store the received control command in the storage unit 275. [

The respective control units of the external apparatuses 201, 204 to 206 can change states of the external apparatuses 201, 204 to 206 in response to the received control command. For example, the control unit of the external devices 201, 204 to 206 may control the power of the display device 201, the power of the air conditioner 204, the power of the light 205, The state can be changed by unlocking the switch.

The respective controllers of the external apparatuses 201 and 204 to 206 can transmit the changed status information to the server 300, respectively.

The server 300 may receive the changed status information of the external devices 201, 204 to 206 through the communication unit 330. [ The server 300 can transmit the changed status information of the external devices 201 and 204 to 206 to the electronic device 100 through the communication unit 330. [ The electronic device 100 can receive status information of the changed external apparatuses 201, 204 to 206 via the communication unit in response to the execution of the recommendation group action 750. [

In step S460 of FIG. 3, when the state of the external device is changed, the group action control method of the electronic device ends.

5 is a schematic flowchart showing a method of controlling group actions of an electronic device, an external device, a server, and an electronic device according to another embodiment of the present invention.

8A to 8G are views showing examples of screens of an electronic device according to another embodiment of the present invention.

In step S510 of Fig. 5, the state of the external device is changed.

8A and 8B, the user can change the state of the automatic locking device 206 to lock. The user can go out of the remaining external apparatuses while maintaining the state of the display device 201, the air conditioner 204, The states of the robot cleaner 202 and the washing machine 203 remain unchanged from the initial state (for example, power-off).

The control unit of the external device 206 may store the changed status information in the storage unit.

The state information stored in the storage unit of the external device 201 may be represented in Table 1 of another embodiment, and redundant description is omitted.

In step S520 of FIG. 5, the changed status information from the external device is transmitted to the server.

Referring to FIG. 8A, the control unit 210 of the automatic locking device 206 may transmit the changed state to the server 300. FIG. The control unit 210 of the automatic locking device 206 may transmit the changed status information to the server 300. [ The changed status information may be status information that includes only changed items in the status information, or status information that includes changed items. The control unit 210 of the automatic locking device 206 may transmit the changed status information to the server 300 using the server information stored in the storage unit 275. [

In addition, when the state information of the electronic device 100 is changed (e.g., the location of the electronic device 100 is changed from home to home), the control of the electronic device 100 may be changed And transmits the status information to the server 300. The control unit of the electronic device 100 may store the changed status information in the storage unit. The changed state information of the electronic device 100 stored in the storage unit may include a change identifier (ID) for history management, a state change time, a pre-change position, a post-change position, and the like.

In step S530 of FIG. 5, the status information is analyzed at the server.

The controller 310 of the server 300 may store the status information of the received automatic locking device 206 in the storage unit 375. [ The state information stored in the storage unit 375 of the server 300 may be represented as in Table 3 of the other embodiments, and redundant explanations are omitted.

The storage unit 375 of the server 300 may store the received status information of the external device 200 and the status information of the electronic device 100 under the control of the control unit 310. [

Each state information stored can be managed by the management software (not shown). The management software can be used to analyze the status information of the external device 200 and the electronic device 100 by using a K-means clustering algorithm or a cross- correlation algorithm can be used. It will be readily understood by those of ordinary skill in the art that various similarity search algorithms as well as the above algorithms can be used.

The management software can extract the feature from the state and state of the external device using the state information of the electronic device 100 and the state information of the external device 100, and can learn and infer the feature. In addition, the management software can extract, learn, and deduce features from the state and state of the electronic device 100 using the state information of the electronic device 100 and the state information of the external device 100.

The storage unit 375 of the server 300 stores the external device usage history of the user corresponding to the change of the status information of the external device 200 received by the control unit 310 and the status information of the electronic device 100 The electronic device usage history of the user corresponding to the change can be stored. Each stored usage history can be managed by management software (not shown). Management software can extract, learn and infer features from external device usage history. In addition, the management software can extract, learn, and deduce features from electronic device usage history.

The management software may generate one or more group actions corresponding to the analysis. For example, when the user does not change the state of the external device 200 and goes out (for example, the state information (for example, the spatial information) of the electronic device 100 carried by the user changes) The management software can check the status of the external device 200 corresponding to the status information of the electronic device 100. [ If there is no change in the state of the external device 200, the management software can recommend an external device (e.g., corresponding to a group action) that requires a state change to the user.

If the user wants to go to sleep (e.g., change the state information of the electronic device 100 that the user is carrying on (e.g., elapsed sleep time)) without changing the state of the external device 200, The status of the external device 200 corresponding to the status information of the device 100 can be confirmed. When there is no change in the state of the external device 200, the management software can recommend an external device (for example, a group action) requiring a state change to the user. In addition, when changing the user's body information (e.g., pulse, body temperature) and changing the environment information (e.g., home temperature, humidity, etc.) of the external device 200, It is possible to recommend a necessary external device (for example, an external device corresponding to the group action).

When the user wants to go to sleep (change the state information (for example, time information) of the electronic device 100 carried by the user) without changing the state of the external device 200, The status of the external device 200 corresponding to the external device 200 can be confirmed. If there is no change in the state of the external device 200, the management software can recommend an external device (e.g., corresponding to a group action) that requires a state change to the user.

The storage unit 375 may store one or a plurality of group actions generated under the control of the control unit 310.

The control unit 310 of the server 300 may transmit status information of the external device 200 (for example, status information of the automatic locking device 206) to the electronic device 100 through the communication unit 330. The control unit 310 of the server 300 may transmit the generated one or more recommended group actions to the electronic device 100 through the communication unit 330. [ The control unit 310 of the server 300 may transmit the generated one or more recommended group actions to each of the external devices 200 through the communication unit 330.

In step S540 of FIG. 5, the status information of the external apparatus received from the server is displayed.

The control unit of the electronic device 100 may receive the external device status information 820 received from the server 300 through the communication unit 130. [ The received external device status information includes status information of the external device 200 that has changed since the last time or status information of the electronic device 100 that corresponds to the status change of the electronic device 100 (for example, And status information of external devices (e.g., 201 to 206).

Referring to FIG. 8C, the control unit of the electronic device 100 may display the received status information 820 of the external device 200 on the screen. Icons 821a to 821f, changed states 822a to 822f, and selection boxes 823a to 823f corresponding to the external apparatus 200 can be displayed on the screen in the state information 820 of the external apparatus. Only the status information of the automatic locking device 206 among the external devices 201 to 206 is changed and displayed.

The control unit may store the external device status information received through the communication unit 230 in the storage unit.

In step S550 of FIG. 5, the received recommendation group action is displayed.

8D, the control unit of the electronic device 100 may display the received recommendation group action 850 from the server 300. For example, The control unit may display the received recommendation group action after the status information of the external device 200. [

The control unit of the electronic device 100 can separately display the received status information of the external device 200 and the received recommendation group action from the server 300. [ The control unit of the electronic device 100 displays one of the status information 852a, 852d, and 852e and the selection boxes 853a, 853d, and 853e in the status information 850 of the external device 200 in a manner distinct from the recommended group action . The control unit of the electronic device 100 displays both the status information 852a, 852d and 852e of the status information 850 of the external device 200 and the select boxes 853a, 853d and 853e in a manner different from the recommended group action can do. For example, at least one of the font, font size, font color, or background color of the status information 852a, 852d, 852e may be changed and distinguished. Also, at least one of the box size, the box line color, the box inner color, the check mark, and the check mark color of the selection boxes 853a, 853d, and 853e may be changed and distinguished.

The control unit of the electronic device 100 may display the received recommendation group action according to the amount of power consumption (for example, in order of increasing power consumption, not shown) or the user's preference (favorite, not shown). When the recommendation group action is executed, an external device having a relatively larger amount of power consumption than the other external devices may be preferentially executed (for example, state change). In this case, the power consumption of the home may be reduced.

When the recommendation group action is executed, the external device preferred by the user may be preferentially executed (e.g., changed in status) than other external devices.

The control unit of the electronic device 100 may display the text 831 corresponding to the " recommended group action " in the interaction area 830. [ If the displayed text 831 has elapsed the determined time (for example, 1 second, changeable), the control unit may not display the text 831.

In step S560 of FIG. 5, a recommendation group action is executed.

Referring to FIG. 8E, when the displayed recommendation group action is executed, the user makes the 21st touch 801 on the button 832 corresponding to the execution of the recommendation group action. The control unit of the electronic device 100 can detect the 21st touch 801 using the touch screen 190 and the touch screen controller 195. [ The control unit of the electronic device 100 calculates the 21st touch position 801a (e.g., X21 and Y21 coordinates) corresponding to the 21st touch 801 using the electric signal received from the touch screen controller 195 .

The control unit of the electronic device 100 may store the twenty-first touch position information corresponding to the twenty-first touch position 801a in the storage unit. The stored 21st touch location information may include a touch identifier (ID), a touch location, a touch detection time, or touch information (e.g., touch pressure, touch direction, touch duration, etc.) for history management.

The control unit of the electronic device 100 generates a control command (for example, a control packet) for changing the state of the external devices 201, 204, and 205 included in the recommended group action 850 in response to the 21st touch 801, Lt; / RTI >

The control unit of the electronic device 100 may transmit the generated control command to the server 300 through the communication unit 130. [ The control unit of the electronic device 100 can generate control commands corresponding to the external apparatuses 201, 204 and 205 (for example, control commands corresponding to the external apparatus 201). In addition, the control unit of the electronic device 100 may generate a single integrated control command corresponding to both of the external apparatuses 201, 204, and 205 as a control command. The structure of the control command transmitted through the communication unit 130 may have a hierarchical structure.

The control packet corresponding to the control command includes a MAC header (MAC header, not shown) corresponding to a destination (e.g., a server) address and a length, a payload corresponding to a change in status information of an external apparatus, And a CRC (cyclical redundancy check, not shown) corresponding to transmission error detection.

Referring to FIG. 8F, the control unit 310 of the server 300 may receive the control command transmitted from the electronic device 100 through the communication unit 330. FIG. The received control command may be stored in the storage unit 375 under the control of the control unit 310.

The control unit 310 can transmit control commands to the external apparatuses 201, 204, and 205, respectively, which are status change targets, using the stored external apparatus information. The control unit 310 may transmit one integrated control command to the external devices 201, 204, and 205, respectively. The control unit of the external apparatuses 201, 204, and 205 can extract the control commands corresponding to the external apparatuses 201, 204, and 205 from the received integrated control commands, respectively,

The control unit of the external devices 201, 204, and 205 can receive the control command through the communication unit 230. [ The control unit of the external apparatuses 201, 204, and 205 may store the received control command in the storage unit 275.

The control units of the external apparatuses 201, 204, and 205 can change states of the external apparatuses 201, 204, and 205 in response to the received control command. For example, each of the control units of the external devices 201, 204, and 205 can change the power-off state of the display device 201, the power-off state of the air conditioner 204, and the power-

In another embodiment of the present invention, when a user turns off a morning call ringing in the electronic device 100, the electronic device 100 may change the status of the electronic device 100 from the server 300 For example, the end of a morning call). The recommended group action corresponding to the morning call can turn on the power of the TV, for example, by gradually lighting up a light (not shown). If the user's input or set time (e.g., 30 sec, changeable) elapses, the control of the electronic device 100 may execute the received recommendation group action.

In step S570 of FIG. 5, the recommended group action is stored.

8G, the control unit of the electronic device 100 may display a selectable button 832 for " group action storage " in the interaction area 830 corresponding to the twenty-first touch 801. [

If there is no change item among the items 821 to 823 displayed in the recommendation group action 820, the user touches the button 832 with the twenty-second touch 802. The control unit of the electronic device 100 may detect the 22nd touch 802 using the touch screen 190 and the touch screen controller 195. [ Since the detection of the twenty-second touch 802 by the control unit is substantially similar to the twenty-first touch 801 (e.g., the touch name is different), redundant description is omitted.

The control unit of the electronic device 100 may display a keypad 166 and a new group action title input window (not shown) on the screen corresponding to the twenty-second touch 802. [ The user can enter a new group action title using the keypad 166. [ The entered new group action title may be " go out2 ". When a new group action is input, the user can select a confirmation (ok, not shown) displayed on the screen.

The control unit of the electronic device 100 may provide feedback corresponding to the storage of the group action to the user. Feedback provided at the electronic device 100 may be provided to the user in one of visual feedback, auditory feedback, and tactile feedback. The control of the electronic device 100 may provide the user with a combination of visual feedback, auditory feedback, and tactual feedback, or a combination of visual feedback, auditory feedback, and tactile feedback via the electronic device 100.

The visual feedback may be displayed to distinguish the visual effect (e.g., an animation effect such as a fade applied to a separate image or a separate image) corresponding to the storage of the group action from the object displayed in the application 600 . The auditory feedback can be output from the speaker 163 as a sound corresponding to the storage of the group action. The tactile feedback may be output from the vibration motor 164 in correspondence with the storage of the group action.

(E.g., at least one of visual feedback, auditory feedback, and tactile feedback) corresponding to the storage of the group action, in the configuration (not shown) of the electronic device 100. [

The user may enter and / or change the feedback providing time (e.g., 300 msec, changeable) at which at least one feedback is provided to the user.

The control unit of the electronic device 100 may store the recommended group action title (e.g., outgoing 2) corresponding to the twenty-second touch 802 and state information corresponding to the recommended group action in the storage unit.

In step S570 of FIG. 5, when the recommended group action is stored, the group action control method of the electronic device ends.

The methods according to exemplary embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. For example, the computer-readable medium may be volatile or non-volatile storage such as a storage device such as ROM, whether removable or rewritable, or any other suitable storage device such as, for example, a RAM, memory chip, Memory, or a storage medium readable by a machine (e.g., a computer) as well as being optically or magnetically recordable, such as, for example, a CD, DVD, magnetic disk or magnetic tape. It will be appreciated that the memory that may be included in the mobile terminal is an example of a machine-readable storage medium suitable for storing programs or programs containing instructions for implementing the embodiments of the present invention. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, Various modifications and variations are possible.

Therefore, the scope of the present invention should not be limited by the exemplary embodiments described, but should be determined by the equivalents of the claims, as well as the claims.

100: electronic device 110: electronic device control part
130: Electronic device communication unit 175: Electronic device storage unit
190: Electronic device touch screen
200: external device 210: external device control part
230: external device communication unit 275: external device storage unit
300: server 310:
330: server communication unit 375: server storage unit
620, 820: External device status information 750, 850: Recommended group action

Claims (20)

Executing an application in an electronic device connectable to an external device and a server;
Requesting the server for external device status information corresponding to the external device;
Displaying the external device status information received from the server on the application screen; And
And generating a group action corresponding to the displayed external apparatus status information,
Wherein the external device status information includes status information of an external device manually changed by an input of a user. The method according to claim 1,
Wherein the external device status information includes an identifier, name, operation information, spatial information, environment information, available resource information, operation history information, or failure information of the external device. The method according to claim 1,
Requesting status information of the external device,
And requests status information of the external device corresponding to a status change of the electronic device to the server when the status of the electronic device changes. The method according to claim 1,
Requesting status information of the external device,
And transmits status change information corresponding to a status change of the electronic device to the server when the status of the electronic device changes. 5. The method of claim 4,
Wherein the state change of the electronic device includes a change of position of the electronic device,
Wherein the position change of the electronic device is detected in the electronic device or detected through connection of the electronic device and the external device. The method according to claim 1,
And request status information of the external device to the external device when the external device is not connected to the server. The method according to claim 1,
Displaying the external device status information on the application screen,
Wherein the icon corresponding to the external device displayed on the screen is displayed in a priority order. The method according to claim 1,
In the step of generating the group action,
And generates a group action different from the group action in response to a user's selection of a selection box included in the displayed external device status information. The method according to claim 1,
Wherein the generated group action includes group action information including an identifier corresponding to the external device. The method according to claim 1,
Further comprising storing the generated group action,
Wherein the stored group action includes group action information including a group action title. 11. The method of claim 10,
And provide feedback of at least one of visual, auditory, and tactile feedback in response to storage of the group action. touch screen;
A communication unit connected to the server; And
And a control unit for controlling the touch screen and the communication unit,
The control unit
Requesting external device status information corresponding to an external device connected to the server to the server, generating a group action using the external device status information received from the server and displayed on the touch screen,
Wherein the external device status information includes status information of the external device that is manually changed by a user's input. 13. The method of claim 12,
Further comprising a GPS receiving a signal corresponding to a position of the electronic device,
Wherein the control unit detects position change of the electronic device using position information corresponding to the position. 14. The method of claim 13,
And when the state information of the electronic device changes in response to the position change, the control unit requests the server for status information of the external device corresponding to the status change of the electronic device. 14. The method of claim 13,
And the control unit transmits the changed status information of the electronic device to the server via the communication unit when the status information of the electronic device is changed in response to the position change. 13. The method of claim 12,
Wherein the control unit requests status information of the external device to the external device when the electronic device and the server are not connected. 13. The method of claim 12,
Wherein the control unit receives a group action title of a group action corresponding to the external device status information via the touch screen by user input. 13. The method of claim 12,
And when the electronic device and the external device are directly connected, the control unit determines the state change of the electronic device in response to the connection of the external device. Executing an application in an electronic device connectable to an external device and a server;
Requesting status information of the external device to the server when the status of the electronic device changes;
Displaying a recommended group action list corresponding to a status change of the electronic device received from the server on the application screen;
Receiving a selection of one of the recommendation group actions in the recommendation group action list; And
And executing the selected recommendation group action,
Wherein the recommendation group action corresponds to a state of the external apparatus that is changed by a user's input. 20. The method of claim 19,
And transmitting a control packet corresponding to the execution of the recommendation group action to the server.

Images