AU2016235039B2 - Method of performing function of device and device for performing the method - Google Patents

Method of performing function of device and device for performing the method Download PDF

Info

Publication number
AU2016235039B2
AU2016235039B2 AU2016235039A AU2016235039A AU2016235039B2 AU 2016235039 B2 AU2016235039 B2 AU 2016235039B2 AU 2016235039 A AU2016235039 A AU 2016235039A AU 2016235039 A AU2016235039 A AU 2016235039A AU 2016235039 B2 AU2016235039 B2 AU 2016235039B2
Authority
AU
Australia
Prior art keywords
information
function
processor
screen
motion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
AU2016235039A
Other versions
AU2016235039A1 (en
Inventor
Han-Joo Chae
Won-Young Choi
Hyun-Su Hong
Jeong-Gwan Kang
Nam-Hoon Kim
Jin La
Yong-Gook Park
Jong-Hyun Ryu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from PCT/KR2014/000773 external-priority patent/WO2014119894A1/en
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority to AU2016235039A priority Critical patent/AU2016235039B2/en
Publication of AU2016235039A1 publication Critical patent/AU2016235039A1/en
Application granted granted Critical
Publication of AU2016235039B2 publication Critical patent/AU2016235039B2/en
Ceased legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/163Indexing scheme relating to constructional details of the computer
    • G06F2200/1637Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)

Abstract

Abstract A method of performing a function of a device based on motion information of the device in a given operational mode (e.g. active or standby mode) of the device, and a device for performing the method are provided. The device includes a sensor configured to detect movement of the device in a standby mode (or active mode) of the device; a storage configured to store motion information based on information related to the movement and at least one piece of function information corresponding to the motion information; and a processor configured to control the device to perform a function corresponding to the motion information in the given operational mode based on the information related to the movement, the motion information, and the at least one piece of function information.

Description

Description
Title of Invention: METHOD OF PERFORMING FUNCTION OF DEVICE AND DEVICE FOR PERFORMING THE METHOD 1] The present application is a divisional application from Australian Patent Application No. 2014213152, the entire disclosure of which is incorporated herein by reference.
Technical Field la] Apparatuses and methods consistent with exemplary embodiments relate to performing a function of a device, and more particularly to, a method of performing a function of a device based on a movement, of the device and a device for performing the method.
Background Art 2] The functions of mobile devices such as smart phones have become more intelligent and more diverse. The numbers of mobile device based applications, services, and contents are increasing.
Disclosure of Invention 3] Accordingly, the accessibility to applications, services, and contents or the accessibility to functions that devices may perform may reduce. In particular, in a standby mode of a device, the accessibility to applications, services, and contents or the accessibility to functions that devices may perform may deteriorate. 4] One or more exemplary embodiments provide a method of performing a function of a device based on motion information of the device in a standby mode of a device, a device for performing the method, and a. non-transitory computer readable medium storing computer codes for performing the same.
[5] One or more exemplary embodiments also provide a method of performing a function of a device based on motion information of the device and context information thereof in a standby node of a device, a device for performing the method, and a non-transitory computer readable medium storing computer codes for performing the same.
[6] One or more exemplary embodiments also provide a method of performing a function of a device based on an operation mode of a device and motion information thereof, a device for performing the method, and a non-transitory computer readable medium storing computer codes for performing the same.
[7] One or more exemplary embodiments also provide a method of performing a function of a device based on an operating mode of a device, motion information thereof, and context information thereof, a device for performing the method, and a. non-transitory computer readable medium storing computer codes for performing the same.
Advantageous Effects 3] According to the above embodiments, it is possible to improve the accessibility to applications, services, and contents or the accessibility to functions that devices may perform. Brief Description of Drawings I] The stated aspects and/or other aspects will become apparent and more readily appreciated from the following description of exemplary embodiments, taken in conjunction with the accompanying drawings in which: 10] FIG. 1 is a block diagram of a device, according to an exemplary embodiment; II] FIG. 2 shows a table for explaining mapping information regarding an operation mode of a device, motion information thereof, and function information thereof, according to an exemplary embodiment; 12] FIGS. 3A and 3B illustrate motion information of a device, according to an exemplary embodiment; 13] FIGS. 4A through 4J illustrate functions of a device performed based on motion information of the device and an operation mode of the device, according to exemplary embodiments; 14] FIG. 5 is a block diagram for explaining an operation between a sensor and a processor based on a seamless sensing platform (SSP), according to an exemplary embodi ment; 15] FIG. 6A is a flowchart of a method of performing a function of a device, according to an exemplary embodiment; 16] FIG. 6B is a flowchart of a method of performing a function of a device, according to another exemplary embodiment; 17] FIG. 7 is a flowchart of a process that may be performed in operation S604 of FIG. 6A or operation 5609 of FIG. 6B, according to an exemplary embodiment; 18] FIG. 8 shows screens for explaining a preset function performed by a device in operations S701 and 5702 of FIG. 7, according to an exemplary embodiment; 19] FIG. 9 is a flowchart, of a process that may be performed in operation S604 of FIG. 6A or operation S609 of FIG. 6B, according to another exemplary embodiment; 20] FIG. 10 shows screens for explaining a preset function performed by a device in operations S901 and S902 of FIG. 9, according to another exemplary embodiment; 21] FIG. 11 is a block diagram of a device, according to another exemplary embodiment; 22] FIG. 12 shows an example of programs and/or command sets that are stored in a storage of 23] FIGS. 13A and 13B are flowcharts of a method of performing a function of a device, according to other exemplary embodiments; 24] FIG. 14 is a block diagram of a device, according to another exemplary embodiment; 25] FIG. 15 is a flowchart of a method of performing a function of a device, according to another exemplary embodiment; 26] FIGS. 16A and 16B are flowcharts of a method of performing a function of a device, according to other exemplary embodiments; 27] FIG. 17 shows screens for explaining functions of a device performed by using the method of FIG. 16A, according to an exemplary embodiment; 28] FIGS. 18A through 18F show gateway screens, according to exemplary embodiments; 29] FIGS. 19A and 19B are flowcharts of a method of performing a function of a device, according to other exemplary embodiments; 50] FIG. 20 shows screens for explaining functions of a device performed by using the method of FIGS. 19A and 1.9B, according to an exemplary embodiment; and 51] FIG. 21 is a block diagram of a device, according to another exemplary embodiment.
Best Mode for Carrying out the Invention 52] According to a first aspect, the present invention provides a device performing a function according to motion of the device, the device comprising: a first sensor configured to detect the motion of the device; and a processor configured to control the device to perform a first function based on the motion of the device while the device is in a first operation mode and to control the device to perform a second function based on the motion of the device while the device is in a second operation mode, wherein the first function is different from the second function and the motion of the device is common to both the first operation mode and the second operation mode. 53] The standby mode of the device may include at least one of an idle state of an application processor included in the device, an inactive state of a function related to a touch screen included in the device, and a screen lock set state of the device. 54] The function related to the touch screen may include at least one of a touch sensing function of the touch screen and a display function of the touch screen. 55] The standby mode of the device may include an inactive state of other elements included in the device other than the movement sensor, the storage, and the processor, a state in which power is not consumed by the other elements, or a state in which power is consumed by the movement sensor, the storage, and the processor. 56] The processor may control the device such that a gateway screen is displayed betore the function is performed. 57] The gateway screen may include notification information notifying that the function is performed, and selection information for selecting an execution mode of the function. 58] When there are a plurality of functions corresponding to the motion information of the device, the gateway screen may include selection information to select an execution mode of each of the plurality of functions. 59] The device may further include a context information sensor for detecting at least one piece of context information related to the device, wherein the storage stores mapping information between the at least one piece of context information of the device, the motion information, and the at least one piece of function information, and the function performed by the processor is determined based on the at least one piece of context information detected by the context information sensor, information related to the movement of the device, and the mapping information. 10] The at least one piece of context information may include at least one piece of current time information, position information of the device, schedule information stored in the device, and log information related to the device. 11] According to a second aspect, the present invention provides a method of performing a function of a device according to motion of the device, the method comprising: detecting motion of the device by using a first sensor of the device; controlling the device to perform a first function based on the motion of the device while the device is in a first operation mode by using a processor of the device; and controlling the device to perform a second function based on the motion of the device while the device is in a second operation mode by the processor, wherein the first function is different from the second function and the motion of the device is common to both the first operation mode and the second operation mode. 12] According to an aspect of another exemplary embodiment, there is provided a nontransitory computer readable recording medium storing one or more programs including commands for executing the method of performing the function of the device. 13] According to another aspect of the present disclosure, there is provided a computer program comprising instructions arranged, when executed, to implement a method in accordance with any one of the above-described aspects. 14] Various respective aspects and features of the present disclosure are defined in the appended claims. 15] It is an aim of certain embodiments of the present disclosure to solve, mitigate or obviate, at least partly, at least one of the problems and/or disadvantages associated with the prior art. Certain embodiments aim to provide at least one of the advantages described below.
Mode for the Invention 16] Reference will now he made in detail to embodiments, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like elements throughout. In this regard, the exemplary embodiments may have different forms and should not be construed'as'being limited to the descriptions set forth herein. |47] Terms such as “fi rst55 and “second'* are used, herein merely-to .describe a variety of constituent elements, but the constituent, elements are not: limited.'by these- terins. These terms are used only for distinguishing one constituent element from another constituent element, [48] Most of tire terms used herein are general terms that-are widely used in the technical art to which the inventive concept pertains. However, some of the terms used herein may reflect intentions- of technicians in this art, precedents, or the occurrence, of new technologies. Also, some of the terms used herein may be arbitmrsly chosen by the present applicant. In this ease, these terms are defined in detail below. Accordingly, the specific 'terras used herein should be understood based on the .unique meanings thereof and the whole context of the exemplary embodiments.
[49] As used herein, the singular forms “a”, “an” and “the** are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will foe-further understood that the terms “comprises5* or “comprising,” and variations of the words, for example “comprising” and “comprises55, means “including· but not limited to”, when used in this specification, and are not intended to (and do not) exclude other components, integers or steps. These terms specify the presence of stated features, integers, steps, operations, elements, components, and/or groups 'thereof, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. As used herein, the term “and/or·’1, includes any and all combinations of one or more of the associated fisted items. Expressions such as “at least one of55 when preceding a list of elements, modify' the entire list of elements and do not modify-the i ndividual etements of the list . . . . . . . y · · [50] Throughout the specification, input information Is touch based input information of a user, The touch based input information may include user gesture based input information. The touch based input information may include input information based on, for example, a tap (or a touch), a long tap (or a long touch), a touch and hold, -a. touch and drag, a double tap, dragging, panning, a flick, a drag and drop, a sweep, and the like, but is not limited thereto.
[51 j The Input information is not limited to the touch based input information. For example, the input information may be movement based input information or vision based input information, [52] The movement based input information may be. based on a user gesture (for example, a device shaking, a device rotation, a device pickup event ? where the device senses it has been, picked up, etc.) based on a movement of a device. For example, the user gesture based, on the device motion when, a device is turned upside down in a direction of gravity, which" will be described, later, .may be set as Incut information based on a movement of the device-indicating a request to perform a preset function.
[53] The vision based input information may be based on information recognized by analyzing an input image captured, by -a camera without'contacting the device. For example, as will be described later, iftformaiioti obtained by recognizing a user's face included in the input image captured by the camera or information obtained by recognizing user's eves may be set as the vision based input information indicating an activation request to a preset function of the device.
[54 j FIG. I is a block diagram of a device 100, according to an exemplary' embodiment.
The device .100 of FIG. 1 performs a preset function based on motion information regarding a movement of the device 100 and operation mode of the device 100, [55] Referring to FIG. 1, the device 100 includes 'a sensor 101, a storage 102, a processor 103, and an Information input/ouipni.unit 104 but. is not limited thereto. That is, the. device 1.00 may include more or fewer constituent elements than those shown in FIG. 1.
[ 56] For example, the device 100 may further include air element for detecting at least one piece of context information regarding the device 100, This will fee described later with respect to FIG. 14. The device 100 may be configured to detect the at least one piece of context information regarding the device 100 by traiismitting and receiving data between the element for detecting at least one piece of context information regarding the device 1QQ, the processor 103. and the storage 102, The at least one piece of context information regarding tile device 100 will be described in more detail, with reference to FIG. 14. Information regarding the operation mode of the device 100 may fee included in the at least one piece of context information regarding the device 1D0.
[57] The sensor 10.1 may include a plurality of sensors of various types to sense, movement of tire device 100.
[58] The information input/output unit .104 may include a display that may display a screen. The display may fee configured as a touch screen and receive user touch based input information.
[59] The operation mode of the device 100 may include a standby mode and an activation mode, but is not limited thereto, [60] The standby mode of the device 1.00 may include at least; one of a black screen state of the device 100, an idle state of an application processor included in the device .100, a deactivation state of a.function related to a touch screen of the iiifo.nn:ation.inpui''output unit 104, anda screen lock set state of the device 100, It m noted that the tern* ‘Flack screen state” is used throughout the present description to indicate a Stale of the screen in which: no infownation is displayed the screen is thus blank and this is typically experienced by the user as a screen that is substantially black or grey in colour; a “black screen state” is therefore not intended to limit the screen colour to black alone.
[61] The deactivation state of a .function related to a touch screen may include a. touch sensing function deactivation state of the touch screen and a display function deactivation state" of'the. touch -screen but is not limited thereto. The toiteh · sensing functioir deactivation slate of the touch semen may -indicate an off state of a touch sensing function of the device 100, The display function deactivation state of the touch screen may indicate a black screen state of the device 100.
[62] The standby mode of the devi ce 1 DO may imel ude a dead i vation s tate of an elemen t; of the.device I (If) other than the sensor 101. the storage 102. and the processor 103,
The standby mode-.of the device 100 may include a deactivation state of a function of the device 100. other· than a function based on an interface between the sensor 101 and the storage 102 among functions- of the processor 103, a function related to the sensor 101., and a function related to the storage 102.
[63] The standby mode of the device 100 may include a low -power state in which only the sensor 101, the storage 102, and the processor 103 operate. That is. the standby mode of the device 100 may include the low power state in which power is consumed by the sensor 101, the storage 102, and the processor 103. The low power state may he. for example, in the range cif power consumption of se veral of rnW and several liW but is not limited thereto.
[64] The standby mode of the device 100 may include a low power state in which no po wer is consumed by an element of the device 100 other than the sensor 101, the storage 102, and the processor 103, The Standby mode of the device 100 may include a state in which power consumption is less than that in-an activation .mode of: the device 100.
[65 j The processor 103 may include an auxiliary processor which may perform a function based on an interface between the processor 103 and the sensor 101 and a function based on an interface between the processor 1,03 and the storage 102, In this case, the above-described low power state may refer to a state in which power is consumed by the sensor 101, the storage 102, and the processor 103. The auxiliary processor may use a micro controller unit that operates at a low clock rate, [66] Alternatively or additionally the processor 103 may include an application processor. This may mean that the processor 103 may include the application processor and the above-described auxiliary processor. The standby mode of the device 100 may include an activation state of (he application processor included in thedevfce 100, That is, when the screen lock set state of the device 100 is operated, in the:activation state of the application processor and is set as the standby mode of the device 100, the standby mode of the device 100 may include the acti vation state of the application processor.
[67] Wien the processor 1.03 includes the application processor and the auxiliary oroeessor, the above-described standby mode of the device 100 mav include an ac-ti.valipn slate of the auxiliary processor included in the processor 103 and a deac tivation state of the application processor'but is not limited thereto.
[68] The device 100 may be, for example, a smart, phone, a 'smart TV, a personal computer (PC), a desktop PC, a notebook, a smart board, a tablet PC, a mobile device, a handheld .device or a handheld PC, a media player, an e-book terminal,;» personal digital assistant (PDA), a digital camera having a function of sensing a movement of the device, and. a digital consumer electronics (CE) device having a function of sensing a movement of the device, bulls not limited thereto.
[6¾ For example, the device ,100 may be equipment that a user may wear. The equipment may he, for example, equipment, used as a watch, glasses, a binding accessor)' (for example, a waist belt, a hair band, etc,), diverse types of wearable accessories (for example, a ring, a bracelet, an ankle bracelet, a hair pin, a necklace, etc.), earphones, a helmet, various types of body guards (for example, knee guards and elbow guards), shoes, gloves, clothes, a hat, a prosthetic leg for an impaired person, a prosthetic hand for im impaired person, etc. The equipment that the user may wear may have a communication function and a data processing function, The equipment that the user may wear is not limited to the equipment described above.
[70] The sensor 101 detects movement of the device 100. The movement of the device 100 may include, for example, a rotation based movement such as an upside-down movement of the he vice '100,· a rotation direction based movement (for example, a clockwise direction movement, a counter clockwise direction Movement, a +¾ axial direction movement, and a -z axial direction movement, a perpendicular dineetion based movement such as that, the device 100 is placed in a horizontal direction and then is lifting in a vertical direction, and a movement distance of the device 100 according to the 'perpendicular direction based movement, but is not limited thereto.
For example, the movement of the device 100 may include a shaking based movement of the device 100 as described above, [71] The sensor 101 includes at least one sensor for detecting the movement of the device 100. That is, the sensor :10.1 May include at least one of a gyro sensor for sensing a rotation based movement of the device P00 and an accelerometer sensor for sensing a perpendicular direction based movement of the device .100 and a moving distance of the device 10(), but is not limited thereto.
[72] For example, tile sensor 101 may further include at least one of a magnetic fieldsensor for sensi ng a rotation direction of the devic e 100, an orientat ion sensor for sensing an inclination direction of the device 100, a global position system (GPS) sensor for sensing a location of the device 100,. a gravity sensor Tor sensing a gravity direction of the device 100, and a rotation number sensor for sensing a rotation number of the device 100, Sensors that mav be further included in the sensor 101 are not also limited to those described above.
[73] The gyro sensor may include three gyro sensors for sensing a rotation angular speed around three axes (x, y, and z axes) of the de vice 100. In this case, the sensor 101 may convert results of sensing an x axis rotation angle (roll (left and right rotation) angle) hf the device 10Q, a y axis rotation angle (pitch (gradient) angle), and a z axis rotation angle (yaw (horizontal rotation) angle) and the rotation direction into electrical signals and output the electrical signals.
[74j An acceleration sensor may be. configured to sense an acceleration variation with respect to the three axes (x., y, and z axes) of the device 100 or an acceleration variation with inspect, to the two axes (x and y axes). In this case, the sensor 101 may convert''results of sensing a linear acceleration of the device 100 and an inclination angle of each axial' direction into electrical signals and output the electrical signals.
The electrical signals output by the sensor 101 are transmitted to the processor 103.
[75] The sensor 101 may be referred to as a movement sensor for detecting the movement of the device 100. The electrical signals output by the sensor 101 may be referred to as a sensing value of the movement of the device 100 ©r information regarding the movement of the device 100.
[.76] The storage 102 stores at least one program and data related to the at least one program. The at least one program stored in the storage 102 includes a program used to control a device so as to perform a function based on motion mformation of the device 100 based on the information regarding"the movement of the de vice 100 and at least one piece of function information of the device 100 corresponding to the motion information, The data related to the at least one program may include mapping information of the above-described information regarding the movement of the device 100, the above-described motion information of the device 100, and the abovedescribed function· information of the device 100,
[77] FIG. 2 shows a table for explaining mapping information regarding operation mode information of the device 100, motion information thereof, and function Mformation thereof, according to an exemplary embodiment. The table of FIG, 2 does not include information indicating a mapping illationship between information regarding a movement of the device 100 and. the motion information thereof However, motion information of the device 100 such as a 9(F rotation in a. clockwise direction, a. 180a rotation in the clockwise direction, and a 270° rotation in the clockw ise direction may be determined, based on the information regarding the: movement of the device 100 that is output by the sensor 1.0L
[ 78] Data related to a program stored in. the storage 102 may include table information shown in FIG, 2, The data related to the program, stored in the storage 102 does not include information related to an activation mode of the .device '10G and may Include the mapping information regarding the movement information of the device 1.00, the· motion information thereof, and the function information thereof related to a standby mode of the device 100. (79] Referring to FiG. 2, the operation mode of the device 100 may include the standby mode and the acti vation mode. The motion information of the device 100 may include information indicating a 90° rotation in a clockwise direction, information indication a 1 86° rotation in the clockwise direction, and information indicating a 270c' rotation in the clock wise direction, f 80] The above-described standby mode may be referred to as a sleep mode, a, deac tivation mode, or an idle state but is not limited thereto. An active mode may be •referred to as a running-mode but is not limited thereto. {'8.1] FIGS. 3Λ and 3B show screens for explainingrotation based motion information of the device 100, according to an exemplary embodiment. That is, FIG. 3A is an. example of a plurality of’ pieces- of motion· information with respect to die device 1.00 in a vertical position. The motion information includes horizontal span motion: information of a 90° rotation in a clockwise direction, horizontal span motion information of a 270° rotation in. the clockwise direction, and upside-do wn motion information of a 180° rotation in the clockwise direction.
[82] The rotation based motion information of the device 100 is not limited to the 90°, 180°, and 270'" rotations -as..shown, in FIG< 3 A, For example, the rotation based motion infofoiation of the device 100 may be set based on information regarding a rotation movement below 90° in the clockwise direction. That is, the rotation based motion information of the de vice 100 may be set. based on information regarding a rotation movement by 45" in the clockwise direction.
[83] The rotation based motion information of the device 100 may include motion information based on mformati oh regarding a movement, according to a rotation of the device 100 by 90° in a counterclockwise direction. The roiation based motion information of the device 100 may inc l ude motion information based on information regarding a movement according to a rotation Of the device 100 by 90° in the clockwise direction and the motion information based on the information regarding the movement according to the rotation of the de vice 100 by 90° in the counterclockwise direction, [84] The rotation based motion information of the device 100 may include one of motion infomtation based on information regarding an upside- down, movement (180° rotation) in a-fz axis direction and motion information based on mformatkm regarding the upside-down movement (180" rotation) in a-z axis direction with respect to the device 100 in the vertical position as shown in FIG, 3B- The rotation based motion information of the device 100 mav include motion· information based on information regarding the upside-down movement (180° rotation) in the ±z axis direction with respect to the device 100 in the horizontal position.
[83] A standby mode of the de vice 100 may be changed to an active mode- according to motion information-detected in the standby mode of the device 100, [86.] The information inpui/output unit 104 may be in a deactivation state in the standby mode of the device 100. For example, when a touch screen is included in the information input/outpus unit 104., and the standby mode.' of the devi.ee 100 is set as a black screen of the touch screen, a deactivation state of a function related to the touch screen, or a screen lock set state of the device 100, the information input/output unit 104 may be in the deactivation state in,the standby mode of the device 100.
[87] The active mode of FIG. 2 may include an active state of ail the sensor 101, the storage 102, the processor 103, and the information inpui/output. unit: 104 that are included in the de vice 100. The active mode of FIG. 2 may include an active state of at least one other element that is not shown as -well as the sensor 10 i, the storage 102, the processor 1.03, and the information input/ootput unit 1,04 that are included in the device 100.
[88] The active mode of FIG, 2 may include a power consumption state in which power is consumed by the sensor 101, the storage 102, the processor 103, mid the information input/outpnt unit 104 that are included in the device 100. The active mode of FIG. 2 may include the power consumption state in which power is consumed by at least one other element that is hot. shown as well as the sensor 101, the storage 1.02, the processor 103, and the information input/eutput unit 104 that are included In the device 100.
[89 j The active mode of FIG. 2 may include an active state of an application processor included in the device 100. The active state of the application ptxreessor may indicate a state in which power is consumed by the application processor, [90] The active mode of FIG. 2 may include a state in which power consumption of the device 100 is greater than that in the standby mode of FIG. 2.
[91] The active ..mode of FIG, 2 may include a state in which at least one of an application, a service, and content that may fee set in the device 100 or may be downloaded by the device 100 from Che outside is executed or an execution of at least one of the application, the service, and the content may be requested.
[92] The state in which at least one of the application, the service, and the content is executed may include a multitasking state. The state in which an execution of at least one of the application, the service, and the content may be requested may include a state in which the.information input/output unit 104 displays or may display a screen including an icon, a screenshot, or a user interface that may be used to set an execution mode of the dDDlicatiom the service, and the content.
[93] A relationship between the operation mode ioforraation of the device 1()0, the motion information' of the device 100, arid the function infonn&amp;tion of the device 100 will now be described in more detail with reference to FIG, 2.
[94] That is, when the motion iMermation of the device 100 .corresponds. to information regarding a movement indicating die 90° rotation in the clockwise direction, and the operation mode of the device 100 is the standby mode, a preset function that may be performed by the de\ ία. 100 is a time: cheek function.
[95 j FIGS, 4A through 4J show screens 401 through 424 for explaining preset functions of the dev ice lOOjperfbrthfcd based on motion informati on of the-device .TOO and an operation mode of the device 100, according to exemplary emhcxlimeats.
[96] Referring to FIG. 4A, when the device 100 is in a standby mode, the information input/output .104· displays the black: Screen 401, and a sensin g value (information regarding a movement) indicating a 90° rotat ion of the device 100' in a clock wise direction is recei ved from the sensor 101, the processor 103 detects the motion information of the device 100 from Information stored in the storage 102 according to the received sensing value, 'In this regard, the detected motion information indicates the 90° rotation In the clockwise direction.
[97 J The processor 103 detects function information from the storage 102 by using the motion information of the device '100 detected in the standby mode of the device 100. The detecting of the function information or the motion information from the .storage 102 fnay.be referred to as reading of inibmatkm or seai'chlng of ihfoMation but is not limited thereto.
[98| Referring to FIG, 2, when the -motion, Information. of the device 100 indicates the 90° rotation of the device 100 in the clockwise direction, and the operation mode of dev ice 100 is In the standby mode, the function infomation detected from the storage 102 is time check function information·. The processor 103 controls a function of the device 100 to perform a time check function according·to the detected function information. Accordingly , the black screen 401 of the information input/output unit 104 is changed to a screen 402 including time information, [99] The screen 402 provided by performing: the time check .function may be-referred to as a first screen . The first screen may be a screen firstly provided on the black screen 401 but i s not limited thereto. For example, the first screen may be the screen firstly provided on the black screen 401 as well av a screen that may provide various types of information such that a user may stay more than a preset time. Various types of information may include·, for example, information related to a gateway that will be described later but is not limited thereto.
[1.00] When the first screen is provided, an application processor included in the device 100 mav be in a deactivation state but mav be in an active state. It mav be determined whether the appl teal ion -processor included in. the device is in a deactivation state according to in Ion-nation provided on the first screen. For example, when the in-fotimtion provided on the first screen is provided in the deactivation state of the application processor included in the device 100, the application processor may he in the deactivation state. When the information provided On the first screen is provided in the active state of the application processor included in the device 100, the application processor may be hr the active state.
[ 101 ] When the screen 402 including the above-described. time-function is displayed, the application processor included in the device 100 may be in the deactivation state. The application processor may be included in the processor 103 and set in the deactivation state or the active state as described above. 'However, the application processor may be installed outside the processor 103, [102] When the device 100 is the standby: mode and the motion information of the device 100 indicates a 180” rotation in the clockwise direction in FIG..2, a quick node function, as shown in FIG. 4E, may be a preset function that may be performed by the device 100. 1103] Referring to FIG, 4B , when the de vice 1.00 is in the standby mode, the information mput/output unit 104 displays a black screen 403, a sensing value indicating the 180·’ rotation of the device 100 in the, clockwise, direction 'is received from the sensor 101, .the- processor 103 recognizes the motion .information of the device 100 as the 180° rotation in the clockwise direction. The recognizing of the motion reformation by the proeessor. 103 according to the sensing value may be based on an operation-of detecting the motion information from the storage 10.2 by using the received sensing value. Thus, the recognizing; of the motion information by the processor 103 may be referred to as detecting of the. motion information; but is not limited thereto.
[104] The processor 103 may detect; an operation mode of the device 100 after detecting the motion infbnrtation of the device 100, The processor 103 may detect information regarding the preset function corresponding to the detected motion information of the device Ϊ00 and the detected .operation.mode of the device 1-00 from, the storage 103, [105 ] When the device 100 is in the standby mode and the motion informat ion of the device 100 is detected as the 180° rotation hi the clockwise direction in FIG. 2, the information regarding -the preset: .function read from the storage 103 is quick node function,inforitihiipn. Accordingly, the processor 103 may perform the quick note function, and a screen displayed on the information mput/output unit 104 may be changed froth the black screen 403 to a note screen 404 as shown in FIG. 4B, [ 106] A recording icon anda camera icon that are included in the note screen 404 of H(i. 4B may be used for the quick note function. That is, when &amp; user command to select the reeordmn icon is inout in the note screen 404. content that is recording may be displayed on the note screen 404. For example, if a user voice signal “I am going to school at 8 tun.” is input, the processor 103 converts the input user voice signal into text'information and displays the converted (ext information on the note screen 404. Accordingly, the user may see a message "I am going· to school at 8'a,m,M· on the note screen.
[107] To this end, die processor 103 may perforata function of converting an audio signal received "through fhe information input/output unit 104 into text information that may he displayed* In this regard, a font, of the text information that may he displayed may be previously set. The displayed text information may he stored hi the storage 102 according to a user storage request.
[108] The refore, desi red content may be written on the note screen 404 by using-a stylus pen or by using a recording function. Accordingly, the -user may quickly write ideas that instantly occur, and may use the quick note function of the device 10Q without the stylus pen, [109] When the stylus pen is installed in the device 100, the quick note function of the device 100 may he used without removing the stylus pen. Widen the recording icon is selected, the processor 103 may display a screen for executing a recording application on the infomiation input/output unit 104 while executing the recording application, [110] When a command to select the camera icon is input on the note screen 404, a camera may he used to display a captured image on a quick note screen. To this end, the processor 103 may perform a function of overlapping the image captured by the camera on the quick note screen, [111 ] For example, the processor 103 may split and display a screen according to an execution of a camera application and the quick note screen. For example, a message: related to the captured image may be input on the note screen 404 by displaying the image captured by the camera in the left side and the note screen hi the right side. An area on which that captured image is displayed and an area on which the note screen 404 is displayed are not limited thereto. The captured image may be a still image or a moving image, [ 112 ] .Sizes of the screen on which the captured, image is displayed and the quick note screen may be previously set. Only an image captured according to a user command or both the captured image and the message input on the note semen 404 may be stored in the storage 102, Accordingly , the user may capture and store an image that the user wants to capture quickly by using the quick note function or may store both the captured image and a message related to the captured image, [113] When the captured image is stored, the execution of the camera application may automatically end. or m ay end according to a user request. Such an operation, follows an environment set of the device 100, The .information mtmt/outhut unit 104 may further include a microphone and a camera for the above-described recording function and capture; function.
[114] When a corresponding application is executed by using the recording icon and the camera icon· that are included in the above-described note screen 404, the note screen 404 may fee defined as a gateway screen to execute the recording application or a camera application.
[115] The gateway screen may include notification mfomtation notifying that a preset .function will be executed; The gateway screen may include selection information used to select an execution mode regarding at least one function. The selection information may he defined like the. above-described recording icon and camera icon. The gateway screen will be described in more detail with reference to FIGS, 1? and 18A through ISP later, [116] When the quick note function indicates a function of quickly performing a note application installed in the device 100. the quick note function may be based on the note application installed in the device 100.
[ 117 ] The quick note function may simultaneously .select the recording icon and the camera icon; in this case, the captured image and the text information of the audio signal corresponding to the captured image may be displayed on the note screen 404. The simultaneously selecti ng of the recording icon and the camera icon may be. performed by using a multi-touch on the recording icon and the camera icon. The simultaneously selecting of the recording icon and the camera icon may 'follow the environment set of the device 100 that the camera icon· is automatically selected since the recording icon is. selected. The simultaneously selecting of the recording icon and the camera icon may follow the environment set of the device. .1.00 that; the recording icon is automatical ly selected since the camera icon is selected.
[ I I S] When the device '100 κ in the standby mode and the motion information based on the information .fogafoing. Hie movement of the device 100 indicates the 180° rotation in the clockwise direction, as shown in PIG. 4C, a universal queue function may be a preset function that may be performed by the device 100, [ 119 ] .FIG.'40 show»: the universal queue function when the device 100 is in the standby mode, the information input/oidput unit 104 displays a black screen 405, and the motion information based on the information regarding the movement of the device 100 indicates the J80a rotation in the clockwise direction, [120] That is, information regarding the preset function that is; read by the processor 103 from, the storage 102 is universal queue function information. The processor 103 controls the device 100 to convert the black screen 405 di splayed on die information input/output unit 104 into an information screen 406 stored in a uhivemal queue. The universal ciueue mav be included in the storage 102, [121:] 'When the device 100 is in the standby mode and the motion .infomiafion of the device 100 indicates the 180° rotation in. the clockwise direction, a universal queue list display function is a preset function that may be performed by the device 100.
[122] When the information' regarding the preset·.function· is universal, queue list display function information, since the processor KB performs the universal queue list display function, as shown in FIG, 4D, the black screen 407 displayed on the information mpuf/output unit.. 104 is: converted into a uni versal queue list screen 408. A universal queue list may be stored in the storage 103, and information based on the universal, queue list may he provided from the storage .103 or a server (not shown). The screen 409 of FIG. 4D is.-a semen for downloading information regarding a universal queue selected based on the universal queue list from the server (not shown). 1123] When the device 100 is in the standby mode and the motion information of .the device 1.00 indicates the 270" rotation in the clockwise direction in FIG. 2,. a byte information viewer function is a preset function that may be performed by the device 100.
[124] The byte information viewer function is a function of showing necessary information according to a screen or an environment set in the device 100. For example, ticket information, security card information, payment barcode information,.coupon-information, etc. that are previously designated by the user are information that may be provided by using the byte information. Viewer function bat are not limited thereto.
[1.25] The user may quickly swipe and view1 information that remains in a clipboard, information that remains as a byte information viewer through a specific interaction, and information stored in a screen capture and a note while using a. specific Application by using: the byte information viewer function.
[126] FIG. 4E shows a screen for executing the byte information viewer function. That is, when the device 100 is. in the standby mode, the information input/output unit 104 displays a black screen. 410, and a sensing value indicating the 270° rotation of the device 1Q0 in the clockw^ise direction is recei ved from the sensor 101, the processor 103 .recognises the motion information of the device 100 based on the operation mode of the device 100, a screen state of an information input/out unit 104, and the: sensing value.
[1.27 ] When the motion information is recognized, the processor .103 detects the information regarding the preset function from the Storage 102 by using the operation mode of the device 100 and the motion information of the device 100. Referring to FIG. 2, the information regarding the preset Function detected from the storage 102 is byte information viewer function information. The processor 103 performs the byte information viewer function, and the black semen 410 of the information: input/ouiput unit 104 is converted into a oreviouslv set information screen 41L
[12&amp;] Referring to FIG. 2, when the device'100 is in an active mode, the motion information of the device 100 indicates the 90'- rotation in the clockwise direction, and: a Inaction eurrendy performed by the device 1.00 is-a web browsing '"function, as shown m FIG, 4F, a browser secret, mode execution function is a preset function that may be performed by the device .100. 11.29] Referring to FIG, 4F, when the device 100 in the active mode executes the web browsing function 412, and the motion information indicating the 90* rotation of the device 1.00 in the clockwise direction is detected based on the sensing value.received from the sensor 10.1, toe processor 103 detects theon form a lion regarding the preset function from the storage 102 by using the.·motion information of the device 100, the operation mode of the device 100, and the function executed by the device 1.00. The information regarding the preset function is browser secret mode execution function information. Accordingly, the processor 103 executes a browser secret mode, also known as an '‘incognito” or “private” browsing mode. Once the browser secret mode ls executed, log information that occurs alter the execution of the browser secret mode, is not recorded on the device 100- The log .information may include information such as a user’s searching history information;, a .user’s internet surfing history information, and log-in information, etc, [ 130] During the execution of the browser secret' mode, when a sensing value indicating a 90° rotation of the device 100 in a counterclockwise direction is recei ved from..the sensor 1:01 (that is, the sensing value is received as a reference value), the processor 103 may cancel the execution of the browser secret mode of-web browsing, A browser secret mode execution function and a browser secret mode cancelation function may be performed by the processor 103 by reading the motion information from the storage 1.02 by using the sensing value, and reading the information regarding the preset function from the storage 10.2 by using the read motion information and foe sensing value.
[131 ] Referring to FIG, 2, when the device 100 is in foe active mode, the motion information of the device 100 indicates the 18(T rotation in the clockwise direction, and an application is currently executed by the device 100, as shown in P1G,4G, a function of switching the application to another application is a preset function that may be performed by the device 100.
[132] Referring to FIG. 4G, while the device .100 executes a specific social network service (SNS) 414, when a sensing v alue indicating the 180° rotation of the device 1.00 in the clockwise direction is received from the sensor 101, foe processor 103 detects the motion, information'of foe device 1,00 from the storage 102 by using the sensing value. The processor 103 detects the infosinatiori regarding foe preset function from the storage .10.2 b.v using foe defected motion information of the device: 1.00 and. foe operation, mode of the device 100. in FIG. 4G, die detected motion information of the device 100 is the function of switching the application to another application.
[133] Thus, the processor 103 performs the function of switching .toe'appl'ication to another .application 415, 416, The above-described other application may include one of a previously set application, an: application that was just previously executed, and another application that is mu hi-tasking but is not limited thereto. If a plurality of applications are performed at the same time, the other application may include an 'ap-plication· that has been recently executed.
[134] When applications are switched, although the processor 103 may directly switch screens, an animation effect may be provided as shown by the screen shots 415 and 416 of PIG, 4G. Screen slims 415 and 416 of FIG, 4G display an accordion effect in which the processor 103 displays a screen of slowly compressing an original application screen, after receiving the sensing value indicating the .180° rotation of the device 100 in the clockwise direction from the sensor 101: the accordion animation effect resembling the gradual compression of the original application screen against a lower edge of the device iOO under the weight of a heavy stone.
[135] The animation effect is not limited to the above-described accordion effect For example, the animation effect may include various animation effects such as an animation effect of making a blurry Image clear, an animation effect of moving an i mage from top to bottom of a screen, an animation effect of rotating an image at the same angle as the rotation angle of the device .100, etc. Various animation effects ..may· be set by the user in advance. The animation elfect may be simulated hi a demonstration form in advance before set by the user.
[136] Referring to FIG,40, while the device 100 executes a specific application (for example, Facebook) 417, when it is sensed that the device 100 rotated by 1.80u in the clockwise direction, the.application (for example,· Facebook) is switched to a previously designated application (for example, KaKao Talk) 418, During an execution of the designated application: (for example, KaKao Talk.)·, when the device 100 rotates by 1.80° in the clockwise direction again 419, the executed application (for example, Kaiao Talk) is switched to a previously executed applieationffor example,.Facebook) 420, As described above, the motion information of the device100 stored in the storage 102, information regarding the operation mode of the device 100, and the information. regarding the preset function that may be performed by the device 100 may be set in such a way that an application executed by the device 100 may be switched to another application. The device 100 may be set to rotate by .1.80® in the counterclockwise direction: on the screen 419, [137] When the operation mode of the device 100 indicates an execution of a service or content, infomiation recardins a oreset function of the device 100 aecordine to a oreset motion Mmrnatian. may be set to switch the service or the content to another service, other content, or another application.
[138] When the operation inode of the device 100 indicates a service or an application, and a plurality of accounts are set in a currently executed service or application, information regarding a preset function of the device 100 according to preset motion information may be set to perform a function of changing a currently used, account to another account.
[ 139] Referring to FIG...2, when the device 100 is in. the active mode and displays a specific list, and the motion information of the device 100 indicates the 180“ rotation in the clockwise direction, a list sorting change function may be a preset function that may he performed by the device 100 as shown in FIG. 41 That is, when the motion information of the device 100 indicates the .180° rotation in the clockwise direction, the processor 103 may change the screen 421 of a list sorted in ascending order of FIG. 41 to the screen 422 of a list sorted in descending order.
[140] Referring to FIG, 2, when the device 100 is in the active mode, and the motion information of the device 100 indicates the 270* rotation in the clockwise direction, a preset function may be set to perfomi. a voice recording function irrespective of a function that is executed by the device 100. For example, when the device 100 displays a home screen, if a sensing value indicating the 270° rotation of the device 100 in the clockwise direction, is received, the device 100 may perform the voice recording function according to information regarding a preset function..
[141] The information regarding the preset function of the device 1,00 according to the operation mode of the device 100 and the motion information of the device 100 are not limited to as defined in FIG. 2, For example, the motion information of the device 100 may be defined only tnfomration regarding an upside-down (180° rotation of the device 100) motion in the clockwise direction. The motion in formation of the device 100 may be defined only motion information 423 indicating horizontal holding of the device 100 and veftical lifting of the device 1.00 as shown in FIG. 4J. Information regarding the preset function eomespondihg to the motion information 423 may match information regarding one of .fa.scti.ons defined in FIG. 2, However,,,:the function information capable of matching the motion information 423 is not limited to FIG. 2, [ 1.42] The motion information of the device 100 is not limited as described above. For example, the motion information of the device 100 may include motion information indicating vertical holding .of the device 1QQ and vertical l ifting of the device 100, motion information indicating vertical holding of the device 100 and moving of the device 100 by a preset distance in a left and/or right direction, and motion information indicating horizontal holding of the device 100 and moving of the device 1.00 by a oreset distance in the left and/or xidit direotion. The preset distance mav be defined.as a distance greater than a minimum distance that may be recognized that the device 100 moves in a left or right direction by using the sensor 1()1, The minimum distance may be determined according to a sensor included in the sensor 101.
[143] FIG, 4J shows a ease where the processor 103 executes a previously set..application, when the device 100 is in the standby mode* and a sensing value indicating horizontal holding of the device 100 and vertical lifting of the device 100 is received from the sensor 101. The sensin g value indicating horizontal holding -Of the de vice 100 and vertical lifti ng of the device 100 may be set as, for example, an .x axis, variation smaller than: 30°, a y axis variation greater than 00°, and an acceleration variation greater than T, wherein T is an integer, but is not limited thereto. That is, the sensing value may he determined according to the sensor included in the sensor 101. 1144] The at least one program stored in the storage 102 may include an application execution program, a service execution, program,-a content storage program, a content reproduction program, etc, [145] The processor 103 tnay execute the at least one program stored, in the storage 102 as described above, and may recognize the motion information, of the device 100 by using a value sensed by the sensor 101 and information stored m the storage .102, [146] The processor 103 may detect the operation mode of the. device TOO. When information regarding the operation mode of the device 100 is stored in a flag register of the processor 103 or in a preset area of the storage 102, the processor 103 may determine the operation mode of the device 100 by reading the information regarding the operation mode of the device .100 from the flag register or from the abovedescribed preset area of the storage 102. The determining of the operation mode of the device 100 may be referred to as detecting of the operation mode: of the device 1.00, lie processor 103 May include a random access memory' (RAM) including the abovedescribed flag register, [147] The processor 103 may be one or more processors for controlling a general operation of the device 100, The processor 103 may control operations of the sensor 101, the storage 102, and the information input/output Unit 104, The processor 103 may be a controller, a microprocessor, a,digital signal processor, etc.
[148] The processor 103 maymelude a low power processor 51.0 that control the sensor 101 by using a seamless sensing platform (SSP) as shown in FIG, 5 and an application processor (AP) 520, The. low power processor 510 may be defined as an auxiliary processor. The application processor 520 may be defined as a main processor. FIG. 5 is a block diagram for explaining an operation between die sensor 101 and the processor 103 based on the SS P, according to an exemplary embodiment.
[1.49] The low power processor 5 :10 of FIG. 5 may be a low power micro control unit (MCU) onemtine in a standby mode of the device 100 described in FIG, 1 above. The low power processor 510 may include a sensor hub 511 and a SSP manager 512. The sensor 101 may Include first through nth sensors 501 ...1 -501...0 which may be attached to the sensor hub 511. The SSP manager 512 may be included' in a framework of the .application processor 520.
[ 150) The sensor hub 311 may receive values sensed from the first through nth sensors 501...1 ~501...n. The first through nth sensors 501...1-501..n may transmit the sensed values based on communication such as Bluetooth low energy .communication to the sensor hub 51L Communication between the first through nth sensors 501....1-501....11 and the sensor hub 511. is not limited to the Bluetooth low energy communication.
[ 151 ] When the operation mode of the device 100 is in the standby mode, the application processor 520 may be set in the standby mode. When the application processor 520 is set in the standby mode, if the operation mode of the .application, processor 520 is changed to an active mode, the sensor hub 5.11 may perform data communication with the SSP manager 512 by using a data communication protocol based on the SSP. The case where the standby mode of the application processor 520 is changed to the active mode may be determined according to information regarding a preset ftmetion that, needs to be executed by the device 100 described in the above-described embodiments.
[.152) The operation between the. sensor hub 511 and the· SSP"manager 512 is .as follows. That is, the sensor hub 511 transmits an interrupt, signal indicating that there is data that is to be transmitted to the SSP manager 512 (513). The SSP manager 5.12 transmits a signalrequesting a data type and a length that are to be transmitted by the sensor hub 511 to the sensor hub 511 (514). The sensor hub 511 transmits information regarding the data type and the length that are to be transmitted to the S S P manager 512 (5.15), The information transmitted from, the sensor hub 511 to the SSP manager 512 is not limited to the data type and the length.
[153] The SSP manager 512 transmits a start to read message MSG to the sensor hub 511 (516). When the sensor hub 511 receives the start to read message MSG (516), the sensor hub 511 makes the sensed values as a previously agreed packet and transmits the packet to the SSP manager 512 (517), The sensed values transmitted froth the sensor hub 511 to the SSP manager 512 may be.referred to as an electrical signal, [154] The SSP manager 5.12 detects motion information from information stored in the storage 102 by using the sensed values received from (he sensor hub 511 in the standby mode of the device 1.00 as described -with refe'ettce to FIG. 1 above. The SSP manager 5 .12 may detect information regarding a preset function of the device 100 based on the detected motion information and may control the function of the device 100 based on the detected preset function information.
[155] The SSP manager 512 detects the motion information from the information stored in the storage· 102 bv using the sensed values received from the sensor hub 51.1, as described in FIG. L and checks the operation mode of the de vice 1.00 as describe in FIG. 1, The SSP manager 512 may detect the information regarding the preset function 'from the storage 102 by using the cheeked operation mode and the detected motion information and may control the function of the device '100 based on the detected preset function information.
[156] The information Input/output unit 104 may be in a black screen in the standby mode of the device 100 as described above, a state in which no power is eohsumcd, a. deactivation state of a function related to the touch screen,..and a deactivation, state of a display function .related to the touch screen but ts not limited thereto.
[ 157] RIG. 6A is a flowchart of a method of performing a iundtion of a device, according to an exemplary· embodiment. FIG: 6A shows a case where a preset function is performed according to motion information of the device 100 and an operation mode of the device 100. The flowchart of FIG. 6 A may be performed by the processor 103 of the device 100.
[158] lit operation S601, the processor 103 receives information regarding a movement of the device 100. The information regarding the movement of the device 100 may he received from sensors included in the sensor 101 of FIG. 1 based on the SSP as-described'with reference to FIG. 5.
[159] The processor 103 detects the preset motion information based on the information regarding the movement of the device 100 (operation $6()2) ·, When the motion information of the device 100'js detected, the processor .103 detects information regarding the operation mode of the device 100 (operation S603), The detecting of the information regarding the operation mode of the device 100 may be referred, to as checking of the operation mode of the device 100.
[160] When the device 100 is in the active mode, the ihformation regarding the operation mode of the device .100 may include information regarding a current state of the device 100. For example, when an application is executed by the device 100, the information regarding the operation mode of the device 100 may include information regarding the application that is currently being executed by the device 100 but is not limited thereto. The detecting of the operation mode of the device 100 in '.operation S603 may be performed as described with respect to the processor 103 of FIG, 1.
[161 ] In operation S604, the processor 103 performs the preset function based on the information. regarding the operation mode of the device 100 and the motion, information of the device 100, The preset function may be detected from the storage: 102 as described with reference to FIGS, 2 and 4A through 4J, [162] FIG. 6B is a flowchart of a method of performing a f unction of a device, according to another exemplary embodiment, FIG, 6B shows a ease where the device 100 is in the standbv mode. The flowchart of FIG. 6B imv he Derformed by the nrocessor 103 of t he devi ce 100.
[ 163] Referring to FIG, SB.,. when the operation mode of the device 100 is the standby mode, the processor 103 may receive information regardi'fig.a movement of the device 100 torn the sensor unit 101, In this regard, the processor 103 may be a low power processor 510 of FIG. 5. Thus, the processor 103 may receiv e the information regarding the movement, of the. device 100 from the sensor 101 by using a SSP based, data communication protocol [164] In operation soft's, hi the standby mode of the device 100,. the- processor 103 receives the information regarding the movement of the device 100 from, the sensor 101 in operation S606. The processor 1()3 detects motion.information from the storage 102 by using the received infomiation regarding the movement {operation S607), When the motion infonnation is detected, the processor 103 detects at least one piece of function information corresponding to the detected motion information in operation S608.
[ 16S] The detecting of the motion information and the at least one piece of function in formation according to storage structures of the motion information and the at least one piece of function information that are stored in the storage 102 may be referred to as detecting of the at least one piece of function information, For example, when the processor 103 detects the at least one piece of function information from the storage 102 by using the information regarding the movement received from the sensor unit 101, the detecting of the motion information and the at least one piece of function information may be arfefred to as the detecting of the at least one piece of function .information, [166] The processor 103 controls the device .100 to perform a function based on the at least one piece of funcl.ion information received from the storage 102 in operation S609.
The flowchart of FIG, 6B may be performed as described with reference to FIGS, 4A through 4E and 4J, In operation S609, the processor 103. may; display a gateway screen as shown in FIGS, 17 and ISA through 18F that will be described later before the function is performed, 1167] FIG, 7 is a flowchart of a process that may be performed in operation B604 of FIG, 6A or operation S6Q9 of FIG, 6B, according to an exemplary embodiment, 068] FIG. 7 relates to the process of perfomiing a preset function of the device 100 according to a result of determining whether .a user looks at the device: 100, 0 69 j Thai is, in operation S701, the processor 103 determines whether the user looks at the device 100 before performing the preset function. Whether the user looks at the device 100 may be determined according to whether a user' luce is included in an image obtained by using a camera included in the device 1.00, Alternatively , whether the user looks at the device 100 may be detemrioed according to whether the userfs face included in the obtained imase is oriented toward the device; 100 but is .not limited thereto.
[170] The processor 103 may determine whether the user’s face is included in the obtained image by using a'face region extraction technology. The processor 103 may determine whether the user’s face included in the.obtained image is oriented toward the device 100'by ustihg a.feature value detection method. The feature value detection method detects feature values such as a distance between the eyes, a noise width, a height and shape of a cheekbone, a proportion of a Sorehead (an area based on a breadth and a height of forehead) on a face, etc. The processor 103 may estimate an orientation direction of the user’s face included hi the obtained image by using the detected feature value and detemiine whether the user looks at the device 100.
[171] instead of the above-described user’s face recognition method, it may be determined whether the user looks at the device 10Q by detecting the user’s eyes from the obtained image and estimating the eyes’ movements.
[172] Asa result of the determining in operation-$701, if it is determined, that the. user looks at the device 100, the processor 103'controls the device 100 to perform a function based on information regarding the preset function (operation S702). 1173] As a result of the determini ng in operation S702, if it determined that the user does not look at the device I0Q, the processor 103 controls the device.Ϊ00. not to perform the function based on the information regarding the preset function (operation S703), [174] To determine whether the user looks at the device 100 by using the face region extraction, the feature value detection, or the eyes movement estimation, as described above, the storage 102 may store at least one related application program and provide the processor 103 with the related application pfograrn according to a request of the processor 103. The processor 103 may execute the -related application program provided bv the storage 102 and determine whether the user looks at the device IOC) as described above..
[175] FIG. 8 shows screens activatinga preset function performed by the device 100 in operations: 8701 and S702 of FIG. 7, according to an exemplary embodiment. That is, when the device 100 is in the standby mode and a screen 810 is in a black screen state as shown in FIG, 8, when it is determined that the device 100 has rotated by 180° in a. clockwise direction by using a sensing value, the processor 103 activates a function of a front camera 821. The processor 103 temporarily changes an operation mode of the device .100 to the active mode so as to execute an application related to the front camera 821 as shown by a screen 8.20. In this regard, the processor 103 may output a black screen via the information inpui/ouiput unit 104 or the screen on which a camera mode is executed via the Information Input/output unit 104.
[176] The processor .103 may determine whether a user looks at the device 100 according to the above-described face recognition or eves estimation reeardinu an imase 822 obtained by using. die front.camera 821. if it is dete.rni.ined that. the user looks' at the device 100., the processor 103 performs .the preset function according to ..an operation mode of the device 100 and motion hiformation of the device 100 (screen 830).
[177] FIG, 9 is a flowchart of a. process that may he performed in operation S604 of FIG. 6A or Operation S609 of FIG. 6B, according to another exemplary embodiment. FIG. 9 relates to the process of performing a preset function in the device 100 when previously set. user gesture based information corresponding to a request, to perform the preset function is recei ved. i;.178] That is; in. operation S901.., the processor 103 determines whether the user gesture based information corresponding to the request to perform the preset function is received before performing the. preset function. 'The user gesture based information may he previously defined as a 2-iouch (for example. 2-toueh based on thumbs of both hands) in a position of horizontally holding the device 100 with both hands as shown in FIG. 10, However, the user gesture based information may be previously defined as 1 -touch (for example, 1-touch using a thumb of a band holding the device ID) in a position of horizontally holding the device 1,00 wi th one hand, 1179] The position of the de vice .100 is not limited to the above-described horizontally held position. For example, the position of the device 100.may include a vertically held position. The horizontally held position as shown in FIG. 10 may indicate that a bezel side Of the device 100 that has height information included in size information of the device 1.00 may be approximately perpendicular to the ground. The vertically held position may indicate that a bezel side of the· device 100 that has width information included in (he size information of the device "100 may he approximately perpendicular to the ground, [I SO] The above-described 2-toueh and 1-touch shay be recognized by using information regarding a previously stored and predicted touch region. The information regarding the previously stored and predicted touch region may he set considering an error range. The information regarding the previously stored and predicted touch region may be previously set according to the size information of the device 100 arid size inforniation of user’s hands. Thesize inforniation of the user's hands may be changed according to body size of the user. The size information of the user’s hands may be determined by using images of scanned user s hands. The size information of the device 10(1» may use information included in previously stored specification information of (he device 100, [181] The above-described information regarding (he previously stored and predicted touch region may be set 'through a process of registering a touch region carried, out by the user. For example, the user may create the same situation by using the device 100 and register a: region touched in the created situation as the predicted touch region. When the predicted touch reaion is registered., the user may set an available error ranee.
[182] The above-described user gesture bused inibmmti on may be stored to map information regarding the operation mode of the device 100 and the motion information of the device 100 that arc stored in the storage 102, 11 S3] The above-described user gesture based information stored in the storage 102 may include at least coordinate information of a touch surface. The above-described coordinate information of die touch surface may include a size of the dev ice 100, coordinate information of a tench surface, on which a 2-touch based on both 'thumbs is predicted to occur when the: user holds the device 100 with both hands, coordinate information of a touch surface on which a 1 -touch based on a right thumb Is predicted to occur when the user holds the device 100 with the right hand, and coordinate information of a touch surface on which a 1 -touch based on a left thumb Is predicted to occur when the user holds the device 100 with the left hand, but is not limited thereto. The coordinate information of the touch surface .may include coordinate information indicating a two-dimensional (2D) screen region. In operation $901, if the processor 103 detennines that a request to perform a preset function based on the ahove-descrihed user gesture is received, the processor 103 performs the above-described-preset function in operation $902, [184] In operation $903,: if the processor 103 determines that the ..request to perform the preset function based on the above-described user gesture is not received, the processor 103 does not perform, the above-described preset "function in operation S903, [1.85] FIG, 10 shows screens for explaining a preset function performed by the device 100 in .operations S9Q1 and S902 of FIG, 9, according to another exemplary embodiment. When (he operation mode of the device 100 i s in the standby mode in the case of a screen 1010 of FIG. 1.0, and the semen 1010 is in a black screen, the processor 103 recognizes motion information of the device 100 by using a sensing value indicating a. movement of the device 100 that moves in a vertical direction more, than a preset distance.
[186] After recognizing the motion information of the device 100, the processor 103 recognizes that a multi-touch with thumbs of both Hands holding the device 100 has .occurred .(operation: S ί 020,), the processor .103 performs the preset function·determined according to the operation mode of the device: 100 and the morion information of the device 1,00 (operation Si030). FIG. 10 shows a case where the preset function continuously executes app lications that have been executed just before the device 1.00 enters the standby mode, [ 187] FIG. 1.1. is a blpck diagram of a device 1100, according to another exemplary embodiment. Referring to FIG. .11, the device 1100 includes an information input unit 110.1, a sensor. .1102, a touch screen 1103, a camera 1104, an audio input unit 1105, an audio outnut unit 1 106. a stora.ee .1107, a wireless communication interface 1108. a wired cpntmunicatiaa'interface i i09. a processor 1 1:1(), and a power supply 1114. However, elements of the device 1100 are not limited to those shown in FIG. 11, That is. the device 1100 may include more or fewer constituent elements than those shown in FIG, 11. Also, the device .1100 may not include, for example, the wired communication interface 1109. (1,8¾] The device 1100 of FIG. 11 may perform -a preset function according to a movement thereof when the device is In.a standby mode based on a first processor 1111 irrespective of an operation of a second processor 1112. The first processor 1111 maybe the above-described low power processor, and the second processor 1112 shay be the above-described application processor but are not limited thereto. The relationship between the first processor 11 11 and the second processor 1112 will be described in more detail below when the corresponding elements are described.
[1:89] The standby mode of the device 1100 may include a low power consumption state described with reference to FIG. 1 that is a power consumption state of the sensor 1102, the first processor 11 1 1, and the storage 1107, The standby mode of the dev ice 1100 may include a state in which-power is not consumed by an dement of the device 1100 other than the sensor IT02, the first processor 1 11 I, and the storage 1107. The standby mode of the de vice 1100 may include..a deactivation state, of an application processor'(AP) 1113 of the second processor 1112, The standby mode of the device 1100 may include a black semen state of the touch screen 1103, The standby mode of the device 1 TOO may include at least one of a deactivation state of a function related to the touch screen i 103and a deactivation state of a touch sensing function of the touch screen 1103. The standby mode of the device 1100 is not limited thereto.
[190] The information input unit 1101 may be in a state in which power is not consumed in the standby mode of the device 1100, The information input unit 1101 may he in a deactivation state in the standby mode of the device 1100, The information input unit 1101 may input data, used to control an operation of the device 1100. For example, the information input unit i lO.1 may input a power on/off command of the device IKK). The infomation input unit 110.1 may include a key pad, a dome switch, a job wheel, a jog switch, a hardware button, a hot key. a touch panel, etc, but is not limited thereto, [191] The sensor 11:02 may be in an active state in the standby mode and an active mode of the device 1100. The sensor 1102 may be the, same as described with reference to the sensor 101 of FIG, 1 and output a signal of sensing a movement of the device 1.100.
The sensor 1.102 may be referred to as a. movement sensor for detecting the movement of the device 11.00, [ 192] The sensor 1.102 generates a signal for sensing a location of the de vice 11,00, whether there is any user contact, ait orientation of the device 1100, an acceleration or deceleration of the device 1100, etc. The sensor 1102 nmv include a uremimitv sensor and a motion sensor. The proximity sensor-is a sensor for detecting whether an object approaches a previously set detection surface or whether the object is present nearby by using a force of an electromagnetic field or an infrared ray without any actual physical touch.. Examples of the proximity sensor include a transparent photoelectric sensor, a direct reflective photoelectric sensor, a mirror reflective photoelectric sensor, a high frequency oscillation photoelectric sensor, a capacitive photoelectric sensor, a magnetic photoelectric Sensor, an infrared photoelectric sensor, etc.
[ 193] The sensor 1102 may output a signal for sensing, a sensor based user gesture. The sensor 1102 may include the first through nth sensors 501...1 - 50i...n like the sensor 101 of FIG. 5. The sensor 1102 may operate in both the standby mode of the device Τ10Θ and the active mode of the device 1100. 1194] The touch screen 1103 may be in a black screen state as described abo ve in the standby mode of the device 1100. The. touch screen 1103 may be in a state in which no power is consumed, in the standby mode of the device 1100. The touch screen 1103 may he in a deactivation state of the function related to the touch screen 1103 and/or a deactivation state of the touch sensing function of the touch screen 1103 in the standby mode of the device 1100. The touch screen 1103 may output a screen or information indicating a screen .lock- set state in the standby mode of the device 1100.The touch screen 1103 may be in the deactivation state in the standby mode of the device 1100. 1195] The touch screen i 103 may be a resistive (decompression) or capaciti ve touch screen but is not limited thereto, The touch semen 1103 may receive user input information that depends on the above-described user touch based gesture. The user input information that depends on the user touch based gesture may he defined as various combinations of a touch frequency, a touch pattern, a touch area, and a touch intensity, |d 96] The touch screen 1103 may had ude various Sensors for sensing a touch or proximity touch thereon. Sensors- included.in the touch screen 1103 may generate a signal by sensing the touch based user gestures or patterns. A proximity sensor for the touch screen 11.03 may be the same as the proximity sensor included in the sensor 1102.
[197] Art example of the sensor for sensing the touch of the touch screen 1.1.03 may include a tactile, sensor, The tactile, sensor may sense various types of information such as roughness of a touch surface, hardness of a touch object, a temperature at a touch point, etc.
[i 98] The touch Of the touch screen 1.1.03 may mean touching a touch panel by using a pointer, A proximity touch of the touch screen 1.103 occurs when the pointer does not actually touch the touch panel but approaches the touch panel within a preset distance. Examples of the pointer may include a: stylus pen, or a user s finger, etc., but are not limited thereto, ! 199] The touch screen 1103 disoiavs information outout bv the device 1100, For examole. the touch screen 1.103 may display a screen responding to user gestures or touch patterns .sensed through sensors included in. the touch screen 1103, The touch .screen 1103 may display a screen responding to control data or user input information input through the user input-unit 1101, The touch screen 1103 may display a screen responding to a signal sensed through the sensor 11.02. The touch screen 1103 may display at least one of the -above-described, screens as shown in FIGS. 4A through 41, [200] The touch screen 1103 may be referred to as an input and output apparatus. A screen displayed on the touch screen 1103 i ncludes a .user .interface (LJ1) screen or a graphical user interface (GUI) screen.
[201 ] The touch screen 1103 may include a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT-LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, or an active, matrix OLED (AMOLED), but is not limited thereto. The touch screen 1103 may be referred to as a display . The device 1100 may include two or more touch screens 1103. When the device 1100 includes two or more touch screens 1.103. the touch screen 1103 may be configured as a dual touch mode. The dual touch mode may refer to a front touch mode of the device 1100 and a back touch mode of the device 1100 but is not limited thereto.
[202] The camera 1104 processes an image frame such as a still image or a moving image obtained by an Image sensor (or a photo sensor)in a video call: mode or a photographing mode. The image frame processed by the camera 1104 may be displayed on the touch screen 1103, The image frame processed by the camera 1104 may be stored In the storage 1.107 or transmitted to the outside through the wireless communication interface 11 OS or the wired communication interface 1109, [203] The camera 1104 may bein a state in which no power is consumed in the standby mode of the device 111)0. The camera 1104 may be in a deactivation state in the standby-mode of the device 11QQ> The camera 1104 may include two or more cameras according to the configuration of the device 1100. That is, the de vice 1100 may include a front camera and a rear camera of the device 1100. The front camera may operate so as to recognize a user’s face or obtain an image for estimating movements of user’s eyes .as shown m FIG. S in the standby mode of the device 1100. The estimating of the movements of user’s eyes may be referred to as tracking of the movements of user' s eyes. The camera 1104 may be used as an input apparatus for recognizing a-user space gesture, [204] The audio input unit 1105 may be a state in which no power -is consumed in the standby mode of the device i 100."The audio input unit i 105 may be a deactivation state in the standby mode of the device 1100. The audio input unit 1105 may receive an input of an ex ternal acoustic signal in a call mode, a recording mode, or a voice recognition mode, convert the acoustic signal to electrical voice data, and. transmit the electrical voice data to the processor 1110, The audio input unit 11()5 may be, for example, a microphone. The audio input unit 1105 may include a function based on diverse noise removal algorithms for removing noise generated during a process for receiving the external acoustic signal.
[205 ] The audio input unit 1105 may he activated if the recording icon of FIG. 4B is selected. The external acoustic signal input through the audio input unit .1105 may be stored in the storage 1107 through the processor 11 JO, The external acoustic signal input through the audio input unit .1.1.05 may be transmitted to the outside via the processor 1110 and the wireless communication interface 1108. The external acoustic signal input through the audio input unit 1.105 may he transmitted to the outside via the processor 1110 and the wired communication interface 1109.
[206] The audio output unit .1106 may he a state in which no power is consumed in the standby mode of the dev ice 1100. The. audio output unit 1106 may he a deactivation, state in the standby mode of the device 1100. The audio output unit 1106 outputs the acoustic signal or an audio signal that is received from the outside or read from the storage 11.07 in the call mode or an..audio, reproduction mode. The audio output unit .1106 may be a speaker. If an audio signal, is included in content when the content is te-piOduced, the audio output unit 1106 outputs the audio signal included in the reproduced content, The audio input unit 1105. and the audio output unit 1106 may be integrally formed within a head set.
[207] The storage 1107 may operate in the standby mode and the active mode of the device 1100. The storage 1107 may be in an activation state in the standby mode and the active* mode of the device 1100, The storage 1107 may store at least one program and/ or a command set and resource that are configured to be executed in the processor 1110 that will be described later.
[ 208] The at least one program may include at least one program for executing--a method of performing a function of the device Γ100 according to an exemplary embodiment The at least one program may Include an operating system: program of the device .1100, an application program related to diverse functions (or services) pe.rfo.nned by the device 1100, and a program for driving hardware components included in the device 1100, and an application program for controlling at least one external device of the device 1,100 but is not limited thereto, [209] The external device may include an accessory of the device 1100, The accessory is referred to as a device'of which function is controlled by the device 1100 since an application program related to the accessory is performed by the device TUX) but is not limited thereto, [210] The storage 1:107 may store at least one program capable of determining whether a value sensed by the sensor 1102 cortestxxuds to «reset motion information of the device 1100 and data related to the at least one program, [211] The first processor 1111 may load the at least one program stored in the storage 1107. execute the loaded program, and determine whether the sensing value corresponds to the preset motion information of the device .1100. That is. when the program is executed, if the first processor 1 1 11 receives the sensing value from the sensor 1102, the first processor 1111 may detect the preset motion information corresponding to a sensin g value received from the storage 1107 by using the received sensing value, ['212] The at least one program used to determine whether the sensing value corresponds to the preset motion information of the device 1 KM) may he previously stored in the first processor 1111. The first processor 1 111 may include a memory such as random access memory (RAM) to store the at least one program.
[213] The resource stored in the storage 1107 may include mapping information between the sensing value, the preset motion information of the device 1100, and preset function information of the device 1100 as described with reference to FIG, 2 above. The resource stored in the storage 1107 .may include information regarding the device 1.:1:00, iofamration necessary for operating the application program set in the device 1100, and-information necessary for executing a program for driving the hardware components but is not limited thereto.
[214] The information regarding the device 1.1.00 may include user information of the device 1100 but is not limited thereto. The storage 1107 may store the information as described with reference to FIGS 7 and 9 above, [215] The storage 1:1,0.7 may include at least one type of storage medium,, such as a flash memory type, a. hard disk type, a .multimedia card micro type, a card type memory (for example, SD, XD memory, etc,), read only memory (ROM), electronically erasable programmable ROM (K.EFROM), programmable ROM (PROM) magnetic memory, and an. optical disk but is not limited thereto.
[21..6] The at least one program and/or the eonimand set. that are stored in the storage 1107 may be· classified as a plurality of modules according to functions.
[217] FIG. 12 shows an example of programs and/or command sets that are stored in the storage 1107. 'Referring "to PIG, 12, the storage 1107 includes an operating system 120.1, a wireless communication module 1202, a wired communieaiion module 1203ya graphics Module 1204, a global positioning system (GPS) module 1.205, a III module 1206, a. sensing module: 1.207, a contact and motion module 1.208., a: power module 1209, and an application database (DB) module 1210 hut K not limited thereto.
[218] The application DB module 1210 may include a device function performing module 1211, a camera module 1212, a voice recording module 1213, a web browsing module 1214, and a aueue m&amp;Maement module 1215 but is not limited thereto* -For example; the- application DB .module .1210 may further include-diverse application modules such as.an e-mail module,, a social networking service (SNS) module, a - video 'conference module, an image management module, a browsing module, a calendar module, a widget module, a search, module, and a. word processing module, [219] The operating system 1201 may control and manage a general funetioiiof the device. 1100. The -operating system 1201 may include a software component for enabling communication between hardware and' software components included hi the device 1100. {220] The wireless communication.module 1.202 may enable communication with at least one external dev ice through the wireless communication interface, 1 11)8. The wireless communication module 1202 may include a software component for processing data received from and transmitted to the at least one external device through the wireless communication interface 1208. The wireless communication module 1202 may enable wireless communication with a server (not shown) or a relay (not shown ] through the wireless communication interface 1108, However, -a wireless communication object is not limited to those described above. { 221] The wired communication module 1203 may enable communication with the wired .communication interface 1109 configured as an element such as a universal serial bus (USB) port find at. least one external device (not shown),The wired communication module 1203 may include a software component for processing data recei ved front and transmitted to the at least one external device through the wired communication interface 1109, {222] The graphics module 1204 may include a software component for brightness adjustment and rendering of graphics displayed on the touch screen 1103 and a software component for providing a virtual keyboard (or a soft keyboard) for inputting text in the application module 12.10, [223] The GPS module 1205 may include a software component for determining a location of the device .1.1.00 and providing the determined location to an. application that provides a location based service. The ill module 1206 may Include a software component for providing a 01 necessary for an application that provides touch screen 1103 based Ul infoniiation, [224] The sensing .module 1207 may include a software component for determining a sensing value received from the sensor 1102 and providing the sensing value to a specific application included in the application DB module 1210 based on a result of determining. For example, if the sensing value received from the sensor i 1.02 is information. regarding a movement.of the .device 1,100,. the sensing module 1,207 transmits the received sensing value to die dev ice function performingmodule 121,1, 12251 The device function oetformine -module-1211 detects motion infotmaiion of the device 11.00 .corresponding to the received sensing value from the storage 1107. When the motion information of the device 1100 corresponding to the received sensing value is detected, the device fimetion performing module 1211 may check an operation mode of the device 1100 by using information stored in the storage 1107 or information stored ih a. flag register that is not shown and is included in the first processor 111.1. A time when the operation mode of the device 1100 is. checked is not limited to that described above. For example, the operation mode of the device 1 MX) may be checked before the sensing value Is received.
[226] The device function performing module .1211 may detect information regarding the checked operation mode and preset function information mapping the detected motion information.'-andperform' a fimetion corresponding to the detected preset function information.
[227 ] The device function performing module 1213 may operate according to the operation mode of the device TICK) without checking the operation mode of the device 1100.
[228] That, is, the device function perfonnmg module 121 i may operate, in a standby mode of the device 1.100 as described with, reference to FIG. 6B above. In more detail , the device fuheiion performing module 1.211 may recei ved the sensing value in the standby mode of the de vice 1100. The receiving of the sensing value in the standby mode of the device 1100 may 'be performed as described with reference to FIG. 5 above.
[229] When the sensing value is received in the standby mode of the de\ ice .1100, the device function perfomting module 1211 detects the motion information of the device .1100 from the storage 1107 by using the received sensing value. The device function performing module 121.1 may detect the preset function information mapping the detected motion infomiation by using the detected motion information of the device 1100 and perform the function corresponding to the detected preset function m-forniation.
[230] The device [suction performing module 1211 may detect the motion information and the preset function information of the device 1. 3.00 from the storage 1107 according to the received sensing value in an active mode of the device 1 i 00 and perform the function corresponding to the detected preset function information.
[231 ] The contact and motion module 1208 may include a software component for detecting a touch contact based on the touch screen 1103 and providing a result of tracking a movement of the device· 1100 based on the touch contact to a specific up-plication included in the application D3B module 1210. For example, the contact and motion module 1208 transmits information regarding the detected touch contact to the device function performing module 1211 if the touch contact based on the touch screen .1103 is detected as described with reference, to FIG, 10 above.
[232] The power module 1209 include» a software component ibr linking with the operating system 1201, controlling a power supply that supplies power to· hardware; components included in the device 11 GO, anti controlling a sleep mode with respect to power supplied to the touch screen 1103, [233] The storage 1.107 may not store the modules· included in the application DB module 1210 among the program and/or command set of FIG. 12 and may store only location information such as a. uniform resource locator (URL) of an application module· and: display information indicating the application module, [234] In this case, the processor 1.11.0 may be connected to an external device including sp-plication DB through the wireless communication interlace 1108 or the wired communication interface 1109 by using the locat ion inibrmation and use a corresponding program and/or a corresponding command set stored in the external device. In this •regard, the external device includes a cloud server or a device,including the application DB but is not limited thereto, [235] In addition, when a user selection signal based on information" regarding the application module displayed on the touch screen i 103 is received, the processor 1110 may use information stored in the external device through the wireless communication interlace 1108 or the wired; communication interf ace 1109 by using the location information of the application module selected by a user.
[ 230] The storage 1107 may store information stored in the storage 102 of FIG. 1, The storage 1107 may further store user schedule information and log information of the device 1100. The user schedule information and the.log information of the device 1100 that are stored in the storage 1107 may be provided to the first processor 1111 as context information of the device 1100, The first·processor 111.1 may request the context information: Of the dev ice I i 00 or the user schedule information and the log information of the device 1100 from the storage 1107.
[23:7] The wireless communication interface 1108 may he a state in which no power is consumed in the standby mode of the device 1100. The wireless eommunieation interface 1108 may be in a deactivation state in the standby mode of the device 1100. The wireless eommunieation interface 1108 may be controlled by the first processor 1111 and set in an active mode in the standby mode of the device T100.
[238 ] The wireless communication interface. 1108 may transmit and receive data to and from the external device over a wireless network including wifeless Internet:, -wireless intranet, a, wireless phone network, .a wireless -local area network (LAN), a Wi-Fi network, a. Wi-Fi direct (WFD) network, a 30 network, a 4G Long Term. Evolution (1-713) network, a Bluetooth:network, aa. infrared data association (MM) network, a RFID netw ork, a ultra wideband (UWB) netw ork, and a Zigbee network, [239 i The wireless .communication interface 1108 may include at least one of a 'broadcasting reception module, a mobile communication module, a wireless internet module, a. short di s tance communication module, mid a location information, module, but is not. limited thereto, [240] The wired communication interface 1109 may be a state In which no power is consumed in the standby mode of the device 1 TOO. The wired communication interface 1109 may be in a deacti vation state is the standby mode of the device 1100. The wired communication interface 1109 may transmit and receive data to and from the external device over a wired network such as wired Internet. The wired communication: interface 1109 may transmit and receive data to and from an external device (not shown) by using a plug and play interface such as a USB port (not shown).
[241] The power supply 1114 supplies power to a hardware component included In the device 1100. The power supply 1114 includes one or more power sources such as a battery and an alternating current (AC) power source. The device 1100 may not include the power supply 1114 but may inclade a connection unit (not shown) that, may be connected to an extermd power supply (not shown). The power supply 1114 may supply power-to the sensor 1.102, the first processor 1111, and the storage 1107 in. the standby mode of the device 1100. The power supply 1114 may not supply power to an element other than the sensor 1102, the first processor II11, and the storage 1107 in the standby mode of the device 1100'.
[242] The processor 1110 may be one or mare processors that control a general operation of the device 1100. The processor 11.10 may generally control the information input unit UOi, the sensor 1.102, the touch screen 1.103* the camera .1.1.04, the audio Input unit 1105, the audio output unit 1106, the storage 1107, the wireless communication interface 11 OS, the wired communication interface 1.109, and the power supply 1114 by using the operating system 1201. and the-modules 1202 through 1213 included in the storage 1.107, Thus, the processor 1110 may be a.controller,.a micrtjprctcessor, of a digital signal processor.
[243] The processor 111.0 may also provide a Ui based on the information input unit .1101, the sensor 1.102, the touch screen :1,103, the earners 1104, and the audio input unit .1105 by using the operating system 1:201 and the UI module 1206, [244] The processor 1110 may execute at least one program related to the method of performing the function of (he device 1100 according to an exemplary embodiment and perform a method as shown in a 'flowchart of FIG. 6A nr PIG. 6B or a flowchart of FIG. BAw 13B that will be described later.
[245 ] The processor 1110 may execute the program by reading the program from the storage 1107. The processor 1.11.0 may execute die program bydownloading the program from an extemal device connected through the wireless enmntunkation interface 1,108 or the wired communication interface ! 109. The external device may fee an application providing server or an application market server. The, external, device may include a cloud server or a communicable device near the device I KK) hut is not limited thereto. The processor 1110 may include an interface function unit between various hardware components included in the device 1.1.00 and the processor T1.10, [246] The processor 1110 includes the first processor 11 il and the second processor 1112. The first processor till may correspond to the low power processor 510of FIG, 5. and the second processor ί 1.1.2 may correspond to the application processor 520 of FIG, 5 hut are not limitexl thereto. The second processor 111.2 of FIG, 11 may include the AP .1.1.13 since an additional processor such as a eomnnin.iest.ion processor (CP) may he included in the second processor 1112, The CP is a processor for contra fling-a communication based operation. 1247] A standby mode of the second processor 11.12 may indicate that the device 1100 is in the standby mode. The standby mode of the second processor 1.112 may indicate that the AP 111.3 is in the standby mode, [248] The first processor 1111 may operate as described above in the standby mode of the device 11()0. When the AP 1113 of the second processor 11.12 needs to be awakened so as to perform a function based oh preset function information detected by the first processor 11.11.,. the first processor fill may transmit an active mode setting request signal to the AP 1113, The first processor 1111 may be configured as a MOU as described above, [249] The first processor 11II may'be connected to the wireless communication interlace 1108 a ml receive context information of the device 1100 such as .location information of the device 1100 and time information thereof from the outside. To this end, the first processor 1.1..1..1 may set the wireless communication interface 1108 that is set in the deactivation state to the active mode in the standby mode of the device 1100, The setting of the active mode of the wireless eommimieatio.fi interface 1108 may be temporarily performed, [ 250] FIGS. 13A and 13B are flowcharts of a method of performing a function of the device HOG, according to Other exemplary embodiments, based on relationships between the sensor 1102, the first processor J J IK and the second processor 1112 of FIG, 11,. The second processor 111.2 of FIGS. 13.4 and 138 may be referred to as the AP 11,13 of FIG. Π.
[251] in operation SI 301, the Sensor 1102 transmits a sensing value to the first processor 1,111, In operation §1302, the first processor 1.11.1 receives the sensing value. Operations SI3Q1 and SI 30.2 of FIG, 13A may be operations in which the first, processor 1111 continuously receives the sensing value from the sensor 1102 in a standby mode of the device 1100, 12521 in operation S1303. the first processor .1111 detects motion information of the device .1100 by using flie received sensing value.
[253] When the motion 'information of the· device 1100 is detected, the first processor 1311 checks whether the.operation mode of the device 1100 is in the standby mode (operation S1304), The checking of the operation mode of the device 1100 in operation S1304 may he performed by detecting .information regarding the operation mode stored in a storage place such as a flag register (not shown) included in the first processor 1111 or information regarding the operation mode stored in a preset region of the. storage 1107 as described with reference to FIGS, I and 2.above.
[ 254] The information regarding the operation mode stored in the flag register and the information regarding the operation mode, stored in the storage 1107 may indicate whether the device 1100 is id the Standby mode of in an active mode by using, for example, a value Wl” and “IT When the operation mode of the device 1100 is in the active mode, additional information indicating more detailed Information regarding the operation mode of the device TI0Q may be included, [235] The additional information may include, for example, information indicating that the device 1100 currently executes web browsing or Facebook activities. The additional ihfoimation may be stored in the preset region of the storage 1107. When the operation mode of the device 1100 is in the active mode, and additional information exists, the detecting of.' the more detailed information regarding the operation mode of the device 1100 by using the additional .informationmay be performed by the second processor I I12, Tie preset region of the storage .1107 is a region in which recorded data may be changed, and is accessible by both the first processor 1111 and the second .processor 1112, [256] If the operation mode of the de vice 1100 is not in the standby mode, the second processor 11:2 is in the active mode, lithe second processor 1112 is in the active mode and the detected preset function.information is executed by the second processor 1112, the first processor 1111 transmits the detected motion information to the second processor 1112 in operation. SI3Q5.
[257] The second processor 1112 detects the preset function information from the storage 1107 by using the. received motion information in operation 513Θ6.
[.258] The second processor 111.2 may detect the more detailed information regarding- the operation mode of the dev ice 1100 by using the addi tional information regarding the operation mode of the device T10Q stored in the storage 1107 as described above before the preset function information is detected.: The additional information may be stored "in a. temporal storage place included in the second processor 11.1.2, In a case that the additional infomalion is stored in the temporal storage place included in the second puxessor i i 12. when the second processor 1112 receives the motion information from the ilrat oroccssor 11II, the second nrocessor 1112 mav detect the more detailed information regarding the operation mode of the device 1.1 GO hy using the additional kfonmtion stored in die temporal storage place, The temporal storage place included in the second processor 1112 may be configured as storage medium such as RAM.
[259] The second processor 1112 determines Whether a subject that performs a preset; function based os the detected preset function information is the second processor 111.2· in operation's1:307,. The determining may be performed hy using metadata for each function hut. is not limited thereto. For example, when a power level (or a.power consumption level) necessary for performing a preset function included in metadata of a preset function is higher than a preset reference value, the second processor 1.112 may determine that the subject that performs the preset function: is the second processor 1112, information regarding the preset reference value may be .determined according to a level of power consumed by the device 11.00 when the. first processor 1111 only operates. The metadata for each function may be stored in the storage 1107.
[260] The second processor 111:2 may determine the subject, that performs the preset function by using information regarding the subject that performs.the preset function, stored in the storage 1107. That Is, the second processor 1,112 may determined the subject that performs the preset function by using information (information indicating the first processor 1111 and information indicating the second processor 1112) regarding the subject mapping the preset function information stored in the storage 1107.
[261] When, it is determined that the subject that performs the preset function is the second processor JT12, the second processor 1112 performs the preset function in operation S i 208.
[262] When it is determined that the subject that perfornis the preset function is not the second processor 1.1.12· but the first processor 1111, the second processor 1112 requests the first processor 1111 to perform the preset function in operation S1309 and is changed to the standby mode In operation S I 310, Accordingly, the first processor 1111.. performs the preset function in operation S1311, li the second processor 1112 is changed front the active mode : to the standby mode, a power consumption state of the device 1100 may be changed to the above-described low power consumption state such as the standby mode of the device 1100. That Is, the power consumption state of the device. 1100 may be based on. the sensor 1.102, the first processor .1 Til, and the storage 1107.
[263] If it Is deteimined that the operation mode of the device 1100 is In the standby mode in operation S I 304, the method proceeds to operation ,S 1312.
[264] The first processor 1111 detects the preset function information from the slot age 1107 fey using'the detected motion inforoiation in operation SI 312. When the preset function informal! on is detected, the first processor till determines that the subject that performs the preset, function is the first processor 1111 according to the detected: preset function information in operation $1313. The determining of the subject that performs the preset 'function may he performed in the same manner as described in relation to Operation $1307 above. That is. if the power level necessary for performing the preset function included in the metadata included in the preset function information is lower than the preset reference value, the subject, that performs the preset function may .be determined as the first processor 1.1.1.1, [265] A method of determining the subject that performs the preset function Is not limited to .that described above..-For example, the first processor I 111 may determine the subject that performs the preset function by using the infommlion regarding the subject mapping the preset function, information stored in the storage 1107 as described above.
[266] When, the subject .that performs the preset function is determined as the first processor 1111, the first processor 1111 performs the preset function while maintaining·the operation mode of the device 110 in the standby mode in operation SI 3.14, [267] When- it is determined that the subject that performs the preset function is not the first processor 11.11 in operation $ 1313, the first processor Till transmits an active mode setting request signal to the second processor 1112 in operation S1315, Accordingly, the second processor 1112 is changed from the standby mode to the active mode in operation S1316.
[268] When, the second processor 11.12 is changed, from the standby mode to the active mode, the second processor 1Π 2 notifies the first processor 1111 about such a change to the active mode in operation SI 31.7. Flag information indicating the operation mode of the device 1100 stored in the first processor 1111 or the storage 1107 is updated to indicate the active mode. The first processor I I11 transmits a preset function performing request signal to the second processor 1112 (operation $1318). The second processor 1112 performs the preset function in operation. $ 1319.
[269] FIG, 14 is a block diagram of a device 140Q, according to another exemplary embodiment. FIG. 14 shows an example of performing a func tion of the device 1400 based on information regarding a movement of the device 1400 and context Information regarding the device 1400. The function of the device 1400 may be performed as displayed on at least one of tile screens of FIGS, 4A through 41.
[270] .Referring' to FIG* 14, the device 1400 includes a sensor 1410, a context information: detector 1420, a storage 1430, an information input/output unit 1440, and a processor 1450 but is not limited thereto. That is, the device 1400· may include more or fewer constituent elements than those shown in FIG. 14 as described with reference to FIG.
L
[271:] For example, when file context information, regarding the device 1400 .is configured to be detected by using the processor 1450, the context information detector 1420 may not be included in the-device 1400. When the context information such as location 'information. of the device 1400 and time information is received front an external device, the device 1400 may include a context information receiving unit instead of the context information detector 1420. The context information receiving unit may be configured as a communicable element life the wireless communication interlace 1108 of FIG. 11 but i s not limited thereto. The external dev ice may include .a. GPS server, but is not limited thereto.
[272] The sensor 1410 senses, the movement of the device 1400 based on the abovedescribed SSP ofFIG. 5 and transmits a sensing value to the processor 1450 like the sensor 1Q1 of FIG. 1., The transmitted sensing value may be referred to as the .information regarding the movement of the device 1400. The sensor 1410 may operate in the standby mode and the active mode of the device 1400; [273] The context ihformation detector 1420 is configured to detect current time information, current location .information, of the device .1400, and an operation made of the device 1400 but is not limited thereto. That is. current context information of the device 1400 may be detected by further referring to schedule information stored in the storage 1430 and log information of the device 1400.
[274] The context information detector 1420 may also operate based on a seamless context detecting platform. When the Context information detector 1420 operates' based on the seamless context detecting platform, the context information detector 1420 and the processor 1450 may be connected, to transmit the context infortnation in a similar way to data commmiication between the sensor bub 511 and the SSP manager 512 of EIG. 5, [275 ] In this case, the context information detector 1420 may be configured to be controlled by a low power processor when the context, mformation such as time information is detected and by an application processor when the context information other than the time information is detected. To this end, the context information detector 1420 may include independent -elements according to detectable context information, For example, the context information detector 1420 may Independently include an element for detecting the time information and an element for detecting the location information, [27(5] When the context information detector 1420 includes, the independent elements as described above, in the standby mode of the device 1400, some elements included in the context mformation detector 1420 may be in an acti ve state, and the other elements included in the context information detector 1420 may be in a deactivation state. The active state of some elements included in the context information detector 1420 mav indicate-a.power consumption state. The deactivation state of the other dements included 'in-the context information detector 1420 may indicate a state in which no power is consumed. 1277] The above-described some elements included In the context information detector 1420 mo controlled by the low power processor, and may include, for example, an element for detecting the context information regarding the time information. - the above-described other elements included in the context information iteteetor 1420 are controlled by the application processor, and may include, for example, an element for detecting the location information. However, the elements included in the context information detector 1420 are not limited ta those described above, [278] The context information that may be detected by the context information detector 1420 may be detected as described below but is not limited thereto, [279] That is, when the device 1400 recognizes preset morion information, the context Information detector 1420 may detect whether the device 1400 is in die standby mode or the active mode. The context information detector 1420 may detect whether the device 1400 is indoors or outdoors. The detecting of whether the device 1400 is indoors or outdoors may he performed by using a ttiangulation method based on GPS receiving information or information received ..from a plurality of access points (APs), [280] When the device 1400 is indoors, the context information detector 1420 may detect i ndoor information (for example, information such, as-an office or a house) through communication w ith indoor APs. When the device 1400 is outdoors, the context information detector 1420 may detect place information (for example, information such as A train station or B theater) from the GPS receiving information or the information recei ved from the APs.
[281.] The context information detector 1420 may detect GPS based time information or current time Information by using a system clock signal inel uded in the device 1400, [282] The context information .detector 1420 may detect related schedule Information and/ or related log infommtian from schedule information and/or log information stored in the storage 1,430 by using the detected time information and the location information .of the device 1400, The context information detector 1420 may infer the context information by using the detected schedule information and/or log information.
[283] When the preset motion information of the device 1.400 is recognized, the context information, detector 1420 may detect context information indicating, that a user of the device 1400 is 'walking or running and then stops walking or rumiing, and at this time, the device 1400 is in the standby mode. To detect the context inforiitation, the context inlomiatlon detector 1420 may include a function of using information stored in the storage 1430 and/or information stored in the processor 1450 and a function of detecting a moving sneed of the device 1400, To Derform the function of detecting the moving speed of the device 14()0, the context information detector 1420 may be configured to previously store reference speed information necessary for' detecting the moving speed of the device 1400 or to use reference speed information stored in the storage 1430.
[284] When the preset motion information of the device .1400 is recognized, the context information detector 1420 may detect context information indicating that the user of the device 1400 holds the device 1400 in the B theater, the device 1400 is in the standby mode, and there is reservation information at a time close to a current time at the B theater by checking M least one of the schedule information, the time information, and the Jog information that are stored in the storage 1430 and/or the processor 1450. To this end, the context information detector 1420 may include the function of detecting the moving speed of the device 1400 as described above, a function of reading necessary information From the storage 1430 and/or die processor 1450, and a function of obtaining the location information of the device 1400 and the time information, [285] When the preset motion information of the device 1400 is recognized, the context infonnation detector 1420 may detect context information indicating that the user of the device 1400 holds the device 1.400 in the A train station, dial the device .1400 is in the standby mode, and that a train ticket for departing from the A train station is reserved fay checking at least one of the schedule information, the lime information, and the log information that are stored in the storage 1430 and/or the processor 1450. To this end, the context information detector 1420 may include the function of detecting the moving speed of the device 1400, the function of reading necessary information from the storage 1430 and/or the processor 1450, and the function of obtaining the location information of the dev ice 1.400 and the time information as described .above.
[286] When the preset motion information of the device 1400 is recognized, the context information detector 1420 may detect context information indicating that the user of the device 1400 holds the device 1400, that the device 1400 is in the active mode, and that the de vice 1.400 executes web browsing.. To This end, the contex t information detector 1420 may include the function of detecting the moving speed of the device 1400 and the function- of reading necessary information from the storage 1430 and/or the processor 1450, [287] When the preset motion information of the device 1.400 is recognized, the context informat iph detector .1420 may detect: nontext hifQh|taiioh indicating that the user of the device 1400 holds the device 1400 at exit 7 at Gangnam Subway Station, that the device 1400 is in the standby mode, and that the user has an appointment at a time close to a current time. To this end, the context information detector i420 may include the function of obtaining the location information of the device 1400'add the time .information, the function of .readmit necessary information (for examnle, the schedule in- formation) from tire storage 1430 and/or the processor 1450.
[288] The context information detector 1420 may be configured to detect only the time information and the location information as the context information. In this ease, the processor 1450 mas detect in more detail the current context information of the device 1400 by referring to information regarding the operation mode of the device 1400, the schedule information,· and-the log· information .that are stored in the storage 1430 based on the recei ved time information and location information.
[289] The storage 1430 may be configured like the storage 102 of FIG . ..1 and, may store .information and programs. The .information input/output unit 1440 may be Configured like the information input/output unit 104 of FIG. 1.
[290] When the pr< >cessor 1450 operates as the law po wer proces sor (nr an auxiliary processor) like the processor 103 of FIG·, .1, the standby mode of the device .1400 may include the power consumption state or the active state of the sensor 1.410, some or all elements included, in the context information detector 1420, die storage 1430, and the processor 1450 that-are included in the device 1400.
[291 ] When the processor .1450 operates as the low1 power processor, the standby mode of the device 1.400 may include a state in which no power is consumed by elements included in the device 1.400,· other than the sensor 1410, some or all elements included in the context information detector 1420, the storage 1430, and the processor· 1450 that are included in the device 1400.
[292] When the processor 1450 operates as the low power processor, the standby mode of the device; 1.400 may include at least one of a touch sensing function and a display function of a touch screen included in the information input/output unit 1440, and a screen lock setting state of the device 1400. The touch sensing function and the display function of the touch screen are as described with reference to the touch semen of FIG. 1, [293] The processor 1450 may include the low power processor and the application processor as described with reference to FIG. 1. When the processor .1450 includes application processor, the standby mode of the device 1400 may include the active stale of the low power processor .included. Sit the processor 1450 and a deactivation state of the application processor included in the processor 1450. When the processor .1450 includes the application processor, the standby mode of the device 1400 may include a power consumption state of the low power processor included in the processor 1450, The standby mode of the device: 1400 may include a state in which no power is consumed by the applicaiion processor included in the processor 1450.
[294] When the processor 1450 includes the low power processor and the application processor, the processor 1.450 may operate as shown in flowcharts' of'FIGS, 15,1.6A, 16B, .19 A, and I9B, An operation of the processor 1450 will now be described based an the flowcharts of FIGS. 15» 1.6'A, 16B, l9A,and I9B.
[295] FIG, 15 is a flowchart of a method of perforating a function of the device 1400* according to another exemplary embodiment. Referring to FIG, 151 in operation S i501, the processor 1450 receives a sensing value from the sensor 1410. The recei vin g Of the sensing value from the sensor 1410 may be based oh an SSF as described with reference to FIG. 5.
[296] The processor 1450 detects preset motion information from, the storage 1430 based on the recei ved sensing value In operation SI 502. An error range of the recei ved sensing value may be considered with respect to the preset motion information stored in the storage 1430. For example, when the preset motion information indicates a 180“ rotation, the received sensing value may be expressed as aft electrical signal corresponding to 18Ό°±α. in this ease, a may be ail integer greater than 0.
[297 ] When preset motion information is detected, the processor 1430 recei\ cs context in formation from the context information detector 1420 in operation S1503. The receiving of the context information '.from the. context information detector 1420 may he performed by transmitting a context information request signal from the processor 1450 to the context information detector 1420.
[29Sj The processor 1450 performs a function of the device 1400 based on the received contex t information and the preset motion information of the dev ice 1400 in operation Si304.
[299] When time information and location information are. received from the context information detector 1420. the processor 1450 may detect schedule inionnatioft, log informal ion,.'and aft Operation mode of the device 1400 that are stored in the s torage J 430 by using the received time information and location information and may detect current context information of the. device. 1400 by using the detected schedule Information, the log information and the operation mode of the. device 1400, in tibia ease, operation SI 503 may refer to a context infOnliation detection operation, and the context information used in operation S I 504 is the current context information related to the device '1400.
[300] The method of FIG. 15 may be .perforated when the device 1400 is in the standby mode or an acti ve mode. Thus, the function performed in operation SI 504 may differ according to the operation mode of the device 1400.
[301.] FIG. 16A is a flowchart of a method of performingla function of device 1400, according to another exemplary embodiment. The flowchart of FIG. 16A further includes a. function of causing the display of a gateway screen (often abbreviated to “gateway”) embedded in the device .1400 when the device 1400 is in a standby mode, in addition to the flowchart of FIG, 15, When a prase! function performed by the device 1400 includes a service., the eatewav mav be referred to as a service gateway. 1302-i The processor 1.450 receives..a sensing value from the sensor 1.410 in operation SI 601. The-received, sensing value -may be referred teas information regarding a movement of the device 1400, The processor 1450 detects preset motion information of the device .1400 by using the received sensing value in operation S .1.602, When context information is received from the context information detector 1.420 in operation S1603, the processor 1450 checks the operation mode of the device 1400. if the device 1400 is in the standby mode in operation S1604, the processor 1450 reads display information in respect of the gateway from the storage J 430 and control s to display a gateway screen on the.in.fomia.tkm i.nput/output unit 1.440 in operation S1605. The processor 1450 detects preset function information based on the preset motion information and the- context information and performs- the preset function based on the detected preset function information,-is operation S1606.
[303] If the. device .1400 is not in the standby mode in operation S I 604, the processor 1450 does not control to display the gateway screen on the.information inpnt/output unit 1440, detects the preset function information based on the context information and the motion information of the device 1400, and performs? the preset function based on the detected preset function information in operation $1607.
[ 304] FIG, 16B. is a flowchart of a method of performing a function of device 1400, according· to another exemplary embodiment, when the device 1400 is in a standby mode as shown in FIG. 6B.
[305] Referring to FIG. 16B, when the device .1400 is in the standby mode in Operation 51608, the processor 1450 receives a sensing value from the sensor 1410 in operation 51609. The received sensing value- may be referred to as information regarding a movement of the device 1400, [306] The processor 1450 detects preset motion information of the device 1400 by using the received sensing value in operation S I 610, When context information is received front the context, information detector 1420 in operation S I 611, the processor 1450 displays a gateway screen embedded in the device 1400 by using the received context infoftnation and the detected motion information in operation S i 61:2. The processor 1450 detects preset function -information based on the preset motion information and the context information and performs a preset function based on the detected preset function infortiiatlon .in.-operation· Si 613.
[307] FIG, 17 shows screens 1710 through 1730 for explaining agateway screen embedded in t he device. 1.400 when preset motion information of the device 1400. is. detec ted and an operation mode of the device 1400 is a standby mode, [308] That is, when the device 1400 is in. the standby mode and a black screen state like the screen 1710, If a mo vement of the device 1400 that rotates by 90° in a clockwise direction is detected, the device 1400 di-solars the uatewav screen like the screen 1720,
The gateway screen may be displayed for a very short period of time. For example, the gateway screen may be displayed tor about 5 seconds hut is not limited thereto. A time taken to display the gateway screen may be set when an environment of the device .1400 is set.
[309] As shown in FIG. 17, the gateway screen may be displayed by an auxiliary processor when the processor 1450 includes the auxiliary processor (for example, a low power processor) and a. main processor (for example, an application processor). Thus, when a preset function that needs to be performed is performed by the auxiliary processor, and the main processor is in the standby mode, the device 1400 may perform the preset function by using the auxiliary processor whi le maintaining the standby mode of the main processor as shown in the screen 1730, [310] The gateway screen may be provided in various forms as. shown in FIGS. ISA through 18F.
[311] That is, the gateway screen may include a language command inquiring a user about manufacturer identification information (for example, logo) of the device 1400 and a lock release as shown in FIG. .18 A.
[312] The gateway screen may include .manufacturer identification information of the device 1400 and information used to select a preset 'executable application as shown in FIG, 18B, FIG, 18B shows the information used to select the preset executable application as icons. However, the .information. used to select the preset executable application is not limited to the above-described icons. For example, the information used to select the preset, executable application may be provided in a text form, [313] When four icons are provided as shown in FIG. 18B, four applications correspond to information regarding· preset functions that may be performed according to motion information of the device 1400 and context information. Thins, a user may select at least one ol the (our executable applications by using the lour icons.
[314] The gateway screen may include manufacturer identification information of the device .1400 and information: used to allow a user to select whether to perform a preset function as shown in FIG, :1.817 HG, I8C shows a ease where the infomiation used to allow the user to select whether to perform the preset function is provided in an image form in a eontent/advetfisement region, [31.5] Information displayed through the content/adveiiisement region may be a size- rediteed image or a part of an 1 mage (for example, a thum.bnai.1 image or a key image or a representative image) indicating the preset function that may be performed but is not limited thereto. The user may select to perform the preset function based on a touch on the content/ad vertisemeiit region.. That is, the user may request to perform the preset function by touching the contenfoidvedisemeut region, The Information displayed through, the contenrfadvertiseme.nt region max corresoond to nreset.function information determined according to motion information and context information of the device 1400 and may be previously stored in the storage 1430, [316] The gateway screen of FIG. 18D includes manufacturer identification information of the device 1400, a. lock (or a screen lock setting state,) release message, and icons used to select at least one executable application. The 'gateway screen of FIG. 18E includes manufacturer identification information of the device i 400. a lock release message, and information based on a eontent/advertisement region that is information used to allow the user to select whether to perform a preset function. The gateway screen of FIG. 18F includes mamifeeturer identification inlbmiation of the device 1400, a lock release message, the information (the content/advertisement region) that may be selected by the user as to whether to perform a preset function, and the information (icons) used to select at least one executable appli eat ion.
[317] The gateway screens are not limited to those shown in FIGS, 18A through .18F. For example, the gateway screens may not include a message “lock release” shown in FIGS. ISA, 18D, i.8E, and 18F.
[318] The gateway screens of FIGS. ISA through 1.8F may be used with respect to the device 100 of FIG. 1 or the device 1100 of FIG. 1L In thi s case, the gateway screens of FIGS, ISA through 18F may be provided according to.an operation mode of a device and motion information of the device without taking into.consideration context information as described above.
[319] FIG, 19A. is a flowchart of a method of performing a function, of the device 1400, according to another exemplary' embodiment. The flowchart of FIG, 19A further includes a function of selecting whether to perform a function through a gateway screen,hi addition to the flowchart of FIG. 16A, Thus, operations SI901 through S19G4 of FIG, 19 A are respectively the. same as operations S1601 through S I 604, and thus further descriptions thereof .are omitted.
[320] If the device 1400 is in a standby mode in operation-81.904, the processor 1450 reads information regarding a gateway screen embedded in the storage 1403 and displays the gateway screen based on the information read from the storage .1403 in operation S1905, The displayed gateway screen may correspond to one of the screens of FIGS. 1SB through 18P.
[321 ] Thus, manufacturer 'identification· information and information used to select whether to perform, a function are output through the information input/output unit 1440. lit particular, when there are a plurality of preset funct ions that, may be performed, a plurality of pieces of information that may be selected as to whether to perform preset functions may he displayed like one of the screens of FIGS. 1 SB, 1.8D. and 18F. The infpimatibn used to select whether to perform the function corresponds to preset function information determined based on «reset motion mfomratioa of the device 1400* detected context information, and information regarding the operation mode of the device 1400, [322] In operation S1906* if a request to perforin a desired preset function that Is to be performed is-received, the--processor 1,450 performs the preset function that is requested to be performed in operation $1907. However, If the request Is not recei ved In operation S1906, the processor 1450 returns to an operation state before recognizing the motion information of the device 1400.
[323] When the device 1400 Is in the standby mode, if the request is not received for a preset period of time, the processor 1450 determines that no request has been made. The processor 1450 may manage the preset period of time, and the storage 1403 may store and manage the preset, period of time.
[324] In operation S I904, if the device 140Q is not in the standby mode (if the device 1400 is an active mode), the processor 1450 may output the information used to select whether to perform the function in operation S i909. In this regard, the information may be output. In a pop-up window but is not limited thereto. The information is used to select whether to perform the preset function determined according to the operation mode, the motion information, and context information of the device 1400.
[325] If the .request to perform the function- is. received based on the information displayed on the device 1400, the processor 1450 performs the function requested In operation S i907. If the request to perform the function is..not received based on the information displayed on the device 1400, the processor 1450 returns to the operation state before recognizing, the motion information of the device 1400.
[326] When the device 1400 is in the active mode, the processor 1450 may determine that the request to perform the function is not recei ved if another function menu Is requested or selected when the information used to select whether to perform the function is displayed as described above or the request to perform the function is not recei ved for the preset period, of time as described above.
[327] FIG. 19B is a flowchart of a method of performing a Function of the device 1400, according to another exemplar)·' embodiment when the device 1400 is in the standby mode. The flowchart- of .PIG. 19B further includes a function of selecting whether to perform, a function through a gateway screen in addition to the flowchart of FIG. 16B. Thus, operations S I 910 through S i 913 of FIG, 19B am respectively performed in a similar v a) to operations S I608 through S1611 of FIG. I6B, and operations S1914 through 1917 of FIG. 19B are respectively perfooaied in. a similar way--to. operations .SI905 through SI 908 of FIG, 19A.
[ 328] FI G . 20 shows screens lor requesting performing a preset function of the device 1400 by using a gateway screen 2020 including informatibn {lor example, icons) used to select at least one executable amaheation and. information (for exanmle, a content/ advertisement region) used to allow a user to select whether to perform a preset function as shown in FIG. IJF.
[329] That is, if the device 1400 is in a standby mode and a black screen state as shown in a screen 2010, when upside down motion information of the device 1400 and context .information of the device 1400 are detected, the gateway screen 2020 is displayed based on preset function intormation determined based on the motion information-of the device 1400 and the context information of the device 1400.
[330] The screen 2030 including train ticket information is displayed when the content/ advertisement region is selected on the gateway screen 2020. in this regard, apart Of an image of a train ticket displayed on the screen 2030, an image of a reduced train ticket, or a text form may be. displayed on the conteiit/advertisement region, [331] Operation.. SI504 of FIG- 15, operations S.1606· and-SI601 of FIG. I6A, operation S.1613 of FIG. 16B, operation S1907ofFlG. 1.9A, and operation S1917 of FIG. 19B may be modified to include the methods of FIGS. 7 and 9.
[332] FIG, 21 is a block diagram of a device 2i 00, according to another exemplary· embodiment. The de vice 2100 of FI G. 21 further includes a context information detector 2103 similar to the context information detector 1420 of the device 1400 of FIG. 14, in addition to the block diagram of FIG. 11., Thus, a processor 2111 may operate like the processor 1450 of FIG. 14, [333] The processor 2111 includes.'a first processor 2112 and a second processor 21,13 as shown in FIG. .11, The first processor 2112 may receive a sensing value from at sensor 2102 based on the SSP of FIG. 5, and may receive context information from the context information sensor 21.03 based on the seamless context detecting platform of FIG, 14.
[334] Configurations and Operations of an information input/output unit 210 L a touch screen 2104,. a. camera 2105, an audio input unit 210.6, an audio output unit 2107, a wireless communication interface 2109, a wired communication interface 2! 10, and a power supply 2115 of FIG. 21 are respectively similar to those of the information input/output unit 110L the touch screen 1103, the camera i 1:04, the audio Input unit 1105, the audio output unit j 106, thewireless communication interface I IQS, the wired communication- interface 1109, and the power supply 1144 of FIG, 11, [335 ] The storage 2108 of FIG. .2.1. has a similar configuration to that of a combination of the storage 1430 of FIG, 14 and the storage 1107 of FIG, 11, and stores information and at least one program that are stored in the storage 1430 and the. storage 1107, [336] A standby mode of the device 2100 may include a state as described with reference to FIGS. 1, I f, and 14. That is, the standby mode of the device 21.00 may include a power consumption stale of the sensor 2102, some elements of the context information sensor 2103, the first orocessor 2112, and. the slomne 2108, The staudbv mode of the device 2100 may include· a power consumption state of the sensor 2.1.02, the context information sensor 2103, the i'iret processor 2112, and the storage 2108, The standby mode of the device 2100 may include a state in which no power is consumed by elements included in the device 2100 other than the sensor 2102, some elements of the context information sensor 2103, the first processor 2112, and the storage 2108. The standby mode of the device 21D0 may include a state in which no power is consumed, by elements included in the device 2100 other than the sensor 2102, the context information sensor 2103, the first processor 2112, and the storage 2108.
[337] The standby mode of the device 2100 may further include at least one of ah inacti ve state of a function related to the touch screen 2.104 and a screen lock set state of the device 2100 as described with reference, to FID, 11.
[338] The external, device control methods according to exemplary embodiments may also he embodied as hardware, software or a combination of hardware and software, including as computer readable codes on a computer readable recording medium. Any such software may he stored in the form of volatile or non-volatile storage. The computer readable medium may be any recording apparatus capable of storing data that is read by a computer system, eg,, a read-only memory (ROM), whether erasable or rewritable or not, or in the form of memory, for example, a random access memory (RAM), memory chips, device or integrated circuits or on an optically or magnetically readable medium, for example a compact disc (CD)-ROM, a magnetic disk or tape, a floppy disk, an optical data storage device, add so oh. 0 wi ll be appreciated that the storage devices and storage media are .embodiments of machine-readable storage that are suitable for storing a program or programs ei>mpiriiig;instrUctiom. that, 'when executed, implement embodiments of the present in vention.
[330] Accordingly, embodiments provide a program comprising code for implementing apparatus or a method as claimed in any one of the claims of this specification and a non-transitory machine-readable storage storing such a program. Still further, such programs may be conveyed .electronically via any medium, for example a communication signal carried over a wired of wireless connection and embodiments suitably encompass the same, [340] The computer readable medium may be distributed among computer systems that are interconnected through a network., and the exemplary embodiments may be stored and implemented as computer readable code in a distributed manner, [341] While exemplary embodiments have been particularly shown and described, it will be understood by those of ordi nary skill in the art that various changes in form and details may be made herein without departing from the scope of the in venti ve concept as defined by the following claims. 13421 Throuahout the deserintion and claims of this specification, the sinsukreneomoasses the plural unless the context otherwise requires. In particular, where lhe: indefinite article is used, the specification is to he understood as con tempi aiing plurality as well as singularity. unless the context requites otherwise, [343] Features, integers or characteristics described in conjunction, with a. particular aspect , embodiment or example of the present disclosure are to be understood to be applicable-to any other aspect, embodiment or example described, herein unless incompatible therewith.
[344] It will be also be appreciated that, throughout the description.and claims of this specification, language in the. general form of “X for Y” (where Y is some action, activity or step and X is some means for carrying out that action, activity or step) .encompasses, means X adapted or arranged specifically, but not exclusively, to do Y,

Claims (20)

  1. The claims defining the invention are as follows: [Claim 1] A device performing a function according to motion of the device, the device comprising: a first sensor configured to detect the motion of the device; and a processor configured to control the device to perform a first function based on the motion of the device while the device is in a first operation mode and to control the device to perform a second function based on the motion of the device while the device is in a second operation mode, wherein the first function is different from the second function and the motion of the device is common to both the first operation mode and the second operation mode. [Claim
  2. 2] The device of claim 1, wherein the processor comprises an application processor, and the first operation mode comprises a standby mode comprising an idle state of the application processor. [Claim
  3. 3] The device of claim 1 or claim 2, further comprising a touch screen, wherein the first operation mode comprises an inactive state of a function related to the touch screen. [Claim
  4. 4] The device of claim 3, wherein the function related to the touch screen comprises at least one of a touch sensing function of the touch screen and a display function of the touch screen. [Claim
  5. 5] The device of claim 1 or claim 2, further comprising a touch screen, wherein the first operation mode comprises a screen lock state of the touch screen. [Claim
  6. 6] The device of claim 1, further comprising a display, wherein the processor controls the device such that a gateway screen is displayed by the display before the first function is performed, wherein the gateway screen comprises notification information notifying that the first function is performed. [Claim
  7. 7] The device of claim 1, further comprising a display, wherein the processor controls the device such that a gateway screen is displayed by the display before the first function is performed, wherein the gateway screen comprises selection information to select an execution mode for each of a plurality of functions, when there are the plurality of functions corresponding to the motion of the device. [Claim
  8. 8] The device of claim 1, further comprising a second sensor configured to detect at least one piece of context information related to the device, wherein the processor determines the first function based on the at least one piece of context information and the motion of the device. [Claim
  9. 9] The device of claim 8, wherein the at least one piece of context information comprises at least one piece of current time information, position information of the device, schedule information stored in the device, and log information related to the device. [Claim
  10. 10] A method of performing a function of a device according to motion of the device, the method comprising: detecting motion of the device by using a first sensor of the device; controlling the device to perform a first function based on the motion of the device while the device is in a first operation mode by using a processor of the device; and controlling the device to perform a second function based on the motion of the device while the device is in a second operation mode by the processor, wherein the first function is different from the second function and the motion of the device is common to both the first operation mode and the second operation mode. [Claim
  11. 11] The method of claim 10, wherein the first operation mode comprises a standby mode comprising an idle state of an application processor of the device. [Claim
  12. 12] The method of claim 10, wherein the first operation mode comprises an inactive state of a function related to a touch screen of the device. [Claim
  13. 13] The method of claim 12, wherein the function related to the touch screen of the device comprises at least one of a touch sensing function of the touch screen and a display function of the touch screen. [Claim
  14. 14] The method of claim 10, wherein the first operation mode comprises a screen lock state of a touch screen of the device. [Claim
  15. 15] The method of claim 10, further comprising: controlling the device such that a gateway screen is displayed by a display of the device before the first function is performed, wherein the gateway screen comprises notification information notifying that the first function is performed. [Claim
  16. 16] The method of claim 10, further comprising: controlling the device such that a gateway screen is displayed by a display of the device before the first function is performed, wherein the gateway screen comprises selection information to select an execution mode for each of a plurality of functions, when there are the plurality of functions corresponding to the motion of the device. [Claim
  17. 17] The method of claim 16, further comprising: detecting at least one piece of context information related to the device by using a second sensor of the device; determining the first function based on the at least one piece of context information and the motion of device, wherein the at least one piece of context information comprises at least one piece of current time information, position information of the device, schedule information stored in the device, and log information related to the device. [Claim
  18. 18] A computer readable recording medium having recorded thereon a program which is executable by a computer to perform the method of claim 10. [Claim
  19. 19] The computer readable recording medium ol claim 18, wherein the tirst operation mode comprises a standby mode comprising an idle state of an application processor of the device. [Claim
  20. 20] The computer readable recording medium of claim 18, further comprising: detecting at least one piece of context information related to the device by using a second sensor of the device; determining the first function based on the at least one piece of context information and the motion of device, wherein the at least one piece of context information comprises at least one piece of current time information, position information of the device, schedule information stored in the device, and log information related to the device.
AU2016235039A 2013-01-29 2016-10-03 Method of performing function of device and device for performing the method Ceased AU2016235039B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2016235039A AU2016235039B2 (en) 2013-01-29 2016-10-03 Method of performing function of device and device for performing the method

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
KR10-2013-0010102 2013-01-29
KR20130010102 2013-01-29
KR1020130084384A KR102161050B1 (en) 2013-01-29 2013-07-17 Method for executing function of device, and device thereof
KR10-2013-0084384 2013-07-17
PCT/KR2014/000773 WO2014119894A1 (en) 2013-01-29 2014-01-28 Method of performing function of device and device for performing the method
AU2014213152A AU2014213152B2 (en) 2013-01-29 2014-01-28 Method of performing function of device and device for performing the method
AU2016235039A AU2016235039B2 (en) 2013-01-29 2016-10-03 Method of performing function of device and device for performing the method

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
AU2014213152A Division AU2014213152B2 (en) 2013-01-29 2014-01-28 Method of performing function of device and device for performing the method

Publications (2)

Publication Number Publication Date
AU2016235039A1 AU2016235039A1 (en) 2016-10-27
AU2016235039B2 true AU2016235039B2 (en) 2017-11-09

Family

ID=51744696

Family Applications (2)

Application Number Title Priority Date Filing Date
AU2014213152A Ceased AU2014213152B2 (en) 2013-01-29 2014-01-28 Method of performing function of device and device for performing the method
AU2016235039A Ceased AU2016235039B2 (en) 2013-01-29 2016-10-03 Method of performing function of device and device for performing the method

Family Applications Before (1)

Application Number Title Priority Date Filing Date
AU2014213152A Ceased AU2014213152B2 (en) 2013-01-29 2014-01-28 Method of performing function of device and device for performing the method

Country Status (4)

Country Link
KR (1) KR102161050B1 (en)
AU (2) AU2014213152B2 (en)
IN (1) IN2014CH00331A (en)
RU (2) RU2635246C2 (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110304648A1 (en) * 2010-06-15 2011-12-15 Lg Electronics Inc. Mobile terminal and method for operating the mobile terminal

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060139328A1 (en) * 2004-12-29 2006-06-29 Nina Maki Mobile communications terminal and a method therefor
US9086779B2 (en) * 2005-12-22 2015-07-21 Core Wireless Licensing S.A.R.L. Input device
WO2009016607A2 (en) * 2007-08-01 2009-02-05 Nokia Corporation Apparatus, methods, and computer program products providing context-dependent gesture recognition
KR101506488B1 (en) * 2008-04-04 2015-03-27 엘지전자 주식회사 Mobile terminal using proximity sensor and control method thereof
US7873849B2 (en) * 2009-09-02 2011-01-18 Apple Inc. Motion sensor data processing using various power management modes
KR102006740B1 (en) * 2010-10-20 2019-08-02 삼성전자 주식회사 Method and apparatus for displaying screen in mobile terminal
KR101855250B1 (en) * 2010-11-03 2018-05-09 삼성전자 주식회사 Touch Control Method And Portable Device supporting the same
US8994499B2 (en) * 2011-03-16 2015-03-31 Apple Inc. Locking and unlocking a mobile device using facial recognition

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110304648A1 (en) * 2010-06-15 2011-12-15 Lg Electronics Inc. Mobile terminal and method for operating the mobile terminal

Also Published As

Publication number Publication date
AU2014213152B2 (en) 2016-07-07
AU2016235039A1 (en) 2016-10-27
KR102161050B1 (en) 2020-10-05
RU2017136528A (en) 2019-02-08
IN2014CH00331A (en) 2015-04-03
KR20140096956A (en) 2014-08-06
RU2015136861A (en) 2017-03-03
AU2014213152A1 (en) 2015-07-02
RU2635246C2 (en) 2017-11-09
RU2017136528A3 (en) 2021-01-15
RU2744816C2 (en) 2021-03-16

Similar Documents

Publication Publication Date Title
US10852841B2 (en) Method of performing function of device and device for performing the method
US20200341578A1 (en) Electronic device
US9952711B2 (en) Electronic device and method of processing screen area of electronic device
US10299110B2 (en) Information transmission method and system, device, and computer readable recording medium thereof
EP3009816B1 (en) Method and apparatus for adjusting color
KR20180097384A (en) Electronic apparatus and controlling method thereof
KR102429740B1 (en) Method and apparatus for precessing touch event
US20170041272A1 (en) Electronic device and method for transmitting and receiving content
EP3023969A2 (en) Display and method and electronic device
US20170118402A1 (en) Electronic device and camera control method therefor
KR102328102B1 (en) Electronic apparatus and screen display method thereof
KR102267790B1 (en) Processing of media content based on device movement
WO2022152024A1 (en) Widget display method and electronic device
US11886673B2 (en) Trackpad on back portion of a device
KR102536148B1 (en) Method and apparatus for operation of an electronic device
EP3161611A1 (en) Controlling brightness of a remote display
US20180286089A1 (en) Electronic device and method for providing colorable content
CN109857317A (en) A kind of control method and terminal device of terminal device
US20160337601A1 (en) Electronic device for processing image and method for controlling the same
AU2016235039B2 (en) Method of performing function of device and device for performing the method
US11861801B2 (en) Enhanced reading with AR glasses
WO2023129380A1 (en) Enhanced reading with ar glasses

Legal Events

Date Code Title Description
FGA Letters patent sealed or granted (standard patent)
MK14 Patent ceased section 143(a) (annual fees not paid) or expired