WO2019045372A1

WO2019045372A1 - User terminal control system and method

Info

Publication number: WO2019045372A1
Application number: PCT/KR2018/009794
Authority: WO
Inventors: 최철영
Original assignee: (의) 삼성의료재단
Priority date: 2017-08-29
Filing date: 2018-08-24
Publication date: 2019-03-07
Also published as: KR101979868B1; KR20190023559A

Abstract

According to one embodiment of the present invention, provided is a terminal control system comprising: a motion determination unit for determining a motion of a user by using a sensor of a user terminal; a display determination unit for determining a display state of the user terminal; a gaze determination unit for determining a terminal observation state of the user on the basis of gaze information on the user; and a driving state change unit for determining whether a driving state of the user terminal is to be changed on the basis of the motion of the user, the display state of the user terminal, and the terminal observation state.

Description

User terminal control system and method

The present invention relates to a user terminal control system and method, and more particularly, to a terminal control system and method capable of restricting user terminal control based on a user's movement, a display state of a user terminal, .

As the use of portable user terminals, especially smart phones, becomes popular, problems arise. One of them is that there is a problem in the walking accident caused by the people walking on the road looking into the smartphone and it is a compound word of a smart phone and a zombie, There is a new word called somibie. The Szombie tribes are immersed in the use of smart phones and are not aware of their surroundings, so walking is dangerous.

A research institute estimated that about 10% of recent pedestrian accidents occurred while walking around looking at a smartphone without looking around, and six of them died each year. In order to prevent accidents caused by sommernies, signs are installed near pedestrian crossings, or when a person approached, a warning sound is generated. However, this does not have the effect of forcibly prohibiting the use of the user's smartphone. It is not an active solution to the problem.

An object of the present invention is to prevent an accident caused by the use of a terminal while walking by restricting the user's terminal control based on the movement of the user, the display state of the user terminal and the state of watching the terminal of the user.

According to an embodiment of the present invention, there is provided a mobile terminal comprising: a motion determiner for determining a motion of a user using a sensor of a user terminal; A display determination unit for determining a display state of the user terminal; A sight line determining unit for determining a state of watching the user's terminal based on the sight line information of the user; And a driving state changing unit for determining whether to change a driving state of the user terminal based on the movement of the user, the display state of the user terminal, and the terminal watching state; The terminal control system comprising:

In the present invention, the driving state change unit may change the driving state of the user terminal when the user's motion is walking, the current display state of the user terminal is active, and the current terminal watching state of the user is a binocular or monaural watching state, Can be changed.

In the present invention, the driving state change unit may change the driving state of the user terminal to any one of a display off state, an output state state, and an input / output state state.

In an exemplary embodiment of the present invention, an environment information acquisition unit acquires environment information of the user terminal; And the driving state change unit may determine whether to change the driving state by referring to the surrounding environment information of the user terminal.

In the present invention, the driving state change unit may determine that the driving state is not changed when determining that the position of the user terminal is indoor based on the surrounding environment information of the user terminal.

In the present invention, the motion determining unit may determine that the user is walking when the user of the user terminal determines that the user has performed a continuous step of a preset value or more within a preset time.

In the present invention, the display determination unit may determine that the display state is active when the display brightness value of the user terminal is equal to or greater than a predetermined value.

In the present invention, the display determining unit may determine that the display state is in an inactive state when a lock screen is displayed on the display even if the display brightness value is equal to or greater than a predetermined value.

In the present invention, the eye gaze determination unit may acquire gaze information by using the iris recognition sensor of the user terminal or by recognizing the iris from the image obtained from the image pickup apparatus of the user terminal.

In the present invention, the eye-gaze determining unit may recognize the iris of the user to obtain eye-gaze information, and determine whether the user's eye-watching state of the user is one of a binocular watching state, .

According to another embodiment of the present invention, there is provided a method for detecting a motion of a user using a sensor of a user terminal, A display determining step of determining a display state of the user terminal; A sight line determining step of determining a state of watching the user's terminal based on the sight line information of the user; And a driving state changing step of determining whether to change the driving state of the user terminal based on the movement of the user, the display state of the user terminal, and the terminal watching state; A terminal control method is provided.

In the present invention, the driving state changing step may include a step of changing the driving state of the user when the user's motion is walking, the current display state of the user terminal is active, and the current terminal watching state of the user is binocular or monaural, The driving state of the terminal can be changed.

In the present invention, the driving state changing step may change the driving state of the user terminal to any one of display off, output device off, and input / output device off.

In the present invention, an environment information obtaining step of obtaining environmental information of the user terminal; And the driving state changing step may determine whether to change the driving state by referring to the surrounding environment information of the user terminal.

In the present invention, the driving state changing step may determine that the driving state is not changed when the position of the user terminal is determined to be the room based on the surrounding environment information of the user terminal.

In the present invention, the motion determining step may determine that the user is walking when the user of the user terminal determines that the user has performed a continuous step of a preset value or more within a preset time.

In the present invention, the display determining step may determine that the display state is active when the display brightness value of the user terminal is equal to or greater than a predetermined value.

In the present invention, the display determination step may determine that the display state is in an inactive state when a lock screen is displayed on the display even if the display brightness value is equal to or greater than a predetermined value.

In the present invention, the eye-gaze determination step may acquire gaze information by using the iris recognition sensor of the user terminal or by recognizing the iris from the image obtained from the image pickup apparatus of the user terminal.

In the present invention, the eye-gaze determination step may include: acquiring gaze information by recognizing the iris of the user, and determining the gazing state of the user on the basis of the gaze information as one of a binocular viewing state, . &Lt; / RTI >

Additionally, a computer program stored on a computer-readable medium for performing the method according to any one of the present invention is provided.

According to the present invention, it is possible to prevent an accident caused by the use of the terminal while walking by restricting the user's terminal control when the condition is satisfied.

1 is a diagram illustrating an example of a network environment of a terminal control system according to an embodiment of the present invention.

2 is a block diagram illustrating an internal configuration of a user terminal and a server according to an exemplary embodiment of the present invention.

3 illustrates an internal structure of a processor according to an embodiment of the present invention.

4 is a time-sequentially flowchart illustrating a terminal control method according to an exemplary embodiment of the present invention.

The following detailed description of the invention refers to the accompanying drawings, which illustrate, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, the specific shapes, structures, and characteristics described herein may be implemented by changing from one embodiment to another without departing from the spirit and scope of the invention. It should also be understood that the location or arrangement of individual components within each embodiment may be varied without departing from the spirit and scope of the present invention. Therefore, the following detailed description is not to be taken in a limiting sense, and the scope of the present invention should be construed as encompassing the scope of the appended claims and all equivalents thereof. In the drawings, like reference numbers designate the same or similar components throughout the several views.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to facilitate a person skilled in the art to which the present invention pertains.

1 shows an example in which the terminal control system includes a plurality of

user terminals

110, 120, 130 and 140, a server 150 and a network 170. [ FIG. 1 is a diagram for explaining the invention. The number of user terminals and the number of servers are not limited to those shown in FIG.

The plurality of

user terminals

110, 120, 130, 140 may be a fixed terminal implemented as a computer device or a mobile terminal. A plurality of

user terminals

110, 120, 130 and 140 may be a smart phone, a mobile phone, a navigation device, a computer, a notebook, a digital broadcasting terminal, a PDA (personal digital assistant), a portable multimedia player ), And tablet PCs. For example, user terminal 1 110 may communicate with

other user terminals

120, 130, 140 and / or server 150 via network 170 using a wireless or wired communication scheme.

The communication method is not limited, and may include a communication method using a communication network (for example, a mobile communication network, a wired Internet, a wireless Internet, a broadcasting network) that the network 170 may include, as well as a short-range wireless communication between the devices. For example, the network 170 may be a personal area network (LAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN) , A network such as the Internet, and the like. The network 170 may also include any one or more of a network topology including a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, It is not limited.

The server 150 is a computer device or a plurality of computer devices that communicate with a plurality of

user terminals

110, 120, 130 and 140 via a network 170 to provide commands, codes, files, Can be implemented.

For example, the server 150 may provide a file for installation of an application to the user terminal 1 (110) connected through the network 170. In this case, the user terminal 1 (110) may install a terminal control application according to an embodiment of the present invention using a file provided from the server (150). The server 150 may be connected to the server 150 according to the control of an operating system (OS) included in the user terminal 1 110 and at least one program (for example, a browser or an installed application) Contents can be provided. For example, when the user terminal 1 110 transmits the terminal control information to the server 150 via the network 170 under the control of the application, the server 150 transmits a code corresponding to the terminal control information to the user terminal 1 (110), and the user terminal (110) can restrict the terminal function according to the control of the application. As another example, the server 150 may establish a communication session for data transmission and reception, and may route data transmission / reception between the plurality of

user terminals

110, 120, 130, 140 through a set communication session. In the following description, it is assumed that terminal control methods according to an embodiment of the present invention can be performed by both a user terminal and a server.

In FIG. 2, the internal configuration of the user terminal 1 110 as an example for one user terminal and the server 150 as an example for one server will be described. Other user terminals 120,130, 140 may also have the same or similar internal configuration.

The user terminal 1 110 and the server 150 may include

memories

211 and 221,

processors

212 and 222,

communication modules

213 and 223 and input /

output interfaces

214 and 224. The

memories

211 and 221 may be a computer-readable recording medium and may include a permanent mass storage device such as a random access memory (RAM), a read only memory (ROM), and a disk drive. In addition, the operating system and at least one program code (for example, a code for a browser installed in the user terminal 1 (110) or the above-described application) may be stored in the

memories

211 and 221. [ These software components may be loaded from a computer readable recording medium separate from the

memories

211 and 221 using a drive mechanism. Such a computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, and a memory card. In other embodiments, the software components may be loaded into

memory

211, 221 via

communication modules

213, 223 rather than a computer readable recording medium. For example, at least one program may be a program installed by a file distribution system (for example, the server 150 described above) that distributes installation files of developers or applications, May be loaded into the

memory

211, 221 based on the application described above.

Processors

212 and 222 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the

processors

212 and 222 by the

memories

211 and 221 or the

communication modules

213 and 223. For example, the

processor

212, 222 may be configured to execute a command received in accordance with a program code stored in a recording device, such as the

memory

211, 221.

The

communication modules

213 and 223 may provide a function for the user terminal 110 and the server 150 to communicate with each other through the network 170 and may communicate with other user terminals Or to communicate with another server (e.g., server 150). For example, when the processor 212 of the user terminal 1 110 receives a request (e.g., a streaming service request for content) generated in accordance with a program code stored in a recording device such as the memory 211, To the server 150 via the network 170 in accordance with the < / RTI > Conversely, control signals, commands, contents, files, and the like provided under the control of the processor 222 of the server 150 are transmitted to the communication module 223 of the user terminal 110 via the communication module 223 and the network 170 213 to the user terminal 1 (110). For example, the control signals and commands of the server 150 received through the communication module 213 may be transmitted to the processor 212 or the memory 211, and the contents or files may be transmitted to the user terminal 110 May be stored as a storage medium that may further include a < RTI ID = 0.0 >

The input /

output interfaces

214 and 224 may be means for interfacing with the input / output device 215. For example, the input device may include a device such as a keyboard or a mouse, and the output device may include a device such as a display for displaying a communication session of the application. As another example, the input / output interface 214 may be a means for interfacing with a device having integrated functions for input and output, such as a touch screen. The processor 212 of the user terminal 1 110 uses the data provided by the server 150 or the user terminal 2 120 in processing a command of the computer program loaded in the memory 211, A service screen or contents can be displayed on the display through the input / output interface 214. [

Also, in other embodiments, user terminal 1 110 and server 150 may include more components than the components of FIG. However, there is no need to clearly illustrate most prior art components. For example, the user terminal 1 110 may be implemented to include at least some of the input / output devices 215 described above, or may include other components such as a transceiver, Global Positioning System (GPS) module, camera, Elements.

The processor 212 may include instructions for controlling the user terminal. 3, a configuration for performing a terminal control function according to an embodiment of the present invention in the processor 212 includes a motion determiner 310, a display determiner 320, a gaze determiner 330, The environment information obtaining unit 340 and the drive state changing unit 350. [

First, the motion determiner 310 determines the movement of the user using the sensor of the user terminal. At this time, the sensor of the user terminal may be a GPS sensor, an acceleration sensor, or a gyroscope sensor in which the user senses a change in the position of the current user terminal. In particular, the motion determiner 310 may determine a motion of the user using the sensing value of the sensor of the user terminal. For example, the motion determining unit 310 can determine the current user's motion as being in the middle of walking, stopping, or moving using the transportation means. For example, when the moving speed of the user terminal is 0, it is determined that the mobile terminal is stationary.

According to an embodiment of the present invention, in addition to the determination based on the moving speed of the user terminal, the motion determination unit 310 may determine that the user is walking when it detects that the user has performed a continuous step equal to or greater than a preset value have. That is, it is possible to detect the user's step by using the sensor of the user terminal, and to determine that the user is walking when the number of consecutive steps detected is equal to or greater than a predetermined value. For example, it can be judged that a person is walking when a three or more consecutive steps are detected. In addition, the motion determiner 310 can determine that the user is walking when the user terminal detects that the current user's step is paused in a predetermined period of time. For example, even if the user pauses for a short time while walking along a series of steps, it is necessary to restrict the control of the user terminal in order to prevent an accident. Therefore, It can be judged that the person is walking.

Next, the display determination unit 320 determines the display state of the user terminal. At this time, the display state indicates the state of the display as a visual output device of the user terminal, and according to an embodiment of the present invention, the display state can be one of an active state and an inactive state. The active state of the display according to an exemplary embodiment of the present invention may mean that the brightness of the display of the user terminal is equal to or greater than a predetermined brightness. That is, in order to prevent the user from being caught on the display screen while the user is walking, the terminal control method according to an exemplary embodiment of the present invention determines whether the brightness value of the current display has a brightness value that the user can perceive Can be determined. The display determination unit 320 may determine that the display state is in an inactive state when the brightness value of the display is less than the reference value.

In an alternative embodiment, the display determination unit 320 may determine that the display is in an inactive state, even if the brightness value of the display is greater than or equal to the reference value, if a lock screen is currently displayed on the display. The lock screen is displayed on the display because it is a temporary action that does not disperse the user's attention such as checking only the time, and the risk of accident caused by the use of the smartphone while walking is small.

Next, the gaze determining unit 330 can determine the user's watching state of the user based on the gaze information of the user. In more detail, from the visual information of the user obtained by recognizing the iris of the user, the visual determination unit 330 can determine whether an extension of the visual direction exists in the display area of the terminal. At this time, the gaze determining unit 330 may determine whether the user is watching the terminal according to whether the extension of the user's gaze direction is toward the inside of the display of the terminal. In addition, the eye-gaze determining unit 330 can obtain eye-gaze information for each of the two irises of the user to determine the eye-watching state.

According to an embodiment of the present invention, the eye-gaze determining unit 330 can recognize the iris from the image acquired by the iris recognition sensor or the imaging device of the user terminal. That is, the gaze direction determining unit 330 can determine the gaze direction using the iris recognition sensor provided in the user terminal. However, even when the iris recognition sensor is not provided in the user terminal, The direction of the eye can be determined.

The gaze determining unit 330 according to an embodiment of the present invention can distinguish the current user's watching state of the user based on the gaze information of the user. In one example, the eye-gaze determining unit 330 determines whether the eye gazing direction of the user's eyes is toward the display of the terminal, the second gazing state when only the gaze direction of the eye gazes toward the display of the terminal, All of them can be judged to be in an unscheduled state when they are out of the display of the terminal.

Next, the environment information acquisition unit 340 acquires the environment information of the terminal. The surrounding environment of the terminal may be all information related to the surrounding environment such as the location of the terminal, the surrounding illuminance, and the current time. According to an embodiment of the present invention, the use of the terminal of the user is restricted while the use of the terminal is restricted by considering the surrounding environment information. For example, the environment information obtaining unit 340 may obtain information on whether the current location of the terminal is indoors or outdoors.

Next, the driving state changing unit 350 determines whether to change the driving state of the user terminal based on the user's motion, the display state of the user terminal, and the terminal watching state. At this time, the user's motion is obtained from the motion determining unit 310, the display state of the user terminal is obtained from the display determining unit 320, and the user's terminal watching state can be obtained from the gaze determining unit 330.

In more detail, the driving state changing unit 350 may restrict the user's terminal control by changing the driving state of the user terminal that satisfies all conditions of the user's motion, the display state of the user terminal, and the terminal watching state. At this time, the driving state changing unit 350 can change the driving state such that the degree of restriction of the terminal control is about the upper, middle, lower (lower). That is, the degree of restriction of the terminal control at the time of the drive state change depends on the degree of satisfaction of the motion of the user, which is a sufficient condition for the drive state change, the display state of the current user terminal and the terminal watching state, It can be different. For example, when the degree of restriction of the terminal control is an upper limit, a strict restriction on the terminal control may be applied rather than a case where the limit of the terminal is low.

According to an embodiment of the present invention, the driving state changing unit 350 may change the driving state of the user terminal to a display off state, an output apparatus off state, an input / output state, The device can be switched to one of the OFF states. At this time, the display off state is a state in which the display function is substantially stopped by setting the illuminance of the display below a predetermined value, and the output device off state is a state in which all the output devices existing in the user terminal such as display, audio, And the input / output device off state is a state in which the user can not control the user terminal using the input device by stopping the function of the input device of the user terminal such as the power button, the volume button, and the Bluetooth keyboard as well as the output device. That is, the degree of restriction of the control of the terminal device is high in the order of the display off state, the output device off state, and the input / output device off state. Generally, in the case of a touch screen display, since the input through the display is limited when the display is off, the display input function may be restricted in the display off state.

For example, the driving state changing unit 350 may be configured to change the driving state of the user terminal when the user's movement is consecutive one step or more, the display state is active, and the terminal watching state is the second viewing state Display-off state. At this time, the music or voice guidance through the speaker output (for example, the navigation function) can be normally operated. Meanwhile, in another embodiment, when the user's motion is detected in more than three consecutive steps, the display state is in the active state, and the terminal watch state is in the first watch state, the driving state of the user terminal is switched to the output device off state It is possible to stop the functions of all the output devices as well as the display by setting them. That is, as the user moves faster, the display state becomes active (or the brightness of the display becomes higher), the higher the terminal watching state, the higher the degree of restriction of the terminal control

The driving state changing unit 350 may change the driving state of the terminal by referring to the surrounding environment such as the position of the terminal, the ambient illuminance, and the current time acquired by the environment information obtaining unit 340. For example, when the current position of the terminal is indoor, the driving state changing unit 350 may not change the driving state even when the user changes the driving state because the risk is low even if the user uses the terminal. . In addition, it is possible to decide whether or not to change the driving state depending on whether it is a home or workplace even in the same room. That is, even in the case of a room, it is necessary to restrict the terminal control in the case of the workplace, so that the driving state of the terminal can be changed based on the same criterion as the outdoors at the position registered by the user or the system setting in the workplace.

In addition, the driving state changing unit 350 according to the embodiment of the present invention can change a condition for changing the driving state of the terminal according to the surrounding environment information. In another example, the driving state changing unit 350 may determine that the display is active even at low brightness by lowering the reference brightness value for determining the display state to be active when the peripheral illuminance of the terminal is low.

In addition, according to an embodiment of the present invention, the driving state change unit 350 may change the driving state of the terminal by referring to the accident state information generated by the other user. That is, the driving state changing unit 350 may change the driving state of the user based on the accident state information of other users (whether or not an accident has occurred, the type of an accident, an accident occurrence point, an accident occurrence time, (A combination of the user's motion, the display state of the terminal, and the watching state of the terminal) of the terminal user based on the condition and whether or not the driving state is changed corresponding thereto. At this time, the driving state change unit 350 can set the control restriction condition and the corresponding driving state change state based on the accident situation information of the terminal user, and can share the control restriction condition and the driving state change with other users can do. At this time, the other users sharing the control restriction condition and the corresponding driving status change may be other users of the user group having similar behavior patterns to the corresponding terminal users. The other users sharing the control restriction condition and the corresponding drive status change may be users located within a certain distance from the user physically. The degree of control of the same user group and whether or not the corresponding driving state is changed can be updated as the accident situation information accumulates. When the accident situation information generated by another user of the user group having a similar behavior pattern to the user is detected, the degree of control of the user and whether the driving state is changed can be changed by the accident situation information of the other user.

For example, when another user of a user group having a similar behavior pattern to the user experiences an accident due to the user not being able to hear the sound of the car while listening to the music while the driving state is in the display off state, State to an output device off state which is a restriction condition higher than the display-off state. When an accident occurs with a motorcycle while the driving state of the other user is behind the display while the driving state is in the display-off state, the driving state of the other user is controlled in the vicinity of the corresponding position, . When another user of the user group having a similar behavior pattern as the user operates the display while the driving state is stopped while the user is walking, control is performed so that the output device is turned off regardless of whether the user is walking or walking You can change the constraint.

On the other hand, the driving state changing unit 350 may output a notification message before changing the driving state. For example, when the driving state changing unit 350 determines to change the driving state of the terminal, the driving state changing unit 350 may output a notification message " the display is turned off because it is walking. &Quot;

Alternatively, the driving state changing unit 350 may maintain the driving state of the current user terminal if one of the motion of the user, the display state of the user terminal, and the terminal watching state is not satisfied. For example, even when the user's motion is walking and the display state is active, the current driving state can be maintained without changing the driving state of the user terminal when the terminal watching state is in an unexpected state. This is because the risk caused by the user using the terminal is small.

Each step of the terminal control method of FIG. 4 may be performed by a processor of the terminal control system according to an embodiment of the present invention.

Referring to FIG. 4, a terminal control method according to an embodiment of the present invention determines a user's movement using a sensor of a user terminal (S41).

Next, the display state of the user terminal is determined (S42).

Next, the user's terminal watching state is determined based on the user's sight line information (S43).

Next, the surrounding environment information of the user terminal is obtained (S44).

Next, it is determined whether to change the driving state of the user terminal based on the movement of the user, the display state of the current user terminal, and the terminal watching state (S45).

The specific acts described in the present invention are, by way of example, not intended to limit the scope of the invention in any way. For brevity of description, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of such systems may be omitted. Also, the connections or connecting members of the lines between the components shown in the figures are illustrative of functional connections and / or physical or circuit connections, which may be replaced or additionally provided by a variety of functional connections, physical Connection, or circuit connections. Also, unless explicitly mentioned, such as " essential ", " importantly ", etc., it may not be a necessary component for application of the present invention.

The use of the terms " above " and similar indication words in the specification of the present invention (particularly in the claims) may refer to both singular and plural. In addition, in the present invention, when a range is described, it includes the invention to which the individual values belonging to the above range are applied (unless there is contradiction thereto), and each individual value constituting the above range is described in the detailed description of the invention The same. Finally, the steps may be performed in any suitable order, unless explicitly stated or contrary to the description of the steps constituting the method according to the invention. The present invention is not necessarily limited to the order of description of the above steps. The use of all examples or exemplary language (e.g., etc.) in this invention is for the purpose of describing the present invention only in detail and is not to be limited by the scope of the claims, It is not. It will also be appreciated by those skilled in the art that various modifications, combinations, and alterations may be made depending on design criteria and factors within the scope of the appended claims or equivalents thereof.

The embodiments of the present invention described above can be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, and the like, alone or in combination. The program instructions recorded on the computer-readable recording medium may be those specifically designed and configured for the present invention or may be those known and used by those skilled in the computer software arts. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROM and DVD, magneto-optical media such as floptical disks, medium, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code, such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be modified into one or more software modules for performing the processing according to the present invention, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, Those skilled in the art will appreciate that various modifications and changes may be made thereto without departing from the scope of the present invention.

Accordingly, the spirit of the present invention should not be construed as being limited to the above-described embodiments, and all ranges that are equivalent to or equivalent to the claims of the present invention as well as the claims .

Claims

A motion determiner for determining a motion of a user using a sensor of a user terminal;

A display determination unit for determining a display state of the user terminal;

A sight line determining unit for determining a state of watching the user's terminal based on the sight line information of the user; And

A driving state changing unit for determining whether to change the driving state of the user terminal based on the movement of the user, the display state of the user terminal, and the terminal watching state;

Lt; / RTI >

Setting a control restriction condition and a corresponding drive state change on the basis of the accident state information of the user, sharing the control restriction condition and the drive state change with other users, and based on the control restriction condition of another user, Wherein the control condition setting unit sets a control restriction condition of the terminal and a drive status change corresponding to the control restriction condition.
The method according to claim 1,

The driving state changing unit may change the driving state of the user terminal when the user's motion is walking, the current display state of the user terminal is active, and the current terminal watching state of the user is binocular or mono viewing Terminal control system.
The method according to claim 1,

Wherein the driving state changing unit comprises:

And changes the driving state of the user terminal to any one of display off, output device off, and input / output device off.
The method according to claim 1,

An environment information acquiring unit acquiring environment information of the user terminal; , &Lt; / RTI >

Wherein the driving state changing unit determines whether to change the driving state by referring to the surrounding environment information of the user terminal.
5. The method of claim 4,

Wherein the driving state changing unit comprises:

And determines that the driving state is not changed when it determines that the location of the user terminal is indoor based on the environment information of the user terminal.
The method according to claim 1,

Wherein the motion determiner comprises:

And determines that the user is walking when it is determined that the user of the user terminal has made a continuous step of a predetermined value or more within a predetermined time.
The method according to claim 1,

The display determination unit may determine,

And determines that the display state is active when the display brightness value of the user terminal is equal to or greater than a predetermined value.
8. The method of claim 7,

The display determination unit may determine,

Wherein the display control unit determines that the display state is in an inactive state when a lock screen is displayed on the display even if the display brightness value is equal to or greater than a predetermined value.
The method according to claim 1,

The eye-

And acquires gaze information by using an iris recognition sensor of the user terminal or by recognizing an iris from an image obtained from an image capturing apparatus of the user terminal.
The method according to claim 1,

The eye-

Acquires gaze information by recognizing the iris of the user, and determines that the user's gazing state of the user is one of a binocular gaze state, a monocular gaze state, and an unexpected state based on the gaze information.
A motion determination step of determining a motion of a user using a sensor of a user terminal;

A display determining step of determining a display state of the user terminal;

A sight line determining step of determining a state of watching the user's terminal based on the sight line information of the user; And

A driving state changing step of determining whether to change the driving state of the user terminal based on the movement of the user, the display state of the user terminal, and the terminal watching state;

Lt; / RTI >

The driving state changing step

Setting a control restriction condition and a corresponding drive state change on the basis of the accident state information of the user, sharing the control restriction condition and the drive state change with other users, and based on the control restriction condition of another user, And setting whether to change the driving state corresponding to the control restriction condition.
12. The method of claim 11,

Wherein the driving state changing step includes:

Wherein the driving state of the user terminal is changed when the motion of the user is walking, the current display state of the user terminal is active, and the current terminal watching state of the user is binocular or monaural.
12. The method of claim 11,

Wherein the driving state changing step includes:

And changing the driving state of the user terminal to any one of display off, output device off, and input / output device off.
12. The method of claim 11,

Acquiring environment information of the user terminal; , &Lt; / RTI >

Wherein the driving state changing step determines whether to change the driving state by referring to the surrounding environment information of the user terminal.
15. The method of claim 14,

Wherein the driving state changing step includes:

And determines that the driving state is not changed when it determines that the location of the user terminal is indoor based on the environment information of the user terminal.
12. The method of claim 11,

Wherein,

When the user of the user terminal judges that the user has performed a continuous step of a preset value or more within a predetermined time, the user terminal is judging that the user is walking.
12. The method of claim 11,

The display determination step may include:

And determines that the display state is active when the display brightness value of the user terminal is equal to or greater than a preset value.
18. The method of claim 17,

The display determination step may include:

And determines that the display state is in an inactive state when a lock screen is displayed on the display even if the display brightness value is equal to or greater than a predetermined value.
12. The method of claim 11,

The eye-

And acquiring gaze information by using an iris recognition sensor of the user terminal or by recognizing an iris from an image obtained from an image capturing apparatus of the user terminal.
12. The method of claim 11,

The eye-

Acquiring gaze information by recognizing the iris of the user, and determining that the user's watching state of the user is one of a binocular viewing state, a monocular viewing state, and an unexpected state based on the gaze information.
20. A computer program stored on a computer-readable medium for carrying out the method according to any one of claims 11 to 20.