KR102365095B1 - A smart remote control that controls a device using a touch pattern and a control method of the smart remote control - Google Patents

Abstract

The present invention relates to a smart remote control that controls a device using a touch pattern, which is connected to different external devices according to input information of a function key, and is linked by drawing various patterns on a touch screen using a gesture mode. External devices can be controlled remotely.

Description

A smart remote control that controls a device using a touch pattern and a control method of the smart remote control

The present invention relates to a smart remote control for controlling a device using a touch pattern.

Conventionally, a remote control was assigned to each of external devices such as a TV, air conditioner, DVD player, and speaker, and the user remotely controlled the external device using each remote control.

Recently, as the types of external devices have been diversified and the IoT era has begun, in addition to the external devices, a light, a refrigerator, a security facility, etc. can be connected.

It is almost impossible to assign a remote control to each of these many external devices, and even if it is assigned, it will cause great inconvenience to the user.

In addition, there is a problem in that the remote control operation becomes difficult when the buttons required for each external device are recklessly integrated into one remote control in a situation where it is different.

The present invention for solving the above problems can provide a smart remote control for controlling a device using a touch pattern that allows different external devices to be connected according to input information of a function key.

In addition, according to the present invention, the touch screen is changed to a key input mode or a gesture mode according to input information of a function key, and the device is controlled using a touch pattern that can control an external device by drawing various patterns using the gesture mode. A smart remote control may be provided.

In addition, according to the present invention, it is possible to provide a smart remote control for controlling a device using a touch pattern that generates a control signal corresponding thereto based on attribute information of figures drawn on the touch screen and relative position information between figures. there is.

In addition, according to the present invention, when the figure drawn on the touch screen is a partition figure including a line or surface, the space on the touch screen is partitioned into a plurality of spaces according to the shape of the line or surface of the partition figure, and the partition figure is drawn It is possible to provide a smart remote control for controlling a device using a touch pattern that generates a control signal according to the position of a figure drawn before or after drawing.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

A smart remote control for controlling a device using a touch pattern according to an embodiment of the present invention for solving the above-described problems includes: a function key input unit including at least one function key; a touch screen receiving a user's touch input information, and capable of a key input mode or a gesture mode; a touch recognition unit that recognizes input information input by a touch or gesture on the touch screen, wherein the input information includes a figure drawn by being touched by a user; and a control unit that generates a control signal corresponding thereto based on attribute information including the shape and size of each figure recognized through the touch recognition unit, and relative position information between each figure; , at least one character enabling key input in the key input mode is engraved or attached, and the control unit changes a device to which the remote control is linked according to a user's operation of a function key, or sets the touch screen to a key input mode Alternatively, it is characterized in that it is changed to a gesture mode.

In addition, the method for controlling a smart remote control for controlling a device using a touch pattern according to an embodiment of the present invention for solving the above-described problems is a method performed by a smart remote control, and the control unit is configured to control a user's function key operation. Accordingly, changing the device to which the remote control is linked, and changing the touch screen to a key input mode or a gesture mode; recognizing a figure drawn by being touched on the touch screen by a touch recognition unit in a gesture mode of the touch screen; and generating, by the control unit, a control signal corresponding thereto, based on attribute information including the shape and size of each figure recognized through the touch recognition unit, relative position information between each figure, and input sequence information between the figures. , wherein the smart remote control includes a function key input unit including at least one function key, and the touch screen is engraved or attached with at least one character enabling key input in the key input mode. there is.

According to the present invention as described above, different external devices are connected according to the input information of the function key, and there is an effect that a single remote control can be linked with various external devices.

In addition, according to the present invention, the touch screen is changed to the key input mode or the gesture mode according to the input information of the function key, and the user can control the external device by drawing various patterns using the gesture mode, so the user can customize the pattern on the remote control. There is an effect that can be used.

In addition, the present invention can generate various control signals according to the shape and size of two or more figures drawn on the touch screen, and the relative positions between the figures.

In addition, according to the present invention, the smart remote control is connected to various locking devices, and there is an effect that security can be strengthened through various patterns rather than a consistent pattern form.

Effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a top view of a smart remote control for controlling a device using a touch pattern according to an embodiment of the present invention.
2 is a diagram illustrating an example in which a user inputs input information to a function key and a touch screen.
3 is a diagram illustrating that a keypad unit is further included in the remote control according to an embodiment of the present invention.
4 is a block diagram of a smart remote control for controlling a device using a touch pattern according to an embodiment of the present invention.
5 to 10 are diagrams illustrating that various figures are sequentially drawn on the touch screen according to an embodiment of the present invention.
11 is a diagram illustrating a case where a figure drawn on a touch screen corresponds to numeric information according to an embodiment of the present invention.
12 and 13 are diagrams illustrating recognition of user's fingerprint information in the process of drawing a figure on the touch screen according to an embodiment of the present invention.
14 is a diagram illustrating an example of a wireless communication unit transmitting a communication method by changing a communication method according to a device receiving a control signal according to an embodiment of the present invention.
15A is a diagram illustrating transmission of control signals to various external devices through a hub external device performing a sub role according to an embodiment of the present invention.
FIG. 15B is a diagram illustrating that FIG. 15A is actually applied.
16 is a diagram illustrating a flowchart of a method for controlling a touch interface according to an embodiment of the present invention.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the present embodiments allow the disclosure of the present invention to be complete, and those of ordinary skill in the art to which the present invention pertains. It is provided to fully understand the scope of the present invention to those skilled in the art, and the present invention is only defined by the scope of the claims.

The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other components in addition to the stated components. Like reference numerals refer to like elements throughout, and "and/or" includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various elements, these elements are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first component mentioned below may be the second component within the spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used herein will have the meaning commonly understood by those of ordinary skill in the art to which this invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless specifically defined explicitly.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a top view of a smart remote control for controlling a device using a touch pattern according to an embodiment of the present invention, FIG. 2 is a diagram illustrating that a user inputs input information to a function key and a touch screen, and FIG. 3 is a diagram illustrating that the remote controller according to an embodiment of the present invention further includes a keypad unit, and FIG. 4 is a block diagram of a smart remote control for controlling a device using a touch pattern according to an embodiment of the present invention.

However, in some embodiments, the server 100 may include fewer or more components than the components shown in FIG. 14 .

1 to 4 , the smart remote controller 10 for controlling a device using a touch pattern according to an embodiment of the present invention includes a function key input unit 11 , a touch screen 40 , and a touch recognition unit 120 . ), a control unit 130 , a lock release unit 140 , a wireless communication unit 150 , and a fingerprint recognition unit 160 .

1 is a top view of the smart remote control 10 . Referring to FIG. 1 , the function key input unit 11 and the touch screen 40 are formed on the top surface of the smart remote control 10 .

The function key input unit 11 includes at least one function key, and in the embodiment of the present invention includes a first function key 13 , a second function key 15 , and a third function key 17 .

The touch screen 40 receives the user's touch input information, a key input mode or a gesture mode is possible, and at least one character is engraved or attached.

The touch recognition unit 120 recognizes input information input by a touch or a gesture from a user on the touch screen 40 .

In this case, the input information includes one or more figures drawn by being touched by the user.

The controller 130 generates a corresponding control signal based on the attribute information including the shape and size of each figure recognized through the touch recognition unit 120 and the relative position information between the figures.

Also, the controller 130 may include input order information between each figure together with the above information and generate a control signal corresponding thereto.

Accordingly, the same control signal is generated in two cases in which the horizontal line 430 is drawn first and the point 410 is drawn later, and in the case where the point 410 is drawn first and the horizontal line 430 is drawn later as shown in FIG. 2A . (Input order information is not included) or different control signals may be generated (Including input order information).

This allows the practitioner of the invention to easily select according to the situation.

In addition, although it is described that input order information is included in some embodiments described below, this is only an example for the description of the invention and is not limited thereto.

In this case, the control unit 130 changes the device to which the smart remote control 10 is interlocked or the touch screen 40 into a key input mode or a gesture mode according to the user's operation of a function key.

At this time, when one of the function keys of the function key input unit 11 is tapped, the control unit 130 interlocks with the device set for the corresponding function key, and transmits the control signal generated according to the input information to the set device. do it with

In addition, when one of the function keys is double tapped, the controller 130 switches the touch screen 40 to a gesture mode or a key input mode.

In addition, the control unit 130 is characterized in that the smart remote control 10 is linked with different devices according to different function key combinations.

For example, when the first function key 13 is tapped, the controller 130 causes the smart remote control 10 to interwork with the TV, and when the first function key 13 is double-tapted, the touch screen 40 is in a gesture mode. is switched from key input mode or key input mode to gesture mode.

In addition, when the second function key 15 is tapped, the controller 130 causes the smart remote control 10 to interlock with the DVD, and when the third function key 17 is tapped, the smart remote control 10 interlocks with the air conditioner .

In addition, the control unit 130 is characterized in that different devices are interlocked according to different function key combinations.

For example, when there are three devices interlocked with the smart remote control 10, the devices interlocked with three function keys can be switched, but when there are four or more interlocked devices, a combination of function keys is required.

Accordingly, when the first function key 13 and the second function key 15 are tapped at the same time, the control unit 130 may cause the smart remote control 10 to interwork with the speaker.

Also, when the first function key 13 and the third function key 17 are simultaneously tapped, the control unit 130 may cause the smart remote control 10 to interlock with the light.

As another example, when the second function key 15 and the third function key 17 are simultaneously tapped, the control unit 130 may cause the smart remote control 10 to interlock with the air purifier.

As such, when a specific function key is input from the user or a specific function key combination input is received from the user, the control unit 130 switches the device to which the smart remote control 10 is interlocked. It allows the remote control 10 to be connected to a plurality of external devices.

As mentioned above, in the touch recognition unit 120, the functions performed in the key input mode and the gesture mode are separated.

When the touch recognition unit 120 is in the key input mode, the touch screen 40 recognizes the area of the engraved or attached character, and performs a corresponding input.

For example, when A(1) and B(2) on the touch screen 40 are input by the user, the input corresponding to AB or 12 may be performed. More specifically, when the smart remote control 10 is connected to the TV, a control signal to be switched to channel 12 may be generated and transmitted to the TV.

As described above, when the first function key 13 is tapped once, the control unit 130 switches the smart remote control 10 to interlock with the TV, and the user touches the area of the character to which the engraving or character sticker is attached. By receiving the input, control signals such as channel change and character input can be generated and transmitted to the TV.

In addition, when the first function key 13 is tapped twice, the controller 130 may switch the touch screen 40 to a gesture mode and recognize input information input by a gesture from the user.

FIG. 2 exemplifies receiving input information of a gesture in which the first function key 13 is tapped twice and the horizontal line in the right direction and the upper right of the horizontal line are touched from the user.

Since the first function key 13 was tapped twice by the user, the control unit 130 switched the touch screen 40 of the smart remote control 10 to the gesture mode, and a control signal corresponding to the input information received from the user. will generate

For example, it is assumed that a horizontal line is drawn from the left to the right, and it is preset to generate a control signal for channel up when the upper right of the horizontal line is touched, and for channel down when the bottom is touched. .

If so, when the control unit 130 receives the gesture input information as described above, it generates a TV channel up control signal, transmits the control signal to the TV, and performs an operation in which the TV channel is upgraded by one step. will be

In this way, by setting various external devices and various gesture information in advance, the user easily controls various external devices linked to the smart remote control 10 by performing a gesture input to the touch recognition unit 120 of the smart remote control 10 . be able to do

In addition, referring to FIG. 3 , the smart remote control 10 according to an embodiment of the present invention is a keypad unit 50 on which at least one of characters, numbers and symbols other than those engraved or attached to the touch screen 40 are engraved. may further include.

Hereinafter, when the touch screen 40 is switched to the gesture mode, gesture input information received from the user will be described in more detail.

5 to 11 are diagrams illustrating that various figures are sequentially drawn on the touch screen 40 according to an embodiment of the present invention.

A figure according to an embodiment of the present invention means a shape including points, lines, and planes, like a general figure.

In addition, the control unit 130 includes property information including shapes and sizes of two or more figures drawn on the touch screen 40 by the user, relative position information indicating a relative position between the two or more figures, and each figure is input It means to generate a control signal corresponding thereto based on the input order information indicating the order and precedence relationship.

Accordingly, different control signals may be generated according to what size and shape figures are input, what is the positional relationship between the figures, and what is the order in which the figures are drawn.

Also, when at least one of the recognized figures is a partition figure including a line or a surface, the controller 130 divides the space on the touch screen 40 into a plurality of spaces according to the shape of the line or surface.

For example, when the dividing figure includes a horizontal line, the controller 130 may divide the touch screen 40 into up, down, left, and right based on the horizontal line.

In this case, when a figure is a horizontal line, it does not mean that it is partitioned up and down based on the horizontal line, and the division range is not limited according to the shape of the figure, such as can also be partitioned to the left and right of the horizontal line.

For example, in the case of a straight line, it can be divided into left, right, directly above, in front of a straight line, behind a straight line, etc., based on the moving direction from the start point to the end point.

For example, it may be divided into the left and right sides based on the center of the horizontal line, or it may be divided into three areas: the left side of the left end of the horizontal line, the top and bottom of the horizontal line, and the right side of the right end of the horizontal line, etc. It can be divided into multiple domains.

In addition, when the starting point and the end point of the partitioned figure correspond to the figure, the controller 130 controls whether the figure drawn before or after the partitioned figure is drawn is located near the starting point or near the end point of the partitioned figure. may cause

Also, when the partitioned figure includes a closed curve, the controller 130 may partition the touch screen 110 into and out of the partitioned figure.

In this way, when the partitioned figure includes a closed curve, the control unit 130 can partition the space of the touch screen 40 into and out of the closed curve, and when it includes a straight line, it virtually extends the straight line to form a straight line. The touch screen 40 may be divided as a reference.

In addition, the control unit 130 is characterized in that it generates a control signal corresponding thereto according to the position of the figure drawn before or after the partitioned figure as described above is located in the plurality of partitioned spaces.

Detailed examples of this will be dealt with in more detail with reference to the drawings below.

In this way, the control unit 130 generates a control signal corresponding thereto according to the number of various cases, and transmits the control signal to the control target 900 through the wireless communication unit 150 to include a TV, an air conditioner, a refrigerator, a lock, A control object 900 such as an application is controlled.

In this case, the control target 900 may be an external device connected to the smart remote controller 10 through wireless communication, such as an air conditioner, a refrigerator, or a locking device.

In addition, since the smart remote control 10 may be provided in devices such as a smart phone, a tablet PC, and a laptop computer, it is also possible to control the operation of various applications installed in the corresponding device.

Since the operation of various applications can be controlled in this way, it is also possible to perform tasks such as authentication and account transfer in a bank application, etc., and may be set in the operation of various applications to perform each operation.

According to an embodiment of the present invention, the attribute information includes direction information from a starting point to an end point touched when each figure is drawn, information about the thickness of the touch line on which each figure is drawn, pressure intensity of the touch line, touch acceleration, and bending of the figure. It includes at least one of the number of dots and time interval information at which each figure is input.

In more detail, even if the first figure and the second figure are drawn by being touched on the touch screen 40, attribute information, relative position information, input order information, etc. are all the same conditions, the first figure is drawn If any one of the thickness information of the touch line, the pressure intensity of the touch line on which the first shape is drawn, and the touch acceleration of the touch line when the first shape is drawn is different, it is determined as a different case and a different control signal can be generated. .

For example, two circles successively drawn with the first pressure and successively drawn with the second pressure are recognized as different cases, meaning that different control signals may be generated.

In addition, the relative position information includes the number of intersections where the two or more figures overlap.

In this case, the relative position information may further include information on a ratio at which two or more figures overlap, a distance between two or more figures, and an intersection angle between two or more figures.

Referring to FIG. 5 , a line 430 and a point 410 are illustrated on the touch screen 40 .

Referring to FIGS. 5A , 5B and 5C , lines 430 and points 410 are illustrated on the touch screen 110 .

In (A) of FIG. 5A , the horizontal line 430 is drawn in the right direction, and the point 410 is drawn on the upper right of the horizontal line 430 .

And, in (B) of FIG. 5A , the horizontal line 430 is drawn in the right direction, and the point 410 is drawn on the upper left of the horizontal line 430 .

Here, although the attribute information including the shape and size of the figures is the same and the input order information between the figures is the same, as described above, since the relative position information between the figures is different, (A) and (B) of FIG. 5A different control signals are generated.

Of course, unlike (A) of FIG. 5A, if the horizontal line 430 is drawn in the right direction and the point 410 is drawn below the right side of the horizontal line 430, another control different from (A) of FIG. 5A A signal may be generated.

As an example of practical application of this, in the case of FIG. 5A (A), a control signal to increase the volume may be generated. And, if a point 410 is drawn on the lower right of the horizontal line 430 , a control signal for turning down the volume may be generated.

And, when the dot 410 is drawn on the upper left of the horizontal line 430 as shown in FIG. 5A (B), a control signal to up the TV channel can be generated, and the dot ( ) on the lower left of the horizontal line 430 410), it is possible to generate a control signal to turn the channel down.

Also, although FIG. 5A illustrates that the horizontal line 430 is drawn in a left-to-right direction, another control signal may be generated when the horizontal line 430 is drawn in a right-to-left direction. (In the case of including direction information from the first touched start point to the end point when a figure is drawn)

As another example, the control signal may vary depending on how long the horizontal line 430 is, and may also vary according to thickness information, pressure strength, and touch acceleration of the touch line on which the horizontal line 430 is drawn.

As another example, the time interval information between the time when the horizontal line 430 is drawn and the time when the point 410 is drawn may also vary. For example, when the horizontal line 430 is drawn and the point 410 is drawn immediately after the horizontal line 430 is drawn and the interval between the time when the horizontal line 430 is drawn and the time when the point 410 is drawn occurs about 0.5 seconds, different A control signal may be generated.

In addition, as described above for the case in which the partition figure is included, since the horizontal line 430 divides the touch screen 110 into a plurality of regions, the controller 130 divides the space on the touch screen 110 by a horizontal line ( It is possible to divide the region into a plurality of regions based on 430 , and generate a control signal corresponding to the position of the point 410 drawn in each region.

An example of this is shown in Figure 5b.

In (A) of FIG. 5B , the point 410 is drawn on the left side of the horizontal line 430 , and in FIG. 5B (B), the point 410 is drawn on the right side of the horizontal line 430 .

As described above, since the control unit 130 can divide the region into a plurality of regions in various ways, such as dividing the region up and down, or dividing the left and right lines based on the horizontal line 430, FIGS. 5B (A) and (B) can generate different control signals.

In (A) of FIG. 5C , a point 410 is drawn above the middle of the horizontal line 430 , and in FIG. 5C (B), a point 410 is drawn below the middle of the horizontal line 430 .

As described above, the controller 130 divides the space on the touch screen 110 into a plurality of regions based on the horizontal line 430 .

In this case, if it is assumed that the control unit 130 divides the area into two regions, upper and lower, based on the horizontal line 430 , different control signals will be generated in (A) and (B) of FIG. 5C .

However, if it is assumed that the control unit 130 divides into two regions, left and right, based on the center of the horizontal line 430 , the same control signal will be generated in (A) and (B) of FIG. 5C .

As described above, in the present invention, when the figure recognized by the controller 130 is a partitioned figure including a line or a surface, the space on the touch screen is partitioned into a plurality of spaces according to the shape of the line or surface, but according to the criterion for partitioning Therefore, various applications are possible.

6 and 7 , lines and lines drawn on the touch screen 40 are exemplified.

In FIG. 6A , the horizontal line 430a is drawn in the right direction, and the vertical line 430b is drawn in the upper right direction on the right side of the horizontal line 430a.

And, in FIG. 6B , it is exemplified that the horizontal line 430a is drawn in the right direction and the vertical line 430b is drawn in the downward direction on the right side of the horizontal line 430a.

When this is actually applied, the volume of the music application connected to the smart remote control 10 may be increased in the case of FIG. 6 (A), and the volume of the music application may be decreased in the case of (B).

As another example, when the horizontal line 430a is drawn in the right direction and the vertical line 430b is drawn in the downward direction on the upper left of the horizontal line 430a, the played song of the music application can be moved to the next song, and the horizontal line When the 430a is drawn in the right direction and the vertical line 430b is drawn in the upper direction on the left side of the horizontal line 430a, the song played in the music application can be moved to the previous song.

Also, as shown in FIG. 7 , when the vertical line 430b is drawn on the upper left side with respect to the horizontal line 430a but is drawn downward or upward, different control signals may be generated.

As another example, another control signal may be generated when the horizontal line 430a is drawn in the left direction.

As described with reference to FIG. 5 , the control signal may vary according to information such as lengths of horizontal lines 430a and vertical lines 430b, thickness information of touch lines, pressure strength, and touch acceleration.

Referring to FIG. 8 , it is exemplified that a rectangle and a dot are drawn on the touch screen 40 .

The control unit 130 includes attribute information including the shape and size of the rectangle 450 and the point 410 recognized through the touch recognition unit 120 , relative position information between the rectangle 450 and the point 410 , and the rectangle ( 450) and a control signal corresponding thereto is generated based on the input sequence information between the points 410.

In addition, since the square 450 among the recognized figures is a partition figure including a surface, the space on the touch screen 40 is divided into a plurality of spaces based on the square 450 .

In FIG. 8 , the controller 130 divides the space on the touch screen 40 into an inside and an outside of the rectangle 450 .

And, the control unit 130 generates a control signal according to where the point 410 drawn before or after the partition figure (square) is drawn is located in the partitioned space.

In Fig. 8 (A), the point 410 is inside the rectangle 450, and in Fig. 8 (B), since the point 410 is outside the rectangle 450, (A) and (B) are different from each other. A control signal is generated.

In addition, in FIG. 8 , when the rectangle 450 is drawn, the first touched start point 490 is the lower left, and it is exemplified that the end point 490 and the start point 490 end in the same way, starting in a clockwise direction.

If the starting point 490 starts at another corner of the quadrangle 450 or the direction drawn from the starting point is counterclockwise, a control signal different from that of FIG. 8 may be generated.

As another example, other than the rectangle 450, a figure such as a triangle, a pentagon, a hexagon, a circle, etc. may be drawn, a figure other than a point may be drawn, and a plurality of points may be drawn instead of a single point, If any one of them is different, different control signals may be generated.

In this way, the smart remote control 10 according to the embodiment of the present invention can allocate different control signals to each of the countless cases and generate the control signals.

Referring to FIG. 9 , a circle and a circle drawn on the touch screen 110 are illustrated.

As shown in FIG. 9(A), the large circle 470a is drawn first, and the small circle 470b is drawn in the large circle 470a, and as shown in FIG. 9(B), the small circle 470b is drawn first. Each case is illustrated in which a large circle 470a is drawn so that the small circle 470b is included therein.

Since the attribute information including the shape and size between the two figures and the relative position information between the figures are the same, the same control signal may be generated in (A) and (B) of FIG. 9 .

As another example, as described above, input order information between each figure is further included so that a control signal generation standard may be applied.

In this case, in (A) of FIG. 9 , the large circle 470a is drawn before the small circle 470b, and in (B), the small circle 470b is drawn before the large circle 470a, so the difference between the two figures is Since the input order information is different, different control signals may be generated in (A) and (B) of FIG. 9 .

Referring to FIG. 10 , a circle and a circle drawn on the touch screen 110 are exemplified.

As described above with respect to the relative position information, the relative position information may include the number of intersections where two or more figures overlap.

Accordingly, circles 470 of similar size and shape are drawn in (A) and (B) of FIG. 10 , and since both include two intersection points, the same control signal can be generated.

As another embodiment, the relative position information according to an embodiment of the present invention may include information on a ratio at which two or more figures overlap, a distance between two or more figures, and an intersection angle between two or more figures.

When such information is included, in FIGS. 10 (A) and (B), the overlapping ratio of the two circles 470 is different, the distance between the two circles 470 is different, and the intersection angle of the two circles 470 is different. Because these are different, different control signals can be generated.

As described above, depending on what kind of information is included in the relative position information according to the embodiment of the present invention, various criteria for determining the control signal may be applied.

11 is a diagram illustrating a case where a figure drawn on the touch screen 40 corresponds to numeric information according to an embodiment of the present invention.

According to an embodiment of the present invention, the smart remote control 10 is connected to a device having a lock function or a locking device, and when the control signal generated by the controller 130 matches the unlock information, the connected device is unlocked. It may further include a lock release unit 140 that

In addition, the control unit 130 determines whether a combined shape of one or two consecutive figures among a plurality of figures drawn by being touched on the touch screen 40 constitutes a shape of a number, and if the determination result is a shape of a number, It is characterized in that the control signal corresponding thereto is generated according to the determined at least two or more numerical information.

Therefore, it is determined whether a combined shape of one or two consecutive figures among a plurality of figures drawn by being touched on the touch screen 40 as shown in FIG. , 2, 7 means that the corresponding control signal is generated.

Accordingly, when a touch input as shown in FIG. 11 (A) is received when the lock password of a specific device corresponds to “5327”, the control unit 130 may cause the unlocking unit 140 to unlock the corresponding device. there is.

The above method may be applied to general locking devices, locking devices, and unlocking applications, but if more security is required, the following method may be further applied.

When the determined at least two or more number information, the order information in which figures corresponding to each number information are drawn, and the relative position information between each number coincide with a preset encryption unlock condition, the lock release unit 140 is connected It is characterized in that the device is unlocked.

When such a method is applied, the lock cannot be released by simply drawing a figure corresponding to the numerical information as shown in FIG. 11(A).

As shown in Figure 11 (B), the figure corresponding to the shape of 7 is drawn on the upper left, the figure corresponding to the shape of 2 is drawn on the lower right, the figure corresponding to the shape of 5 is drawn on the upper right, and the figure corresponding to the shape of 3 is drawn When the corresponding figure is drawn in the lower left corner, it means that the lock release unit 140 releases the lock.

This is because not only input number information corresponding to "5327" but also drawing figures at positions 5, 3, 2, and 7 correspond to, as well as touching the sequence of each number accurately, is shown in Fig. 11 (A) A higher level of security can be implemented.

12 and 13 are diagrams illustrating that the user's fingerprint information is recognized in the process of drawing a figure on the touch screen 40 according to an embodiment of the present invention.

The smart remote control 10 according to an embodiment of the present invention may further include a fingerprint recognition unit 160 for recognizing a user's fingerprint touched on the touch screen 40 .

And, the unlocking unit 140 matches the control signal generated by the controller 130 and the unlocking information, but the fingerprint information of the user recognized in the process of drawing a figure on the touch screen 40 is registered in advance. When the information matches, the connected device is unlocked.

Conventionally, in most cases, the positions of the touch screen 40 and the fingerprint recognition unit 160 are separately provided. For example, in the case of a smartphone, a home button that can be unlocked through fingerprint recognition is provided separately from the touch screen 40 .

However, in the embodiment of the present invention, the user's fingerprint can be recognized through the touch screen 40, and security can be further strengthened through this.

For example, in FIG. 12 , a horizontal line 430 in the right direction is touch-inputted with FIG. 5(A) and a point 410 is touch-inputted at the upper right of the horizontal line 430. Generated through the control unit 130 The control signals used may be the same.

However, when the fingerprint recognition unit 160 is applied, FIG. 12 is different from FIG. 5 (A) in that the user's fingerprint is taken when a touch input is made. However, since the unlock information does not match, the lock cannot be released.

As such, the recognition of the user's fingerprint touched on the touch screen 40 by the fingerprint recognition unit 160 is not limited to drawing a dot-shaped figure as shown in FIG. 12 .

Since the lock release unit 140 according to an embodiment of the present invention utilizes the user's fingerprint information recognized in the process of drawing a figure on the touch screen 40, even when drawing a figure including a line or a surface, the user's finger When a line or a surface is drawn using all of the fingerprints of , the fingerprint information is recognized and the unlocking unit 140 may unlock the lock.

This is exemplified in FIG. 13 , in which a figure in the shape of a circle 470 is drawn on the touch screen 40 from the user, and points 410a and 410b on the inside and outside of the circle 470, respectively. It is exemplified that the figure of the shape is drawn.

At this time, the user draws the circle 470 using the fingerprint of the finger instead of using the touch pen or the tip of the finger when drawing the circle, and the fingerprint recognition unit 160 touches the touch screen 40 in this way. It recognizes the user's fingerprint.

Then, when figures in the shape of points 410a and 410b are sequentially drawn inside and outside the circle 470 , the controller 130 generates a corresponding control signal.

At this time, the unlocking unit 140 does not simply unlock the device when the control signal matches, but when the user's fingerprint information recognized through the fingerprint recognition unit 160 matches the pre-registered fingerprint information, Unlock the connected device.

Through this, even if the other person knows a method for generating a control signal to unlock the device, the security cannot be unlocked if the fingerprints do not match, so the security will be further strengthened compared to the previous methods. can

Various embodiments may be applied to this. As shown in FIG. 13 , the user's fingerprint may be recognized in the process of drawing a circle, or the user's fingerprint may be recognized when drawing an internal point or an external point.

FIG. 14 is a diagram illustrating that the wireless communication unit 150 according to an embodiment of the present invention changes a communication method according to a device receiving a control signal and transmits the changed communication method.

14, when the control signal corresponds to an operation signal of an external device connected to the smart remote control 10, the smart remote control 10 according to the embodiment of the present invention wirelessly transmits the control signal to the corresponding external device. It further includes a wireless communication unit 150 to control the external device.

At this time, the wireless communication unit 150 is equipped with various communication methods such as Wifi, NFC, Bluetooh, infrared, etc., and determines the method in which the external device corresponding to the control signal can communicate, and converts the control signal into the communication method. It is characterized in that it is wirelessly transmitted to an external device.

Even though the smart remote control 10 can be connected to various external devices and can generate various control signals, if the external device receiving the control signal does not use the control signal, the smart remote control 10 can be used for performance purposes. It can be impossible.

Accordingly, the smart remote control 10 according to an embodiment of the present invention can use various communication methods such as Wifi, NFC, infrared, and Bluetooth, and converts the control signal into a communication method used by an external device that receives the control signal. It has the advantage that it can be used interchangeably with various external devices.

15A is a diagram illustrating transmission of control signals to various external devices through the hub external device 800 performing a sub role according to an embodiment of the present invention, and FIG. 15B is a diagram illustrating the actual application of FIG. 15A am.

The wireless communication unit 150 according to an embodiment of the present invention wirelessly transmits a control signal to the external hub device 800 when it is connected to an external hub device 800 that is connected to one or more other external devices and performs a hub role. , so that the corresponding hub external device 800 transmits a control signal to another external device.

Referring to FIG. 15A , it is exemplified that the TV is set as the hub external device 800 . In addition, the TV is connected to external devices such as an air conditioner, a refrigerator, a speaker, and a light.

Accordingly, the wireless communication unit 150 of the smart remote control 10 transmits a control signal to the TV, which is the external hub device 800, and transmits control signals to various external devices connected to the TV to control various external devices. will do

In (A) of FIG. 15B , a circle 470 is drawn on the touch screen, and two points 410 are touched and drawn in the inner region of the circle 470 .

In this case, according to a preset condition, the control unit 130 generates a control signal for turning on the light and transmits the control signal to the external hub device (800, TV), and the external hub device (800, TV). transmits a turn-on control signal to the light to turn on the light.

Conversely, in (B) of FIG. 15B , a circle 470 is drawn on the touch screen, and two points 410 are touched and drawn in an area outside the circle 470 .

In this case, the controller 130 generates a control signal for turning off the light according to a preset condition and transmits the control signal to the external hub device 800 (TV), and the external hub device 800, TV) transmits a turn-off control signal to the light to turn off the light.

In this way, when the user only inputs various patterns on the touch screen 40 of the remote control 10 , the control unit 130 generates a control signal corresponding thereto and transmits it to the external hub device 800 , and the external hub device Since the 800 transmits the corresponding control signal to the corresponding control target 900 and controls it, it is possible to conveniently control the various control targets 900 .

Similarly, the air conditioner may be turned on with the external hub device 800 (TV). When a triangle is drawn instead of a circle and two dots are touched inside the triangle, the controller 130 generates a control signal to turn on the air conditioner and transmits the control signal to the external hub device 800 (TV), and the external hub device ( 800, TV) transmits a turn-on control signal to the air conditioner to turn on the air conditioner.

On the contrary, when a triangle is drawn and two points 410 are touched in the area outside the triangle, the controller 130 generates a control signal for turning off the air conditioner according to a preset condition to generate a control signal for turning off the external hub device. A control signal is transmitted to (800, TV), and the external hub device (800, TV) transmits a turn-off control signal to the air conditioner to turn off the light.

In other words, a circle indicates a light and a triangle indicates an air conditioner, and control commands can be issued in the same pattern for different heterogeneous products.

16 is a diagram illustrating a flowchart of a control method of the smart remote controller 10 for controlling a device using a touch pattern according to an embodiment of the present invention.

The control unit 130 changes a device to which the smart remote control 10 is interlocked according to the user's operation of a function key, and changes the touch screen 40 to a key input mode or a gesture mode. (Step S510)

After step S510 , in the gesture mode of the touch screen 40 , the touch recognition unit 120 recognizes a figure drawn by being touched on the touch screen 40 . (Step S520)

After step S520, the control unit 130 generates a control signal corresponding thereto based on the attribute information including the shape and size of each figure recognized through the touch recognition unit 120, and the relative position information between each figure. make it (Step S530)

At this time, the smart remote control 10 includes a function key input unit 11 including at least one function key, and the touch screen 40 is engraved or attached with at least one character enabling key input in the key input mode. has been

More specifically, step S530 may further include the following steps.

When the recognized figure is a divided figure including a line or a surface, the controller 130 divides the space on the touch screen 40 into a plurality of spaces according to the shape of the line or surface. (Step S533)

The control unit 130 generates a control signal corresponding to a position of a figure drawn before or after the partitioned figure is arranged in the plurality of partitioned spaces. (Step S537)

In this case, the attribute information includes direction information from the first point to the end point touched when each figure is drawn, information about the thickness of the touch line on which each figure is drawn, pressure intensity of the touch line, touch acceleration, the number of bent points of the figure, and each The figure includes at least one of inputted time interval information.

In addition, the relative position information includes an overlapping ratio of two or more figures, a distance between two or more figures, and an intersection angle between two or more figures.

In an embodiment, the smart remote control 10 may be connected to a device having a lock function or a lock device.

The method may further include, by the unlocking unit 140 , unlocking the connected device when the control signal generated by the controller 130 matches the unlocking information.

In one embodiment, the controller 130 determines whether a combined shape of one or two consecutive figures among a plurality of figures drawn by being touched on the touch screen 40 constitutes a shape of a number, and the result of the determination In the case of the shape of a number, the method may further include generating a control signal corresponding thereto according to the determined information on at least two or more numbers.

In the above step, when the control unit 130 determines the at least two or more number information, the order information in which figures corresponding to each number information are drawn, and the relative position information between the numbers match the preset encryption unlock condition, the lock is released The step of unlocking the connected device by the unit 140 may be further included.

In an embodiment, the smart remote control 10 may further include a fingerprint recognition unit 160 for recognizing a user's fingerprint touched on the touch screen 40 .

The unlocking unit 140 matches the control signal generated by the controller 130 and the unlocking information, but the user's fingerprint information recognized in the process of drawing the figure on the touch screen 40 is The method may further include unlocking the connected device when it matches the registered fingerprint information.

In one embodiment, when the control signal corresponds to an operation signal of an external device connected to the smart remote controller 10, the wireless communication unit 150 wirelessly transmits the control signal to the external device to control the external device. It may further include a step of making it possible.

At this time, the wireless communication unit 150, Wifi, NFC, Bluetooth, infrared, etc. communication methods are possible, the control signal to determine the corresponding external device can communicate with the communication method to wirelessly transmit the control signal in the communication method characterized.

As another example, the wireless communication unit 150 wirelessly transmits the control signal to the external hub device 800 when it is connected to the external hub device 800 that is connected to one or more other external devices and serves as a hub, and the The hub external device 800 transmits the control signal to another external device.

The smart remote controller 10 control method described above differs from the smart remote controller 10 described above with reference to FIGS. 4 to 15 only in the category of the invention, and since the description of the invention is the same, a more detailed description will be omitted.

In the above, the embodiments of the present invention have been described with reference to the accompanying drawings, but those skilled in the art to which the present invention pertains know that the present invention may be embodied in other specific forms without changing the technical spirit or essential features thereof. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

10: Remote control 11: Function key input
13: first function key 15: second function key
17: third function key 40: touch screen
50: keypad unit 120: touch recognition unit
130: control unit 140: unlocking unit
150: wireless communication unit 160: fingerprint recognition unit
800: hub external device 900: control target

Claims (15)

a function key input unit including at least one function key;
a touch screen receiving a user's touch input information, and capable of a key input mode or a gesture mode;
a touch recognition unit that recognizes input information input by a touch or a gesture on the touch screen, wherein the input information includes a figure drawn by being touched by a user; and
The shape of two or more figures drawn on the touch screen based on attribute information including the shape and size of each figure recognized through the touch recognition unit, relative position information between each figure, and input order information between each figure, It includes; a control unit that generates different control signals according to the size, the relative position between the figures, and the input order;
The touch screen has at least one character engraved or attached to enable key input in the key input mode,
The control unit, characterized in that according to a user's operation of a function key, to change a device to which the remote control is linked, or to change the touch screen to a key input mode or a gesture mode,
A smart remote control that controls the device using a touch pattern.
According to claim 1,
The control unit is
When one of the function keys is tapped, it is interlocked with a device set for the corresponding function key, and a control signal generated according to the input information is transmitted to the set device,
When one of the function keys is double tapped, the touch screen is switched to a gesture mode or a key input mode,
A smart remote control that controls the device using a touch pattern. According to claim 1,
The control unit is
Characterized in that different devices are linked according to different function key combinations,
A smart remote control that controls the device using a touch pattern. According to claim 1,
The remote control is
Further comprising a; at least one of the letters, numbers, and symbols other than the letters engraved or attached to the touch screen are engraved on the keypad unit;
A smart remote control that controls the device using a touch pattern. According to claim 1,
When the recognized figure is a partition figure including a line or a surface, the control unit divides the space on the touch screen into a plurality of spaces according to the shape of the line or surface,
Characterized in generating a control signal corresponding to the position in the divided plurality of spaces of the drawn figure before or after the partitioned figure is drawn,
A smart remote control that controls the device using a touch pattern. According to claim 1,
The attribute information is
When each figure is drawn, direction information from the first touched start point to the end point, thickness information of the touch line on which each figure is drawn, pressure intensity of the touch line, touch acceleration, the number of bent points of the figure, and each figure are inputted which includes at least one of time interval information,
A smart remote control that controls the device using a touch pattern. According to claim 1,
The relative location information is
which includes the number of intersection points where two or more figures overlap,
A smart remote control that controls the device using a touch pattern. 8. The method according to any one of claims 1 to 7,
The remote control is
It is connected to a device equipped with a locking function or a locking device,
When the control signal generated by the control unit and the lock release information match, a lock release unit for unlocking the connected device; further comprising
A smart remote control that controls the device using a touch pattern. 9. The method of claim 8,
The control unit is
Among the plurality of figures drawn by being touched on the touch screen, it is determined whether a combined shape of one or two consecutive figures forms the shape of a number, and if the determination result is a shape of a number, the determined at least two or more number information Accordingly, characterized in that it generates a control signal corresponding thereto,
A smart remote control that controls the device using a touch pattern. 10. The method of claim 9,
The control unit is
When the determined at least two or more number information, information on the order in which figures corresponding to each number information are drawn, and relative position information between each number match a preset encryption release condition, the unlocking unit unlocks the connected device characterized in that
A smart remote control that controls the device using a touch pattern. 9. The method of claim 8,
The remote control is
Further comprising; a fingerprint recognition unit for recognizing a user's fingerprint touched on the touch screen;
The unlocking unit,
If the control signal generated by the controller matches the unlock information, but the user's fingerprint information recognized in the process of drawing the figure on the touch screen matches the registered fingerprint information, lock the connected device characterized by releasing
A smart remote control that controls the device using a touch pattern. According to claim 1,
The remote control is
When the control signal corresponds to an operation signal of an external device connected to the smart remote control, a wireless communication unit for wirelessly transmitting the control signal to the corresponding external device to control the external device; further comprising,
A smart remote control that controls the device using a touch pattern. 13. The method of claim 12,
The wireless communication unit,
Wifi, NFC, Bluetooth, characterized in that at least one communication method of infrared is possible, and the control signal is wirelessly transmitted in the corresponding communication method by determining the method in which the external device corresponding to the control signal can communicate,
A smart remote control that controls the device using a touch pattern. 14. The method of claim 12 or 13,
The wireless communication unit,
When connected to a hub external device that is connected to one or more other external devices to perform a hub role, the control signal is wirelessly transmitted to the hub external device, and the external hub device transmits the control signal to another external device,
A smart remote control that controls the device using a touch pattern. A method performed by a smart remote control,
changing, by the controller, a device to which the remote control is linked according to a user's operation of a function key, and changing the touch screen to a key input mode or a gesture mode;
recognizing a figure drawn by being touched on the touch screen by a touch recognition unit in a gesture mode of the touch screen; and
Two or more figures drawn on the touch screen by the control unit based on attribute information including the shape and size of each figure recognized through the touch recognition unit, relative position information between each figure, and input order information between the figures Including; generating different control signals according to the shape, size, relative position between the figures, and the input sequence of
The smart remote control includes a function key input unit including at least one function key,
The touch screen has at least one character engraved or attached to enable key input in the key input mode,
A control method of a smart remote control that uses a touch pattern to control a device.

Images