KR101229947B1 - Method of providing smart drag operation - Google Patents

Abstract

The present invention relates to a technique for defining and implementing a drag operation suitable for use in a smart TV screen. More specifically, the present invention allows the user to adjust the screen more finely compared to the scroll function used in the past when operating a web browser screen on a smart TV, for example, with a remote control, and furthermore, when playing a game on the smart TV, Disclosed is a technique for providing a smart drag operation that can be operated very delicately. According to the smart drag function of the present invention, the user's ease of operation in the smart TV can be maximized by providing an effect similar to touching and dragging a finger or scrolling finely on a web browser, such as a smart pad environment. That is, compared to the conventional scrolling function, it is possible to finely control the screen movement and at the same time, the effect of realizing the convenience of drag operation provided on the touch panel from the smart pad on the smart TV using the remote control. do.

Description

How to provide smart drag {METHOD OF PROVIDING SMART DRAG OPERATION}

The present invention relates to a technique for defining and implementing a drag operation suitable for use in a smart TV screen. More specifically, the present invention allows the user to adjust the screen more finely compared to the scroll function used in the past when operating a web browser screen on a smart TV, for example, with a remote control, and furthermore, when playing a game on the smart TV, Disclosed is a technique for providing a smart drag operation that can be operated very delicately.

Technology development for implementing smart TVs on various platforms such as Android and Apple OS is in progress, and it is expected that such smart TVs will be widely used in homes in the future. Smart TVs offer users the advantages of both TV and the Internet, including Internet browsers and more.

Smart TVs come with a variety of applications installed at the time of manufacture, and you can install additional application software whenever you need it, just as you would with a normal personal computer. This allows smart TVs to install multiple applications and utilize them as needed.

When application software is installed on a smart TV, various application icons are generally displayed on the TV screen. If a user selects a specific icon from the list and executes it by double-click operation or the like, the application software linked to the icon is driven. Such operation is generally performed using a remote control of a television or a smart terminal.

On the other hand, when executing an application on a smart TV, sometimes a part of the execution screen is displayed on the TV screen due to problems such as resolution. For example, referring to FIG. 5 (a), only a part of the screen on which the web browser is executed in the smart TV 100 is displayed on the TV screen. Smart TVs are generally installed in a living room of a home, and the user watches some distance away. Therefore, in consideration of readability, it is necessary to secure a certain size of text appearing on the TV screen. As a result, only a part of the execution screen of the web browser is displayed on the TV screen.

To cope with this situation, smart TVs have generally been added with the ability to scroll up, down, left and right. That is, scrolling the TV display screen in four directions up, down, left, and right, using the four-way key button on the remote control or the joystick installed on the remote control. 5 (b) shows the result of scrolling the web browser execution screen downward, and the application execution screen is displayed on the smart TV in such a scrolling manner.

However, if the scroll function is used, there is a problem that a lot of pointer movement occurs more than necessary, unlike what is desired. This cannot be avoided even if the user attempts to control it in detail, and therefore, if the user wants to move up or down by about one or two lines on the newspaper article screen as shown in [Fig. 5], the scroll function is not suitable at all.

In an environment based on smart pads (eg, iPad, Galaxy Tab), multi-touch technology is used, and in such a condition, the user can delicately manipulate the touch pad. However, since smart TVs are intended to maintain a general TV environment in which remote control functions are performed at some distance, it is not easy to provide fine screen movement control in this manner. In addition, using smart pads to control smart TVs is not appropriate because they require significant additional investment.

On the other hand, the conventional smart TV was very inconvenient even when installing and enjoying games on the smart TV. Referring to FIG. 6, an execution screen of an ANGRY BIRD and a KART RIDER, which are games that are popular in smartphones and smart pads, are shown. In smartphones and smart pads, an effective operation is possible in which a user directly touches a game screen, but the game execution environment is completely different in the smart TV 100.

If a special stage control tool for a game is not provided, the smart TV 100 requires a user to operate the game with a remote controller. By the way, it is very inconvenient to use the game because of the nature of the remote control, and sometimes the function necessary for the game operation is not provided. For example, in order to execute the Angry Bird game of Fig. 6 (a), it is necessary to perform a very delicate operation of catching a bird, which is very difficult to perform with the remote controller.

As a result, when the smart TV is installed in the living room of the home and the user controls the function through the remote control to a certain degree, the application execution screen of the smart TV can be more finely controlled, and it can be useful for playing games. There is a need for operational techniques.

An object of the present invention is to define a drag operation suitable for use in a smart TV and to provide a technique for implementing the same. More specifically, the present invention allows the user to adjust the screen more finely compared to the scroll function used in the past when operating a web browser screen on a smart TV, for example, with a remote control, and furthermore, when playing a game on the smart TV, An object of the present invention is to provide a smart drag operation that can be operated very delicately.

A smart drag providing method on a smart TV screen according to the present invention for achieving the above object, the first step of setting the smart TV to the pointer movement mode; A second step of moving the pointer on the smart TV screen in response to the OTP sensing signal sensed from the optical trackpad of the remote controller; A third step of switching the smart TV to the smart drag mode when the control signal according to the drag button input of the remote controller is received; Receiving a sensed OTP sensing signal from an optical trackpad of the remote controller; A fifth step of calculating an operation direction and a coordinate change value of the optical trackpad from the OTP sensing signal; A sixth step of generating a TV screen image obtained by dragging the TV screen formed by integrating the pointer and the smart TV screen image corresponding to the operation direction and the coordinate change value; And a seventh step of providing and displaying the dragged TV screen image to the smart TV.

According to an aspect of the present invention, there is provided a smart drag providing method, comprising: an eighth step of switching a smart TV to a pointer movement mode when a smart signal is received in response to a drag button re-entry of a remote controller when the smart TV is in a smart drag mode; And a ninth step of moving the pointer on the smart TV screen in response to the OTP sensing signal sensed by the optical trackpad of the remote controller.

In addition, the smart drag providing method according to the invention, the first step of setting the smart TV to the pointer movement mode; A second step of moving the pointer on the smart TV screen in response to the OTP sensing signal sensed from the optical trackpad of the remote controller; A third step of switching the smart TV to the smart drag mode when the control signal according to the drag button input of the remote controller is received; A fourth step of identifying the striking object object from the screen of the smart TV based on the pointer position when the drag button input is received; Receiving a sensed OTP sensing signal from an optical trackpad of the remote controller; Calculating a manipulation direction and a coordinate change value of the optical trackpad from the OTP sensing signal; A seventh step of generating a TV screen image by dragging the pointer and the striking object object corresponding to the manipulation direction and the coordinate change value; An eighth step of providing the dragged TV screen image to the smart TV for display; A ninth step of switching the smart TV to the pointer movement mode when a control signal according to a drag button re-entry of the remote controller is received; And a tenth step of providing a release to the hitting object.

Meanwhile, in the smart drag providing method according to the present invention, in the pointer moving mode, the color of the pointer is set to a first preset color, and in the smart drag mode, the color of the pointer is set to a second preset color that is distinguished from the first color. It is preferable to set.

According to the present invention, the user's ease of operation in a smart TV can be maximized by providing an effect similar to touching and dragging a finger or scrolling finely on a web browser, such as a smart pad environment.

That is, the smart drag function according to the present invention makes it possible to finely control the screen movement compared to the conventional scroll function, and at the same time, the convenience of the drag operation provided from the smart pad to the touch panel on the smart TV using the remote controller. It provides the effect of making it practical.

1 is a view for explaining the configuration of a set-top box for smart TV for implementing the drag implementation technology according to the present invention.
2 is a diagram conceptually showing how a smart drag operation is provided on a TV screen.
3 is a flowchart illustrating a smart drag providing method in a smart TV screen according to the present invention.
4 is a flowchart illustrating a case where a smart drag providing method in a smart TV screen according to the present invention is used in a hitting game.
5 is a diagram illustrating an example of scrolling a web browser execution screen on a smart TV.
6 is a diagram illustrating an example of a game execution screen on a smart TV.
7 is a diagram illustrating the concept of a pointer movement mode in the present invention.
8 is a view showing the concept of a smart drag mode in the present invention.

Hereinafter, with reference to the drawings will be described in detail the present invention.

1 is a view showing the overall configuration of the smart drag providing system according to the present invention, Figure 2 is a view showing a state in which the smart drag operation is provided on the TV screen with a conceptual view. 3 illustrates a process of providing a smart drag operation according to the present invention, and FIG. 4 illustrates a process of providing a smart drag operation in a hitting game such as Angry Birds.

1 and 2, in order to provide a smart drag operation on a smart TV screen according to the present invention, the remote controller 10, the smart phone 20, the set-top box 30, the smart TV 40 Is provided.

The remote controller 10 includes an optical track pad 'OTP' 3 and a drag button 1. In FIG. 2, the optical trackpad 3 and the drag button 1 are mechanically provided on the remote controller 10, but may be implemented in a software manner. That is, the optical trackpad 3 and the drag button 1 may be implemented as a specific touch area on the touch screen provided in the remote controller 10.

The optical trackpad 3 is a means for sensing the directionality (eg, up, down, or four directions) and the movement distance of the pointer movement in response to a user operation so that the pointer coordinates on the TV screen can be input in two or three dimensions. to be. In addition, the drag button 1 is for mode switching, and is for switching to a pointer moving mode for freely moving a pointer on a TV screen and a smart drag mode for performing an operation specifically defined in the present invention.

In the present invention, the pointer move mode is a mode in which the pointer can freely move to a desired position on the TV screen and can search for various contents according to the present invention. This is analogous to moving a computer screen pointer using a mouse device on a personal computer screen. Preferably, when the pointer position reaches the screen boundary in the pointer movement mode, the display screen is scrolled in the corresponding direction. For example, in the pointer movement mode, when the pointer reaches an upper boundary and reaches a preset time (for example, 0.5 seconds), it is preferable that the screen of the smart TV 40 is automatically scrolled upward.

Meanwhile, as illustrated in FIG. 8, the smart drag mode refers to a mode in which the TV screen is moved in accordance with a user's operation direction while the pointer is substantially fixed to the TV screen. In this case, the screen movement direction is generally made up and down, and may include other directions. It feels like the pointer grabs the TV screen and pulls it in that direction.

Comparing the two, the pointer movement mode is the mode in which the TV background (e.g. web browser screen) is fixed and the pointer moves freely on it, and the smart drag mode is the pointer and the pointer as the pointer grabs the TV background and pulls it in a specific direction. This mode is to move the TV background integrally. In the smart drag mode, the pointer and the TV screen move together, which can be moved as an image of a single layer. Alternatively, the pointer and the TV screen can be moved as a single layer, but the same amount can be moved as a result. In the latter case, the pointer and the TV screen may appear to move separately.

In order to perform the operation of the 'smart drag mode', a considerable amount of graphics processing is required, so processing the smart drag mode in a low-end embedded system such as the set-top box 30 is inevitable. As a result, Smart Drag mode will move slowly in one or two lines.

The smart phone 20 has a touch screen, and drags the same function of the remote control 10 including the drag button 1 and the optical trackpad 3 of the remote control 10 described above on the corresponding touch screen through software. It can be implemented as a button area, an OTP area, and other direction key areas. In the present specification, only the remote controller 10 is described for convenience of description.

Subsequently, the set top box 30 includes a transceiver 31, a controller 32, and an input / output interface (I / O interface) 33.

The transceiver 31 wirelessly receives a control signal from the remote controller 10 or the smartphone 20 and transmits the control signal to the controller 32.

The controller 32 includes a mode conversion module 32a, a position sensing module 32b, and a drag screen control module 32c.

The mode conversion module 32a determines whether an initial signal according to the input of the drag button 1 is received from the remote controller 10, and when the initial signal is received, switches the mode from the pointer moving mode to the smart drag mode. . Also, the mode conversion module 32a determines whether a termination signal according to the re-entry of the drag button 1 is received from the remote controller 10, and when the termination signal is received, releases the smart drag mode and the pointer. Return to move mode.

On the other hand, when the mode conversion module 32a transmits screen data to the smart TV 40 through the input / output interface 33, as shown in FIG. 2, in the pointer movement mode, the pointer has a first color (eg, Display in blue). Subsequently, when the mode switching module 32a is switched to the smart drag mode according to the input to the drag button 1, the mode conversion module 32a displays the pointer in a second color (for example, orange) to recognize the mode change to the user of the smart TV 40. Is implemented. 2 and 8 show the color of the pointer to correspond to this setting.

The position sensing module 32b wirelessly receives the OTP sensing signal detected from the optical trackpad 3 of the remote controller 10 from the remote controller 10, calculates an operation direction and a coordinate change value therefrom, and then drags the screen control module 32c. To send).

The drag screen control module 32c configures screen data that is smart dragged by the coordinate change value in the operation direction, and controls the input / output interface 33 to be provided to the smart TV 40. In the smart drag mode, the pointer and the TV background move together as the pointer grabs the TV background and pulls it in a specific direction corresponding to the operation direction. Therefore, the drag screen control module 32c controls the coordinate change value of the pointer / background image. Create a screen moved by.

According to another embodiment of the present invention, the drag screen control module 32c may provide the screen data dragged by the coordinate change value to the smart TV 40 while maintaining the point where the pointer is located on the screen at the time of switching the smart drag mode. have.

3 is a flowchart illustrating a process of providing a smart drag operation on a smart TV screen according to the present invention. Referring to FIGS. 1 to 3, in order to provide smart drag on a smart TV screen, a user waits for a user to input a drag button 1 on the remote controller 10 (S1).

The system waits until the user presses the drag button 1 of the remote controller 10, and the set-top box 30 determines whether an initial signal according to the input of the drag button 1 is received from the remote controller 10 ( S2).

The set top box 30 switches to the smart drag mode when an initial signal according to the drag button input is received in step S2 (S3).

Thereafter, the set-top box 30 receives the OTP sensing signal sensed from the optical trackpad 3 of the remote controller 10 from the remote controller 10, and calculates an operation direction and a coordinate change value from the remote controller 10 (S4). At this time, the coordinate change value may be set to calculate only the change of the position value of the up and down in order to perform the same function as the scroll function of the web browser, in this case, the operation direction indicates the up and down direction.

Then, the set top box 30 provides the screen data dragged by the coordinate change value to the smart TV 40 to be displayed (S5). Referring to FIG. 8, in the smart drag mode, the screen and the pointer displayed on the smart TV 40 move integrally, and the pointer color is changed to a second preset color to inform the user that the current smart drag mode is present. desirable.

When the screen moving operation according to the smart drag mode is completed, the set-top box 30 determines whether a termination signal according to the re-entry of the drag button 1 is received from the remote controller 10 (S6). When the user receives the termination signal from the remote controller 10 as the user inputs the drag button 1 again on the remote controller 10, the set-top box 30 releases the changed smart drag mode in step S3 (S7). .

On the other hand, when the determination result of the step (S6) is not received a termination signal indicating that the user re-enter the drag button 1, instead of receiving the OTP sensing signal indicating the coordinate change from the remote control 10 set-top box 30 ) Repeats steps S4 to S6 to generate and display an image which is moved according to the coordinate change value by integrating the screen and the pointer displayed on the smart TV 40.

4 is a diagram illustrating a process of providing a smart drag operation in a hit game such as Angry Birds on a smart TV screen according to the present invention. 1 and 4, after the hitting game is executed on the smart TV 40, the drag button 10 of the remote controller 10 for the purpose of appropriately executing the game by the user on the remote controller 10. The set top box 30 waits until pressing (S11).

The set top box 30 determines whether an initial signal according to the input of the drag button 1 is received from the remote controller 10 (S12).

The set top box 30 switches to the smart drag mode when an initial signal is received from the remote controller 10 according to the drag button 1 input. In FIG. 8, since the entire web browser screen is treated as an object, the pointer moves integrally to the web browser screen (ie, the TV screen). In an application such as a game, it is necessary to set each appearance element as an object. desirable. In the hitting game such as Angry Birds, the software is configured to manage the game appearance elements displayed on the screen of the smart TV 40 as a plurality of objects and to set the object corresponding to the position of the pointer as the hitting body when entering the smart drag mode. Since the smart drag mode can be called 'hit mode' in other words (S13).

After the step S13, the set-top box 30 receives the OTP sensing signal sensed from the optical trackpad 3 of the remote controller 10 from the remote controller 10, and at the time when the striking mode is switched from the OTP sensing signal. The operation direction and coordinate change value to be dragged are calculated from the striking body position (S14).

After the step S14, the set-top box 30 displays the screen data from which the hitting body is dragged by the coordinate change value from the point where the hitting body is located at the time when the hitting body is switched to the hitting mode in step S13. To be provided to be displayed (S15). In the game application, since the hitting body is treated as a separate object, the pointer is integrated with the corresponding object, that is, the hitting body, and the hitting body, which is the corresponding object, moves (drags) as the user manipulates the optical trackpad 3.

Subsequently, the set top box 30 determines whether a termination signal according to the re-entry of the drag button 1 is received from the remote controller 10 (S16).

When the drag button 1 receives the termination signal from the remote controller 10 according to the re-input in step S16, the set-top box 30 returns to the pointer movement mode again, and releases the hitting object of the TV screen. By providing (release) to implement a screen, for example hitting according to the game content (S17).

On the other hand, if the drag button 1 is not re-entered as a result of the determination of step S16 and the OTP sensing signal indicating the coordinate change is received from the remote controller 10, the set-top box 30 performs steps S14 to S16. Repeat to run.

Through this process, it is possible to implement the pulling of the slingshot by utilizing the drag button 1 in the game application that needs to be fixed and reorientation, such as hitting game. That is, the application can be easily utilized in the order of clicking the drag button 1, adjusting the position of the protest using the optical trackpad 3, and clicking the drag button 1 or the optical trackpad 3.

The technical idea of the present invention can be embodied as computer readable program codes on a computer readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, and those implemented in the form of carrier waves (eg, transmission over the Internet).

The computer-readable recording medium can also be distributed over network coupled computer systems so that the computer readable program code is stored and executed in a " distributed manner. &Quot; In addition, functional programs, program codes, and code segments for implementing the present invention can be easily inferred by programmers in the art to which the present invention belongs.

As described above, the present invention has been described with respect to the preferred embodiment of the present invention, although specific terms are used, which is used only in a general sense to easily explain the technical content of the present invention and help the understanding of the scope of the present invention. It is not intended to be limiting. It will be apparent to those skilled in the art that various modifications based on the technical idea of the present invention in addition to the embodiments disclosed herein are possible.

1: drag button 3: optical trackpad
10: remote control 20: smartphone
30: set-top box 31: transceiver
32: control unit 32a: mode conversion module
32b: position sensing module 32c: drag screen control module
33: input / output interface 40: smart TV

Claims (4)

The set-top box executes to provide smart drag through the operation of the optical trackpad and drag button installed on the remote control.
Setting the set-top box to the pointer movement mode in response to a user's remote control operation;
Moving the pointer on the screen in response to the OTP sensing signal sensed by the optical trackpad of the remote controller;
Switching the set top box to a smart drag mode when a control signal according to a drag button input of a remote controller is received;
Receiving an OTP sensing signal sensed from an optical trackpad of a remote controller;
Computing the smart drag operation direction and the coordinate change value from the OTP sensing signal-Coordinate change step to calculate the coordinate change value smaller than the pointer movement mode in the smart drag mode for the same user operation on the optical trackpad Sets-;
Generating a screen image dragged corresponding to the manipulation direction and the coordinate change value while the pointer and the screen are integrated;
Displaying and displaying the dragged screen image;
Smart drag providing method that is configured to include.
The method according to claim 1,
Switching the set-top box to the pointer movement mode when the control signal according to the drag button re-entry of the remote controller is received while the set-top box is in the smart drag mode;
Moving a pointer on a screen in response to an OTP sensing signal sensed by an optical trackpad of the remote controller;
Smart drag providing method that is configured to include more.
delete The method according to claim 1,
Setting a display color of the pointer to a preset first color when entering the pointer movement mode;
Setting the display color of the pointer to a preset second color, wherein the second color is a color distinct from the first color when entering the smart drag mode;
Smart drag providing method that is configured to include more.

Images