KR102091650B1 - Method for controlling interface of terminal device and terminal device using the same - Google Patents

Abstract

The present application relates to a method for controlling an interface of a terminal device and a terminal device using the same, wherein the method for controlling the interface of a terminal device according to an embodiment of the present invention comprises: executing a first service and a second service; Distinguishing the type of input received from the user and recognizing the first input for the first service or the second input for the second service, respectively; And controlling the first service or the second service in response to each recognized first input or second input.

Description

Method for controlling interface of terminal device and terminal device using same {Method for controlling interface of terminal device and terminal device using the same}

The present application relates to an interface control method of a terminal device capable of providing an interface capable of individual control input to a plurality of running services and a terminal device using the same.

Recently, the mobile terminal supports a multi-tasking function that can execute two functions or menus at the same time. Accordingly, the user can compose and send a message or search for a photo album while listening to a music file through the mobile terminal using the multi-tasking function.

However, when a plurality of services are executed using multi-tasking, the first service may be displayed on the display unit of the mobile terminal and the remaining second services may be executed in the background. The user may wish to perform control of the second service while executing the first service, in which case the user switches the second service running in the background to be output on the display unit, and control of the second service is completed. When the second service is switched to the background again, the first service can be displayed on the display unit. That is, in order to control the second service during the execution of the first service, there is the inconvenience of repeatedly performing a cumbersome operation.

In particular, when the first service is a navigation service, a user may be driving a vehicle, and when controlling the second service while driving, problems such as an increased risk of accidents may occur due to scattered user's eyes.

The present application is to provide an interface control method of a terminal device that provides an interface capable of individual control input to a plurality of services being executed, and a terminal device using the same.

The present application is to provide an interface control method of a terminal device capable of applying an input to a second service running in the background while the first service is running, and a terminal device using the same.

The present application is intended to provide an interface control method of a terminal device and a terminal device using the same, which can accurately distinguish and authorize an input for each service even when a user does not view the terminal device.

An interface control method of a terminal device according to an embodiment of the present invention includes the steps of: executing a first service and a second service in an interface control method of a terminal device executing a plurality of services; Distinguishing the type of input received from the user and recognizing the first input for the first service or the second input for the second service, respectively; And controlling the first service or the second service in response to each recognized first input or second input.

A terminal device according to an embodiment of the present invention includes an input unit having a touch panel to receive a touch input applied from a user; A display unit that visually outputs a running service and combines with the touch panel to implement a touch screen; And while the first service and the second service are being executed, the type of the touch input is distinguished and recognized as a first input for the first service or a second input for the second service, and each recognized first input. Or it may include a control unit for controlling the first service or the second service in response to the second input.

In addition, not all the features of the present invention are listed in the solution means of the above-mentioned subject. Various features of the present invention and the advantages and effects thereof may be understood in more detail with reference to specific embodiments below.

According to an interface control method of a terminal device according to an embodiment of the present invention and a terminal device using the same, an interface capable of individually controlling input to a plurality of running services may be provided.

According to an interface control method of a terminal device according to an embodiment of the present invention and a terminal device using the same, an input to a second service running in the background may be applied while the first service is running.

According to an interface control method of a terminal device and a terminal device using the same according to an embodiment of the present invention, a simple touch input applied by a user can be recognized by being distinguished as an input to a corresponding service.

According to an interface control method of a terminal device and a terminal device using the same according to an embodiment of the present invention, a user can easily distinguish and apply inputs to each service easily even without looking at the terminal device.

However, an interface control method of a terminal device that executes a plurality of services according to embodiments of the present invention and an effect that a terminal device using the same can achieve are not limited to those mentioned above, and another effect not mentioned These will be clearly understood by those of ordinary skill in the art from the following description.

1 is a block diagram showing a terminal device according to an embodiment of the present invention.
2 is a schematic diagram showing a navigation system for a navigation service executed by a terminal device according to an embodiment of the present invention.
3 is a schematic diagram showing a navigation service and a sound source reproduction service according to an embodiment of the present invention.
4 and 5 are schematic diagrams showing first and second inputs of a terminal device according to an embodiment of the present invention.
6 is a schematic diagram showing a confirmation gesture of a terminal device according to an embodiment of the present invention.
7 is a flowchart illustrating a method of controlling an interface of a terminal device according to an embodiment of the present invention.

Hereinafter, exemplary embodiments disclosed herein will be described in detail with reference to the accompanying drawings, but the same or similar elements are assigned the same reference numbers regardless of the reference numerals, and overlapping descriptions thereof will be omitted. The suffixes "modules" and "parts" for the components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves. That is, the term 'unit' used in the present invention refers to a hardware component such as software, FPGA or ASIC, and 'unit' performs certain roles. However, 'wealth' is not limited to software or hardware. The 'unit' may be configured to be in an addressable storage medium or may be configured to reproduce one or more processors. Thus, as an example, 'part' refers to components such as software components, object-oriented software components, class components and task components, processes, functions, attributes, procedures, Includes subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, database, data structures, tables, arrays and variables. The functionality provided within components and 'parts' may be combined into a smaller number of components and 'parts' or further separated into additional components and 'parts'.

In addition, in describing the embodiments disclosed in the present specification, when it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed herein, detailed descriptions thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed in the specification is not limited by the accompanying drawings, and all modifications included in the spirit and technical scope of the present invention , It should be understood to include equivalents or substitutes.

The terminal device may provide various services according to a user's input, and may support multi-tasking, which simultaneously executes a plurality of services according to an embodiment. The terminal device may be a mobile terminal such as a smart phone or a tablet PC, and an application for providing a service may be downloaded and installed in the mobile terminal. For example, the terminal device may access the App store or Play store to download the corresponding application, or download the corresponding application through wired or wireless communication with another device (not shown).

Here, the mobile terminal includes a mobile phone, a smart phone, a navigation terminal, a laptop computer, a terminal for digital broadcasting, a personal digital assistants (PDA), a portable multimedia player (PMP), a slate PC, and a tablet. It may include a PC (tablet PC), ultrabook (ultrabook), wearable device (wearable device, for example, a watch-type terminal (smartwatch), glass-type terminal (smart glass), HMD (head mounted display), and the like.

When the terminal device executes a plurality of services, the first service is executed in the foreground, such as displayed on the display unit of the terminal device, and the remaining second services, etc., are not displayed separately. Can be run on The user may wish to perform control of the second service while executing the first service. In this case, in the conventional case, the user switches the second service running in the background to the foreground to input control for the second service. Approved. Thereafter, when control of the second service is completed, the second service is switched back to the background and the first service is returned to the foreground.

That is, the terminal device may execute a plurality of services at the same time, but it is inconvenient to perform a cumbersome operation in order to control the second service during the execution of the first service. In particular, when the terminal device is a mobile terminal or the like, the size of the display unit or the type of the input device is limited, and thus it is difficult to provide an interface that simultaneously controls a plurality of services.

On the other hand, the terminal device according to an embodiment of the present invention can provide an interface for controlling a plurality of services, and by using this, it is possible to solve the above-described problems. Hereinafter, a terminal device according to an embodiment of the present invention will be described.

1 is a block diagram showing a terminal device according to an embodiment of the present invention.

Referring to FIG. 1, the terminal device 100 according to an embodiment of the present invention may include an input unit 110, a display unit 120, a communication unit 130, a memory 140, and a control unit 150.

The input unit 110 may receive an input applied from a user. Here, the input unit 110 may include a touch panel or the like, and may receive a touch input applied by a user using the touch panel. According to an embodiment, a microphone may be further included to detect a voice spoken by the user. Data obtained from the input unit 110 may be analyzed and processed by a user's control command.

The display 120 may visually display information processed by the terminal device 100. That is, the display unit 120 may display execution screen information of a service such as an application driven by the terminal device 100, user interface (UI) information, and graphical user interface (GUI) information according to the execution screen information. .

In addition, the display unit 120 may form a mutual layer structure with the touch panel provided in the input unit 110 or may be integrally formed to implement a touch screen. The touch screen may function as an input unit 110 that provides an input interface between the terminal device 100 and a user, and at the same time, function as a display unit 120 that provides an output interface between the terminal device 100 and a user. . Depending on the embodiment, it is also possible to further provide information processed by the terminal device 100 to the user through sound such as voice or sound, including a speaker (not shown).

The communication unit 130 may connect to a wireless or wired communication network to communicate with other terminal devices or servers. Depending on the embodiment, a mobile communication module, a short-range communication module, a wireless Internet module, a location information module, etc. may be included in the communication unit 130.

The mobile communication module includes technical standards or communication methods for mobile communication (eg, Global System for Mobile Communication (GSM), Code Division Multi Access (CDMA), Wideband CDMA (WCDMA), High Speed Downlink Packet Access HSDPA) ), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), etc. can transmit and receive radio signals to and from neighboring base stations on a mobile communication network.

The short-range communication module is for short-range communication, Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field (NFC) Communication), Wi-Fi (Wireless-Fidelity), and Wireless USB (Wireless Universal Serial Bus) technology can be used to support short-range communication.

The wireless Internet module is a module for wireless Internet access, and can transmit and receive wireless signals in a communication network according to wireless Internet technologies. Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World) Interoperability for Microwave Access).

The location information module is a module for obtaining a location of a terminal device, and typical examples thereof include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. That is, the terminal device 100 may receive a signal transmitted by the GPS satellite 1 by utilizing the GPS module, and use it to obtain the position of the terminal device 100.

The memory 140 may store data supporting various functions of the terminal device 100. The memory 340 may store applications and applications that provide a number of services driven by the terminal device 100 or data and commands for the operation of the terminal device 100.

The memory 140 includes a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), and a multimedia card micro type. ), Card-type memory (e.g. SD or XD memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EPMROM) It can be implemented with storage media such as -only memory (PROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk.

The controller 150 may control the overall operation of the terminal device 100 and may control the operation of the application stored in the memory 140. The control unit 150 may control the operation of the application to provide a service corresponding to each application to the user. The controller 150 may support multitasking that simultaneously executes a plurality of services. For example, the controller 150 may execute a navigation service using a navigation application that performs route guidance of a vehicle, and at the same time, execute a sound source reproduction service using a sound source reproduction application that outputs a sound source. Here, the plurality of services executed by the controller 150 may be respective services provided by different applications, but may be different services provided by one application according to embodiments.

When the controller 150 executes a plurality of services at the same time, the controller 150 can distinguish and recognize which of the plurality of services the input received from the user is. That is, when the control unit 150 executes the first service and the second service at the same time, the control unit 150 distinguishes the type of input received from the user, so that the first and second services are input to the first service. It can distinguish the second input for. At this time, the input method of each of the first input and the second input may be set in advance.

Specifically, the controller 150 may receive a touch input applied by the user to the touch screen, and the touch input is a general tab, drag, swipe, pinch in, In the case of a pinch out, it can be recognized as a first input. On the other hand, when a user applies a long tap input or the like that touches the same location in the touch screen for a predetermined time or longer, it can be recognized as a second input. In the case of a long tap input, since the user must intentionally maintain the touch at the same location for a set time or longer, it can be considered that the user intends the second input. Therefore, when the long tap input is applied, it can be determined that the input is for the second service running in the background.

However, since it may be difficult to control various services for the second service using only the long tap input, the controller 150 may recognize the second input including an input applied in connection with the long tap input. For example, after completing the long tap input, the user may drag to the left, and the controller 150 may recognize the second input by including the long tap input and dragging to the left. The user may be preset to perform different control according to each drag direction applied after the long tap input. Here, the case of dragging after inputting a long tap is exemplified, but is not limited thereto, and various inputs, etc. may be applied in connection.

Meanwhile, the second input may be set in various ways in addition to the long tap input. That is, as an input distinct from the first input, any one can be used as long as it can be seen that the user intends to input the second service. For example, in the case of a force touch that touches the touch screen with a pressure greater than or equal to the set pressure, the user must intentionally apply more than the set pressure, so it can be used as a second input. In addition, a multi-touch touching the touch screen with two fingers or an input for a user to draw a specific shape such as a circle or triangle using drag may be used as the second input.

Additionally, when it is determined as the second input, the control unit 150 may inform the user that the second input corresponds. For example, when a touch is maintained for a set time when inputting a long tap, or when a pressure greater than a set pressure is applied when inputting a poster value, the terminal device 100 outputs animation, sound, vibration, etc. It can be notified that the requirements for input are satisfied. According to an embodiment, when a long tap is input, a gauge bar indicating a holding time and a setting time that the user maintains a touch may be output to indicate to the user how long the touch should be maintained.

Also, according to an embodiment, the control unit 150 may recognize a location where a touch input is applied to the touch screen, and recognize the location as a first input and a second input. Specifically, the touch screen may have a first input area and a second input area set in advance, and the controller 150 recognizes the touch input applied to the first input area as a first input, and the second input area. The applied touch input may be recognized as a second input.

Here, the first input area is set as a part of the touch screen (for example, a button at the bottom left or a radial area at one side at the bottom), and the second input area is the remaining area of the touch screen excluding the first input area. Can be set. In this case, it is also possible to display the first input area as an icon, image, color, etc., to indicate to the user that the corresponding area corresponds to the first input area.

For example, a service that does not require a lot of input to the touch screen, such as a voice recognition service, may be set as a first service to correspond to the first input area formed in a relatively small area. On the other hand, in the case of a service that frequently authorizes input, it can be set as a second service to utilize a relatively wide second input area. Here, the first input area and the second input area may be divided by dividing the touch screen up and down or left and right, or by forming them in a predetermined area on the touch screen, respectively, and the first input area and the second input area. It is also possible to set a plurality of input areas. In addition, the first input region and the second input region can be distinguished in various ways.

Furthermore, according to an embodiment, the control unit 150 may distinguish and recognize the first input and the second input according to a timing at which the user applies a touch input to the touch screen. For example, when the first service is a voice recognition service, the user may utter and input a voice command, and the terminal device may output a voice guidance confirming whether or not control corresponding to the voice command is executed. At this time, a second service such as a navigation service may be displayed and executed on the touch screen of the terminal device. In this case, in general, the controller 150 may recognize the touch input applied to the touch screen as the second input for the second service. However, during a predetermined time limit set from when the voice guidance is output, the user's touch input applied to the touch screen may be recognized as the first input to the first service.

That is, when a voice guidance for confirming whether or not to execute the control corresponding to the user's voice command is output, it is necessary to first confirm whether or not the user is authorized to execute the corresponding control. Therefore, despite the second service being displayed on the touch screen, it is possible to recognize the touch input as the first input for a certain time limit after the voice guidance is output.

In addition, in various ways, the first input and the second input may be distinguished and recognized according to the timing at which each touch input is applied.

Thereafter, the controller 150 may control the first service or the second service, respectively, in response to each recognized first input or second input. That is, since the user can conveniently apply the control input to the second service running in the background, it is convenient to perform control for each service without the hassle of switching the first service and the second service to the background. can do.

On the other hand, a plurality of services executed by the terminal device 100 may exist in various ways, for example, a navigation service informing a driving route of a vehicle, and music, podcast, audiobook, and other sound sources. There may be a sound source playback service to play. Hereinafter, an example will be described in which a navigation service is provided as a first service and a sound source reproduction service is provided as a second service.

2 is a schematic diagram showing a navigation system for a navigation service executed by a terminal device according to an embodiment of the present invention.

The terminal device 100 may provide a navigation service that guides a driving route for the vehicle. The navigation service may perform route search from the origin to the destination according to a preset route search algorithm, and display the searched route by mapping on the map. Thereafter, after confirming the current vehicle position through a GPS (Global Position System) including a GPS satellite 1, a route guidance corresponding to the position of the vehicle may be visually or audibly output to inform the user. In addition, the terminal device 100 may provide various services such as a sound source reproduction service in addition to the navigation service, and may simultaneously provide the navigation service.

The terminal device 100 may be a dedicated device implemented to guide the driving route of the vehicle, or may be a buried device embedded in the vehicle. Depending on the embodiment, a mobile terminal such as a smartphone or tablet PC including a GPS receiver may also operate as the terminal device 100 such as providing a navigation service. That is, a navigation application for providing a route guidance service to a mobile terminal can be downloaded and installed, and the application can be executed to enable the mobile terminal to provide a navigation service. Here, it is also possible to download and install a sound source playback application for sound source playback on the mobile terminal.

Depending on the embodiment, the terminal device 100 may be connected to the service server 200 through a communication network. Here, the communication network may include a wired network and a wireless network, specifically, a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN). It may include a network. In addition, the communication network may include a known World Wide Web (WWW). However, the communication network according to the present invention is not limited to the above-listed networks, and may include a known wireless data network, a known telephone network, a known wired or wireless television network, and the like.

The terminal device 100 may communicate with the service server 200 through a communication network, and may provide a navigation service using information received from the service server 200. For example, the terminal device 100 may receive real-time traffic information from the service server 200, and may search for a driving route using the received real-time traffic information. In addition, the map stored in the terminal device 100 may be updated using the map information received from the service server 200. Depending on the embodiment, the service server 200 may perform route search, and the terminal device 100 may provide a route guidance service according to the driving route provided by the service server 200. That is, the terminal device 100 receives information from the user, such as a place of departure and a destination, requests a route search to the service server 200, and the service server 200 searches for a driving route based on the received information and then searches for a terminal device A driving route may be provided to 100.

The service server 200 may provide the terminal device 100 with information required for providing a navigation service. The service server 200 may provide map information, real-time traffic information, etc. to the terminal device 100 through a communication network. Here, the map information may include information on an updated road, building, facility, etc., and real-time traffic information may be information on whether or not the road is congested in real time. Accordingly, the terminal device 100 may derive an optimal driving route by searching for a driving route using map information and traffic information provided by the service server 200. In addition, according to an embodiment, in response to a route search request of the terminal device 100, the service server 200 may search for a driving route between the origin and the destination using a predetermined route search algorithm, and the searched driving route Information about the terminal device 100 may be provided.

Depending on the embodiment, a plurality of service servers 200 may exist, and each service server 200 may provide various services to the terminal device 100 in addition to the navigation service. For example, the service server 200 may provide sound source streaming to the terminal device 100 so that the terminal device 100 executes a sound source playback service, and in addition, provides various services such as games and digital books. You can. The terminal device 100 may execute each service provided by the service server 200 and provide it to the user.

On the other hand, as shown in Figure 3 (a), the user can be provided with a navigation service from the terminal device 100. The display unit 120 may display a map area m in which driving information such as a user's driving route is displayed, and status information s such as an estimated arrival time and a distance remaining to the destination. In addition, the navigation service provided by the terminal device 100 may be to provide a voice recognition function, and the voice recognition icon (v) for activation of the voice recognition function may be displayed on the display unit 120 at a preset location. have. Here, the voice recognition icon (v) is located in the lower left corner so that the user can easily touch the voice recognition icon (v) even without looking at the display 120. According to an embodiment, a specific area in the display unit 120 may be set as an area for activating the speech recognition function, so that the user can more easily activate the speech recognition function.

The user may be provided with a navigation service from the terminal device 100, and at the same time, may further want to receive a sound source reproduction service. In this case, the user may additionally execute a sound source reproduction service using various methods, and depending on the embodiment, it is also possible to utilize a voice recognition function. That is, the user may activate the voice recognition function of the terminal device 100 by touching the voice recognition icon v of FIG. 3 (a). In this case, as shown in Fig. 3 (b), an animation a indicating activation of the speech recognition function may be output. After confirming that the voice recognition function is activated through the animation (a), the user may request to execute the sound source reproduction service by uttering the voice while the animation (a) is displayed. Since the input unit 110 of the terminal device 100 is equipped with a microphone, it is possible to recognize a user's voice by utilizing this, and execute a sound source reproduction service in response to a user's execution request. In this case, as shown in Fig. 3 (c), sound source playback information p indicating the title, singer, etc. of the sound source currently being executed in the sound source playback service is displayed, and the corresponding sound source is output through the speaker of the terminal device 100. Can be output. Thereafter, the sound source playback information p may be replaced with status information s and not displayed, and the sound source playback service may be executed in the background.

Although not illustrated, it is also possible for a user to execute a sound source reproduction service using a long tap input or a poster value input according to an embodiment. For example, if a long tap input or a poster value input is applied while the navigation service is being executed, frequently used services may be displayed radially, and a sound source playback service may be executed by dragging in the direction of the sound source playback service from the list.

Meanwhile, the user may want to check the driving route provided by the navigation service while simultaneously executing the navigation service and the sound source reproduction service. In this case, the input may be applied to the terminal device 100, and the terminal device 100 may check whether the input authorized by the user is input to the navigation service. Here, when the user's input is the first input to the first service, the navigation service, an operation corresponding to the first input may be performed. Specifically, as illustrated in FIG. 4, when the user drags or performs pinch out, the user changes the display area of the map m or inputs to a navigation service such as zooming in on the map. It can be determined by. That is, the navigation service currently being executed in the display unit 120 may be controlled in response to a general touch input. For example, in addition to drag and pinch-out, inputs such as tap, pinch-in, and swipe can be recognized as inputs to the navigation service.

On the other hand, the user may want to change the output sound source while simultaneously executing the navigation service and the sound source playback service. In this case, since it is a control for the sound source reproduction service, which is a second service operating in the background, the user needs to perform a second input such as a long tap input. Specifically, as shown in FIG. 5 (a), when a user applies a touch to the input unit 110, a gauge indicating a retention time that the user maintains a touch on the ring-shaped gauge bar may gradually rise. Here, the set time corresponds to the time required for the gauge to fill all the gauge bars of the entire ring shape. When the holding time reaches the set time, as shown in Fig. 5 (b), the circle inside the gauge bar of the ring shape may be displayed as a full shape. At this time, the terminal device 100 may output completion of the set time by outputting sound or vibration.

Thereafter, as shown in FIG. 5 (c), the user may apply an input dragging to the right in connection with the long tap, and the terminal device 100 may recognize the second input including the associated input. have. That is, it can be confirmed that the input is for the sound source playback service running in the background through the long tap input, and then it can be recognized that the request is for "playing the next song" by dragging to the right. Here, after the long tap input, various controls for the sound source reproduction service may be performed according to each input applied in association. For example, after a long tap input, it may be recognized as "playing the previous song" when dragging to the left, "increase volume" when dragging upward, or "decrease volume" when dragging downward. In addition, it is possible to perform control of a sound source reproduction service using various inputs that are linked after a long tap input.

Additionally, when a user applies an input to a navigation service or a sound source playback service, as illustrated in FIG. 6, the terminal device 100 outputs a pop-up message confirming whether or not control is executed corresponding to each input. You can. For example, when adding a waypoint in the navigation service, a user's intention can be clearly identified through a pop-up message. Here, FIG. 6 illustrates a case of confirming by using a pop-up message, but depending on the embodiment, it is also possible to confirm whether or not the waypoint is added through the voice guidance output by the terminal device 100. That is, in the case of the pop-up message, since the user needs to move the gaze to the display unit 120 of the terminal device 100 to check the content of the pop-up message, safety problems such as distraction of the driving user may occur. . Accordingly, the terminal device 100 may allow the user's intention to be confirmed by voice guidance instead of a pop-up message. In this case, since the user can confirm the content of the pop-up message using hearing, the influence on the user's driving can be minimized.

Thereafter, the terminal device 100 may determine whether the user inputs the confirmation gesture in response to a pop-up message or voice guidance, and may determine whether to add a stopover or the like when the confirmation gesture is input. Here, since the user is driving the vehicle, it is necessary to enable the user to easily input the confirmation gesture even without looking at the terminal device 100. Accordingly, here, the entire area of the touch screen being output by the navigation service of the terminal device 100 may be set as an inputable area, and it may be determined whether a confirmation gesture is input in the inputable area. In the case of the confirmation gesture, it can be set in various ways, and as shown in Fig. 6 (b), the user inputs a double tap to continuously apply the double tap on the touch screen, or the user as shown in Fig. 6 (c). When a specific shape such as a check mark is applied to the touch screen, it may be regarded that a confirmation gesture is input. In addition, multi-touch, long-tap input, poster input, etc., which are simultaneously touched using two fingers, can be used as a confirmation gesture.

7 is a flowchart illustrating a method of controlling an interface of a terminal device according to an embodiment of the present invention.

Referring to FIG. 7, an interface control method of a terminal device according to an embodiment of the present invention may include a service execution step (S10), an input recognition step (S20), and a service control step (S30).

Hereinafter, an interface control method of a terminal device according to an embodiment of the present invention will be described with reference to FIG. 7.

In the service execution step (S10), the terminal device may simultaneously execute the first service and the second service. The terminal device may support multitasking that simultaneously executes a plurality of services, and may execute two or more services simultaneously, depending on the embodiment. The terminal device may activate the first service by displaying it on the display unit, and the second service may be executed in the background. The first service and the second service executed by the terminal device may be set in various ways, and depending on the embodiment, the first service may be a navigation service and the second service may be a sound source reproduction service.

Meanwhile, when a second service is to be executed while the first service is being executed, it is also possible to perform an execution request for the second service using a voice recognition function, depending on the embodiment. That is, the terminal device may receive an execution request for the second service through voice recognition during execution of the first service, and additionally execute the second service in response to the execution request. Specifically, when the user applies a touch input to the voice recognition icon displayed on the touch screen, the terminal device may activate the voice recognition function. Thereafter, the user may request the execution of the second service using the voice recognition function, and the terminal device 100 may execute the second service in response to the execution request.

In the input recognition step (S20), it is possible to distinguish the type of input received from the user. That is, the user's input can be recognized by distinguishing the first input to the first service and the second input to the second service. Specifically, a touch input may be received from a user using a touch screen provided in the terminal device, and each touch input may be determined as a first input or a second input using the touch screen. Here, the input method of each of the first input and the second input may be set in advance.

Specifically, a general tab, drag, swipe, pinch in, or pinch out touch input may be recognized as a first input. Since the first service is currently displayed on the display unit of the terminal device, in general, the user can be expected to apply the input to the first service. Therefore, in the case of a general touch input, it can be determined as the first input. That is, when the first service is a navigation service, a tap, drag, swipe, pinch-in, or pinch-out applied to the touch screen may be recognized as a first input to the navigation service.

On the other hand, since it is not a general case to authorize the input to the second service running in the background, it is necessary to check whether the user intends to input the actual second service. For example, the long tap input or the poster value input means that the user maintains a touch for a set time or more at the same location or applies pressure over a set pressure to the touch screen, so that the user wants to apply a control input for the second service. It can be seen as having an intention to. Accordingly, when the long tap input or the poster value input is applied to the touch screen, the terminal device 100 may determine that the second input is applied. In addition, the second input may be set in various ways according to an embodiment, and the input recognition step (S20) may recognize each of them separately. In particular, when the second service is a sound source playback service, when a long tap input or a poster value input applied to the touch screen is applied, it can be recognized as a second input to the sound source playback service.

However, since it may be difficult to control various services for the second service only by inputting the long tap or the poster value, the input recognition step (S20) further includes an input applied in connection with the long tap input or the poster value input to the second input. Can be recognized. For example, the user can drag to the left after completing the long tap input, and the terminal device can recognize the second input including dragging to the left after inputting the long tap. That is, it indicates that the input is related to the second input through the long tap input or the poster value input, and then can apply a specific control command for the second service through the input applied in connection with the long tap input or the poster value input. have.

Additionally, in the input recognition step (S20), the entire area of the touch screen may be set as an inputtable area. That is, a long tap input or a poster value input applied by a user may be recognized from a touch input applied in the inputtable area. Here, when the first service is a navigation service, the user may be driving a vehicle. Therefore, it is necessary to make it possible to input the first input or the second input easily even when the user does not look at the terminal device. Therefore, here, by allowing input to be applied to any of the touch screens, the user can easily perform control of the first service or the second service.

Depending on the embodiment, in the input recognition step (S20), it is also possible to distinguish the location where the touch input is applied to the touch screen and recognize the first input and the second input. Specifically, a first input area and a second input area may be preset on the touch screen, and a touch input applied to the first input area is recognized as a first input, and a touch input applied to the second input area is recognized. It can be recognized as the second input. Here, the first input area is set to be formed radially on one side of the bottom of the touch screen, and the second input area can be set to the remaining areas of the touch screen except for the first input area. In this case, it is also possible to display the first input area as an icon, image, color, etc., to indicate to the user that the corresponding area corresponds to the first input area.

Furthermore, depending on the embodiment, it is also possible to distinguish and recognize the first input and the second input according to the timing at which the user applies the touch input to the touch screen in the input recognition step (S20). For example, when the first service is a voice recognition service, the user may utter and input a voice command, and the terminal device may output a voice guidance confirming whether or not control corresponding to the voice command is executed. At this time, a second service such as a navigation service may be displayed and executed on the touch screen of the terminal device. In this case, the touch input applied to the touch screen may be recognized as the second input for the second service. However, during a predetermined time limit set from when the voice guidance is output, the user's touch input applied to the touch screen may be recognized as the first input to the first service.

That is, when a voice guidance for confirming whether or not to execute the control corresponding to the user's voice command is output, it is necessary to first confirm whether or not the user is authorized to execute the corresponding control. Therefore, despite the second service being displayed on the touch screen, it is possible to recognize the touch input as the first input for a certain time limit after the voice guidance is output.

In the service control step S30, the first service or the second service may be controlled in response to each of the first input or the second input recognized by the terminal device. For example, when the first service is a navigation service, a display area of a map provided by the navigation service may be changed or zoom-in or zoom-out in response to the first input. have. In addition, when the first service is a sound source playback service, in response to the second input, a playback order or volume of sound sources provided by the sound source playback service may be adjusted. Through this, the user can conveniently apply the control input to the second service running in the background, and without the hassle of switching the first service and the second service to the foreground and background, conveniently for each service. Control can be performed.

On the other hand, in the service control step S30, a pop-up message or a voice message for confirming whether or not control corresponding to the first input or the second input is executed may be output. That is, before executing the actual control, the user may be asked to confirm to clarify the user's intention. In this case, the terminal device can confirm whether the user inputs the confirmation gesture in response to the pop-up message or the voice guidance, and can determine whether to execute the corresponding control only when the confirmation gesture is input. The confirmation gesture may be set in various ways, and in some embodiments, when a user inputs a double tap to continuously apply two taps to the touch screen, or when a user applies a specific shape such as a check mark to the touch screen, it is confirmed. It can be seen that the gesture is input. In addition, when a multi-touch, a long tap input, a poster value input, etc., which are simultaneously touched using two fingers is applied, a confirmation gesture may be set as input.

The above-described present invention can be embodied as computer readable codes on a medium on which a program is recorded. The computer-readable medium may be a computer that continuously stores executable programs or may be temporarily stored for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or several hardware combinations, and is not limited to a medium directly connected to a computer system, but may be distributed on a network. Examples of the medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floptical disks, And program instructions including ROM, RAM, flash memory, and the like. In addition, examples of other media include an application store for distributing applications, a site for distributing or distributing various software, and a recording medium or storage medium managed by a server. Accordingly, the above detailed description should not be construed as limiting in all respects, but should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

The present invention is not limited by the above-described embodiments and the accompanying drawings. For those skilled in the art to which the present invention pertains, it will be apparent that components according to the present invention can be substituted, modified and changed without departing from the technical spirit of the present invention.

1: GPS satellite 100: Terminal device
110: input unit 120: display unit
130: communication unit 140: memory
150: control unit 200: service server
S10: Service execution step S20: Input recognition step
S30: Service control step

Claims (17)

In the interface control method of a terminal device for executing a plurality of services,
Executing a first service and a second service;
Distinguishing the type of input received from the user and recognizing the first input for the first service or the second input for the second service, respectively; And
And controlling the first service or the second service in response to each recognized first input or second input.
The controlling step
Before executing the control according to the recognized first input or second input, a pop-up message or voice guidance for confirming whether the control is executed is output, and a user's confirmation gesture corresponding to the pop-up message or voice guidance is input. If it is authorized, the interface control method of the terminal device, characterized in that to perform control for the first service or the second service.
The method of claim 1, wherein the step of recognizing
Using a touch screen provided on the terminal device, a user receives a touch input applied to the touch screen,
A method of controlling an interface of a terminal device, wherein the type of the input is classified based on the location of the touch screen to which the touch input is applied.
The method of claim 1, wherein the step of recognizing
Using a touch screen provided on the terminal device, a user receives a touch input applied to the touch screen,
When a long tap input that touches the same location in the touch screen for a predetermined time or a force touch input that touches the touch screen at a pressure equal to or higher than a set pressure is applied, it is recognized as the second input. Interface control method of the terminal device, characterized in that.
In the interface control method of a terminal device for executing a plurality of services,
Executing a first service and a second service;
Distinguishing the type of input received from the user and recognizing the first input for the first service or the second input for the second service, respectively; And
And controlling the first service or the second service in response to each recognized first input or second input.
The step of recognizing
Using a touch screen provided on the terminal device, a user receives a touch input applied to the touch screen,
When a long tap input that touches the same location in the touch screen for a predetermined time or a force touch input that touches the touch screen at a pressure equal to or higher than a set pressure is applied, it is recognized as the second input. ,
When inputting the long tap, the interface control method of the terminal device, characterized in that for outputting a gauge bar indicating the holding time and the setting time for the user to keep the touch.
The method of claim 3, wherein the step of recognizing
After the long tap input or the force touch input is applied, a user interface control method of the terminal device, characterized in that the user recognizes the second input using an input applied in connection with the long tap input or the force touch input.
The method of claim 1, wherein the step of executing
During the execution of the first service, if an execution request for the second service is received from a user through a voice recognition function, further executing the second service in response to the execution request;
Interface control method of the terminal device further comprising a.
The method of claim 6, wherein the step of executing
In response to a user's touch input to the voice recognition icon displayed on the touch screen of the terminal device, the interface control method of the terminal device, characterized in that to activate the voice recognition function.
delete The method of claim 1, wherein the confirmation gesture
The touch input provided by the user on the touch screen provided in the terminal device includes a double tap for applying two taps in succession, multi-touch simultaneously using two fingers, or a specific shape drawn by dragging. Interface control method of the terminal device.
According to claim 1,
The first service is a navigation service, and the second service is a sound source reproduction service.
The method of claim 10, wherein the step of recognizing
Using the touch screen provided in the terminal device, the tap, drag, swipe, pinch in or pinch out applied in the touch screen is recognized as the first input to the navigation service,
When a long tap input or a poster value input applied to the touch screen is applied, the interface control method of the terminal device, characterized in that it is recognized as the second input to the sound source reproduction service.
The method of claim 2, wherein the step of recognizing
Each touch input applied to the first input region and the second input region set in the touch screen is distinguished and recognized as the first input and the second input, respectively, and the first input region is one of the bottom of the touch screen. Is formed on the side,
The second input area is an interface control method of a terminal device, characterized in that it is formed of the remaining areas of the touch screen except for the first input area.
In the interface control method of a terminal device for executing a plurality of services,
Executing a first service and a second service;
Distinguishing the type of input received from the user and recognizing the first input for the first service or the second input for the second service, respectively; And
And controlling the first service or the second service in response to each recognized first input or second input.
The step of recognizing
Using a touch screen provided on the terminal device, a user receives a touch input applied to the touch screen,
A method of controlling an interface of a terminal device, characterized in that the first and second inputs are distinguished and recognized according to a timing at which a user applies a touch input to the touch screen.
The method of claim 13, wherein the step of recognizing
The first service or the second service requests a user requesting guidance from the user, and the input for a certain period of time after the guidance is requested is recognized as the input to the requested service. Method for controlling the interface of a terminal device.
The method of claim 13, wherein the step of recognizing
When the first service is a voice recognition service, and a voice guidance confirming whether or not control is performed corresponding to a voice command uttered by a user is output, a touch input applied to the touch screen within a time limit is recognized as the first input. Interface control method of the terminal device, characterized in that.
A computer program stored in a medium in combination with hardware to execute a method of controlling an interface of a terminal device according to any one of claims 1 to 7 and 9 to 15.
An input unit having a touch panel and receiving a touch input applied from a user;
A display unit that visually outputs a running service and combines with the touch panel to implement a touch screen; And
While the first service and the second service are being executed, the type of the touch input is distinguished and recognized as the first input for the first service or the second input for the second service, and each recognized first input or It includes a control unit for controlling the first service or the second service in response to the second input,
The input unit
A terminal device characterized in that the first input and the second input are distinguished and recognized according to a timing at which a user applies a touch input to the touch screen.

Images