KR101856258B1 - A screen dividing method using dynamic touch interaction - Google Patents

Abstract

The present invention relates to a technique for controlling screen output in a mobile terminal provided with a touch screen, in which a screen is divided into two or more zones (first to Nth zones) having different display formats, And displaying the contents independent of each other in the divided zones.

Description

TECHNICAL FIELD [0001] The present invention relates to a screen dividing method using a dynamic touch interaction,

The present invention relates to a screen output control technique in a mobile terminal provided with a touch screen. More particularly, the present invention relates to a technique of dividing a screen into two or more sections (first to Nth sections) having different display formats, And to display contents independent of each of the divided regions through input.

Recently, the size of AVN monitors and smartphone LCDs is getting larger and the number of pixels is increasing. On the other hand, as the screen size increases and the number of pixels increases, the amount of information that can be displayed in one screen increases. In addition, AVNs and smart phones are now becoming commonplace, and multitasking is now commonplace, often displaying two or more pieces of content on one screen (for example, when sending a message while watching a video).

In order to display two or more contents on one screen, it is necessary to properly divide the screen. For example, in order to simultaneously display the moving picture and the navigation on the screen, the navigation screen is displayed on the background, It is necessary to display the navigation screen and the moving picture separately.

However, unlike a PC in which the window size can be freely adjusted by a simple operation of the mouse while the window is used as an OS, the AVN or the smartphone which the user needs to operate using the finger, Or when the display size is adjusted to a larger size or when the display position is moved to a desired position, the operation is difficult and the adjustment is inconvenient.

Embodiments of the present invention can divide the touch screen screen into two or more zones (first to Nth zones) having different display formats by a simple operation, A method of dividing a screen into which independent contents are displayed can be provided.

A screen division method according to an exemplary embodiment of the present invention includes a memory for storing content to be output through a touch screen as data, a memory for dividing the touch screen screen into two or more areas, A first touch input recognizing step of recognizing a screen division input of a first pattern inputted through the touch screen, a second touch input recognizing step of recognizing a screen division input of the first pattern input through the touch screen, A screen dividing line determining step of determining a screen dividing line based on the position information of the input position when the screen dividing input of the first pattern is recognized and dividing the screen into an area bounded by the screen dividing line and a corner of the screen, And displaying the committed content in the screen area.

Preferably, the first touch input recognizing step is configured to recognize a touch input that is dragged from the upper edge of the screen to the end of the lower edge of the screen, and the screen dividing line determination step determines the upper edge and the lower side of the screen The position information of the touched point at the corner can be checked and the screen dividing line connecting the two points can be confirmed.

Preferably, in the method of dividing a screen using the dynamic touch interaction, the first touch input recognizing step and the screen dividing line determining step may include a touch input of a pattern of dragging from one corner to the next corner of one of four corners on the screen It is possible to divide the screen into a region bounded by the trajectory dragged by the edge of the screen and the edge of the screen.

Preferably, the first touch input recognizing step, the screen dividing line determining step, and the dividing outputting step are performed in a state in which two contents are displayed on the screen, the touch input is input in the form of a closed curve of a quadrangle on the screen of the touch screen , It is possible to move to a divided screen in which one of the two contents is created as an area bounded by the closed curve.

A method of dividing a screen using a dynamic touch interaction according to an embodiment of the present invention includes a second touch input recognition step of recognizing a second pattern screen switching input of a multi-touch input simultaneously input to a plurality of areas divided through the touch screen And a cross output step of crossing the contents displayed at the position of each touch input when the screen switching input of the second pattern is recognized.

Preferably, the predetermined menu screen is displayed on one of the divided screens generated by the screen division.

The method of dividing a screen using a dynamic touch interaction according to an embodiment of the present invention includes a third touch input recognizing step of recognizing a third pattern screen drag input that drags a point among the divided screen areas, And a screen moving step of moving the content displayed at the position where the drag input is started to the screen of the area where the drag input is terminated when the drag input is recognized.

The embodiment of the present invention allows a user to divide the touch screen screen into two or more zones (first to Nth zones) having different display formats by a simple touch operation, It is possible to easily and easily divide the screen and to adjust the size and position of the screen.

1 is a block diagram illustrating a main configuration of a terminal to which a screen division function is applied according to an embodiment of the present invention;
2 is a view for explaining an external structure of a mobile terminal having the configuration of FIG. 1;
3 is a diagram illustrating operation of a user's device and screen output.
FIG. 4 is a flowchart for explaining the operation of the apparatus of FIG. 1; FIG.
5 is a diagram illustrating a screen displayed on the display unit 151 of FIG. 1 as the navigation function is executed.
FIG. 6 is a diagram for explaining an end-type screen dividing process according to the present invention; FIG.
7 is a diagram illustrating a result of screen division by longitudinal division;
8 is a diagram illustrating an " b "
9 is a diagram illustrating an example of screen division by a closed curve of a rectangular shape.
10 is a diagram for explaining a screen switching function according to the present invention.

Hereinafter, embodiments according to the present invention will be described with reference to the accompanying drawings.

The suffix 'module' and 'suffix' for the components used in the following description are given or mixed in consideration of ease of explanation, and do not have their own meaning or role.

FIG. 1 is a block diagram illustrating a main configuration of a mobile terminal to which a screen division function according to an embodiment of the present invention is applied.

In one embodiment of the present invention, a case in which the present invention is applied to a navigation apparatus for a vehicle is described. However, this is merely an example of an implementation, and may be a terminal that can be carried by the user, And may be implemented in various forms such as a mobile phone, a smart phone, a laptop computer, a digital broadcast receiving terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and a tablet computer.

1, a vehicle mobile terminal according to an embodiment of the present invention includes a wireless communication unit 110, an A / V (Audio / Video) input unit 120, a user input unit 130, A storage unit 140, an output unit 150, a memory 160, an interface unit 170, a control unit 180, and a power supply unit 190.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and a wireless communication system or between a mobile terminal 100 and a network provided in an area where the mobile terminal is located . For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 may receive a broadcast signal through an antenna or receive broadcast related information from an external broadcast management server through a separate broadcast channel, and the broadcast channel may include a satellite channel and a terrestrial channel.

Meanwhile, the broadcast management server refers to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast server and transmitting the generated broadcast signals and / or broadcast related information. In addition, the broadcast signal includes a data broadcast signal such as a TV broadcast signal, a radio broadcast signal, and traffic information (e.g., TPEG information), as well as a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal Signal may also be included.

The broadcast-related information may include information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may be received by the mobile communication module 112 through a mobile communication network, Lt; RTI ID = 0.0 > IP < / RTI >

In addition, the broadcast-related information may be recorded in an EPG (Electronic Program Guide), a DVB-T (Digital Multimedia Broadcasting-Satellite), a DMB-S (Media Forward Link Only) , Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. The broadcast receiving module 111 may include the above-described digital broadcast receiving apparatus, and may be configured to be suitable for other types of broadcasting systems, which are not shown in the above-mentioned examples including an analog broadcasting as required.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160 as needed.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 113 may be embedded in the mobile terminal 100 or may be coupled to the mobile terminal 100 in a form of a package.

WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 is a module for performing short-range communication, and includes Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB) ZigBee, etc. may be used.

The location information module 115 is a structure for acquiring location information of the mobile terminal 100, and a GPS (Global Position System) module is used as a representative example thereof. The control unit 180 comprehensively calculates the GPS satellite signals received by the position information module 115 to calculate the current position and display it on the map through the display unit 151 to be described later, The traveling direction, the traveling speed, the route guidance, and the like based on the result of the determination.

1, the A / V input unit 120 is configured to receive image information and audio information, and may include a camera 121 and a microphone 122. The camera 121 generates an image frame such as a still image or a moving image obtained by the image sensor in a black box recording mode (Rec. Mode) for a vehicle. The generated image frame can be displayed on the display unit 151. [

Meanwhile, the image frame generated by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. The camera 121 may have a multi-channel black box function that has two or more images according to the use environment, for example, images of two or more directions simultaneously.

The microphone 122 receives external sound information by a microphone in a communication mode, a recording mode, or a voice recognition mode, converts the external sound information into an electric voice signal, and processes it. The converted voice signal is processed in a form that can be transmitted to the mobile communication base station by the mobile communication module 112 when the mobile communication module 112 is in the call mode and can be outputted through the antenna. May be input directly through the < RTI ID = 0.0 > Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 is configured to generate input information for controlling the operation of the entire apparatus according to a user's operation. The user input unit 130 includes a key pad, a dome switch, a touch pad (static / a jog wheel, a jog switch, or the like.

The output unit 150 is a means by which the mobile terminal 100 processes the user's command and expresses the result as a signal that the user can perceive through the five senses through the agreed signal processing process. (151) and an audio output module (152). The display unit 151 displays the data processed by the mobile terminal 100 as visual information on the screen. For example, when the mobile terminal is in the navigation mode, information on the current position, destination, route, And displays a map, a speed, a direction, and a distance instruction on a screen and provides a user interface related thereto. In case of a black box mode or a photographing mode, a captured image or UI (or GUI) Lt; / RTI >

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) A dual display in which different images are displayed according to the viewing direction (e.g., a display in which one display is viewed from the driver's seat and a broadcast display is viewed from the passenger's seat) And may include at least one.

Some of the various display devices can be implemented as a transparent or light transmissive display capable of viewing the outside, and a transparent OLED (TOLED) is typically used. The back surface of the display unit 151, . ≪ / RTI > With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

In addition, there may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, a plurality of display means may be disposed on one surface or may be integrally disposed, Or may be arranged separately on the respective surfaces.

(Hereinafter, referred to as a 'touch screen') having a display unit 151 and a sensor (hereinafter, referred to as 'touch sensor' May be used as an output device and an input device, and the touch sensor may take the form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor is adapted to convert a change in pressure or capacitance applied to a specific portion of the display unit 151 into an electrical input signal and may be installed in the user input unit 130 or the output unit 150, Not only the position and the area but also the pressure at the time of touch can be detected.

When there is a touch input to the touch sensor, a signal corresponding to the touch is generated and transmitted to the touch controller (not shown), and the touch controller transmits the processed data to the controller 180. Thereby, the control unit 180 recognizes which area of the display panel is touched.

Meanwhile, although the case of using the touch sensor of the pressure detection type is described in the present embodiment, it may be implemented by applying the infrared touch sensor.

Hereinafter, for the sake of convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as 'proximity touch' The act of actually contacting the pointer on the touch screen will be referred to as a " contact touch. &Quot; The position at which the proximity touch is performed with the pointer on the touch screen may be configured to be assigned to the corresponding position when the pointer extends from the pointer to the touch screen in a direction perpendicular to the touch screen.

Also, the touch screen may detect a touch signal applied to more than two points at the same time, which is called 'multi-touch'.

Meanwhile, the audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in the multimedia file playback mode, broadcast reception mode, or the like, as the sound of an audible sound. The sound output module 152 may output voice guidance (e.g., a warning sound, a notification sound, a route announcement sound, etc.) related to a function performed by the mobile terminal 100 and may include a receiver, a speaker, and a buzzer.

The memory 160 stores a program for data processing and control of the controller 180 and stores content data such as a telephone directory, map information, audio and image information as data, And temporarily stores data input / output through the I / O unit 150.

The frequency of use of each of the data may be stored in the memory 160 as well as the frequency of use of the data (for example, a frequent destination and frequency of use for each multimedia file) And data about the sound

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type such as SD or XD, a random access memory (RAM) , An SRAM (Static Random Access Memory), a ROM (Read Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, Lt; RTI ID = 0.0 > a < / RTI >

Meanwhile, the mobile terminal 100 may be configured to interoperate with a web storage that is performed on behalf of the data storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 may receive data from an external device or supply power to each component in the mobile terminal 100. The interface unit 170 may receive data processed in the mobile terminal 100 from external devices It is also a device.

The interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a video I / O port, an earphone port, and the like.

When the mobile terminal 100 is connected to an external cradle, the interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100, or various commands The signal may be a path through which the signal is transmitted to the mobile terminal 100. Various command signals or power from the cradle may be used as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The control unit 180 controls the overall operation of the mobile terminal, and performs control and data processing for data communication, route search, black-box recording, and the like. The control unit 180 is provided with a multimedia module 181 for multimedia playback.

Also, the controller 180 is provided with a touch interaction module 182 that interprets a signal input through the touch sensor according to an established standard and converts the interpreted command into a corresponding command.

In FIG. 1, reference numeral 140 denotes a screen display content storage unit for dividing and storing a plurality of contents to be output through the display unit 151 in accordance with the agreed format according to the area to be displayed, under the control of the controller 180 The contents to be displayed in each zone and the display format of the contents may be stored as data in the storage units 141 to 143 allocated to the respective zones according to a predetermined control signal from the controller 180. [

The display content storage unit 140 may be configured separately from the memory 160 as illustrated in FIG. 1, but may be implemented in the memory 160 as needed, or may include a separate storage module Alternatively, the controller 180 may selectively access the content information stored in the memory 160, thereby converting the content information on a display screen.

The multimedia module 181 and the touch interaction module 182 are not necessarily implemented in the control unit 180 and may be implemented separately from the control unit 180. [

The power supply unit 190 supplies operating power to the entire apparatus under the control of the controller 180.

FIG. 2 is a view for explaining the external structure of the mobile terminal 100 of FIG. The mobile terminal shown in FIG. 2 is provided with a bar-shaped body, but may be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are combined. Or may be embodied in a form embedded in the vehicle body of the vehicle.

The body of the mobile terminal includes a case (casing, housing, cover, etc.) which forms an outer shape, and the case may be formed by injection molding of synthetic resin or made of a metal material such as stainless steel (STS) .

The mobile terminal 100 may include a display unit 151, an audio output unit 152, a camera 121, a user input unit 130, a microphone 122, an interface unit 170, and the like.

The display unit 151 occupies most of the main surface which is the front surface of the front case. An audio output module 152 and a camera 121 are disposed at an upper portion of the display unit 151. An input button 131 and a microphone 122 are disposed at a lower portion of the display unit 151, The portion 170 and the like may be arranged on the side of the front case and / or the rear case.

The user input unit 130 is configured to receive a command for controlling the operation of the mobile terminal 100 from a user and may include a plurality of operation units. The operating units are collectively referred to as a manipulating portion, which can be employed in any manner, in a tactile manner.

The contents input by the operation units can be variously set. For example, the first operation unit receives commands such as start, end, and scroll, and the second operation unit controls the size of the sound output from the sound output module 152 and the switching to the touch recognition mode of the display unit 151 And the like can be inputted.

Various types of time information can be displayed on the display unit 151. These information can be displayed in the form of letters, numbers, symbols, graphics, or icons.

These are displayed in the form of a keypad in a predetermined arrangement, and a user can select a desired shape and touch to enter corresponding information or select a function. This is called a virtual keypad.

FIG. 3 illustrates a process in which a user inputs information through a touch input to a virtual keypad provided in a front window of a mobile terminal. The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with each other.

For example, an output window 151a and an input window 151b are disposed on the upper and lower portions of the display unit 151, and a virtual keypad 151c is displayed on the input window 151b, Is output. When the virtual keypad 151c is touched, a number or the like corresponding to the touched point is displayed on one side of the output window 151a.

In addition, the touch pad implemented as a layer structure on the display unit 151 can recognize a touch input by dragging and perform processing corresponding thereto.

The user drags a touch point on the surface of the touch pad on the display unit 151 using a finger or the like so that the touch point is dragged on the display unit 151 to display an object (e.g., a cursor or a pointer) Can be moved. When the user moves the finger on the touch pad on the display unit 151, the path through which the finger moves is visually displayed on the display unit 151. This is because the image displayed on the display unit 151 is edited When used. The display unit 151 shown in FIG. 3 is implemented with a touch screen having the above-described functions.

Next, the operation of the apparatus having the above-described configuration will be described with reference to the flowchart shown in FIG.

An arrow or finger-shaped graphic for pointing a specific object or selecting a menu in the display unit 151 is called a pointer or a cursor. However, in the case of a pointer, it often means a finger or a stylus pen for a touch operation or the like. Therefore, in this specification, a graphic displayed on the display unit 151 is referred to as a cursor and a physical means for performing a touch, a proximity touch, and a gesture such as a finger or a stylus pen is referred to as a pointer .

4 is a flowchart illustrating an operation of a mobile terminal having a screen division function according to an embodiment of the present invention.

When the user selects an arbitrary function (e.g., navigation function) button provided in the user input unit 130 of the mobile terminal 100 (ST10), the controller 180 reads the data stored in the memory 160 (ST 11), and outputs the result on the entire screen as illustrated in FIG. 5. (ST 12)

In this case, the content displayed on the entire screen is managed through the first zone content storage unit 141.

6, when a user touches, for example, a finger on the screen, a touch input is performed by dragging from the top edge of the screen to the end of the bottom edge of the screen, the controller 180 controls the touch interaction module (ST 13). When the user touches the top edge of the screen and the touch point of the bottom edge of the screen, A screen division line connecting the two points is confirmed by checking the position information (ST14), and the screen is divided according to the division line to display the contents in each divided area (ST15).

At this time, in the divided regions, for example, as illustrated in Fig. 7, the navigation screen that has been output as the full screen is displayed on the first area (left screen) of the divided screen and the split screen of the newly created second area Contents to be displayed on each divided screen can be displayed in the respective contents storage units, that is, contents displayed in the first zone are stored by the first zone contents storage unit 141, And the two-zone content storage unit 142, respectively.

On the other hand, the form of the screen division can have various touch inputs and a divided structure according to the type of the above-described terminal division, for example, it is also possible to divide the screen division into two.

FIGS. 8 and 9 illustrate different types of touch inputs and examples thereof.

In FIG. 8, the user divides the screen by dragging from one corner of four edges on the screen to its neighboring corner, and displays a menu screen divided at the upper right side through the " .

In FIG. 9, in a state where two contents are displayed on the screen, when the user performs touch input in the form of a closed curve of a quadrangle on the screen of the touch screen, the moving picture screen is enlarged into the area bounded by the closed curve It shows an example of moving.

In addition to the above-described examples, various types of touch input and corresponding screen division may be possible.

10, when the user performs multi-touching on the two divided areas at the same time, the controller 180 controls the touch interaction module 182 to display the user (ST16). When the input is confirmed by the agreed multi-touch input, the contents of the two touched areas are switched and displayed to switch the screen (ST17).

On the other hand, unlike the case of switching the screens of the two areas, the user can select new content from the menu created on the divided screen in a state where the screen division is completed, It may be moved to the split screen.

That is, according to the embodiment, the touch screen screen can be divided into two or more zones (first to N-th zones) having different display formats by a simple operation, and the user can input the divided angles The content displayed in the zone can be moved or switched.

The present invention is not limited to the above-described embodiments, and various modifications may be made without departing from the technical scope of the present invention. For example, the ratio of dividing the touch screen and the content to be displayed in each divided area The type may be preset at the time of manufacture of the mobile terminal or arbitrarily designated by the user.

The functions of the present invention may be implemented by adding additional hardware, but may be embodied as codes readable by a processor on a medium on which the program is recorded. Examples of the medium include a ROM, a RAM, a CD- , A floppy disk, an optical data storage device, or the like, and may be implemented in the form of a carrier wave (for example, transmission over the Internet).

The present invention is not limited to the configuration of the above embodiments, and all or some of the configurations disclosed in the embodiments may be selectively combined.

100: mobile terminal 110: wireless communication unit
111: broadcast receiving module 112: mobile communication module
113 wireless Internet module 114 short-range communication module
115: Position information module 120: A / V input section
121: camera 122: microphone
130: user input unit 140: display content storage unit
141: first zone content storage unit 142: second zone content storage unit
143: third zone content storage unit 150: output unit
151: Display unit 152: Acoustic output module
160: memory 170: interface section
180: control unit 181: multimedia module
182: Touch interaction module 190: Power supply

Claims (7)

A memory for storing contents to be outputted through a touch screen as data; And a control unit for dividing the touch screen screen into two or more areas and controlling the contents to be displayed in different display formats for the divided screen areas based on the data stored in the memory, ;
A first touch input recognizing step of recognizing a screen division input of a first pattern inputted through the touch screen;
Determining a screen dividing line based on the position information of the input position when the screen dividing input of the first pattern is recognized;
And a division output step of dividing the screen into an area bounded by the screen dividing line and an edge of the screen and displaying the contents committed in each divided screen area,
The first touch input recognizing step, the screen dividing line determining step,
When a touch input is input in the form of a closed curve of a quadrangle on the screen of the touch screen in a state where two contents are displayed on the screen, any one of the two contents is bound to the closed curve To the area where the dynamic touch interaction is to be performed. The method according to claim 1,
The first touch input recognition step
A touch input that is dragged from the top edge of the screen to the end of the bottom edge,
Wherein the screen dividing line determining step determines the screen dividing line connecting the two points by checking the top corner of the screen and the position information of the touched point with respect to the corresponding input, How to split the screen. The method according to claim 1,
The first touch input recognition step and the screen division line determination step
Wherein the screen is divided into an area bounded by a trajectory dragged by a touch input of a pattern dragging from one corner of one of four corners on the screen to an edge adjacent to the corner and a corner of the screen, How to split the screen. delete The method according to claim 1,
A second touch input recognizing step of recognizing a second pattern screen switching input of a multi-touch input simultaneously input to a plurality of areas divided through the touch screen; And
Further comprising: a crossing output step of crossing the contents displayed at the position of each touch input when the screen switching input of the second pattern is recognized. The method according to claim 1,
Wherein a predetermined menu screen is displayed on one of the divided screens generated by the screen division. The method according to claim 1,
A third touch input recognizing step of recognizing a third pattern screen drag input to drag any one point among the divided screen areas;
Further comprising a screen moving step of moving the content displayed at the position where the drag input is started to the screen of the area where the drag input is terminated when the screen drag input of the third pattern is recognized. .

Images