KR101570424B1 - Mobile terminal and control method for the mobile terminal - Google Patents
Mobile terminal and control method for the mobile terminal Download PDFInfo
- Publication number
- KR101570424B1 KR101570424B1 KR1020140065223A KR20140065223A KR101570424B1 KR 101570424 B1 KR101570424 B1 KR 101570424B1 KR 1020140065223 A KR1020140065223 A KR 1020140065223A KR 20140065223 A KR20140065223 A KR 20140065223A KR 101570424 B1 KR101570424 B1 KR 101570424B1
- Authority
- KR
- South Korea
- Prior art keywords
- screen
- mode
- mobile terminal
- display device
- input signal
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
- H04W88/02—Terminal devices
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C2201/00—Transmission systems of control signals via wireless link
- G08C2201/30—User interface
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q2209/00—Arrangements in telecontrol or telemetry systems
- H04Q2209/40—Arrangements in telecontrol or telemetry systems using a wireless architecture
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Telephone Function (AREA)
Abstract
The present invention relates to a mobile terminal capable of wireless connection with an external display device and a control method thereof. The wireless communication unit performs a wireless connection to wirelessly communicate with at least one display device through a network. When the wireless communication unit is wirelessly connected to the display device, the display unit displays the first screen, A GUI (Graphic User Interface) corresponding to a first screen displayed on the display unit is provided to the display device, and when an input signal related to the screen control is received, based on the information related to the state of the main body and the display device, And a control unit that executes at least one of a first mode and a second mode that varies the application range of the device on which the control is performed. In the first mode, the control unit simultaneously controls a first screen output to the display unit based on the received input signal and a second screen corresponding to the GUI output to the display apparatus, and in the second mode, The control unit changes the GUI corresponding to the second screen while maintaining the first screen based on the received input signal and provides the GUI to the display apparatus or controls the first screen while maintaining the second screen.
Description
The present invention relates to a mobile terminal capable of wireless connection with an external display device and a control method thereof.
The terminal is movable And may be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.
As the functions of the terminal are diversified, the terminal is implemented in the form of a multimedia device having a combination of functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, have. Further, in order to support and enhance the function of the terminal, it may be considered to improve the structural and software parts of the terminal.
Also, such a mobile terminal can be wirelessly connected to at least one external display device. In such a case, the screen being output to the mobile terminal may also be output to the wirelessly connected external display device.
For this purpose, the mobile terminal can provide a screen to be output to the external display device and a corresponding GUI (Graphic User Interface), as well as controlling the screen of the mobile terminal. Meanwhile, even when the screen of the mobile terminal and the screen of the external display device are controlled through the mobile terminal, the input of the control command for the screen control must be independently performed not only in the mobile terminal but also in the external display device .
It is therefore an object of the present invention to provide a mobile terminal and a mobile terminal capable of performing screen control on the basis of an input received from a display device as well as a mobile terminal, Terminal and a control method thereof.
It is another object of the present invention to provide a mobile terminal and a mobile terminal that implement an application range of a device on which screen control is performed based on a received input based on an operation state of a wirelessly connected mobile terminal and a display device, And a control method thereof.
According to an aspect of the present invention, there is provided a mobile terminal including: a main body; A display unit provided in the main body and configured to output a first screen; A wireless communication unit for performing a wireless connection for wireless communication with at least one display device through a network; (GUI) corresponding to a first screen displayed on the display unit when the main body is wirelessly connected to the display apparatus, and when an input signal related to screen control is received, And a control unit for executing at least one of a first mode and a second mode for varying an application range of a device on which screen control is performed based on information related to the state of the display device. In the first mode, the control unit simultaneously controls a first screen displayed on the display unit based on the received input signal and a second screen corresponding to the GUI displayed on the display apparatus, 2 mode, the GUI corresponding to the second screen is changed and provided to the display device while maintaining the first screen based on the received input signal, or the first screen is controlled while maintaining the second screen .
Also, in one embodiment, the input signal associated with the screen control includes at least one of a first input signal corresponding to the input applied to the body and a second input signal received from the display device, When the input signal related to the screen control is received, the first input signal and the second input signal are distinguished and processed.
Also, in one embodiment, the second input signal is generated through an input to an external input device connected to the display device.
In one embodiment, in the first mode, the first screen and the second screen are screens corresponding to the execution of the same application, and in the second mode, the first screen and the second screen are mutually And is a different screen corresponding to execution of another application.
In one embodiment, in the first mode, when the first input signal and the second input signal are simultaneously received, the control unit processes the received input signal according to a predetermined priority, Updates the first screen outputted to the display unit based on the first input signal in the second mode, and updates the first screen displayed on the display unit based on the first input signal, And updates a second screen displayed on the display device based on the input signal.
In addition, in one embodiment, the predetermined priority is determined based on whether the received input signal is a first input signal or a second input signal, a type of a control command corresponding to the received input signal, And the state information.
In one embodiment, the control unit may switch the first mode to the second mode in response to detection of a text input corresponding to the first input signal on the display unit in the first mode .
In one embodiment, the control unit changes the second mode back to the first mode in response to the end of the text input on the display unit.
In one embodiment, the control unit controls to output a predetermined alarm upon switching of a mode related to the screen control.
In one embodiment, in the first mode, in response to an input signal for text input being received from the display device, the control unit maintains the first mode so that the text input can also be performed in the main body .
Also, in one embodiment, while the first mode is being executed, the controller receives user information existing within a predetermined range based on the display device obtained using the camera, and when an event is detected in the main body And determines whether to switch to the second mode based on the received user information.
Also, in one embodiment, when the first mode is switched to the second mode based on the received user information, when the detected event is terminated, the control unit returns the second mode again to the first mode Mode.
In one embodiment, the controller stops signal processing for the second input signal received from the display device while the event is detected.
Also, in one embodiment, when the time information requesting the input of the user information is output to the second screen displayed on the display device while the second mode is being executed, And switches to the first mode for a set time.
Also, in one embodiment, when the wireless connection between the main body and the video display device is released in the second mode, the control unit controls the display unit to display the second screen, which has been output to the video display device, 2 mode to the first mode.
Further, in one embodiment, the controller is configured to output, when the wireless connection between the main body and the video display device is released in the second mode, a notification icon indicating that the wireless connection is released to the display .
Also, in one embodiment, in response to the detection of a predetermined gesture input to the main body in a state in which the first screen and the second screen are being output, the control unit controls the second mode Or to switch from the second mode to the first mode.
In one embodiment, when the power of the battery included in the main body is judged to be lower than the reference value while the second mode is being executed, a message for switching to the first mode is displayed on the display device So that the display unit is inactivated.
Also, in one embodiment, when the power of the battery included in the main body is determined to be lower than the reference value while the first mode is being executed, when the input for attempting to switch to the second mode is detected And a notification icon indicating that the second mode can not be switched is output to the display device.
Also, in one embodiment, the control unit controls the screen in a mode that was executed when the display unit is inactivated, when the display unit is activated again.
A mobile terminal and a control method thereof according to an embodiment of the present invention may be configured so that a mobile terminal including various functions and a simple display device are wirelessly connected to each other so that a screen output to a mobile terminal can be output to a wirelessly- Thus, a non-smart display device can display various contents by utilizing the resources of the mobile terminal.
In addition, in the mobile terminal and the control method thereof according to an embodiment of the present invention, when the screen output to the mobile terminal is also output to the wirelessly connected display device, However, the input itself related to the screen control can be independently performed in the mobile terminal and the display device, thereby improving user convenience.
Also, a mobile terminal and a control method thereof according to an exemplary embodiment of the present invention may be configured to perform a screen update corresponding to a received input based on operation states of a wirelessly connected mobile terminal and a display device, The application range can be applied differently. That is, the screen control of the mobile terminal and the display device can be operated in the dual mode or the single mode according to the circumstances, thereby providing a multi-user interface environment to the user.
1 is a block diagram illustrating a mobile terminal according to one embodiment disclosed herein.
2A and 2B are conceptual diagrams of a communication system in which a mobile terminal according to the present invention is operable.
FIGS. 3A and 3B are views showing an example of a mobile terminal according to an embodiment disclosed herein in different directions.
4 is a flowchart of a typical operation method of a mobile terminal according to the present invention.
5A and 5B are illustrative conceptual diagrams for explaining the flow chart of FIG.
6A and 6B are conceptual diagrams illustrating an operation mode related to screen control in a mobile terminal according to the present invention.
FIG. 7 is an exemplary flowchart illustrating a processing method when an input signal is simultaneously received in a mobile terminal and an image display device in a mobile terminal according to the present invention.
8A, 8B, 9A, 9B, 9C, 10A, 10B, 10C, 10D, 11, 12A, 12B and 13, And an operation mode related to the screen control according to various user environments.
The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC A tablet PC, an ultrabook, a wearable device such as a smartwatch, a smart glass, and a head mounted display (HMD). have.
However, it will be appreciated by those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, a digital signage, and the like, will be.
1 is a block diagram illustrating a mobile terminal according to the present invention.
The
The
The
The
The
The
The
In addition, the
In addition to the operations related to the application program, the
In addition, the
The
At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the
Hereinafter, the various components of the
First, referring to the
The
The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.
The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the
Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 113 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.
The wireless Internet module 113 for performing a wireless Internet connection through the mobile communication network can be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE or LTE- May be understood as a kind of the
The short-
Here, the other
The position information module 115 is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module 115 may perform any of the other functions of the
Next, the
The
The
Meanwhile, the
First, the
Examples of the
On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as "proximity touch & The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The
The touch sensor uses a touch (or touch input) applied to the touch screen (or the display unit 151) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, Detection.
For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.
Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the
On the other hand, the
On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.
The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the
The
The
The
In addition, the
In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.
The
The
In addition to vibration, the
The
The
The signal output from the
The
The identification module is a chip for storing various information for authenticating the use right of the
The
The
The
Meanwhile, as described above, the
In addition, the
The
In addition, the
As another example, the
In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.
2A and 2B are conceptual diagrams of a communication system in which the
First, referring to FIG. 2A, the communication system may use different wireless interfaces and / or physical layers. For example, wireless interfaces that can be used by a communication system include Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA) , Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE)), Global System for Mobile Communications (GSM), and the like.
Hereinafter, for the sake of convenience of description, the description will be limited to CDMA. However, it is apparent that the present invention can be applied to all communication systems including CDMA wireless communication systems.
2A, a CDMA wireless communication system includes at least one
Each of the plurality of
The intersection of sector and frequency assignment may be referred to as a CDMA channel. The
As shown in FIG. 2A, a broadcasting transmitter (BT) 295 transmits a broadcasting signal to
In addition, FIG. 2A illustrates a
Of the typical operation of a wireless communication system, the
Next, a method of acquiring location information of a mobile terminal using a WiFi (Wireless Fidelity) Positioning System (WPS) will be described with reference to FIG. 2B.
A WiFi Positioning System (WPS) 300 uses a WiFi module included in the
The WiFi
The
SSID, RSSI, channel information, Privacy, Network Type, Signal Strength, and Noise Strength based on the location information request message of the
The
In FIG. 2B, the wireless APs connected to the
Next, the
The information of any wireless APs stored in the
Since the
The extracted location information of the
Hereinafter, a structure of a mobile terminal or a mobile terminal in which components of the mobile terminal or the mobile terminal according to an embodiment of the present invention shown in FIG. 1 are arranged will be described.
3A and 3B are views showing an example of the
The disclosed
Here, the terminal body can be understood as a concept of referring to the
The
A
In some cases, electronic components may also be mounted on the
As shown, when the
These
The
Meanwhile, the
The
1B and 1C, a
However, these configurations are not limited to this arrangement. These configurations may be excluded or replaced as needed, or placed on different planes. For example, the
The
The
In addition, the
The
The touch sensor may be a film having a touch pattern and disposed between the
In this way, the
The first
The
The
The
The first and
In this figure, the
The contents input by the first and
On the other hand, a rear input unit (not shown) may be provided on the rear surface of the terminal body as another example of the
The rear input unit may be disposed so as to overlap with the
When a rear input unit is provided on the rear surface of the terminal body, a new type of user interface using the rear input unit can be realized. When the
Meanwhile, the
The
The
And a
The
The
And a second
The terminal body may be provided with at least one antenna for wireless communication. The antenna may be embedded in the terminal body or formed in the case. For example, an antenna constituting a part of the broadcast receiving module 111 (see FIG. 1A) may be configured to be able to be drawn out from the terminal body. Alternatively, the antenna may be formed in a film type and attached to the inner surface of the
The terminal body is provided with a power supply unit 190 (see FIG. 1A) for supplying power to the
The
The
The
Hereinafter, embodiments related to a control method that can be implemented in a mobile terminal configured as above will be described with reference to the accompanying drawings. It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.
The
Here, the GUI (Graphic User Interface) corresponding to the screen displayed on the
When the input signal related to the screen control is received, the control unit selects one of a first mode and a second mode for varying the application range of the device on which screen control is performed based on the information related to the state of the main body and the display device At least one can be executed. At this time, the first mode and the second mode are selectively performed, and they can be switched based on the reference (input signal, information related to the state).
Here, the input signal related to the screen control may be a user input 130 such as an
When the first mode is selected, the control unit can simultaneously control a first screen displayed on the display unit based on the received input signal and a second screen corresponding to the GUI displayed on the display apparatus.
In addition, when the second mode is selected, the control unit changes the GUI corresponding to the second screen while maintaining the first screen based on the received input signal, and provides the GUI to the display apparatus, It is possible to control only the first screen. That is, in the second mode, only the screen being output to the mobile terminal is updated or only the screen output to the display device is updated according to the received input signal.
4 is a flowchart of a typical operation method of the
First, a first screen corresponding to the execution of at least one application is displayed on the
Next, the
The display device may be a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC, , A tablet PC, an ultrabook, a wearable device, a smart glass, a head mounted display (HMD), and the like.
Here, the video display device includes both a device for receiving and outputting a broadcast, a device for recording and reproducing video, and a device for recording and reproducing audio. Hereinafter, as an example of the
The
In this case, the
However, in the present invention, since both the signal processing and the screen configuration related to the screen control are performed in the
5A, the
In addition, when the touch area for selecting a plurality of video display devices connectable to the
When the
Here, the GUI (Graphic User Interface) corresponding to the first screen displayed on the
Next, the control unit detects that an input signal related to the screen control is received (S430). Here, the input signal may be generated through the
Specifically, the input signal related to the screen control may be at least one of a first input signal corresponding to the input applied to the body of the terminal 100 and a second input signal received from the
The second input signal may be generated through an input to an
The control unit may process the first input signal and the second input signal separately when an input signal related to the screen control is received. Signal processing for when an input signal associated with screen control is received from the
Referring to FIG. 5B, a process of performing signal processing in the
When the input signal related to the screen control is received, the control unit changes the application range of the device on which the screen control is performed based on the information related to the state of the terminal 100 and the state of the
The information related to the state of the terminal 100 and the
The user environment information includes information related to a user viewing the terminal 100 or a user viewing the video display device 200 (for example, whether the user is the user or not) Intention (whether to input text, whether to share the screen, switch the operation mode related to screen control, etc.).
The controller collects information related to various states and user environment information from the terminal and the image display device, and can automatically select, change, or cancel the operation mode related to the screen control. For example, based on a specific input, the control unit may determine whether the user intends to use the terminal and the video display device as the same input means or only the device to which the specific input is currently applied as the input means have. In addition, the control unit can trace and detect the information related to the status of both devices and the environment of the user, retrospectively for a predetermined period of time after the input signal is received.
Specifically, when the first mode is selected, the control unit simultaneously controls a first screen displayed on the display unit based on the received input signal and a second screen corresponding to the GUI displayed on the display apparatus S450). That is, in the first mode, the screen images outputted to the
On the other hand, when the second mode other than the first mode is selected, the controller independently controls one of the first screen and the second screen corresponding to the GUI (S460). That is, the control unit may change the GUI corresponding to the second screen while maintaining the first screen on the basis of the received input signal, and provide the GUI to the
Hereinafter, the first mode will be referred to as a single mode and the second mode will be referred to as a dual mode.
The single mode means that the input means of the
6A and 6B, an operation mode related to the screen control, that is, a first mode and a second mode will be described with specific examples.
Reference numeral 6a is an example of a case where screen control in the
6A, a
In this case, when the input signal input through the
6A, when the touch gesture is applied to the
6B is an example of a case where screen control in the
In the second mode, the first screen and the second screen may be different screens corresponding to the execution of different applications. However, even in the dual mode, the screen output to the
6B, when an input signal, for example, a moving picture playback signal, input through the
The control unit controls the screen in a single mode or a dual mode. When the control unit receives a new input signal related to the screen control, the control unit displays the current operation mode Can be switched. That is, the mode can be switched from the single mode to the dual mode or from the dual mode to the single mode.
In this way, upon switching of the mode related to the screen control, the control unit can output a predetermined alarm. The predetermined alarm may be a pop-up message on the display of the
As described above, according to the embodiment of the present invention, when the screen output to the mobile terminal is directly output to the wirelessly connected display device, the control of the screen output to both devices is actually performed only in the mobile terminal , The input itself related to the screen control can be independently performed in the mobile terminal and the display device, thereby improving user convenience.
FIG. 7 is an exemplary flowchart illustrating a processing method when an input signal is simultaneously received in a mobile terminal and an image display device in a mobile terminal according to the present invention.
As shown in FIG. 7, the
At this time, a first screen, for example, a predetermined web page screen, is displayed on the
In step S720, the controller selects a mode of a screen control, that is, a single mode or a dual mode, in response to the
Next, the controller detects that the first input signal corresponding to the input applied to the main body of the terminal 100 is received simultaneously with the second input signal received from the display device 200 (S730). Then, the control unit performs processing of the simultaneously received input signals differently according to the current screen control mode.
Specifically, when the current screen control mode is the single mode (i.e., the first mode), the control unit processes the first input signal and the second input signal according to a predetermined priority, And the second screen displayed on the
Here, the predetermined priority may be set by various criteria. Specifically, based on at least one of whether the received input signal is a first input signal or a second input signal, a type of control command corresponding to the received input signal, and status information related to the main body of the terminal 100, The priority of the processing can be determined. For example, the terminal 100 can give priority to the first input signal inputted thereto. Alternatively, when an input signal corresponding to a control command to be processed first, for example, a control command for turning off the screen and a control command for scrolling the screen, is first executed, A control command for scrolling the screen can not be executed. In this case, the control signal for scrolling the screen can be given priority to the input signal. If the battery of the main body of the terminal 100 is insufficient, the terminal 100 can be given priority in terms of power off.
On the other hand, when the current screen control mode is the dual mode (i.e., the second mode), the control unit updates the first screen output to the
Meanwhile, the
Figures 8A, 8B, 9A, 9B, 9C, 10A, 10B, 10C, 10D, 10E, 11, 12A, 12B and 13 are cross- And illustrative conceptual diagrams for explaining an operation mode related to a screen control according to an operation state of the image display apparatus and various user environments.
Hereinafter, Figs. 8A and 8B are views for explaining a method of switching an operation mode related to screen control in a text input state in a single mode.
8A, in a single mode, the control unit displays, in a single area of the
In this case, the control unit switches the single mode to the dual mode to control the screen. As a result, a
When the text input is ended through the
8B, in the single mode, the control unit corresponds to the text input performed in one area of the
In this case, the control unit maintains the single mode so that the text input can also be performed in the main body of the terminal 100. As a result, a
9A, 9B and 9C are diagrams for explaining a method of switching an operation mode related to screen control when a specific event, for example, a call signal, is detected in the terminal 100 in the single mode to be.
When an event is generated in at least one application of the main body, the
Here, an example in which the
In this case, the control unit can receive user information existing within a predetermined range based on the
Next, the control unit may determine whether to switch to the second mode based on the received user information, in response to an event, that is, a call signal, received from the mobile terminal.
Specifically, as shown in FIG. 9A, in the state where the same moving
Also, the controller may change the second mode back to the first mode when the first mode is switched to the second mode based on the received user information, when the detected event ends. That is, when the call signal is terminated, the switched dual mode returns to the single mode, and the moving
Meanwhile, the controller stops signal processing on the second input signal received from the
For example, as shown in FIGS. 9A and 9B, in the state where the same moving
9C, when the video call is received in the
10A, 10B, 10C, and 10D are embodiments for explaining a method of switching an operation mode related to screen control according to user input or in a specific scene.
In response to the detection of a preset gesture input in the main body of the terminal 100 in a state in which the first screen and the second screen are being output to the
10A shows a case where a predetermined user gesture is input to the terminal 100 as shown in FIG. 10A when the terminal 100 and the
Here, the gesture of shaking the main body of the terminal while pressing a specific key (e.g., a home key) of the terminal has been described as an example of the predetermined user gesture. However, the gesture is not limited thereto. May be performed by at least one combination.
On the other hand, FIG. 10B is an example of a case where a predetermined user gesture is applied to the terminal 100 to switch to the single mode when the terminal 100 and the
10C illustrates an example in which a preset user gesture is performed through an
Meanwhile, when the time information for requesting the input of the user information, for example, the user login input area, is displayed on the second screen displayed on the
12 is a flowchart illustrating a method of switching an operation mode related to screen control in a state where different screens are displayed on the
When the wireless connection between the main body of the terminal 100 and the
On the other hand, when the wireless connection between the main body of the
Hereinafter, FIGS. 12A, 12B, and 13 are views illustrating a method of switching an operation mode related to screen control when the battery of the terminal is insufficient.
While the
That is, when the power of the battery of the terminal is insufficient, the controller controls the
If it is determined that the power of the battery included in the main body of the terminal 100 is equal to or lower than the reference value while the single mode is being executed, if the input for attempting to switch to the dual mode is sensed, d) A notification icon indicating that you can not switch to dual mode, 'The battery is low. Quot ;, " unable to switch to dual mode ", is output to the
Meanwhile, when the
13, when the battery power of the terminal 100 is lower than the reference value, a message for inducing a connection with another device is transmitted to the
As described above, the mobile terminal and the control method thereof according to the embodiment of the present invention allow a mobile terminal including various functions and a simple display device to be wirelessly connected to each other, The non-smart display device can display various contents by utilizing the resources of the mobile terminal.
In addition, when a screen output to the mobile terminal is output to a wirelessly connected display device, the screen output to both devices is actually controlled only by the mobile terminal, but the input itself related to the screen control is controlled by the mobile terminal and the display device It can be performed independently, thereby improving user convenience.
In addition, the application range of the device to be subjected to the screen update corresponding to the received input may be differently applied based on the operation state of the wirelessly-connected mobile terminal and the display device and various user environments. That is, the screen control of the mobile terminal and the display device can be operated in the dual mode or the single mode according to the circumstances, thereby providing a multi-user interface environment to the user.
Furthermore, the present invention can be embodied as computer-readable code on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Also, the computer may include a
Claims (20)
A display unit provided in the main body and configured to output a first screen;
A wireless communication unit for performing a wireless connection for wireless communication with at least one display device through a network;
When the main body is wirelessly connected to the display device, provides a GUI (Graphic User Interface) corresponding to the first screen displayed on the display unit to the display device,
And a control unit that executes at least one of a first mode and a second mode that is different in an application range of a device on which screen control is performed based on information related to the state of the main body and the display device And a control unit,
Wherein,
In the first mode, a first screen output to the display unit and a second screen corresponding to the GUI output to the display device are simultaneously controlled based on the received input signal, and in the second mode, Wherein the control unit changes the GUI corresponding to the second screen and provides the GUI to the display apparatus while maintaining the first screen based on the input signal or controls the first screen while maintaining the second screen,
In a state in which the first screen and the second screen are being output, controlling to switch from one of the first mode and the second mode to another in response to detection of a gesture input preset in the main body Wherein the mobile terminal is a mobile terminal.
Wherein the input signal associated with the screen control comprises at least one of a first input signal corresponding to an input applied to the body and a second input signal received from the display device,
Wherein,
Wherein when the input signal related to the screen control is received, the first input signal and the second input signal are discriminated and processed.
Wherein the second input signal is generated through an input to an external input device connected to the display device.
In the first mode, the first screen and the second screen are screens corresponding to the execution of the same application,
Wherein in the second mode, the first screen and the second screen are different screens corresponding to execution of different applications.
Wherein,
Wherein when the first input signal and the second input signal are simultaneously received in the first mode, the received input signal is processed according to a predetermined priority, and the first screen and the second screen, which are output to the display unit, Updates the second screen to be outputted simultaneously,
And the second mode updates the first screen output to the display unit based on the first input signal and updates the second screen output to the display device based on the second input signal. Mobile terminal.
The predetermined priority may be a priority,
Wherein the determination is based on at least one of whether the received input signal is a first input signal or a second input signal, a type of control command corresponding to the received input signal, and status information associated with the main body Mobile terminal.
Wherein,
And switches the first mode to the second mode in response to detection of a text input corresponding to the first input signal on the display unit in the first mode.
Wherein,
Wherein the display unit changes the second mode back to the first mode in response to the end of the text input.
Wherein the control unit controls to output a predetermined alarm upon switching of a mode related to the screen control.
Wherein,
Wherein in the first mode, in response to receiving an input signal for text input from the display device, the mobile terminal maintains the first mode such that the text input can also be performed in the body.
While the first mode is being executed
Wherein,
Receiving user information existing within a predetermined range on the basis of the display device obtained using a camera,
Wherein the mobile terminal determines whether to switch to the second mode based on the received user information in response to an event detected in the main body.
Wherein,
Wherein when the first mode is switched to the second mode based on the received user information, the second mode is switched back to the first mode when the detected event is terminated.
Wherein,
And stops signal processing for the second input signal received from the display device while the event is detected.
Wherein,
When the time information requesting the input of the user information is output to the second screen displayed on the display device while the second mode is being executed, switching the second mode to the first mode for a preset time The mobile terminal comprising:
Wherein,
And switching the second mode to the first mode so that a second screen displayed on the video display device is displayed on the display unit when the wireless connection between the main body and the video display device is released in the second mode The mobile terminal comprising:
Wherein,
When the wireless connection between the main body and the video display device is released in the second mode, outputs a notification icon indicating that the wireless connection is released to the display.
Wherein,
If it is determined that the power of the battery included in the main body is lower than the reference value while the second mode is being executed,
Wherein the control unit controls the display unit to output a message for switching to the first mode, and deactivates the display unit.
Wherein,
When an input for attempting to switch to the second mode is detected when it is determined that the power of the battery included in the main body is lower than the reference value while the first mode is being executed,
And controls the display device to output a notification icon indicating that the second mode can not be switched.
Wherein,
Wherein the control unit controls the screen in a mode that was executed when the display unit is inactivated when the display unit is activated again.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020140065223A KR101570424B1 (en) | 2014-05-29 | 2014-05-29 | Mobile terminal and control method for the mobile terminal |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020140065223A KR101570424B1 (en) | 2014-05-29 | 2014-05-29 | Mobile terminal and control method for the mobile terminal |
Publications (1)
Publication Number | Publication Date |
---|---|
KR101570424B1 true KR101570424B1 (en) | 2015-11-20 |
Family
ID=54844361
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020140065223A KR101570424B1 (en) | 2014-05-29 | 2014-05-29 | Mobile terminal and control method for the mobile terminal |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101570424B1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017142163A1 (en) * | 2016-02-17 | 2017-08-24 | 삼성전자 주식회사 | Display device and operation method therefor |
CN112130787A (en) * | 2019-06-25 | 2020-12-25 | 北京小米移动软件有限公司 | Electronic equipment, display signal transmission system, method and device |
CN112256371A (en) * | 2020-10-20 | 2021-01-22 | 北京字跳网络技术有限公司 | Method and device for displaying information and electronic equipment |
-
2014
- 2014-05-29 KR KR1020140065223A patent/KR101570424B1/en active IP Right Grant
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017142163A1 (en) * | 2016-02-17 | 2017-08-24 | 삼성전자 주식회사 | Display device and operation method therefor |
CN112130787A (en) * | 2019-06-25 | 2020-12-25 | 北京小米移动软件有限公司 | Electronic equipment, display signal transmission system, method and device |
CN112256371A (en) * | 2020-10-20 | 2021-01-22 | 北京字跳网络技术有限公司 | Method and device for displaying information and electronic equipment |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR20170024846A (en) | Mobile terminal and method for controlling the same | |
KR20150105845A (en) | Mobile terminal and method for controlling the same | |
KR101677644B1 (en) | Mobile terminal and method of controlling the same | |
KR20150084133A (en) | Mobile terminal and method for controlling the same | |
KR101570424B1 (en) | Mobile terminal and control method for the mobile terminal | |
KR20160122119A (en) | Mobile terminal and control method therefor | |
KR20170037431A (en) | Mobile terminal and control method for the mobile terminal | |
KR20170052190A (en) | Terminal device and controlling method thereof | |
KR20170021514A (en) | Display apparatus and controlling method thereof | |
KR101792514B1 (en) | Intelligent agent system including terminal device and controlling method thereof | |
KR20160139744A (en) | Wearable device and method for controlling the same | |
KR20160032964A (en) | Mobile terminal and method for controlling the same | |
KR101846129B1 (en) | Mobile terminal for playing content of virtual racing | |
KR20170047059A (en) | Mobile terminal for displaying information and controlling method thereof | |
KR20170071215A (en) | Mobile terminal and method for controlling the same | |
KR20170016700A (en) | Mobile terminal and method for controlling the same | |
KR101698099B1 (en) | Mobile terminal and control method for the mobile terminal | |
KR20170027439A (en) | Mobile terminal and method for controlling the same | |
KR20160116436A (en) | Mobile terminal device and display device transmitting information, controlling method thereof | |
KR20170019910A (en) | Mobile terminal and method for controlling the same | |
KR20170029330A (en) | Mobile terminal and method for controlling the same | |
KR20170011915A (en) | Mobile terminal and method for controlling the same | |
KR20160088033A (en) | Mobile terminal and method for controlling the same | |
KR20160071843A (en) | Mobile terminal and method for controlling the same | |
KR20160090083A (en) | Mobile terminal and method for controlling the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
E701 | Decision to grant or registration of patent right | ||
GRNT | Written decision to grant | ||
FPAY | Annual fee payment |
Payment date: 20191014 Year of fee payment: 5 |