KR102381068B1 - Wireless device and operating method thereof - Google Patents

Abstract

The present invention relates to an operation method when screen mirroring is connected with a plurality of wireless devices, wherein the first wireless device includes a display unit, a wireless communication unit for screen mirroring connection with a plurality of wireless devices, and a control unit for controlling the display unit and the wireless communication unit, , the controller may display a screen mirroring image according to data received from the second wireless device among the plurality of wireless devices and at least one or more source device icons corresponding to the remaining wireless devices.

Description

WIRELESS DEVICE AND OPERATING METHOD THEREOF

The present invention relates to a wireless device and method of operation thereof.

Recently, along with the development of information and communication technology, various wireless communication technologies have been developed. Among them, wireless LAN (WLAN) uses a portable terminal such as a personal digital assistant (PDA), a laptop computer, a portable multimedia player (PMP), etc. based on radio frequency technology for home, business or It is a technology that allows wireless Internet access in a specific service area.

As a direct communication technology that enables devices to easily connect to each other without a wireless access point (AP), which is basically required in the existing wireless LAN system, Wi-Fi Direct or Wi-Fi P2P (peer) -to-peer) is being discussed. According to the Wi-Fi Direct standard technology, devices can be connected without going through a complicated setting process, and in order to provide various services to users, it is possible to support the operation of exchanging data with each other at the communication speed of a general wireless LAN system.

Recently, various Wi-Fi supporting devices are used, and among them, the number of Wi-Fi Direct supporting devices capable of communicating between Wi-Fi devices without an AP is increasing. WFA (Wi-Fi Alliance) is introducing a platform that supports various services (eg, Send, Play, Display, Print, etc.) using Wi-Fi Direct link. The technology is being discussed. This may be referred to as a Wi-Fi Direct Service (WFDS).

Among WFDS, a display service includes a service that enables screen sharing between P2P devices. The screen sharing service is also called a screen mirroring technology in that a wireless device displays the same image through image transmission.

In the past, a screen mirroring connection of a wireless device was 1:1, but recently a 1:N screen mirroring connection is possible. , a method of controlling data included in a plurality of wireless devices, and the like may be problematic.

An object of the present invention is to provide a wireless device that is screen mirroring connected to another wireless device while screen mirroring is connected to one wireless device, and an operating method thereof.

An object of the present invention is to provide a wireless device that operates in connection with a plurality of wireless devices and screen mirroring, and a method of operating the same.

The first wireless device according to an embodiment of the present invention includes a display unit, a wireless communication unit for screen mirroring connection with a plurality of wireless devices, and a control unit for controlling the display unit and the wireless communication unit, and the control unit includes a second wireless device among the plurality of wireless devices. A screen mirroring image according to data received from the device and at least one source device icon corresponding to the remaining wireless devices may be displayed.

When the control unit receives a command to select a source icon corresponding to the third wireless device from among the one or more source device icons, at least one or more including a screen mirroring image according to data received from the third wireless device and the second wireless device The source device icon can be displayed.

When the plurality of wireless devices include the second wireless device and the third wireless device, the controller displays a screen mirroring image according to data received from the second wireless device and a source device icon corresponding to the third wireless device, or 3 A screen mirroring image according to data received from the wireless device and a source device icon corresponding to the second wireless device may be displayed.

The source device icon may include at least one of a device name, a model image, and a background screen image of the wireless device.

The controller may display at least one data type icon, and upon receiving a command to select any one data type icon, display at least one data icon corresponding to the selected data type icon among data stored in a plurality of wireless devices. .

The data type icon may include at least one of a video data icon, a photo data icon, and a voice data icon.

When receiving a command for selecting any one of at least one or more data icons, the controller may receive data corresponding to the selected data icon from the source device and display the screen mirroring image.

When receiving a command to swipe the screen mirroring image being displayed, the controller may display the next page of the page being displayed as the screen mirroring image as the screen mirroring image.

If there is no next page of the page being displayed as the screen mirroring image, the controller may display one page of the other wireless device as the screen mirroring image.

The controller may detect an alarm signal received from a plurality of wireless devices, and display an alarm icon indicating the detected alarm signal when the alarm signal is detected.

When receiving a command for selecting an alarm icon, the controller may receive and display alarm contents from a source device from which an alarm signal is received.

The controller may further display at least one or more alarm icons indicating unconfirmed alarm signals received on the plurality of wireless devices.

The controller may receive a data copy command for copying data from one of the plurality of wireless devices to another.

When receiving a data copy command for selecting any one data icon from the screen mirroring image being displayed and dragging and dropping it to the source device icon, the controller drags and drops data corresponding to the data icon to the source device corresponding to the dragged and dropped source device icon. can be copied to

The controller may terminate a real-time screaming protocol (RTSP) connection with other wireless devices except for the second wireless device among the plurality of wireless devices.

According to an embodiment of the present invention, there is an advantage in that a screen mirroring image can be displayed by easily selecting any one wireless device among a plurality of screen mirroring connected wireless devices. That is, there is an advantage in that it is easy to switch the screen mirroring image being displayed to the screen mirroring image of another wireless device.

According to an embodiment of the present invention, there is an advantage in that data stored in a plurality of wireless devices connected to screen mirroring can be easily displayed, copied, and managed.

According to an embodiment of the present invention, there is an advantage in that alarm signals received by a plurality of wireless devices can be easily displayed and managed.

1 is a block diagram showing the configuration of a display device according to an embodiment of the present invention.
2 is a block diagram of a remote control device according to an embodiment of the present invention.
3 shows an actual configuration example of a remote control device according to an embodiment of the present invention.
4 shows an example of using a remote control device according to an embodiment of the present invention.
5 is a block diagram illustrating a mobile terminal related to the present invention.
6 is a flowchart illustrating a method in which a wireless device operates when screen mirroring is connected to at least one other wireless device according to an embodiment of the present invention.
7 is a block diagram illustrating a screen mirroring connection of a wireless device to a plurality of wireless devices according to an embodiment of the present invention.
8 is a flowchart illustrating a method of operating when a sink device receives a connection request signal from a second source device in a state in which it is connected to the first source device according to the first embodiment of the present invention.
9A to 9D are exemplary views for explaining a method of operating the sink device according to the first embodiment described with reference to FIG. 8 when receiving a connection request signal from a second source device in a state in which it is connected to the first source device.
10 is a flowchart illustrating a method of operating when a sink device receives a connection request signal from a second source device in a state in which it is connected to a first source device according to a second embodiment of the present invention.
11A to 11D are exemplary views for explaining a method of operating the sink device according to the second embodiment described with reference to FIG. 10 when receiving a connection request signal from a second source device while being connected to the first source device.
12 is a flowchart illustrating a method of displaying a screen mirroring screen when a wireless device is screen mirroring connected to a plurality of other wireless devices according to the first embodiment of the present invention.
13A to 13B are exemplary views for explaining a method of displaying a screen mirroring screen according to the first embodiment of the present invention described with reference to FIG. 12 .
14 is a flowchart illustrating a method of displaying a screen mirroring screen when a wireless device is screen mirroring-connected to a plurality of other wireless devices according to a second embodiment of the present invention.
15A to 15D are exemplary views for explaining a method of displaying a screen mirroring screen according to the second embodiment of the present invention described with reference to FIG. 14 .
16 is a flowchart illustrating a method of displaying a screen mirroring screen when a wireless device is screen mirroring connected to a plurality of other wireless devices according to a third embodiment of the present invention.
17A to 17E are exemplary views for explaining a method of displaying a screen mirroring screen when the wireless device according to the third embodiment of the present invention described with reference to FIG. 16 is screen mirroring connected to a plurality of other wireless devices.
18A to 18C are exemplary views for explaining a method of displaying alarm information when an alarm signal is received in a screen mirroring connected wireless device according to an embodiment of the present invention.

Hereinafter, embodiments related to the present invention will be described in more detail with reference to the drawings.

A display device according to an embodiment of the present invention is, for example, an intelligent display device in which a computer support function is added to a broadcast reception function, and is faithful to a broadcast reception function and has an Internet function added thereto, such as a handwritten input device and a touch screen Alternatively, a more user-friendly interface such as a spatial remote control may be provided. In addition, it is connected to the Internet and a computer with the support of a wired or wireless Internet function, so that functions such as e-mail, web browsing, banking, or games can also be performed. A standardized general-purpose OS may be used for these various functions. Accordingly, in the display device described in the present invention, various user-friendly functions can be performed since various applications can be freely added or deleted, for example, on a general-purpose OS kernel. The display device may be, more specifically, for example, a network TV, HBBTV, smart TV, LED TV, OLED TV, and the like, and may be applied to a smart phone in some cases.

1 is a block diagram showing the configuration of a display device according to an embodiment of the present invention.

Referring to FIG. 1 , the display apparatus 100 includes a broadcast receiving unit 130 , an external device interface unit 135 , a storage unit 140 , a user input interface unit 150 , a control unit 170 , and a wireless communication unit 173 . , a display unit 180 , an audio output unit 185 , and a power supply unit 190 may be included.

The broadcast receiving unit 130 may include a tuner 131 , a demodulator 132 , and a network interface unit 133 .

The tuner 131 may tune into a specific broadcasting channel according to a channel selection command. The tuner 131 may receive a broadcast signal for a specific selected broadcast channel.

The demodulator 132 may divide the received broadcast signal into a video signal, an audio signal, and a data signal related to a broadcast program, and may restore the separated video signal, audio signal, and data signal to an outputable form.

The external device interface unit 135 may receive an application or an application list in an adjacent external device and transmit it to the control unit 170 or the storage unit 140 .

The external device interface unit 135 may provide a connection path between the display device 100 and an external device. The external device interface unit 135 may receive one or more of an image and audio output from an external device connected to the display device 100 wirelessly or by wire, and transmit it to the controller 170 . The external device interface unit 135 may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more High Definition Multimedia Interface (HDMI) terminals, and a component terminal.

An image signal of an external device input through the external device interface unit 135 may be output through the display unit 180 . A voice signal of an external device input through the external device interface unit 135 may be output through the audio output unit 185 .

The external device connectable to the external device interface unit 135 may be any one of a set-top box, a Blu-ray player, a DVD player, a game machine, a sound bar, a smart phone, a PC, a USB memory, and a home theater, but this is only an example. .

The network interface unit 133 may provide an interface for connecting the display apparatus 100 to a wired/wireless network including an Internet network. The network interface unit 133 may transmit or receive data to or from another user or other electronic device through the connected network or another network linked to the connected network.

In addition, some content data stored in the display apparatus 100 may be transmitted to another user registered in advance in the display apparatus 100 , or to a user selected from among other electronic devices or to a selected electronic device.

The network interface unit 133 may access a predetermined web page through the connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, it is possible to transmit or receive data with a corresponding server.

In addition, the network interface unit 133 may receive content or data provided by a content provider or a network operator. That is, the network interface unit 133 may receive contents such as movies, advertisements, games, VODs, broadcast signals, etc. and related information provided from the contents provider or the network provider through the network.

Also, the network interface unit 133 may receive firmware update information and an update file provided by a network operator, and transmit data to the Internet or a content provider or network operator.

The network interface unit 133 may select and receive a desired application from among applications open to the public through a network.

The storage unit 140 may store a program for each signal processing and control in the control unit 170 , and may store a signal-processed image, audio, or data signal.

In addition, the storage unit 140 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface unit 135 or the network interface unit 133 , and may perform a predetermined function through the channel storage function. It is also possible to store information about the image.

The storage unit 140 may store an application or an application list input from the external device interface unit 135 or the network interface unit 133 .

The display apparatus 100 may reproduce content files (movie files, still image files, music files, document files, application files, etc.) stored in the storage unit 140 and provide them to the user.

The user input interface unit 150 may transmit a signal input by the user to the control unit 170 or may transmit a signal from the control unit 170 to the user. For example, the user input interface unit 150 is Bluetooth (Bluetooth), WB (Ultra Wideband), ZigBee (ZigBee) method, according to various communication methods such as RF (Radio Frequency) communication method or infrared (IR) communication method, Control signals such as power on/off, channel selection, and screen setting may be received and processed from the remote control device 200 , or a control signal from the control unit 170 may be transmitted to the remote control device 200 .

Also, the user input interface unit 150 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a setting value to the control unit 170 .

The image signal processed by the controller 170 may be input to the display unit 180 and displayed as an image corresponding to the image signal. Also, the image signal processed by the control unit 170 may be input to an external output device through the external device interface unit 135 .

The audio signal processed by the control unit 170 may be audio output to the audio output unit 185 . In addition, the audio signal processed by the control unit 170 may be input to an external output device through the external device interface unit 135 .

In addition, the controller 170 may control overall operations within the display apparatus 100 .

In addition, the control unit 170 may control the display apparatus 100 according to a user command input through the user input interface unit 150 or an internal program, and access the network to display an application or a list of applications desired by the user. You can make it available for download in (100).

The control unit 170 allows the user-selected channel information to be output through the display unit 180 or the audio output unit 185 together with the processed image or audio signal.

In addition, the control unit 170 according to the external device image reproduction command received through the user input interface unit 150, from an external device input through the external device interface unit 135, for example, a camera or camcorder, An image signal or an audio signal may be output through the display unit 180 or the audio output unit 185 .

Meanwhile, the controller 170 may control the display unit 180 to display an image, for example, a broadcast image input through the tuner 131 or an external input input through the external device interface unit 135 . An image, an image input through the network interface unit, or an image stored in the storage unit 140 may be controlled to be displayed on the display unit 180 . In this case, the image displayed on the display unit 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

In addition, the control unit 170 may control the content stored in the display apparatus 100, received broadcast content, or external input content input from the outside to be reproduced, and the content may include a broadcast image, an external input image, an audio file, It may be in various forms, such as a still image, a connected web screen, and a document file.

The wireless communication unit 173 may communicate with an external device through wired or wireless communication. The wireless communication unit 173 may perform short range communication with an external device. To this end, the wireless communication unit 173 is Bluetooth (Bluetooth™), RFID (Radio Frequency Identification), infrared communication (Infrared Data Association; IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi At least one of (Wireless-Fidelity), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-distance communication. Such a wireless communication unit 173 is between the display apparatus 100 and a wireless communication system, between the display apparatus 100 and another display apparatus 100, or the display apparatus 100 through wireless area networks. It is possible to support wireless communication between networks in which the display apparatus 100 or an external server is located. The local area networks may be local area networks (Wireless Personal Area Networks).

Here, the other display apparatus 100 is a wearable device capable of exchanging (or interworking with) data with the display apparatus 100 according to the present invention, for example, a smart watch, smart glasses. (smart glass), HMD (head mounted display)), it can be a mobile terminal such as a smart phone. The wireless communication unit 173 may detect (or recognize) a communicable wearable device in the vicinity of the display apparatus 100 . Furthermore, when the detected wearable device is a device authenticated to communicate with the display apparatus 100 according to the present invention, the control unit 170 transmits at least a portion of data processed by the display apparatus 100 to the wireless communication unit 173 . It can be transmitted to a wearable device through Accordingly, the user of the wearable device may use data processed by the display apparatus 100 through the wearable device.

The display unit 180 converts the image signal, the data signal, the OSD signal processed by the controller 170, or the image signal and the data signal received from the external device interface unit 135 into R, G, and B signals, respectively, and drives them. signal can be generated.

Meanwhile, since the display device 100 shown in FIG. 1 is only an embodiment of the present invention. Some of the illustrated components may be integrated, added, or omitted according to the specifications of the actually implemented display apparatus 100 .

That is, two or more components may be combined into one component, or one component may be subdivided into two or more components as needed. In addition, the function performed by each block is for explaining the embodiment of the present invention, and the specific operation or device does not limit the scope of the present invention.

According to another embodiment of the present invention, the display apparatus 100 does not include a tuner 131 and a demodulator 132, and does not include a network interface unit 133 or an external device interface unit ( 135), the image may be received and reproduced.

For example, the display apparatus 100 is divided into an image processing apparatus such as a set-top box for receiving contents according to a broadcast signal or various network services, and a content reproduction apparatus which reproduces content input from the image processing apparatus. can be implemented.

In this case, the operating method of the display apparatus according to an embodiment of the present invention, which will be described below, includes not only the display apparatus 100 as described with reference to FIG. 1 , but also an image processing apparatus such as the separated set-top box or a display unit ( 180) and the audio output unit 185 may be performed by any one of the content reproducing apparatus.

Next, a remote control apparatus according to an embodiment of the present invention will be described with reference to FIGS. 2 to 3 .

2 is a block diagram of a remote control apparatus according to an embodiment of the present invention, and FIG. 3 shows an actual configuration example of the remote control apparatus 200 according to an embodiment of the present invention.

First, referring to FIG. 2 , the remote control device 200 includes a fingerprint recognition unit 210 , a wireless communication unit 220 , a user input unit 230 , a sensor unit 240 , an output unit 250 , and a power supply unit 260 . ), a storage unit 270 , a control unit 280 , and a voice acquisition unit 290 .

Referring to FIG. 2 , the wireless communication unit 220 transmits/receives a signal to and from any one of the display devices according to the embodiments of the present invention described above.

The remote control device 200 includes an RF module 221 capable of transmitting and receiving signals to and from the display device 100 according to the RF communication standard, and capable of transmitting and receiving signals to and from the display device 100 according to the IR communication standard. An IR module 223 may be provided. In addition, the remote control device 200 may include a Bluetooth module 225 capable of transmitting and receiving signals to and from the display device 100 according to the Bluetooth communication standard. In addition, the remote control device 200 includes an NFC module 227 capable of transmitting and receiving signals to and from the display device 100 according to a near field communication (NFC) communication standard, and a display according to a wireless LAN (WLAN) communication standard. A WLAN module 229 capable of transmitting and receiving signals to and from the device 100 may be provided.

In addition, the remote control device 200 transmits a signal containing information about the movement of the remote control device 200 to the display device 100 through the wireless communication unit 220 .

Meanwhile, the remote control device 200 may receive a signal transmitted by the display device 100 through the RF module 221 , and if necessary, power on/off the display device 100 through the IR module 223 . It can transmit commands about off, channel change, volume change, and the like.

The user input unit 230 may include a keypad, a button, a touch pad, or a touch screen. The user may input a command related to the display apparatus 100 to the remote control apparatus 200 by manipulating the user input unit 230 . When the user input unit 230 includes a hard key button, the user may input a command related to the display apparatus 100 to the remote control apparatus 200 through a push operation of the hard key button. This will be described with reference to FIG. 3 .

Referring to FIG. 3 , the remote control device 200 may include a plurality of buttons. The plurality of buttons include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a volume control button 235, a voice recognition button 236, It may include a channel change button 237 , a confirmation button 238 , and a back button 239 .

The fingerprint recognition button 212 may be a button for recognizing a user's fingerprint. As an embodiment, the fingerprint recognition button 212 may perform a push operation, and thus may receive a push operation and a fingerprint recognition operation. The power button 231 may be a button for turning on/off the power of the display apparatus 100 . The home button 232 may be a button for moving to the home screen of the display apparatus 100 . The live button 233 may be a button for displaying a real-time broadcast program. The external input button 234 may be a button for receiving an external input connected to the display apparatus 100 . The volume control button 235 may be a button for adjusting the level of the volume output by the display apparatus 100 . The voice recognition button 236 may be a button for receiving a user's voice and recognizing the received voice. The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button 238 may be a button for selecting a specific function, and the back button 239 may be a button for returning to a previous screen.

Fig. 2 will be described again.

When the user input unit 230 includes a touch screen, the user may input a command related to the display apparatus 100 to the remote control apparatus 200 by touching a soft key of the touch screen. In addition, the user input unit 230 may include various types of input means that the user can operate, such as a scroll key or a jog key, and this embodiment does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243 , and the gyro sensor 241 may sense information regarding the movement of the remote control device 200 .

For example, the gyro sensor 241 may sense information about the operation of the remote control device 200 based on the x, y, and z axes, and the acceleration sensor 243 is the moving speed of the remote control device 200 . It is possible to sense information about the Meanwhile, the remote control device 200 may further include a distance measuring sensor, so that the distance to the display unit 180 of the display device 100 may be sensed.

The output unit 250 may output an image or audio signal corresponding to a manipulation of the user input unit 230 or a signal transmitted from the display apparatus 100 . Through the output unit 250 , the user may recognize whether the user input unit 230 is operated or whether the display apparatus 100 is controlled.

For example, the output unit 250 includes an LED module 251 that is turned on when the user input unit 230 is manipulated or a signal is transmitted and received with the display device 100 through the wireless communication unit 220, and a vibration module that generates vibration ( 253), a sound output module 255 for outputting a sound, or a display module 257 for outputting an image may be provided.

In addition, the power supply unit 260 supplies power to the remote control device 200, and when the remote control device 200 does not move for a predetermined period of time, stops the power supply, thereby reducing power wastage. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs and application data required for control or operation of the remote control device 200 . If the remote control device 200 wirelessly transmits and receives signals through the display device 100 and the RF module 221 , the remote control device 200 and the display device 100 transmit and receive signals through a predetermined frequency band. .

The control unit 280 of the remote control device 200 stores information about a frequency band in which a signal can be wirelessly transmitted and received with the display device 100 paired with the remote control device 200 in the storage unit 270 and is referenced. can do.

The controller 280 controls all matters related to the control of the remote control device 200 . The control unit 280 transmits a signal corresponding to a predetermined key operation of the user input unit 230 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 240 to the display device ( 100) can be transmitted.

Also, the voice acquisition unit 290 of the remote control device 200 may acquire a voice.

The voice acquisition unit 290 may include at least one microphone 291 , and may acquire a voice through the microphone 291 .

Next, FIG. 4 will be described.

4 shows an example of using a remote control device according to an embodiment of the present invention.

4A illustrates that a pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180 .

The user may move or rotate the remote control device 200 up, down, left and right. The pointer 205 displayed on the display unit 180 of the display apparatus 100 corresponds to the movement of the remote control apparatus 200 . As shown in the drawing, the remote control apparatus 200 may be called a space remote controller because the corresponding pointer 205 is moved and displayed according to movement in 3D space.

4B illustrates that when the user moves the remote control apparatus 200 to the left, the pointer 205 displayed on the display unit 180 of the display apparatus 100 also moves to the left correspondingly.

Information on the movement of the remote control device 200 sensed through the sensor of the remote control device 200 is transmitted to the display device 100 . The display apparatus 100 may calculate the coordinates of the pointer 205 from information about the movement of the remote control apparatus 200 . The display apparatus 100 may display the pointer 205 to correspond to the calculated coordinates.

4C illustrates a case in which the user moves the remote control device 200 away from the display unit 180 while pressing a specific button in the remote control device 200 . Accordingly, the selected area in the display unit 180 corresponding to the pointer 205 may be zoomed in and displayed.

Conversely, when the user moves the remote control apparatus 200 closer to the display unit 180 , the selected area in the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed.

Meanwhile, when the remote control apparatus 200 moves away from the display unit 180 , the selection area is zoomed out, and when the remote control apparatus 200 approaches the display unit 180 , the selection area may be zoomed in.

In addition, while a specific button in the remote control device 200 is pressed, recognition of vertical and horizontal movements may be excluded. That is, when the remote control device 200 moves away from or close to the display unit 180 , up, down, left, and right movements are not recognized, but only forward and backward movements may be recognized. In a state in which a specific button in the remote control device 200 is not pressed, only the pointer 205 moves according to the up, down, left, and right movements of the remote control device 200 .

Meanwhile, the moving speed or moving direction of the pointer 205 may correspond to the moving speed or moving direction of the remote control device 200 .

Meanwhile, in the present specification, a pointer refers to an object displayed on the display unit 180 in response to an operation of the remote control device 200 . Accordingly, objects of various shapes other than the arrow shape shown in the drawing are possible with the pointer 205 . For example, it may be a concept including a dot, a cursor, a prompt, a thick outline, and the like. In addition, the pointer 205 may be displayed corresponding to any one point among a horizontal axis and a vertical axis on the display unit 180, and may also be displayed corresponding to a plurality of points such as a line and a surface. Do.

Next, a configuration of a mobile terminal related to the present invention will be described with reference to FIG. 5 .

5 is a block diagram illustrating a mobile terminal related to the present invention.

Mobile terminal 500 is a wireless communication

It may include a bride 510 , an input unit 520 , a sensing unit 540 , an output unit 550 , an interface unit 560 , a memory 570 , a control unit 580 , and a power supply unit 590 . The components shown in FIG. 5 are not essential for implementing the mobile terminal, and thus the mobile terminal described in this specification may have more or fewer components than those listed above.

More specifically, among the components, the wireless communication unit 510 is between the mobile terminal 500 and the wireless communication system, between the mobile terminal 500 and another mobile terminal 500 , or between the mobile terminal 500 and an external server. It may include one or more modules that enable wireless communication between them. In addition, the wireless communication unit 510 may include one or more modules for connecting the mobile terminal 500 to one or more networks.

The wireless communication unit 510 may include at least one of a broadcast reception module 511 , a mobile communication module 512 , a wireless Internet module 513 , a short-range communication module 514 , and a location information module 515 .

The input unit 520 includes a camera 521 or image input unit for inputting an image signal, a microphone 522 or an audio input unit for inputting an audio signal, and a user input unit 523 for receiving information from a user, for example, , a touch key, a push key, etc.). The voice data or image data collected by the input unit 520 may be analyzed and processed as a user's control command.

The sensing unit 540 may include one or more sensors for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 540 may include a proximity sensor 541, an illumination sensor 542, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity. Sensor (G-sensor), gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor: infrared sensor), fingerprint recognition sensor (finger scan sensor), ultrasonic sensor , optical sensor (eg, camera (see 121), microphone (see 122)), battery gauge, environmental sensor (eg, barometer, hygrometer, thermometer, radiation sensor, heat It may include at least one of a detection sensor, a gas detection sensor, etc.), a chemical sensor (eg, an electronic nose, a healthcare sensor, a biometric sensor, etc.) On the other hand, the mobile terminal disclosed herein may include these sensors Among them, information sensed by at least two or more sensors may be combined and utilized.

The output unit 550 is for generating an output related to visual, auditory or tactile sense, and includes at least one of a display unit 551 , a sound output unit 552 , a haptic module 553 , and an optical output unit 554 . can do. The display unit 551 may implement a touch screen by forming a mutually layered structure with the touch sensor or integrally formed therewith. Such a touch screen may function as a user input unit 523 providing an input interface between the mobile terminal 500 and a user, and may provide an output interface between the mobile terminal 500 and a user.

The interface unit 560 serves as a passage with various types of external devices connected to the mobile terminal 500 . This interface unit 560, a wired / wireless headset port (port), an external charger port (port), a wired / wireless data port (port), a memory card (memory card) port, for connecting a device equipped with an identification module It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In response to the connection of the external device to the interface unit 560 , the mobile terminal 500 may perform appropriate control related to the connected external device.

In addition, the memory 570 stores data supporting various functions of the mobile terminal 500 . The memory 570 may store a plurality of application programs (or applications) driven in the mobile terminal 500 , data for operation of the mobile terminal 500 , and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the mobile terminal 500 from the time of shipment for basic functions (eg, incoming calls, outgoing functions, message reception, and outgoing functions) of the mobile terminal 500 . Meanwhile, the application program may be stored in the memory 570 , installed on the mobile terminal 500 , and driven to perform an operation (or function) of the mobile terminal by the controller 580 .

In addition to the operation related to the application program, the controller 580 generally controls the overall operation of the mobile terminal 500 . The controller 580 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 570 .

In addition, the controller 580 may control at least some of the components described with reference to FIG. 5 in order to drive an application program stored in the memory 570 . Furthermore, in order to drive the application program, the controller 580 may operate at least two or more of the components included in the mobile terminal 500 in combination with each other.

The power supply unit 590 receives external power and internal power under the control of the control unit 580 and supplies power to each component included in the mobile terminal 500 . The power supply unit 590 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the respective components may operate in cooperation with each other in order to implement an operation, control, or control method of a mobile terminal according to various embodiments to be described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 570 .

Hereinafter, before looking at various embodiments implemented through the mobile terminal 500 as described above, the above-listed components will be described in more detail with reference to FIG. 5 .

First, referring to the wireless communication unit 510 , the broadcast reception module 511 of the wireless communication unit 510 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more of the broadcast reception modules may be provided to the mobile terminal 500 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 512 includes technical standards or communication methods for mobile communication (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV -Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE-A (Long Term Evolution-Advanced, etc.) transmits and receives a radio signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network constructed according to.

The wireless signal may include various types of data according to transmission/reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 513 refers to a module for wireless Internet access, and may be built-in or external to the mobile terminal 500 . The wireless Internet module 513 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

As wireless Internet technology, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), etc., and the wireless Internet module ( 513) transmits and receives data according to at least one wireless Internet technology within a range including Internet technologies not listed above.

From the point of view that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the wireless Internet module 513 that performs wireless Internet access through the mobile communication network ) may be understood as a type of the mobile communication module 512 .

The short-range communication module 514 is for short-range communication, and includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, NFC. At least one of (Near Field Communication), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-range communication. The short-distance communication module 514 is, between the mobile terminal 500 and the wireless communication system, between the mobile terminal 500 and another mobile terminal 500, or the mobile terminal 500 via wireless area networks (Wireless Area Networks). ) and another mobile terminal (100, or an external server) can support wireless communication between the network located. The local area network may be local area networks (Wireless Personal Area Networks).

Here, the other mobile terminal 500 is capable of exchanging data (or interworking) with the mobile terminal 500 according to the present invention, a display device 100, a wearable device, for example, a smart It can be a watch (smartwatch), smart glass (smart glass), HMD (head mounted display)). The short-distance communication module 514 may detect (or recognize) a display apparatus 100 , a wearable device, etc. capable of communicating with the mobile terminal 500 in the vicinity of the mobile terminal 500 . Furthermore, when the detected display apparatus 100 or the wearable device is a device that is authenticated to communicate with the mobile terminal 500 according to the present invention, the controller 580 may control at least a portion of data processed by the mobile terminal 500 . may be transmitted to the wearable device through the short-range communication module 514 . Accordingly, the user of the wearable device may use data processed by the mobile terminal 500 through the wearable device. For example, according to this, when a call is received in the mobile terminal 500, the user performs a phone call through the wearable device, or when a message is received in the mobile terminal 500, the user receives the received call through the wearable device. It is possible to check the message.

The location information module 515 is a module for acquiring a location (or current location) of a mobile terminal, and a representative example thereof includes a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the mobile terminal utilizes a GPS module, it can acquire the location of the mobile terminal by using a signal transmitted from a GPS satellite. As another example, if the mobile terminal utilizes the Wi-Fi module, the location of the mobile terminal may be obtained based on information of the Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 515 may perform any function of the other modules of the wireless communication unit 510 to obtain data on the location of the mobile terminal as a substitute or additionally. The location information module 515 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 520 is for input of image information (or signal), audio information (or signal), data, or information input from a user. Alternatively, a plurality of cameras 521 may be provided. The camera 521 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 551 or stored in the memory 570 . On the other hand, a plurality of cameras 521 provided in the mobile terminal 500 may be arranged to form a matrix structure, and through the cameras 521 forming the matrix structure in this way, various angles or focal points are applied to the mobile terminal 500 . A plurality of image information with can be input. Also, the plurality of cameras 521 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 522 processes an external sound signal as electrical voice data. The processed voice data may be utilized in various ways according to a function (or a running application program) being performed by the mobile terminal 500 . Meanwhile, various noise removal algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 522 .

The user input unit 523 is for receiving information from the user, and when information is input through the user input unit 523 , the controller 580 may control the operation of the mobile terminal 500 to correspond to the input information. . The user input unit 523 is a mechanical input means (or a mechanical key, for example, a button located on the front, rear or side of the mobile terminal 500, a dome switch, a jog wheel, jog switch, etc.) and a touch input means. As an example, the touch input means consists of a virtual key, a soft key, or a visual key displayed on the touch screen through software processing, or a part other than the touch screen. It may be made of a touch key (touch key) disposed on the. On the other hand, the virtual key or the visual key, it is possible to be displayed on the touch screen while having various forms, for example, graphic (graphic), text (text), icon (icon), video (video) or these can be made by a combination of

On the other hand, the sensing unit 540 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a sensing signal corresponding thereto. The controller 580 may control the driving or operation of the mobile terminal 500 or perform data processing, functions, or operations related to an application program installed in the mobile terminal 500 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 540 will be described in more detail.

First, the proximity sensor 541 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor 541 may be disposed in an inner region of the mobile terminal covered by the touch screen as described above or near the touch screen.

Examples of the proximity sensor 541 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, an infrared proximity sensor, and the like. When the touch screen is capacitive, the proximity sensor 541 may be configured to detect the proximity of an object having conductivity by a change in an electric field according to the proximity of the object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of description, the act of approaching an object on the touch screen without contacting it so that the object is recognized that it is located on the touch screen is called “proximity touch”, and the touch The act of actually touching an object on the screen is called "contact touch". The position where the object is touched in proximity on the touch screen means a position where the object is perpendicular to the touch screen when the object is touched in proximity. The proximity sensor 541 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.) there is. On the other hand, the controller 580 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern detected through the proximity sensor 541 as described above, and furthermore, provides visual information corresponding to the processed data. It can be printed on the touch screen. Furthermore, the controller 580 may control the mobile terminal 500 to process different operations or data (or information) according to whether a touch to the same point on the touch screen is a proximity touch or a contact touch. .

The touch sensor receives a touch (or touch input) applied to the touch screen (or the display unit 551) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. detect

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific part of the touch screen or a change in capacitance occurring in a specific part of the touch screen into an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, an electrostatic capacitance at the time of touch, etc. in which a touch object applying a touch on the touch screen is touched on the touch sensor. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen, a stylus pen, or a pointer.

As such, when there is a touch input to the touch sensor, a signal(s) corresponding thereto is sent to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the controller 580 . Accordingly, the control unit 580 can know which area of the display unit 551 has been touched, and the like. Here, the touch controller may be a component separate from the controller 580 , or may be the controller 580 itself.

Meanwhile, the controller 580 may perform different controls or may perform the same control according to the type of the touch object that touches the touch screen (or a touch key provided other than the touch screen). Whether to perform different controls or the same control according to the type of the touch object may be determined according to the current operating state of the mobile terminal 500 or a running application program.

On the other hand, the above-described touch sensor and proximity sensor independently or in combination, a short (or tap) touch on the touch screen (short touch), long touch (long touch), multi touch (multi touch), drag touch (drag touch) ), flick touch, pinch-in touch, pinch-out touch, swype touch, hovering touch, etc. It can sense touch.

The ultrasonic sensor may recognize position information of a sensing target by using ultrasonic waves. Meanwhile, the control unit 580 may calculate the position of the wave source through information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source may be calculated using the property that light is much faster than ultrasonic waves, that is, the time at which light arrives at the optical sensor is much faster than the time at which ultrasonic waves reach the ultrasonic sensor. More specifically, the position of the wave source may be calculated using a time difference from the time that the ultrasonic wave arrives using light as a reference signal.

On the other hand, the camera 521 as seen in the configuration of the input unit 520 includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

The camera 521 and the laser sensor may be combined to detect a touch of a sensing target for a 3D stereoscopic image. The photo sensor may be stacked on the display device, and the photo sensor is configured to scan the motion of a sensing target close to the touch screen. More specifically, the photo sensor mounts a photo diode and TR (transistor) in rows/columns and scans the contents placed on the photo sensor using an electrical signal that changes according to the amount of light applied to the photo diode. That is, the photo sensor calculates the coordinates of the sensing target according to the amount of change in light, and through this, location information of the sensing target can be obtained.

The display unit 551 displays (outputs) information processed by the mobile terminal 500 . For example, the display unit 551 may display execution screen information of an application program driven in the mobile terminal 500 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information. .

Also, the display unit 551 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glassesless method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

The sound output unit 552 may output audio data received from the wireless communication unit 510 or stored in the memory 570 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 552 also outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 500 . The sound output unit 552 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 553 generates various tactile effects that the user can feel. A representative example of the tactile effect generated by the haptic module 553 may be vibration. The intensity and pattern of vibration generated by the haptic module 553 may be controlled by a user's selection or setting of the controller. For example, the haptic module 553 may synthesize and output different vibrations or output them sequentially.

In addition to vibration, the haptic module 553 is configured to respond to stimuli such as a pin arrangement that moves vertically with respect to the contact skin surface, a jet force or suction force of air through a nozzle or an inlet, a brush against the skin surface, contact of an electrode, an electrostatic force, etc. Various tactile effects can be generated, such as the effect of heat absorption and the effect of reproducing a feeling of coolness and warmth using an element capable of absorbing heat or generating heat.

The haptic module 553 may not only deliver a tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through a muscle sense such as a finger or arm. Two or more haptic modules 553 may be provided according to the configuration of the mobile terminal 500 .

The light output unit 554 outputs a signal for notifying the occurrence of an event by using the light of the light source of the mobile terminal 500 . Examples of the event generated in the mobile terminal 500 may be message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the optical output unit 554 is implemented as the mobile terminal emits light of a single color or a plurality of colors toward the front or rear. The signal output may be terminated when the mobile terminal detects the user's event confirmation.

The interface unit 560 serves as a passage with all external devices connected to the mobile terminal 500 . The interface unit 560 receives data from an external device, receives power and transmits it to each component inside the mobile terminal 500 , or transmits data inside the mobile terminal 500 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module (port), an audio I/O (Input/Output) port, a video I/O (Input/Output) port, an earphone port, etc. may be included in the interface unit 560 .

On the other hand, the identification module is a chip storing various information for authenticating the usage authority of the mobile terminal 500, a user identification module (UIM), a subscriber identity module (subscriber identity module; SIM), universal user authentication It may include a universal subscriber identity module (USIM) and the like. A device equipped with an identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the terminal 100 through the interface unit 560 .

In addition, the interface unit 560 is a passage through which power from the cradle is supplied to the mobile terminal 500 when the mobile terminal 500 is connected to an external cradle, or is input from the cradle by a user. Various command signals may be a path through which the mobile terminal 500 is transmitted. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile terminal 500 is correctly mounted on the cradle.

The memory 570 may store a program for the operation of the controller 580 and may temporarily store input/output data (eg, phonebook, message, still image, moving picture, etc.). The memory 570 may store data related to vibration and sound of various patterns output when a touch input on the touch screen is input.

The memory 570 is a flash memory type, a hard disk type, a solid state disk type, a silicon disk drive type, a multimedia card micro type. ), card-type memory (such as SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EEPROM) -only memory), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk may include at least one type of storage medium. The mobile terminal 500 may be operated in relation to a web storage that performs the storage function of the memory 570 on the Internet.

Meanwhile, as described above, the controller 580 controls the operation related to the application program and the general operation of the mobile terminal 500 . For example, if the state of the mobile terminal satisfies a set condition, the controller 580 may execute or release a lock state that restricts input of a user's control command to applications.

In addition, the controller 580 performs control and processing related to voice calls, data communication, video calls, etc., or performs pattern recognition processing capable of recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively. can Furthermore, the controller 580 may control any one or a plurality of components described above in order to implement various embodiments described below on the mobile terminal 500 according to the present invention.

The power supply unit 590 receives external power and internal power under the control of the control unit 580 to supply power required for operation of each component. The power supply unit 590 includes a battery, and the battery may be a built-in battery configured to be rechargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 590 may include a connection port, and the connection port may be configured as an example of the interface 160 to which an external charger that supplies power for charging the battery is electrically connected.

As another example, the power supply unit 590 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 590 uses one or more of an inductive coupling method based on a magnetic induction phenomenon or a resonance coupling method based on an electromagnetic resonance phenomenon from an external wireless power transmitter. power can be transmitted.

Meanwhile, various embodiments below may be implemented in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

Next, a communication system that can be implemented through the mobile terminal 500 according to the present invention will be described.

First, the communication system may use different air interfaces and/or physical layers. For example, the air interfaces available by a communication system include Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA). ), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A)), Global System for Mobile Communications (GSM), etc. may be included.

Hereinafter, for convenience of description, the description will be limited to CDMA. However, it is apparent that the present invention can be applied to all communication systems including CDMA wireless communication systems as well as OFDM (Orthogonal Frequency Division Multiplexing) wireless communication systems.

The CDMA wireless communication system includes at least one terminal 100, at least one base station (Base Station, BS (also referred to as Node B or Evolved Node B)), and at least one base station controller (Base Station Controllers, BSCs). ), and a mobile switching center (MSC). The MSC is configured to be connected to a Public Switched Telephone Network (PSTN) and BSCs. BSCs may be connected in pairs with a BS through a backhaul line. The backhaul line may be provided according to at least one of E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, and xDSL. Accordingly, a plurality of BSCs may be included in a CDMA wireless communication system.

Each of the plurality of BSs may include at least one sector, and each sector may include an omni-directional antenna or an antenna pointing in a specific radial direction from the BS. In addition, each sector may include two or more antennas of various types. Each BS may be configured to support multiple frequency assignments, and each of the multiple frequency assignments may have a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sector and frequency allocation may be referred to as a CDMA channel. BSs may be referred to as Base Station Transceiver Subsystems (BTSs). In this case, one BSC and at least one BS may be collectively referred to as a “base station”. A base station may also refer to a “cell site”. Alternatively, each of a plurality of sectors for a specific BS may be referred to as a plurality of cell sites.

A broadcast transmitter (BT) transmits a broadcast signal to the terminals 100 operating in the system. The broadcast reception module 511 shown in FIG. 5 is provided in the terminal 500 to receive a broadcast signal transmitted by the BT.

In addition, a global positioning system (GPS) for confirming the location of the mobile terminal 500 may be linked to the CDMA wireless communication system. The satellite helps to locate the mobile terminal 500 . Useful location information may be obtained by two or fewer or more satellites. Here, the location of the mobile terminal 500 may be tracked using not only the GPS tracking technology but also all techniques capable of tracking the location. In addition, at least one of the GPS satellites may optionally or additionally be responsible for satellite DMB transmission.

The location information module 515 provided in the mobile terminal is for detecting, calculating, or identifying the location of the mobile terminal, and representative examples may include a Global Position System (GPS) module and a Wireless Fidelity (WiFi) module. If necessary, the location information module 515 may perform any function of the other modules of the wireless communication unit 510 to obtain data on the location of the mobile terminal as a substitute or additionally.

The GPS module calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information, thereby accurately calculating three-dimensional current location information according to latitude, longitude, and altitude. . Currently, a method of calculating position and time information using three satellites and correcting errors in the calculated position and time information using another one satellite is widely used. In addition, the GPS module may calculate the speed information by continuously calculating the current location in real time. However, it is difficult to accurately measure the position of the mobile terminal using the GPS module in the shaded area of the satellite signal, such as indoors. Accordingly, in order to compensate for positioning by the GPS method, a WiFi Positioning System (WPS) may be utilized.

A WiFi positioning system (WPS) uses a WiFi module provided in the mobile terminal 500 and a wireless AP (Wireless Access Point) that transmits or receives a wireless signal with the WiFi module, the mobile terminal 500 As a technology for tracking the location of a wireless network, it refers to a wireless local area network (WLAN)-based positioning technology using WiFi.

The Wi-Fi location tracking system may include a Wi-Fi positioning server, a mobile terminal 500, a wireless AP connected to the mobile terminal 500, and a database in which arbitrary wireless AP information is stored.

The mobile terminal 500 connected to the wireless AP may transmit a location information request message to the Wi-Fi location location server.

The Wi-Fi positioning server extracts information on the wireless AP connected to the mobile terminal 500 based on the location information request message (or signal) of the mobile terminal 500 . Information on the wireless AP connected to the mobile terminal 500 may be transmitted to the Wi-Fi positioning server through the mobile terminal 500 or may be transmitted from the wireless AP to the Wi-Fi positioning server.

Based on the location information request message of the mobile terminal 500, the extracted wireless AP information is MAC Address, Service Set IDentification (SSID), Received Signal Strength Indicator (RSSI), Reference Signal Received Power (RSRP), RSRQ ( Reference Signal Received Quality), channel information, Privacy, Network Type, signal strength, and noise strength may be at least one.

As described above, the Wi-Fi positioning server may receive information on a wireless AP connected to the mobile terminal 500 and extract wireless AP information corresponding to the wireless AP to which the mobile terminal is connected from a pre-established database. At this time, the information of arbitrary wireless APs stored in the database includes MAC Address, SSID, channel information, Privacy, Network Type, latitude and longitude coordinates of the wireless AP, the name of the building where the wireless AP is located, the number of floors, and detailed indoor location information (GPS coordinates). available), the AP owner's address, phone number, and the like. In this case, in order to remove a mobile AP or a wireless AP provided using an illegal MAC address in the positioning process, the Wi-Fi positioning server may extract only a predetermined number of wireless AP information in order of increasing RSSI.

Thereafter, the Wi-Fi positioning server may extract (or analyze) the location information of the mobile terminal 500 by using at least one wireless AP information extracted from the database. By comparing the included information and the received wireless AP information, the location information of the mobile terminal 500 is extracted (or analyzed).

As a method for extracting (or analyzing) the location information of the mobile terminal 500, a Cell-ID method, a fingerprint method, a triangulation method, a landmark method, etc. may be utilized.

The Cell-ID method is a method of determining the location of a wireless AP having the strongest signal strength among surrounding wireless AP information collected by the mobile terminal as the location of the mobile terminal. It has the advantages of being simple to implement, not requiring additional cost, and being able to quickly obtain location information, but has a disadvantage in that the positioning accuracy is lowered when the installation density of the wireless AP is low.

The fingerprint method is a method of collecting signal strength information by selecting a reference position in a service area, and estimating the position through signal strength information transmitted from a mobile terminal based on the collected information. In order to use the fingerprint method, it is necessary to make a database of propagation characteristics in advance.

The triangulation method is a method of calculating the position of a mobile terminal based on the coordinates of at least three wireless APs and the distance between the mobile terminal. In order to measure the distance between the mobile terminal and the wireless AP, the signal strength is converted into distance information, the time at which a wireless signal is transmitted (Time of Arrival, ToA), and the time difference of the signal is transmitted (Time Difference of Arrival, TDoA) , the angle at which the signal is transmitted (Angle of Arrival, AoA), etc. may be used.

The landmark method is a method of measuring the location of a mobile terminal using a landmark transmitter that knows the location.

In addition to the enumerated methods, various algorithms may be utilized as a method for extracting (or analyzing) location information of a mobile terminal.

The extracted location information of the mobile terminal 500 is transmitted to the mobile terminal 500 through the Wi-Fi positioning server, so that the mobile terminal 500 can acquire the location information.

The mobile terminal 500 may acquire location information by being connected to at least one wireless AP. In this case, the number of wireless APs required to acquire the location information of the mobile terminal 500 may be variously changed according to the wireless communication environment in which the mobile terminal 500 is located.

Next, a method in which at least one wireless device is connected to one wireless device by screen mirroring and operates will be described with reference to FIG. 6 . Here, the wireless device may include the display apparatus 100 and the mobile terminal 500 described above. Accordingly, the wireless device may include all of the components of the display apparatus 100 described with reference to FIG. 1 or all of the components of the mobile terminal 500 described with reference to FIG. 5 .

The screen mirroring connection may mean connecting to enable a screen sharing service between wireless devices using Wi-Fi Direct Service (WFDS).

A device that supports streaming of multimedia content through a P2P link among a plurality of screen mirroring connected wireless devices is called a source device, and a device that receives and renders multimedia content from a source device through a P2P link is called a sink device. can be called According to an embodiment, the source device may be the mobile terminal 500 shown in FIG. 5 , and the sink device may be the display device 100 shown in FIG. 1 . However, this is merely exemplary and need not be limited thereto.

Referring to FIG. 6 , the sink device may perform a screen mirroring connection with the first source device ( S10 ).

Here, the sink device, the first source device, and the second source device to be described later may be a screen mirroring-connectable wireless device. For convenience of description, a device that receives and renders multimedia content among wireless devices is referred to as a sink device and a device that supports content streaming is referred to as a source device, and the description is not limited thereto.

The wireless communication unit of the sink device may receive a screen mirroring connection request signal from the first source device, and may perform screen mirroring connection with the first source device.

The wireless communication unit of the sink device may receive a connection request signal from the second source device (S20).

The sink device may receive a screen mirroring connection request signal from the second source device while screen mirroring is connected to the first source device.

Here, the screen mirroring connection request signal may be a signal that one wireless device requests a screen mirroring connection to another wireless device.

The sink device may perform screen mirroring connection with the second source device (S30).

The sink device may be screen-mirrored-connected to the second source device while being screen-mirrored-connected to the first source device. That is, the wireless device may be connected to a plurality of wireless devices to provide screen mirroring.

Next, a method in which one wireless device is connected to another wireless device by screen mirroring according to an embodiment of the present invention will be described with reference to FIGS. 7 to 11 . First, FIG. 7 is a block diagram illustrating a screen mirroring connection of a wireless device to a plurality of wireless devices according to an embodiment of the present invention.

Referring to FIG. 7 , any one wireless device may perform screen mirroring connection with a plurality of wireless devices. In this case, any one wireless device may be the sink apparatus 600 , and the plurality of wireless devices connected to the sink apparatus may be the first to third source apparatuses 610 , 620 , and 630 . In FIG. 7 , only three wireless devices connected to the sink apparatus 600 are illustrated, but this is only exemplary.

Each of the sink apparatus 600 and the first to third source apparatuses 610 , 620 , and 630 may be a same type of wireless device or may be a different type of wireless device.

The sink device 600 may receive a screen mirroring connection request signal from another wireless device such as the second source device 620 or the third source device 630 while being connected to the first source device 610 .

8 is a flowchart illustrating a method of operating a sink device when receiving a connection request signal from a second source device in a state in which the sink device is connected to the first source device according to the first embodiment of the present invention.

Referring to FIG. 8 , the sink device 600 may receive a screen mirroring connection request signal from the second source device 620 while the first source device 610 is connected ( S20 ).

According to the first embodiment of the present invention, when the sink device 600 receives a screen mirroring connection request signal from the second source device 620 while the first source device 610 is connected, the second source device 620 ) and a window to check whether screen mirroring is connected or not may be displayed (S101).

The sink device 600 may receive a connection acceptance signal or a connection rejection signal with the second source device 620 through a window for checking whether screen mirroring is connected.

The sink device 600 may determine whether it has received a connection acceptance signal with the second source device 620 .

When the sink device 600 receives the connection acceptance signal with the second source device 620 , it terminates the screen mirroring connection with the first source device 610 ( S105 ), and connects the screen mirroring with the second source device 620 . can be performed (S107).

Meanwhile, when the sink device 600 does not receive the connection acceptance signal with the second source device 620 , the sink device 600 may maintain a screen mirroring connection with the first source device 610 ( S109 ).

Here, termination of the screen mirroring connection may mean terminating all connections related to screen mirroring with other wireless devices including an RTSP connection to be described later.

9A to 9D are exemplary views for explaining a method of operating the sink device according to the first embodiment described with reference to FIG. 8 when receiving a connection request signal from a second source device while being connected to the first source device.

Referring to FIG. 9A , the display unit of the sink device 600 may display a first screen mirroring image 611 . The first screen mirroring image 611 may be content received from the sink device 600 and the first source device 610 connected to the screen mirroring. The sink device 600 may receive a screen mirroring connection request signal from the second source device 620 while screen mirroring is connected to the first source device 610 .

Referring to FIG. 9B , the display unit of the sink device 600 may display a window 612 for confirming whether or not a connection with the second source device 620 is established. The window 612 for confirming whether to connect to the second source device 620 may include a connection acceptance icon 612a and a connection rejection icon 612b.

As shown in FIG. 9C , when the control unit of the sink device 600 receives a command to select the connection acceptance icon 612a, it terminates the screen mirroring connection with the first source device 610 and the second source device ( 620) and screen mirroring may be performed. Accordingly, the display unit of the sink device 600 may display the second screen mirroring image 621 instead of the first screen mirroring image 611 . The second screen mirroring image 621 may be content received from the sink device 600 and the first source device 610 screen mirroring connected.

Meanwhile, as shown in FIG. 9D , when receiving a command for selecting the connection rejection icon 612b, the controller of the sink device 600 may maintain the connection with the first source device 610 . Accordingly, the display unit of the sink device 600 may continuously display the first screen mirroring image 611 .

As such, according to the first embodiment of the present invention, when a screen mirroring connection request is received from another wireless device, a wireless device already connected to another wireless device for screen mirroring selects which wireless device to perform screen mirroring connection with. There are advantages that can be

10 is a flowchart illustrating a method of operating when a sink device receives a connection request signal from a second source device in a state in which it is connected to a first source device according to a second embodiment of the present invention.

Referring to FIG. 10 , the sink device 600 may receive a screen mirroring connection request signal from the second source device 620 while the first source device 610 is connected ( S20 ).

According to the second embodiment of the present invention, the sink device 600 may terminate the RTSP connection with the first source device 610 (S201).

Here, the RTSP (real-time screaming protocol) connection refers to a communication protocol (protocol) for transmitting and receiving voice or video in real time. RTSP does not transmit actual data, but uses the protocol to transmit data to the transport layer do.

That is, when the sink device 600 receives a connection request signal from the second source device 620 while being connected to the first source device 610 , only the RTSP connection necessary for data transmission/reception with the first source device 610 is terminated. and other connections can be maintained.

The sink device 600 may terminate the RTSP connection with the first source device 610 and may display a second screen mirroring image through screen mirroring connection with the second source device 620 ( S203 ).

Also, the sink device 600 may simultaneously display the first source device icon and the second mirroring image (S205).

That is, the controller of the sink device 600 may display a screen mirroring image of an RTSP-connected source device among a plurality of screen mirroring-connected source devices, and display an icon of the source device for which the RTSP connection is terminated. If there are two or more source devices connected to the sink device 600, the control unit of the sink device 600 may display a screen image corresponding to the RTSP-connected source device and display source device icons corresponding to the remaining source devices. there is.

Here, the source device icon may mean an icon representing the source device. For example, the source device icon may be a device name indicating a corresponding source device, a device model image corresponding to the source device, or a background screen image of the source device, but this is only exemplary and is not limited thereto. That is, the source device icon may be set as a default in the wireless device or may be set by a user input, and the types of icons may vary.

The control unit of the sink device 600 may determine whether a command for selecting the first source device icon has been received (S207).

If the control unit of the sink device 600 does not receive a command for selecting the first source device icon, the second screen mirroring image of the second source device 620 and the first source device icon may be continuously displayed.

Upon receiving the command for selecting the first source device icon, the control unit of the sink device 600 terminates the RTSP connection with the second source device 620 ( S209 ), and performs an RTSP connection with the first source device 610 . It can be done (S211).

As the sink device 600 is RTSP-connected to the first source device 610, it displays the first screen mirroring image of the first source device 610 (S213), and sets the second source device icon to the first screen mirroring image. and can be displayed simultaneously (S215).

That is, when any one of the at least one or more displayed source device icons is selected, the control unit of the sink device 600 re-performs RTSP connection with the source device corresponding to the selected source device icon, and displays a screen mirroring image of the RTSP-connected source device can do. Also, the sink device 600 may terminate the RTSP connection with the previously connected source device, and may display a source device icon corresponding to the terminated source device.

The control unit of the sink device 600 may determine whether a command for selecting the icon of the second source device has been received ( S207 ).

That is, the control unit of the sink device 600 may determine whether a command for selecting the displayed source device icon is received as the RTSP connection is terminated.

If the control unit of the sink device 600 does not receive a command to select the second source device icon, the controller of the sink device 600 may continuously display the first screen mirroring image of the first source device 610 and the second source device icon.

Upon receiving a command for selecting the second source device icon, the control unit of the sink device 600 may perform an RTSP connection with the second source device 620 ( S219 ).

In this way, the sink device 600 may be screen mirroring-connected to a plurality of source devices, and may be easily connected to any one of the plurality of source devices connected through a screen mirroring icon.

11A to 11D are exemplary views for explaining a method of operating the sink device according to the second embodiment described with reference to FIG. 10 when receiving a connection request signal from a second source device while being connected to the first source device.

Referring to FIG. 11A , the sink device 600 is screen mirroring connected to the first source device 610 , and the display unit of the sink device 600 may display a first screen mirroring image 611 . The sink device 600 may receive a screen mirroring connection request signal from the second source device 620 while screen mirroring is connected to the first source device 610 . The sink device 600 may terminate the RTSP connection with the first source device 610 and may perform a screen mirroring connection with the second source device 620 .

11B to 11C , the display unit of the sink device 600 may display the second screen mirroring image 620 instead of the first screen mirroring image 611 . Also, the display unit of the sink device 600 may display the first source device icon 613 corresponding to the first source device 610 together with the second screen mirroring image 620 . The first source device icon 613 may be an image of the first source device 610 as shown in FIG. 11B or a name or model name of the first source device 610 as shown in FIG. 11C , but this It is merely exemplary and need not be limited thereto.

If only the RTSP connection to the sink device 600 is terminated other than the first source device 610 and there are more source devices connected to screen mirroring, the display unit of the sink device 600 may display a plurality of source device icons.

The control unit of the sink device 600 may receive a command to select any one of at least one or more source device icons, and may receive and display content from a source device corresponding to the selected source device icon. For example, as shown in FIG. 11D , when the control unit of the sink device 600 receives a command to select the first source device icon 613 , the first content that is received from the first source device 610 . A screen mirroring image 611 may be displayed. In this case, the controller of the sink device 600 may display the source device icon 623 of the second source device 620 together with the first screen mirroring image 611 .

As such, when one source device is screen mirroring-connected and another source device requests a screen mirroring connection, the sink device 600 terminates only the RTSP connection without terminating all screen mirroring connections to be connected to a plurality of source devices. can In addition, the sink device 600 has the advantage of being able to quickly switch to and connect to another source device by displaying a source device icon corresponding to the source device for which only the RTSP connection is terminated.

Again, FIG. 6 will be described.

The sink device 600 may perform screen mirroring connection with a plurality of source devices in the same manner as described above.

The display unit of the sink device 600 may display a screen mirroring screen when a plurality of source devices are connected (S40).

When a plurality of source devices are connected, the screen mirroring screen may be expressed in various ways. Hereinafter, various methods of displaying the screen mirroring screen will be described with reference to FIGS. 12 to 17 .

12 is a flowchart illustrating a method of displaying a screen mirroring screen when a wireless device is screen mirroring connected to a plurality of other wireless devices according to the first embodiment of the present invention.

First, the sink device 600 may connect to a plurality of source devices (S301).

The sink device 600 may display a screen mirroring image of any one of the plurality of source devices ( S303 ).

That is, the controller of the sink device 600 may receive content from any one of a plurality of source devices and display one screen mirroring image. For example, the controller of the sink device 600 controls the screen mirroring image of the first screen mirroring-connected source device among the plurality of source devices, the screen mirroring image of the most recently connected source device, or the source device having the largest number of screen mirroring connections. Screen mirroring images and the like can be displayed.

The controller of the sink device 600 may simultaneously display the screen mirroring image and the source device list including the remaining source devices ( S305 ).

The control unit of the sink device 600 may determine whether a command for selecting one source device from the source device list has been received (S307).

If the control unit of the sink device 600 does not receive a command for selecting one source device from the source device list, it may continuously display the screen mirroring image and the source device list. When receiving a command for selecting one source device from the source device list, the control unit of the sink device 600 may display a screen mirroring image of the selected source device (S309).

13A to 13B are exemplary views for explaining a method of displaying a screen mirroring screen according to the first embodiment of the present invention described with reference to FIG. 12 .

The display unit of the sink device 600 may display a screen mirroring image of any one source device among a plurality of connected source devices and a source device list indicating the other source devices. Referring to FIG. 13A , the first screen mirroring image 611 of the first source device 610 and the source device list 640 may be displayed. The source device list 640 includes source device icons 642, 643, 644) may be included.

Referring to FIG. 13B , the controller of the sink device 600 may receive a command for selecting one source device icon 642 from the source device list 640 . The control unit of the sink device 600 may receive content from the second source device 642 corresponding to the selected source device icon 642 and display the second screen mirroring image 621 and the source device list 640 . there is. At this time, the source device list 642 may also be changed to include source device icons 641 , 643 , and 644 corresponding to the remaining source devices except for the second source device.

14 is a flowchart illustrating a method of displaying a screen mirroring screen when a wireless device is screen mirroring-connected to a plurality of other wireless devices according to a second embodiment of the present invention.

First, the sink device 600 may connect to a plurality of source devices (S401).

The sink device 600 may classify data stored in a plurality of source devices according to data types ( S403 ).

Here, the type of data may mean an extension of the data. For example, the type of data may represent photo data, video data, and voice data.

The controller of the sink device 600 may simultaneously display the broadcast signal image and the data type icon (S405).

Here, the broadcast signal image may refer to an image received by the wireless device from a broadcasting station through a tuner and displayed. The controller of the sink device 600 may display a data type icon together with a screen mirroring image of any one source device as well as a broadcast signal image.

The data type icon may be an icon indicating a data type.

The control unit of the sink device 600 may determine whether a command for selecting one data type icon from among the displayed data type icons has been received ( S407 ).

Users can select the type of data they want to view through the data type icon.

If the control unit of the sink device 600 does not receive a command for selecting the data type icon, the broadcast signal image and the data type icon may be continuously displayed.

Upon receiving a command for selecting a data type icon, the control unit of the sink device 600 may display an icon of data corresponding to the selected data type icon among data stored in a plurality of source devices simultaneously with the broadcast signal image (S409) .

That is, the controller of the sink device 600 may identify data corresponding to the selected data type among data stored in the plurality of source devices, and display a data icon indicating the data.

The control unit of the sink device 600 may determine whether a command for selecting one of the displayed at least one or more data icons has been received ( S411 ).

A user may select a data icon to be viewed from among the displayed data icons.

If any one data icon is not selected, the controller of the sink device 600 may continuously display the broadcast signal image and the data icon.

When any one data icon is selected, the controller of the sink device 600 may receive data corresponding to the selected data icon from the source device and display the screen mirroring image (S413).

When a data icon is selected, the controller of the sink device 600 may receive data from a source device storing the selected data icon and display a screen mirroring image.

15A to 15D are exemplary views for explaining a method of displaying a screen mirroring screen according to the second embodiment of the present invention described with reference to FIG. 14 .

Referring to FIG. 15A , the display unit of the sink device 600 may display a broadcast signal image 601 received through a tuner. In this case, the broadcast signal image 601 is merely exemplary, and the sink device 600 may display a screen mirroring image that is already connected. The control unit of the sink device 600 may receive screen mirroring connection request signals from the plurality of source devices 610 , 620 , and 630 while displaying the broadcast signal image 601 and perform screen mirroring connection.

As shown in FIG. 15B , when the control unit of the sink device 600 is connected to a plurality of source devices 610 , 620 , and 630 by screen mirroring, at least one data type icon 651 , along with a broadcast signal image 601 , 652, 653) can be displayed. The data type icons 651 , 652 , and 653 may include a video data icon 651 , a photo data icon 652 , a voice data icon 653 , and the like. However, the data types shown in FIG. 15B are merely exemplary, and as the data types included in the source device are more diverse, the sink device 600 may display more data type icons.

When the sink device 600 receives a command to select any one of the displayed data type icons, as shown in FIG. 15C , the sink device 600 may display data icons 661a, 661b, 662, 663 corresponding to the selected data type. there is. The data icons 661a, 661b, 662, and 663 may indicate data corresponding to a selected data type icon among data stored in a plurality of source devices. In the example of FIG. 15C , the first and second data icons 661a and 661b are data stored in the first source device 610 , and the third data icon 662 is data stored in the second source device 620 , The fourth data icon 663 may be data stored in the third source device 630 .

When the sink device 600 receives a command to select one of the displayed data icons, as shown in FIG. 15D , data corresponding to the selected data icon may be received from the source device and displayed. For example, upon receiving a command for selecting the fourth data icon 663 illustrated in FIG. 15C , fourth data may be received and displayed from the third source device 630 .

As described above, when a plurality of source devices are connected, the sink device according to an embodiment of the present invention has the advantage of being able to quickly find and display necessary data by checking data stored in each source device and displaying it for each data type. That is, there is an advantage in that it can reduce the effort of searching for data by connecting to each source device.

16 is a flowchart illustrating a method of displaying a screen mirroring screen when a wireless device is screen mirroring connected to a plurality of other wireless devices according to a third embodiment of the present invention.

First, the wireless communication unit of the sink device 600 may connect to a plurality of source devices ( S501 ).

The display unit of the sink device 600 may display a screen mirroring image of any one of the plurality of source devices ( S503 ).

The controller of the sink device 600 may receive content from any one of a plurality of source devices and display a screen mirroring image. In this case, the source device for transmitting the screen mirroring image may be any one of a first screen mirroring-connected source device, a most recently screen-mirroring-connected source device, or a source device having the largest number of connections.

The controller of the sink device 600 may determine whether a command to swipe the screen mirroring image has been received (S505).

Here, the swipe command may be an input command that selects one point of the screen mirroring image being displayed and pushes it to another point. For example, the swipe command is an input command for selecting a point on the left side of the screen mirroring image being displayed and dragging and dropping it in a direction for a point on the right side, or, conversely, selects a point on the right side of the screen mirroring image and drags it in the direction of a point on the left side. It can be an input command to drop. However, the swipe command is only an example, and the controller of the sink device 600 may receive a command for displaying the next page in various ways.

If the control unit of the sink device 600 does not receive a swipe command, it may continuously display a screen mirroring image of any one source device.

Upon receiving the command to swipe the screen mirroring image, the control unit of the sink device 600 may determine whether a next page of the page being displayed as the screen mirroring image exists ( S507 ).

Here, the page may mean a background screen page of the source device, a document page stored in the source device, and the like, but this is only exemplary.

The controller of the sink device 600 may determine whether there is an image next to the image currently being displayed as a screen mirroring image in addition to the page.

When the next page exists, the controller of the sink device 600 may display a screen mirroring image indicating the next page (S509).

On the other hand, if the next page does not exist, the controller of the sink device 600 may display a screen mirroring image indicating one page of another source device (S511).

The sink device 600 may repeat the operation of determining whether a swipe command is received after displaying the next page or one page of another source device as a screen mirroring image.

Through this, the sink device 600 has the advantage of being able to display all pages of the source device having the currently displayed page, and then easily switch to the page of another source device and display the page.

17A to 17E are exemplary views for explaining a method of displaying a screen mirroring screen when the wireless device according to the third embodiment of the present invention described with reference to FIG. 16 is screen mirroring connected to a plurality of other wireless devices.

Referring to FIG. 17A , the display unit of the sink device 600 may receive data from the first source device 610 and display a first-first screen mirroring image 611a. In this case, the 1-1 screen mirroring image 611a may be the first page of the background screen of the first source device 610 .

The controller of the sink device 600 may receive a command to swipe the 1-1 screen mirroring image 611a. For example, the controller of the sink device 600 may receive a command for selecting a point on the right side of the 1-1 screen mirroring image 611a with the pointer 205 and dragging and dropping it to a point on the left side. Accordingly, the control unit of the sink device 600 may determine whether a page following the first page of the background screen of the first source device 610 exists. When the next page exists, the control unit of the sink device 600 may display the 1-2 screen mirroring image 611b indicating page 2 of the background screen of the first source device 610 as shown in FIG. 17B . The 1-2-th screen mirroring image 611b may be content representing two pages of the background screen received from the first source device 610 .

The controller of the sink device 600 may receive a swipe command while the 1-2 th screen mirroring image 611b is being displayed. If the swipe command is a command for dragging and dropping a point on the left side of the 1-2 screen mirroring image 611b with the pointer 205 and dragging and dropping it to a right side point, the 1-1 screen mirroring image 611a is displayed again. can be displayed However, if the swipe command is a command for selecting a point on the right side of the 1-2 screen mirroring image 611b with the pointer 205 and dragging and dropping it to a point on the left side, the background screen of the first source device 610 . It can be determined whether the next page of page 2 exists. When the next page exists, the controller of the sink device 600 may display a screen mirroring image indicating the next page. However, if the next page does not exist, the 2-1 screen mirroring image 621a indicating page 1 of the background screen of the second source device 620 may be displayed. Similarly, when the sink device 600 receives a swipe command for dragging and dropping the 2-1 screen mirroring image 621a from one point on the right to one point on the left, as shown in FIG. 17D , the second source device 620 . ), a 2-2 screen mirroring image 621b indicating page 2 of the background screen may be displayed.

When the control unit of the sink device 600 receives the command to swipe the 2-2 screen mirroring image 621b, it is determined whether the next page of page 2 of the background screen exists, and if the next page does not exist, another source device is further It is determined whether there is another source, and if another source does not exist, the first-first screen mirroring image 611a of the first source device 610 may be displayed again.

As described above, the sink device 600 has the advantage of being able to quickly and easily switch pages through a swipe command without having to connect to another source device at the moment of page switching by performing screen mirroring connection with another source device in advance. .

The wireless device according to an embodiment of the present invention may display a screen mirroring screen when a plurality of source devices are connected through various embodiments as described above. Meanwhile, the method for displaying the screen mirroring screen according to the first to third embodiments described above may be implemented individually or in combination with other embodiments.

Again, FIG. 6 will be described.

The controller of the sink device 600 may determine which one of the plurality of source devices has received the alarm signal while the screen mirroring screen is being displayed ( S50 ).

Here, the alarm signal may include a signal received from the outside to the wireless device and a signal generated according to internally set information. For example, the alarm signal may include a call reception signal, a text reception signal, a pop-up notification symbol, a wake-up call alarm signal, a schedule alarm signal, and the like.

When an alarm signal is received from any one source device, the control unit of the sink device 600 may display the received alarm icon and the alarm list icon (S51).

Here, the alarm icon may be an icon indicating information of the received alarm signal. Also, the alarm list icon may be an icon for converting to a list in which at least one or more alarm information previously received from a plurality of source devices can be checked.

The control unit of the sink device 600 may receive a command for selecting an alarm icon for checking a recently received alarm signal. Alternatively, the control unit of the sink device 600 may receive a command for selecting an alarm list icon for checking at least one or more alarm information previously received from a plurality of source devices.

The control unit of the sink device 600 may determine whether a command for selecting an alarm list icon has been received ( S60 ).

When receiving a command for selecting an alarm list icon, the control unit of the sink device 600 may display an alarm icon corresponding to at least one or more alarm signals received from a plurality of source devices ( S61 ).

Here, the alarm icon may be the same as the alarm icon described above.

The controller of the sink device 600 may determine whether a command for selecting an alarm icon has been received ( S70 ). The control unit of the sink device 600 may determine whether a command for selecting an alarm icon displayed as an alarm icon displayed in step S51 or an alarm list icon is selected as in step S61 is received.

If the control unit of the sink device 600 does not receive a command to select an alarm icon, it may continuously display the screen mirroring screen.

Upon receiving a command for selecting an alarm icon, the control unit of the sink device 600 may receive and display alarm contents corresponding to the alarm icon from the corresponding source device (S71).

18A to 18C are exemplary views for explaining a method of displaying alarm information when an alarm signal is received in a screen mirroring connected wireless device according to an embodiment of the present invention.

The display unit of the sink device 600 may display a screen mirroring screen. For example, the display unit of the sink device 600 may display a screen mirroring screen including a first screen mirroring image 611 and a source device list 640 indicating the remaining connected source devices.

The controller of the sink device 600 may detect whether an alarm signal is received from a source device connected to the screen mirroring.

Referring to FIG. 18A , the controller of the sink device 600 may display an alarm icon 671 and an alarm list icon 672 when the source device detects reception of an alarm signal. The alarm icon 671 indicates alarm information recently received from the source device. Referring to the example shown in FIG. 18A , the alarm icon 671 may be an icon indicating that a message has been received from the first source device 610 . The alarm list icon 672 may be an icon that can be switched to a page for checking alarm information received from the first to fourth source devices.

The control unit of the sink device 600 may receive a command for selecting either the alarm icon 671 or the alarm list icon 672 . When receiving a command for selecting the alarm icon 671 , the control unit of the sink device 600 may receive alarm information from the source device from which the alarm has been received and display the alarm contents 685 . On the other hand, when the control unit of the sink device 600 receives a command to select the alarm list icon 672 , it displays an alarm list including unconfirmed alarm items 681 , 682 , and 683 received by a plurality of source devices, respectively. can do.

As described above, the sink device 600 according to an embodiment of the present invention has the advantage of being able to conveniently manage the alarm signals received from a plurality of source devices through the alarm icon 671 and the alarm list icon 672 . there is.

Again, FIG. 6 will be described.

The controller of the sink device 600 may determine whether an alarm signal is received or whether a data copy command is received while the screen mirroring screen is displayed. A method of determining whether an alarm signal is received has been described above, and a method of determining whether a data copy command is received will be described below.

The control unit of the sink device 600 may determine whether a command for selecting one data icon from the screen mirroring image being displayed and dragging and dropping it to the icon of another source device is received (S80).

Here, the command for selecting the data icon and dragging and dropping it to the icon of another source device may be a data copy command for copying data corresponding to the selected data icon to the source device corresponding to the icon from which the pointer is dropped.

If the control unit of the sink device 600 does not receive the data copy command, it may continuously display the screen mirroring screen.

Upon receiving the data copy command, the control unit of the sink device 600 may copy data corresponding to the selected data icon to the source device corresponding to the dragged-and-dropped source device icon (S81).

19A to 19B are exemplary views for explaining a method of copying data between wireless devices connected to screen mirroring according to an embodiment of the present invention.

The display unit of the sink device 600 may display a screen mirroring screen. For example, the display unit of the sink device 600 may display a screen mirroring screen including a first screen mirroring image 611 and a source device list 640 indicating the remaining connected source devices. The first screen mirroring image 611 may include at least one data icon 691 , and the source device list 641 may include at least one or more source device icons 642 , 643 , and 644 .

Referring to FIG. 19A , the controller of the sink device 600 selects any one data icon 691 from the first screen mirroring image 611 and sends a drag and drop command to any one source device icon 642 . can receive For example, the dragged and dropped source device icon 642 may be an icon corresponding to the second source device 620 , but this is merely exemplary.

Accordingly, the controller of the sink device 600 may control the source device 620 corresponding to the dragged and dropped source device icon 642 to install the selected data. According to an embodiment, the controller of the sink device 600 may transmit the corresponding data to the source device 620 corresponding to the dragged and dropped source device icon 642 . According to another embodiment, the control unit of the sink device 600 transmits a link for installing the corresponding data to the source device 620 corresponding to the dragged and dropped source device icon 642, and the source device 620 Corresponding data can be transmitted through the received link. However, such a method is merely exemplary, and the controller of the sink device 600 may copy data to the selected source device in various ways.

The above description is merely illustrative of the technical spirit of the present invention, and various modifications and variations will be possible without departing from the essential characteristics of the present invention by those skilled in the art to which the present invention pertains.

Therefore, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention, but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments.

The protection scope of the present invention should be construed by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

Claims (15)

A first wireless device comprising:
display unit;
A wireless communication unit for connecting a plurality of wireless devices and screen mirroring; and
A control unit for controlling the display unit and the wireless communication unit,
the control unit
displaying a screen mirroring image according to data received from a second wireless device among the plurality of wireless devices and at least one source device icon corresponding to the remaining wireless devices,
When receiving a command to swipe the screen mirroring image being displayed, the next page of the page being displayed as the screen mirroring image is displayed as a screen mirroring image,
A first wireless device for displaying a page of another wireless device in screen mirroring connection as a screen mirroring image when there is no next page of the page being displayed as the screen mirroring image. According to claim 1,
the control unit
Upon receiving a command for selecting a source icon corresponding to a third wireless device from among the one or more source device icons, at least one or more including a screen mirroring image according to data received from the third wireless device and the second wireless device A first wireless device displaying a source device icon. 3. The method of claim 2,
the control unit
When the plurality of wireless devices includes a second wireless device and a third wireless device,
Displaying a screen mirroring image according to data received from the second wireless device and a source device icon corresponding to the third wireless device, or displaying a screen mirroring image according to data received from the third wireless device and a screen mirroring image corresponding to the second wireless device A first wireless device displaying a source device icon. According to claim 1,
The source device icon is
A first wireless device comprising at least one of a device name, a model image, and a background screen image of the wireless device. According to claim 1,
the control unit
A first wireless device displaying at least one data type icon and displaying at least one data type icon corresponding to the selected data type icon among data stored in a plurality of wireless devices upon receiving a command to select any one data type icon . 6. The method of claim 5,
The data type icon is
A first wireless device comprising at least one of a video data icon, a photo data icon, and a voice data icon. 6. The method of claim 5,
the control unit
A first wireless device for displaying a screen mirroring image by receiving data corresponding to the selected data icon from a source device when receiving a command for selecting one of the one or more data icons. delete delete According to claim 1,
the control unit
A first wireless device for detecting an alarm signal received by the plurality of wireless devices, and displaying an alarm icon indicating the detected alarm signal when the alarm signal is detected. 11. The method of claim 10,
the control unit
A first wireless device for receiving and displaying alarm contents from a source device from which the alarm signal is received when receiving a command for selecting the alarm icon. 11. The method of claim 10,
the control unit
A first wireless device further displaying at least one alarm icon indicating an unacknowledged alarm signal received on the plurality of wireless devices. According to claim 1,
the control unit
A first wireless device to receive a data copy command to copy data from one of the plurality of wireless devices to another. 14. The method of claim 13,
the control unit
When receiving a data copy command for selecting any one data icon from the displayed screen mirroring image and dragging and dropping it to the source device icon, the data corresponding to the data icon is transferred to the source corresponding to the dragged and dropped source device icon. A first wireless device copying to the device. According to claim 1,
the control unit
A first wireless device terminating a real-time screaming protocol (RTSP) connection with other wireless devices except for the second wireless device among the plurality of wireless devices.

Images