US9197734B2 - Apparatus and method for sharing screens from multiple mobile devices - Google Patents

Apparatus and method for sharing screens from multiple mobile devices Download PDF

Info

Publication number
US9197734B2
US9197734B2 US13/734,163 US201313734163A US9197734B2 US 9197734 B2 US9197734 B2 US 9197734B2 US 201313734163 A US201313734163 A US 201313734163A US 9197734 B2 US9197734 B2 US 9197734B2
Authority
US
United States
Prior art keywords
mobile device
screen
physical
graphical component
physical screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US13/734,163
Other versions
US20140194066A1 (en
Inventor
Zhiyun Li
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority to US13/734,163 priority Critical patent/US9197734B2/en
Assigned to SAMSUNG ELECTRONICS CO., LTD. reassignment SAMSUNG ELECTRONICS CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LI, ZHIYUN
Priority to KR1020130167205A priority patent/KR102124498B1/en
Publication of US20140194066A1 publication Critical patent/US20140194066A1/en
Application granted granted Critical
Publication of US9197734B2 publication Critical patent/US9197734B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00Digital computers in general; Data processing equipment in general
    • G06F15/16Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • H04M1/7253
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1446Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1438Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using more than one graphics controller
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/14Solving problems related to the presentation of information to be displayed
    • G09G2340/145Solving problems related to the presentation of information to be displayed related to small screens
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2356/00Detection of the display position w.r.t. other display screens
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/12Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/16Details of telephonic subscriber devices including more than one display unit

Definitions

  • the present invention relates to an apparatus and method for screen sharing. More particularly, the present invention relates to an apparatus and method for sharing screens from multiple mobile devices.
  • Mobile terminals are developed to provide wireless communication between users. As technology has advanced, mobile terminals now provide many additional features beyond simple telephone conversation. For example, mobile terminals are now able to provide additional functions such as an alarm, a Short Messaging Service (SMS), a Multimedia Message Service (MMS), E-mail, games, remote control of short range communication, an image capturing function using a mounted digital camera, a multimedia function for providing audio and video content, a scheduling function, and many more. With the plurality of features now provided, a mobile terminal has effectively become a necessity of daily life.
  • SMS Short Messaging Service
  • MMS Multimedia Message Service
  • E-mail electronic mail
  • games remote control of short range communication
  • an image capturing function using a mounted digital camera a multimedia function for providing audio and video content
  • a scheduling function a scheduling function
  • Mobile devices also provide a variety of sharing features, which allow users to share data on their mobile devices with other users. For example, a user may take a picture using a mobile device equipped with a camera, and share the image with other users. This sharing is typically accomplished through a wireless communication technology such as Near Field Communications (NFC), Bluetooth, Wi-Fi, or infrared communication.
  • NFC Near Field Communications
  • Bluetooth Bluetooth
  • Wi-Fi Wireless Fidelity
  • desktop arrangements typically involve a single system controlling multiple monitors.
  • Mobile device design is trending toward a multiple window system, similar to desktop and laptop computers, in which a display environment includes multiple windows and other graphical components.
  • a display environment includes multiple windows and other graphical components.
  • an aspect of the present invention is to provide an apparatus and method for sharing screens from multiple mobile devices.
  • a mobile device in accordance with an aspect of the present invention, includes a sensor, a communication unit for determining whether at least one other mobile device is substantially in contact with the mobile device, based on information received from the sensor, and for communicating with the at least one other mobile device, a display unit including a physical screen for displaying a graphical component, and a controller for combining the physical screen of the display unit with physical screens of the at least one other mobile device into a single logical screen such that graphical components displayed on one physical screen may be moved to another physical screen as if both physical screens were part of a single screen.
  • a method for sharing screens of multiple mobile devices includes rendering, by a first mobile device, a graphical component on a first physical screen of the first mobile device, determining whether a second mobile device contacts the first mobile device, and when the second mobile device contacts the first mobile device, tiling and combining the first physical screen with a second physical screen of the second mobile device to create a logical screen.
  • FIG. 1 illustrates a method of sharing according to an exemplary embodiment of the present invention
  • FIGS. 2A-2D illustrate different arrangements of mobile devices according to an exemplary embodiment of the present invention.
  • FIG. 3 illustrates a mobile device according to exemplary embodiments of the present invention.
  • Exemplary embodiments of the present invention include an apparatus and method for enabling screen sharing among multiple mobile devices.
  • FIG. 1 illustrates a method of sharing according to an exemplary embodiment of the present invention.
  • the mobile device may include any device having a physical screen, such as tablets, mobile phones, and the like.
  • Device 1 and Device 2 may support the same operating system, such as AndroidTM.
  • AndroidTM operating system
  • Device 1 and Device 2 may support different operating systems; in this case, the functionality of the screen sharing may be incorporated in an application (app) executing in both Device 1 and Device 2.
  • One or more sensors incorporated within the mobile devices detect the contact between the mobile devices in step 120 .
  • the sensors may be outfitted with passive or active detection.
  • the sensors need not be incorporated in both of the mobile devices.
  • the sensors may be incorporated in only one of the mobile devices.
  • the sensors may also detect the orientation of the devices (e.g., whether the devices contact horizontally as shown in FIG. 1 , or vertically as shown in FIG. 2A ) and the alignment of the devices. Detecting the alignment of the devices may be especially useful if the devices do not have the same size.
  • the sensors detect the contact and alignment of the devices and communicate this information to the devices to enable the creation of a single logical screen.
  • step 130 the physical screens of the mobile devices are tiled and combined into a single logical screen.
  • both Device 1 and Device 2 treat the screens as a single screen. The same screen is therefore shared between both devices.
  • Device 1 and Device 2 may communicate with each other via a wireless communication system.
  • a short-range communication system such as Near Field Communication, Bluetooth, or infrared communication may be used to exchange data between the devices and arrange the combination of the two physical screens into a single logical screen.
  • any communication system (wired or wireless) may be employed for this purpose.
  • the devices When the devices are tiled and combined, the devices may set up a communication channel between them using the communication system. This communication channel may be used to transmit information needed to render the graphical components on the logical screen.
  • the shared screen setup allows graphical components displayed on the screens of the mobile devices to move within the logical screen in step 140 .
  • Graphical components may include windows, icons, widgets, menus, and the like.
  • Device 1 and Device 2 treat the logical screen as a single screen
  • the respective devices may nevertheless control the display of graphical components on their respective physical screens. For example, a window shown on the screen of Device 1 would be rendered and controlled by Device 1, while an icon shown on the physical screen of Device 2 would be rendered and controlled by Device 2.
  • a graphical component displayed on the physical screen of Device 1 may nevertheless be controlled by Device 2, and vice versa.
  • Device 1 and Device 2 may operate in a master/slave relationship, in which one device is the master device that controls operations for both devices. If Device 1 is the master device, then Device 1 will control operations related to the logical screen, and Device 2 may only be responsible for rendering graphical components on the physical screen of Device 2 under the control of Device 1.
  • the devices may share the control over the logical screen, such as by dividing up control of various graphical components according to the physical screen on which each graphical component is being displayed. Even in this scenario, both devices may retain information about graphical components displayed on the other. This information may be updated whenever the user moves a graphical component, or may be updated periodically. In addition, when the user moves a graphical component from one screen to the other, information about the graphical component may be transferred to the other device to assist the other device in rendering the graphical component.
  • the logical screen may be used to facilitate sharing of data between the two devices.
  • data associated with that graphical component may also be transferred. For example, if a user moves an icon representing a file from the physical screen of Device 1 to the physical screen of Device 2, the file itself may be copied to Device 2 to correspond with the movement of the icon from the physical screen of Device 1 to the physical screen of Device 2.
  • the user may employ a variety of gestures to move icons, windows, and other graphical components around the logical screen. For example, the user may touch a window displayed on the physical screen of Device 1 and drag the window to the physical screen of Device 2. As the user drags the window, the window would appear entirely on the physical screen of Device 1, then appear partially on both physical screens, and finally appear entirely on the physical screen. An associated data transfer may be initiated when the window appears entirely on the physical screen of Device 2.
  • touch gestures may also be used to move windows and other graphical components around the logical screen.
  • multi-touch and pinch gestures may be used in the same manner as single-device screens, even when a graphical component straddles multiple physical screens.
  • the user may “throw” a graphical component across the logical screen from one physical screen to the other by touching the graphical component, making a quick drag motion in the direction of another physical screen, and then releasing the touch. This may result in the graphical component moving, as if thrown, to a position on the corresponding physical screen.
  • This position may be a predetermined position or a position determined according to a velocity or acceleration of the user's touch movement.
  • Device 1 transmits information about the graphical component to Device 2 via the communication channel set up in step 130 .
  • This information may include information needed to render the entire graphical component, as well as information about a portion of the graphical component to be displayed on the physical screen of Device 2.
  • Further operation of the logical screen with respect to the graphical component may depend on whether Device 1 retains control over the graphical component or whether Device 2 has control over the graphical component. If Device 2 has control over the graphical component, Device 1 transmits a context of the object to Device 2, to enable Device 2 to control the graphical component. This context may be a memory dump of the runtime status of the graphical component. Alternatively, if the graphical component has a well-defined state (such as e.g., a window for editing a text file), Device 2 may merely sync the data (text data) with Device 1.
  • Device 2 transmits any information about the user's interaction with the graphical component to Device 1 over the communication channel. Device 1 then updates its context to incorporate the changes due to the user's interaction and transmits appropriate information back to Device 2 to enable Device 2 to render the graphical component according to the user's interaction.
  • Device 1 and Device 2 may share a memory space including a context of the graphical component, update the context according to the user's interaction, and render the graphical component according to the updated context.
  • the memory may be shared across the devices, or may be shared in another memory space, such as a server or cloud storage.
  • FIG. 1 shows an arrangement of two devices arranged side-by-side in a horizontal manner. However, this is only one possible arrangement. Several other exemplary arrangements are described below with respect to FIGS. 2A-2D .
  • FIGS. 2A-2D illustrate different arrangements of mobile devices according to an exemplary embodiment of the present invention.
  • FIGS. 2A-2D any number of devices may be combined to form a single logical screen, and a variety of arrangements are possible.
  • FIG. 2A shows an example in which two devices are arranged vertically. This arrangement may be suitable for displaying a full-size keyboard on the physical screen of the lower device and enabling input of characters displayed on the physical screen of the upper device.
  • FIGS. 2B and 2C show examples of more than two devices combining to form a single logical screen.
  • three devices are shown in a pyramid arrangement, while in FIG. 2C , the three devices are shown arranged side-by-side. Arrangements of more than three devices are also possible.
  • FIG. 2D shows an example in which the screens of Device 1 and Device 2 are not perfectly aligned.
  • the tiling and combining may not occur until the screens of the devices are substantially aligned with one another, such as the arrangements shown in FIG. 1 and FIGS. 2A and 2C .
  • the physical screens may be combined even when they do not align with each other, such as the examples shown in FIGS. 2B and 2D .
  • the physical screens may be tiled and combined in such a way that the logical screen has an irregular shape.
  • the physical screens may also be tiled and combined in such a way that the logical screen maintains a rectangular arrangement.
  • a mapping may occur when moving a graphical component from one screen to another. For example, in the arrangement shown in FIG. 2B , the entire top edge of Device 1 may be mapped to the left half of Device 3's bottom edge.
  • FIG. 1 and FIGS. 2A-2D show mobile devices of the same size, it is understood that the mobile devices may have different sizes or types.
  • Device 1 may be a tablet with a relatively large form factor
  • Device 2 may be a tablet with a smaller form factor.
  • Device 1 may be a tablet and Device 2 may be a mobile phone (e.g., smartphone).
  • the functionality for facilitating screen sharing may be incorporated into an operating system of the mobile devices, such as the AndroidTM operating system developed by Google, Inc.
  • the functionality may also be incorporated into a separate application.
  • applications may be developed for different operating systems to allow screen sharing across devices having different operating systems.
  • FIG. 3 illustrates a mobile device according to exemplary embodiments of the present invention.
  • the mobile device 300 includes a screen 310 and a sensor 320 .
  • the mobile device 300 may also include a controller and a communication unit.
  • the controller is disposed within the mobile device 300 and is thus not shown in FIG. 3 ; similarly, the communication unit may be disposed entirely or partially within the mobile device 300 (the communication unit may include an antenna arranged on the exterior of the mobile device 300 ) and is also not shown in FIG. 3 .
  • the mobile device 300 may also include additional units not shown, which may vary according to the function of the mobile device 300 .
  • Such additional units may include a storage unit, a camera, a Global Position System (GPS) or other location services unit, a speaker, a microphone, an input unit, and the like.
  • GPS Global Position System
  • the display unit 310 represents a physical screen of the mobile device 300 , and displays graphical components, including windows, icons, menus, other user interface elements, and various content.
  • the display unit 320 may be implemented as a touch screen.
  • the controller determines that another device is in contact with the mobile device 300 , the controller controls the physical screen of the display unit 310 to act as a portion of a logical screen. Accordingly, the user may move graphical components displayed on the physical screen of the display unit 320 among and between the physical screens of the other mobile device(s) as if the graphical components were on the same screen. While the display unit 310 is described herein as a touch screen, it should be understood that exemplary embodiments of the present invention are not limited thereto.
  • the sensor unit 320 detects the approach and alignment of other devices and provides this information to the controller.
  • the sensor 320 may be any type of sensor that is capable of detecting contact or proximity, and may be an inductive type, capacitive type, optical type, ultrasonic type, magnetic type, and the like. While only one sensor 320 is shown on the mobile device 300 , multiple sensors 320 may be deployed, and may be arranged on two or more sides of the mobile device. The sensors may be arranged in a dense manner or in a sparse manner. A sparse array of sensors may be used to detect a limited number of predetermined alignments, while a denser array may be able to detect a larger range of alignments.
  • the senor 320 may be replaced or supplemented by a group of pins arranged on some or all sides of the device. When these pins come into contact with corresponding pins in the other mobile device, a communication circuit is completed that enables the two devices to communicate data regarding the logical screen. This communication may supplement or replace communication via the communication unit.
  • the pins may be supplemented with magnets to facilitate proper alignment between the mobile device 300 and the other mobile device.
  • the controller controls the overall operations of the mobile device 300 .
  • the controller determines whether another device is in contact with the mobile device 300 , based on the information provided by the sensor 320 .
  • the controller determines the side (or portion of a side) that is contacting the other device, and cooperates with the other device (via the communication unit) to tile and combine the physical screens into a single logical screen.
  • the controller may be responsible for displaying any graphical components to be displayed on the physical screen of the display unit 310 .
  • the controller may communicate information needed to render the graphical component, as well as other related information, to the other device via the communication unit.
  • the controller may receive information needed to render the graphical component via the display unit 310 , as well as other related information.
  • the communication unit may communicate with the other devices using any short-range communication system. Exemplary systems include NFC, Bluetooth, and infrared communication. In addition, according to the functionality of the mobile device 300 , the communication unit may also be equipped to communicate using other wired or wireless communication systems.
  • Exemplary embodiments of the present invention may have a variety of applications. Two such applications, file transfer and virtual keyboard, have been described above. However, exemplary embodiments may also be applied to games and social applications. For example, tiling and combining two physical screens into one logical screen may open up new methods of gameplay and multiplayer options. Other applications are also possible, including multitasking (e.g., showing multiple windows on the same screen, displaying data from one or more devices) or document viewing (e.g., showing one document on one physical screen and another document on another physical screen). Other applications are, of course, also possible, and it is to be understood that exemplary embodiments of the present invention are not limited to these applications.
  • the devices While it has been described above that the devices come into contact with each other, the devices need not come into physical contact with each other.
  • the devices could be separated by a distance of up to several millimeters. Such a distance would be close enough for the user to perceive the physical screens as a single logical screen and to allow the user to manipulate both physical screens easily.
  • relaxing the requirement for physical contact will assist children and users with limited dexterity, for whom it might be difficult to arrange the devices appropriately.

Abstract

An apparatus and method for sharing screens among multiple mobile devices are provided. The mobile device includes a sensor, a communication unit for determining whether at least one other mobile device is substantially in contact with the mobile device, based on information received from the sensor, and for communicating with the at least one other mobile device, a display unit including a physical screen for displaying a graphical component, and a controller for combining the physical screen of the display unit with physical screens of the at least one other mobile device into a single logical screen such that graphical components displayed on one physical screen may be moved to another physical screen as if both physical screens were part of a single screen.

Description

BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to an apparatus and method for screen sharing. More particularly, the present invention relates to an apparatus and method for sharing screens from multiple mobile devices.
2. Description of the Related Art
Mobile terminals are developed to provide wireless communication between users. As technology has advanced, mobile terminals now provide many additional features beyond simple telephone conversation. For example, mobile terminals are now able to provide additional functions such as an alarm, a Short Messaging Service (SMS), a Multimedia Message Service (MMS), E-mail, games, remote control of short range communication, an image capturing function using a mounted digital camera, a multimedia function for providing audio and video content, a scheduling function, and many more. With the plurality of features now provided, a mobile terminal has effectively become a necessity of daily life.
Mobile devices also provide a variety of sharing features, which allow users to share data on their mobile devices with other users. For example, a user may take a picture using a mobile device equipped with a camera, and share the image with other users. This sharing is typically accomplished through a wireless communication technology such as Near Field Communications (NFC), Bluetooth, Wi-Fi, or infrared communication.
However, mobile devices do not support sharing between monitors or screens, in which screens of two different mobile devices are treated as a single screen, allowing the user to move interface items displayed on one screen to the other. Desktop and laptop computers support a multi-monitor operation in which multiple monitors are tiled together and act as a single screen. However, these desktop arrangements typically involve a single system controlling multiple monitors.
Mobile device design is trending toward a multiple window system, similar to desktop and laptop computers, in which a display environment includes multiple windows and other graphical components. In view of this trend, there is a need for a method and system to enable sharing of interface items among screens of multiple mobile devices.
SUMMARY OF THE INVENTION
Aspects of the present invention are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present invention is to provide an apparatus and method for sharing screens from multiple mobile devices.
In accordance with an aspect of the present invention, a mobile device provided. The mobile device includes a sensor, a communication unit for determining whether at least one other mobile device is substantially in contact with the mobile device, based on information received from the sensor, and for communicating with the at least one other mobile device, a display unit including a physical screen for displaying a graphical component, and a controller for combining the physical screen of the display unit with physical screens of the at least one other mobile device into a single logical screen such that graphical components displayed on one physical screen may be moved to another physical screen as if both physical screens were part of a single screen.
In accordance with another aspect of the present invention, a method for sharing screens of multiple mobile devices is provided. The method includes rendering, by a first mobile device, a graphical component on a first physical screen of the first mobile device, determining whether a second mobile device contacts the first mobile device, and when the second mobile device contacts the first mobile device, tiling and combining the first physical screen with a second physical screen of the second mobile device to create a logical screen.
Other aspects, advantages, and salient features of the invention will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses exemplary embodiments of the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
The above and other aspects, features, and advantages of certain exemplary embodiments of the present invention will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
FIG. 1 illustrates a method of sharing according to an exemplary embodiment of the present invention;
FIGS. 2A-2D illustrate different arrangements of mobile devices according to an exemplary embodiment of the present invention; and
FIG. 3 illustrates a mobile device according to exemplary embodiments of the present invention.
Throughout the drawings, it should be noted that like reference numbers are used to depict the same or similar elements, features, and structures.
DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS
The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of exemplary embodiments of the invention as defined by the claims and their equivalents. It includes various specific details to assist in that understanding, but these are to be regarded as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. In addition, descriptions of well-known functions and constructions are omitted for clarity and conciseness.
The terms and words used in the following description and claims are not limited to the bibliographical meanings, but are merely used by the inventor to enable a clear and consistent understanding of the invention. Accordingly, it should be apparent to those skilled in the art that the following description of exemplary embodiments of the present invention are provided for illustration purposes only and not for the purpose of limiting the invention as defined by the appended claims and their equivalents.
It is to be understood that the singular forms “a,” “an,” and “the” include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to “a component surface” includes reference to one or more of such surfaces.
By the term “substantially” it is meant that the recited characteristic, parameter, or value need not be achieved exactly, but that deviations or variations, including for example, tolerances, measurement error, measurement accuracy limitations and other factors known to those of skill in the art, may occur in amounts that do not preclude the effect the characteristic was intended to provide.
Exemplary embodiments of the present invention include an apparatus and method for enabling screen sharing among multiple mobile devices.
FIG. 1 illustrates a method of sharing according to an exemplary embodiment of the present invention.
Referring to FIG. 1, two mobile devices, Device 1 and Device 2, are brought into contact with each other in step 110. The mobile device may include any device having a physical screen, such as tablets, mobile phones, and the like. According to an exemplary embodiment of the present invention, Device 1 and Device 2 may support the same operating system, such as Android™. However, Device 1 and Device 2 may support different operating systems; in this case, the functionality of the screen sharing may be incorporated in an application (app) executing in both Device 1 and Device 2.
One or more sensors incorporated within the mobile devices detect the contact between the mobile devices in step 120. The sensors may be outfitted with passive or active detection. The sensors need not be incorporated in both of the mobile devices. The sensors may be incorporated in only one of the mobile devices. In addition to detecting the contact, the sensors may also detect the orientation of the devices (e.g., whether the devices contact horizontally as shown in FIG. 1, or vertically as shown in FIG. 2A) and the alignment of the devices. Detecting the alignment of the devices may be especially useful if the devices do not have the same size. The sensors detect the contact and alignment of the devices and communicate this information to the devices to enable the creation of a single logical screen.
In step 130, the physical screens of the mobile devices are tiled and combined into a single logical screen. Thus, while the two screens remain physically separate, both Device 1 and Device 2 treat the screens as a single screen. The same screen is therefore shared between both devices. To tile and combine the two physical screens, Device 1 and Device 2 may communicate with each other via a wireless communication system. According to an exemplary embodiment of the present invention, a short-range communication system, such as Near Field Communication, Bluetooth, or infrared communication may be used to exchange data between the devices and arrange the combination of the two physical screens into a single logical screen. However, any communication system (wired or wireless) may be employed for this purpose.
When the devices are tiled and combined, the devices may set up a communication channel between them using the communication system. This communication channel may be used to transmit information needed to render the graphical components on the logical screen.
The shared screen setup allows graphical components displayed on the screens of the mobile devices to move within the logical screen in step 140. Graphical components may include windows, icons, widgets, menus, and the like.
While both Device 1 and Device 2 treat the logical screen as a single screen, the respective devices may nevertheless control the display of graphical components on their respective physical screens. For example, a window shown on the screen of Device 1 would be rendered and controlled by Device 1, while an icon shown on the physical screen of Device 2 would be rendered and controlled by Device 2.
However, in some cases, a graphical component displayed on the physical screen of Device 1 may nevertheless be controlled by Device 2, and vice versa. For example, Device 1 and Device 2 may operate in a master/slave relationship, in which one device is the master device that controls operations for both devices. If Device 1 is the master device, then Device 1 will control operations related to the logical screen, and Device 2 may only be responsible for rendering graphical components on the physical screen of Device 2 under the control of Device 1.
As described above, the devices may share the control over the logical screen, such as by dividing up control of various graphical components according to the physical screen on which each graphical component is being displayed. Even in this scenario, both devices may retain information about graphical components displayed on the other. This information may be updated whenever the user moves a graphical component, or may be updated periodically. In addition, when the user moves a graphical component from one screen to the other, information about the graphical component may be transferred to the other device to assist the other device in rendering the graphical component.
The logical screen may be used to facilitate sharing of data between the two devices. When a graphical component is moved from one physical screen to the other, data associated with that graphical component may also be transferred. For example, if a user moves an icon representing a file from the physical screen of Device 1 to the physical screen of Device 2, the file itself may be copied to Device 2 to correspond with the movement of the icon from the physical screen of Device 1 to the physical screen of Device 2.
Since the two physical screens are combined as a single logical screen, the user may employ a variety of gestures to move icons, windows, and other graphical components around the logical screen. For example, the user may touch a window displayed on the physical screen of Device 1 and drag the window to the physical screen of Device 2. As the user drags the window, the window would appear entirely on the physical screen of Device 1, then appear partially on both physical screens, and finally appear entirely on the physical screen. An associated data transfer may be initiated when the window appears entirely on the physical screen of Device 2.
Other touch gestures may also be used to move windows and other graphical components around the logical screen. For example, multi-touch and pinch gestures may be used in the same manner as single-device screens, even when a graphical component straddles multiple physical screens. Similarly, the user may “throw” a graphical component across the logical screen from one physical screen to the other by touching the graphical component, making a quick drag motion in the direction of another physical screen, and then releasing the touch. This may result in the graphical component moving, as if thrown, to a position on the corresponding physical screen. This position may be a predetermined position or a position determined according to a velocity or acceleration of the user's touch movement.
When a graphical object moves from one device to another, such as from Device 1 to Device 2 as shown in FIG. 1, Device 1 transmits information about the graphical component to Device 2 via the communication channel set up in step 130. This information may include information needed to render the entire graphical component, as well as information about a portion of the graphical component to be displayed on the physical screen of Device 2. As the graphical component moves from Device 1 to Device 2, more and more of the graphical component may be displayed on Device 2, until the entire graphical component is displayed on Device 2.
Further operation of the logical screen with respect to the graphical component may depend on whether Device 1 retains control over the graphical component or whether Device 2 has control over the graphical component. If Device 2 has control over the graphical component, Device 1 transmits a context of the object to Device 2, to enable Device 2 to control the graphical component. This context may be a memory dump of the runtime status of the graphical component. Alternatively, if the graphical component has a well-defined state (such as e.g., a window for editing a text file), Device 2 may merely sync the data (text data) with Device 1.
If Device 1 retains control over the graphical component, Device 2 transmits any information about the user's interaction with the graphical component to Device 1 over the communication channel. Device 1 then updates its context to incorporate the changes due to the user's interaction and transmits appropriate information back to Device 2 to enable Device 2 to render the graphical component according to the user's interaction.
Alternatively, Device 1 and Device 2 may share a memory space including a context of the graphical component, update the context according to the user's interaction, and render the graphical component according to the updated context. In this case, the memory may be shared across the devices, or may be shared in another memory space, such as a server or cloud storage.
FIG. 1 shows an arrangement of two devices arranged side-by-side in a horizontal manner. However, this is only one possible arrangement. Several other exemplary arrangements are described below with respect to FIGS. 2A-2D.
FIGS. 2A-2D illustrate different arrangements of mobile devices according to an exemplary embodiment of the present invention.
Referring to FIGS. 2A-2D, any number of devices may be combined to form a single logical screen, and a variety of arrangements are possible. FIG. 2A shows an example in which two devices are arranged vertically. This arrangement may be suitable for displaying a full-size keyboard on the physical screen of the lower device and enabling input of characters displayed on the physical screen of the upper device.
FIGS. 2B and 2C show examples of more than two devices combining to form a single logical screen. In FIG. 2B, three devices are shown in a pyramid arrangement, while in FIG. 2C, the three devices are shown arranged side-by-side. Arrangements of more than three devices are also possible.
The screens of the mobile devices need not be perfectly aligned. FIG. 2D shows an example in which the screens of Device 1 and Device 2 are not perfectly aligned. According to some exemplary embodiments, the tiling and combining may not occur until the screens of the devices are substantially aligned with one another, such as the arrangements shown in FIG. 1 and FIGS. 2A and 2C. According to other exemplary embodiments, the physical screens may be combined even when they do not align with each other, such as the examples shown in FIGS. 2B and 2D.
Where the physical screens do not align, such as in the arrangement shown in FIG. 2B, the physical screens may be tiled and combined in such a way that the logical screen has an irregular shape. The physical screens may also be tiled and combined in such a way that the logical screen maintains a rectangular arrangement. In this case, a mapping may occur when moving a graphical component from one screen to another. For example, in the arrangement shown in FIG. 2B, the entire top edge of Device 1 may be mapped to the left half of Device 3's bottom edge.
Although FIG. 1 and FIGS. 2A-2D show mobile devices of the same size, it is understood that the mobile devices may have different sizes or types. For example, Device 1 may be a tablet with a relatively large form factor, while Device 2 may be a tablet with a smaller form factor. Similarly, Device 1 may be a tablet and Device 2 may be a mobile phone (e.g., smartphone).
The functionality for facilitating screen sharing according to exemplary embodiments of the present invention may be incorporated into an operating system of the mobile devices, such as the Android™ operating system developed by Google, Inc. The functionality may also be incorporated into a separate application. In this case, applications may be developed for different operating systems to allow screen sharing across devices having different operating systems.
FIG. 3 illustrates a mobile device according to exemplary embodiments of the present invention.
Referring to FIG. 3, the mobile device 300 includes a screen 310 and a sensor 320. In addition, the mobile device 300 may also include a controller and a communication unit. The controller is disposed within the mobile device 300 and is thus not shown in FIG. 3; similarly, the communication unit may be disposed entirely or partially within the mobile device 300 (the communication unit may include an antenna arranged on the exterior of the mobile device 300) and is also not shown in FIG. 3. The mobile device 300 may also include additional units not shown, which may vary according to the function of the mobile device 300. Such additional units may include a storage unit, a camera, a Global Position System (GPS) or other location services unit, a speaker, a microphone, an input unit, and the like.
The display unit 310 represents a physical screen of the mobile device 300, and displays graphical components, including windows, icons, menus, other user interface elements, and various content. The display unit 320 may be implemented as a touch screen. When the controller determines that another device is in contact with the mobile device 300, the controller controls the physical screen of the display unit 310 to act as a portion of a logical screen. Accordingly, the user may move graphical components displayed on the physical screen of the display unit 320 among and between the physical screens of the other mobile device(s) as if the graphical components were on the same screen. While the display unit 310 is described herein as a touch screen, it should be understood that exemplary embodiments of the present invention are not limited thereto.
The sensor unit 320 detects the approach and alignment of other devices and provides this information to the controller. The sensor 320 may be any type of sensor that is capable of detecting contact or proximity, and may be an inductive type, capacitive type, optical type, ultrasonic type, magnetic type, and the like. While only one sensor 320 is shown on the mobile device 300, multiple sensors 320 may be deployed, and may be arranged on two or more sides of the mobile device. The sensors may be arranged in a dense manner or in a sparse manner. A sparse array of sensors may be used to detect a limited number of predetermined alignments, while a denser array may be able to detect a larger range of alignments.
According to another exemplary embodiment of the present invention, the sensor 320 may be replaced or supplemented by a group of pins arranged on some or all sides of the device. When these pins come into contact with corresponding pins in the other mobile device, a communication circuit is completed that enables the two devices to communicate data regarding the logical screen. This communication may supplement or replace communication via the communication unit. In this exemplary embodiment, the pins may be supplemented with magnets to facilitate proper alignment between the mobile device 300 and the other mobile device.
The controller controls the overall operations of the mobile device 300. The controller determines whether another device is in contact with the mobile device 300, based on the information provided by the sensor 320. When the controller determines that another device is in contact with the mobile device, the controller determines the side (or portion of a side) that is contacting the other device, and cooperates with the other device (via the communication unit) to tile and combine the physical screens into a single logical screen.
While the logical screen is active and the mobile device 300 is contacting the other device, the controller may be responsible for displaying any graphical components to be displayed on the physical screen of the display unit 310. When a graphical component moves to the physical screen of the other device, the controller may communicate information needed to render the graphical component, as well as other related information, to the other device via the communication unit. Similarly, when the graphical component moves to the physical screen of the mobile device 300, the controller may receive information needed to render the graphical component via the display unit 310, as well as other related information.
The communication unit may communicate with the other devices using any short-range communication system. Exemplary systems include NFC, Bluetooth, and infrared communication. In addition, according to the functionality of the mobile device 300, the communication unit may also be equipped to communicate using other wired or wireless communication systems.
Exemplary embodiments of the present invention may have a variety of applications. Two such applications, file transfer and virtual keyboard, have been described above. However, exemplary embodiments may also be applied to games and social applications. For example, tiling and combining two physical screens into one logical screen may open up new methods of gameplay and multiplayer options. Other applications are also possible, including multitasking (e.g., showing multiple windows on the same screen, displaying data from one or more devices) or document viewing (e.g., showing one document on one physical screen and another document on another physical screen). Other applications are, of course, also possible, and it is to be understood that exemplary embodiments of the present invention are not limited to these applications.
While it has been described above that the devices come into contact with each other, the devices need not come into physical contact with each other. For example, the devices could be separated by a distance of up to several millimeters. Such a distance would be close enough for the user to perceive the physical screens as a single logical screen and to allow the user to manipulate both physical screens easily. In addition, relaxing the requirement for physical contact will assist children and users with limited dexterity, for whom it might be difficult to arrange the devices appropriately.
While the invention has been shown and described with reference to certain exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims and their equivalents.

Claims (16)

What is claimed is:
1. A mobile device comprising:
a sensor;
a communication unit for determining whether at least one other mobile device is in physical contact with the mobile device along at least a portion of an edge of the mobile device, based on information received from the sensor, and for communicating with the at least one other mobile device;
a display unit including a physical screen for displaying a graphical component; and
a controller for combining the physical screen of the display unit with physical screens of the at least one other mobile device into a single logical screen such that graphical components displayed on one physical screen may be moved to another physical screen as if both physical screens were part of a single screen.
2. The mobile device of claim 1, wherein the controller controls the display unit to render each graphical component displayed on the physical screen of the display unit.
3. The mobile device of claim 2, wherein, when a graphical component is moved from the physical screen of the display unit to a physical screen of one of the at least one other mobile devices, the controller controls the communication unit to transmit information for rendering the graphical component to the corresponding at least one other mobile device.
4. The mobile device of claim 2, wherein, when a graphical component is moved from the physical screen of the display unit to physical screen of one of the at least one other mobile devices, the controller controls the communication unit to transmit information related to the graphical component to the corresponding at least one other mobile device.
5. The mobile device of claim 1, wherein the display unit includes a touch screen.
6. The mobile device of claim 1, wherein the sensor comprises a plurality of sensors arranged on at least two sides of the mobile device.
7. The mobile device of claim 1, wherein the controller controls the display unit to transmit information to the at least one other mobile device, the information relating to user interaction with the graphical component.
8. The mobile device of claim 1, wherein the receiver receives information about a second graphical component to be displayed by the display unit, and the controller controls the display unit to display the second graphical component according to the received information.
9. The mobile device of claim 1, wherein the sensor determines whether the mobile device is substantially in contact with at least one other mobile device, and determines at least one of an orientation and alignment of the at least one other mobile device.
10. The mobile device of claim 1, wherein the sensor comprises a group of pins connectable to a corresponding group of pins in the at least one other mobile device such that a communication channel is created between the mobile device and the at least one other mobile device when the group of pins contacts the corresponding group of pins.
11. A method for sharing screens of multiple mobile devices, the method comprising:
rendering, by a first mobile device, a graphical component on a first physical screen of the first mobile device;
determining whether a second mobile device in is physical contact with the first mobile device along at least a portion of an edge of the mobile device; and
when the second mobile device is in physical contact with the first mobile device, tiling and combining the first physical screen with a second physical screen of the second mobile device to create a logical screen.
12. The method of claim 11, further comprising:
receiving a user input to move the graphical component from the first physical screen to the second physical screen; and
rendering, by the second mobile device, the graphical component on the second physical screen.
13. The method of claim 12, further comprising:
transmitting information to the second mobile device so as to allow the second mobile device to render the graphical component on the second physical screen.
14. The method of claim 12, further comprising:
transmitting information related to the graphical component to the second mobile device.
15. The method of claim 11, further comprising:
receiving, at the first mobile device from the second mobile device, information on a second graphical component; and
rendering, by the first mobile device, the second graphical component on the first physical screen based on the received information.
16. The method of claim 11, further comprising:
receiving, by the first mobile device, information about user interaction with a graphical component displayed on the first physical screen; and
transmitting, from the first mobile device to the second mobile device, the information about the user interaction.
US13/734,163 2013-01-04 2013-01-04 Apparatus and method for sharing screens from multiple mobile devices Expired - Fee Related US9197734B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/734,163 US9197734B2 (en) 2013-01-04 2013-01-04 Apparatus and method for sharing screens from multiple mobile devices
KR1020130167205A KR102124498B1 (en) 2013-01-04 2013-12-30 Apparatus and method for sharing screens

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US13/734,163 US9197734B2 (en) 2013-01-04 2013-01-04 Apparatus and method for sharing screens from multiple mobile devices

Publications (2)

Publication Number Publication Date
US20140194066A1 US20140194066A1 (en) 2014-07-10
US9197734B2 true US9197734B2 (en) 2015-11-24

Family

ID=51061304

Family Applications (1)

Application Number Title Priority Date Filing Date
US13/734,163 Expired - Fee Related US9197734B2 (en) 2013-01-04 2013-01-04 Apparatus and method for sharing screens from multiple mobile devices

Country Status (2)

Country Link
US (1) US9197734B2 (en)
KR (1) KR102124498B1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170052665A1 (en) * 2015-08-20 2017-02-23 Samsung Electronics Co., Ltd. Method of text input for wearable devices

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6097679B2 (en) * 2013-02-28 2017-03-15 エルジー アプラス コーポレーション Inter-terminal function sharing method and terminal
EP2801891B1 (en) 2013-05-09 2018-12-26 Samsung Electronics Co., Ltd Input Apparatus, Pointing Apparatus, Method for Displaying Pointer, and Recordable Medium
US9417835B2 (en) 2013-05-10 2016-08-16 Google Inc. Multiplayer game for display across multiple devices
JP2015061107A (en) * 2013-09-17 2015-03-30 株式会社リコー Distribution management device and distribution system
KR20150117018A (en) * 2014-04-09 2015-10-19 삼성전자주식회사 Computing apparatus, method for controlling computing apparatus thereof, and multi-display system
US9880799B1 (en) * 2014-08-26 2018-01-30 Sprint Communications Company L.P. Extendable display screens of electronic devices
US10015214B2 (en) * 2014-09-30 2018-07-03 Adobe Systems Incorporated Method and apparatus for sharing viewable content with conference participants through automated identification of content to be shared
KR102269481B1 (en) * 2014-10-17 2021-06-28 삼성전자주식회사 Method for screen sharing with devices and device thereof
KR102335024B1 (en) * 2014-12-10 2021-12-03 삼성전자주식회사 Method for controlling and an electronic device thereof
CN104754128B (en) * 2015-03-23 2018-03-27 联想(北京)有限公司 A kind of information processing method and electronic equipment
CN107018204B (en) * 2017-05-25 2020-06-05 深圳市勤能科技有限公司 Data interaction method and equipment
US11093197B2 (en) * 2017-07-31 2021-08-17 Stmicroelectronics, Inc. System and method to increase display area utilizing a plurality of discrete displays
CN107566866B (en) * 2017-09-21 2020-06-09 四川长虹电器股份有限公司 Television capable of being used in combination, screen combination display method and screen division display method
US10732916B2 (en) * 2017-11-28 2020-08-04 Ncr Corporation Multi-device display processing
CN111381791B (en) * 2020-03-03 2023-03-21 安徽文香科技有限公司 Interactive system, method, equipment and storage medium
KR20230014479A (en) * 2021-07-21 2023-01-30 삼성전자주식회사 Method of displaying integrated screen and electronic device supporting the same

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7894854B2 (en) * 2004-10-26 2011-02-22 Pantech & Curitel Communications, Inc. Image/audio playback device of mobile communication terminal
US7894860B2 (en) * 2006-11-03 2011-02-22 Samsung Electronics Co., Ltd. Method and apparatus for displaying a plurality of images in mobile terminal
US20130065648A1 (en) * 2011-09-08 2013-03-14 Hyungjung KIM Mobile terminal and control method for the same
US20130090101A1 (en) * 2011-10-10 2013-04-11 Joonkyu Park Mobile terminal and controlling method thereof
US20130132477A1 (en) * 2011-11-21 2013-05-23 Andrew Garrod Bosworth Location Aware Shared Spaces
US20130138728A1 (en) * 2011-11-25 2013-05-30 Lg Electronics Inc. Mobile device, display device and method for controlling the same
US20140007080A1 (en) * 2012-06-27 2014-01-02 Clearside, Inc. System and method for dynamically creating executable files
US8660492B2 (en) * 2011-05-20 2014-02-25 Lg Electronics Inc. Mobile terminal and method of controlling the same
US20140073300A1 (en) * 2012-09-10 2014-03-13 Genband Us Llc Managing Telecommunication Services using Proximity-based Technologies
US8682248B2 (en) * 2012-04-07 2014-03-25 Samsung Electronics Co., Ltd. Method and system for reproducing contents, and computer-readable recording medium thereof
US20140155031A1 (en) * 2012-12-03 2014-06-05 Samsung Electronics Co., Ltd. Method and mobile terminal for controlling screen lock
US8774715B2 (en) * 2011-05-18 2014-07-08 Lg Electronics Inc. Mobile terminal
US8838135B2 (en) * 2011-07-26 2014-09-16 Golba Llc Distributed method and system for determining the position of a mobile device using long-range signals and calibrating the position using short-range signals

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060146765A1 (en) * 2003-02-19 2006-07-06 Koninklijke Philips Electronics, N.V. System for ad hoc sharing of content items between portable devices and interaction methods therefor
KR101278194B1 (en) * 2008-12-03 2013-06-27 한국전자통신연구원 Apparatus for display of portable terminal and method thereof

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7894854B2 (en) * 2004-10-26 2011-02-22 Pantech & Curitel Communications, Inc. Image/audio playback device of mobile communication terminal
US7894860B2 (en) * 2006-11-03 2011-02-22 Samsung Electronics Co., Ltd. Method and apparatus for displaying a plurality of images in mobile terminal
US8774715B2 (en) * 2011-05-18 2014-07-08 Lg Electronics Inc. Mobile terminal
US8660492B2 (en) * 2011-05-20 2014-02-25 Lg Electronics Inc. Mobile terminal and method of controlling the same
US8838135B2 (en) * 2011-07-26 2014-09-16 Golba Llc Distributed method and system for determining the position of a mobile device using long-range signals and calibrating the position using short-range signals
US20130065648A1 (en) * 2011-09-08 2013-03-14 Hyungjung KIM Mobile terminal and control method for the same
US20130090101A1 (en) * 2011-10-10 2013-04-11 Joonkyu Park Mobile terminal and controlling method thereof
US20130132477A1 (en) * 2011-11-21 2013-05-23 Andrew Garrod Bosworth Location Aware Shared Spaces
US20130138728A1 (en) * 2011-11-25 2013-05-30 Lg Electronics Inc. Mobile device, display device and method for controlling the same
US8682248B2 (en) * 2012-04-07 2014-03-25 Samsung Electronics Co., Ltd. Method and system for reproducing contents, and computer-readable recording medium thereof
US20140007080A1 (en) * 2012-06-27 2014-01-02 Clearside, Inc. System and method for dynamically creating executable files
US20140073300A1 (en) * 2012-09-10 2014-03-13 Genband Us Llc Managing Telecommunication Services using Proximity-based Technologies
US20140155031A1 (en) * 2012-12-03 2014-06-05 Samsung Electronics Co., Ltd. Method and mobile terminal for controlling screen lock

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170052665A1 (en) * 2015-08-20 2017-02-23 Samsung Electronics Co., Ltd. Method of text input for wearable devices
US10382927B2 (en) * 2015-08-20 2019-08-13 Samsung Electronics Co., Ltd. Method of text input for wearable devices

Also Published As

Publication number Publication date
KR20140089300A (en) 2014-07-14
US20140194066A1 (en) 2014-07-10
KR102124498B1 (en) 2020-06-22

Similar Documents

Publication Publication Date Title
US9197734B2 (en) Apparatus and method for sharing screens from multiple mobile devices
US9338116B2 (en) Device and method for displaying and interacting with display objects
EP2797299B1 (en) Device and method for remote controlling of an external display using different positions of the remote controller
US9389691B2 (en) Devices and methods for establishing a communicative coupling in response to a gesture
EP2391093B1 (en) Electronic device and method of controlling the same
US20140320387A1 (en) Device, System and Method for Generating Display Data
US11604535B2 (en) Device and method for processing user input
US9829706B2 (en) Control apparatus, information processing apparatus, control method, information processing method, information processing system and wearable device
CN103677711A (en) Method for connecting mobile terminal and external display and apparatus implementing the same
KR101343587B1 (en) Data transfering method using direction information and mobile device using the method
US9794396B2 (en) Portable terminal and method for controlling multilateral conversation
CA2862987A1 (en) Device and method for identifying data
US20140168255A1 (en) Device and Method for Processing Notification Data
EP2827238B1 (en) Actionable user input on displayed items
KR102463080B1 (en) Head mounted display apparatus and method for displaying a content
WO2013164351A1 (en) Device and method for processing user input
EP2660695B1 (en) Device and method for processing user input
US20150215465A1 (en) Communication message management method and electronic device supporting the same
EP2797280A1 (en) Device, system and method for generating display data
EP2819387B1 (en) Device and method for displaying and interacting with display objects
EP2746930A1 (en) Device and method for processing notification data

Legal Events

Date Code Title Description
AS Assignment

Owner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LI, ZHIYUN;REEL/FRAME:029567/0885

Effective date: 20121228

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20231124