US20120050183A1 - Switching display modes based on connection state - Google Patents

Switching display modes based on connection state Download PDF

Info

Publication number
US20120050183A1
US20120050183A1 US12943444 US94344410A US2012050183A1 US 20120050183 A1 US20120050183 A1 US 20120050183A1 US 12943444 US12943444 US 12943444 US 94344410 A US94344410 A US 94344410A US 2012050183 A1 US2012050183 A1 US 2012050183A1
Authority
US
Grant status
Application
Patent type
Prior art keywords
mobile device
display
controls
application
display mode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12943444
Inventor
Reena Singhal Lee
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control and interface arrangements for touch screen
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/14Solving problems related to the presentation of information to be displayed
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2380/00Specific applications
    • G09G2380/14Electronic books and readers
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for switching display modes based on connections between devices. In one aspect, it is determined that an external display has been connected to or disconnected from a mobile device. Based on the determining, an application executing on the mobile device is switched between a first display mode and a second display mode. In the first display mode, a single user interface is displayed on the touch screen of the mobile device. In the second display mode, a first user interface is displayed on the external display and a second user interface, for receiving user inputs, is displayed on the touch screen of the mobile device.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims priority to U.S. Application Ser. No. 61/377,673 filed on Aug. 27, 2010 and entitled “Switching Display Modes Based on Connection State,” the entire contents of which are incorporated herein by reference.
  • BACKGROUND
  • This specification relates to mobile devices.
  • Mobile devices, such as smart phones, personal digital assistants (PDAs), and the like, typically include touch screen displays that can display information to a user. Through a touch screen display of a mobile device, a user can provide input to the mobile device, in response to which the mobile device can display information. In several situations, the mobile device simultaneously displays information on and enables users to provide inputs through the touch screen display.
  • Mobile devices are often sized to fit in a user's palm. Consequently, the size of the touch screen display that a mobile device includes is small relative to, for example, a computer monitor or a television screen. Also, in some situations, there may be limitations on the display characteristics of the touch screen display due to constraints on a number and/or size of components that can be installed in the mobile device. The small size of mobile device touch screen displays makes it difficult to simultaneously display information and receive user inputs.
  • SUMMARY
  • In general, one innovative aspect of the subject matter described in this specification can be embodied in processes for switching display modes of a mobile device (or of an application running on the mobile device), based on the state of a connection between the mobile device and an external display. When the mobile device and the external display are disconnected, the mobile device can display a single user interface on, and can receive inputs through, its touch screen. When the mobile device and the external display are connected, the mobile device can display a user interface on, and can receive inputs through, its touch screen, and can display a different, user interface on the external display. When connected, the user interface on the touch screen can display controls which help the user to provide inputs, while user interface on the external display can be the primary user interface for the application.
  • In general, another innovative aspect of the subject matter described in this specification can be embodied in methods that include the actions of determining that an external display has been connected to or disconnected from a mobile device, and based on determining that the external display has been connected to or disconnected from the mobile device, switching an application executing on the mobile device between a first display mode in which the application generates a single user interface for display on a touch screen of the mobile device, and a second display mode in which the application generates a first user interface for display on the external display and a different, second user interface for display on, and for receiving user inputs through, the touch screen of the mobile device.
  • Other embodiments of these aspects include corresponding systems, apparatus, and computer programs, configured to perform the actions of the methods, encoded on computer storage devices.
  • These and other embodiments can each optionally include one or more of the following features. In various examples, determining that an external display has been connected to or disconnected from a mobile device further comprises determining that the external display has been connected to the mobile device, and switching an application further comprises switching the application from the first display mode to the second display mode; determining that the external display has been connected to or disconnected from the mobile device further comprises determining that the external display has been disconnected from the mobile device, and switching an application further comprises switching the application from the second display mode to the first display mode; displaying, on the touch screen of the mobile device in the first display mode, a visual element and a first set of controls for receiving user inputs to control the visual element, displaying, on the external display in the second display mode, the visual element, and displaying, on the touch screen of the mobile device in the second display mode, a second set of controls for receiving the user inputs to control the visual element; the second set of controls includes controls that are not included in the first set of controls; the second set of controls includes all controls of the first set of controls and additional controls; and/or the actions include, in the first display mode, displaying a control in a first size, and in the second display mode, displaying the control in a second size that is larger than the first size.
  • Particular implementations of the subject matter described in this specification can be implemented so as to realize one or more of the following advantages. A mobile device can display a user interface on its touch screen for the purpose of aiding or encouraging user input. At the same time, a different user interface can be displayed on an external display, as the primary user interface for an application running on the mobile device. Because the external display can be larger or can include different display characteristics than the touch screen, the user can have a better experience when running the application with a connected external display, than they would by running the application on the mobile device alone. Controls displayed on the touch screen can guide or otherwise inform the user when interacting with the touch screen.
  • Furthermore, a user does not need to restart an application in order to display the user interface of a mobile device application on the external display. Rather, by connecting the mobile device and the external display, not only can the user view a user interface on the external display, but the user can also control the user interface displayed on the larger external display through interactions with the touch screen of the mobile device. Because the mobile device can be designed to be held in a user's hand, the user can find it easier to provide inputs through the touch screen of the mobile device than through some other input mechanism. All of these advantages can enhance the user experience when the user invokes gaming, navigation, media playing, or other types of applications.
  • The details of one or more implementations of the subject matter described in this specification are set forth in the accompanying drawings and the description below. Other potential features, aspects, and advantages of the subject matter will become apparent from the description, the drawings, and the claims.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIGS. 1A-B, 3A-B, 4A-B, 5 and 6 illustrate example mobile devices.
  • FIG. 2 is a flowchart of an example process.
  • Like reference numbers and designations in the various drawings indicate like elements.
  • DETAILED DESCRIPTION
  • FIG. 1A illustrates an example mobile device 105. Among other components, the mobile device 105 includes a touch screen 117 and one or more processors 180 that execute a computer application 182. In some implementations, the mobile device 105 can additionally include a hardware controller 124 (e.g., trackball, a track pad, a keyboard, or a mouse). The mobile device 105 can be, for example, a personal digital assistant (PDA), smart phone, navigation system, music player, tablet computer, e-book reader, or any other type of computing device.
  • As used by this specification, a “touch screen” (or “touchscreen,” or “touch screen display”) is an electronic visual display that can detect the presence and location of a touch within the display area. The touch, which defines a user input, can occur using a finger, hand, stylus light pen, or other object. The touch can represent a single touch at a particular location on the touch screen 117, or the touch can represent a movement, or “swipe,” across multiple locations on the touch screen 117. The user can touch the touch screen 117 to control the application.
  • Although the touch screen 117 and the external display 110 are both output devices for displaying visual information, the external display 110 is different from the touch screen 117 because it is a peripheral device that is connected to the mobile device 105 through an outside or outer part of the mobile device 105. For example, the external display 110 can be connected to the mobile device 105 through an external interface or port 129, while the touch screen 117 is built in to the mobile device 105. Because the external display 110 is not constrained internal to the mobile device 105 and is therefore not constrained by the size of the mobile device 105, the external display 110 can be larger than, or can include improved display characteristics over, the touch screen 117.
  • The application can be, for example, a media playing application, a gaming application, a navigation application, a text editor, or any other application. The application can generate and display one or more user interfaces on the touch screen 117. When the mobile device 105 is connected to the external display 110, the application can display one or more user interfaces on each of the touch screen 117 and/or the external display 110. Each user interface is made up of one or more graphical or textual elements, which are referred to collectively by this specification as “visual elements”).
  • The application running on the mobile device 105 (or the mobile device 105 itself) is capable of operating in two or more different display modes (e.g., first display mode 100 and second display mode 200), which are manually or automatically selected based at least upon whether the mobile device 105 is connected to or disconnected from the external display 110. Depending upon which mode is selected, the application can output a single user interface for display on the touch screen 117, or the application can output a user interface for display on the touch screen 117 for receiving user inputs, and can output another, different user interface for display on the external display 110 as the primary user interface for the application. The application receives user inputs through the touch screen 117 and/or hardware controllers 124. The primary user interface is a user interface within which the application displays the outputs (e.g., visual elements) generated in response to the user inputs.
  • The application can run in the first display mode 100 when the mobile device 105 is not connected to the external display 110, i.e., when the mobile device 105 is disconnected from the external display 110. The application can determine that the mobile device 105 is not connected to the external display 110 based on receiving a signal that indicates that no external display 110 is connected or that a port through which the external display 110 would be connected is not being used, or based on not receiving a signal that would indicate that an external display 110 is connected or that a port 129 through which the external display would be connected is being used. Alternatively, the application can prompt the user to specify whether the mobile device is or is not connected to the external display 110.
  • In the first display mode 100, the application generates a single user interface 120, and displays the user interface 120 on the touch screen 117. The user interface 120 includes one or more visual elements 121, which can include video, still and/or animated images, graphics, game components, interactive street maps, text, or combinations thereof. Generating a single user interface can include generating one or more user interfaces for display on a single display, but does not include generating a user interface for display on multiple displays, or generating different user interfaces for display in multiple displays.
  • Among the many visual elements displayed in the user interface 120, the application displays a set of controls (for example, controls 122) that, along with hardware controller 124, can be used to receive user inputs. In this situation, because the application is a media playing application, the set of controls 122 can include a “START/PAUSE” button 126, a “FORWARD” button 127, and a “REWIND” button 128. Other applications can use different types of controls.
  • The mobile device 105 transitions from the first display mode 101 to the second display mode 102 when the external monitor 110 is connected to the mobile device 105. Even after detecting the connection, the application can require confirmation from the user of the mobile device 105 before transitioning from the first display mode 101 to the second display mode 102. The connection 115 between the mobile device 105 and the external monitor 110 can be a wireless connection (e.g., through a Digital Visual Interface (DVI) connection) or through a wireless connection (e.g., through a BLUETOOTH interface).
  • The application can determine that the mobile device 105 is connected to the external display 110 based on receiving a signal that indicates that the external display 110 is connected or that a port 129 through which the external display 110 would be connected is being used, or based on not receiving a signal that would indicate that an external display 110 is disconnected or that a port 129 through which the external display would be connected is not being used. Alternatively, the application can prompt the user to specify whether the mobile device 105 is or is not connected to the external display 110.
  • In the second display mode 102, the application generates at least two user interfaces: user interface 130, which the mobile device 105 displays on the external display 110 and user interface 132, which the mobile device displays on the touch screen 117. The user interfaces 130 and 132 are different from each other, and are each different from the user interface 120.
  • In the second display mode 102, the application displays one or more visual elements (e.g., visual elements 140), which can include video, still and/or animated images, graphics, game components, interactive street maps, text, or combinations thereof. Because the user interface 130 is the primary user interface for the application in the second display mode, the visual elements 140 displayed in the user interface 130 in the second display mode 102 can include some or all of the visual elements (e.g., visual elements 121) that were displayed in the user interface on the touch screen 117 in the first display mode 101. When the external display 110 is larger than the touch screen 117 (or otherwise has different, e.g., an improved, display characteristic, relative to the touch screen 117), the visual element 140 can be displayed in a different, e.g., more visually pleasing, manner in the second display mode 102, than the visual element 121.
  • In the second display mode 102, the application also generates a user interface 132, which the application displays on the touch screen 117. In the second display mode 102, the application can receive inputs through a set of controls 135 that the application displays in the user interface 132, as well as through the hardware controller 124. Whereas, in the first display mode 101, the application displayed both the visual elements and the controls 122 in the touch screen 117, in the second display mode 102, the application can display other controls (e.g., set of controls 135) in the touch screen 117 because the application has moved certain visual elements to the external display. For example, the set of controls 135 can include a “START/PAUSE button” 136, a “FORWARD” button 137, and a “REWIND” button 138.
  • Because the application can display such other controls in the touch screen 117 in the second display mode 102, an input to control a visual element 121 that would have been received through the hardware controller 124 in the first display mode 101 can be received, instead, through the touch screen 117 in the second display mode 102 using the set of controls 135. Further, because the application can display other visual elements (e.g., same as or different from visual element 140) in the user interface 130 displayed on the external display 110, the application can display fewer visual elements in the user interface 132. For example, the application can display only the “START/PAUSE button” 136, the “FORWARD” button 137, and the “REWIND” button 138 on the user interface 132.
  • Furthermore, the user interfaces 132 or 140 can display a control (or a corresponding set of controls) with a size, shape, color, pattern, or other characteristic that is different than a corresponding control from the user interface 120, which can be larger or smaller than the first size. For example, the set of controls 122 and the set of controls 135, each include a “START/PAUSE button”, a “FORWARD” button, and a “REWIND” button. However, the “START/PAUSE button” 136 is larger in size than the “START/PAUSE” button 126, the “FORWARD” button 137 is larger than the “FORWARD” button 127, and the “REWIND” button 138 is larger than the “REWIND” button 128. In other words, in the user interface 132, the set of controls 135 can be displayed in a larger size relative to the touch screen 117 because the application has to display fewer visual elements within the touch screen 117. Doing so can make it easier for a user to interact with the user interface 132, especially on small screen mobile devices.
  • The mobile device 105 transitions from the second display mode 102 to the first display mode 101 when the external monitor 110 is disconnected from the mobile device 105. Even after detecting the disconnection, the application can require confirmation from the user of the mobile device 105 before transitioning from the second display mode to the first display mode. Disconnection can occur by detaching a cable (in the context of a wireline connection) or by terminating a BLUETOOTH connection or by disabling a transmitter (in the context of a wireless connection).
  • The application can determine that the mobile device 105 is disconnected from the external display 110 based on receiving a signal that indicates that no external display is connected or that a port 129 through which the external display would be connected is not being used, or based on not receiving a signal that would indicate that an external display is connected or that a port 129 through which the external display would be connected is being used. Once transitioned to the first display mode 101, the application stops displaying the first user interface 130 on the external display 110 and the second user interface 132 on the touch screen 117, and displays the single user interface 120 on the touch screen 117 instead.
  • FIG. 1B illustrates an example mobile device 205. In the first display mode 201, a media player application executing on the mobile device 205 generates a single user interface 220 and displays the user interface 220 on the touch screen 217. In addition, the media player application generates a set of controls 222 that include, for example, a “START/PAUSE” button 226, a “FORWARD” button 227, and a “REWIND” button 228. A user can provide input to view the media, for example, video content, using the set of controls 222 displayed on the touch screen 217.
  • When the mobile device 205 is connected to the external display 210 over the connection 215, through the port 229, the application switches the media player application to the second display mode 202. In the second display mode 202, the media player application generates a first user interface 230 which the mobile device 205 displays on the external display 210. Within the first user interface 230, the media player application displays visual elements (e.g., visual element 240) that the media player application displayed in user interface 220 in the first display mode 201. Further, the media player application generates a second user interface 232 that the mobile device 205 displays on the touch screen 217. Because the media player application displays visual elements on the external display 210, the media player application is provided with more space to display other visual elements and controls in the second user interface 232.
  • Also, the media player application can generate two sets of controls 235 and 245, and display both sets in the second user interface 232. Because more space is available on the touch screen 217 to the media player application, the application can display more controls on the touch screen 217 in the second display mode 202 than the application could in the first display mode 201. Consequently, the set of controls 235 can include all controls that are included in the set of controls 222 and the set of controls 245 can include additional controls. Alternatively, or in addition, in the second display mode 202, the application can generate a single set of controls that includes the controls displayed in the first display mode 201 and additional controls. For example, the set of controls 235 can include a “START/PAUSE” button 236, a “FORWARD” button 237, and a “REWIND” button 238. Additionally, the set of controls 245 can include, for example, a “RECORD” button 246, a “SKIP CHAPTER FORWARD” button 247, and a “SKIP CHAPTER BACKWARD” button 248.
  • Thus, in a first display mode 201, space constraints can limit a number of controls that can be displayed in the touch screen 217 of the mobile device 205 to display controls through which a user can provide inputs to control the visual elements. In the second display mode 202, when the mobile device 205 is connected to the external display 210, the space constraints are relaxed and more space is provided to the media player application to display controls. For example, a number of controls using which a user can provide inputs to the media player application increases when the mobile device 205 is connected to the external display 210. Consequently, whereas it was possible to display only a certain number of controls while operating the mobile device 205 in the first display mode 201, it becomes possible to display more controls while operating the mobile device in the second display mode 202.
  • FIG. 2 is a flowchart of an example process 250. Briefly, the process 250, which can be executed by one or more computers that are configured to execute computer software instructions, includes the actions of determining that an external display has been connected to or disconnected from a mobile device, and based on determining that the external display has been connected to or disconnected from the mobile device, switching an application executing on the mobile device between a first display mode in which the application generates a single user interface for display on a touch screen of the mobile device, and a second display mode in which the application generates a first user interface for display on the external display and a different, second user interface for display on, and for receiving user inputs through, the touch screen of the mobile device.
  • When the process 250 begins, it is determined that an external display has been connected to a mobile device (255). For example, the application receives a signal indicating that an external display has been connected to the mobile device. Alternatively, or in addition, the application executing on the mobile device stops receiving a signal that would indicate that an external display is disconnected or that a port through which the external display would be connected is not being used. Further, the application determines that the external display has been connected to the mobile device upon receiving a signal from the user indicating that the mobile device is connected to the external display.
  • Based on determining that the external display has been connected to the mobile device, an application executing on the mobile device is switched from a first display mode in which the application generates a single user interface for display on a touch screen of the mobile device, to a second display mode in which the application generates a first user interface for display on the external display and a different, second user interface for display on, and for receiving user inputs through, the touch screen of the mobile device (260).
  • In some implementations, a mobile device can be connected to the two external displays. In such implementations, the application can be switched from the first display mode to a second display mode in which the application displays two second user interfaces on the two external displays. The two second user interfaces can be identical to each other. Alternatively, in some implementations, the application can be switched to a second display mode in which the application displays a second user interface in one of the external displays and displays a third user interface in the other external display. The second user interface and the third user interface can each display different visual elements.
  • In some implementations, when the application determines the connection between the mobile device and the external display, the application can receive display characteristics of the external display, e.g., screen resolution, screen size, and the like. In response, the application can generate a second user interface that the application determines as being optimal for an external display having the received display characteristics. For example, if the screen size of the external display is larger than that of the touch screen, then the application can generate controls that are larger than the controls displayed in the touch screen of the mobile device.
  • In some implementations, when the application determines the connection between the mobile device and the external display, the application can additionally determine if the external display is configured to receive user inputs. For example, the application can receive one or more signals from the external display indicating that the external display includes a touch screen through which the external display can receive inputs. In response, the application can generate visual elements and controls for display in the second user interface. For example, the application can display a first set of controls on the touch screen of the mobile device and a second, additional set of controls on the touch screen of the external display.
  • It is determined that the external display has been disconnected from the mobile device (265). For example, the application can determine that the mobile device is disconnected from the external display based on receiving a signal that indicates that no external display is connected or that a port 229 through which the external display would be connected is not being used, or based on not receiving a signal that would indicate that an external display is connected or that a port 229 through which the external display would be connected is being used.
  • Based on determining that the external display has been disconnected from the mobile device, the application is switched from the second display mode to the first display mode (270), thereby ending the process 250. For example, the mobile device can detect that a signal that previously indicated that a connection was established now has been lost. Specifically, the application can detect that a Bluetooth connection through which the mobile device and the external display were paired has been terminated. Alternatively, the application can detect that a signal received through the cable that connected the port 229 of the mobile device to the external display is no longer received. Further, when power to the external display is turned off in a second display mode, the application can automatically switch the application to the first display mode.
  • FIGS. 3A-B illustrate an example mobile device 300. In the first display mode 301, a navigation application generates a single user interface 305 that the mobile device displays on the touch screen of the mobile device 300. Further, the navigation application generates and displays one or more visual elements, for example, visual element 320, within the user interface 305. For example, the visual element 320 represents an interactive street map. The navigation application displays the interactive street map in the user interface 305.
  • Further, the navigation application generates a set of controls (controls 315, 325, 330) that the mobile device 300 displays in the user interface 305. A user can use the set of controls to provide input to interact with the visual element 320. For example, the set of controls include a keyboard control 315. A user can input text using the keyboard control 315. In the context of a navigation application, the user can use the keyboard control 315 to input addresses.
  • The navigation application can identify the location specified by the address and display an identifier marking the location on the visual element 320 corresponding to the interactive street map. In some implementations, the mobile device 300 includes a touch screen configured to receive user inputs such as a finger swipe. By swiping a finger across the visual element 320 representing the interactive street map, the user can navigate the street map. In some implementations, the set of controls can include a directionality control 325 that can include, for example, controls representing arrows. The mobile device 300 can receive user inputs through the directionality controls 325 to navigate the interactive street map. In some implementations, the navigation application can generate and display in the user interface 305, another visual element 330 representing a text box. The address that the user inputs through the keyboard control 315 can be displayed in the visual element 330 representing the text box.
  • When the mobile device 300 is connected to the external display 335, the navigation application switches to a second display mode 302. In the second display mode 302, the navigation application generates and displays a first user interface 342 on the external display 335. Further, the navigation application generates and displays a second user interface 344 on the touch screen of the mobile device 300. In the first user interface 342, the navigation application displays a visual element 346 representing the interactive street map. Further, the navigation application displays a visual element 354 representing a text box in which the navigation application displays the address that the user has provided.
  • In the second user interface 344, the navigation application displays a set of controls (controls 348, 350, 352). The control 352 is a keyboard control similar to the control 315 displayed in the first display mode 301. The controls 348 and 350 represent sliding bars using which the user can interact with the visual element 346 representing the interactive street map, for example, in lieu of the finger swiping input with which the user interacted with the interactive street map in the first display mode 301. Thus, in some implementations, the controls in the second set of controls in the second display mode 302 can include controls that are not included among the set of controls in the first display mode 301. In alternative implementations, as shown in FIG. 3B, the navigation application can display the visual element 354 representing the text box in the second user interface 344 displayed on the touch screen of the mobile device 300.
  • Further, in some implementations, the navigation application can display the user interface, the visual elements, and the controls in a portrait orientation in the first display mode 301. In such implementations, in the second display mode 302, the navigation application can display the user interface, the visual elements, and the controls in a landscape orientation.
  • In this manner, the mobile device 300 can be used to control an interactive street map displayed on the external display 335 to which the mobile device 300 is connected. For example, a user can execute the navigation application on the mobile device 300 that is not connected to any external display. In such a situation, the user can input an address using the controls 315, for example, and view an interactive street map 320 on the touch screen of the mobile device 300.
  • When the user connects the mobile device 300 to the external display 335, for example, a display screen of an in-car navigation system, the display screen of the in-car navigation system displays the interactive street map and the mobile device 300 displays controls to input an address on the touch screen of the mobile device 300. Thus, by connecting the mobile device 300 to the in-car navigation system, the user can use the mobile device 300 to control and interact with the street map.
  • FIGS. 4A-B illustrate an example mobile device 400. Similar to the second display mode 302 described with reference to FIGS. 3A-B, the mobile device 400 detects a connection 430 between the mobile device 400 and an external display 435. The mobile device 400 switches the display mode of a navigation application from a first display mode to a second display mode 402 in which the navigation application displays a visual element 445 representing an interactive street map in the user interface 440 on the external display 435.
  • In some implementations, the visual elements and controls that the navigation application displays in a user interface on the touch screen 405 can be similar to those that the navigation application displays in the user interface on the touch screen 405 in the first display mode. Therefore, for example, in both the first and second display modes, the navigation application can display a keyboard control 415, and a visual element 420 representing a textbox. In addition, in the second display mode 402, the navigation application can display scroll bar controls 422 and 424.
  • In some implementations, when the navigation application switches the navigation application from the first display mode to the second display mode 402, the navigation application generates and displays a set of controls on the touch screen of the mobile device 400 that are entirely different from the set of controls that the navigation application generates and the mobile device displays in the first display mode. For example, as described with reference to FIG. 4B, the navigation application displays multiple controls in the user interface 450 on the touch screen 405.
  • The multiple controls can include a “SAT” button 456 through which the mobile device 405 receives input to display a visual element 445 representing a satellite image of the interactive street map in the external display 435. The controls can also include a “STREET” button 458 through which the mobile device 405 receives input to display another visual element representing a street view of a location on the interactive street map. The controls can further include a “MAP” button that can return the display on the external display 445 to a map view from a street view.
  • In some scenarios, the mobile device 400 can include voice functionalities through which input to control the navigation application can be received. The controls can include a “VOICE” button and a “MUTE” button, through which the user can provide input to activate and de-activate the voice functionalities, respectively. Further, the controls can include zoom buttons 452 and 454, an “EXIT” button 466, and the like.
  • FIG. 5 illustrates an example mobile device 500. The mobile device 500 can execute a gaming application in a first display mode 501 and a second display mode 502. In the first display mode 501, the gaming application generates a single user interface 510 that the mobile device 500 displays on the touch screen 505. Further, the gaming application generates a set of controls 512 through which inputs are received to control a visual element 514 that the gaming application generates.
  • In some implementations, as an alternative or in addition to the set of controls 512, a user can control the visual element 514 directly by touching the visual element 514 or other portions of the user interface 510. Thus, in the first display mode 501, the gaming application generates and displays a video game interface on the touch screen 505.
  • When connected to an external display 515, the gaming application determines that a connection 520 to the external display 515 exists, and switches from the first display mode 501 to the second display mode 502. In the second display mode 502, the gaming application generates and displays a first user interface 525 on the external display 515. In this user interface 525, the gaming application displays the video game interface that the mobile device 500 displayed on the touch screen 505 in the first display mode 501. Further, the gaming application generates and displays a second user interface 535 on the touch screen 505.
  • In the second display mode 502, the gaming application can generate display a set of controls 540 that include multiple control buttons and visual elements representing arrows pointing in different directions. Because the video game interface is displayed in the external display 515, the visual elements that are to be controlled as part of the gaming experience need no longer be displayed on the touch screen of the mobile device 500.
  • Instead, the set of controls 540 that the mobile device 500 displays on the touch screen 505 of the mobile device 500 can be used to control the visual elements 530 displayed in the external display 515. Thus, when the mobile device 500 executes a gaming application and the mobile device 500 is connected to an external display 515, the mobile device 500 can be used as a controller to control visual elements displayed in a video game interface displayed in the external display 515.
  • FIG. 6 illustrates an example mobile device 600. An application executing on the mobile device 600 requests permission to switch from a first display mode to a second display mode 602. In some situations, the mobile device 600 can be in an environment of one or more external displays with which the mobile device 600 can automatically be paired, e.g., through a BLUETOOTH connection. However, the user may not always desire such a pairing, but rather may desire to continue to operate the mobile device 600 in a first display mode even when the mobile device 600 can be operated in the second display mode. In such situations, the application requests permission to switch from the first display mode to the second display mode to ensure that the user desires such a switch.
  • The mobile device 600 can include a touch screen 605 and hardware controllers 620 through which input can be received to control visual elements displayed on the touch screen 605. The application can detect a connection 615 to an external display 610. To request permission, the application can display a message on the touch screen 605 indicating that the mobile device 600 detects a connection to an external display, and can display another message asking the user to provide input indicating whether the application should switch from the first display mode to the second display mode.
  • For example, the application can display the message, “SWITCH?”, and display a “YES” button 607 and a “NO” button 609 in the user interface 605. The user can select the “YES” button 607, e.g., by touching the touch screen of the mobile device 600, thereby providing permission to switch. Upon receiving permission to switch, the mobile device 600 can switch the application from the first display mode to the second display mode. If the user selects the “NO” button 609 instead, the application can determine that the user has denied permission to switch display modes. In response, the mobile device 600 can continue to execute the application in the first display mode.
  • Implementations of the subject matter and the operations described in this specification can be implemented in digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Implementations of the subject matter described in this specification can be implemented as one or more computer programs, i.e., one or more modules of computer program instructions, encoded on computer storage medium for execution by, or to control the operation of, data processing apparatus. Alternatively or in addition, the program instructions can be encoded on an artificially-generated propagated signal, for example, a machine-generated electrical, optical, or electromagnetic signal, which is generated to encode information for transmission to suitable receiver apparatus for execution by a data processing apparatus.
  • A computer storage medium (similar to the computer readable medium 184 shown in FIG. 1A) can be, or be included in, a computer-readable storage device, a computer-readable storage substrate, a random or serial access memory array or device, or a combination of one or more of them. Moreover, while a computer storage medium is not a propagated signal, a computer storage medium can be a source or destination of computer program instructions encoded in an artificially-generated propagated signal. The computer storage medium can also be, or be included in, one or more separate physical components or media (for example, multiple CDs, disks, or other storage devices).
  • The operations described in this specification can be implemented as operations performed by a data processing apparatus on data stored on one or more computer-readable storage devices or received from other sources. For example, the mobile device can include one or more computer-readable storage devices that store the computer software instructions. The mobile device can further include one or more data processing apparatuses that can read the computer software instructions from the computer-readable storage devices and execute them.
  • The term “data processing apparatus” encompasses all kinds of apparatus, devices, and machines for processing data, including by way of example a programmable processor, a computer, a system on a chip, or multiple ones, or combinations, of the them. The apparatus can include special purpose logic circuitry, for example, an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit). The apparatus can also include, in addition to hardware, code that creates an execution environment for the computer program in question, for example, code that constitutes processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of them.
  • A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, declarative or procedural languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, object, or other unit suitable for use in a computing environment. A computer program can, but need not, correspond to a file in a file system. A program can be stored in a portion of a file, in a single file dedicated to the program in question, or in multiple coordinated files (for example, files that store one or more modules, sub-programs, or portions of code). A computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
  • The processes and logic flows described in this specification can be performed by one or more programmable processors executing one or more computer programs to perform actions by operating on input data and generating output. The processes and logic flows can also be performed by, and apparatus can also be implemented as, special purpose logic circuitry, for example, an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit).
  • Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. The essential elements of a computer are a processor for performing actions in accordance with instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, for example, magnetic, magneto-optical disks, or optical disks.
  • However, a computer need not have such devices. Moreover, a computer can be embedded in another device, for example, a mobile telephone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a Global Positioning System (GPS) receiver, or a portable storage device (for example, a universal serial bus (USB) flash drive), to name just a few.
  • Devices suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices, for example, EPROM, EEPROM, and flash memory devices; magnetic disks, for example, internal hard disks or removable disks; magneto-optical disks; and SD cards, CD-ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
  • While this specification contains many specific implementation details, these should not be construed as limitations on the scope of any disclosures or of what can be claimed, but rather as descriptions of features specific to particular implementations of particular disclosures. Certain features that are described in this specification in the context of separate implementations can also be implemented in combination in a single implementation. Conversely, various features that are described in the context of a single implementation can also be implemented in multiple implementations separately or in any suitable subcombination. Moreover, although features can be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination can be directed to a subcombination or variation of a subcombination.
  • Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing can be advantageous. Moreover, the separation of various system components in the implementations described above should not be understood as requiring such separation in all implementations, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.
  • Thus, particular implementations of the subject matter have been described. Other implementations are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In certain implementations, multitasking and parallel processing can be advantageous.
  • In the examples described above, the application executing on the mobile device is described as performing the operations such as detecting that the external display has been connected to or disconnected from the mobile device, and switching display modes based on the detecting. The operations can alternatively, or in addition, be performed by the mobile device on which the application is executing.
  • In other words, the mobile device can detect that the external display has been connected to the mobile device. Based on the detecting, the mobile device can switch the application executing on the mobile device from the first display mode to the second display mode. Subsequently, the mobile device can detect that the external display has been disconnected from the mobile device. In response, the mobile device can switch the application back to the first display mode.
  • In some implementations, when a user changes an orientation of the mobile device in a second display mode, for example, from portrait to landscape, the orientation of the visual elements displayed in the external display also correspondingly change, i.e., from portrait to landscape. In some implementations, if the mobile device is held in a portrait mode and the external display displays a visual element in a landscape mode, and the user changes the orientation of the mobile device from the portrait mode to a landscape mode, then the orientation of the visual element in the external display is changed from a landscape mode to a portrait mode. In such implementations, black boxes are displayed around the images displayed in the external display.

Claims (20)

    What is claimed is:
  1. 1. A method comprising:
    determining that an external display has been connected to or disconnected from a mobile device; and
    based on determining that the external display has been connected to or disconnected from the mobile device, switching an application executing on the mobile device between a first display mode in which the application generates a single user interface for display on a touch screen of the mobile device, and a second display mode in which the application generates a first user interface for display on the external display and a different, second user interface for display on, and for receiving user inputs through, the touch screen of the mobile device.
  2. 2. The method of claim 1, wherein:
    determining that an external display has been connected to or disconnected from a mobile device further comprises determining that the external display has been connected to the mobile device, and
    switching an application further comprises switching the application from the first display mode to the second display mode.
  3. 3. The method of claim 1, wherein:
    determining that the external display has been connected to or disconnected from the mobile device further comprises determining that the external display has been disconnected from the mobile device, and
    switching an application further comprises switching the application from the second display mode to the first display mode.
  4. 4. The method of claim 1, further comprising:
    displaying, on the touch screen of the mobile device in the first display mode, a visual element and a first set of controls for receiving user inputs to control the visual element;
    displaying, on the external display in the second display mode, the visual element; and
    displaying, on the touch screen of the mobile device in the second display mode, a second set of controls for receiving the user inputs to control the visual element.
  5. 5. The method of claim 4, wherein the second set of controls includes controls that are not included in the first set of controls.
  6. 6. The method of claim 4, wherein the second set of controls includes all controls of the first set of controls and additional controls.
  7. 7. The method of claim 1, further comprising:
    in the first display mode, displaying a control in a first size; and
    in the second display mode, displaying the control in a second size that is larger than the first size.
  8. 8. A computer-readable storage medium storing computer software instructions executable by one or more data processing apparatus to perform operations comprising:
    determining that an external display has been connected to or disconnected from a mobile device; and
    based on determining that the external display has been connected to or disconnected from the mobile device, switching an application executing on the mobile device between a first display mode in which the application generates a single user interface for display on a touch screen of the mobile device, and a second display mode in which the application generates a first user interface for display on the external display and a different, second user interface for display on, and for receiving user inputs, through the touch screen of the mobile device.
  9. 9. The medium of claim 8, wherein:
    determining that an external display has been connected to or disconnected from a mobile device further comprises determining that the external display has been connected to the mobile device, and
    switching an application further comprises switching the application from the first display mode to the second display mode.
  10. 10. The medium of claim 8, wherein determining that the external display has been connected to or disconnected from the mobile device further comprises determining that the external display has been disconnected from the mobile device, and
    switching an application further comprises switching the application from the second display mode to the first display mode.
  11. 11. The medium of claim 8, the operations further comprising:
    displaying, on the touch screen of the mobile device in the first display mode, a visual element and a first set of controls for receiving user inputs to control the visual element;
    displaying, on the external display in the second display mode, the visual element; and
    displaying, on the touch screen of the mobile device in the second display mode, a second set of controls for receiving the user inputs to control the visual element.
  12. 12. The medium of claim 11, wherein the second set of controls includes controls that are not included in the first set of controls.
  13. 13. The medium of claim 11, wherein the second set of controls includes all controls of the first set of controls and additional controls.
  14. 14. The medium of claim 8, the operations further comprising:
    in the first display mode, displaying a control in a first size; and
    in the second display mode, displaying the control in a second size that is larger than the first size.
  15. 15. A system comprising: one or more computers; and a computer-readable storage medium storing computer software instructions executable by the one or more computers to perform operations comprising:
    determining that an external display has been connected to or disconnected from a mobile device; and
    based on determining that the external display has been connected to or disconnected from the mobile device, switching an application executing on the mobile device between a first display mode in which the application generates a single user interface for display on a touch screen of the mobile device, and a second display mode in which the application generates a first user interface for display on the external display and a different, second user interface for display on, and for receiving user inputs, through the touch screen of the mobile device.
  16. 16. The system of claim 15, wherein:
    determining that an external display has been connected to or disconnected from a mobile device further comprises determining that the external display has been connected to the mobile device, and
    switching an application further comprises switching the application from the first display mode to the second display mode.
  17. 17. The system of claim 15, wherein determining that the external display has been connected to or disconnected from the mobile device further comprises determining that the external display has been disconnected from the mobile device, and
    switching an application further comprises switching the application from the second display mode to the first display mode.
  18. 18. The system of claim 15, the operations further comprising:
    displaying, on the touch screen of the mobile device in the first display mode, a visual element and a first set of controls for receiving user inputs to control the visual element;
    displaying, on the external display in the second display mode, the visual element; and
    displaying, on the touch screen of the mobile device in the second display mode, a second set of controls for receiving the user inputs to control the visual element.
  19. 19. The system of claim 18, wherein the second set of controls includes controls that are not included in the first set of controls.
  20. 20. The system of claim 18, wherein the second set of controls includes all controls of the first set of controls and additional controls.
US12943444 2010-08-27 2010-11-10 Switching display modes based on connection state Abandoned US20120050183A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US37767310 true 2010-08-27 2010-08-27
US12943444 US20120050183A1 (en) 2010-08-27 2010-11-10 Switching display modes based on connection state

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US12943444 US20120050183A1 (en) 2010-08-27 2010-11-10 Switching display modes based on connection state
PCT/US2011/049286 WO2012027640A1 (en) 2010-08-27 2011-08-26 Switching display modes based on connection state
US13250428 US20120287058A1 (en) 2010-08-27 2011-09-30 Switching display modes based on connection state
US14859543 US9715364B2 (en) 2010-08-27 2015-09-21 Switching display modes based on connection state

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13250428 Continuation US20120287058A1 (en) 2010-08-27 2011-09-30 Switching display modes based on connection state

Publications (1)

Publication Number Publication Date
US20120050183A1 true true US20120050183A1 (en) 2012-03-01

Family

ID=44583479

Family Applications (3)

Application Number Title Priority Date Filing Date
US12943444 Abandoned US20120050183A1 (en) 2010-08-27 2010-11-10 Switching display modes based on connection state
US13250428 Abandoned US20120287058A1 (en) 2010-08-27 2011-09-30 Switching display modes based on connection state
US14859543 Active US9715364B2 (en) 2010-08-27 2015-09-21 Switching display modes based on connection state

Family Applications After (2)

Application Number Title Priority Date Filing Date
US13250428 Abandoned US20120287058A1 (en) 2010-08-27 2011-09-30 Switching display modes based on connection state
US14859543 Active US9715364B2 (en) 2010-08-27 2015-09-21 Switching display modes based on connection state

Country Status (2)

Country Link
US (3) US20120050183A1 (en)
WO (1) WO2012027640A1 (en)

Cited By (62)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120297400A1 (en) * 2011-02-03 2012-11-22 Sony Corporation Method and system for invoking an application in response to a trigger event
US20120299846A1 (en) * 2011-05-27 2012-11-29 Kyohei Matsuda Electronic apparatus and operation support method
US20130016040A1 (en) * 2011-07-11 2013-01-17 Samsung Electronics Co. Ltd. Method and apparatus for displaying screen of portable terminal connected with external device
US20130033414A1 (en) * 2011-08-04 2013-02-07 Microsoft Corporation Display Environment for a Plurality of Display Devices
US20130050230A1 (en) * 2011-08-23 2013-02-28 Samsung Electronics Co., Ltd Display method and apparatus in portable terminal
US20130080936A1 (en) * 2011-09-27 2013-03-28 Paul E. Reeves Displaying a unified desktop across connected devices
US20130106750A1 (en) * 2011-10-28 2013-05-02 Fuminobu Kurosawa Connecting Touch Screen Phones in a Vehicle
US20130141331A1 (en) * 2011-12-02 2013-06-06 Htc Corporation Method for performing wireless display control, and associated apparatus and associated computer program product
US20130159917A1 (en) * 2011-12-20 2013-06-20 Lenovo (Singapore) Pte. Ltd. Dynamic user interface based on connected devices
US20130162502A1 (en) * 2011-12-23 2013-06-27 Kt Corporation Dynamically controlling display mode of external device coupled to user equipment
US20130166790A1 (en) * 2011-12-23 2013-06-27 Kt Corporation Controlling applications according to connection state and execution condition
US20130167040A1 (en) * 2011-12-22 2013-06-27 Kt Corporation Selectively tranferring image data from user equipment to external device
US20130179554A1 (en) * 2012-01-06 2013-07-11 Lenovo (Beijing) Co., Ltd Method, apparatus and electronic device for application display
US20130222238A1 (en) * 2012-02-23 2013-08-29 Wacom Co., Ltd. Handwritten information inputting device and portable electronic apparatus including handwritten information inputting device
US20130234941A1 (en) * 2012-03-07 2013-09-12 Samsung Electronics Co., Ltd. Control system with ridge interface and method of operation thereof
CN103336661A (en) * 2012-03-12 2013-10-02 三星电子株式会社 Display apparatus and control method thereof
US20130321309A1 (en) * 2012-05-25 2013-12-05 Sony Mobile Communications Japan, Inc. Terminal apparatus, display system, display method, and recording medium
US20140035816A1 (en) * 2012-08-03 2014-02-06 Novatek Microelectronics Corp. Portable apparatus
EP2706734A1 (en) * 2012-09-10 2014-03-12 Samsung Electronics Co., Ltd Method and apparatus for executing application in device
WO2014038918A1 (en) * 2012-09-10 2014-03-13 Samsung Electronics Co., Ltd. Method for connecting mobile terminal and external display and apparatus implementing the same
US20140145969A1 (en) * 2012-11-29 2014-05-29 Research In Motion Limited System and method for graphic object management in a large-display area computing device
US20140215098A1 (en) * 2012-02-13 2014-07-31 Intel Corporation Docking display adapter with automatic mode switching
US20140215347A1 (en) * 2013-01-28 2014-07-31 Hon Hai Precision Industry Co., Ltd. Portable device and control method thereof
EP2784661A1 (en) * 2013-03-26 2014-10-01 Ricoh Company, Ltd. Computer program product, information processing method, and information processing apparatus
US20140325099A1 (en) * 2011-11-24 2014-10-30 Sharp Kabushiki Kaisha Electronic device and operation control method
US20140337769A1 (en) * 2013-05-13 2014-11-13 Samsung Electronics Co., Ltd. Method and apparatus for using electronic device
US20140349757A1 (en) * 2011-06-03 2014-11-27 Nintendo Co., Ltd. Computer-Readable Storage Medium, Information Processing Apparatus, Information Processing System and Information Processing Method
US8904051B2 (en) 2011-12-26 2014-12-02 Kt Corporation Controlling multiple external device coupled to user equipment
US8949494B2 (en) 2011-06-30 2015-02-03 Kt Corporation User equipment connectable to an external device
US8959267B2 (en) 2011-06-30 2015-02-17 Kt Corporation Controlling an external device connected to user equipment
EP2843542A1 (en) * 2013-08-29 2015-03-04 Samsung Electronics Co., Ltd User terminal apparatus, method for controlling user terminal apparatus, and expanded display system
US20150113425A1 (en) * 2013-10-17 2015-04-23 Samsung Electronics Co., Ltd. Display apparatus and method of controlling display apparatus
US20150113411A1 (en) * 2013-10-18 2015-04-23 Apple Inc. Automatic Configuration of Displays for Slide Presentation
US20150130842A1 (en) * 2011-01-11 2015-05-14 Apple Inc. Mirroring graphics content to an external display
US20150177975A1 (en) * 2013-12-19 2015-06-25 Samsung Electronics Co., Ltd. Electronic device and method for providing graphical user interface of the same
US9164544B2 (en) 2011-12-09 2015-10-20 Z124 Unified desktop: laptop dock, hardware configuration
US9268518B2 (en) 2011-09-27 2016-02-23 Z124 Unified desktop docking rules
WO2016048854A1 (en) * 2014-09-24 2016-03-31 Microsoft Technology Licensing, Llc Interactive text preview
WO2016079373A1 (en) * 2014-11-18 2016-05-26 Solu Machines Oy Touch screen device for controlling an external display
WO2016071670A3 (en) * 2014-11-06 2016-06-30 Displaylink (Uk) Limited System for controlling a display device
US20160209973A1 (en) * 2015-01-21 2016-07-21 Microsoft Technology Licensing, Llc. Application user interface reconfiguration based on an experience mode transition
US20160216876A1 (en) * 2015-01-22 2016-07-28 Samsung Electronics Co., Ltd. Display apparatus, control apparatus, and operating methods thereof
US9405459B2 (en) 2011-08-24 2016-08-02 Z124 Unified desktop laptop dock software operation
US20160232871A1 (en) * 2013-09-26 2016-08-11 Le Shi Zhi Xin Electronic Technology (Tianjin) Limited Display method and display device
WO2016128280A1 (en) * 2015-02-13 2016-08-18 Koninklijke Philips N.V. Portable medical support system with ancillary viewing mode and method of operation thereof
US20160266751A1 (en) * 2015-03-09 2016-09-15 Lenovo (Singapore) Pte. Ltd. Virtualized Extended Desktop Workspaces
US20160266669A1 (en) * 2015-03-10 2016-09-15 Intel Corporation Virtual touch pad method and apparatus for controlling an external display
US9514306B2 (en) 2011-12-26 2016-12-06 Kt Corporation Restricting operation results from being transferred to coupled external device
EP2701050A3 (en) * 2012-05-29 2017-03-08 Sony Mobile Communications, Inc. Terminal apparatus, display method and recording medium to control a display using orientation sensors
US9632740B2 (en) * 2013-11-12 2017-04-25 Rockwell Automation Asia Pacific Business Center Pte. Ltd. System and method for an input-driven, switching-enabled, display device for an automation controller
US9658695B2 (en) * 2012-11-08 2017-05-23 Cuesta Technology Holdings, Llc Systems and methods for alternative control of touch-based devices
US9671874B2 (en) 2012-11-08 2017-06-06 Cuesta Technology Holdings, Llc Systems and methods for extensions to alternative control of touch-based devices
US9678640B2 (en) 2014-09-24 2017-06-13 Microsoft Technology Licensing, Llc View management architecture
US20170193713A1 (en) * 2016-01-04 2017-07-06 Deere & Company Agricultural machine performance improvement system
US9715252B2 (en) 2011-08-24 2017-07-25 Z124 Unified desktop docking behavior for window stickiness
US9769227B2 (en) 2014-09-24 2017-09-19 Microsoft Technology Licensing, Llc Presentation of computing environment on multiple devices
EP3223072A4 (en) * 2014-11-20 2017-09-27 ZTE Corporation Projector playing control method, device, and computer storage medium
US9860306B2 (en) 2014-09-24 2018-01-02 Microsoft Technology Licensing, Llc Component-specific application presentation histories
US9864443B2 (en) 2012-07-31 2018-01-09 Samsung Electronics Co., Ltd. Method for controlling user input and electronic device thereof
US9883231B2 (en) 2013-09-03 2018-01-30 Samsung Electronics Co., Ltd. Content control using an auxiliary device
US9928562B2 (en) 2012-01-20 2018-03-27 Microsoft Technology Licensing, Llc Touch mode and input type recognition
US10025684B2 (en) 2014-09-24 2018-07-17 Microsoft Technology Licensing, Llc Lending target device resources to host device computing environment

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5854244B2 (en) * 2012-03-19 2016-02-09 日本電気株式会社 In-vehicle information system
US9167528B2 (en) 2012-03-23 2015-10-20 Htc Corporation Power saving method and related mobile device
JP2013201491A (en) * 2012-03-23 2013-10-03 Sharp Corp Potable terminal, communication system, portable terminal control method, and program for realizing control method
CN103327583B (en) * 2012-03-23 2016-09-14 宏达国际电子股份有限公司 The power saving method and related mobile device
US9536363B2 (en) 2012-08-16 2017-01-03 Schlage Lock Company, Llc Operation communication system
US9472034B2 (en) 2012-08-16 2016-10-18 Schlage Lock Company Llc Electronic lock system
US9437062B2 (en) 2012-08-16 2016-09-06 Schlage Lock Company Llc Electronic lock authentication method and system
US20140139431A1 (en) * 2012-11-21 2014-05-22 Htc Corporation Method for displaying images of touch control device on external display device
US20150002743A1 (en) * 2013-07-01 2015-01-01 Mediatek Inc. Video data displaying system and video data displaying method
US10073599B2 (en) 2015-01-07 2018-09-11 Microsoft Technology Licensing, Llc Automatic home screen determination based on display device
CN105912287A (en) * 2016-03-31 2016-08-31 联想(北京)有限公司 Display method, device and equipment

Citations (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5410326A (en) * 1992-12-04 1995-04-25 Goldstein; Steven W. Programmable remote control device for interacting with a plurality of remotely controlled devices
JPH09244780A (en) * 1996-03-08 1997-09-19 Sanyo Electric Co Ltd Controller for terminal machine
US5818425A (en) * 1996-04-03 1998-10-06 Xerox Corporation Mapping drawings generated on small mobile pen based electronic devices onto large displays
US5880732A (en) * 1997-04-29 1999-03-09 Telefonaktiebolaget L M Ericsson Publ. Apparatus enabling usage of external display monitor with a mobile telephone
US6348956B1 (en) * 1993-10-20 2002-02-19 Matsushita Electric Industrial Co., Ltd. Remote controller for a variety of appliances
US20020102998A1 (en) * 2000-11-21 2002-08-01 Ming-Hung Lin Mobile device, auxiliary rendering device and arrangement
US6478679B1 (en) * 1997-08-08 2002-11-12 Sega Enterprises, Ltd. Memory device, controller and electronic device
US20020190920A1 (en) * 2001-06-15 2002-12-19 Shao-Tsu Kung Personal digital assistant with a power-saving external image output port
US20030025678A1 (en) * 2001-08-04 2003-02-06 Samsung Electronics Co., Ltd. Apparatus with touch screen and method for displaying information through external display device connected thereto
US20040157642A1 (en) * 2003-02-04 2004-08-12 Samsung Electronics Co., Ltd. Integrated mobile terminal device and method for controlling external display unit
US6781635B1 (en) * 2000-06-08 2004-08-24 Nintendo Co., Ltd. Display processing system, and portable terminal and conversion adaptor used therefor
US20050262535A1 (en) * 2002-07-05 2005-11-24 Mami Uchida Image display system, image display method and display unit
US20060085753A1 (en) * 2004-10-19 2006-04-20 Vance Scott L Systems, methods and computer program products for displaying content on multiple display screens using handheld wireless communicators
US20060259942A1 (en) * 2005-05-13 2006-11-16 Microsoft Corporation Phone-to-monitor connection device
US20070075915A1 (en) * 2005-09-26 2007-04-05 Lg Electronics Inc. Mobile communication terminal having multiple displays and a data processing method thereof
US20070085759A1 (en) * 2005-09-15 2007-04-19 Lg Electronics Inc. Method for displaying multimedia contents and mobile communications terminal capable of implementing the same
US20070203641A1 (en) * 2005-12-31 2007-08-30 Diaz Melvin B In-vehicle navigation system with removable navigation unit
US20070236482A1 (en) * 2006-04-07 2007-10-11 Microsoft Corporation Attachable display system for a portable device
US20070265717A1 (en) * 2006-05-10 2007-11-15 Compal Communications Inc. Portable communications device with image projecting capability and control method thereof
US20080043020A1 (en) * 2006-08-18 2008-02-21 Microsoft Corporation User interface for viewing street side imagery
US20080273015A1 (en) * 2007-05-02 2008-11-06 GIGA BYTE Communications, Inc. Dual function touch screen module for portable device and opeating method therefor
US20090249359A1 (en) * 2008-03-25 2009-10-01 Caunter Mark Leslie Apparatus and methods for widget intercommunication in a wireless communication environment
US7624210B2 (en) * 2004-12-24 2009-11-24 Masahiro Izutsu Mobile information communication apparatus, connection unit for mobile information communication apparatus, and external input/output unit for mobile information communication apparatus
US20090325607A1 (en) * 2008-05-28 2009-12-31 Conway David P Motion-controlled views on mobile computing devices
US20100070162A1 (en) * 2006-10-13 2010-03-18 Navitime Japan Co., Ltd. Navigation system, mobile terminal device, and route guiding method
US20100138780A1 (en) * 2008-05-20 2010-06-03 Adam Marano Methods and systems for using external display devices with a mobile computing device
US20100134385A1 (en) * 2008-12-02 2010-06-03 Fuji Xerox Co., Ltd. Systems and methods for interacting with mobile devices using external displays
US20100250816A1 (en) * 2009-03-27 2010-09-30 Qualcomm Incorporated System and method of managing displays at a portable computing device and a portable computing device docking station
US20100262928A1 (en) * 2009-04-10 2010-10-14 Cellco Partnership D/B/A Verizon Wireless Smart object based gui for touch input devices
US20100302141A1 (en) * 2009-05-28 2010-12-02 Subramonian Shankar Display and Interaction Environment for Mobile Devices
US7877703B1 (en) * 2005-03-14 2011-01-25 Seven Networks, Inc. Intelligent rendering of information in a limited display environment
US20110037851A1 (en) * 2009-08-14 2011-02-17 Lg Electronics Inc. Remote control device and remote control method using the same
US20110163949A1 (en) * 2010-01-07 2011-07-07 Chao-Tsung Chen Control system using portable electronic device for performing operations
US20110246904A1 (en) * 2010-04-01 2011-10-06 Gus Pinto Interacting with Remote Applications Displayed Within a Virtual Desktop of a Tablet Computing Device
US20110302527A1 (en) * 2010-06-02 2011-12-08 Microsoft Corporation Adjustable and progressive mobile device street view

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7058356B2 (en) * 2000-06-15 2006-06-06 Benjamin Slotznick Telephone device with enhanced audio-visual features for interacting with nearby displays and display screens
JP2002262189A (en) * 2001-02-28 2002-09-13 Sony Corp Portable information terminal and information processing method, program storage medium and program
JP4691268B2 (en) * 2001-05-02 2011-06-01 任天堂株式会社 Game system and a game program
US6966837B1 (en) * 2001-05-10 2005-11-22 Best Robert M Linked portable and video game systems
JP2003108472A (en) * 2001-09-28 2003-04-11 Canon Inc Communication device and control method therefor, information equipment and control method therefor, communication system, and control program
US6947975B2 (en) * 2001-10-03 2005-09-20 Palm, Inc. Mobile device peripheral interface system and method
US8531275B2 (en) * 2006-02-02 2013-09-10 The Directv Group, Inc. Remote control mode on-screen displays and methods for producing the same
US8260933B2 (en) * 2006-02-15 2012-09-04 Samsung Electronics Co., Ltd. Multimedia content redirection method
KR100816286B1 (en) * 2006-05-18 2008-03-24 삼성전자주식회사 Display apparatus and support method using the portable terminal and the external device
US9697280B2 (en) * 2006-12-13 2017-07-04 Quickplay Media, Inc. Mediation and settlement for mobile media
US20090077467A1 (en) * 2007-07-16 2009-03-19 Abhishek Adappa Mobile television and multimedia player key presentations
US7956848B2 (en) 2007-09-04 2011-06-07 Apple Inc. Video chapter access and license renewal
JP5194673B2 (en) * 2007-09-26 2013-05-08 株式会社日立製作所 Transmitting and receiving method of a mobile terminal, and information
JP4596280B2 (en) * 2007-12-14 2010-12-08 ソニー株式会社 Menu screen forced display method of the video output apparatus and a video output device
US8416196B2 (en) 2008-03-04 2013-04-09 Apple Inc. Touch event model programming interface
KR100988377B1 (en) * 2008-05-06 2010-10-18 엘지전자 주식회사 Apparatus and method for managing menu of mobile terminal
US8086275B2 (en) 2008-10-23 2011-12-27 Microsoft Corporation Alternative inputs of a mobile communications device
US20100216508A1 (en) * 2009-02-23 2010-08-26 Augusta Technology, Inc. Systems and Methods for Driving an External Display Device Using a Mobile Phone Device
US8914462B2 (en) 2009-04-14 2014-12-16 Lg Electronics Inc. Terminal and controlling method thereof
US9241062B2 (en) * 2009-05-20 2016-01-19 Citrix Systems, Inc. Methods and systems for using external display devices with a mobile computing device
US9014685B2 (en) * 2009-06-12 2015-04-21 Microsoft Technology Licensing, Llc Mobile device which automatically determines operating mode
US8412839B2 (en) * 2009-06-24 2013-04-02 Harris Technology, Llc Portable phone remote
US9055904B2 (en) 2009-08-03 2015-06-16 Nike, Inc. Multi-touch display and input for vision testing and training
WO2011037558A1 (en) 2009-09-22 2011-03-31 Apple Inc. Device, method, and graphical user interface for manipulating user interface objects
KR101670352B1 (en) 2009-12-03 2016-10-28 엘지전자 주식회사 Mobile Terminal, Electronic Device and Method Of Controlling Electronic Device
US20110185390A1 (en) 2010-01-27 2011-07-28 Robert Bosch Gmbh Mobile phone integration into driver information systems
US9274682B2 (en) 2010-02-19 2016-03-01 Microsoft Technology Licensing, Llc Off-screen gestures to create on-screen input
KR20110104620A (en) 2010-03-17 2011-09-23 삼성전자주식회사 Apparatus and method for inputing character in portable terminal
EP2564598A4 (en) * 2010-04-28 2017-04-26 LG Electronics Inc. Image display apparatus and method for operating the same
US20110301835A1 (en) * 2010-06-07 2011-12-08 James Bongiorno Portable vacation/travel planner, and family tour guide device
US20120013541A1 (en) * 2010-07-14 2012-01-19 Research In Motion Limited Portable electronic device and method of controlling same
KR20130007811A (en) * 2011-07-11 2013-01-21 삼성전자주식회사 Method and apparatus for displaying screen of portable terminal connected with external device

Patent Citations (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5410326A (en) * 1992-12-04 1995-04-25 Goldstein; Steven W. Programmable remote control device for interacting with a plurality of remotely controlled devices
US6348956B1 (en) * 1993-10-20 2002-02-19 Matsushita Electric Industrial Co., Ltd. Remote controller for a variety of appliances
JPH09244780A (en) * 1996-03-08 1997-09-19 Sanyo Electric Co Ltd Controller for terminal machine
US5818425A (en) * 1996-04-03 1998-10-06 Xerox Corporation Mapping drawings generated on small mobile pen based electronic devices onto large displays
US5880732A (en) * 1997-04-29 1999-03-09 Telefonaktiebolaget L M Ericsson Publ. Apparatus enabling usage of external display monitor with a mobile telephone
US6478679B1 (en) * 1997-08-08 2002-11-12 Sega Enterprises, Ltd. Memory device, controller and electronic device
US6781635B1 (en) * 2000-06-08 2004-08-24 Nintendo Co., Ltd. Display processing system, and portable terminal and conversion adaptor used therefor
US20020102998A1 (en) * 2000-11-21 2002-08-01 Ming-Hung Lin Mobile device, auxiliary rendering device and arrangement
US20020190920A1 (en) * 2001-06-15 2002-12-19 Shao-Tsu Kung Personal digital assistant with a power-saving external image output port
US20030025678A1 (en) * 2001-08-04 2003-02-06 Samsung Electronics Co., Ltd. Apparatus with touch screen and method for displaying information through external display device connected thereto
US20050262535A1 (en) * 2002-07-05 2005-11-24 Mami Uchida Image display system, image display method and display unit
US20040157642A1 (en) * 2003-02-04 2004-08-12 Samsung Electronics Co., Ltd. Integrated mobile terminal device and method for controlling external display unit
US20060085753A1 (en) * 2004-10-19 2006-04-20 Vance Scott L Systems, methods and computer program products for displaying content on multiple display screens using handheld wireless communicators
US7624210B2 (en) * 2004-12-24 2009-11-24 Masahiro Izutsu Mobile information communication apparatus, connection unit for mobile information communication apparatus, and external input/output unit for mobile information communication apparatus
US7877703B1 (en) * 2005-03-14 2011-01-25 Seven Networks, Inc. Intelligent rendering of information in a limited display environment
US7835505B2 (en) * 2005-05-13 2010-11-16 Microsoft Corporation Phone-to-monitor connection device
US20060259942A1 (en) * 2005-05-13 2006-11-16 Microsoft Corporation Phone-to-monitor connection device
US20070085759A1 (en) * 2005-09-15 2007-04-19 Lg Electronics Inc. Method for displaying multimedia contents and mobile communications terminal capable of implementing the same
US20070075915A1 (en) * 2005-09-26 2007-04-05 Lg Electronics Inc. Mobile communication terminal having multiple displays and a data processing method thereof
US20070203641A1 (en) * 2005-12-31 2007-08-30 Diaz Melvin B In-vehicle navigation system with removable navigation unit
US20070236482A1 (en) * 2006-04-07 2007-10-11 Microsoft Corporation Attachable display system for a portable device
US20070265717A1 (en) * 2006-05-10 2007-11-15 Compal Communications Inc. Portable communications device with image projecting capability and control method thereof
US20080043020A1 (en) * 2006-08-18 2008-02-21 Microsoft Corporation User interface for viewing street side imagery
US20100070162A1 (en) * 2006-10-13 2010-03-18 Navitime Japan Co., Ltd. Navigation system, mobile terminal device, and route guiding method
US20080273015A1 (en) * 2007-05-02 2008-11-06 GIGA BYTE Communications, Inc. Dual function touch screen module for portable device and opeating method therefor
US20090249359A1 (en) * 2008-03-25 2009-10-01 Caunter Mark Leslie Apparatus and methods for widget intercommunication in a wireless communication environment
US20100138780A1 (en) * 2008-05-20 2010-06-03 Adam Marano Methods and systems for using external display devices with a mobile computing device
US20090325607A1 (en) * 2008-05-28 2009-12-31 Conway David P Motion-controlled views on mobile computing devices
US20100134385A1 (en) * 2008-12-02 2010-06-03 Fuji Xerox Co., Ltd. Systems and methods for interacting with mobile devices using external displays
US20100250816A1 (en) * 2009-03-27 2010-09-30 Qualcomm Incorporated System and method of managing displays at a portable computing device and a portable computing device docking station
US20100262928A1 (en) * 2009-04-10 2010-10-14 Cellco Partnership D/B/A Verizon Wireless Smart object based gui for touch input devices
US20100302141A1 (en) * 2009-05-28 2010-12-02 Subramonian Shankar Display and Interaction Environment for Mobile Devices
US20110037851A1 (en) * 2009-08-14 2011-02-17 Lg Electronics Inc. Remote control device and remote control method using the same
US20110163949A1 (en) * 2010-01-07 2011-07-07 Chao-Tsung Chen Control system using portable electronic device for performing operations
US20110246904A1 (en) * 2010-04-01 2011-10-06 Gus Pinto Interacting with Remote Applications Displayed Within a Virtual Desktop of a Tablet Computing Device
US20110302527A1 (en) * 2010-06-02 2011-12-08 Microsoft Corporation Adjustable and progressive mobile device street view

Cited By (98)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9411550B2 (en) * 2011-01-11 2016-08-09 Apple Inc. Mirroring graphics content to an external display
US20150130842A1 (en) * 2011-01-11 2015-05-14 Apple Inc. Mirroring graphics content to an external display
US9864560B2 (en) 2011-01-11 2018-01-09 Apple Inc. Mirroring graphics content to an external display
US20120297400A1 (en) * 2011-02-03 2012-11-22 Sony Corporation Method and system for invoking an application in response to a trigger event
US8978047B2 (en) * 2011-02-03 2015-03-10 Sony Corporation Method and system for invoking an application in response to a trigger event
US20120299846A1 (en) * 2011-05-27 2012-11-29 Kyohei Matsuda Electronic apparatus and operation support method
US9436426B2 (en) * 2011-06-03 2016-09-06 Nintendo Co., Ltd. Computer-readable storage medium, information processing apparatus, information processing system and information processing method
US20140349757A1 (en) * 2011-06-03 2014-11-27 Nintendo Co., Ltd. Computer-Readable Storage Medium, Information Processing Apparatus, Information Processing System and Information Processing Method
US8949494B2 (en) 2011-06-30 2015-02-03 Kt Corporation User equipment connectable to an external device
US8959267B2 (en) 2011-06-30 2015-02-17 Kt Corporation Controlling an external device connected to user equipment
US20130016040A1 (en) * 2011-07-11 2013-01-17 Samsung Electronics Co. Ltd. Method and apparatus for displaying screen of portable terminal connected with external device
US9013366B2 (en) * 2011-08-04 2015-04-21 Microsoft Technology Licensing, Llc Display environment for a plurality of display devices
US20130033414A1 (en) * 2011-08-04 2013-02-07 Microsoft Corporation Display Environment for a Plurality of Display Devices
US20130050230A1 (en) * 2011-08-23 2013-02-28 Samsung Electronics Co., Ltd Display method and apparatus in portable terminal
US9715252B2 (en) 2011-08-24 2017-07-25 Z124 Unified desktop docking behavior for window stickiness
US9003311B2 (en) 2011-08-24 2015-04-07 Z124 Activating applications in unified desktop
US9405459B2 (en) 2011-08-24 2016-08-02 Z124 Unified desktop laptop dock software operation
US9213516B2 (en) 2011-08-24 2015-12-15 Z124 Displaying a unified desktop across devices
US8910061B2 (en) 2011-08-24 2014-12-09 Z124 Application manager in a unified desktop
US9122441B2 (en) 2011-08-24 2015-09-01 Z124 Opening applications in unified desktop
US8904165B2 (en) 2011-09-27 2014-12-02 Z124 Unified desktop wake and unlock
US20130080936A1 (en) * 2011-09-27 2013-03-28 Paul E. Reeves Displaying a unified desktop across connected devices
US8874894B2 (en) 2011-09-27 2014-10-28 Z124 Unified desktop wake and unlock
US8872727B2 (en) 2011-09-27 2014-10-28 Z124 Activating applications in portions of unified desktop
US9268518B2 (en) 2011-09-27 2016-02-23 Z124 Unified desktop docking rules
US9069518B2 (en) 2011-09-27 2015-06-30 Z124 Unified desktop freeform window mode
US9116563B2 (en) * 2011-10-28 2015-08-25 Honda Motor Co., Ltd. Connecting touch screen phones in a vehicle
US20130106750A1 (en) * 2011-10-28 2013-05-02 Fuminobu Kurosawa Connecting Touch Screen Phones in a Vehicle
US20140325099A1 (en) * 2011-11-24 2014-10-30 Sharp Kabushiki Kaisha Electronic device and operation control method
US20130141331A1 (en) * 2011-12-02 2013-06-06 Htc Corporation Method for performing wireless display control, and associated apparatus and associated computer program product
US9164544B2 (en) 2011-12-09 2015-10-20 Z124 Unified desktop: laptop dock, hardware configuration
US20130159917A1 (en) * 2011-12-20 2013-06-20 Lenovo (Singapore) Pte. Ltd. Dynamic user interface based on connected devices
US20130167040A1 (en) * 2011-12-22 2013-06-27 Kt Corporation Selectively tranferring image data from user equipment to external device
US9766785B2 (en) * 2011-12-22 2017-09-19 Kt Corporation Selectively tranferring image data from user equipment to external device
US20130162502A1 (en) * 2011-12-23 2013-06-27 Kt Corporation Dynamically controlling display mode of external device coupled to user equipment
US20130166790A1 (en) * 2011-12-23 2013-06-27 Kt Corporation Controlling applications according to connection state and execution condition
US9542338B2 (en) * 2011-12-23 2017-01-10 Kt Corporation Controlling applications according to connection state and execution condition
US9514306B2 (en) 2011-12-26 2016-12-06 Kt Corporation Restricting operation results from being transferred to coupled external device
US8904051B2 (en) 2011-12-26 2014-12-02 Kt Corporation Controlling multiple external device coupled to user equipment
US20130179554A1 (en) * 2012-01-06 2013-07-11 Lenovo (Beijing) Co., Ltd Method, apparatus and electronic device for application display
US9928566B2 (en) 2012-01-20 2018-03-27 Microsoft Technology Licensing, Llc Input mode recognition
US9928562B2 (en) 2012-01-20 2018-03-27 Microsoft Technology Licensing, Llc Touch mode and input type recognition
US20140215098A1 (en) * 2012-02-13 2014-07-31 Intel Corporation Docking display adapter with automatic mode switching
US9880734B2 (en) * 2012-02-23 2018-01-30 Wacom Co., Ltd. Handwritten information inputting device and portable electronic apparatus including handwritten information inputting device
US9377947B2 (en) * 2012-02-23 2016-06-28 Wacom Co., Ltd. Handwritten information inputting device and portable electronic apparatus including handwritten information inputting device
US20150253982A1 (en) * 2012-02-23 2015-09-10 Wacom Co., Ltd. Handwritten information inputting device and portable electronic apparatus including handwritten information inputting device
US20130222238A1 (en) * 2012-02-23 2013-08-29 Wacom Co., Ltd. Handwritten information inputting device and portable electronic apparatus including handwritten information inputting device
US9323334B2 (en) * 2012-03-07 2016-04-26 Samsung Electronics Co., Ltd. Control system with ridge interface and method of operation thereof
US20130234941A1 (en) * 2012-03-07 2013-09-12 Samsung Electronics Co., Ltd. Control system with ridge interface and method of operation thereof
EP2639687A3 (en) * 2012-03-12 2016-08-24 Samsung Electronics Co., Ltd Display apparatus and control method thereof
CN103336661A (en) * 2012-03-12 2013-10-02 三星电子株式会社 Display apparatus and control method thereof
US20130321309A1 (en) * 2012-05-25 2013-12-05 Sony Mobile Communications Japan, Inc. Terminal apparatus, display system, display method, and recording medium
US9632642B2 (en) 2012-05-25 2017-04-25 Sony Corporation Terminal apparatus and associated methodology for automated scroll based on moving speed
US9128562B2 (en) * 2012-05-25 2015-09-08 Sony Corporation Terminal apparatus, display system, display method, and recording medium for switching between pointer mode and touch-panel mode based on handheld activation
EP2701050A3 (en) * 2012-05-29 2017-03-08 Sony Mobile Communications, Inc. Terminal apparatus, display method and recording medium to control a display using orientation sensors
US9864443B2 (en) 2012-07-31 2018-01-09 Samsung Electronics Co., Ltd. Method for controlling user input and electronic device thereof
US20140035816A1 (en) * 2012-08-03 2014-02-06 Novatek Microelectronics Corp. Portable apparatus
EP2706734A1 (en) * 2012-09-10 2014-03-12 Samsung Electronics Co., Ltd Method and apparatus for executing application in device
US9880584B2 (en) 2012-09-10 2018-01-30 Samsung Electronics Co., Ltd. Method and apparatus for executing application in device
CN104620220A (en) * 2012-09-10 2015-05-13 三星电子株式会社 Method and apparatus for executing application in device
WO2014038918A1 (en) * 2012-09-10 2014-03-13 Samsung Electronics Co., Ltd. Method for connecting mobile terminal and external display and apparatus implementing the same
US9671874B2 (en) 2012-11-08 2017-06-06 Cuesta Technology Holdings, Llc Systems and methods for extensions to alternative control of touch-based devices
US9658695B2 (en) * 2012-11-08 2017-05-23 Cuesta Technology Holdings, Llc Systems and methods for alternative control of touch-based devices
US20140145969A1 (en) * 2012-11-29 2014-05-29 Research In Motion Limited System and method for graphic object management in a large-display area computing device
US9513795B2 (en) * 2012-11-29 2016-12-06 Blackberry Limited System and method for graphic object management in a large-display area computing device
US20140215347A1 (en) * 2013-01-28 2014-07-31 Hon Hai Precision Industry Co., Ltd. Portable device and control method thereof
EP2784661A1 (en) * 2013-03-26 2014-10-01 Ricoh Company, Ltd. Computer program product, information processing method, and information processing apparatus
US9865228B2 (en) 2013-03-26 2018-01-09 Ricoh Company, Ltd. Computer program product, information processing method, and information processing apparatus
JP2014191099A (en) * 2013-03-26 2014-10-06 Ricoh Co Ltd Information processing program, information processing method and information processor
US20140337769A1 (en) * 2013-05-13 2014-11-13 Samsung Electronics Co., Ltd. Method and apparatus for using electronic device
WO2014185690A1 (en) * 2013-05-13 2014-11-20 Samsung Electronics Co., Ltd. Method and apparatus for using electronic device
CN105210026A (en) * 2013-05-13 2015-12-30 三星电子株式会社 Method and apparatus for using electronic device
EP2843542A1 (en) * 2013-08-29 2015-03-04 Samsung Electronics Co., Ltd User terminal apparatus, method for controlling user terminal apparatus, and expanded display system
US9883231B2 (en) 2013-09-03 2018-01-30 Samsung Electronics Co., Ltd. Content control using an auxiliary device
US20160232871A1 (en) * 2013-09-26 2016-08-11 Le Shi Zhi Xin Electronic Technology (Tianjin) Limited Display method and display device
US9933988B2 (en) * 2013-10-17 2018-04-03 Samsung Electronics Co., Ltd. Display apparatus and method of controlling display apparatus
US20150113425A1 (en) * 2013-10-17 2015-04-23 Samsung Electronics Co., Ltd. Display apparatus and method of controlling display apparatus
WO2015056867A1 (en) * 2013-10-17 2015-04-23 Samsung Electronics Co., Ltd. Display apparatus and method of controlling display apparatus
US9535578B2 (en) * 2013-10-18 2017-01-03 Apple Inc. Automatic configuration of displays for slide presentation
US20150113411A1 (en) * 2013-10-18 2015-04-23 Apple Inc. Automatic Configuration of Displays for Slide Presentation
US9632740B2 (en) * 2013-11-12 2017-04-25 Rockwell Automation Asia Pacific Business Center Pte. Ltd. System and method for an input-driven, switching-enabled, display device for an automation controller
US20150177975A1 (en) * 2013-12-19 2015-06-25 Samsung Electronics Co., Ltd. Electronic device and method for providing graphical user interface of the same
WO2016048854A1 (en) * 2014-09-24 2016-03-31 Microsoft Technology Licensing, Llc Interactive text preview
US9769227B2 (en) 2014-09-24 2017-09-19 Microsoft Technology Licensing, Llc Presentation of computing environment on multiple devices
US9678640B2 (en) 2014-09-24 2017-06-13 Microsoft Technology Licensing, Llc View management architecture
US10025684B2 (en) 2014-09-24 2018-07-17 Microsoft Technology Licensing, Llc Lending target device resources to host device computing environment
US9860306B2 (en) 2014-09-24 2018-01-02 Microsoft Technology Licensing, Llc Component-specific application presentation histories
GB2532038B (en) * 2014-11-06 2018-08-29 Displaylink Uk Ltd System for controlling a display device
WO2016071670A3 (en) * 2014-11-06 2016-06-30 Displaylink (Uk) Limited System for controlling a display device
WO2016079373A1 (en) * 2014-11-18 2016-05-26 Solu Machines Oy Touch screen device for controlling an external display
EP3223072A4 (en) * 2014-11-20 2017-09-27 ZTE Corporation Projector playing control method, device, and computer storage medium
US20160209973A1 (en) * 2015-01-21 2016-07-21 Microsoft Technology Licensing, Llc. Application user interface reconfiguration based on an experience mode transition
US20160216876A1 (en) * 2015-01-22 2016-07-28 Samsung Electronics Co., Ltd. Display apparatus, control apparatus, and operating methods thereof
WO2016128280A1 (en) * 2015-02-13 2016-08-18 Koninklijke Philips N.V. Portable medical support system with ancillary viewing mode and method of operation thereof
US20160266751A1 (en) * 2015-03-09 2016-09-15 Lenovo (Singapore) Pte. Ltd. Virtualized Extended Desktop Workspaces
US20160266669A1 (en) * 2015-03-10 2016-09-15 Intel Corporation Virtual touch pad method and apparatus for controlling an external display
US20170193713A1 (en) * 2016-01-04 2017-07-06 Deere & Company Agricultural machine performance improvement system
US10037630B2 (en) * 2016-01-04 2018-07-31 Deere & Company Agricultural machine performance improvement system

Also Published As

Publication number Publication date Type
US20120287058A1 (en) 2012-11-15 application
WO2012027640A1 (en) 2012-03-01 application
US20160011841A1 (en) 2016-01-14 application
US9715364B2 (en) 2017-07-25 grant

Similar Documents

Publication Publication Date Title
US20130097556A1 (en) Device, Method, and Graphical User Interface for Controlling Display of Application Windows
US20120281129A1 (en) Camera control
US20080297484A1 (en) Method and apparatus for providing gesture information based on touchscreen and information terminal device having the apparatus
US20080297483A1 (en) Method and apparatus for touchscreen based user interface interaction
US20120113044A1 (en) Multi-Sensor Device
US20100162176A1 (en) Reduced complexity user interface
US20110154249A1 (en) Mobile device and related control method for external output depending on user interaction based on image sensing module
US20120242596A1 (en) Portable devices, data transmission systems and display sharing methods thereof
US20120304106A1 (en) Desktop as Immersive Application
US20130169545A1 (en) Cooperative displays
US20140137020A1 (en) Graphical user interface for navigating applications
US20120144347A1 (en) Display device and control method thereof
CN102033710B (en) Method for managing file folder and related equipment
US20130159934A1 (en) Changing idle screens
JP2011076233A (en) Image displaying device, image displaying method, and program
US20140101575A1 (en) Multi-display apparatus and method of controlling the same
US20110154248A1 (en) Information processing apparatus and screen selection method
US20140111451A1 (en) User interface (ui) display method and apparatus of touch-enabled device
US20120169670A1 (en) Mobile terminal and touch recognizing method therein
US20130016040A1 (en) Method and apparatus for displaying screen of portable terminal connected with external device
US20130342483A1 (en) Apparatus including a touch screen and screen change method thereof
US20140066017A1 (en) Method of unlocking mobile terminal, and the mobile terminal
US20140362119A1 (en) One-handed gestures for navigating ui using touch-screen hover events
US20130106700A1 (en) Electronic apparatus and input method
US20120299846A1 (en) Electronic apparatus and operation support method

Legal Events

Date Code Title Description
AS Assignment

Owner name: GOOGLE INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LEE, REENA SINGHAL;REEL/FRAME:025344/0916

Effective date: 20101101

AS Assignment

Owner name: GOOGLE LLC, CALIFORNIA

Free format text: CHANGE OF NAME;ASSIGNOR:GOOGLE INC.;REEL/FRAME:044142/0357

Effective date: 20170929