WO2007027743A1 - Auxiliary display device driver interface - Google Patents

Auxiliary display device driver interface Download PDF

Info

Publication number
WO2007027743A1
WO2007027743A1 PCT/US2006/033820 US2006033820W WO2007027743A1 WO 2007027743 A1 WO2007027743 A1 WO 2007027743A1 US 2006033820 W US2006033820 W US 2006033820W WO 2007027743 A1 WO2007027743 A1 WO 2007027743A1
Authority
WO
WIPO (PCT)
Prior art keywords
auxiliary display
display device
driver
interface
device driver
Prior art date
Application number
PCT/US2006/033820
Other languages
French (fr)
Inventor
Daniel J. Polivy
Andrew J. Fuller
Sriram Viji
Matthew P. Rhoten
Teague C. Mapes
Original Assignee
Microsoft Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corporation filed Critical Microsoft Corporation
Priority to CN2006800313086A priority Critical patent/CN101253470B/en
Priority to EP06790093A priority patent/EP1920320A4/en
Priority to JP2008529221A priority patent/JP2009506463A/en
Priority to KR1020087004927A priority patent/KR101319632B1/en
Publication of WO2007027743A1 publication Critical patent/WO2007027743A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/20Software design
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/10Program control for peripheral devices
    • G06F13/102Program control for peripheral devices where the programme performs an interfacing function, e.g. device driver
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/448Execution paradigms, e.g. implementations of programming paradigms
    • G06F9/4482Procedural
    • G06F9/4484Executing subprograms
    • G06F9/4486Formation of subprogram jump address

Definitions

  • auxiliary display screen along with an operating system-provided platform (referred to as an auxiliary display platform, or a Windows 0 SideShowTM platform) , enables developers and authors to present content to users.
  • an auxiliary display platform or a Windows 0 SideShowTM platform
  • auxiliary display device for an operating system such as Microsoft Windows
  • device manufacturers also referred to as independent hardware vendors, or IHVs
  • UMDF Windows VistaTM User Mode Driver Framework
  • Creating a driver is complicated, as among other things, an auxiliary display driver is required to decode data from the auxiliary display platform into logical auxiliary display operations, and then transmit those intentions to the device through a protocol that the auxiliary display device understands.
  • Auxiliary display devices potentially can take many forms, and the underlying transport protocol used to communicate with the device can vary from device type to device type. Creating a driver is thus a particularly time consuming, burdensome, tedious and error-prone endeavor for device manufacturers .
  • a class extension object may interpret and/or translate commands received from the auxiliary display platform into a format the driver code can more easily handle, thereby simplifying the driver code .
  • Event data may be provided from the auxiliary display device driver such that corresponding event information may be passed to the auxiliary display platform.
  • the auxiliary display platform may provide data directed towards the auxiliary display device from one or more application programs, and when an auxiliary display device driver receives the data, an interface set implemented by the auxiliary display device driver allows a helper object to process commands received as data from the auxiliary display platform and to call back to the auxiliary display device driver via the interface with corresponding data.
  • the helper object may translate the call and command into data in a data format understood by the auxiliary display device driver, and call back the auxiliary display device driver with the data.
  • the auxiliary display device driver may then provide corresponding information to the auxiliary display- device via the transport.
  • FIGURE 1 shows an illustrative example of a general- purpose computing environment into which various aspects of the present invention may be incorporated.
  • FIG. 2 is a block diagram representing an example architecture in which an interface set may be implemented for auxiliary display device communication.
  • FIG. 3 is a block diagram representing example components including libraries in which an interface may be implemented for auxiliary display device communication.
  • FIG. 4 is a block diagram representing example components including example interfaces and a helper object that may be used for auxiliary display device communication.
  • FIGURE 1 illustrates an example of a suitable computing system environment 100 on which the invention may be implemented.
  • the computing system environment 100 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the computing environment 100 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment 100.
  • the invention is operational with numerous other general purpose or special purpose computing system environments or configurations.
  • Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited to: personal computers, server computers, handheld or laptop devices, tablet devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
  • the invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer.
  • program modules include routines, programs, objects, components, data structures, and so forth, which perform particular tasks or implement particular abstract data types.
  • the invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network.
  • program modules may be located in local and/or remote computer storage media including memory storage devices .
  • an exemplary system for implementing the invention includes a general purpose computing device in the form of a computer 110.
  • Components of the computer 110 may include, but are not limited to, a processing unit 120, a system memory 130, and a system bus 121 that couples various system components including the system memory to the processing unit 120.
  • the system bus 121 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures.
  • the computer 110 typically includes a variety of computer-readable media.
  • Computer-readable media can be any available media that can be accessed by the computer 110 and includes both volatile and nonvolatile media, and removable and non-removable media.
  • computer-readable media may comprise computer storage media and communication media.
  • Computer storage media includes volatile and nonvolatile, removable and nonremovable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by the computer 110.
  • Communication media typically embodies computer-readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
  • modulated data signal means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.
  • communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of the any of the above should also be included within the scope of computer-readable media.
  • the system memory 130 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 131 and random access memory (RAM) 132.
  • ROM read only memory
  • RAM random access memory
  • BIOS basic input/output system
  • RAM 132 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 120.
  • FIG. 1 illustrates operating system 134, application programs 135, other program modules 136 and program data 137.
  • the computer 110 may also include other removable/non-removable, volatile/nonvolatile computer storage media.
  • FIG. 1 illustrates a hard disk drive 141 that reads from or writes to nonremovable, nonvolatile magnetic media, a magnetic disk drive 151 that reads from or writes to a removable, nonvolatile magnetic disk 152, and an optical disk drive 155 that reads from or writes to a removable, nonvolatile optical disk 156 such as a CD ROM or other optical media.
  • Other removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like.
  • the hard disk drive 141 is typically connected to the system bus 121 through a non-removable memory interface such as interface 140, and magnetic disk drive 151 and optical disk drive 155 are typically connected to the system bus 121 by a removable memory interface, such as interface 150.
  • the drives and their associated computer storage media provide storage of computer-readable instructions, data structures, program modules and other data for the computer 110.
  • hard disk drive 141 is illustrated as storing operating system 144, application programs 145, other program modules 146 and program data 147. Note that these components can either be the same as or different from operating system 134, application programs 135, other program modules 136, and program data 137. Operating system 144, application programs 145, other program modules 146, and program data 147 are given different numbers herein to illustrate that, at a minimum, they are different copies.
  • a user may enter commands and information into the computer 110 through input devices such as a tablet, or electronic digitizer, 164, a microphone 163, a keyboard 162 and pointing device 161, commonly referred to as mouse, trackball or touch pad.
  • Other input devices not shown in FIG. 1 may include a joystick, game pad, satellite dish, scanner, or the like.
  • These and other input devices are often connected to the processing unit 120 through a user input interface 160 that is coupled to the system bus, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB) .
  • a monitor 191 or other type of display device is also connected to the system bus 121 via an interface, such as a video interface 190.
  • the monitor 191 may also be integrated with a touch-screen panel or the like. Note that the monitor and/or touch screen panel can be physically coupled to a housing in which the computing device 110 is incorporated, such as in a tablet-type personal computer. In addition, computers such as the computing device 110 may also include other peripheral output devices such as speakers 195 and printer 196, which may be connected through an output peripheral interface 194 or the like. [0020] The computer 110 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 180.
  • the remote computer 180 may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer 110, although only a memory storage device 181 has been illustrated in FIG. 1.
  • the logical connections depicted in FIG. 1 include a local area network (LAN) 171 and a wide area network (WAN) 173, but may also include other networks.
  • LAN local area network
  • WAN wide area network
  • Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.
  • the computer 110 When used in a LAN networking environment, the computer 110 is connected to the LAN 171 through a network interface or adapter 170. When used in a WAN networking environment, the computer 110 typically includes a modem 172 or other means for establishing communications over the WAN 173, such as the Internet.
  • the modem 172 which may be internal or external, may be connected to the system bus 121 via the user input interface 160 or other appropriate mechanism.
  • program modules depicted relative to the computer 110, or portions thereof may be stored in the remote memory storage device .
  • FIG. 1 illustrates remote application programs 185 as residing on memory device 181.
  • An auxiliary display subsystem 199 may be connected via the user interface 160 to allow data such as program content, system status and event notifications to be provided to the user, even if the main portions of the computer system are in a low power state.
  • the auxiliary display subsystem 199 may be connected to the modem 172 and/or network interface 170 to allow communication between these systems while the main processing unit 120 is in a low power state.
  • auxiliary display driver Various aspects of the technology described herein are directed towards simplifying the task of writing an auxiliary display driver. In part this is accomplished providing a common mechanism that implements a set of well- defined logical auxiliary display operations, thereby reducing the amount of work that a driver implementer needs to perform. As a result, driver implementers can, for the most part, direct their efforts to providing a transport mechanism to their auxiliary display device, and need not concern themselves with the complexity of the communication between the auxiliary display driver and the auxiliary display platform.
  • auxiliary devices include devices not conventionally thought of as devices that are "computer- system" coupled devices, such as television sets, audio receivers, audio/video recorders, telephones, a separate computer, a mobile communications device, a secondary display screen with actuators, a watch, a wall (e.g., kitchen) display, a display screen, a digital picture frame, a clock, a radio, a media player, a device embedded within or using the main display of a consumer electronics device, automotive, transportation or other vehicular units, keyboards or other input devices of the main computer system, a pager, a personal digital assistant, and so forth.
  • computers such as television sets, audio receivers, audio/video recorders, telephones, a separate computer, a mobile communications device, a secondary display screen with actuators, a watch, a wall (e.g., kitchen) display, a display screen, a digital picture frame, a clock, a radio, a media player, a device embedded within or using the main display of a consumer electronics device, automotive
  • the present invention is not limited to the examples, structures or functionality described herein,- rather, any of the examples, structures or functionalities described herein are non-limiting, and the present invention may be used various ways that provide benefits and advantages in computing, data communication and content handling in general.
  • FIG. 2 of the drawings there is shown an example architecture that exposes one or more auxiliary devices (e.g., one auxiliary device 202 is shown in PIG. 2) to clients comprising application programs 204 and other programs (e.g., operating system components).
  • an auxiliary display API set 206 is present, which provides APIs for various functions, including registering the client application 204 (a component of the program or possibly the program itself) with the system, sending content to the coupled auxiliary device 202, sending notifications to the coupled auxiliary device 202, and receiving events from the coupled auxiliary device 202. Events may include navigation events, content request events, content change events, and so forth.
  • the API layer 206 is written on a portable device API set 208, which together can be considered as an auxiliary display platform 210.
  • the portable device API set 208 maps the auxiliary display device 202 into a category of portable devices, and allows enumeration of the device's capabilities. This is encapsulated within the user-mode driver framework 212, however, and not exposed to the client application 204.
  • the set of auxiliary display APIs 206 may use Windows Portable Device (WPD) functions to communicate through Interprocess Communications (IPC) to the driver framework 212 that in turn communicates data to the device 202.
  • WPD Windows Portable Device
  • IPC Interprocess Communications
  • an interface is defined between each layer, including an interface that needs to be exposed by the driver of a device to enable auxiliary display functionality at the driver level .
  • each auxiliary display device vendor provides a corresponding auxiliary device driver 224 (although in some situations a device can. use a generic driver, and thus, for example may be provided by the auxiliary display platform provider) .
  • the user mode driver framework provides a device driver interface (DDI) set 226 such as via libraries 227 or the like for coupling device drivers (e.g., 224) to the auxiliary display platform 210.
  • the driver 224 can then implement the interface set 226 to receive data from the auxiliary display platform corresponding to the API-received information, and forward corresponding data to an appropriate hardware interface (transport) 230 for communication to the auxiliary display device.
  • DMI device driver interface
  • transport hardware interface
  • FIG. 3 shows an example of the user mode driver framework 212 in more detail.
  • the user mode driver framework 212 hosts the user mode auxiliary display driver 224, comprising a main component typically written by an independent hardware vendor, or IHV.
  • IHV independent hardware vendor
  • the auxiliary display driver 224 may convert the data from the auxiliary display platform 210 's format (which, for example may arrive in a Simple Content Format comprising a data format defined in XML) into something the device can more easily render, such as a bitmap .
  • the auxiliary display driver 224 can use any suitable communication protocol the driver writer (e.g., IHV) chooses, essentially stacking the transport driver 230 beneath the auxiliary display driver 224.
  • connection and/or device discovery are handled by the code in the auxiliary display driver 224, but in most cases, device discovery is performed by the operating system's PnP or PnP- X subsystems .
  • the auxiliary display driver 224 links in the auxiliary display class extension library 326.
  • the auxiliary display class extension library 326 provides a communications conduit to the auxiliary display platform 210.
  • the auxiliary display class extension library 326 exposes an interface to access data from the auxiliary display platform 210 and to pass any navigation events, received via the auxiliary display device 202, back to the auxiliary display platform 210.
  • the auxiliary display class extension library 326 may be implemented as a COM component, which does not need to be linked directly into the auxiliary display driver 224.
  • a reference auxiliary display bitmap library 327 also represented in FIG. 3, comprises an optional library that the driver 224 may use, simplifying software development for driver writers willing to use a recommended bitmap display reference platform.
  • the driver 224 may have glance mode information and notifications converted from the auxiliary display platform format 210 into bitmaps that are formatted for a bitmap display reference screen resolution.
  • an independent hardware vendor extensibility library 328 Also represented in FIG. 3 is an independent hardware vendor extensibility library 328. For example, if an independent hardware vendor has provided additional hardware connected to the auxiliary device 202 beyond the auxiliary display reference design, the driver 224 may be extended with this additional library 328 to support the extended functionality and expose that functionality to the main computer system's operating system.
  • FIG. 4 provides details regarding an example, COM- based implementation that is consistent with those of FIGS. 2 and 3.
  • a driver writer has the driver 224 implement a COM interface that comprises a collection of logical auxiliary display operations; note that depending on the actual device, not all of the interface need be implemented.
  • the implementation of the device driver interface methods provide specifics for communicating the logical intent of the device driver interface method to the auxiliary device 202, on a transport 230 of the device manufacturer's choosing that is suitable for a given device.
  • an instance of the implemented device driver interface object is registered with an auxiliary display class extension component, such as provided in a library that ships in Windows VistaTM.
  • the driver writer implements a light layer of driver entry code that instantiates an instance of the class extension object, and thereafter forwards incoming data to the class extension object.
  • the class extension object does the work of interpreting the raw incoming data into logical driver operations.
  • FIG. 4 illustrates the components of one example auxiliary display driver architecture.
  • the class extension object 440 implements the ISideShowClassExtension interface and serves as a helper library for auxiliary display drivers.
  • the class extension object 440 serves (at least) two purposes, including processing forwarded function control codes (e.g., WPD Input/Output controls, or IOCTLs) from independent hardware vendor UMDF driver entry code 442.
  • processing forwarded function control codes e.g., WPD Input/Output controls, or IOCTLs
  • IOCTLs independent hardware vendor UMDF driver entry code 442.
  • One purpose of the class extension object 440 is to facilitate communications between the auxiliary display platform 210 APIs and auxiliary display devices. Because the hardware and firmware that compose an auxiliary display varies among independent hardware vendors, an auxiliary display driver is extensible to allow the independent hardware vendor to support communication with their specific auxiliary display implementation over the independent hardware vendor chosen transport 230.
  • the auxiliary display driver 224 is hosted as a standard user mode driver framework (UMDF) driver that delegates I/O control to an auxiliary display class extension library.
  • the library comprises a COM object (e.g., provided by the platform vendor) that cracks (opens and interprets) IOCTLs, performs security checks (e.g., via a permission manager 444 that verifies control panel, or CPL, data) , and translates IOCTLs into callbacks into the independent hardware vendor driver code.
  • the independent hardware vendor callback code (e.g., in a block 446) then has the responsibility of making the actual device transactions transfer over whatever transport mechanism they use to communicate with the device.
  • an auxiliary display driver may be implemented as two DLLs, including the independent hardware vendor provided DLL that includes the UMDF driver entry point 442 and the device specific callbacks 446, along with DLL containing the auxiliary display class extension COM object that is loaded by the independent hardware vendor DLL .
  • the auxiliary display class extension object 440 processes forwarded WPD IOCTLs by opening them, performing security checks on the data, and then breaking the IOCTLs out into functional calls on independent hardware vendor supplied callbacks. More particularly, the independent hardware vendor callbacks are supplied to the class extension object 440 by calling the Initialize () method and passing in an object that implements the ISideShowDriver interface.
  • the class extension object takes ownership of the device driver interface object and uses it as a strategy pattern to execute driver commands .
  • the class extension object 440 does not actually post events; events are posted within the independent hardware vendor code 446.
  • This implementation is consistent with other UMDF drivers, avoids wrapping basic UMDF functionality, and avoids closely coupling the helper library with UMDF.
  • a driver may enable communication to enhanced displays that run auxiliary display firmware based on the TinyCLR, as generally described in U.S. patent application serial no. 10/996,577 filed November 23, 2004, assigned to the assignee of the present application and hereby incorporated by reference.
  • a modified version of this driver without the TinyCLR communication portion may be offered as a library that other drivers can build on top of to interface to different types of devices.
  • the library interface of the class extension 440 comprises a subset of the commands exposed in an enhanced driver that works with TinyCLR firmware.
  • An alternative approach to allow device and driver extensibility is to provide auxiliary display functionality as part of a Media Transfer Protocol (MTP) specification. This comprises a core section that supports basic displays as well as an extension that allows for enhanced display functionality.
  • the auxiliary display APIs deal with sending messages using MTP to devices that support the auxiliary display commands over MTP. This will use the system provided MTP driver to communicate to the device. The device will be responsible for translating the MTP messages to a format that it can understand.
  • MTP Media Transfer Protocol
  • auxiliary display class extension can be built into a filter driver which runs on top of the system-provided MTP driver and encapsulates the auxiliary display functionality in MTP commands directly, without the auxiliary display API having to know the specifics of the device it is communicating with.
  • the auxiliary display class extension object provides security by filtering device driver interface commands based on a device user mode, and by ensuring that only the authorized users (s) may set user information on the device.
  • DMI device driver interface
  • the class extension object supports three types of device user modes:
  • Open Access - a device in open access mode allows users to interact with the device.
  • the driver allows device driver interface commands for any user at any time.
  • Interactive User - a device in interactive user mode will only interact with the currently active console user of the main computer system.
  • the driver rejects device driver interface commands for any user other than the current active user.
  • the auxiliary display class extension object filters the device driver interface commands by taking the certain (example) steps when a device driver interface command is issued. The steps that are taken depend on the response that is returned when the driver queries the device for its user mode. For the open access user mode, the device driver interface command is let through.
  • the driver gets the SID (security ID) of the current interactive user (defined as the user on the console of the main computer system) , the driver gets the SID of the calling process and the driver compares the SIDs. If the SIDs are equal, the device driver interface command is let through, otherwise the command is blocked.
  • SID security ID
  • the driver queries the device for the SID of the current device user, and also gets the SID of the calling process. The driver compares the SIDS, and if the SIDs are equal, the device driver interface command is let through, otherwise the command is blocked.
  • the class extension object ensures that only user settings specified by an authorized user through the CPL (auxiliary display control panel applet) are applied to the device.
  • a monitor (comprising a process that essentially runs all the time on the main computer system) has permission to read user information from the registry. This process monitors the system for events, including PnP device add, logon or logoff of a new user, and fast user switching events.
  • the monitor process notifies the driver that a user information update is to occur.
  • the class extension object impersonates the monitor process, reads the user information, and applies that information on the device.
  • user information may be written and read from the registry through the permission manager 444.
  • This method unregisters the class extension object and releases any references the class extension may have.
  • HRESULT OnProcessIoControl IWDFIoQueue* pQueue, IWDFIoRequest* pRequest, ULONG ControlCode, SIZE_T InputBufferSizelnBytes, SIZE_T
  • This method accepts forwarded WPD based IOCTLs. Clients should register an object that implements the ISideShowDriver interface by calling Initialize () before calling this method. Valid IOCTLs that may be passed into this method include the IOCTLs generated by the auxiliary display platform. Should the independent hardware vendor wish to pass custom WPD IOCTLs into this method, they are to implement handler code in the
  • ISideShowDriver rOnProcessWpdMessage () . Clients should complete the I/O request, as the I/O request will not be completed by this call .
  • the ISideShowDriver interface is used by the ISideShowClassExtension object to execute commands on the device.
  • ISideShowDriver is an unregistered COM object that is supplied to the ISideShowClassExtension class via the Initialize method.
  • the independent hardware vendor is responsible for implementing this interface.
  • HRESULT OnSetCurrentUser(SID* user, LPCWSTR pwszFriendlyName) [0053] Used to tell the device who the current user is.
  • user [in] A pointer to a SID that identifies the new current user.
  • pwszFreindlyName [in] A string that is the friendly, human-readable user name.
  • This method allows clients to ask the device for the current designated user of the device.
  • ppuser [out] A pointer to an address that upon return will contain the SID of the current designated user of the device. The caller should free the SID by calling
  • HRESULT OnSetTime (SID* user, FILETIME time) [0055] Used to set the current time on the device.
  • user [in] A pointer to a SID that indicates the owner of the calling process.
  • time [in] A FILETIME that is the current time.
  • user [in] A pointer to a SID that indicates the owner of the calling process.
  • pwszTimeFormat [in] A string that indicates the time format .
  • This method tells the device what the current language for the given device user pair is .
  • user [in] A pointer to a SID that indicates the owner of the calling process.
  • lid [in] A LANGID that is the current language for the specified user.
  • HRESULT OnGetDeviceFirmwareVersion (LPCWSTR* ppwszVersion)
  • This method retrieves the version information for the device firmware.
  • ppwszVersion [out] A pointer to a wide string that upon return will contain the device firmware information. HRESULT OnGetDeviceEndpoints (ENDPOINT_ID** rgEndpoints, DWORD* cEndpoints)
  • This method retrieves the endpoints that are supported by the device .
  • user [in] A pointer to a SID that indicates the owner of the calling process.
  • rgEndpoints [out] A pointer to an array of ENDPOINTS that are the endpoints supported by the device. rgEndpoints should be freed by the client by calling CoTaskMemFree ( ) .
  • This method is used by the API to determine the capabilities of the device (i.e. screen resolution, color depth, etc.)
  • pKey [in] A pointer to a PROPERTYKEY that identifies the device capability to query.
  • pvValue [out] A pointer to a PROPVARIANT that upon return will contain the value for the corresponding capability.
  • This method is used by the CPL to determine what the default set of applications that should be enabled on first run are. This method will be called upon device installation.
  • ppguidApps [out] A pointer to an array of APPLICATION_ID that upon return will contain the app ids of the default set of apps .
  • the client is responsible for freeing the array of GUIDs with a call to CoTaskMemFree ( ) .
  • DWORD cbLargelcon BYTE* pbMediumlcon, DWORD cbMediumlcon, CONST BYTE* pbSmalllcon, DWORD cbSmallcon) [0065]
  • This method is used by the CPL to enable an application for use by the specified user on the device.
  • user [in] A pointer to a SID that indicates the owner of the calling process.
  • pAppld [in] A pointer to a APPLICATION ⁇ D that indicates the application to be registered with the device for the given user.
  • wszName [in] A LPCWSTR that is the friendly name of the application that the device may use for display purposes .
  • policy [in] A DWORD that indicates the cache policy to be used by the device for the app. Policy may be a value such as :
  • This method is used by the CPL to disable an application for the specified user on the device.
  • user [in] A pointer to a SID that indicates the owner of the calling process.
  • pAppld [in] A pointer to an APPLICATION_ID to be removed from the device for the specified user.
  • pAppld A pointer to a GUID that is the app Id for which the notification is to be sent.
  • notificationld [in] A NOTIFICATION_ID that is the notification id.
  • ftExpiration [in] A FILETIME that is the time at which the notification expires and should be removed from view on the device .
  • pwszTitle [in] A string that is the text of the title of the notification.
  • pwszMessage [in] A string that is the text of the notification message.
  • pblmage An array of bytes that is the image associated with the notification.
  • cblmage [in] The count of bytes of the image, pblmage.
  • HRESULT OnRemoveNotification CONST PAPPLICATION_ID pAppld, NOTIFICATION__ID notificationld
  • This method removes an active notification from the device .
  • pAppld [in] A pointer to an APPLICATION_ID that is the app Id of the notification to be removed.
  • notificationld [in] A DWORD that is the notification id.
  • HRESULT OnRemoveAllNotifications CONST PAPPLICATION_ID pAppld [0069] This method removes all notifications for an application from the device.
  • pApId[in] A pointer to an APPLICATION_ID that indicates the applciation for which all notifications should be removed.
  • HRESULT OnAddContent CONST PAPPLICATION_ID pAppld
  • This method sends content to the device for the given app.
  • pAppld A pointer to an APPLICATION ⁇ D that is the app Id of the app for which the content is associated.
  • pRendererld A pointer to an ENDPOINT_ID that is the renderer Id for which the content is associated, contented [in] The content id of the content to add.
  • pbData An array of bytes that is the content to be added to the app.
  • HRESULT OnRemoveContent (CONST PAPPLICATION_ID pAppld, CONST GUID pRenderld) [0071] This method removes content from the device for the given app .
  • pAppld [in] A pointer to an APPLICATION_ID of the application for which the content is to be removed.
  • pRendererld [in] A pointer to a GUID that is the renderer Id for which the content is associated.
  • HRESULT OnRemoveAllContent (CONST PAPPLICATION_ID pAppld, CONST PENDPOINT_ID pRendererld) [0072] Removes all content for an application from the device .
  • pAppld A pointer to an APPLICATI0N_ID that is the app id of the app for which all content will be removed.
  • pRendererld A pointer to an ENDPOINT_ID that is the renderer Id of the content to be removed.
  • HRESULT OnSetNotificationsEnabled ( [in] const SID* pUserSid, [in] const BOOL flsEnabled) [0073] Suppresses device-generated notifications.
  • user [in] A pointer to a SID that indicates the owner of the calling process.
  • flsEnable [in] A Bool that indicates if notifications should be suppressed by the device.
  • This method is fall-back handler that is called in response to an unknown WPD IOCTL.
  • This method gives the independent hardware vendor the opportunity to extend the device driver interface and implement their own WPD IOCTL in the same context as the other interface methods .
  • the independent hardware vendor is responsible for validation and security checks on the passed-in data.
  • the intent of the method is provide a mechanism to extend rather than bypass the device driver interface .

Abstract

In a main computer system coupled to an auxiliary display device, described is an interface set for implementation by an auxiliary display device driver, to couple the driver to an auxiliary display platform. Commands received from the auxiliary display platform may be handled by code external to the driver, such as a class extension object. For example, the class extension object may interpret and/or translate commands received from the auxiliary display platform into a format understood by the driver code. The auxiliary display device driver may then provide corresponding command information including data to the auxiliary display device via the transport. Event data may be returned from the auxiliary display device driver via the interface set to the class extension object, such that corresponding event information, e.g., received at the auxiliary display device, may be returned to the auxiliary display platform.

Description

AUXILIARY DISPLAY DEVICE DRIVER INTERFACE
BACKGROUND
[0001] In contemporary (e.g., Windows'8 Vista™-based) computer systems, users are able to view and generally interact with selected content on a small auxiliary display device coupled to or integrated into a main host computer system. To this end, an auxiliary display screen along with an operating system-provided platform (referred to as an auxiliary display platform, or a Windows0 SideShow™ platform) , enables developers and authors to present content to users. This allows the user to view the content even when the main host computer system is in a reduced power state (e.g., ACPI S3 sleep state), or even turned off.' [0002] When creating an auxiliary display device for an operating system such as Microsoft Windows , device manufacturers, also referred to as independent hardware vendors, or IHVs, implement a Windows Vista™ User Mode Driver Framework (UMDF) driver that facilitates communications between the auxiliary display platform and the auxiliary display device. Creating a driver is complicated, as among other things, an auxiliary display driver is required to decode data from the auxiliary display platform into logical auxiliary display operations, and then transmit those intentions to the device through a protocol that the auxiliary display device understands. Auxiliary display devices potentially can take many forms, and the underlying transport protocol used to communicate with the device can vary from device type to device type. Creating a driver is thus a particularly time consuming, burdensome, tedious and error-prone endeavor for device manufacturers .
SUMMARY
[0003] This Summary is provided to introduce a selection of representative concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used in any way that would limit the scope of the claimed subject matter. [0004] Briefly, various aspects of the subject matter described herein are directed towards an interface set that may be implemented by an auxiliary display device driver to couple the driver to an auxiliary display platform. By calling into the auxiliary display device driver via the interface set, commands received from the auxiliary display platform may be handled by code external to the driver, thereby facilitating communication between the auxiliary display platform and the driver. For example, a class extension object may interpret and/or translate commands received from the auxiliary display platform into a format the driver code can more easily handle, thereby simplifying the driver code . Event data may be provided from the auxiliary display device driver such that corresponding event information may be passed to the auxiliary display platform.
[0005] Thus, the auxiliary display platform may provide data directed towards the auxiliary display device from one or more application programs, and when an auxiliary display device driver receives the data, an interface set implemented by the auxiliary display device driver allows a helper object to process commands received as data from the auxiliary display platform and to call back to the auxiliary display device driver via the interface with corresponding data. For example, upon receiving a call from the auxiliary display device driver that includes a command related to performing an operation related to an auxiliary display, the helper object may translate the call and command into data in a data format understood by the auxiliary display device driver, and call back the auxiliary display device driver with the data. The auxiliary display device driver may then provide corresponding information to the auxiliary display- device via the transport.
[0006] Other advantages will become apparent from the following detailed description when taken in conjunction with the drawings .
BRIEF DESCRIPTION OF THE DRAWINGS
[0007] The present invention is illustrated by way of example and not limited in the accompanying figures in which like reference numerals indicate similar elements and in which:
[0008] FIGURE 1 shows an illustrative example of a general- purpose computing environment into which various aspects of the present invention may be incorporated. [0009] FIG. 2 is a block diagram representing an example architecture in which an interface set may be implemented for auxiliary display device communication. [0010] FIG. 3 is a block diagram representing example components including libraries in which an interface may be implemented for auxiliary display device communication. [0011] FIG. 4 is a block diagram representing example components including example interfaces and a helper object that may be used for auxiliary display device communication.
DETAILED DESCRIPTION EXEMPLARY OPERATING ENVIRONMENT
[0012] FIGURE 1 illustrates an example of a suitable computing system environment 100 on which the invention may be implemented. The computing system environment 100 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the computing environment 100 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment 100.
[0013] The invention is operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited to: personal computers, server computers, handheld or laptop devices, tablet devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like. [0014] The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, and so forth, which perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in local and/or remote computer storage media including memory storage devices .
[0015] With reference to FIG. 1, an exemplary system for implementing the invention includes a general purpose computing device in the form of a computer 110. Components of the computer 110 may include, but are not limited to, a processing unit 120, a system memory 130, and a system bus 121 that couples various system components including the system memory to the processing unit 120. The system bus 121 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus. [0016] The computer 110 typically includes a variety of computer-readable media. Computer-readable media can be any available media that can be accessed by the computer 110 and includes both volatile and nonvolatile media, and removable and non-removable media. By way of example, and not limitation, computer-readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and nonremovable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by the computer 110. Communication media typically embodies computer-readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term "modulated data signal" means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of the any of the above should also be included within the scope of computer-readable media.
[0017] The system memory 130 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 131 and random access memory (RAM) 132. A basic input/output system 133 (BIOS), containing the basic routines that help to transfer information between elements within computer 110, such as during start-up, is typically stored in ROM 131. RAM 132 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 120. By way of example, and not limitation, FIG. 1 illustrates operating system 134, application programs 135, other program modules 136 and program data 137. [0018] The computer 110 may also include other removable/non-removable, volatile/nonvolatile computer storage media. By way of example only, FIG. 1 illustrates a hard disk drive 141 that reads from or writes to nonremovable, nonvolatile magnetic media, a magnetic disk drive 151 that reads from or writes to a removable, nonvolatile magnetic disk 152, and an optical disk drive 155 that reads from or writes to a removable, nonvolatile optical disk 156 such as a CD ROM or other optical media. Other removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. The hard disk drive 141 is typically connected to the system bus 121 through a non-removable memory interface such as interface 140, and magnetic disk drive 151 and optical disk drive 155 are typically connected to the system bus 121 by a removable memory interface, such as interface 150.
[0019] The drives and their associated computer storage media, described above and illustrated in FIG. 1, provide storage of computer-readable instructions, data structures, program modules and other data for the computer 110. In FIG. 1, for example, hard disk drive 141 is illustrated as storing operating system 144, application programs 145, other program modules 146 and program data 147. Note that these components can either be the same as or different from operating system 134, application programs 135, other program modules 136, and program data 137. Operating system 144, application programs 145, other program modules 146, and program data 147 are given different numbers herein to illustrate that, at a minimum, they are different copies. A user may enter commands and information into the computer 110 through input devices such as a tablet, or electronic digitizer, 164, a microphone 163, a keyboard 162 and pointing device 161, commonly referred to as mouse, trackball or touch pad. Other input devices not shown in FIG. 1 may include a joystick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to the processing unit 120 through a user input interface 160 that is coupled to the system bus, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB) . A monitor 191 or other type of display device is also connected to the system bus 121 via an interface, such as a video interface 190. The monitor 191 may also be integrated with a touch-screen panel or the like. Note that the monitor and/or touch screen panel can be physically coupled to a housing in which the computing device 110 is incorporated, such as in a tablet-type personal computer. In addition, computers such as the computing device 110 may also include other peripheral output devices such as speakers 195 and printer 196, which may be connected through an output peripheral interface 194 or the like. [0020] The computer 110 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 180. The remote computer 180 may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer 110, although only a memory storage device 181 has been illustrated in FIG. 1. The logical connections depicted in FIG. 1 include a local area network (LAN) 171 and a wide area network (WAN) 173, but may also include other networks. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.
[0021] When used in a LAN networking environment, the computer 110 is connected to the LAN 171 through a network interface or adapter 170. When used in a WAN networking environment, the computer 110 typically includes a modem 172 or other means for establishing communications over the WAN 173, such as the Internet. The modem 172, which may be internal or external, may be connected to the system bus 121 via the user input interface 160 or other appropriate mechanism. In a networked environment, program modules depicted relative to the computer 110, or portions thereof, may be stored in the remote memory storage device . By way of example, and not limitation, FIG. 1 illustrates remote application programs 185 as residing on memory device 181. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used. [0022] An auxiliary display subsystem 199 may be connected via the user interface 160 to allow data such as program content, system status and event notifications to be provided to the user, even if the main portions of the computer system are in a low power state. The auxiliary display subsystem 199 may be connected to the modem 172 and/or network interface 170 to allow communication between these systems while the main processing unit 120 is in a low power state. AUXILIARY DISPLAY DEVICE DRIVER INTERFACE
[0023] Various aspects of the technology described herein are directed towards simplifying the task of writing an auxiliary display driver. In part this is accomplished providing a common mechanism that implements a set of well- defined logical auxiliary display operations, thereby reducing the amount of work that a driver implementer needs to perform. As a result, driver implementers can, for the most part, direct their efforts to providing a transport mechanism to their auxiliary display device, and need not concern themselves with the complexity of the communication between the auxiliary display driver and the auxiliary display platform.
[0024] To this end, there are provided the concepts of an interface for an auxiliary display driver, along with a set of logical auxiliary display operations that make up the device driver interface. As will be understood, however, the technology described herein is not limited to these concepts or the examples used to describe the device driver interface, or the auxiliary display driver interface, such as the examples described herein that are based on COM (component object model) technology. Moreover, the technology described herein is not limited to any particular types of auxiliary devices, but rather includes devices not conventionally thought of as devices that are "computer- system" coupled devices, such as television sets, audio receivers, audio/video recorders, telephones, a separate computer, a mobile communications device, a secondary display screen with actuators, a watch, a wall (e.g., kitchen) display, a display screen, a digital picture frame, a clock, a radio, a media player, a device embedded within or using the main display of a consumer electronics device, automotive, transportation or other vehicular units, keyboards or other input devices of the main computer system, a pager, a personal digital assistant, and so forth. As such, the present invention is not limited to the examples, structures or functionality described herein,- rather, any of the examples, structures or functionalities described herein are non-limiting, and the present invention may be used various ways that provide benefits and advantages in computing, data communication and content handling in general.
[0025] Turning to FIG. 2 of the drawings, there is shown an example architecture that exposes one or more auxiliary devices (e.g., one auxiliary device 202 is shown in PIG. 2) to clients comprising application programs 204 and other programs (e.g., operating system components). To communicate data to and from the program 204 at the program level, an auxiliary display API set 206 is present, which provides APIs for various functions, including registering the client application 204 (a component of the program or possibly the program itself) with the system, sending content to the coupled auxiliary device 202, sending notifications to the coupled auxiliary device 202, and receiving events from the coupled auxiliary device 202. Events may include navigation events, content request events, content change events, and so forth. Software code such as operating system components and/or application programs may also be uploaded to the auxiliary device. [0026] In the example of FIG. 2, the API layer 206 is written on a portable device API set 208, which together can be considered as an auxiliary display platform 210. In general, the portable device API set 208 maps the auxiliary display device 202 into a category of portable devices, and allows enumeration of the device's capabilities. This is encapsulated within the user-mode driver framework 212, however, and not exposed to the client application 204. For example, the set of auxiliary display APIs 206 may use Windows Portable Device (WPD) functions to communicate through Interprocess Communications (IPC) to the driver framework 212 that in turn communicates data to the device 202. To enable the pieces of this platform to interact with each other, an interface is defined between each layer, including an interface that needs to be exposed by the driver of a device to enable auxiliary display functionality at the driver level .
[0027] Turning to the hardware vendor's perspective, in general, each auxiliary display device vendor provides a corresponding auxiliary device driver 224 (although in some situations a device can. use a generic driver, and thus, for example may be provided by the auxiliary display platform provider) . In general, the user mode driver framework provides a device driver interface (DDI) set 226 such as via libraries 227 or the like for coupling device drivers (e.g., 224) to the auxiliary display platform 210. The driver 224 can then implement the interface set 226 to receive data from the auxiliary display platform corresponding to the API-received information, and forward corresponding data to an appropriate hardware interface (transport) 230 for communication to the auxiliary display device. For example, in FIG. 2, examples shown are USB and Bluetooth , although other types of transports including Wi-FI, AM/FM, infrared, network transports such as TCP/IP-based transports, and so forth are feasible. As is understood, these connections are only shown for example purposes, as any device driver will forward data for wireless or wired communication as appropriate . [0028] FIG. 3 shows an example of the user mode driver framework 212 in more detail. As described above, the user mode driver framework 212 hosts the user mode auxiliary display driver 224, comprising a main component typically written by an independent hardware vendor, or IHV. One of the driver's roles is to extract information from the auxiliary display platform 210, and pass any navigation events input at the auxiliary device 202 back to the auxiliary display platform 210. Depending on the capabilities of the auxiliary device 202, the auxiliary display driver 224 may convert the data from the auxiliary display platform 210 's format (which, for example may arrive in a Simple Content Format comprising a data format defined in XML) into something the device can more easily render, such as a bitmap . [0029] To communicate with the auxiliary device 202, as represented in FIG. 3, the auxiliary display driver 224 can use any suitable communication protocol the driver writer (e.g., IHV) chooses, essentially stacking the transport driver 230 beneath the auxiliary display driver 224. Note that in one example implementation, connection and/or device discovery (if appropriate) are handled by the code in the auxiliary display driver 224, but in most cases, device discovery is performed by the operating system's PnP or PnP- X subsystems . [0030] To interface to the auxiliary display platform 210, the auxiliary display driver 224 links in the auxiliary display class extension library 326. As represented in FIG. 3, once linked, the auxiliary display class extension library 326 provides a communications conduit to the auxiliary display platform 210. In one example implementation, the auxiliary display class extension library 326 exposes an interface to access data from the auxiliary display platform 210 and to pass any navigation events, received via the auxiliary display device 202, back to the auxiliary display platform 210. In one example implementation (generally represented in FIG. 4) , the auxiliary display class extension library 326 may be implemented as a COM component, which does not need to be linked directly into the auxiliary display driver 224.
[0031] A reference auxiliary display bitmap library 327, also represented in FIG. 3, comprises an optional library that the driver 224 may use, simplifying software development for driver writers willing to use a recommended bitmap display reference platform. For example, with the bitmap library 327, the driver 224 may have glance mode information and notifications converted from the auxiliary display platform format 210 into bitmaps that are formatted for a bitmap display reference screen resolution. [0032] Also represented in FIG. 3 is an independent hardware vendor extensibility library 328. For example, if an independent hardware vendor has provided additional hardware connected to the auxiliary device 202 beyond the auxiliary display reference design, the driver 224 may be extended with this additional library 328 to support the extended functionality and expose that functionality to the main computer system's operating system. Examples of such additional hardware include a biometric reader, a GPS unit, and so forth. The hardware vendor extensibility library 328 may also be implemented as an additional user-mode or kernel-mode driver that acts as a filter driver, and can be either above or below the auxiliary display driver in the driver stack. [0033] FIG. 4 provides details regarding an example, COM- based implementation that is consistent with those of FIGS. 2 and 3. In this example, a driver writer has the driver 224 implement a COM interface that comprises a collection of logical auxiliary display operations; note that depending on the actual device, not all of the interface need be implemented. In general, the implementation of the device driver interface methods provide specifics for communicating the logical intent of the device driver interface method to the auxiliary device 202, on a transport 230 of the device manufacturer's choosing that is suitable for a given device. [0034] In one example embodiment, an instance of the implemented device driver interface object is registered with an auxiliary display class extension component, such as provided in a library that ships in Windows Vista™. In general, the driver writer implements a light layer of driver entry code that instantiates an instance of the class extension object, and thereafter forwards incoming data to the class extension object. Also in general, the class extension object does the work of interpreting the raw incoming data into logical driver operations. The class extension object calls into the device driver interface that has been implemented, where the intent of the logical operation may be executed by the driver writer's code. [0035] FIG. 4 illustrates the components of one example auxiliary display driver architecture. The class extension object 440 implements the ISideShowClassExtension interface and serves as a helper library for auxiliary display drivers. The class extension object 440 serves (at least) two purposes, including processing forwarded function control codes (e.g., WPD Input/Output controls, or IOCTLs) from independent hardware vendor UMDF driver entry code 442. [0036] One purpose of the class extension object 440 is to facilitate communications between the auxiliary display platform 210 APIs and auxiliary display devices. Because the hardware and firmware that compose an auxiliary display varies among independent hardware vendors, an auxiliary display driver is extensible to allow the independent hardware vendor to support communication with their specific auxiliary display implementation over the independent hardware vendor chosen transport 230.
[0037] In the example of FIG. 4, the auxiliary display driver 224 is hosted as a standard user mode driver framework (UMDF) driver that delegates I/O control to an auxiliary display class extension library. The library comprises a COM object (e.g., provided by the platform vendor) that cracks (opens and interprets) IOCTLs, performs security checks (e.g., via a permission manager 444 that verifies control panel, or CPL, data) , and translates IOCTLs into callbacks into the independent hardware vendor driver code. The independent hardware vendor callback code (e.g., in a block 446) then has the responsibility of making the actual device transactions transfer over whatever transport mechanism they use to communicate with the device. Thus, an auxiliary display driver may be implemented as two DLLs, including the independent hardware vendor provided DLL that includes the UMDF driver entry point 442 and the device specific callbacks 446, along with DLL containing the auxiliary display class extension COM object that is loaded by the independent hardware vendor DLL . [0038] As described above, the auxiliary display class extension object 440 processes forwarded WPD IOCTLs by opening them, performing security checks on the data, and then breaking the IOCTLs out into functional calls on independent hardware vendor supplied callbacks. More particularly, the independent hardware vendor callbacks are supplied to the class extension object 440 by calling the Initialize () method and passing in an object that implements the ISideShowDriver interface. The class extension object takes ownership of the device driver interface object and uses it as a strategy pattern to execute driver commands . [0039] Note that in this example implementation, the class extension object 440 does not actually post events; events are posted within the independent hardware vendor code 446. This implementation is consistent with other UMDF drivers, avoids wrapping basic UMDF functionality, and avoids closely coupling the helper library with UMDF. [0040] As part of the platform, a driver may enable communication to enhanced displays that run auxiliary display firmware based on the TinyCLR, as generally described in U.S. patent application serial no. 10/996,577 filed November 23, 2004, assigned to the assignee of the present application and hereby incorporated by reference. A modified version of this driver without the TinyCLR communication portion may be offered as a library that other drivers can build on top of to interface to different types of devices. Note that the library interface of the class extension 440 comprises a subset of the commands exposed in an enhanced driver that works with TinyCLR firmware. [0041] An alternative approach to allow device and driver extensibility is to provide auxiliary display functionality as part of a Media Transfer Protocol (MTP) specification. This comprises a core section that supports basic displays as well as an extension that allows for enhanced display functionality. The auxiliary display APIs deal with sending messages using MTP to devices that support the auxiliary display commands over MTP. This will use the system provided MTP driver to communicate to the device. The device will be responsible for translating the MTP messages to a format that it can understand. Alternately, the auxiliary display class extension can be built into a filter driver which runs on top of the system-provided MTP driver and encapsulates the auxiliary display functionality in MTP commands directly, without the auxiliary display API having to know the specifics of the device it is communicating with. EXAMPLE SECURITY AND USER MODES
[0042] The auxiliary display class extension object provides security by filtering device driver interface commands based on a device user mode, and by ensuring that only the authorized users (s) may set user information on the device. For device driver interface (DDI) filtering, the class extension object supports three types of device user modes:
Open Access - a device in open access mode allows users to interact with the device. The driver allows device driver interface commands for any user at any time.
Interactive User - a device in interactive user mode will only interact with the currently active console user of the main computer system. The driver rejects device driver interface commands for any user other than the current active user.
Fixed User - a device in fixed user mode only interacts with a single designated fixed user. The driver rejects device driver interface commands from the current active user (or any other user) if they are not the designated fixed user of the device. Either the device or the PC may designate the fixed user of the device, and the fixed user may change at any time. [0043] The auxiliary display class extension object filters the device driver interface commands by taking the certain (example) steps when a device driver interface command is issued. The steps that are taken depend on the response that is returned when the driver queries the device for its user mode. For the open access user mode, the device driver interface command is let through. [0044] If the user mode is instead Interactive, the driver gets the SID (security ID) of the current interactive user (defined as the user on the console of the main computer system) , the driver gets the SID of the calling process and the driver compares the SIDs. If the SIDs are equal, the device driver interface command is let through, otherwise the command is blocked.
[0045] If the user mode is Fixed User, the driver queries the device for the SID of the current device user, and also gets the SID of the calling process. The driver compares the SIDS, and if the SIDs are equal, the device driver interface command is let through, otherwise the command is blocked. [0046] With respect to per-user settings enforcement, the class extension object ensures that only user settings specified by an authorized user through the CPL (auxiliary display control panel applet) are applied to the device. To this end, a monitor (comprising a process that essentially runs all the time on the main computer system) has permission to read user information from the registry. This process monitors the system for events, including PnP device add, logon or logoff of a new user, and fast user switching events. When any one of these events occurs, the monitor process notifies the driver that a user information update is to occur. At this time, the class extension object impersonates the monitor process, reads the user information, and applies that information on the device. In one implementation, user information may be written and read from the registry through the permission manager 444. [0047] When the user makes changes to settings in the CPL, the CPL calls into the driver and passes in the user data. Before making calls into the implemented callbacks, the class extension object verifies the passed-in user data against the user data contained in the registry. EXAMPLE INTERFACES AND METHODS ISideShowClassExtension interface [0048] Independent hardware vendors should CoCreatelnstance () an instance of this class within IPnpCallbackHardware : : OnPrepareHardware () and retain a pointer to the instance for the lifetime of the UMDF driver. This interface assists independent hardware vendors by- parsing WPD IOCTLs and breaking them down into device driver interface calls on independent hardware vendor provided callbacks. Independent hardware vendors should register an ISideShowDriver object with this interface by calling Initialize () .
HRESULT Initialize (IUnknown* WdfDeviceUnknown, IUnknown* pSideShowDriverUnknown) [0049] This method registers an ISideShowDriver object with the class extension object and initializes the class extension for use.
HRESULT UninitializeO
[0050] This method unregisters the class extension object and releases any references the class extension may have. HRESULT OnProcessIoControl (IWDFIoQueue* pQueue, IWDFIoRequest* pRequest, ULONG ControlCode, SIZE_T InputBufferSizelnBytes, SIZE_T
OutputBufferSizelnBytes) . [0051] This method accepts forwarded WPD based IOCTLs. Clients should register an object that implements the ISideShowDriver interface by calling Initialize () before calling this method. Valid IOCTLs that may be passed into this method include the IOCTLs generated by the auxiliary display platform. Should the independent hardware vendor wish to pass custom WPD IOCTLs into this method, they are to implement handler code in the
ISideShowDriver : rOnProcessWpdMessage () . Clients should complete the I/O request, as the I/O request will not be completed by this call . ISideShowDriver interface
[0052] The ISideShowDriver interface is used by the ISideShowClassExtension object to execute commands on the device. ISideShowDriver is an unregistered COM object that is supplied to the ISideShowClassExtension class via the Initialize method. The independent hardware vendor is responsible for implementing this interface. HRESULT OnSetCurrentUser(SID* user, LPCWSTR pwszFriendlyName) [0053] Used to tell the device who the current user is. user [in] A pointer to a SID that identifies the new current user. pwszFreindlyName [in] A string that is the friendly, human-readable user name.
HRESULT OnGetCurrentUser (SID** ppuser)
[0054] This method allows clients to ask the device for the current designated user of the device. ppuser [out] A pointer to an address that upon return will contain the SID of the current designated user of the device. The caller should free the SID by calling
FreeSidO .
HRESULT OnSetTime (SID* user, FILETIME time) [0055] Used to set the current time on the device. user [in] A pointer to a SID that indicates the owner of the calling process. time [in] A FILETIME that is the current time.
HRESULT OnSetShortDateFormat (SID* user, LPCWSTR pwszDateFormat)
[0056] Used to set the date format of the device to short, and to indicate what that format is. user [in] A pointer to a SID that indicates the owner of the calling process. pwszDateFormat [in]
HRESULT OnSetLongDateFormat (SID* user, LPCWSTR pwszDateFormat)
[0057] Used to set the date format of the device to long, and to indicate what that format is . user [in] A pointer to a SID that indicates the owner of the calling process. pwszDateFormat tin]
HRESULT OnSetShortTimeFormat (SID* user, LPCWSTR pwszTimeFormat)
[0058] Used to set the time format of the device to short, and to indicate what that format is. user [in] A pointer to a SID that indicates the owner of the calling process. pwszTimeFormat [in] A string that indicates the time format .
HRESULT OnSetLongTimeFormat (SID* user, LPCWSTR pwszTimeFormat)
[0059] Used to set the time format of the device to long, and to indicate what that time format is . user [in] A pointer to a SID that indicates the owner of the calling process. pwszTimeFormat [in] A string that indicates the time format . HRESULT OnSetLanguage(SID* user, LANGID lid)
[0060] This method tells the device what the current language for the given device user pair is . user [in] A pointer to a SID that indicates the owner of the calling process. lid [in] A LANGID that is the current language for the specified user. HRESULT OnGetDeviceFirmwareVersion (LPCWSTR* ppwszVersion)
[0061] This method retrieves the version information for the device firmware. ppwszVersion [out] A pointer to a wide string that upon return will contain the device firmware information. HRESULT OnGetDeviceEndpoints (ENDPOINT_ID** rgEndpoints, DWORD* cEndpoints)
[0062] This method retrieves the endpoints that are supported by the device . user [in] A pointer to a SID that indicates the owner of the calling process. rgEndpoints [out] A pointer to an array of ENDPOINTS that are the endpoints supported by the device. rgEndpoints should be freed by the client by calling CoTaskMemFree ( ) .
HRESULT OnGetDeviceCapabilities (PROPERTYKEY* pKey, PROPVARIANT* pvValue)
[0063] This method is used by the API to determine the capabilities of the device (i.e. screen resolution, color depth, etc.) pKey [in] A pointer to a PROPERTYKEY that identifies the device capability to query. pvValue [out] A pointer to a PROPVARIANT that upon return will contain the value for the corresponding capability.
HRESULT OnGetPreEnabledApplications (APPLICATION_ID** ppguidApps)
[0064] This method is used by the CPL to determine what the default set of applications that should be enabled on first run are. This method will be called upon device installation. ppguidApps [out] A pointer to an array of APPLICATION_ID that upon return will contain the app ids of the default set of apps . The client is responsible for freeing the array of GUIDs with a call to CoTaskMemFree ( ) .
HRESULT OnAddApplication(SID* user, CONST PAPPLICATION_ID pAppld, CONST PENDPOINT_ID pEndPoint,
LPCWSTR wszName, DWORD policy, CONST BYTE* pbLargelσon,
DWORD cbLargelcon, BYTE* pbMediumlcon, DWORD cbMediumlcon, CONST BYTE* pbSmalllcon, DWORD cbSmallcon) [0065] This method is used by the CPL to enable an application for use by the specified user on the device. user [in] A pointer to a SID that indicates the owner of the calling process. pAppld [in] A pointer to a APPLICATION^D that indicates the application to be registered with the device for the given user. wszName [in] A LPCWSTR that is the friendly name of the application that the device may use for display purposes . policy [in] A DWORD that indicates the cache policy to be used by the device for the app. Policy may be a value such as :
KeepOldest
KeepFrequentlyAccessed KeepRecentlyAccessed pbLargelcon [in] An array of bytes that is the large icon image associated with the app. cbLargelcon [in] The count of bytes of the large icon data pointed to by pbLargelcon. pbSmalllcon [in] An array of byte that is the small icon image associated with the app. cbSmalllcon [in] The count of bytes of the small icon data pointed to by pbSmalllcon. HRESULT OnRemoveApplication(SID* user, CONST
PAPPLICATION_ID pAppld)
[0066] This method is used by the CPL to disable an application for the specified user on the device. user, [in] A pointer to a SID that indicates the owner of the calling process. pAppld [in] A pointer to an APPLICATION_ID to be removed from the device for the specified user.
HRESULT OnAddNotification (CONST PAPPLICATION_ID pAppld, NOTIFICATION_ID notificationld, FILETIME ftExpiration,
LPCWSTR pwszTitle, LPCWSTR pwszMessage, CONST BYTE* pblmage, DWORD cblmage) [0067] Sends a notification to the device. pAppld [in] A pointer to a GUID that is the app Id for which the notification is to be sent. notificationld [in] A NOTIFICATION_ID that is the notification id. ftExpiration [in] A FILETIME that is the time at which the notification expires and should be removed from view on the device . pwszTitle [in] A string that is the text of the title of the notification. pwszMessage [in] A string that is the text of the notification message. pblmage [in] An array of bytes that is the image associated with the notification. cblmage [in] The count of bytes of the image, pblmage.
HRESULT OnRemoveNotification (CONST PAPPLICATION_ID pAppld, NOTIFICATION__ID notificationld) [0068] This method removes an active notification from the device . pAppld [in] A pointer to an APPLICATION_ID that is the app Id of the notification to be removed. notificationld [in] A DWORD that is the notification id.
HRESULT OnRemoveAllNotifications (CONST PAPPLICATION_ID pAppld) [0069] This method removes all notifications for an application from the device. pApId[in] A pointer to an APPLICATION_ID that indicates the applciation for which all notifications should be removed. HRESULT OnAddContent (CONST PAPPLICATION_ID pAppld,
CONST PENDPOINT_ID pRendererld, CONTENT_ID contentld, CONST BYTE* pData, DWORD cbData)
[0070] This method sends content to the device for the given app. pAppld [in] A pointer to an APPLICATION^D that is the app Id of the app for which the content is associated. pRendererld [in] A pointer to an ENDPOINT_ID that is the renderer Id for which the content is associated, contented [in] The content id of the content to add. pbData [in] An array of bytes that is the content to be added to the app. cbData [in] The count of bytes of the data. HRESULT OnRemoveContent (CONST PAPPLICATION_ID pAppld, CONST GUID pRenderld) [0071] This method removes content from the device for the given app . pAppld [in] A pointer to an APPLICATION_ID of the application for which the content is to be removed. pRendererld [in] A pointer to a GUID that is the renderer Id for which the content is associated. HRESULT OnRemoveAllContent (CONST PAPPLICATION_ID pAppld, CONST PENDPOINT_ID pRendererld) [0072] Removes all content for an application from the device . pAppld [in] A pointer to an APPLICATI0N_ID that is the app id of the app for which all content will be removed. pRendererld [in] A pointer to an ENDPOINT_ID that is the renderer Id of the content to be removed.
HRESULT OnSetNotificationsEnabled( [in] const SID* pUserSid, [in] const BOOL flsEnabled) [0073] Suppresses device-generated notifications. user [in] A pointer to a SID that indicates the owner of the calling process. flsEnable [in] A Bool that indicates if notifications should be suppressed by the device.
HRESULT OnDeviceloControl (SID* user, IWDFIoQueue* pQueue, IWDFIoRequest* pRequest, ULONG ControlCode, SIZEJT InputBufferSizelnBytes, SIZE_T
OutputBufferSizelnBytes)
[0074] This method is fall-back handler that is called in response to an unknown WPD IOCTL. This method gives the independent hardware vendor the opportunity to extend the device driver interface and implement their own WPD IOCTL in the same context as the other interface methods . The independent hardware vendor is responsible for validation and security checks on the passed-in data. The intent of the method is provide a mechanism to extend rather than bypass the device driver interface .
HRESULT OnGetDeviceName ( [out, string] LPWSTR* ppwszName)
[0075] This method is used to retrieve the name of the device for display purposes in the Device Manager. HRESULT OnGetDeviceManufacturer ( [out, string] LPWSTR* ppwszManufacturer)
[0076] This method is used to retrieve the name of the device manufacturer for display purposes in the Device Manager . [0077] As can be readily appreciated, most of the driver code is not algorithm intensive. A possible exception is a mechanism within the driver that deduces what the logical WPD object is based on an object ID. The class extension object uses regular expressions to match object IDs to logical WPD objects. This may be optimized by replacing the regular expressions with a more simplistic string parsing function, although doing so trades off robustness for speed.

Claims

WHAT IS CLAIMED IS:
1. In a computing environment, a method comprising: providing an interface set comprising at least one interface, the interface set being implemented by an auxiliary display device driver to couple the driver to an auxiliary display platform; and calling into the auxiliary display device driver via the interface set, including making calls corresponding to commands received from the auxiliary display platform.
2. The method of claim 1 further comprising, registering an implemented device driver interface object with an auxiliary display driver class extension object.
3. The method of claim 1 wherein calling into the auxiliary display device driver via the interface set comprises communicating with the auxiliary display platform via a class extension object.
4. The method of claim 3 wherein auxiliary display device driver is hosted in a user mode driver framework, and further comprising, instantiating the class extension object as a helper object in the user mode driver framework.
5. The method of claim 3 further comprising, obtaining event data from the auxiliary display device driver via the interface set and the class extension object, and passing corresponding event information to the auxiliary display platform.
6. The method of claim 3 further comprising, performing security checks via the class extension object and a monitor process .
7. In a computing environment having a main computer system and an auxiliary display device, a system comprising: an auxiliary display platform that provides data directed towards the auxiliary display device from one or more application programs; an auxiliary display device driver that receives the data and provides corresponding information to the auxiliary- display device via a transport; an interface set implemented by the auxiliary display device driver; and a class extension object that communicates with the auxiliary display device driver via the interface set, the class extension object configured to process commands received as data from the auxiliary display platform and to call back to the auxiliary display device driver via the interface with corresponding data, for providing as the corresponding information to the auxiliary display device via the transport .
8. The system of claim 7 wherein the commands received as data from the auxiliary display platform comprise input / output (I/O) control commands, and wherein the class extension object receives the I/O control commands from the auxiliary display device driver via the interface set, interprets the I/O control commands, and calls back to the auxiliary display device driver via the interface with corresponding data translated from the I/O control commands.
9. The system of claim 7 further comprising a monitor process, wherein the class extension object communicates with the monitor process to perform security checks on the commands received as data from the auxiliary display platform.
10. The system of claim 7 wherein the interface and class extension object are provided in at least one auxiliary display-related library.
11. The system of claim 7 further comprising an auxiliary display bitmap library.
12. The system of claim 7 wherein the interface includes means for providing event data from the auxiliary display device driver to the class extension object, to facilitate providing corresponding event information to the auxiliary display platform.
13. The system of claim 7 wherein the interface set includes an interface having at least one of : means for registering the auxiliary display device driver with the class extension object and means for forwarding commands from the auxiliary display device driver to the class extension object.
14. The system of claim 7 wherein the interface set includes an interface that is used to create device event data for communicating from the auxiliary display device driver to the auxiliary display platform, wherein the interface includes at least one of: means for constructing a content missing event packet, means for constructing an application event, means for providing information about a current user, and means for requesting information about a current user.
15. The system of claim 7 wherein the interface set includes an interface that is used to execute commands on the device, wherein the interface includes at least one of: means for controlling display characteristics on the auxiliary display device, means for setting system information on the auxiliary display device, means for providing security information of a calling process, means for determining capabilities of the auxiliary display device, means for enabling applications to run on the auxiliary display device, means for sending a notification to the auxiliary device, means for removing at least one notification from the auxiliary device, means for sending application-related content to the auxiliary device, means for uploading software code to run on the device, and means for removing at least one set of application-related content from the auxiliary device.
16. A computer-readable medium having computer-executable instructions, which when implemented perform steps, comprising: receiving a call from an auxiliary display device driver, the call including a command related to performing an operation related to an auxiliary display; translating the call and command into data in a data format understood by the auxiliary display device driver; and calling back the auxiliary display device driver with the data .
17. The computer-readable medium of claim 16 wherein the call is received from the auxiliary display device driver via a defined interface set implemented by the auxiliary display device driver, and wherein calling back the auxiliary display device driver comprises returning the data via a call back registered via the defined interface set.
18. The computer-readable medium of claim 16 having further computer-executable instructions comprising, performing security checks related to the command.
19. The computer-readable medium of claim 16 having further computer-executable instructions comprising, determining whether a user may interact with an auxiliary display device via the auxiliary display device driver based on user identification information and a current operating mode.
20. The computer-readable medium of claim 19 wherein the current operating mode may be changed to allow different types of access to the device, and wherein the current operating mode corresponds to one of: a single user mode, a multiple users mode, a mode for a current device user that has data on the device, and a mode that allows access to a current console user of a host computer system on which the auxiliary display device driver runs.
PCT/US2006/033820 2005-08-31 2006-08-29 Auxiliary display device driver interface WO2007027743A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN2006800313086A CN101253470B (en) 2005-08-31 2006-08-29 Auxiliary display device driver interface
EP06790093A EP1920320A4 (en) 2005-08-31 2006-08-29 Auxiliary display device driver interface
JP2008529221A JP2009506463A (en) 2005-08-31 2006-08-29 Auxiliary display device driver interface
KR1020087004927A KR101319632B1 (en) 2005-08-31 2006-08-29 Auxiliary display device driver interface

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US71323805P 2005-08-31 2005-08-31
US60/713,238 2005-08-31
US11/410,856 US8659505B2 (en) 2005-08-31 2006-04-24 Auxiliary display device driver interface
US11/410,856 2006-04-24

Publications (1)

Publication Number Publication Date
WO2007027743A1 true WO2007027743A1 (en) 2007-03-08

Family

ID=37803384

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/033820 WO2007027743A1 (en) 2005-08-31 2006-08-29 Auxiliary display device driver interface

Country Status (6)

Country Link
US (2) US8659505B2 (en)
EP (1) EP1920320A4 (en)
JP (1) JP2009506463A (en)
KR (1) KR101319632B1 (en)
CN (1) CN101253470B (en)
WO (1) WO2007027743A1 (en)

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8749561B1 (en) 2003-03-14 2014-06-10 Nvidia Corporation Method and system for coordinated data execution using a primary graphics processor and a secondary graphics processor
US8743019B1 (en) 2005-05-17 2014-06-03 Nvidia Corporation System and method for abstracting computer displays across a host-client network
TWI303367B (en) * 2006-03-30 2008-11-21 Infoaction Technology Inc Management system for usb audio device cluster
US8775704B2 (en) * 2006-04-05 2014-07-08 Nvidia Corporation Method and system for communication between a secondary processor and an auxiliary display subsystem of a notebook
US9195428B2 (en) * 2006-04-05 2015-11-24 Nvidia Corporation Method and system for displaying data from auxiliary display subsystem of a notebook on a main display of the notebook
US8629814B2 (en) 2006-09-14 2014-01-14 Quickbiz Holdings Limited Controlling complementary bistable and refresh-based displays
US8127310B1 (en) * 2007-03-26 2012-02-28 Celio Corporation Method and apparatus for dynamically switching display drivers in mobile device operating system
US7926072B2 (en) * 2007-10-01 2011-04-12 Spring Design Co. Ltd. Application programming interface for providing native and non-native display utility
US7971043B2 (en) * 2007-11-22 2011-06-28 Andes Technology Corporation Electronic system and method for changing number of operation stages of a pipeline
US8185783B2 (en) * 2007-11-22 2012-05-22 Microsoft Corporation Split user-mode/kernel-mode device driver architecture
US20090172710A1 (en) * 2007-12-28 2009-07-02 Arman Toorians Method and system for enabling a mini program on a computing device to access an auxiliary system
US8819256B2 (en) * 2008-01-16 2014-08-26 Broadcom Corporation Method and system for device property for specification of vendor specific protocol features
US8826307B2 (en) * 2008-04-18 2014-09-02 Microsoft Corporation Extensible private driver interface
US8736617B2 (en) 2008-08-04 2014-05-27 Nvidia Corporation Hybrid graphic display
US8799425B2 (en) 2008-11-24 2014-08-05 Nvidia Corporation Configuring display properties of display units on remote systems
US20100138768A1 (en) * 2008-12-02 2010-06-03 Nvidia Corporation Simplifying Configuration Of Multiple Display Units For Common Use
US9075559B2 (en) 2009-02-27 2015-07-07 Nvidia Corporation Multiple graphics processing unit system and method
US9135675B2 (en) * 2009-06-15 2015-09-15 Nvidia Corporation Multiple graphics processing unit display synchronization system and method
US8766989B2 (en) 2009-07-29 2014-07-01 Nvidia Corporation Method and system for dynamically adding and removing display modes coordinated across multiple graphics processing units
US9111325B2 (en) 2009-12-31 2015-08-18 Nvidia Corporation Shared buffer techniques for heterogeneous hybrid graphics
US20110185369A1 (en) * 2010-01-25 2011-07-28 Canon Kabushiki Kaisha Refresh of auxiliary display
US8620379B2 (en) 2010-12-06 2013-12-31 Broadcom Corporation Windows portable devices interface for Bluetooth low energy devices
US8786634B2 (en) 2011-06-04 2014-07-22 Apple Inc. Adaptive use of wireless display
US8997120B1 (en) * 2012-03-30 2015-03-31 Emc Corporation Lightweight communication channel for control of device driver components
US9075985B2 (en) * 2013-05-31 2015-07-07 Microsoft Technology Licensing, Llc Restricted transmogrifying driver platform
US9818379B2 (en) 2013-08-08 2017-11-14 Nvidia Corporation Pixel data transmission over multiple pixel interfaces
US10078481B2 (en) 2014-01-29 2018-09-18 Intel Corporation Secondary display mechanism
US10223178B2 (en) * 2017-01-23 2019-03-05 Wyse Technology L.L.C. Enabling WPD devices to be managed at the capability level
US10657245B2 (en) * 2017-03-14 2020-05-19 Wyse Technology L.L.C. Dynamically controlling access to devices
US11032136B2 (en) * 2018-02-01 2021-06-08 Microsoft Technology Licensing, Llc Discovery of network camera devices
CN111756604B (en) * 2019-03-29 2022-04-12 华为技术有限公司 Equipment coordination method, device and system
CN112069524A (en) * 2020-09-15 2020-12-11 北京字跳网络技术有限公司 Information processing method, device, equipment and storage medium
CN112860202A (en) * 2021-02-04 2021-05-28 苏州必捷网络有限公司 Method for expanding computer desktop without additional display card

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003038582A1 (en) * 2001-10-31 2003-05-08 Microsoft Corporation Selective suspension of bus devices
US20040225901A1 (en) * 2003-05-05 2004-11-11 Bear Eric Gould Method and system for auxiliary processing of information for a computing device
US20050066209A1 (en) * 2003-09-18 2005-03-24 Kee Martin J. Portable electronic device having high and low power processors operable in a low power mode
US6919864B1 (en) * 2000-07-27 2005-07-19 Avaya Technology Corp. Display monitor

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5195176A (en) * 1991-09-09 1993-03-16 Destiny Technology Corporation Method and apparatus to enhance laser printer speed and functionality
US5343404A (en) * 1992-11-12 1994-08-30 Maritec Corp. Precision digital multimeter and waveform synthesizer for multi-signals with distorted waveforms embedded in noise
US5515081A (en) * 1993-11-30 1996-05-07 Borland International, Inc. System and methods for improved storage and processing of BITMAP images
JPH10319139A (en) 1997-05-15 1998-12-04 Naotaka Kato Time-displaying device and method
US7152211B1 (en) * 2001-01-30 2006-12-19 Microsoft Corporation Resolution independent theming
JP2003008736A (en) * 2001-06-22 2003-01-10 Pioneer Electronic Corp Portable information terminal
US7619633B2 (en) * 2002-06-27 2009-11-17 Microsoft Corporation Intelligent caching data structure for immediate mode graphics
US8763061B2 (en) * 2002-02-13 2014-06-24 Motorola Mobility Llc Correlation of tuned channel information with internet web addresses
MXPA04009699A (en) * 2002-04-04 2004-12-13 Gen Instrument Corp Method and apparatus for displaying graphics on an auxiliary display device using low level graphics drivers.
US20040051732A1 (en) * 2002-07-02 2004-03-18 La Classe Locations, Inc. Digital project management system
US7739693B2 (en) * 2002-11-25 2010-06-15 Sap Ag Generic application program interface for native drivers
US20070288715A1 (en) * 2004-06-14 2007-12-13 Rok Productions Limited Media Player

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6919864B1 (en) * 2000-07-27 2005-07-19 Avaya Technology Corp. Display monitor
WO2003038582A1 (en) * 2001-10-31 2003-05-08 Microsoft Corporation Selective suspension of bus devices
US20040225901A1 (en) * 2003-05-05 2004-11-11 Bear Eric Gould Method and system for auxiliary processing of information for a computing device
US20050066209A1 (en) * 2003-09-18 2005-03-24 Kee Martin J. Portable electronic device having high and low power processors operable in a low power mode

Also Published As

Publication number Publication date
EP1920320A1 (en) 2008-05-14
CN101253470A (en) 2008-08-27
US20070046562A1 (en) 2007-03-01
US8659505B2 (en) 2014-02-25
CN101253470B (en) 2013-01-02
KR101319632B1 (en) 2013-10-22
EP1920320A4 (en) 2009-01-07
JP2009506463A (en) 2009-02-12
KR20080037063A (en) 2008-04-29
US20140196058A1 (en) 2014-07-10

Similar Documents

Publication Publication Date Title
US8659505B2 (en) Auxiliary display device driver interface
US7802022B2 (en) Generic USB drivers
US7631270B2 (en) Network connectivity and wireless status in a notification area
US7770182B2 (en) Event routing model for an extensible editor
US7093034B2 (en) Method and apparatus for input management having a plurality of input provider types wherein staging area holds and allows access by external components
US8250518B2 (en) Per user file associations
US20080005371A1 (en) Plug-And-Play Device And Method Of Using The Same
US20070198946A1 (en) Auxiliary display sidebar integration
EP1662385A2 (en) Self-installing computer peripherals
US9092239B2 (en) Configuring user interfaces in electronic devices
US9223733B2 (en) Bidi extension for connected devices
JP2007523413A (en) Electronic content processing system and method
US20130081010A1 (en) Template and server content download using protocol handlers
US8051191B2 (en) Ethernet extensibility
US20070118658A1 (en) User selectable management alert format
US10862757B2 (en) Isolating a redirected biometric device to a remote session
US7191263B2 (en) Enhanced input using packet switching over a PS/2 or other interface

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200680031308.6

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2006790093

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 1020087004927

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 2008529221

Country of ref document: JP

Ref document number: 1834/DELNP/2008

Country of ref document: IN

NENP Non-entry into the national phase

Ref country code: DE