EP3785430A1 - Graphical display supporting multi-location camera - Google Patents

Graphical display supporting multi-location camera

Info

Publication number
EP3785430A1
EP3785430A1 EP19729593.4A EP19729593A EP3785430A1 EP 3785430 A1 EP3785430 A1 EP 3785430A1 EP 19729593 A EP19729593 A EP 19729593A EP 3785430 A1 EP3785430 A1 EP 3785430A1
Authority
EP
European Patent Office
Prior art keywords
camera device
display
camera
computing system
location
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP19729593.4A
Other languages
German (de)
French (fr)
Other versions
EP3785430B1 (en
Inventor
Kae-Ling Jacquline GURR
Eric Paul Witt
Ryan Eugene Whitaker
Scott Schenone
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
Publication of EP3785430A1 publication Critical patent/EP3785430A1/en
Application granted granted Critical
Publication of EP3785430B1 publication Critical patent/EP3785430B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B29/00—Combinations of cameras, projectors or photographic printing apparatus with non-photographic non-optical apparatus, e.g. clocks or weapons; Cameras having the shape of other objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1601—Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays
    • G06F1/1605—Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems

Definitions

  • Video conferencing enables people to communicate in real-time through the sharing of video captured by a camera.
  • Both cameras and graphical displays may be integrated into personal computers or may take the form of separate peripheral devices. In either configuration, the camera may be located near the graphical display during conferencing so that the subject can view a remote camera feed presented by the graphical display while also being within the frame of the camera.
  • a computing system includes a display and a sensor system.
  • the sensor system includes a plurality of sensors distributed at respective locations relative to the display to detect a presence of a structural feature of a camera device.
  • the computing system further includes a computing device that receives an output from one or more sensors of the sensor system indicative of the presence of the structural feature of the camera device.
  • the computing device determines a location of the camera device relative to the display based on the output received from the one or more sensors.
  • the computing device presents a graphical user interface (GUI) window for the camera device via the display at a location that is based on the location of the camera device.
  • GUI graphical user interface
  • FIG. 1 depicts example interactions between a display device and a camera device of a computing system.
  • FIG. 2 is a flow diagram depicting an example method.
  • FIGS. 3A and 3B depict aspects of a display device and a camera device according to a first example implementation.
  • FIGS. 4A, 4B, 4C, and 4D depict aspects of a display device and a camera device according to a second example implementation.
  • FIGS. 5A, 5B, and 5C depict aspects of a display device and a camera device according to a third example implementation.
  • FIGS. 6A, 6B, 6C depict aspects of a display device and a camera device according to a fourth example implementation.
  • FIG. 7 depicts an example graphical user interface window for a camera device.
  • FIG. 8 depicts an example computing system.
  • FIG. 1 depicts example interactions between a display device 110 and a camera device 120 of a computing system 100.
  • Camera device 120 is moveable relative to display device 110, as indicated by camera 120 being moved between locations denoted as 120A, 120B, and 120C, for example.
  • Display device 110 includes a graphical display 112 (i.e., a display) defining a display region.
  • Display device 110 may present graphical content via graphical display 112.
  • graphical display 112 extends to an edge of display device 110 in which a bezel of the display device partially or fully resides behind a face of graphical display 110 when viewed from a front side of the graphical display. This configuration may enable multiple display devices to be tiled to form a larger composite graphical display while minimizing or even eliminating visibility of the bezel.
  • display device 110 may have other configurations, including a configuration in which graphical display 112 is surrounded by a more substantial bezel that places an exterior edge of graphical display 112 inward from an exterior edge of display device 110 when viewed from a front side of the graphical display.
  • the graphical content presented via graphical display 112 may include one or more graphical user interface (GUI) windows.
  • GUI graphical user interface
  • a GUI window 130 for camera device 120 may be presented via graphical display 112 at a location that is based on the location of the camera device.
  • GUI window 130 is moved between locations denoted as 130A, 130B, and 130C as camera device 120 is moved between locations 120A, 120B, and 120C, respectively.
  • camera device 120 is moved along an exterior edge of display device 110, and GUI window 130 is presented directly beside or proximate to camera device 120 via graphical display 112.
  • FIG. 1 further depicts another example interaction in which camera device
  • a GUI window 132 for camera device 122 is presented via graphical display 112 at a location that is based on the location of the camera device.
  • GUI window 132 is moved between locations 132A and 132B, respectively.
  • camera device 122 is located within the display region of graphical display 112, it is possible to present graphical content that fully surrounds or partially surrounds camera device 112.
  • FIG. 2 is a flow diagram depicting an example method 200.
  • Method 200 may be performed by a computing system that includes programming to implement the functionality described above with reference to FIG. 1. Additional aspects of a computing system are described with reference to FIG. 8.
  • method 200 includes receiving an output from one or more sensors of a sensor system indicative of a presence of a structural feature of a camera device.
  • the sensor system may include a plurality of sensors distributed at respective locations relative to a graphical display to detect the presence of the structural feature of the camera device.
  • the structural feature of the camera device may be detected through magnetic or capacitive sensing, or through connection of an electronic connector of the camera device to a corresponding electronic connector of the display device. Examples of these various sensing techniques are described in further detail with reference to FIGS. 3-6.
  • Each sensor of the sensor system may output a corresponding sensor signal at 210 that represents a measurement of a physical parameter.
  • a signal may be output by a sensor of the sensor system only upon satisfaction of a particular condition, such as the sensor detecting a presence of the structural feature of the camera device.
  • a signal output by a sensor of the sensor system may take the form of a time-varying signal that varies responsive to a presence of the structural feature of the camera device.
  • the output from each sensor may be received over a wired or wireless interface.
  • the output received from a sensor may be compared to a threshold value or condition to determine whether the output indicates a presence of the structural feature of the camera device. This threshold value or condition may be pre-established, and may be stored as data at a computer-readable data storage machine, for example.
  • method 200 includes determining a location of the camera device relative to the display based on the output received from the one or more sensors of the sensor system.
  • Each sensor of the sensor system has a respective location relative to the graphical display, and the output of that sensor may be attributed to the location of that sensor based on a pre-established relationship between the location of the sensor and an interface over which the output of that sensor is received. This pre-established relationship may be stored as data at a computer-readable data storage machine, for example.
  • method 200 includes presenting a GUI window for the camera device via the graphical display at a location that is based on the location of the camera device.
  • the GUI window may include one or more of (1) a local camera feed received from the camera device at 216, (2) a remote camera feed received from a remote camera device at 218, (3) one or more graphical elements corresponding to user controls, and/or (4) other human- readable information in the form of text, graphical icons, etc.
  • An example of a GUI window for a camera device is described in further detail with reference to FIG. 7.
  • the GUI window presented at 214 may occupy a limited sub-region of the graphical display, as depicted in FIG. 1 with reference to GUI windows 130 and 132.
  • two or more GUI windows may be presented for the camera device, e.g. one for each camera of two or more cameras being used for a teleconference.
  • a first GUI window occupies the entire display region of the graphical display or a sub-portion of the display, and the other GUI windows each occupy only a portion of the display (e.g. a limited sub-region within the first GUI window).
  • the location, size, and/or orientation of the GUI window presented at 214 may have a pre-established spatial relationship to the location of the camera device.
  • a reference location of the GUI window e.g., a center of an exterior edge of the GUI window closest to the camera device or other suitable reference
  • the GUI window may be presented directly beside or proximate to the camera device.
  • the GUI window may partially or completely surround the camera device, and the camera device may be located at a predefined location within the GUI window, where the camera device is mounted to or resting upon the graphical display.
  • the orientation of the GUI window presented at 214 may be based on an orientation of the camera device and/or an orientation of the display device relative to a reference datum.
  • the GUI window presented via the graphical display may maintain its orientation even if the camera device changes its orientation relative to its optical axis.
  • the GUI window may change its orientation responsive to a change in an orientation of the graphical display to maintain the orientation of the GUI window relative to a global reference datum (e.g., a gravity vector) as detected by an accelerometer, inertial sensor, inclinometer, or other suitable sensor of the display device or camera device.
  • a global reference datum e.g., a gravity vector
  • the local camera feed received from the camera device (i.e., a local camera device) at 216 may be received over a wired or wireless interface of a computing system (i.e., local computing system), depending on implementation.
  • the remote camera feed received from the remote camera device at 218 may be associated with a communications session between a remote computing system of the remote camera device and a local computing system of the display device and the camera device.
  • the remote camera feed may be received via a communications network over a wired or wireless interface of the local computing system.
  • the local camera feed may be transmitted from the local computing system to the remote computing system via the communications network, over a wired or wireless interface of the local computing system.
  • Operations 210 and 212 may be repeatedly performed in combination with operation 214 to determine whether the location of the camera device has changed relative to the graphical display.
  • the location of the GUI window presented at 214 may be moved or otherwise updated responsive to a change of the location of the camera device relative to the graphical display.
  • FIG. 1 depicts the location of GUI window 130 being moved or otherwise updated from location 130A to 130B to 130C as camera device 120 is moved from location 120A to 120B to 120C along an exterior edge of graphical display 112.
  • FIG. 1 depicts the location of GUI window 132 being moved or otherwise updated from location 132A to 132B as camera device 122 is moved from location 122A to 122B within the display region of graphical display 112.
  • FIGS. 3 A and 3B depict aspects of a display device 310 and a camera device
  • display device 310 is an example of previously described display device 110
  • camera device 320 is an example of previously described camera device 120 of FIG. 1.
  • camera device 320 interfaces with display device 310 via a wired interface that takes the form of a pair of electronic connectors. A location of the camera device relative to the display device is detected via electrical interaction between the electronic connectors of the camera device and the display device.
  • camera device 320 is depicted in further detail including a device body 322, optical components 324 including a lens and an optical sensor, and a camera-side electronic connector 326.
  • Connector 326 includes a set of electrically conductive pins 328 arranged in a pin-out pattern over which electrical power, ground reference, and/or signals may be exchanged with a corresponding connector.
  • Display device 310 is also depicted in further detail in FIG. 3 A, including a graphical display 312 and a display-side electronic connector 330 located along an exterior edge 314 of the display device.
  • Connector 330 includes a set of electrically conductive pins 332 arranged in a pin-out pattern over which electrical power, ground reference, and/or signals may be exchanged with a corresponding connector, such as camera-side electronic connector 326.
  • the pin-out pattern of conductive pins 332 correspond to the pin-out pattern of camera-side connector 326, enabling electrical connections to be established between pins 332 of connector 330 and corresponding pins 328 of connector 326.
  • Display-side electronic connector 330 may be disposed within or combined with a connector port 334 that is formed within a body 336 of display device 310.
  • connector 330 may correspond to a female connector and connector 326 may correspond to a male connector of a connector pair.
  • connector 326 may correspond to a female connector and connector 330 may correspond to a male connector.
  • connectors 326 and 330 may take other suitable forms, including configurations in which connectors 326 and 330 are aligned and held in contact with each other by magnetic attraction.
  • camera device 320 and/or display device 310 may include magnetic elements located within the device body near or integrated within their respective connectors 326 and 330 that attract corresponding magnetic or ferromagnetic elements of the other device.
  • a graphical display such as graphical display 312 may extend to an edge of display device 310, which may enable multiple display devices to be tiled to form a larger composite graphical display.
  • display-side electronic connector 330 may be located behind graphical display 312 as viewed from the front of the display device.
  • display device 310 may have other configurations, including a configuration in which graphical display 312 is surrounded by a frame that displaces an exterior edge of graphical display 312 inward from an exterior edge of display device 310.
  • FIG. 3B depicts display device 310 having a plurality of display-side electronic connectors 330 distributed at respective locations 330A-330L relative to graphical display 312 by which a presence of a structural feature of camera device 320 may be detected.
  • location 330C of connector 330 may correspond to the previously depicted location 120A of camera device 120 of FIG. 1.
  • the structural feature of camera device 310 may be camera-side electronic connector 326 or electronic components within the camera device, and the sensor system includes the display-side electronic connector 330 located at 330A-330L.
  • a presence of the camera device may be detected by establishing an electrically conductive bridge between two electrical contacts of the display-side electronic connector 330 via the camera-side electronic connector 326 that interfaces with connector 330.
  • a presence of the camera device may be detected at a particular display-side electronic connector (330A-330L) without requiring that the camera device actively communicate according to a pre-established protocol.
  • the presence of the camera device may be detected by detecting a voltage, ground reference, or other electrical value that traverses two or more electrical contacts of connector 330 via connector 326 or other electrical component of the camera device.
  • One or more sensors of the sensor system of the display device may be provided to detect a change to an electrical property of each display-side electronic connector by which the location of the camera device may be determined.
  • FIGS. 4A, 4B, 4C, and 4D depict aspects of a display device 410 and a camera device 420 according to a second example implementation.
  • display device 410 is an example of previously described display device 110
  • camera device 420 is an example of previously described camera device 120 of FIG. 1.
  • a location of camera device 420 relative to display device 410 is detected via magnetic interaction between the camera device and the display device.
  • FIG. 4A depicts display device 410 including a graphical display 412.
  • Display device 410 further includes a sensor system 414 that is distributed along an exterior edge 416 of the display device.
  • graphical display 412 may extend completely or nearly to an edge of display device 410 (e.g., in the case of a thin or rear-mounted bezel), which may enable multiple display devices to be tiled to form a larger composite display.
  • sensor system 414 may be located behind graphical display 412 as viewed from the front of the display device.
  • display device 410 may have other configurations, including a configuration in which graphical display 412 is surrounded by a more substantial bezel that displaces an exterior edge of graphical display 412 inward from exterior edge 414 of the display device. In this configuration, sensor system 414 may be located within the frame of display device 410.
  • FIG. 4B depicts camera device 420 including a device body 422, optical components 424 including a lens and an optical sensor, and a camera-side magnetically- interactive element 426.
  • Element 426 may take the form of a magnet or a ferromagnetic material.
  • display device 410 is also depicted in further detail, including aspects of sensor system 414.
  • Sensor system 414 may include a set of barrel magnets 430 located along exterior edge 414 of graphical display 412 that rotate responsive to the presence of the camera-side magnetically-interactive element 426 of camera device 420. Each barrel magnet 430 may rotate about an axis 432 that is parallel to exterior edge 414.
  • Sensor system 414 may further include a set of one or more display-side magnetically-interactive elements 434 that urge the set of barrel magnets toward a first rotational position in the absence of camera device 420.
  • Element 434 may take the form of a magnet or a ferromagnetic material.
  • FIGS. 4C and 4D depict aspects of sensor system 414 in further detail.
  • display-side magnetically-interactive element 434 is initially urging barrel magnet 430 toward a first rotational position.
  • Barrel magnet 430 may have positive and negative poles that are separated by a boundary 440 that is parallel to axis 432.
  • camera- side magnetically-interactive element 426 is approaching sensor system 414, but not yet within range to be detected by the sensor system.
  • camera 420 is mounted to exterior edge 414 of display device 410, and element 426 is within detection range of sensor system 414.
  • Element 426 causes rotation of barrel magnet 430 as indicated by a change of position of boundary 440 due to the magnetic attraction of element 426 exceeding the magnetic attraction of element 434.
  • sensor system 414 may include one or more transducers 442 (e.g., Hall effect sensors or other suitable sensors) that vary an output voltage responsive to rotation of one or more of the plurality of barrel magnets 430.
  • the barrel magnets may form part of the sensor system.
  • barrel magnets 430 may be omitted, and transducers 442 may be distributed along the exterior edge of the display device to detect a presence of element 426 as a magnetic element.
  • advantages of the barrel magnets include their ability to secure the camera device to the display device as well as the ability to secure multiple instances of the display device to each other to form a composite graphical display.
  • an angular rotation and/or position of barrel magnets 430 about axis 432 may be detected by respective potentiometers 440 as sensors of the sensor system.
  • optical sensing by a plurality of sensors of the sensor system may be used to detect an angular rotation and/or position of barrel magnets 430 about axis 432.
  • FIGS. 5A, 5B, 5C depict aspects of a display device 510 and a camera device
  • display device 510 is an example of previously described display device 110
  • camera device 522 is an example of previously described camera device 122 of FIG. 1.
  • a location of camera device 522 relative to display device 510 is detected via capacitive interaction between the camera device and the display device.
  • Display device 510 includes a capacitive graphical display 512.
  • a structural feature of camera device 522 in the form of a capacitive marker interfaces with the capacitive graphical display.
  • Camera device 522 may be moved between locations (e.g., 522A and 522B) within a display region of capacitive graphical display 512.
  • a location and an identity of the camera device may be detected based on the capacitive marker contacting the capacitive graphical display.
  • the capacitive marker may be sufficiently unique in shape and/or size to serve as an identifier that the object contacting the capacitive graphical display is a camera device.
  • FIG. 5 A depicts capacitive graphical display 512 including a capacitive array of capacitive sensors distributed across the display region of the graphical display.
  • a face of graphical display 512 is formed of a transparent glass or other suitable material, and the capacitive array resides on an opposite side of the face of the graphical display.
  • the capacitive array may detect capacitively-interactive objects physically contacting the face of graphical display 512, such as a finger, stylus, or a capacitive marker of camera device 522.
  • FIG. 5B depicts a front side of camera device 522 in further detail, including a device body 524 and optical components 526 including a lens and an optical sensor.
  • FIG. 5C depicts a rear side of camera device 522 in further detail, including device body 524 upon which a capacitive marker 528 is provided.
  • Capacitive marker 528 upon contacting a face of graphical display 512, may be recognized via the capacitive array as belonging to camera device 522.
  • a capacitive marker may have a shape or form that unambiguously indicates an orientation of the camera device relative to the display device. It will be understood that a capacitive marker may take various forms, and that capacitive marker 528 is an example of a capacitive marker.
  • the particular capacitive marker that is chosen for a camera device may be pre-established and stored as a data item in a computer- readable data storage machine, which enables that capacitive marker to be referenced for detection of the camera device.
  • camera device 522 may be mounted to a face of graphical display 512 by magnetic interaction between camera device 522 and display device 510.
  • camera device 522 and/or display device 510 may include a magnetic element and the other device may include a magnetically- interactive element in the form of a magnet or ferromagnetic material.
  • the display device may include an array of magnets or a layer or array of a ferromagnetic material that is distributed across graphical display 512 (e.g. behind the graphical display) to which camera device 522 is attracted.
  • FIGS. 6A, 6B, 6C depict aspects of previously described display device 510 and a camera device 622 according to a fourth example implementation.
  • Display device 510 includes capacitive graphical display 512 as previously described with reference to FIG. 5.
  • Camera device 622 is an example of previously described camera device 122 of FIG. 1.
  • a location of camera device 622 relative to display device 510 is again detected via capacitive interaction between the camera device and the display device.
  • Camera device 622 includes a device body 624 having a body portion 626 that overlaps with a portion of the capacitive graphical display 512. Camera device 622 further includes optical components 628 including a lens and an optical sensor. FIG. 6B depicts a rear view of camera device 622.
  • An external surface of body portion 626 includes a capacitive marker 630 that contacts capacitive graphical display 512 when the camera device is mounted to the display device.
  • a capacitive marker may have a shape or form that unambiguously indicates an orientation of the camera device relative to the display device. It will be understood that a capacitive marker may take various forms, and that capacitive marker 630 is an example of a capacitive marker.
  • the particular capacitive marker that is chosen for a camera device may be pre-established and stored as a data item in a computer-readable data storage machine, which enables that capacitive marker to be referenced for detection of the camera device.
  • FIG. 6C depicts a side view of camera device 622 mounted along an exterior edge 610 of display device 510.
  • Camera device 622 may be moved along an exterior edge of display device 510. The location and identity of the camera device may be detected based on capacitive marker 630 that contacts capacitive graphical display 512.
  • Device body 624 may further include another body portion 632 that opposes body portion 624 to facilitate mounting of camera device 622 to display device 510.
  • FIG. 7 depicts an example GUI window 700 for a camera device.
  • GUI window 700 may include one or more of a local camera feed 710 that is received from a local camera device of a local computing system, a remote camera feed 712 received from a remote camera device, one or more graphical elements corresponding to user controls 714, and/or human-readable information 716 in the form of text, graphical icons, etc.
  • the methods and processes described herein may be tied to a computing system of one or more computing devices.
  • such methods and processes may be implemented as a computer-application program or service, an application-programming interface (API), a library, and/or other computer- program product.
  • API application-programming interface
  • FIG. 8 schematically shows an example of a computing system 800 that can enact one or more of the methods and processes described above.
  • Computing system 800 is shown in simplified form.
  • Computing system 800 may take the form of one or more personal computers, server computers, tablet computers, home-entertainment computers, network computing devices, gaming devices, mobile computing devices, mobile communication devices (e.g., smart phone), and/or other computing devices.
  • Computing system 800 includes a logic machine 810 and a data storage machine 812.
  • Computing system 800 may optionally include a display subsystem 814, input subsystem 816, communication subsystem 820, camera device 822, and/or other components not shown in FIG. 8.
  • Logic machine 810 includes one or more physical devices configured to execute instructions.
  • the logic machine may be configured to execute instructions that are part of one or more applications, services, programs, routines, libraries, objects, components, data structures, or other logical constructs.
  • Such instructions may be implemented to perform a task, implement a data type, transform the state of one or more components, achieve a technical effect, or otherwise arrive at a desired result.
  • the logic machine may include one or more processors configured to execute software instructions. Additionally or alternatively, the logic machine may include one or more hardware or firmware logic machines configured to execute hardware or firmware instructions. Processors of the logic machine may be single-core or multi-core, and the instructions executed thereon may be configured for sequential, parallel, and/or distributed processing. Individual components of the logic machine optionally may be distributed among two or more separate devices, which may be remotely located and/or configured for coordinated processing. Aspects of the logic machine may be virtualized and executed by remotely accessible, networked computing devices configured in a cloud-computing configuration. [0052] Storage machine 812 includes one or more physical devices configured to hold instructions executable by the logic machine to implement the methods and processes described herein. When such methods and processes are implemented, the state of storage machine 812 may be transformed— e.g., to hold different data.
  • Storage machine 812 may include removable and/or built-in devices.
  • Storage machine 812 may include optical memory (e.g., CD, DVD, HD-DVD, Blu-Ray Disc, etc.), semiconductor memory (e.g., RAM, EPROM, EEPROM, etc.), and/or magnetic memory (e.g., hard-disk drive, floppy-disk drive, tape drive, MRAM, etc.), among others.
  • Storage machine ?? may include volatile, nonvolatile, dynamic, static, read/write, read-only, random-access, sequential-access, location-addressable, file-addressable, and/or content- addressable devices.
  • storage machine 812 includes one or more physical devices.
  • aspects of the instructions described herein alternatively may be propagated by a communication medium (e.g., an electromagnetic signal, an optical signal, etc.) that is not held by a physical device for a finite duration.
  • a communication medium e.g., an electromagnetic signal, an optical signal, etc.
  • logic machine 810 and storage machine 812 may be integrated together into one or more hardware-logic components.
  • Such hardware-logic components may include field-programmable gate arrays (FPGAs), program- and application-specific integrated circuits (PASIC / ASICs), program- and application-specific standard products (PSSP / ASSPs), system-on-a-chip (SOC), and complex programmable logic devices (CPLDs), for example.
  • FPGAs field-programmable gate arrays
  • PASIC / ASICs program- and application-specific integrated circuits
  • PSSP / ASSPs program- and application-specific standard products
  • SOC system-on-a-chip
  • CPLDs complex programmable logic devices
  • module may be used to describe an aspect of computing system 800 implemented to perform a particular function.
  • a module, program, or engine may be instantiated via logic machine 810 executing instructions held by storage machine 812. It will be understood that different modules, programs, and/or engines may be instantiated from the same application, service, code block, object, library, routine, API, function, etc. Likewise, the same module, program, and/or engine may be instantiated by different applications, services, code blocks, objects, routines, APIs, functions, etc.
  • module may encompass individual or groups of executable files, data files, libraries, drivers, scripts, database records, etc.
  • display subsystem 814 may be used to present a visual representation of data held by storage machine 812.
  • This visual representation may take the form of a graphical user interface (GET).
  • GET graphical user interface
  • Display subsystem 814 may include one or more display devices utilizing virtually any type of technology. Such display devices may be combined with logic machine 810 and/or storage machine 812 in a shared enclosure, or such display devices may be peripheral display devices.
  • input subsystem 816 may comprise or interface with a sensor system for detecting a presence of camera device 820.
  • Input subsystem 816 may further include one or more user-input devices such as a keyboard, mouse, touch screen, or game controller.
  • the input subsystem may comprise or interface with selected natural user input (NUI) componentry.
  • NUI natural user input
  • Such componentry may be integrated or peripheral, and the transduction and/or processing of input actions may be handled on- or off-board.
  • Examples of other sensors of input subsystem 816 may include a microphone, an infrared, color, stereoscopic, and/or depth camera, a head tracker, eye tracker, accelerometer, inertial sensor, inclinometer, and/or gyroscope for motion / orientation detection and/or intent recognition, as well as electric-field sensing componentry for assessing brain activity.
  • communication subsystem 818 may be configured to communicatively couple computing system 800 with one or more other computing devices.
  • Communication subsystem 800 may include wired and/or wireless communication devices compatible with one or more different communication protocols.
  • the communication subsystem may be configured for communication via a wireless telephone network, or a wired or wireless local- or wide-area network.
  • the communication subsystem may allow computing system 800 to send and/or receive messages to and/or from other devices via a network such as the Internet.
  • FIG. 10 Another example provides a computing system comprising a display; a sensor system including a plurality of sensors distributed at respective locations relative to the display to detect a presence of a structural feature of a camera device; and a computing device programmed to: receive an output from one or more sensors of the sensor system indicative of the presence of the structural feature of the camera device; determine a location of the camera device relative to the display based on the output received from the one or more sensors; and present a graphical user interface (GUI) window for the camera device via the display at a location that is based on the location of the camera device.
  • GUI graphical user interface
  • the structural feature of the camera device includes a capacitive marker on an external surface of the camera device, and the display comprises a capacitive array as the sensor system.
  • the camera device is mounted to an enclosure of the display and includes a body portion that overlaps with and contacts a portion of the display in which the body portion has the external surface that includes the capacitive marker.
  • the structural feature of the camera device includes one or more magnetic elements; and the plurality of sensors include one or more sensors configured to vary an output voltage responsive to the presence of the one or more magnets of the camera device.
  • the structural feature of the camera device includes one or more magnetically-interactive elements;
  • the sensor system includes a plurality of barrel magnets located along a perimeter of the display that rotate responsive to the presence of the one or more magnetically-interactive elements of the camera device;
  • the plurality of sensors detect a rotation of each of the plurality of barrel magnets.
  • the plurality of sensors include one or more transducers that vary an output voltage responsive to rotation of one or more of the plurality of barrel magnets.
  • the structural feature of the camera device is a camera-side electronic connector of the camera device; and the sensor system includes a plurality of display-side electronic connectors distributed along an exterior edge of the display.
  • the location of the GUI is presented directly beside or proximate to the location of the camera device.
  • the computing device is further programmed to receive a camera feed from the camera device and to present the camera feed via the GUI window.
  • the computing device is further programmed to present one or more user controls for the camera device via the GUI window.
  • the computing device is further programmed to: receive a camera feed from the camera device and to transmit the camera feed to a remote computing system; and receive a remote camera feed from the remote computing system and to present the remote camera feed via the GUI window.
  • the computing device is further programmed to: move the location of the GUI window presented via the display responsive to a change of the location of the camera device relative to the display determined based on an output received from the sensor system.
  • the GUI window is a sub-region of the display.
  • the computing system further comprises the camera device
  • Another example provides a method performed by a computing system, the method comprising receiving an output from one or more sensors of a sensor system indicative of a presence of a structural feature of a camera device relative to a display; determining a location of the camera device relative to the display based on the output received from the one or more sensors; and presenting a graphical user interface (GUI) window for the camera device via the display at a location that is based on the location of the camera device.
  • the structural feature of the camera device includes a capacitive marker on an external surface of the camera device; and the display comprises a capacitive array as the sensor system.
  • the structural feature of the camera device includes one or more magnetic elements; and the plurality of sensors include one or more sensors configured to vary an output voltage responsive to the presence of the one or more magnets of the camera device.
  • the structural feature of the camera device includes one or more magnetically-interactive elements; the sensor system includes a plurality of barrel magnets located along a perimeter of the display that rotate responsive to the presence of the one or more magnetically- interactive elements of the camera device; and the plurality of sensors detect a rotation of each of the plurality of barrel magnets.
  • the structural feature of the camera device is a camera-side electronic connector of the camera device; and the sensor system includes a plurality of display-side electronic connectors distributed along an exterior edge of the display.
  • FIG. 1 Another example provides a computing system comprising a display; a camera device including a structural feature that is one or more of capacitively-interactive and magnetically-interactive; a sensor system including a plurality of sensors distributed at respective locations relative to the display to detect a presence of the structural feature of the camera device; a logic machine; and a data storage machine having instructions stored thereon executable by the logic machine to: receive an output from one or more sensors of the sensor system indicative of the presence of the structural feature of the camera device; determine a location of the camera device relative to the display based on the output received from the one or more sensors; and present a graphical user interface (GUI) window for the camera device via the display at a location that is directly beside or proximate to the location of the camera device, the GUI window being a sub-region of the display and containing a camera feed of the camera device and/or user controls for the camera device.
  • GUI graphical user interface

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A computing system includes a display and a sensor system. The sensor system includes a plurality of sensors distributed at respective locations relative to the display to detect a presence of a structural feature of a camera device. The computing system further includes a computing device that receives an output from one or more sensors of the sensor system indicative of the presence of the structural feature of the camera device. The computing device determines a location of the camera device relative to the display based on the output received from the one or more sensors. The computing device presents a graphical user interface (GUI) window for the camera device via the display at a location that is based on the location of the camera device.

Description

GRAPHICAL DISPLAY SUPPORTING MULTI-LOCATION CAMERA
BACKGROUND
[0001] Video conferencing enables people to communicate in real-time through the sharing of video captured by a camera. Both cameras and graphical displays may be integrated into personal computers or may take the form of separate peripheral devices. In either configuration, the camera may be located near the graphical display during conferencing so that the subject can view a remote camera feed presented by the graphical display while also being within the frame of the camera.
SUMMARY
[0002] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure.
[0003] According to an aspect of the present disclosure, a computing system includes a display and a sensor system. The sensor system includes a plurality of sensors distributed at respective locations relative to the display to detect a presence of a structural feature of a camera device. The computing system further includes a computing device that receives an output from one or more sensors of the sensor system indicative of the presence of the structural feature of the camera device. The computing device determines a location of the camera device relative to the display based on the output received from the one or more sensors. The computing device presents a graphical user interface (GUI) window for the camera device via the display at a location that is based on the location of the camera device.
BRIEF DESCRIPTION OF THE DRAWINGS
[0004] FIG. 1 depicts example interactions between a display device and a camera device of a computing system.
[0005] FIG. 2 is a flow diagram depicting an example method.
[0006] FIGS. 3A and 3B depict aspects of a display device and a camera device according to a first example implementation.
[0007] FIGS. 4A, 4B, 4C, and 4D depict aspects of a display device and a camera device according to a second example implementation. [0008] FIGS. 5A, 5B, and 5C depict aspects of a display device and a camera device according to a third example implementation.
[0009] FIGS. 6A, 6B, 6C depict aspects of a display device and a camera device according to a fourth example implementation.
[0010] FIG. 7 depicts an example graphical user interface window for a camera device.
[0011] FIG. 8 depicts an example computing system.
DETAILED DESCRIPTION
[0012] FIG. 1 depicts example interactions between a display device 110 and a camera device 120 of a computing system 100. Camera device 120 is moveable relative to display device 110, as indicated by camera 120 being moved between locations denoted as 120A, 120B, and 120C, for example.
[0013] Display device 110 includes a graphical display 112 (i.e., a display) defining a display region. Display device 110 may present graphical content via graphical display 112. In this example, graphical display 112 extends to an edge of display device 110 in which a bezel of the display device partially or fully resides behind a face of graphical display 110 when viewed from a front side of the graphical display. This configuration may enable multiple display devices to be tiled to form a larger composite graphical display while minimizing or even eliminating visibility of the bezel. However, display device 110 may have other configurations, including a configuration in which graphical display 112 is surrounded by a more substantial bezel that places an exterior edge of graphical display 112 inward from an exterior edge of display device 110 when viewed from a front side of the graphical display.
[0014] The graphical content presented via graphical display 112 may include one or more graphical user interface (GUI) windows. For example, a GUI window 130 for camera device 120 may be presented via graphical display 112 at a location that is based on the location of the camera device. In FIG. 1, GUI window 130 is moved between locations denoted as 130A, 130B, and 130C as camera device 120 is moved between locations 120A, 120B, and 120C, respectively. In this example, camera device 120 is moved along an exterior edge of display device 110, and GUI window 130 is presented directly beside or proximate to camera device 120 via graphical display 112.
[0015] FIG. 1 further depicts another example interaction in which camera device
122 is mounted to or rests upon display device 110 within a display region defined by graphical display 112. In this example, camera device 122 is again moveable relative to display device 110, as indicated by camera 122 being moved between locations denoted as 122A and 122B. Further, a GUI window 132 for camera device 122 is presented via graphical display 112 at a location that is based on the location of the camera device. Here, as camera device 122 is moved between locations 122A and 122B, GUI window 132 is moved between locations 132A and 132B, respectively. In this example, because camera device 122 is located within the display region of graphical display 112, it is possible to present graphical content that fully surrounds or partially surrounds camera device 112.
[0016] FIG. 2 is a flow diagram depicting an example method 200. Method 200 may be performed by a computing system that includes programming to implement the functionality described above with reference to FIG. 1. Additional aspects of a computing system are described with reference to FIG. 8.
[0017] At 210, method 200 includes receiving an output from one or more sensors of a sensor system indicative of a presence of a structural feature of a camera device. The sensor system may include a plurality of sensors distributed at respective locations relative to a graphical display to detect the presence of the structural feature of the camera device. In at least some implementations, the structural feature of the camera device may be detected through magnetic or capacitive sensing, or through connection of an electronic connector of the camera device to a corresponding electronic connector of the display device. Examples of these various sensing techniques are described in further detail with reference to FIGS. 3-6.
[0018] Each sensor of the sensor system may output a corresponding sensor signal at 210 that represents a measurement of a physical parameter. In some examples, a signal may be output by a sensor of the sensor system only upon satisfaction of a particular condition, such as the sensor detecting a presence of the structural feature of the camera device. In other examples, a signal output by a sensor of the sensor system may take the form of a time-varying signal that varies responsive to a presence of the structural feature of the camera device. The output from each sensor may be received over a wired or wireless interface. The output received from a sensor may be compared to a threshold value or condition to determine whether the output indicates a presence of the structural feature of the camera device. This threshold value or condition may be pre-established, and may be stored as data at a computer-readable data storage machine, for example.
[0019] At 212, method 200 includes determining a location of the camera device relative to the display based on the output received from the one or more sensors of the sensor system. Each sensor of the sensor system has a respective location relative to the graphical display, and the output of that sensor may be attributed to the location of that sensor based on a pre-established relationship between the location of the sensor and an interface over which the output of that sensor is received. This pre-established relationship may be stored as data at a computer-readable data storage machine, for example.
[0020] At 214, method 200 includes presenting a GUI window for the camera device via the graphical display at a location that is based on the location of the camera device. The GUI window may include one or more of (1) a local camera feed received from the camera device at 216, (2) a remote camera feed received from a remote camera device at 218, (3) one or more graphical elements corresponding to user controls, and/or (4) other human- readable information in the form of text, graphical icons, etc. An example of a GUI window for a camera device is described in further detail with reference to FIG. 7.
[0021] The GUI window presented at 214 may occupy a limited sub-region of the graphical display, as depicted in FIG. 1 with reference to GUI windows 130 and 132. In some implementations, two or more GUI windows may be presented for the camera device, e.g. one for each camera of two or more cameras being used for a teleconference. In such examples, a first GUI window occupies the entire display region of the graphical display or a sub-portion of the display, and the other GUI windows each occupy only a portion of the display (e.g. a limited sub-region within the first GUI window).
[0022] The location, size, and/or orientation of the GUI window presented at 214 may have a pre-established spatial relationship to the location of the camera device. In at least some implementations, a reference location of the GUI window (e.g., a center of an exterior edge of the GUI window closest to the camera device or other suitable reference) may be presented at or within a predefined spatial area of the location of the camera device or an edge of the graphical display proximate to the location of the camera device (e.g. within a predefined quantity of pixels from the camera device). As an example, the GUI window may be presented directly beside or proximate to the camera device. As another example, the GUI window may partially or completely surround the camera device, and the camera device may be located at a predefined location within the GUI window, where the camera device is mounted to or resting upon the graphical display.
[0023] The orientation of the GUI window presented at 214 may be based on an orientation of the camera device and/or an orientation of the display device relative to a reference datum. As an example, the GUI window presented via the graphical display may maintain its orientation even if the camera device changes its orientation relative to its optical axis. As another example, the GUI window may change its orientation responsive to a change in an orientation of the graphical display to maintain the orientation of the GUI window relative to a global reference datum (e.g., a gravity vector) as detected by an accelerometer, inertial sensor, inclinometer, or other suitable sensor of the display device or camera device.
[0024] The local camera feed received from the camera device (i.e., a local camera device) at 216 may be received over a wired or wireless interface of a computing system (i.e., local computing system), depending on implementation. The remote camera feed received from the remote camera device at 218 may be associated with a communications session between a remote computing system of the remote camera device and a local computing system of the display device and the camera device. The remote camera feed may be received via a communications network over a wired or wireless interface of the local computing system. The local camera feed may be transmitted from the local computing system to the remote computing system via the communications network, over a wired or wireless interface of the local computing system.
[0025] Operations 210 and 212 may be repeatedly performed in combination with operation 214 to determine whether the location of the camera device has changed relative to the graphical display. At 220, the location of the GUI window presented at 214 may be moved or otherwise updated responsive to a change of the location of the camera device relative to the graphical display. As an example, FIG. 1 depicts the location of GUI window 130 being moved or otherwise updated from location 130A to 130B to 130C as camera device 120 is moved from location 120A to 120B to 120C along an exterior edge of graphical display 112. As another example, FIG. 1 depicts the location of GUI window 132 being moved or otherwise updated from location 132A to 132B as camera device 122 is moved from location 122A to 122B within the display region of graphical display 112.
[0026] FIGS. 3 A and 3B depict aspects of a display device 310 and a camera device
320 according to a first example implementation. In FIGS. 3 A and 3B, display device 310 is an example of previously described display device 110, and camera device 320 is an example of previously described camera device 120 of FIG. 1. In this example implementation, camera device 320 interfaces with display device 310 via a wired interface that takes the form of a pair of electronic connectors. A location of the camera device relative to the display device is detected via electrical interaction between the electronic connectors of the camera device and the display device.
[0027] In FIG. 3 A, camera device 320 is depicted in further detail including a device body 322, optical components 324 including a lens and an optical sensor, and a camera-side electronic connector 326. Connector 326 includes a set of electrically conductive pins 328 arranged in a pin-out pattern over which electrical power, ground reference, and/or signals may be exchanged with a corresponding connector.
[0028] Display device 310 is also depicted in further detail in FIG. 3 A, including a graphical display 312 and a display-side electronic connector 330 located along an exterior edge 314 of the display device. Connector 330 includes a set of electrically conductive pins 332 arranged in a pin-out pattern over which electrical power, ground reference, and/or signals may be exchanged with a corresponding connector, such as camera-side electronic connector 326. The pin-out pattern of conductive pins 332 correspond to the pin-out pattern of camera-side connector 326, enabling electrical connections to be established between pins 332 of connector 330 and corresponding pins 328 of connector 326.
[0029] Display-side electronic connector 330 may be disposed within or combined with a connector port 334 that is formed within a body 336 of display device 310. In this configuration, connector 330 may correspond to a female connector and connector 326 may correspond to a male connector of a connector pair. In another example, connector 326 may correspond to a female connector and connector 330 may correspond to a male connector. However, it will be understood that connectors 326 and 330 may take other suitable forms, including configurations in which connectors 326 and 330 are aligned and held in contact with each other by magnetic attraction. For example, camera device 320 and/or display device 310 may include magnetic elements located within the device body near or integrated within their respective connectors 326 and 330 that attract corresponding magnetic or ferromagnetic elements of the other device.
[0030] As previously described with reference to FIG. 1, a graphical display, such as graphical display 312, may extend to an edge of display device 310, which may enable multiple display devices to be tiled to form a larger composite graphical display. In this configuration, display-side electronic connector 330 may be located behind graphical display 312 as viewed from the front of the display device. However, display device 310 may have other configurations, including a configuration in which graphical display 312 is surrounded by a frame that displaces an exterior edge of graphical display 312 inward from an exterior edge of display device 310.
[0031] FIG. 3B depicts display device 310 having a plurality of display-side electronic connectors 330 distributed at respective locations 330A-330L relative to graphical display 312 by which a presence of a structural feature of camera device 320 may be detected. For example, location 330C of connector 330 may correspond to the previously depicted location 120A of camera device 120 of FIG. 1.
[0032] In the example implementation of FIGS. 3 A and 3B, the structural feature of camera device 310 may be camera-side electronic connector 326 or electronic components within the camera device, and the sensor system includes the display-side electronic connector 330 located at 330A-330L. For example, a presence of the camera device may be detected by establishing an electrically conductive bridge between two electrical contacts of the display-side electronic connector 330 via the camera-side electronic connector 326 that interfaces with connector 330. In this example, a presence of the camera device may be detected at a particular display-side electronic connector (330A-330L) without requiring that the camera device actively communicate according to a pre-established protocol. Rather, the presence of the camera device may be detected by detecting a voltage, ground reference, or other electrical value that traverses two or more electrical contacts of connector 330 via connector 326 or other electrical component of the camera device. One or more sensors of the sensor system of the display device may be provided to detect a change to an electrical property of each display-side electronic connector by which the location of the camera device may be determined.
[0033] FIGS. 4A, 4B, 4C, and 4D depict aspects of a display device 410 and a camera device 420 according to a second example implementation. In FIGS. 4A, 4B, 4C, and 4D display device 410 is an example of previously described display device 110, and camera device 420 is an example of previously described camera device 120 of FIG. 1. In this example implementation, a location of camera device 420 relative to display device 410 is detected via magnetic interaction between the camera device and the display device.
[0034] FIG. 4A depicts display device 410 including a graphical display 412.
Display device 410 further includes a sensor system 414 that is distributed along an exterior edge 416 of the display device. As previously described with reference to FIG. 1, graphical display 412 may extend completely or nearly to an edge of display device 410 (e.g., in the case of a thin or rear-mounted bezel), which may enable multiple display devices to be tiled to form a larger composite display. In this configuration, sensor system 414 may be located behind graphical display 412 as viewed from the front of the display device. However, display device 410 may have other configurations, including a configuration in which graphical display 412 is surrounded by a more substantial bezel that displaces an exterior edge of graphical display 412 inward from exterior edge 414 of the display device. In this configuration, sensor system 414 may be located within the frame of display device 410.
[0035] FIG. 4B depicts camera device 420 including a device body 422, optical components 424 including a lens and an optical sensor, and a camera-side magnetically- interactive element 426. Element 426 may take the form of a magnet or a ferromagnetic material. In FIG. 4B, display device 410 is also depicted in further detail, including aspects of sensor system 414. Sensor system 414 may include a set of barrel magnets 430 located along exterior edge 414 of graphical display 412 that rotate responsive to the presence of the camera-side magnetically-interactive element 426 of camera device 420. Each barrel magnet 430 may rotate about an axis 432 that is parallel to exterior edge 414. Sensor system 414 may further include a set of one or more display-side magnetically-interactive elements 434 that urge the set of barrel magnets toward a first rotational position in the absence of camera device 420. Element 434 may take the form of a magnet or a ferromagnetic material.
[0036] FIGS. 4C and 4D depict aspects of sensor system 414 in further detail. In
FIG. 4C, display-side magnetically-interactive element 434 is initially urging barrel magnet 430 toward a first rotational position. Barrel magnet 430 may have positive and negative poles that are separated by a boundary 440 that is parallel to axis 432. In FIG. 4C, camera- side magnetically-interactive element 426 is approaching sensor system 414, but not yet within range to be detected by the sensor system. In FIG. 4D, camera 420 is mounted to exterior edge 414 of display device 410, and element 426 is within detection range of sensor system 414. Element 426 causes rotation of barrel magnet 430 as indicated by a change of position of boundary 440 due to the magnetic attraction of element 426 exceeding the magnetic attraction of element 434.
[0037] A variety of sensor types may be used to detect the presence of camera-side magnetically-interactive element 426 of camera device 420. As an example, sensor system 414 may include one or more transducers 442 (e.g., Hall effect sensors or other suitable sensors) that vary an output voltage responsive to rotation of one or more of the plurality of barrel magnets 430. In this example, the barrel magnets may form part of the sensor system. As another example, barrel magnets 430 may be omitted, and transducers 442 may be distributed along the exterior edge of the display device to detect a presence of element 426 as a magnetic element. However, advantages of the barrel magnets include their ability to secure the camera device to the display device as well as the ability to secure multiple instances of the display device to each other to form a composite graphical display. As yet another example, an angular rotation and/or position of barrel magnets 430 about axis 432 may be detected by respective potentiometers 440 as sensors of the sensor system. In still further examples, optical sensing by a plurality of sensors of the sensor system may be used to detect an angular rotation and/or position of barrel magnets 430 about axis 432. [0038] FIGS. 5A, 5B, 5C depict aspects of a display device 510 and a camera device
522 according to a third example implementation. In FIGS. 5A, 5B, and 5C, display device 510 is an example of previously described display device 110, and camera device 522 is an example of previously described camera device 122 of FIG. 1. In this example implementation, a location of camera device 522 relative to display device 510 is detected via capacitive interaction between the camera device and the display device.
[0039] Display device 510 includes a capacitive graphical display 512. A structural feature of camera device 522 in the form of a capacitive marker interfaces with the capacitive graphical display. Camera device 522 may be moved between locations (e.g., 522A and 522B) within a display region of capacitive graphical display 512. A location and an identity of the camera device may be detected based on the capacitive marker contacting the capacitive graphical display. For example, the capacitive marker may be sufficiently unique in shape and/or size to serve as an identifier that the object contacting the capacitive graphical display is a camera device.
[0040] FIG. 5 A depicts capacitive graphical display 512 including a capacitive array of capacitive sensors distributed across the display region of the graphical display. In a typical configuration, a face of graphical display 512 is formed of a transparent glass or other suitable material, and the capacitive array resides on an opposite side of the face of the graphical display. The capacitive array may detect capacitively-interactive objects physically contacting the face of graphical display 512, such as a finger, stylus, or a capacitive marker of camera device 522.
[0041] FIG. 5B depicts a front side of camera device 522 in further detail, including a device body 524 and optical components 526 including a lens and an optical sensor. FIG. 5C depicts a rear side of camera device 522 in further detail, including device body 524 upon which a capacitive marker 528 is provided. Capacitive marker 528, upon contacting a face of graphical display 512, may be recognized via the capacitive array as belonging to camera device 522. In some examples, a capacitive marker may have a shape or form that unambiguously indicates an orientation of the camera device relative to the display device. It will be understood that a capacitive marker may take various forms, and that capacitive marker 528 is an example of a capacitive marker. The particular capacitive marker that is chosen for a camera device may be pre-established and stored as a data item in a computer- readable data storage machine, which enables that capacitive marker to be referenced for detection of the camera device.
[0042] In at least some implementations, camera device 522 may be mounted to a face of graphical display 512 by magnetic interaction between camera device 522 and display device 510. For example, one or both of camera device 522 and/or display device 510 may include a magnetic element and the other device may include a magnetically- interactive element in the form of a magnet or ferromagnetic material. The display device may include an array of magnets or a layer or array of a ferromagnetic material that is distributed across graphical display 512 (e.g. behind the graphical display) to which camera device 522 is attracted.
[0043] FIGS. 6A, 6B, 6C depict aspects of previously described display device 510 and a camera device 622 according to a fourth example implementation. Display device 510 includes capacitive graphical display 512 as previously described with reference to FIG. 5. Camera device 622 is an example of previously described camera device 122 of FIG. 1. In this example implementation, a location of camera device 622 relative to display device 510 is again detected via capacitive interaction between the camera device and the display device.
[0044] Camera device 622 includes a device body 624 having a body portion 626 that overlaps with a portion of the capacitive graphical display 512. Camera device 622 further includes optical components 628 including a lens and an optical sensor. FIG. 6B depicts a rear view of camera device 622. An external surface of body portion 626 includes a capacitive marker 630 that contacts capacitive graphical display 512 when the camera device is mounted to the display device. In some examples, a capacitive marker may have a shape or form that unambiguously indicates an orientation of the camera device relative to the display device. It will be understood that a capacitive marker may take various forms, and that capacitive marker 630 is an example of a capacitive marker. The particular capacitive marker that is chosen for a camera device may be pre-established and stored as a data item in a computer-readable data storage machine, which enables that capacitive marker to be referenced for detection of the camera device.
[0045] FIG. 6C depicts a side view of camera device 622 mounted along an exterior edge 610 of display device 510. Camera device 622 may be moved along an exterior edge of display device 510. The location and identity of the camera device may be detected based on capacitive marker 630 that contacts capacitive graphical display 512. Device body 624 may further include another body portion 632 that opposes body portion 624 to facilitate mounting of camera device 622 to display device 510.
[0046] FIG. 7 depicts an example GUI window 700 for a camera device. GUI window 700 may include one or more of a local camera feed 710 that is received from a local camera device of a local computing system, a remote camera feed 712 received from a remote camera device, one or more graphical elements corresponding to user controls 714, and/or human-readable information 716 in the form of text, graphical icons, etc.
[0047] In at least some implementations, the methods and processes described herein may be tied to a computing system of one or more computing devices. In particular, such methods and processes may be implemented as a computer-application program or service, an application-programming interface (API), a library, and/or other computer- program product.
[0048] FIG. 8 schematically shows an example of a computing system 800 that can enact one or more of the methods and processes described above. Computing system 800 is shown in simplified form. Computing system 800 may take the form of one or more personal computers, server computers, tablet computers, home-entertainment computers, network computing devices, gaming devices, mobile computing devices, mobile communication devices (e.g., smart phone), and/or other computing devices.
[0049] Computing system 800 includes a logic machine 810 and a data storage machine 812. Computing system 800 may optionally include a display subsystem 814, input subsystem 816, communication subsystem 820, camera device 822, and/or other components not shown in FIG. 8.
[0050] Logic machine 810 includes one or more physical devices configured to execute instructions. For example, the logic machine may be configured to execute instructions that are part of one or more applications, services, programs, routines, libraries, objects, components, data structures, or other logical constructs. Such instructions may be implemented to perform a task, implement a data type, transform the state of one or more components, achieve a technical effect, or otherwise arrive at a desired result.
[0051] The logic machine may include one or more processors configured to execute software instructions. Additionally or alternatively, the logic machine may include one or more hardware or firmware logic machines configured to execute hardware or firmware instructions. Processors of the logic machine may be single-core or multi-core, and the instructions executed thereon may be configured for sequential, parallel, and/or distributed processing. Individual components of the logic machine optionally may be distributed among two or more separate devices, which may be remotely located and/or configured for coordinated processing. Aspects of the logic machine may be virtualized and executed by remotely accessible, networked computing devices configured in a cloud-computing configuration. [0052] Storage machine 812 includes one or more physical devices configured to hold instructions executable by the logic machine to implement the methods and processes described herein. When such methods and processes are implemented, the state of storage machine 812 may be transformed— e.g., to hold different data.
[0053] Storage machine 812 may include removable and/or built-in devices. Storage machine 812 may include optical memory (e.g., CD, DVD, HD-DVD, Blu-Ray Disc, etc.), semiconductor memory (e.g., RAM, EPROM, EEPROM, etc.), and/or magnetic memory (e.g., hard-disk drive, floppy-disk drive, tape drive, MRAM, etc.), among others. Storage machine ?? may include volatile, nonvolatile, dynamic, static, read/write, read-only, random-access, sequential-access, location-addressable, file-addressable, and/or content- addressable devices.
[0054] It will be appreciated that storage machine 812 includes one or more physical devices. However, aspects of the instructions described herein alternatively may be propagated by a communication medium (e.g., an electromagnetic signal, an optical signal, etc.) that is not held by a physical device for a finite duration.
[0055] Aspects of logic machine 810 and storage machine 812 may be integrated together into one or more hardware-logic components. Such hardware-logic components may include field-programmable gate arrays (FPGAs), program- and application-specific integrated circuits (PASIC / ASICs), program- and application-specific standard products (PSSP / ASSPs), system-on-a-chip (SOC), and complex programmable logic devices (CPLDs), for example.
[0056] The terms“module,”“program,” and“engine” may be used to describe an aspect of computing system 800 implemented to perform a particular function. In some cases, a module, program, or engine may be instantiated via logic machine 810 executing instructions held by storage machine 812. It will be understood that different modules, programs, and/or engines may be instantiated from the same application, service, code block, object, library, routine, API, function, etc. Likewise, the same module, program, and/or engine may be instantiated by different applications, services, code blocks, objects, routines, APIs, functions, etc. The terms “module,” “program,” and “engine” may encompass individual or groups of executable files, data files, libraries, drivers, scripts, database records, etc.
[0057] When included, display subsystem 814 may be used to present a visual representation of data held by storage machine 812. This visual representation may take the form of a graphical user interface (GET). As the herein described methods and processes change the data held by the storage machine, and thus transform the state of the storage machine, the state of display subsystem 814 may likewise be transformed to visually represent changes in the underlying data. Display subsystem 814 may include one or more display devices utilizing virtually any type of technology. Such display devices may be combined with logic machine 810 and/or storage machine 812 in a shared enclosure, or such display devices may be peripheral display devices.
[0058] When included, input subsystem 816 may comprise or interface with a sensor system for detecting a presence of camera device 820. Input subsystem 816 may further include one or more user-input devices such as a keyboard, mouse, touch screen, or game controller. In some embodiments, the input subsystem may comprise or interface with selected natural user input (NUI) componentry. Such componentry may be integrated or peripheral, and the transduction and/or processing of input actions may be handled on- or off-board. Examples of other sensors of input subsystem 816 may include a microphone, an infrared, color, stereoscopic, and/or depth camera, a head tracker, eye tracker, accelerometer, inertial sensor, inclinometer, and/or gyroscope for motion / orientation detection and/or intent recognition, as well as electric-field sensing componentry for assessing brain activity.
[0059] When included, communication subsystem 818 may be configured to communicatively couple computing system 800 with one or more other computing devices. Communication subsystem 800 may include wired and/or wireless communication devices compatible with one or more different communication protocols. As examples, the communication subsystem may be configured for communication via a wireless telephone network, or a wired or wireless local- or wide-area network. In some embodiments, the communication subsystem may allow computing system 800 to send and/or receive messages to and/or from other devices via a network such as the Internet.
[0060] Another example provides a computing system comprising a display; a sensor system including a plurality of sensors distributed at respective locations relative to the display to detect a presence of a structural feature of a camera device; and a computing device programmed to: receive an output from one or more sensors of the sensor system indicative of the presence of the structural feature of the camera device; determine a location of the camera device relative to the display based on the output received from the one or more sensors; and present a graphical user interface (GUI) window for the camera device via the display at a location that is based on the location of the camera device. In this example or any other example disclosed herein, the structural feature of the camera device includes a capacitive marker on an external surface of the camera device, and the display comprises a capacitive array as the sensor system. In this example or any other example disclosed herein, the camera device is mounted to an enclosure of the display and includes a body portion that overlaps with and contacts a portion of the display in which the body portion has the external surface that includes the capacitive marker. In this example or any other example disclosed herein, the structural feature of the camera device includes one or more magnetic elements; and the plurality of sensors include one or more sensors configured to vary an output voltage responsive to the presence of the one or more magnets of the camera device. In this example or any other example disclosed herein, the structural feature of the camera device includes one or more magnetically-interactive elements; the sensor system includes a plurality of barrel magnets located along a perimeter of the display that rotate responsive to the presence of the one or more magnetically-interactive elements of the camera device; and
the plurality of sensors detect a rotation of each of the plurality of barrel magnets. In this example or any other example disclosed herein, the plurality of sensors include one or more transducers that vary an output voltage responsive to rotation of one or more of the plurality of barrel magnets. In this example or any other example disclosed herein, the structural feature of the camera device is a camera-side electronic connector of the camera device; and the sensor system includes a plurality of display-side electronic connectors distributed along an exterior edge of the display. In this example or any other example disclosed herein, the location of the GUI is presented directly beside or proximate to the location of the camera device. In this example or any other example disclosed herein, the computing device is further programmed to receive a camera feed from the camera device and to present the camera feed via the GUI window. In this example or any other example disclosed herein, the computing device is further programmed to present one or more user controls for the camera device via the GUI window. In this example or any other example disclosed herein, the computing device is further programmed to: receive a camera feed from the camera device and to transmit the camera feed to a remote computing system; and receive a remote camera feed from the remote computing system and to present the remote camera feed via the GUI window. In this example or any other example disclosed herein, the computing device is further programmed to: move the location of the GUI window presented via the display responsive to a change of the location of the camera device relative to the display determined based on an output received from the sensor system. In this example or any other example disclosed herein, the GUI window is a sub-region of the display. In this example or any other example disclosed herein, the computing system further comprises the camera device
[0061] Another example provides a method performed by a computing system, the method comprising receiving an output from one or more sensors of a sensor system indicative of a presence of a structural feature of a camera device relative to a display; determining a location of the camera device relative to the display based on the output received from the one or more sensors; and presenting a graphical user interface (GUI) window for the camera device via the display at a location that is based on the location of the camera device. In this example or any other example disclosed herein, the structural feature of the camera device includes a capacitive marker on an external surface of the camera device; and the display comprises a capacitive array as the sensor system. In this example or any other example disclosed herein, the structural feature of the camera device includes one or more magnetic elements; and the plurality of sensors include one or more sensors configured to vary an output voltage responsive to the presence of the one or more magnets of the camera device. In this example or any other example disclosed herein, the structural feature of the camera device includes one or more magnetically-interactive elements; the sensor system includes a plurality of barrel magnets located along a perimeter of the display that rotate responsive to the presence of the one or more magnetically- interactive elements of the camera device; and the plurality of sensors detect a rotation of each of the plurality of barrel magnets. In this example or any other example disclosed herein, the structural feature of the camera device is a camera-side electronic connector of the camera device; and the sensor system includes a plurality of display-side electronic connectors distributed along an exterior edge of the display.
[0062] Another example provides a computing system comprising a display; a camera device including a structural feature that is one or more of capacitively-interactive and magnetically-interactive; a sensor system including a plurality of sensors distributed at respective locations relative to the display to detect a presence of the structural feature of the camera device; a logic machine; and a data storage machine having instructions stored thereon executable by the logic machine to: receive an output from one or more sensors of the sensor system indicative of the presence of the structural feature of the camera device; determine a location of the camera device relative to the display based on the output received from the one or more sensors; and present a graphical user interface (GUI) window for the camera device via the display at a location that is directly beside or proximate to the location of the camera device, the GUI window being a sub-region of the display and containing a camera feed of the camera device and/or user controls for the camera device.
[0063] It will be understood that the configurations and/or approaches described herein are exemplary in nature, and that these specific embodiments or examples are not to be considered in a limiting sense, because numerous variations are possible. The specific routines or methods described herein may represent one or more of any number of processing strategies. As such, various acts illustrated and/or described may be performed in the sequence illustrated and/or described, in other sequences, in parallel, or omitted. Likewise, the order of the above-described processes may be changed.
[0064] The subject matter of the present disclosure includes all novel and non- obvious combinations and sub-combinations of the various processes, systems and configurations, and other features, functions, acts, and/or properties disclosed herein, as well as any and all equivalents thereof.

Claims

1. A computing system, comprising:
a display;
a sensor system including a plurality of sensors distributed at respective locations relative to the display to detect a presence of a structural feature of a camera device; and a computing device programmed to:
receive an output from one or more sensors of the sensor system indicative of the presence of the structural feature of the camera device;
determine a location of the camera device relative to the display based on the output received from the one or more sensors; and
present a graphical user interface (GUI) window for the camera device via the display at a location that is based on the location of the camera device.
2. The computing system of claim 1 , wherein the structural feature of the camera device includes a capacitive marker on an external surface of the camera device; and
wherein the display comprises a capacitive array as the sensor system.
3. The computing system of claim 2, wherein the camera device is mounted to an enclosure of the display and includes a body portion that overlaps with and contacts a portion of the display, the body portion having the external surface that includes the capacitive marker.
4. The computing system of claim 1 , wherein the structural feature of the camera device includes one or more magnetic elements; and
wherein the plurality of sensors include one or more sensors configured to vary an output voltage responsive to the presence of the one or more magnets of the camera device.
5. The computing system of claim 1 , wherein the structural feature of the camera device includes one or more magnetically-interactive elements;
wherein the sensor system includes a plurality of barrel magnets located along a perimeter of the display that rotate responsive to the presence of the one or more magnetically-interactive elements of the camera device; and
wherein the plurality of sensors detect a rotation of each of the plurality of barrel magnets.
6. The computing system of claim 5, wherein the plurality of sensors include one or more transducers that vary an output voltage responsive to rotation of one or more of the plurality of barrel magnets.
7. The computing system of claim 1 , wherein the structural feature of the camera device is a camera-side electronic connector of the camera device; and
wherein the sensor system includes a plurality of display-side electronic connectors distributed along an exterior edge of the display.
8. The computing system of claim 1, wherein the location of the GUI is presented directly beside or proximate to the location of the camera device.
9. The computing system of claim 1, wherein the computing device is further programmed to receive a camera feed from the camera device and to present the camera feed via the GUI window.
10. The computing system of claim 1, wherein the computing device is further programmed to present one or more user controls for the camera device via the GUI window.
11. The computing system of claim 1, wherein the computing device is further programmed to:
receive a camera feed from the camera device and to transmit the camera feed to a remote computing system; and
receive a remote camera feed from the remote computing system and to present the remote camera feed via the GUI window.
12. The computing system of claim 1, wherein the computing device is further programmed to:
move the location of the GUI window presented via the display responsive to a change of the location of the camera device relative to the display determined based on an output received from the sensor system.
13. The computing system of claim 1, wherein the GUI window is a sub-region of the display.
14. The computing system of claim 1, further comprising the camera device.
15. A method performed by a computing system, the method comprising:
receiving an output from one or more sensors of a sensor system indicative of a presence of a structural feature of a camera device relative to a display;
determining a location of the camera device relative to the display based on the output received from the one or more sensors; and
presenting a graphical user interface (GUI) window for the camera device via the display at a location that is based on the location of the camera device.
EP19729593.4A 2018-05-30 2019-05-13 Graphical display supporting multi-location camera Active EP3785430B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/993,089 US10616528B2 (en) 2018-05-30 2018-05-30 Graphical display supporting multi-location camera
PCT/US2019/031927 WO2019231642A1 (en) 2018-05-30 2019-05-13 Graphical display supporting multi-location camera

Publications (2)

Publication Number Publication Date
EP3785430A1 true EP3785430A1 (en) 2021-03-03
EP3785430B1 EP3785430B1 (en) 2023-08-30

Family

ID=66810847

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19729593.4A Active EP3785430B1 (en) 2018-05-30 2019-05-13 Graphical display supporting multi-location camera

Country Status (4)

Country Link
US (1) US10616528B2 (en)
EP (1) EP3785430B1 (en)
CN (1) CN112136319B (en)
WO (1) WO2019231642A1 (en)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111475247B (en) * 2020-04-10 2023-09-26 维沃移动通信有限公司 Display method and electronic device
US11388324B2 (en) * 2020-06-15 2022-07-12 Intel Corporation Camera device, base unit, computation device, and corresponding methods and computer programs
US12213263B2 (en) * 2021-08-16 2025-01-28 Lenovo (Singapore) Pte. Ltd. Display camera system
US12526385B2 (en) 2021-10-26 2026-01-13 Dell Products L.P. Information handling system camera with direct access settings and automated presentation positioning
US11985448B2 (en) * 2021-12-14 2024-05-14 Dell Products L.P. Camera with magnet attachment to display panel
US12069356B2 (en) * 2021-12-14 2024-08-20 Dell Products L.P. Display backplate to facilitate camera magnet attachment to a display panel
US12388953B2 (en) * 2021-12-14 2025-08-12 Dell Products L.P. Camera front touch sensor to control video stream
US12289509B2 (en) * 2021-12-14 2025-04-29 Dell Products L.P. Reversible chargeable camera and dock with rear wall privacy
US12363259B2 (en) * 2021-12-14 2025-07-15 Dell Products L.P. Camera with magnet attachment to display panel and lightguide housing
US12200328B2 (en) 2021-12-14 2025-01-14 Dell Products L.P. Camera with dock having automated alignment
US12158690B2 (en) * 2021-12-14 2024-12-03 Dell Products L.P. Camera with video stream disablement responsive to movement
US12192631B2 (en) * 2021-12-14 2025-01-07 Dell Products L.P. Camera automated orientation with magnetic attachment to display panel
US12108147B2 (en) * 2021-12-14 2024-10-01 Dell Products L.P. Camera with microphone mute responsive to movement
US11843469B2 (en) 2022-04-29 2023-12-12 Microsoft Technology Licensing, Llc Eye contact assistance in video conference
CN217693467U (en) * 2022-05-31 2022-10-28 杭州登虹科技有限公司 Wireless charging camera
US12418430B1 (en) * 2022-07-31 2025-09-16 Zoom Communications, Inc. Dynamic configuration of interface elements for eye contact in a communication session
US12155940B2 (en) 2023-01-31 2024-11-26 Dell Products L.P. Information handling system peripheral camera with magnetic coupling and display illumination adjustment
US12126883B2 (en) 2023-01-31 2024-10-22 Dell Products L.P. Portable information handling system peripheral camera with magnetic coupling and touch inputs
US12309474B2 (en) * 2023-01-31 2025-05-20 Dell Products L.P. Portable information handling system display having a magnetically attached camera
US12368941B2 (en) 2023-01-31 2025-07-22 Dell Products L.P. Portable information handling system peripheral camera with tapered thermal spreader
US12602078B2 (en) * 2023-01-31 2026-04-14 Dell Products L.P. Portable information handling system peripheral camera and dock with contoured wireless charging
US12444073B2 (en) * 2023-01-31 2025-10-14 Dell Products L.P. Information handling system peripheral camera with magnetic coupling and integrated colorimeter
US12212830B2 (en) 2023-01-31 2025-01-28 Dell Products L.P. Information handling system peripheral camera with magnetic coupling and spindle stand
US12222752B2 (en) * 2023-01-31 2025-02-11 Dell Products L.P. Portable information handling system peripheral camera and dock

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3335017B2 (en) * 1994-11-29 2002-10-15 キヤノン株式会社 Camera device control device
US6208373B1 (en) * 1999-08-02 2001-03-27 Timothy Lo Fong Method and apparatus for enabling a videoconferencing participant to appear focused on camera to corresponding users
US6507356B1 (en) * 2000-10-13 2003-01-14 At&T Corp. Method for improving video conferencing and video calling
US7594630B2 (en) 2004-06-25 2009-09-29 Apple Inc. Mounting fixture for a peripheral device
TWI316167B (en) 2006-05-01 2009-10-21 Quanta Comp Inc Built-in webcam device
GB2446612A (en) 2007-02-13 2008-08-20 Qin Gang A movable magnetic object holder which secures onto the frame of an LCD monitor
US20090047995A1 (en) * 2007-08-15 2009-02-19 Sony Ericsson Mobile Communications Ab Portable communication device having a dual camera module with a common image sensor element
CN101472133B (en) * 2007-12-28 2010-12-08 鸿富锦精密工业（深圳）有限公司 Image correction device and image correction method
WO2010053473A1 (en) * 2008-11-04 2010-05-14 Hewlett-Packard Development Company, L.P. Controlling a video window position relative to a video camera position
CN101990011B (en) 2009-07-29 2013-11-20 鸿富锦精密工业（深圳）有限公司 Portable electronic device
US8390412B2 (en) 2010-09-17 2013-03-05 Apple Inc. Protective cover
US8823769B2 (en) * 2011-01-05 2014-09-02 Ricoh Company, Ltd. Three-dimensional video conferencing system with eye contact
US8725133B2 (en) 2011-02-15 2014-05-13 Lg Electronics Inc. Method of transmitting and receiving data, display device and mobile terminal using the same
US8665304B2 (en) * 2011-03-21 2014-03-04 Sony Corporation Establishing 3D video conference presentation on 2D display
US9167201B2 (en) * 2012-06-07 2015-10-20 Alcatel Lucent Feedback-system for managing video conferencing with a portable multimedia device comprising a frontal camera
MX353909B (en) 2013-12-10 2018-02-02 Vysk Communications Inc Camera disruption apparatus and method.
JP2015115046A (en) 2013-12-16 2015-06-22 ソニー株式会社 Information processing apparatus, program, information processing method, and information processing system
WO2015116127A1 (en) 2014-01-31 2015-08-06 Hewlett-Packard Development Company, L.P. Modular camera mounting assembly
CA2888173A1 (en) 2014-04-17 2015-10-17 Navagation Solutions, Llc Rotatable camera
US10025427B2 (en) * 2014-06-27 2018-07-17 Microsoft Technology Licensing, Llc Probabilistic touch sensing
US20180089500A1 (en) * 2015-04-02 2018-03-29 Fst21 Ltd Portable identification and data display device and system and method of using same
US9653844B1 (en) 2016-05-12 2017-05-16 Nanoport Technology Inc. Electronic device connectors with rotatable anchors
US10116874B2 (en) * 2016-06-30 2018-10-30 Microsoft Technology Licensing, Llc Adaptive camera field-of-view
CN206133361U (en) 2016-07-29 2017-04-26 合肥惠科金扬科技有限公司 Smooth movable clamp plate subassembly of camera and display device
US10409470B2 (en) 2016-09-14 2019-09-10 Microsoft Technology Licensing, Llc Touch-display accessory with relayed display plane
US9942517B1 (en) * 2016-10-04 2018-04-10 Avaya Inc. Multi-mode video conferencing system
US10754416B2 (en) * 2016-11-14 2020-08-25 Logitech Europe S.A. Systems and methods for a peripheral-centric augmented/virtual reality environment

Also Published As

Publication number Publication date
EP3785430B1 (en) 2023-08-30
US10616528B2 (en) 2020-04-07
CN112136319B (en) 2022-09-09
CN112136319A (en) 2020-12-25
US20190373214A1 (en) 2019-12-05
WO2019231642A1 (en) 2019-12-05

Similar Documents

Publication Publication Date Title
US10616528B2 (en) Graphical display supporting multi-location camera
EP3622701B1 (en) Image capture using a hinged device with multiple cameras
US9661214B2 (en) Depth determination using camera focus
US11683470B2 (en) Determining inter-pupillary distance
US8913170B1 (en) Cameras for computing devices
EP2864932B1 (en) Fingertip location for gesture input
US9094670B1 (en) Model generation and database
US8943582B1 (en) Transferring information among devices using cameras
US20140218291A1 (en) Aligning virtual camera with real camera
US20150338943A1 (en) Inter-display communication
US10339700B2 (en) Manipulating virtual objects on hinged multi-screen device
US20190272138A1 (en) Displaying content based on positional state
EP3759569B1 (en) Sensing relative orientation of computing device portions
US20180329521A1 (en) Application program mode based on device orientation
US9838677B1 (en) Detecting impact events for dropped devices
US20190220146A1 (en) Transforming received touch input
US12320888B2 (en) Controlling computer-generated facial expressions
KR102799611B1 (en) Mobile terminal
EP3486815A1 (en) Model data of an object disposed on a movable surface
US20250022105A1 (en) Device for replacing intrusive object in images
US20190304146A1 (en) Anchor graph
TW201626165A (en) Identification of an object on a touch-sensitive surface
CN110362203B (en) Information processing method, device, storage medium and augmented reality device
KR20210066546A (en) Mobile terminal and method for controlling thereof
KR20200001017A (en) Electronic device for adjusting depth of content

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201125

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RAP3 Party data changed (applicant data changed or rights of an application transferred)

Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20230322

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230703

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602019036132

Country of ref document: DE

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20230830

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1606937

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231230

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231130

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231230

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231201

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240102

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602019036132

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240418

Year of fee payment: 6

26N No opposition filed

Effective date: 20240603

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230830

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240513

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240531

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20240531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240531

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250423

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20250423

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20190513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20190513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20250531