US20150085060A1 - User experience for conferencing with a touch screen display - Google Patents
User experience for conferencing with a touch screen display Download PDFInfo
- Publication number
- US20150085060A1 US20150085060A1 US14/033,007 US201314033007A US2015085060A1 US 20150085060 A1 US20150085060 A1 US 20150085060A1 US 201314033007 A US201314033007 A US 201314033007A US 2015085060 A1 US2015085060 A1 US 2015085060A1
- Authority
- US
- United States
- Prior art keywords
- user
- detecting
- computer
- camera
- touch sensitive
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/266—Arrangements to supply power to external peripherals either directly from the computer or under computer control, e.g. supply of power through the communication port, computer controlled power-strips
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
- G06F1/3215—Monitoring of peripheral devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
- G06F1/3231—Monitoring the presence, absence or movement of users
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
- G06F3/0325—Detection arrangements using opto-electronic means using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0412—Digitisers structurally integrated in a display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30244—Camera pose
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42202—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Definitions
- conferencing systems are currently available. Some such systems have video conference capabilities in which a camera is placed in a conference room, in a location that enables the camera to capture video images of people sitting around a table or focusing on a presenter from a distance.
- Such conference room solutions normally are not well equipped for a scenario in which a user approaches a screen or whiteboard or other collaborative workspace. Therefore, such systems often place a single camera above or below the workspace, in the conference room.
- Touch screen displays are also currently in wide use. Some touch screen displays can be used in a collaborative way in which local and remote users interact with a touch screen display or other collaborative work surface at their location.
- Cameras that are mounted on the bottom of the screen are often too low to present a convenient view. In addition, they often present an awkward image, especially when a user approaches the display or is working in close proximity to the display. Also, as screens get larger, the bottom of the screen may fall near or below a standard conference room table, not allowing enough room for the camera to see above the table.
- a video conference system includes two cameras placed on opposite sides of a touch screen display. Multimedia processing is performed in order to automatically control power, control the placement of displayed items, and control switching between the cameras, based on user position or user interactions with the system.
- FIGS. 1 and 2 show top views of exemplary video conferencing systems.
- FIG. 3 is a block diagram of one illustrative multimedia processing architecture.
- FIG. 4 is a flow diagram illustrating one embodiment of the operation of the architecture shown in FIG. 3 in automatically powering up and powering down a multimedia system.
- FIG. 5 is a flow diagram illustrating one embodiment of the architecture shown in FIG. 3 in controlling outgoing video and camera switching.
- FIG. 6 shows one embodiment of a user interface display on a touch sensitive screen.
- FIG. 7 is a flow diagram illustrating one embodiment of the operation of the architecture shown in FIG. 3 in displaying images and incoming video on the touch sensitive screen as well as in playing audio.
- FIG. 8 is one embodiment of a user interface display on the touch sensitive screen.
- FIG. 9 is a flow diagram illustrating one embodiment of the operation of the architecture shown in FIG. 3 in performing power management based on user interactions with the system.
- FIG. 10 shows one embodiment of the architecture shown in FIG. 3 deployed in a cloud-based architecture.
- FIG. 11 is a block diagram of one illustrative computing environment.
- FIGS. 1 and 2 are top views of a portion of an illustrative multimedia conferencing architecture 100 in accordance with one embodiment. A more detailed block diagram of architecture 100 is described below with respect to FIG. 3 .
- FIGS. 1 and 2 are provided to give an overall context.
- FIG. 1 shows that architecture 100 includes touch sensitive display device 102 , a first camera 104 and a second camera 106 .
- architecture 100 includes a multimedia processing system and various other sensors and user input/output (I/O) mechanisms that are described in greater detail below with respect to FIG. 3 .
- cameras 104 and 106 illustratively have a horizontal field of view that is larger than 90 degrees and may be, for instance, approximately 95 degrees. Cameras 104 and 106 can also each be comprised of two or more cameras with smaller horizontal fields of view, and the images from those cameras can be stitched together to obtain a composite image with a horizontal field of view that is in excess of 90 degrees.
- Touch sensitive display device 102 resides in a plane that has a longitudinal axis generally indicated by number 108 .
- a viewing and touch sensitive display screen 110 on device 102 , faces a conference room 112 that is shown, in FIG. 1 , with a conference room table 114 and a plurality of chairs 116 .
- Architecture 100 also shows two different exemplary locations that a user might occupy including a first location 118 and a second location 120 .
- the user may illustratively be facing the touch sensitive display screen 110 and be working on a collaborative surface displayed on the touch sensitive display screen 110 of device 102 .
- the user is off to the side of screen 110 and may, therefore, be making a presentation using the touch sensitive display screen 110 but generally facing conference room 112 .
- FIG. 1 also shows that the user (or another user) may be in one of the chairs 116 , or that the user (or another user) may be at a location 122 that is located at a distance further from device 102 than either positions 118 and 120 .
- the user may be viewing a presentation being give by another person, or attending a teleconference and viewing images on touch sensitive display screen 110 .
- the user may be either approaching device 102 or moving away from device 102 , or simply standing or sitting at the location 122 , and observing device 102 .
- cameras 104 and 106 are illustratively positioned relative to device 102 so that they have overlapping fields of vision that encompass a majority of conference room 112 , but are generally tilted downward slightly relative to a horizontal plane in conference room 112 . Because the field of view of each camera is, for instance, approximately 95 degrees, they are illustratively positioned to be directed inward relative to longitudinal axis 108 .
- a line 109 perpendicular to the center of the camera's view (generally indicated by line 111 ) is offset from longitudinal axis 108 by an angle ⁇ that is approximately 30 degrees.
- the center 111 of the fields of view is directed inward relative to longitudinal axis 108 so the angle formed by axis 108 and line 111 is less than 90 degrees and may be approximately 30 degrees.
- the cameras are illustratively positioned so that they capture the face of the user when the user is either standing in front of screen 110 (such as at position 118 ) or to the side of screen 110 (such as at position 120 ). Therefore, when the user is working at the touch sensitive screen 110 , at least one of cameras 104 and 106 captures the user. Similarly, when the user is presenting from the screen, and is standing off to the side of the screen, at least one of cameras 104 and 106 also captures the user's image. Assume that the user in either of positions 118 or 120 stands a distance d from display screen 110 . In one embodiment, the distance d is approximately 10-14 inches.
- cameras 104 and 106 are illustratively positioned relative to the longitudinal axis of device 102 so that they capture an image of the user who is either standing in front of screen 110 and located at least as close as 10-14 inches from the screen (or further away) and when the user is standing off to the side of device 102 and located a distance of 10-14 inches (or beyond) from the screen.
- the fields of view of cameras 104 and 106 illustratively capture at least a majority of conference room 112 .
- FIG. 2 is a top view of another embodiment of architecture 100 , in which similar items are similarly numbered to those shown in FIG. 1 .
- cameras 104 and 106 are replaced by cameras 124 and 126 , respectively.
- Cameras 124 and 126 illustratively have a field of view that is larger than cameras 104 and 106 in FIG. 1 and may be approximately 140 degrees. Therefore, they are positioned relative to the longitudinal axis 108 of device 102 so that their fields of view overlap in a way that is substantially parallel to, and adjacent, the surface of screen 110 .
- the overlapping fields of view of cameras 124 and 126 are also positioned so that they capture a substantial majority of conference room 112 , and so that they capture an image of the user when the user is located in front of screen 110 (such as in position 118 ) or to the side of screen 110 , such as in position 120 .
- cameras 124 and 126 are placed so that the centers of their fields of view (represented by line 127 ) are perpendicular to a line 128 that is offset from axis 108 by approximately 20 degrees.
- the center 127 of the fields of view is directed inward relative to longitudinal axis 108 so the angle formed by axis 108 and line 127 is less than 90 degrees and may be approximately 20 degrees.
- device 102 switches the outgoing video for the conference between the two cameras based on a variety of different factors.
- device 102 controls various user input mechanisms, the displays displayed on screen 110 , the power up and power down scenarios, as well as a variety of other items that influence the user's experience in interacting with device 102 , based on a wide variety of different parameters, including how the user is moving, where the user is located, how the user is interacting with the device 102 , etc. These are described below in greater detail.
- FIG. 3 is a more detailed block diagram of one embodiment of multimedia processing architecture 100 .
- the more detailed diagram of multimedia processing architecture 100 includes conferencing system 130 .
- System 130 itself, includes multimedia processing system 138 and a plurality of different user input/output (I/O) mechanisms 140 .
- FIG. 3 also shows that conferencing system 130 can illustratively be connected for conferencing with one or more remote systems, such as a remote system 131 , over a communication channel 133 so that user 132 can communicate, using conferencing system 130 , with a remote user 135 .
- Communication channel 133 can include one or more of a variety of different types of communication channels, such as a wide area network, a cellular or switched telephone network, a local area network, or a wide variety of other communication channels.
- User 132 interacts with conferencing system 130 either directly, as indicated by arrow 134 , or through one or more different user devices 136 .
- user 132 may interact with conferencing system 130 using a mobile device (such as a smart phone, a tablet computer, or a palmtop computer) using a laptop or desktop computer, etc.
- a mobile device such as a smart phone, a tablet computer, or a palmtop computer
- laptop or desktop computer etc.
- user 132 can also interact directly with system 130 using the various user I/O mechanisms and sensors provided in conferencing system 130 .
- Multimedia processing system 138 includes data store 142 .
- Data store 142 can include applications 144 , operating systems 146 , control programs 148 , data 150 and other items 152 .
- Multimedia processing system 138 also includes processor 154 , touch sensitive display control component 156 , conferencing subsystem 158 , local/wide area network subsystems 160 , collaborative display control component 162 , audio control component 164 , camera control component 166 , power management component 168 , and speech/natural language component 170 .
- Multimedia processing system 138 can also include other sensor control systems 172 and a variety of other items as well, as indicated by block 174 .
- Multimedia processing system 138 is shown as interacting with various user input/output (I/O) mechanisms and sensors 140 .
- sensors can include touch sensitive display device 102 (also shown in FIGS. 1 and 2 ), one or more styluses 176 , cameras 104 , 106 , 124 and 126 , collectively referred to by block 178 in FIG. 3 , one or more audio speakers 180 , touchless natural input device 182 , microphones 184 , a variety of other sensors (such as light sensors, motion sensors, sound sensors, etc.) as indicated by block 186 and other user input mechanisms 188 .
- FIG. 3 shows that data store 142 is a single data store and is local to multimedia processing system 138 . It should be noted, however, that data store 142 can be remote from system 138 , and accessed by system 138 . It can also be multiple different data stores, all of which are local to system 138 , all of which are remote therefrom, or some of which are local while others are remote.
- the illustration shown in FIG. 3 is exemplary only.
- Processor 154 is illustratively a computer processor with associated memory and timing circuitry, not separately shown. It is a functional part of system 138 and architecture 100 , and is activated by the various other components or items in architecture 100 to facilitate their functionality.
- Touch sensitive display control component 156 is illustratively a control component that controls the various displays on the touch sensitive display screen 110 of device 102 .
- the various ways that the display can be controlled are described more specifically below with respect to FIGS. 4-9 . Of course, these are exemplary descriptions only.
- Conferencing subsystem 158 illustratively provides functionality to manage and control conferencing capabilities of architecture 100 . For instance, it provides the functionality to initiate communications with remote system 131 over communication channel 133 . Of course, this can be performed by multiple different components as well, and the component shown in FIG. 3 is shown for the sake of example only.
- Local/wide area network subsystem 160 illustratively provides functionality for enabling communication over a local or wide area network. It also illustratively provides functionality for performing near field communication or other types of networking using wireless or wired communication.
- Collaborative display control component 162 illustratively provides the functionality for generating and controlling a collaborative display on the touch sensitive display device 102 .
- component 162 illustratively generates a collaborative note taking display, whiteboard display, etc., on the touch sensitive display device, and processes the user inputs (from local and remote users) to modify the display accordingly.
- Audio control component 164 illustratively provides the control functionality for controlling speakers 180 and microphones 184 .
- audio control component 164 illustratively switches the active speaker based upon the location of the user relative to the display device, or based upon other parameters, as are described in more detail below.
- Camera control component 166 illustratively receives and processes a variety of parameters to control cameras 178 .
- component 166 illustratively controls which camera is automatically selected as the active camera to provide the outgoing video signal, based upon a variety of sensed parameters. Controlling the cameras and the outgoing video signals is described in greater detail below with respect to FIGS. 5 and 6 .
- Power management component 168 illustratively provides the functionality for managing the power of the various components, systems, subsystems and items in architecture 100 . This can be done in a variety of different ways, such as based on sensed inputs, user position, etc. This is described in greater detail below with respect to FIG. 9 .
- Speech/natural language component 170 illustratively provides the functionality for receiving, recognizing, and acting on speech inputs.
- component 170 can illustratively include speech recognition components, voice recognition components, or other components that enable a user to speak commands or other speech inputs and have them understood and acted upon by the various items in architecture 100 .
- Other sensor control system 172 illustratively receives sensor inputs from a variety of other sensors and user input mechanisms and provides command and control information based upon those inputs. This is exemplary only.
- Touch sensitive display device 102 is illustratively a large display that has touch sensing capability.
- device 102 can be a touch sensitive display ranging from, for instance, a twelve inch display to an 82 inch display, or an even larger display. It illustratively provides touch capability so that it can support touch gestures input by a user, using the user's finger, a stylus, another type of pen or pointer, etc. It can illustratively provide a high resolution display (such as a quad HD display) that renders text, ink, and large amounts of content in a very expeditious manner. It also illustratively provides multi-touch capability. Thus, device 102 may illustratively support unlimited touch points, sub-millimeter touch precision, near-zero parallax, ultra-low latency touch response and pen and stylus support, although these need not all be supported.
- the touch sensitive display control component 156 illustratively runs code which controls the display.
- display device 102 can be a presentation surface that is used by a user (or presenter) who is making a presentation to other individuals in the office. It can also illustratively be operated as a collaborative whiteboard, that enables multiple users across multiple different devices (some of which can be remote) to collaborate on a note taking system, a word processing system, a drawing system, or on any other type of system.
- Styluses 176 can illustratively be connected by hardware cables or they can be wireless devices that can be used as pointing devices or to perform other stylus functions, on touch sensitive display device 102 . Some of the stylus functionality is described in greater detail below.
- cameras 178 can be two different cameras that are configured to provide a wide field of view. They illustratively support viewing people located adjacent the display device, (such as those working at display screen 110 or presenting from it) and up to 20 feet away or more.
- Camera control component 166 illustratively controls which camera is active, and it can also control various functions, such as cropping, pan, tilt and zoom, etc., some of which are described in greater detail below.
- Speakers 180 are illustratively physically located relative to display device 102 , and cameras 178 , so that they provide audio that corresponds to the incoming and outgoing video.
- the active speaker that provides the audio for that remote user is also the speaker located on that side of the display device. This is described in greater detail below as well.
- microphones 184 are illustratively directional microphones, or a microphone array, that is located relative to display device 102 so that it can pick up audio from various users located in different locations relative to display device 102 .
- microphones 184 are a microphone array mounted to the top of display device 102 . When fully utilized, the microphone array produces a signal or set of signals that indicate where a user is located (e.g., from a left/center/right horizontal perspective).
- Audio control component 164 can illustratively control which microphones 184 are active based upon the location of various users relative to display device 102 , and based upon other parameters as well.
- Touchless natural input device 182 can take a wide variety of different forms. For instance, in one embodiment, it includes a motion sensing input device for a game or other console. It is based around a webcam style peripheral device that enables users to control and interact with the console without touching a controller. This can be done, for instance, using a natural user interface that detects gestures and spoken commands. It can use an infrared projector and camera to track the movements of objects and individuals in three-dimensions. It can include a camera, a depth sensor and a multi-array microphone that provides full-body, three-dimensional motion capture, facial recognition and voice recognition capabilities. This is exemplary only.
- Other sensors 186 can include light sensors (such as for sensing when someone turns on a light in a conference room or for sensing other light conditions in the vicinity of device 102 ) motion sensors, for sensing things such as when individuals enter the conference room or move about within the conference room, and sound sensors that can pick up and identify various sounds, in addition to microphones 184 .
- other or different user input mechanisms 188 can be used as well, and these can include keyboards, keypads, displayed (touch sensitive) control components such as soft keyboards, icons, links, dynamic links or tiles, buttons, and other hardware input mechanisms, such as pointing devices (like a mouse or track ball), and a wide variety of other user input mechanisms.
- the mechanisms can be actuated using a wide variety of different methods as well, such as voice commands, touch gestures, stylus inputs, etc.
- FIG. 4 is a flow diagram showing one embodiment of the operation of power management component 168 in automatically powering up and powering down conferencing system 130 .
- system 130 can be manually powered up and powered down by a given user 132 who simply actuates an appropriate user input mechanism causing system 130 to power up or power down. For instance, user 132 can simply actuate a power button to turn the system on and off.
- FIG. 4 shows one embodiment of the operation of power management component 168 in automatically powering up or powering down the system, based on a variety of different sensed parameters.
- power management component 168 first detects the presence of a user somewhere in the vicinity of system 130 . This is indicated by block 200 in FIG. 4 .
- power management component 168 receives inputs from a variety of the sensors or user input mechanisms 140 that indicate that the user is present.
- component 168 can receive an input from a microphone 184 , a motion sensor, a camera 178 , or a variety of other mechanisms that indicate that the user has walked into the conference room 112 where system 130 is deployed, or elsewhere in the vicinity of system 130 . This is indicated by block 202 .
- Power management component 168 can also detect (such as by a light sensor input or a camera input) that a user has turned on a light in the conference room 112 or elsewhere in the vicinity of system 130 . This is indicted by block 204 . Component 168 can also detect that a user is approaching the device based on an input from a camera or an input from a motion sensor or otherwise. This is indicated by block 206 . Of course, component 168 can detect the user's presence in other ways as well, such as by receiving an audio input or other inputs, and this is indicated by block 208 .
- component 168 powers up conferencing system 130 .
- component 168 powers up only a subset of the parts of the system so the system is not fully powered up, in that all subsystems and components are not powered up at that time. This is indicated by block 210 in FIG. 4 .
- component 168 can power up the touch sensitive display device 102 but keep the backlight off, so that device 102 is not fully powered up. This is indicated by block 212 . In doing this, component 168 can perform part of the power up process for the device so that when the user actually approaches the device or begins to use the device, the remaining part of the power up sequence does not take as long. However, by keeping the backlight off, device 102 is not distracting to people in its vicinity.
- Component 168 can power up other parts of the conferencing system, but keep a different subset of its components or subsystems powered down, in other ways as well. This is indicated by block 214 .
- component 168 can analyze this action to determine whether it indicates that the user is entering a full system power up scenario. This is indicated by block 216 in FIG. 4 .
- component 168 detects (through appropriate sensor inputs) that a user is approaching the touch sensitive display device 102 , this may be a power up scenario so component 168 powers up the rest of the system. This is indicated by block 218 .
- Component 168 can also detect that user 132 has plugged in another type of user device into system 130 (such as a laptop computer, a tablet computer, a smart phone, or another device). This can be interpreted as the user wishing to power up the system as well, and this is indicated by block 222 in FIG. 4 .
- another type of user device such as a laptop computer, a tablet computer, a smart phone, or another device. This can be interpreted as the user wishing to power up the system as well, and this is indicated by block 222 in FIG. 4 .
- conferencing system 130 allows a user to reserve a teleconference or meeting time or to schedule a teleconference or meeting
- the user may be permitted to identify the leader or presenter at the teleconference or meeting.
- the leader or presenter is known to system 130 (such as by having profile data stored in data store 142 for the leader or presenter)
- system 130 can identify when the leader or presenter enters the room.
- the leader or presenter is carrying an RFID badge or other wireless communication device, a smart phone or other mobile device that is known by system 130 to identify the leader or presenter.
- system 130 can indicate to power management component 168 that the leader or presenter for the teleconference or meeting that is currently scheduled has entered the room. In that case, component 168 can power up the system as well.
- the profile information for the leader or presenter includes facial recognition information
- system 130 can identify that the presenter or leader has entered the room, based upon the presenter's or leader's facial features. Identifying that the leader or presenter has entered the room or is in the vicinity of system 130 is indicated by block 226 in FIG. 4 .
- system 130 (and component 168 ) can identify that the user wishes to power up the system in other ways as well. This is indicated by block 228 .
- the particular ways described above are exemplary only.
- power management component 168 Once power management component 168 has identified a power up scenario, it illustratively turns on touch sensitive display device 102 to the fully powered up state. This is indicated by block 230 in FIG. 4 . Power management of the various subsystems can be performed as well, and this is discussed in more detail below with respect to FIG. 9 .
- power management component 168 detects a likely power down scenario. This is indicated by block 236 .
- the power down scenario can be detected using a wide variety of different inputs.
- component 168 can determine (such as through an audio input 237 , a camera input, a light sensor input, etc.) that all of the participants in the conference or meeting have left the conference room and have turned off the light. This is indicated by block 238 in FIG. 4 .
- Component 168 can determine that there has been no pixel movement within the field of view of cameras 178 for a predetermined time. This may indicate that nobody is in the room or that the system should be powered down, because nobody is moving and no one is approaching the touch sensitive display device 102 . This is indicated by block 240 in FIG. 4 .
- component 168 can be notified by conferencing subsystem 158 that the user has hung up the call. This can indicate that at least part of system 130 should be powered down, and this is indicated by block 242 in FIG. 4 .
- component 168 can identify a potential power down scenario when the user has closed the presentation application that is being used to make the presentation. This is indicated by block 244 .
- power management component 168 illustratively powers down conferencing system 130 .
- This is indicated by block 248 in FIG. 4 .
- Touch sensitive display control component 156 can generate a prompt for the user on touch sensitive display device 102 .
- the prompt can ask the user whether the user wishes to power down the system, and wait for a user input. Prompting the user is indicated by block 250 in FIG. 4 .
- Touch sensitive display control component 156 can generate and display a power down message and power the system down without waiting for a user input. This is indicated by block 252 in FIG. 4 .
- the component 168 can power down the system in a variety of other ways as well, such as by generating an audio prompt or an audio power down message, such as by simply powering the system down without generating a prompt or a message, or in other ways. This is indicated by block 254 in FIG. 4 .
- FIG. 5 is a flow diagram illustrating one embodiment of the operation of camera control component 166 in controlling which camera 178 (or which camera 104 and 106 or 124 and 126 in FIGS. 1 and 2 ) generates the outgoing video stream.
- a power management component 168 powers up both cameras without sending an outgoing video stream from either of them. This is indicated by block 260 in FIG. 5 .
- Camera control component 166 determines whether an active camera has been selected manually by either a local user or a remote user. This is indicated by block 262 .
- a local user 162 can illustratively approach one of cameras 178 (or touch sensitive display device 102 ) and actuate a suitable user input mechanism to manually select one of the cameras as the active camera.
- a remote user 135 can actuate a suitable user input mechanism to select one of the cameras as an active camera as well. If this is the case, then camera control component 166 simply activates the manually selected camera as the active camera. If not, however, then camera control component 166 performs an automatic camera selection analysis based on a variety of inputs, in order to identify one of the cameras as the camera that should be activated. Performing the automatic camera selection analysis is indicated by block 264 in FIG. 5 .
- camera control component 166 can base the analysis on a wide variety of input criteria. For instance, camera control component 166 can receive an audio input 265 and analyze it to identify a location of a speaker or other parameter.
- camera control component 166 can analyze the video stream generated by the cameras to determine whether either of the cameras is blocked by a large object. If so, camera control component 166 can select the other camera as the active camera. Determining whether a camera is blocked by a large object is indicated by block 266 in FIG. 5 . This may happen, for instance, where a user is making a presentation both locally, and to remote users. If the user has his or her back turned to the active camera and his or her head is closely proximate the active camera, then camera control component 166 determines that the user is blocking that camera, and selects the opposite camera as being the active camera, to provide the outgoing video.
- camera control component 166 can determine whether a user is facing the camera, but is in closer proximity to one camera than to the other camera. Referring, for example, to FIG. 2 , if the user is located in location 118 , such that the user is closer to camera 124 , and facing display screen 110 , then control component 166 illustratively selects camera 124 as the active camera so that the user's face can be captured, even though the user is close to the display screen 110 . Using the location of a person close to the screen (such as the left side or the right side) to select a camera is indicated by block 268 in FIG. 5 .
- Camera control component 166 can also receive inputs from other sensors (such as a motion sensor) to indicate whether there is movement close to one of the cameras. If so, camera control component 166 can select that camera as the active camera. Receiving a motion sensor input is indicated by block 270 in FIG. 5 .
- Camera control component 166 can also use facial recognition to select the active camera.
- facial recognition it may be that the user's or presenter's face can be recognized by system 130 , based upon facial recognition profile information, or otherwise.
- camera control component 166 can select, as the active camera, the particular camera that gives the best view of the presenter's or leader's face, no matter where that person is in the room.
- Using facial recognition to select the active camera is indicated by block 272 in FIG. 5 .
- Camera control component 166 can also use inputs from other sensors or user input mechanisms in order to select the active camera. For instance, if the user touches touch sensitive display device 102 at a given location on screen 110 , component 166 can select the camera closest to that location as the active camera. Further, if the user picks up or touches one of the styluses 176 , component 166 can select, as the active camera, the camera that is closest to that stylus. Further, using microphone beam forming, the location of a given user's voice can be roughly located and the camera closest to that user can be selected as the active camera. This can also help for users in the room who are, for example, on the far right side of the room.
- the microphone can detect that, it can swap to the left camera which would have a better view of the person further down on the right. For instance, if the presenter is making a presentation, but a member of the local audience is asking a question, the audio beam forming process can identify, in general terms, the location of that user, or the general direction of that user. Component 166 can then activate the camera that gives the best view of that location. Selecting a camera based upon locations of any user interactions with the screen or other user input devices is indicated by block 274 in FIG. 5 .
- Component 166 can select a camera as the active camera in other ways as well. For example, where the component 166 receives a sensor input indicating that a member of the audience is approaching the touch sensitive display 102 , component 166 can select, as the active camera, the one that gives the best view of that user's location as they approach the touch sensitive display 102 . Selecting a camera as the active camera in other ways is indicated by block 276 in FIG. 5 .
- component 166 selects one of the cameras as the active camera. This is indicated by block 278 in FIG. 5 .
- Component 166 then activates the selected camera. This is indicated by block 280 .
- camera control component 166 keeps the non-selected camera on, but in a non-broadcasting state so that it does not provide the outgoing video. This can assist in the camera switching process. For instance, where component 166 switches back and forth between the cameras at a relatively frequent rate, keeping both cameras on (even though only one at a time is selected) can make the switching process quicker, because the power up sequence for the selected camera does not need to be fully under taken.
- Activating the selected camera can be done in a number of different ways as well.
- component 166 can first control the selected camera so that it provides the outgoing video to conferencing subsystem 158 . This is indicated by block 282 in FIG. 5 .
- component 166 provides some visual indication that indicates which camera is the selected and active camera. This can be done, for instance, by turning on a light (such as an LED or another source of illumination) that is mounted to device 102 closely proximate the selected camera. This is indicated by block 284 .
- a light such as an LED or another source of illumination
- component 166 can indicate to audio control component 164 which camera is the selected camera, and audio control component 164 can then activate the speaker that is associated with the selected camera so that the speaker mounted to device 102 next to the selected camera is turned on, or made louder, etc. This is indicated by block 286 .
- camera control component 166 can indicate to sensor control system 172 which of the cameras is selected as the active camera, and system 172 can then activate the motion sensor that is mounted to device 102 and located closely proximate the selected camera. This is indicated by block 288 in FIG. 5 .
- touch sensitive display control component 156 illustratively displays the incoming video of remote users, along with the touch sensitive pallet of control components, on the side closest to the selected camera. This can make it easier for the user to control the system.
- camera control component 166 illustratively selects camera 124 as the active camera to obtain an image of the user's face, when the user is located in position 118 . Because the user is closer to camera 124 than to camera 126 , touch sensitive display control component 156 also illustratively switches the display of the incoming video on display 110 so that it is closely proximate location 118 on display 110 . Further, component 156 can display touch sensitive control mechanisms on the user interface display at a location that is close to location 118 , so that the user can easily actuate those control mechanisms using touch gestures on display 110 . Collocating the other displays in this way is indicated by block 290 in FIG. 5 . Camera control component 166 can, of course, perform other actions based upon which camera is activated. This is indicated by block 292 .
- FIG. 6 shows one embodiment of a touch sensitive display device 102 , which is similar to that shown in FIG. 2 . Similar items are similarly numbered. Thus, it can be seen that cameras 124 and 126 are located on the opposite sides of display 110 . Each camera has an associated light source (e.g., a LED) 300 and 302 , respectively. Also, there is illustratively a speaker 304 and 306 located closely proximately camera 124 and 126 , respectively. In addition, in one embodiment, motion sensors 308 and 310 are also located closely proximate cameras 124 and 126 , respectively.
- light source e.g., a LED
- speaker 304 and 306 located closely proximately camera 124 and 126 , respectively.
- motion sensors 308 and 310 are also located closely proximate cameras 124 and 126 , respectively.
- FIG. 6 shows that display 110 is currently displaying a collaborative workspace 312 that allows a user to collaborate with other, remote or local users, to perform work on collaborative workspace 312 . It can be seen that, in the example shown in FIG. 6 , the users have generated a pie chart 314 and a set of notes 316 on the collaborative workspace. Of course, a wide variety of other content or information can be displayed on collaborative workspace 312 as well.
- FIG. 6 also shows that device 102 includes first and second styluses 318 and 320 located generally on longitudinally opposite sides of display 110 . Each stylus can be located in a holster 322 and 324 , respectively, so that they can be removed and used by a user to point to or draw on collaborative workspace 312 , or anywhere else on touch sensitive display 110 .
- camera control component 166 has identified that the user is approximately in the location 120 (shown in FIG. 2 ) which is closer to camera 126 , than to camera 124 . Therefore, camera control component 166 has illustratively selected camera 126 and activated it. In one embodiment, camera control component 166 has also illuminated light source 302 to give a visual indication that camera 126 is the active camera. Component 166 also illustratively communicates with the other components in multimedia processing system 138 to activate speaker 306 and motion sensor 310 , both of which are also closer to camera 126 than to camera 124 .
- collaborative display control component 162 moves the collaborative workspace 312 to the opposite side of display 110 so that touch sensitive display control component 156 can display the remote user video images (e.g., the incoming videos) in a location of display 110 that is closely proximate camera 126 .
- the remote user video images are indicated by blocks 330 and 332 , respectively. It can be seen that, in one embodiment, when a remote user is speaking or has indicated a desire to speak (such as by unmuting himself or herself) that remote user's corresponding video image can be enlarged (e.g., image 330 is larger than image 332 ).
- component 156 also displays the control user input mechanisms, which can be actuated using touch gestures to control device 102 , on a region of display 110 that is also closer to camera 126 than to camera 124 . Because the user is located on that side of the display device 102 , the displayed controls are illustratively displayed close to the user so that they can be easily actuated by the user. The displayed controls are indicated by block 334 in FIG. 6 . FIG. 6 also shows that, in one embodiment, because the user is standing closer to stylus 320 then to stylus 318 , system 130 illuminates a light source 336 on stylus 320 so that the user can easily identify that stylus and use it.
- the system can automatically display directions or other helpful information for using that mechanism. For instance, where the user reaches for one of displayed controls 334 , the system can automatically display a direction display 335 describing the control.
- camera control component 166 can illustratively control the non-selected camera as capturing images to provide input to analyze a variety of different things, such as the acoustic dynamics of the conference room (or the vicinity of device 102 ). This is indicated by block 350 in FIG. 5 .
- the non-selected camera e.g., camera 124
- Camera 124 can also be used to capture images that are analyzed to determine the location of various people in the conference room or otherwise in the vicinity of device 102 . This is indicated by block 354 .
- the non-selected camera 124 can also be used to analyze the size of the conference room, or the acoustic characteristics of the room (such as whether it has drapes, carpeting, etc.). This is indicated by blocks 356 and 358 , respectively.
- the non-selected camera 124 can also be used to capture images that can provide information to control component 166 in order to perform further camera switching analysis. This is indicated by block 360 .
- the non-selected camera 124 can be used to provide other information as well. This is indicated by block 362 .
- Camera control component 166 can also perform a variety of other video actions, using the cameras, based upon a variety of inputs from user input/output mechanisms and sensors 140 . This is indicated by block 364 in FIG. 5 .
- camera control component 166 can control the selected camera to crop and un-crop the images based upon the video being captured. For instance, where a user is approaching the camera, component 166 can crop tightly to that user's face. However, where a user is moving away from the camera, component 166 can un-crop in a gradual or continuous way, or in another way. This is indicated by block 366 in FIG. 5 .
- Camera control component 166 can also control the selected camera 166 to perform tilt, pan and zoom operations. This is indicated by block 368 .
- component 166 can control the selected camera to follow that person and to maintain an image of that person, using tilt, pan and zoom functions on the camera. Of course, these functions can be used to perform other operations as well.
- Control component 166 can also perform other video operations based on a variety of different inputs. This is indicated by block 370 in FIG. 5 .
- camera control component 166 continues to perform these operations until power management component 168 determines that a power down condition exists for that camera. This is indicated by block 372 in FIG. 5 . When that happens, power management component 168 powers down the camera. This is indicated by block 374 .
- FIG. 7 is a flow diagram illustrating one embodiment of the operation of touch sensitive display control component 156 in generating a display of the incoming video, and also of displaying various other images and generating audio outputs from device 102 .
- FIG. 8 is one exemplary user interface display. FIGS. 6-8 will now be described in conjunction with one another.
- Control component 156 first (using inputs from user input/output mechanisms and sensors 140 ) receives an indication as to the general position of a user. This is indicated by block 400 in FIG. 7 .
- component 156 can identify the horizontal location of the user relative to display device 102 (e.g., whether the user is closer to camera 124 or camera 126 ). This is indicated by block 402 .
- component 156 can also illustratively identify the user's height. This is indicated by block 404 .
- Component 156 can use cameras 124 and 126 to triangulate to obtain a distance of the user from display screen 120 . This is indicated by block 406 .
- component 156 can obtain this information from a touchless natural input device 182 or other sensors as well.
- component 156 can detect the user's location or position in other ways as well. This is indicated by block 408 .
- Component 156 then, in conjunction with other components in system 138 , controls the display of items on display 110 based upon the user's location. This is indicated by block 410 in FIG. 7 .
- camera control component 166 can activate the camera nearest the user and turn on the light 300 or 302 . This is indicated by block 412 . It can be seen in FIG. 6 that the user is located closer to camera 126 , while in FIG. 8 , the user is located closer to camera 124 .
- Control component 156 also displays the incoming video nearest the user (e.g., nearest the activated camera). This is indicated by block 414 . It can be seen that the remote user video images 330 and 332 are displayed in a position that is closer to the detected position of the user, relative to display screen 110 . In FIG. 6 , this is on the right hand side of the display, while in FIG. 8 this is on the left hand side of the display. When the incoming video images are moved from side to side, they can be controlled to perform any desired visual effect, such as sucking in to disappear, and inflating to reappear, etc.
- FIG. 7 also shows that component 156 illustratively displays the touch-sensitive controls 334 nearest the user as well. This is indicated by block 416 in FIG. 7 . In FIG. 6 , they are displayed on the right side of screen 110 , while in FIG. 8 they are displayed on the left side of the screen.
- FIG. 7 also indicates that the controls can illustratively be displayed at an appropriate height. For instance, since the height of the user can be determined based upon the sensor inputs, if the user is tall, the controls can be displayed higher. If the user is shorter, the controls can be displayed lower. In addition, the touch sensitive gestures can be adjusted as well.
- touch gestures it is not uncommon for certain touch gestures to ask the user to swipe from the top of the screen down, or from the left or right of the screen in the opposite direction.
- the touch gestures can be modified so that the user does not have to reach all the way to the top of the screen or to either side of the screen, in order to invoke the necessary control, given those types of touch gestures.
- system 138 activates the user input mechanisms that are closest to the user. For instance, as described above, the stylus that is closest to the user's position may be activated. In FIG. 6 , this is stylus 320 , while in FIG. 8 , this is stylus 318 . Activating the user input devices nearest the user is indicated by block 418 in FIG. 7 .
- audio control component 164 activates the speaker nearest the user so that the incoming audio is played from the speaker nearest the user. This is indicated by block 420 .
- Display control component 156 also illustratively displays the collaborative workspace 312 in an appropriate location. This is indicated by block 422 . This can be displaying the workspace 312 closest to the user, or on the opposite side as the user, or directly in front of the user, or otherwise.
- System 138 also illustratively activates the motion and other sensors nearest the user. This is indicated by block 424 .
- touch sensitive display control component 156 can take other actions based on the detected user position. This is indicated by block 426 .
- the various components in system 138 continue to perform this type of displaying of the various components on user interface display 110 , and to activate the various user input mechanisms, based upon the user position and other detected inputs until a power down condition is detected. This is indicated by block 428 . When that occurs, the various components and systems and subsystems can be powered down, as desired. This is indicated by block 430 .
- FIG. 9 is a flow diagram illustrating one embodiment in which power management component 168 manages the power for various subsystems, even when most of system 130 is powered up. For instance, component 168 first determines that the system is to be powered up either partially or fully. This is indicated by block 432 in FIG. 9 . Component 168 can then be provided with inputs that allow it to determine whether anyone is relatively close to touch sensitive display device 102 , or to one of the user input/output mechanisms 140 . This is indicated by block 434 . If so, power management component 168 powers up the subsystems near the user. This is indicated by block 436 . By way of example, if the user is near stylus 320 , power management component 168 provides power to that stylus, while keeping stylus 318 powered down.
- power management component 168 illustratively powers off various subsystems that are on or near display device 102 . This is indicated by block 438 .
- power management component 168 can power down the touch sensing mechanisms on the display device. This is indicated by block 440 . Also, if no one is near device 102 , then power management component 168 can power down both styluses. This is indicated by block 442 . Power management component 168 can power down other subsystems or components as well. This is indicated by block 444 .
- power management component 168 When power management component 168 is provided with various inputs that indicate that a user is approaching the display device, power management component 168 illustratively powers up the appropriate components or subsystems. This is indicated by block 446 . For instance, if a user is approaching the right hand side of the display device, then power management component 168 may illustratively power up the corresponding stylus or other user input mechanisms on that side of device 102 . Powering up the subsystems near the user is indicated by block 448 in FIG. 9 .
- Power management component 168 illustratively continues to control power management of the system in these various ways until a power down scenario is detected. This is indicated by block 450 . When that occurs, power management component 168 powers down the desired systems, subsystems, components, etc. This is indicated by block 452 .
- system 130 can have knowledge of a calendar for the device 102 or conference room in which it is located.
- Component 168 can use the time and date when meetings are supposed to start, along with attendee information, to control power management.
- Component 168 can, for instance, automatically power up device 102 and call other attendees of a meeting, or call into a conference call, without user interaction. This can be done based on meeting start time and conference call or attendee information.
- FIG. 10 is a block diagram of architecture 100 , shown in FIG. 1 , except that its elements are disposed in a cloud computing architecture 500 .
- Cloud computing provides computation, software, data access, and storage services that do not require end-user knowledge of the physical location or configuration of the system that delivers the services.
- cloud computing delivers the services over a wide area network, such as the internet, using appropriate protocols.
- cloud computing providers deliver applications over a wide area network and they can be accessed through a web browser or any other computing component.
- Software or components of architecture 100 as well as the corresponding data can be stored on servers at a remote location.
- the computing resources in a cloud computing environment can be consolidated at a remote data center location or they can be dispersed.
- Cloud computing infrastructures can deliver services through shared data centers, even though they appear as a single point of access for the user.
- the components and functions described herein can be provided from a service provider at a remote location using a cloud computing architecture.
- they can be provided from a conventional server, or they can be installed on client devices directly, or in other ways.
- Cloud computing both public and private provides substantially seamless pooling of resources, as well as a reduced need to manage and configure underlying hardware infrastructure.
- a public cloud is managed by a vendor and typically supports multiple consumers using the same infrastructure. Also, a public cloud, as opposed to a private cloud, can free up the end users from managing the hardware.
- a private cloud may be managed by the organization itself and the infrastructure is typically not shared with other organizations. The organization still maintains the hardware to some extent, such as installations and repairs, etc.
- FIG. 10 specifically shows that multimedia processing system 138 is located in cloud 502 (which can be public, private, or a combination where portions are public while others are private). Therefore, user 132 uses touch sensitive display device 102 to access those systems through cloud 502 .
- cloud 502 which can be public, private, or a combination where portions are public while others are private. Therefore, user 132 uses touch sensitive display device 102 to access those systems through cloud 502 .
- FIG. 10 also depicts another embodiment of a cloud architecture.
- FIG. 10 shows that it is also contemplated that some elements of architecture 100 are disposed in cloud 502 while others are not.
- data store 142 can be disposed outside of cloud 502 , and accessed through cloud 502 .
- collaborative display control component 162 (or other components) is also outside of cloud 502 . Regardless of where they are located, they can be accessed directly by device 504 , through a network (either a wide area network or a local area network), they can be hosted at a remote site by a service, or they can be provided as a service through a cloud or accessed by a connection service that resides in the cloud. All of these architectures are contemplated herein.
- architecture 100 can be disposed on a wide variety of different devices. Some of those devices include servers, desktop computers, laptop computers, tablet computers, or other mobile devices, such as palm top computers, cell phones, smart phones, multimedia players, personal digital assistants, etc.
- FIG. 11 is one embodiment of a computing environment in which architecture 100 , or parts of it, (for example) can be deployed.
- an exemplary system for implementing some embodiments includes a general-purpose computing device in the form of a computer 810 .
- Components of computer 810 may include, but are not limited to, a processing unit 820 (which can comprise processor 154 ), a system memory 830 , and a system bus 821 that couples various system components including the system memory to the processing unit 820 .
- the system bus 821 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures.
- such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus.
- ISA Industry Standard Architecture
- MCA Micro Channel Architecture
- EISA Enhanced ISA
- VESA Video Electronics Standards Association
- PCI Peripheral Component Interconnect
- Computer 810 typically includes a variety of computer readable media.
- Computer readable media can be any available media that can be accessed by computer 810 and includes both volatile and nonvolatile media, removable and non-removable media.
- Computer readable media may comprise computer storage media and communication media.
- Computer storage media is different from, and does not include, a modulated data signal or carrier wave. It includes hardware storage media including both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
- Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computer 810 .
- Communication media typically embodies computer readable instructions, data structures, program modules or other data in a transport mechanism and includes any information delivery media.
- modulated data signal means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.
- communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of any of the above should also be included within the scope of computer readable media.
- the system memory 830 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 831 and random access memory (RAM) 832 .
- ROM read only memory
- RAM random access memory
- BIOS basic input/output system 833
- RAM 832 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 820 .
- FIG. 11 illustrates operating system 834 , application programs 835 , other program modules 836 , and program data 837 .
- the computer 810 may also include other removable/non-removable volatile/nonvolatile computer storage media.
- FIG. 11 illustrates a hard disk drive 841 that reads from or writes to non-removable, nonvolatile magnetic media, a magnetic disk drive 851 that reads from or writes to a removable, nonvolatile magnetic disk 852 , and an optical disk drive 855 that reads from or writes to a removable, nonvolatile optical disk 856 such as a CD ROM or other optical media.
- removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like.
- the hard disk drive 841 is typically connected to the system bus 821 through a non-removable memory interface such as interface 840
- magnetic disk drive 851 and optical disk drive 855 are typically connected to the system bus 821 by a removable memory interface, such as interface 850 .
- the functionality described herein can be performed, at least in part, by one or more hardware logic components.
- illustrative types of hardware logic components include Field-programmable Gate Arrays (FPGAs), Program-specific Integrated Circuits (ASICs), Program-specific Standard Products (ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.
- the drives and their associated computer storage media discussed above and illustrated in FIG. 11 provide storage of computer readable instructions, data structures, program modules and other data for the computer 810 .
- hard disk drive 841 is illustrated as storing operating system 844 , application programs 845 , other program modules 846 , and program data 847 .
- operating system 844 application programs 845 , other program modules 846 , and program data 847 are given different numbers here to illustrate that, at a minimum, they are different copies.
- a user may enter commands and information into the computer 810 through input devices such as a keyboard 862 , touch screen 110 , a microphone 863 , and a pointing device 861 , such as a mouse, trackball or touch pad.
- input devices such as a keyboard 862 , touch screen 110 , a microphone 863 , and a pointing device 861 , such as a mouse, trackball or touch pad.
- Other input devices such as those described above with respect to FIG. 3 can be used, and still others (not shown) may include a joystick, game pad, satellite dish, scanner, or the like.
- These and other input devices are often connected to the processing unit 820 through a user input interface 860 that is coupled to the system bus, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB).
- USB universal serial bus
- a visual display 891 or other type of display device is also connected to the system bus 821 via an interface, such as a video interface 890 .
- computers may also include other peripheral output devices such as speakers 897 and printer 896 , which may be connected through an output peripheral interface 895 .
- the computer 810 is operated in a networked environment using logical connections to one or more remote computers, such as a remote computer 880 .
- the remote computer 880 may be a personal computer, a hand-held device, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer 810 .
- the logical connections depicted in FIG. 11 include a local area network (LAN) 871 and a wide area network (WAN) 873 , but may also include other networks.
- LAN local area network
- WAN wide area network
- Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.
- the computer 810 When used in a LAN networking environment, the computer 810 is connected to the LAN 871 through a network interface or adapter 870 .
- the computer 810 When used in a WAN networking environment, the computer 810 typically includes a modem 872 or other means for establishing communications over the WAN 873 , such as the Internet.
- the modem 872 which may be internal or external, may be connected to the system bus 821 via the user input interface 860 , or other appropriate mechanism.
- program modules depicted relative to the computer 810 may be stored in the remote memory storage device.
- FIG. 11 illustrates remote application programs 885 as residing on remote computer 880 . It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.
Abstract
Description
- Many conferencing systems are currently available. Some such systems have video conference capabilities in which a camera is placed in a conference room, in a location that enables the camera to capture video images of people sitting around a table or focusing on a presenter from a distance.
- Such conference room solutions normally are not well equipped for a scenario in which a user approaches a screen or whiteboard or other collaborative workspace. Therefore, such systems often place a single camera above or below the workspace, in the conference room.
- Touch screen displays are also currently in wide use. Some touch screen displays can be used in a collaborative way in which local and remote users interact with a touch screen display or other collaborative work surface at their location.
- As the touch screen displays become larger, camera placement presents more challenges. Cameras mounted on top of the touch screen display often present the remote user with a camera view that is similar to that of a security camera. This is often an awkward view. This top camera placement is also unable to capture video images of people standing to the left or to the right of the collaborative work surface. When it does capture images of those people, it often only captures the tops of their heads, especially when a local user is working in close proximity to the display, and especially when the local user is directly in front of the display, which happens often when the user is drawing on or interacting with content on the collaborative work surface.
- Cameras that are mounted on the bottom of the screen are often too low to present a convenient view. In addition, they often present an awkward image, especially when a user approaches the display or is working in close proximity to the display. Also, as screens get larger, the bottom of the screen may fall near or below a standard conference room table, not allowing enough room for the camera to see above the table.
- The discussion above is merely provided for general background information and is not intended to be used as an aid in determining the scope of the claimed subject matter.
- A video conference system includes two cameras placed on opposite sides of a touch screen display. Multimedia processing is performed in order to automatically control power, control the placement of displayed items, and control switching between the cameras, based on user position or user interactions with the system.
- This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter. The claimed subject matter is not limited to implementations that solve any or all disadvantages noted in the background.
-
FIGS. 1 and 2 show top views of exemplary video conferencing systems. -
FIG. 3 is a block diagram of one illustrative multimedia processing architecture. -
FIG. 4 is a flow diagram illustrating one embodiment of the operation of the architecture shown inFIG. 3 in automatically powering up and powering down a multimedia system. -
FIG. 5 is a flow diagram illustrating one embodiment of the architecture shown inFIG. 3 in controlling outgoing video and camera switching. -
FIG. 6 shows one embodiment of a user interface display on a touch sensitive screen. -
FIG. 7 is a flow diagram illustrating one embodiment of the operation of the architecture shown inFIG. 3 in displaying images and incoming video on the touch sensitive screen as well as in playing audio. -
FIG. 8 is one embodiment of a user interface display on the touch sensitive screen. -
FIG. 9 is a flow diagram illustrating one embodiment of the operation of the architecture shown inFIG. 3 in performing power management based on user interactions with the system. -
FIG. 10 shows one embodiment of the architecture shown inFIG. 3 deployed in a cloud-based architecture. -
FIG. 11 is a block diagram of one illustrative computing environment. -
FIGS. 1 and 2 are top views of a portion of an illustrativemultimedia conferencing architecture 100 in accordance with one embodiment. A more detailed block diagram ofarchitecture 100 is described below with respect toFIG. 3 .FIGS. 1 and 2 are provided to give an overall context.FIG. 1 shows thatarchitecture 100 includes touchsensitive display device 102, afirst camera 104 and asecond camera 106. It will also be noted thatarchitecture 100 includes a multimedia processing system and various other sensors and user input/output (I/O) mechanisms that are described in greater detail below with respect toFIG. 3 . - In the embodiment shown in
FIG. 1 ,cameras Cameras sensitive display device 102 resides in a plane that has a longitudinal axis generally indicated bynumber 108. A viewing and touchsensitive display screen 110, ondevice 102, faces aconference room 112 that is shown, inFIG. 1 , with a conference room table 114 and a plurality ofchairs 116.Architecture 100 also shows two different exemplary locations that a user might occupy including afirst location 118 and asecond location 120. When the user is atlocation 118, the user may illustratively be facing the touchsensitive display screen 110 and be working on a collaborative surface displayed on the touchsensitive display screen 110 ofdevice 102. When the user is atlocation 120, the user is off to the side ofscreen 110 and may, therefore, be making a presentation using the touchsensitive display screen 110 but generally facingconference room 112. -
FIG. 1 also shows that the user (or another user) may be in one of thechairs 116, or that the user (or another user) may be at alocation 122 that is located at a distance further fromdevice 102 than eitherpositions chairs 116, the user may be viewing a presentation being give by another person, or attending a teleconference and viewing images on touchsensitive display screen 110. When the user is atlocation 122, the user may be either approachingdevice 102 or moving away fromdevice 102, or simply standing or sitting at thelocation 122, and observingdevice 102. - In
FIG. 1 ,cameras device 102 so that they have overlapping fields of vision that encompass a majority ofconference room 112, but are generally tilted downward slightly relative to a horizontal plane inconference room 112. Because the field of view of each camera is, for instance, approximately 95 degrees, they are illustratively positioned to be directed inward relative tolongitudinal axis 108. In one embodiment, aline 109 perpendicular to the center of the camera's view (generally indicated by line 111) is offset fromlongitudinal axis 108 by an angle α that is approximately 30 degrees. In other words, thecenter 111 of the fields of view is directed inward relative tolongitudinal axis 108 so the angle formed byaxis 108 andline 111 is less than 90 degrees and may be approximately 30 degrees. - In one embodiment, regardless of the cameras' fields of view, the cameras are illustratively positioned so that they capture the face of the user when the user is either standing in front of screen 110 (such as at position 118) or to the side of screen 110 (such as at position 120). Therefore, when the user is working at the touch
sensitive screen 110, at least one ofcameras cameras positions display screen 110. In one embodiment, the distance d is approximately 10-14 inches. Of course, this is an illustrative range, and the distance d could be other distances as well. In any case,cameras device 102 so that they capture an image of the user who is either standing in front ofscreen 110 and located at least as close as 10-14 inches from the screen (or further away) and when the user is standing off to the side ofdevice 102 and located a distance of 10-14 inches (or beyond) from the screen. In addition, the fields of view ofcameras conference room 112. -
FIG. 2 is a top view of another embodiment ofarchitecture 100, in which similar items are similarly numbered to those shown inFIG. 1 . However, in the embodiment shown inFIG. 2 ,cameras cameras Cameras cameras FIG. 1 and may be approximately 140 degrees. Therefore, they are positioned relative to thelongitudinal axis 108 ofdevice 102 so that their fields of view overlap in a way that is substantially parallel to, and adjacent, the surface ofscreen 110. The overlapping fields of view ofcameras conference room 112, and so that they capture an image of the user when the user is located in front of screen 110 (such as in position 118) or to the side ofscreen 110, such as inposition 120. In the embodiment shown inFIG. 2 ,cameras axis 108 by approximately 20 degrees. In other words, thecenter 127 of the fields of view is directed inward relative tolongitudinal axis 108 so the angle formed byaxis 108 andline 127 is less than 90 degrees and may be approximately 20 degrees. - In a variety of different embodiments, as will be discussed below,
device 102 switches the outgoing video for the conference between the two cameras based on a variety of different factors. In addition,device 102 controls various user input mechanisms, the displays displayed onscreen 110, the power up and power down scenarios, as well as a variety of other items that influence the user's experience in interacting withdevice 102, based on a wide variety of different parameters, including how the user is moving, where the user is located, how the user is interacting with thedevice 102, etc. These are described below in greater detail. -
FIG. 3 is a more detailed block diagram of one embodiment ofmultimedia processing architecture 100. The more detailed diagram ofmultimedia processing architecture 100 includesconferencing system 130.System 130, itself, includesmultimedia processing system 138 and a plurality of different user input/output (I/O)mechanisms 140.FIG. 3 also shows thatconferencing system 130 can illustratively be connected for conferencing with one or more remote systems, such as aremote system 131, over acommunication channel 133 so thatuser 132 can communicate, usingconferencing system 130, with aremote user 135.Communication channel 133 can include one or more of a variety of different types of communication channels, such as a wide area network, a cellular or switched telephone network, a local area network, or a wide variety of other communication channels. -
User 132 interacts withconferencing system 130 either directly, as indicated byarrow 134, or through one or moredifferent user devices 136. For instance,user 132 may interact withconferencing system 130 using a mobile device (such as a smart phone, a tablet computer, or a palmtop computer) using a laptop or desktop computer, etc. Of course,user 132 can also interact directly withsystem 130 using the various user I/O mechanisms and sensors provided inconferencing system 130. -
Multimedia processing system 138 includesdata store 142.Data store 142 can includeapplications 144,operating systems 146,control programs 148,data 150 andother items 152.Multimedia processing system 138 also includesprocessor 154, touch sensitivedisplay control component 156,conferencing subsystem 158, local/widearea network subsystems 160, collaborativedisplay control component 162,audio control component 164,camera control component 166,power management component 168, and speech/natural language component 170.Multimedia processing system 138 can also include othersensor control systems 172 and a variety of other items as well, as indicated byblock 174. -
Multimedia processing system 138 is shown as interacting with various user input/output (I/O) mechanisms andsensors 140. Such sensors can include touch sensitive display device 102 (also shown inFIGS. 1 and 2 ), one ormore styluses 176,cameras block 178 inFIG. 3 , one or moreaudio speakers 180, touchlessnatural input device 182,microphones 184, a variety of other sensors (such as light sensors, motion sensors, sound sensors, etc.) as indicated byblock 186 and otheruser input mechanisms 188. -
FIG. 3 shows thatdata store 142 is a single data store and is local tomultimedia processing system 138. It should be noted, however, thatdata store 142 can be remote fromsystem 138, and accessed bysystem 138. It can also be multiple different data stores, all of which are local tosystem 138, all of which are remote therefrom, or some of which are local while others are remote. The illustration shown inFIG. 3 is exemplary only. -
Processor 154 is illustratively a computer processor with associated memory and timing circuitry, not separately shown. It is a functional part ofsystem 138 andarchitecture 100, and is activated by the various other components or items inarchitecture 100 to facilitate their functionality. - Touch sensitive
display control component 156 is illustratively a control component that controls the various displays on the touchsensitive display screen 110 ofdevice 102. The various ways that the display can be controlled are described more specifically below with respect toFIGS. 4-9 . Of course, these are exemplary descriptions only. -
Conferencing subsystem 158 illustratively provides functionality to manage and control conferencing capabilities ofarchitecture 100. For instance, it provides the functionality to initiate communications withremote system 131 overcommunication channel 133. Of course, this can be performed by multiple different components as well, and the component shown inFIG. 3 is shown for the sake of example only. - Local/wide
area network subsystem 160 illustratively provides functionality for enabling communication over a local or wide area network. It also illustratively provides functionality for performing near field communication or other types of networking using wireless or wired communication. - Collaborative
display control component 162 illustratively provides the functionality for generating and controlling a collaborative display on the touchsensitive display device 102. For instance,component 162 illustratively generates a collaborative note taking display, whiteboard display, etc., on the touch sensitive display device, and processes the user inputs (from local and remote users) to modify the display accordingly. -
Audio control component 164 illustratively provides the control functionality for controllingspeakers 180 andmicrophones 184. For instance,audio control component 164 illustratively switches the active speaker based upon the location of the user relative to the display device, or based upon other parameters, as are described in more detail below. -
Camera control component 166 illustratively receives and processes a variety of parameters to controlcameras 178. For instance,component 166 illustratively controls which camera is automatically selected as the active camera to provide the outgoing video signal, based upon a variety of sensed parameters. Controlling the cameras and the outgoing video signals is described in greater detail below with respect toFIGS. 5 and 6 . -
Power management component 168 illustratively provides the functionality for managing the power of the various components, systems, subsystems and items inarchitecture 100. This can be done in a variety of different ways, such as based on sensed inputs, user position, etc. This is described in greater detail below with respect toFIG. 9 . - Speech/
natural language component 170 illustratively provides the functionality for receiving, recognizing, and acting on speech inputs. For instance,component 170 can illustratively include speech recognition components, voice recognition components, or other components that enable a user to speak commands or other speech inputs and have them understood and acted upon by the various items inarchitecture 100. - Other
sensor control system 172 illustratively receives sensor inputs from a variety of other sensors and user input mechanisms and provides command and control information based upon those inputs. This is exemplary only. - Touch
sensitive display device 102 is illustratively a large display that has touch sensing capability. For instance,device 102 can be a touch sensitive display ranging from, for instance, a twelve inch display to an 82 inch display, or an even larger display. It illustratively provides touch capability so that it can support touch gestures input by a user, using the user's finger, a stylus, another type of pen or pointer, etc. It can illustratively provide a high resolution display (such as a quad HD display) that renders text, ink, and large amounts of content in a very expeditious manner. It also illustratively provides multi-touch capability. Thus,device 102 may illustratively support unlimited touch points, sub-millimeter touch precision, near-zero parallax, ultra-low latency touch response and pen and stylus support, although these need not all be supported. - The touch sensitive
display control component 156 illustratively runs code which controls the display. Thus,display device 102 can be a presentation surface that is used by a user (or presenter) who is making a presentation to other individuals in the office. It can also illustratively be operated as a collaborative whiteboard, that enables multiple users across multiple different devices (some of which can be remote) to collaborate on a note taking system, a word processing system, a drawing system, or on any other type of system. -
Styluses 176 can illustratively be connected by hardware cables or they can be wireless devices that can be used as pointing devices or to perform other stylus functions, on touchsensitive display device 102. Some of the stylus functionality is described in greater detail below. - As briefly discussed above with respect to
FIGS. 1 and 2 ,cameras 178 can be two different cameras that are configured to provide a wide field of view. They illustratively support viewing people located adjacent the display device, (such as those working atdisplay screen 110 or presenting from it) and up to 20 feet away or more.Camera control component 166 illustratively controls which camera is active, and it can also control various functions, such as cropping, pan, tilt and zoom, etc., some of which are described in greater detail below. -
Speakers 180 are illustratively physically located relative to displaydevice 102, andcameras 178, so that they provide audio that corresponds to the incoming and outgoing video. By way of example, if a remote user's video image is displayed on one side ofdisplay screen 110 ofdevice 102, then the active speaker that provides the audio for that remote user is also the speaker located on that side of the display device. This is described in greater detail below as well. - Similarly,
microphones 184 are illustratively directional microphones, or a microphone array, that is located relative to displaydevice 102 so that it can pick up audio from various users located in different locations relative to displaydevice 102. In one embodiment,microphones 184 are a microphone array mounted to the top ofdisplay device 102. When fully utilized, the microphone array produces a signal or set of signals that indicate where a user is located (e.g., from a left/center/right horizontal perspective).Audio control component 164 can illustratively control whichmicrophones 184 are active based upon the location of various users relative todisplay device 102, and based upon other parameters as well. - Touchless
natural input device 182 can take a wide variety of different forms. For instance, in one embodiment, it includes a motion sensing input device for a game or other console. It is based around a webcam style peripheral device that enables users to control and interact with the console without touching a controller. This can be done, for instance, using a natural user interface that detects gestures and spoken commands. It can use an infrared projector and camera to track the movements of objects and individuals in three-dimensions. It can include a camera, a depth sensor and a multi-array microphone that provides full-body, three-dimensional motion capture, facial recognition and voice recognition capabilities. This is exemplary only. -
Other sensors 186 can include light sensors (such as for sensing when someone turns on a light in a conference room or for sensing other light conditions in the vicinity of device 102) motion sensors, for sensing things such as when individuals enter the conference room or move about within the conference room, and sound sensors that can pick up and identify various sounds, in addition tomicrophones 184. Of course, other or differentuser input mechanisms 188 can be used as well, and these can include keyboards, keypads, displayed (touch sensitive) control components such as soft keyboards, icons, links, dynamic links or tiles, buttons, and other hardware input mechanisms, such as pointing devices (like a mouse or track ball), and a wide variety of other user input mechanisms. The mechanisms can be actuated using a wide variety of different methods as well, such as voice commands, touch gestures, stylus inputs, etc. -
FIG. 4 is a flow diagram showing one embodiment of the operation ofpower management component 168 in automatically powering up and powering downconferencing system 130. It will be noted thatsystem 130 can be manually powered up and powered down by a givenuser 132 who simply actuates an appropriate user inputmechanism causing system 130 to power up or power down. For instance,user 132 can simply actuate a power button to turn the system on and off. However,FIG. 4 shows one embodiment of the operation ofpower management component 168 in automatically powering up or powering down the system, based on a variety of different sensed parameters. - In one embodiment,
power management component 168 first detects the presence of a user somewhere in the vicinity ofsystem 130. This is indicated byblock 200 inFIG. 4 . In one embodiment,power management component 168 receives inputs from a variety of the sensors oruser input mechanisms 140 that indicate that the user is present. By way of example,component 168 can receive an input from amicrophone 184, a motion sensor, acamera 178, or a variety of other mechanisms that indicate that the user has walked into theconference room 112 wheresystem 130 is deployed, or elsewhere in the vicinity ofsystem 130. This is indicated byblock 202. -
Power management component 168 can also detect (such as by a light sensor input or a camera input) that a user has turned on a light in theconference room 112 or elsewhere in the vicinity ofsystem 130. This is indicted byblock 204.Component 168 can also detect that a user is approaching the device based on an input from a camera or an input from a motion sensor or otherwise. This is indicated byblock 206. Of course,component 168 can detect the user's presence in other ways as well, such as by receiving an audio input or other inputs, and this is indicated byblock 208. - Once
component 168 has detected the user's presence,component 168 powers upconferencing system 130. However, in one embodiment,component 168 powers up only a subset of the parts of the system so the system is not fully powered up, in that all subsystems and components are not powered up at that time. This is indicated byblock 210 inFIG. 4 . By way of example,component 168 can power up the touchsensitive display device 102 but keep the backlight off, so thatdevice 102 is not fully powered up. This is indicated byblock 212. In doing this,component 168 can perform part of the power up process for the device so that when the user actually approaches the device or begins to use the device, the remaining part of the power up sequence does not take as long. However, by keeping the backlight off,device 102 is not distracting to people in its vicinity. -
Component 168 can power up other parts of the conferencing system, but keep a different subset of its components or subsystems powered down, in other ways as well. This is indicated byblock 214. - Once the user takes action relative to
conferencing system 130,component 168 can analyze this action to determine whether it indicates that the user is entering a full system power up scenario. This is indicated byblock 216 inFIG. 4 . - By way of example, if
component 168 detects (through appropriate sensor inputs) that a user is approaching the touchsensitive display device 102, this may be a power up scenario socomponent 168 powers up the rest of the system. This is indicated byblock 218. - If the user approaches another user input mechanism (such as a stylus) or picks up a user input mechanism or otherwise touches a user input mechanism, this can also indicate that the user wishes to have the entire system powered up. This is indicated by
block 220 inFIG. 4 . -
Component 168 can also detect thatuser 132 has plugged in another type of user device into system 130 (such as a laptop computer, a tablet computer, a smart phone, or another device). This can be interpreted as the user wishing to power up the system as well, and this is indicated by block 222 inFIG. 4 . - Of course, if
user 132 provides a voice command (which is received and understood by speech/natural language component 170) this can indicate that the user wishes to power up the system. This is indicated byblock 224 inFIG. 4 . - Other processing can be performed as well, in order to determine whether the user is entering a power up scenario. For instance, where
conferencing system 130 allows a user to reserve a teleconference or meeting time or to schedule a teleconference or meeting, the user may be permitted to identify the leader or presenter at the teleconference or meeting. If the leader or presenter is known to system 130 (such as by having profile data stored indata store 142 for the leader or presenter), thensystem 130 can identify when the leader or presenter enters the room. By way of example, it may be that the leader or presenter is carrying an RFID badge or other wireless communication device, a smart phone or other mobile device that is known bysystem 130 to identify the leader or presenter. Ifsystem 130 detects the presence of that device, thensystem 130 can indicate topower management component 168 that the leader or presenter for the teleconference or meeting that is currently scheduled has entered the room. In that case,component 168 can power up the system as well. Of course, where the profile information for the leader or presenter includes facial recognition information, then, using a camera input,system 130 can identify that the presenter or leader has entered the room, based upon the presenter's or leader's facial features. Identifying that the leader or presenter has entered the room or is in the vicinity ofsystem 130 is indicated byblock 226 inFIG. 4 . - It will be appreciated that system 130 (and component 168) can identify that the user wishes to power up the system in other ways as well. This is indicated by
block 228. The particular ways described above are exemplary only. - Once
power management component 168 has identified a power up scenario, it illustratively turns on touchsensitive display device 102 to the fully powered up state. This is indicated byblock 230 inFIG. 4 . Power management of the various subsystems can be performed as well, and this is discussed in more detail below with respect toFIG. 9 . - Suffice it to say at this point, that the system is sufficiently powered up so that the user can perform various interactions with the system. Having the user interact with the system is indicated by
block 232 inFIG. 4 . Thesystem 130 then performs various actions based upon the user interactions. A variety of these interactions are discussed below with respect to the remaining figures. This is indicated byblock 234 inFIG. 4 . - At some point,
power management component 168 detects a likely power down scenario. This is indicated byblock 236. As with the power up scenario, the power down scenario can be detected using a wide variety of different inputs. By way of example,component 168 can determine (such as through anaudio input 237, a camera input, a light sensor input, etc.) that all of the participants in the conference or meeting have left the conference room and have turned off the light. This is indicated byblock 238 inFIG. 4 . -
Component 168 can determine that there has been no pixel movement within the field of view ofcameras 178 for a predetermined time. This may indicate that nobody is in the room or that the system should be powered down, because nobody is moving and no one is approaching the touchsensitive display device 102. This is indicated byblock 240 inFIG. 4 . - Where the presentation or conference is a teleconference,
component 168 can be notified byconferencing subsystem 158 that the user has hung up the call. This can indicate that at least part ofsystem 130 should be powered down, and this is indicated byblock 242 inFIG. 4 . - Where the conference or presentation is a whiteboard presentation or another presentation using touch
sensitive display device 102,component 168 can identify a potential power down scenario when the user has closed the presentation application that is being used to make the presentation. This is indicated byblock 244. - It will be appreciated that potential power down scenarios can be detected in a wide variety of other ways as well. This is indicated by
block 246 inFIG. 4 . - In response to identifying a power down scenario,
power management component 168 illustratively powers downconferencing system 130. This is indicated byblock 248 inFIG. 4 . This can be done in a variety of different ways as well. Touch sensitivedisplay control component 156 can generate a prompt for the user on touchsensitive display device 102. For instance, the prompt can ask the user whether the user wishes to power down the system, and wait for a user input. Prompting the user is indicated byblock 250 inFIG. 4 . Touch sensitivedisplay control component 156 can generate and display a power down message and power the system down without waiting for a user input. This is indicated byblock 252 inFIG. 4 . - The
component 168 can power down the system in a variety of other ways as well, such as by generating an audio prompt or an audio power down message, such as by simply powering the system down without generating a prompt or a message, or in other ways. This is indicated byblock 254 inFIG. 4 . -
FIG. 5 is a flow diagram illustrating one embodiment of the operation ofcamera control component 166 in controlling which camera 178 (or whichcamera FIGS. 1 and 2 ) generates the outgoing video stream. In one embodiment, apower management component 168 powers up both cameras without sending an outgoing video stream from either of them. This is indicated byblock 260 inFIG. 5 .Camera control component 166 then determines whether an active camera has been selected manually by either a local user or a remote user. This is indicated byblock 262. By way of example, alocal user 162 can illustratively approach one of cameras 178 (or touch sensitive display device 102) and actuate a suitable user input mechanism to manually select one of the cameras as the active camera. Also, in one embodiment, aremote user 135 can actuate a suitable user input mechanism to select one of the cameras as an active camera as well. If this is the case, thencamera control component 166 simply activates the manually selected camera as the active camera. If not, however, thencamera control component 166 performs an automatic camera selection analysis based on a variety of inputs, in order to identify one of the cameras as the camera that should be activated. Performing the automatic camera selection analysis is indicated byblock 264 inFIG. 5 . - In performing the analysis,
camera control component 166 can base the analysis on a wide variety of input criteria. For instance,camera control component 166 can receive an audio input 265 and analyze it to identify a location of a speaker or other parameter. - In addition,
camera control component 166 can analyze the video stream generated by the cameras to determine whether either of the cameras is blocked by a large object. If so,camera control component 166 can select the other camera as the active camera. Determining whether a camera is blocked by a large object is indicated byblock 266 inFIG. 5 . This may happen, for instance, where a user is making a presentation both locally, and to remote users. If the user has his or her back turned to the active camera and his or her head is closely proximate the active camera, thencamera control component 166 determines that the user is blocking that camera, and selects the opposite camera as being the active camera, to provide the outgoing video. - Also, in one embodiment,
camera control component 166 can determine whether a user is facing the camera, but is in closer proximity to one camera than to the other camera. Referring, for example, toFIG. 2 , if the user is located inlocation 118, such that the user is closer tocamera 124, and facingdisplay screen 110, then controlcomponent 166 illustratively selectscamera 124 as the active camera so that the user's face can be captured, even though the user is close to thedisplay screen 110. Using the location of a person close to the screen (such as the left side or the right side) to select a camera is indicated byblock 268 inFIG. 5 . -
Camera control component 166 can also receive inputs from other sensors (such as a motion sensor) to indicate whether there is movement close to one of the cameras. If so,camera control component 166 can select that camera as the active camera. Receiving a motion sensor input is indicated byblock 270 inFIG. 5 . -
Camera control component 166 can also use facial recognition to select the active camera. By way of example, it may be that the user's or presenter's face can be recognized bysystem 130, based upon facial recognition profile information, or otherwise. In that case,camera control component 166 can select, as the active camera, the particular camera that gives the best view of the presenter's or leader's face, no matter where that person is in the room. Using facial recognition to select the active camera is indicated byblock 272 inFIG. 5 . -
Camera control component 166 can also use inputs from other sensors or user input mechanisms in order to select the active camera. For instance, if the user touches touchsensitive display device 102 at a given location onscreen 110,component 166 can select the camera closest to that location as the active camera. Further, if the user picks up or touches one of thestyluses 176,component 166 can select, as the active camera, the camera that is closest to that stylus. Further, using microphone beam forming, the location of a given user's voice can be roughly located and the camera closest to that user can be selected as the active camera. This can also help for users in the room who are, for example, on the far right side of the room. Since the microphone can detect that, it can swap to the left camera which would have a better view of the person further down on the right. For instance, if the presenter is making a presentation, but a member of the local audience is asking a question, the audio beam forming process can identify, in general terms, the location of that user, or the general direction of that user.Component 166 can then activate the camera that gives the best view of that location. Selecting a camera based upon locations of any user interactions with the screen or other user input devices is indicated byblock 274 inFIG. 5 . -
Component 166 can select a camera as the active camera in other ways as well. For example, where thecomponent 166 receives a sensor input indicating that a member of the audience is approaching the touchsensitive display 102,component 166 can select, as the active camera, the one that gives the best view of that user's location as they approach the touchsensitive display 102. Selecting a camera as the active camera in other ways is indicated byblock 276 inFIG. 5 . - Based upon the analysis,
component 166 then selects one of the cameras as the active camera. This is indicated byblock 278 inFIG. 5 . -
Component 166 then activates the selected camera. This is indicated byblock 280. In one embodiment,camera control component 166 keeps the non-selected camera on, but in a non-broadcasting state so that it does not provide the outgoing video. This can assist in the camera switching process. For instance, wherecomponent 166 switches back and forth between the cameras at a relatively frequent rate, keeping both cameras on (even though only one at a time is selected) can make the switching process quicker, because the power up sequence for the selected camera does not need to be fully under taken. - Activating the selected camera can be done in a number of different ways as well. For instance,
component 166 can first control the selected camera so that it provides the outgoing video toconferencing subsystem 158. This is indicated byblock 282 inFIG. 5 . Also, in one embodiment,component 166 provides some visual indication that indicates which camera is the selected and active camera. This can be done, for instance, by turning on a light (such as an LED or another source of illumination) that is mounted todevice 102 closely proximate the selected camera. This is indicated byblock 284. In addition,component 166 can indicate toaudio control component 164 which camera is the selected camera, andaudio control component 164 can then activate the speaker that is associated with the selected camera so that the speaker mounted todevice 102 next to the selected camera is turned on, or made louder, etc. This is indicated byblock 286. In addition, where motion sensors are located proximate each of the cameras,camera control component 166 can indicate tosensor control system 172 which of the cameras is selected as the active camera, andsystem 172 can then activate the motion sensor that is mounted todevice 102 and located closely proximate the selected camera. This is indicated byblock 288 inFIG. 5 . - Further, other actions can be taken based upon which camera is the selected camera as well. For instance, when a presenter is closely proximate the touch
sensitive display device 102, and one of the cameras is activated, that may indicate that the user is closer to that camera than the opposite camera. In that case, touch sensitivedisplay control component 156 illustratively displays the incoming video of remote users, along with the touch sensitive pallet of control components, on the side closest to the selected camera. This can make it easier for the user to control the system. - By way of example, and again referring to
FIG. 2 , assume thatuser 132 is facingdisplay 110 inposition 118. In that embodiment,camera control component 166 illustratively selectscamera 124 as the active camera to obtain an image of the user's face, when the user is located inposition 118. Because the user is closer tocamera 124 than tocamera 126, touch sensitivedisplay control component 156 also illustratively switches the display of the incoming video ondisplay 110 so that it is closelyproximate location 118 ondisplay 110. Further,component 156 can display touch sensitive control mechanisms on the user interface display at a location that is close tolocation 118, so that the user can easily actuate those control mechanisms using touch gestures ondisplay 110. Collocating the other displays in this way is indicated byblock 290 inFIG. 5 .Camera control component 166 can, of course, perform other actions based upon which camera is activated. This is indicated byblock 292. -
FIG. 6 shows one embodiment of a touchsensitive display device 102, which is similar to that shown inFIG. 2 . Similar items are similarly numbered. Thus, it can be seen thatcameras display 110. Each camera has an associated light source (e.g., a LED) 300 and 302, respectively. Also, there is illustratively aspeaker proximately camera motion sensors proximate cameras -
FIG. 6 shows that display 110 is currently displaying acollaborative workspace 312 that allows a user to collaborate with other, remote or local users, to perform work oncollaborative workspace 312. It can be seen that, in the example shown inFIG. 6 , the users have generated apie chart 314 and a set ofnotes 316 on the collaborative workspace. Of course, a wide variety of other content or information can be displayed oncollaborative workspace 312 as well.FIG. 6 also shows thatdevice 102 includes first andsecond styluses display 110. Each stylus can be located in aholster 322 and 324, respectively, so that they can be removed and used by a user to point to or draw oncollaborative workspace 312, or anywhere else on touchsensitive display 110. - In the embodiment shown in
FIG. 6 ,camera control component 166 has identified that the user is approximately in the location 120 (shown inFIG. 2 ) which is closer tocamera 126, than tocamera 124. Therefore,camera control component 166 has illustratively selectedcamera 126 and activated it. In one embodiment,camera control component 166 has also illuminatedlight source 302 to give a visual indication thatcamera 126 is the active camera.Component 166 also illustratively communicates with the other components inmultimedia processing system 138 to activatespeaker 306 andmotion sensor 310, both of which are also closer tocamera 126 than tocamera 124. - Based on the selection of
camera 126 as the active camera, collaborativedisplay control component 162 moves thecollaborative workspace 312 to the opposite side ofdisplay 110 so that touch sensitivedisplay control component 156 can display the remote user video images (e.g., the incoming videos) in a location ofdisplay 110 that is closelyproximate camera 126. The remote user video images are indicated byblocks image 330 is larger than image 332). - Further,
component 156 also displays the control user input mechanisms, which can be actuated using touch gestures to controldevice 102, on a region ofdisplay 110 that is also closer tocamera 126 than tocamera 124. Because the user is located on that side of thedisplay device 102, the displayed controls are illustratively displayed close to the user so that they can be easily actuated by the user. The displayed controls are indicated byblock 334 inFIG. 6 .FIG. 6 also shows that, in one embodiment, because the user is standing closer tostylus 320 then tostylus 318,system 130 illuminates alight source 336 onstylus 320 so that the user can easily identify that stylus and use it. - Further, when the user reaches for a user input mechanism, the system can automatically display directions or other helpful information for using that mechanism. For instance, where the user reaches for one of displayed
controls 334, the system can automatically display adirection display 335 describing the control. - Referring again to the flow diagram of
FIG. 5 ,camera control component 166 can illustratively control the non-selected camera as capturing images to provide input to analyze a variety of different things, such as the acoustic dynamics of the conference room (or the vicinity of device 102). This is indicated byblock 350 inFIG. 5 . By way of example, the non-selected camera (e.g., camera 124) can be used to capture images that are analyzed for facial detection or facial recognition. This is indicated byblock 352.Camera 124 can also be used to capture images that are analyzed to determine the location of various people in the conference room or otherwise in the vicinity ofdevice 102. This is indicated byblock 354. Thenon-selected camera 124 can also be used to analyze the size of the conference room, or the acoustic characteristics of the room (such as whether it has drapes, carpeting, etc.). This is indicated byblocks non-selected camera 124 can also be used to capture images that can provide information to controlcomponent 166 in order to perform further camera switching analysis. This is indicated byblock 360. Of course, thenon-selected camera 124 can be used to provide other information as well. This is indicated byblock 362. -
Camera control component 166 can also perform a variety of other video actions, using the cameras, based upon a variety of inputs from user input/output mechanisms andsensors 140. This is indicated byblock 364 inFIG. 5 . By way of example,camera control component 166 can control the selected camera to crop and un-crop the images based upon the video being captured. For instance, where a user is approaching the camera,component 166 can crop tightly to that user's face. However, where a user is moving away from the camera,component 166 can un-crop in a gradual or continuous way, or in another way. This is indicated byblock 366 inFIG. 5 . -
Camera control component 166 can also control the selectedcamera 166 to perform tilt, pan and zoom operations. This is indicated byblock 368. By way of example, where the presenter or a speaker is identified,component 166 can control the selected camera to follow that person and to maintain an image of that person, using tilt, pan and zoom functions on the camera. Of course, these functions can be used to perform other operations as well. -
Control component 166 can also perform other video operations based on a variety of different inputs. This is indicated byblock 370 inFIG. 5 . - In one embodiment,
camera control component 166 continues to perform these operations untilpower management component 168 determines that a power down condition exists for that camera. This is indicated byblock 372 inFIG. 5 . When that happens,power management component 168 powers down the camera. This is indicated byblock 374. -
FIG. 7 is a flow diagram illustrating one embodiment of the operation of touch sensitivedisplay control component 156 in generating a display of the incoming video, and also of displaying various other images and generating audio outputs fromdevice 102.FIG. 8 is one exemplary user interface display.FIGS. 6-8 will now be described in conjunction with one another. -
Control component 156 first (using inputs from user input/output mechanisms and sensors 140) receives an indication as to the general position of a user. This is indicated byblock 400 inFIG. 7 . In one embodiment,component 156 can identify the horizontal location of the user relative to display device 102 (e.g., whether the user is closer tocamera 124 or camera 126). This is indicated byblock 402. However,component 156 can also illustratively identify the user's height. This is indicated byblock 404.Component 156 can usecameras display screen 120. This is indicated byblock 406. Of course,component 156 can obtain this information from a touchlessnatural input device 182 or other sensors as well. In addition,component 156 can detect the user's location or position in other ways as well. This is indicated byblock 408. -
Component 156 then, in conjunction with other components insystem 138, controls the display of items ondisplay 110 based upon the user's location. This is indicated byblock 410 inFIG. 7 . First, as described with respect toFIG. 5 ,camera control component 166 can activate the camera nearest the user and turn on the light 300 or 302. This is indicated byblock 412. It can be seen inFIG. 6 that the user is located closer tocamera 126, while inFIG. 8 , the user is located closer tocamera 124. -
Control component 156 also displays the incoming video nearest the user (e.g., nearest the activated camera). This is indicated byblock 414. It can be seen that the remoteuser video images screen 110. InFIG. 6 , this is on the right hand side of the display, while inFIG. 8 this is on the left hand side of the display. When the incoming video images are moved from side to side, they can be controlled to perform any desired visual effect, such as sucking in to disappear, and inflating to reappear, etc. -
FIG. 7 also shows thatcomponent 156 illustratively displays the touch-sensitive controls 334 nearest the user as well. This is indicated byblock 416 inFIG. 7 . InFIG. 6 , they are displayed on the right side ofscreen 110, while inFIG. 8 they are displayed on the left side of the screen.FIG. 7 also indicates that the controls can illustratively be displayed at an appropriate height. For instance, since the height of the user can be determined based upon the sensor inputs, if the user is tall, the controls can be displayed higher. If the user is shorter, the controls can be displayed lower. In addition, the touch sensitive gestures can be adjusted as well. By way of example, it is not uncommon for certain touch gestures to ask the user to swipe from the top of the screen down, or from the left or right of the screen in the opposite direction. When the user is relatively small in stature, it may be difficult for the user to reach the top of the screen, or either side. Therefore, the touch gestures can be modified so that the user does not have to reach all the way to the top of the screen or to either side of the screen, in order to invoke the necessary control, given those types of touch gestures. - In another embodiment,
system 138 activates the user input mechanisms that are closest to the user. For instance, as described above, the stylus that is closest to the user's position may be activated. InFIG. 6 , this isstylus 320, while inFIG. 8 , this isstylus 318. Activating the user input devices nearest the user is indicated byblock 418 inFIG. 7 . - Further,
audio control component 164 activates the speaker nearest the user so that the incoming audio is played from the speaker nearest the user. This is indicated byblock 420. -
Display control component 156 also illustratively displays thecollaborative workspace 312 in an appropriate location. This is indicated byblock 422. This can be displaying theworkspace 312 closest to the user, or on the opposite side as the user, or directly in front of the user, or otherwise. -
System 138 also illustratively activates the motion and other sensors nearest the user. This is indicated byblock 424. Of course, touch sensitivedisplay control component 156 can take other actions based on the detected user position. This is indicated byblock 426. - The various components in
system 138 continue to perform this type of displaying of the various components onuser interface display 110, and to activate the various user input mechanisms, based upon the user position and other detected inputs until a power down condition is detected. This is indicated byblock 428. When that occurs, the various components and systems and subsystems can be powered down, as desired. This is indicated byblock 430. -
FIG. 9 is a flow diagram illustrating one embodiment in whichpower management component 168 manages the power for various subsystems, even when most ofsystem 130 is powered up. For instance,component 168 first determines that the system is to be powered up either partially or fully. This is indicated byblock 432 inFIG. 9 .Component 168 can then be provided with inputs that allow it to determine whether anyone is relatively close to touchsensitive display device 102, or to one of the user input/output mechanisms 140. This is indicated by block 434. If so,power management component 168 powers up the subsystems near the user. This is indicated byblock 436. By way of example, if the user is nearstylus 320,power management component 168 provides power to that stylus, while keepingstylus 318 powered down. - However, if, at block 434, no one is detected as being near touch
sensitive display device 102, thenpower management component 168 illustratively powers off various subsystems that are on ornear display device 102. This is indicated byblock 438. - By way of example, if no one is near the
display device 102, thenpower management component 168 can power down the touch sensing mechanisms on the display device. This is indicated byblock 440. Also, if no one isnear device 102, thenpower management component 168 can power down both styluses. This is indicated byblock 442.Power management component 168 can power down other subsystems or components as well. This is indicated byblock 444. - When
power management component 168 is provided with various inputs that indicate that a user is approaching the display device,power management component 168 illustratively powers up the appropriate components or subsystems. This is indicated byblock 446. For instance, if a user is approaching the right hand side of the display device, thenpower management component 168 may illustratively power up the corresponding stylus or other user input mechanisms on that side ofdevice 102. Powering up the subsystems near the user is indicated byblock 448 inFIG. 9 . -
Power management component 168 illustratively continues to control power management of the system in these various ways until a power down scenario is detected. This is indicated byblock 450. When that occurs,power management component 168 powers down the desired systems, subsystems, components, etc. This is indicated byblock 452. - This is not an exhaustive list of power management features, and others can be implemented as well. For example,
system 130 can have knowledge of a calendar for thedevice 102 or conference room in which it is located.Component 168 can use the time and date when meetings are supposed to start, along with attendee information, to control power management.Component 168 can, for instance, automatically power updevice 102 and call other attendees of a meeting, or call into a conference call, without user interaction. This can be done based on meeting start time and conference call or attendee information. -
FIG. 10 is a block diagram ofarchitecture 100, shown inFIG. 1 , except that its elements are disposed in acloud computing architecture 500. Cloud computing provides computation, software, data access, and storage services that do not require end-user knowledge of the physical location or configuration of the system that delivers the services. In various embodiments, cloud computing delivers the services over a wide area network, such as the internet, using appropriate protocols. For instance, cloud computing providers deliver applications over a wide area network and they can be accessed through a web browser or any other computing component. Software or components ofarchitecture 100 as well as the corresponding data, can be stored on servers at a remote location. The computing resources in a cloud computing environment can be consolidated at a remote data center location or they can be dispersed. Cloud computing infrastructures can deliver services through shared data centers, even though they appear as a single point of access for the user. Thus, the components and functions described herein can be provided from a service provider at a remote location using a cloud computing architecture. Alternatively, they can be provided from a conventional server, or they can be installed on client devices directly, or in other ways. - The description is intended to include both public cloud computing and private cloud computing. Cloud computing (both public and private) provides substantially seamless pooling of resources, as well as a reduced need to manage and configure underlying hardware infrastructure.
- A public cloud is managed by a vendor and typically supports multiple consumers using the same infrastructure. Also, a public cloud, as opposed to a private cloud, can free up the end users from managing the hardware. A private cloud may be managed by the organization itself and the infrastructure is typically not shared with other organizations. The organization still maintains the hardware to some extent, such as installations and repairs, etc.
- In the embodiment shown in
FIG. 10 , some items are similar to those shown inFIGS. 1-3 and they are similarly numbered.FIG. 10 specifically shows thatmultimedia processing system 138 is located in cloud 502 (which can be public, private, or a combination where portions are public while others are private). Therefore,user 132 uses touchsensitive display device 102 to access those systems throughcloud 502. -
FIG. 10 also depicts another embodiment of a cloud architecture.FIG. 10 shows that it is also contemplated that some elements ofarchitecture 100 are disposed incloud 502 while others are not. By way of example,data store 142 can be disposed outside ofcloud 502, and accessed throughcloud 502. In another embodiment, collaborative display control component 162 (or other components) is also outside ofcloud 502. Regardless of where they are located, they can be accessed directly by device 504, through a network (either a wide area network or a local area network), they can be hosted at a remote site by a service, or they can be provided as a service through a cloud or accessed by a connection service that resides in the cloud. All of these architectures are contemplated herein. - It will also be noted that
architecture 100, or portions of it, can be disposed on a wide variety of different devices. Some of those devices include servers, desktop computers, laptop computers, tablet computers, or other mobile devices, such as palm top computers, cell phones, smart phones, multimedia players, personal digital assistants, etc. -
FIG. 11 is one embodiment of a computing environment in whicharchitecture 100, or parts of it, (for example) can be deployed. With reference toFIG. 11 , an exemplary system for implementing some embodiments includes a general-purpose computing device in the form of acomputer 810. Components ofcomputer 810 may include, but are not limited to, a processing unit 820 (which can comprise processor 154), asystem memory 830, and asystem bus 821 that couples various system components including the system memory to theprocessing unit 820. Thesystem bus 821 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus. Memory and programs described with respect toFIG. 3 can be deployed in corresponding portions ofFIG. 11 . -
Computer 810 typically includes a variety of computer readable media. Computer readable media can be any available media that can be accessed bycomputer 810 and includes both volatile and nonvolatile media, removable and non-removable media. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer storage media is different from, and does not include, a modulated data signal or carrier wave. It includes hardware storage media including both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed bycomputer 810. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of any of the above should also be included within the scope of computer readable media. - The
system memory 830 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 831 and random access memory (RAM) 832. A basic input/output system 833 (BIOS), containing the basic routines that help to transfer information between elements withincomputer 810, such as during start-up, is typically stored inROM 831.RAM 832 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processingunit 820. By way of example, and not limitation,FIG. 11 illustratesoperating system 834,application programs 835,other program modules 836, andprogram data 837. - The
computer 810 may also include other removable/non-removable volatile/nonvolatile computer storage media. By way of example only,FIG. 11 illustrates ahard disk drive 841 that reads from or writes to non-removable, nonvolatile magnetic media, amagnetic disk drive 851 that reads from or writes to a removable, nonvolatilemagnetic disk 852, and anoptical disk drive 855 that reads from or writes to a removable, nonvolatileoptical disk 856 such as a CD ROM or other optical media. Other removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. Thehard disk drive 841 is typically connected to thesystem bus 821 through a non-removable memory interface such asinterface 840, andmagnetic disk drive 851 andoptical disk drive 855 are typically connected to thesystem bus 821 by a removable memory interface, such asinterface 850. - Alternatively, or in addition, the functionality described herein can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs), Program-specific Integrated Circuits (ASICs), Program-specific Standard Products (ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.
- The drives and their associated computer storage media discussed above and illustrated in
FIG. 11 , provide storage of computer readable instructions, data structures, program modules and other data for thecomputer 810. InFIG. 11 , for example,hard disk drive 841 is illustrated as storingoperating system 844,application programs 845,other program modules 846, andprogram data 847. Note that these components can either be the same as or different fromoperating system 834,application programs 835,other program modules 836, andprogram data 837.Operating system 844,application programs 845,other program modules 846, andprogram data 847 are given different numbers here to illustrate that, at a minimum, they are different copies. - A user may enter commands and information into the
computer 810 through input devices such as akeyboard 862,touch screen 110, amicrophone 863, and apointing device 861, such as a mouse, trackball or touch pad. Other input devices such as those described above with respect toFIG. 3 can be used, and still others (not shown) may include a joystick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to theprocessing unit 820 through auser input interface 860 that is coupled to the system bus, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB). Avisual display 891 or other type of display device is also connected to thesystem bus 821 via an interface, such as avideo interface 890. In addition to the monitor, computers may also include other peripheral output devices such asspeakers 897 andprinter 896, which may be connected through an outputperipheral interface 895. - The
computer 810 is operated in a networked environment using logical connections to one or more remote computers, such as aremote computer 880. Theremote computer 880 may be a personal computer, a hand-held device, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to thecomputer 810. The logical connections depicted inFIG. 11 include a local area network (LAN) 871 and a wide area network (WAN) 873, but may also include other networks. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet. - When used in a LAN networking environment, the
computer 810 is connected to theLAN 871 through a network interface or adapter 870. When used in a WAN networking environment, thecomputer 810 typically includes amodem 872 or other means for establishing communications over theWAN 873, such as the Internet. Themodem 872, which may be internal or external, may be connected to thesystem bus 821 via theuser input interface 860, or other appropriate mechanism. In a networked environment, program modules depicted relative to thecomputer 810, or portions thereof, may be stored in the remote memory storage device. By way of example, and not limitation,FIG. 11 illustratesremote application programs 885 as residing onremote computer 880. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used. - It should also be noted that the different embodiments described herein can be combined in different ways. That is, parts of one or more embodiments can be combined with parts of one or more other embodiments. All of this is contemplated herein.
- Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims (20)
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/033,007 US20150085060A1 (en) | 2013-09-20 | 2013-09-20 | User experience for conferencing with a touch screen display |
PCT/US2014/056108 WO2015042160A2 (en) | 2013-09-20 | 2014-09-17 | User experience for conferencing with a touch screen display |
EP14781749.8A EP3047351A2 (en) | 2013-09-20 | 2014-09-17 | User experience for conferencing with a touch screen display |
CN201480051934.6A CN105683863A (en) | 2013-09-20 | 2014-09-17 | User experience for conferencing with a touch screen display |
US15/453,278 US9986206B2 (en) | 2013-09-20 | 2017-03-08 | User experience for conferencing with a touch screen display |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/033,007 US20150085060A1 (en) | 2013-09-20 | 2013-09-20 | User experience for conferencing with a touch screen display |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/453,278 Division US9986206B2 (en) | 2013-09-20 | 2017-03-08 | User experience for conferencing with a touch screen display |
Publications (1)
Publication Number | Publication Date |
---|---|
US20150085060A1 true US20150085060A1 (en) | 2015-03-26 |
Family
ID=51663478
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/033,007 Abandoned US20150085060A1 (en) | 2013-09-20 | 2013-09-20 | User experience for conferencing with a touch screen display |
US15/453,278 Active US9986206B2 (en) | 2013-09-20 | 2017-03-08 | User experience for conferencing with a touch screen display |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/453,278 Active US9986206B2 (en) | 2013-09-20 | 2017-03-08 | User experience for conferencing with a touch screen display |
Country Status (4)
Country | Link |
---|---|
US (2) | US20150085060A1 (en) |
EP (1) | EP3047351A2 (en) |
CN (1) | CN105683863A (en) |
WO (1) | WO2015042160A2 (en) |
Cited By (61)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160034121A1 (en) * | 2014-07-30 | 2016-02-04 | Wal-Mart Stores, Inc. | Method and Apparatus for Automatically Displaying Multiple Presentations for Multiple Users |
US20160041617A1 (en) * | 2014-08-07 | 2016-02-11 | Google Inc. | Radar-Based Gesture Recognition |
US9363476B2 (en) | 2013-09-20 | 2016-06-07 | Microsoft Technology Licensing, Llc | Configuration of a touch screen display with conferencing |
US20160274649A1 (en) * | 2014-03-07 | 2016-09-22 | Boe Technology Group Co., Ltd. | Power Supply Control Method for Display Device and Display Device |
CN106094942A (en) * | 2016-06-23 | 2016-11-09 | 广州派诺网络技术有限公司 | Smart meeting room control method |
US20170026700A1 (en) * | 2015-07-24 | 2017-01-26 | Samsung Electronics Co., Ltd. | Display apparatus and method for controlling a screen of display apparatus |
US9575560B2 (en) | 2014-06-03 | 2017-02-21 | Google Inc. | Radar-based gesture-recognition through a wearable device |
US9600080B2 (en) | 2014-10-02 | 2017-03-21 | Google Inc. | Non-line-of-sight radar-based gesture recognition |
US9693592B2 (en) | 2015-05-27 | 2017-07-04 | Google Inc. | Attaching electronic components to interactive textiles |
US9778749B2 (en) | 2014-08-22 | 2017-10-03 | Google Inc. | Occluded gesture recognition |
US9811164B2 (en) | 2014-08-07 | 2017-11-07 | Google Inc. | Radar-based gesture sensing and data transmission |
US9837760B2 (en) | 2015-11-04 | 2017-12-05 | Google Inc. | Connectors for connecting electronics embedded in garments to external devices |
US9848780B1 (en) | 2015-04-08 | 2017-12-26 | Google Inc. | Assessing cardiovascular function using an optical sensor |
US9933908B2 (en) | 2014-08-15 | 2018-04-03 | Google Llc | Interactive textiles |
US9942519B1 (en) | 2017-02-21 | 2018-04-10 | Cisco Technology, Inc. | Technologies for following participants in a video conference |
US9948786B2 (en) | 2015-04-17 | 2018-04-17 | Cisco Technology, Inc. | Handling conferences using highly-distributed agents |
US9986206B2 (en) | 2013-09-20 | 2018-05-29 | Microsoft Technology Licensing, Llc | User experience for conferencing with a touch screen display |
US9983747B2 (en) | 2015-03-26 | 2018-05-29 | Google Llc | Two-layer interactive textiles |
US10009389B2 (en) | 2007-01-03 | 2018-06-26 | Cisco Technology, Inc. | Scalable conference bridge |
US10016162B1 (en) | 2015-03-23 | 2018-07-10 | Google Llc | In-ear health monitoring |
US10084665B1 (en) | 2017-07-25 | 2018-09-25 | Cisco Technology, Inc. | Resource selection using quality prediction |
US10080528B2 (en) | 2015-05-19 | 2018-09-25 | Google Llc | Optical central venous pressure measurement |
US10088908B1 (en) | 2015-05-27 | 2018-10-02 | Google Llc | Gesture detection and interactions |
US10139916B2 (en) | 2015-04-30 | 2018-11-27 | Google Llc | Wide-field radar-based gesture recognition |
US10175781B2 (en) | 2016-05-16 | 2019-01-08 | Google Llc | Interactive object with multiple electronics modules |
US10241581B2 (en) | 2015-04-30 | 2019-03-26 | Google Llc | RF-based micro-motion tracking for gesture tracking and recognition |
US10268321B2 (en) | 2014-08-15 | 2019-04-23 | Google Llc | Interactive textiles within hard objects |
US10291597B2 (en) | 2014-08-14 | 2019-05-14 | Cisco Technology, Inc. | Sharing resources across multiple devices in online meetings |
US10291762B2 (en) | 2015-12-04 | 2019-05-14 | Cisco Technology, Inc. | Docking station for mobile computing devices |
US10300370B1 (en) | 2015-10-06 | 2019-05-28 | Google Llc | Advanced gaming and virtual reality control using radar |
US10310620B2 (en) | 2015-04-30 | 2019-06-04 | Google Llc | Type-agnostic RF signal representations |
US10375125B2 (en) | 2017-04-27 | 2019-08-06 | Cisco Technology, Inc. | Automatically joining devices to a video conference |
US10375474B2 (en) | 2017-06-12 | 2019-08-06 | Cisco Technology, Inc. | Hybrid horn microphone |
US10376195B1 (en) | 2015-06-04 | 2019-08-13 | Google Llc | Automated nursing assessment |
CN110169052A (en) * | 2017-01-13 | 2019-08-23 | 哈曼国际工业有限公司 | Integrated audio/video collaboration system for meeting |
US10404481B2 (en) | 2017-06-06 | 2019-09-03 | Cisco Technology, Inc. | Unauthorized participant detection in multiparty conferencing by comparing a reference hash value received from a key management server with a generated roster hash value |
US10440073B2 (en) | 2017-04-11 | 2019-10-08 | Cisco Technology, Inc. | User interface for proximity based teleconference transfer |
US10477148B2 (en) | 2017-06-23 | 2019-11-12 | Cisco Technology, Inc. | Speaker anticipation |
US10492302B2 (en) | 2016-05-03 | 2019-11-26 | Google Llc | Connecting an electronic component to an interactive textile |
US10491860B2 (en) * | 2017-01-16 | 2019-11-26 | Amazon Technologies, Inc. | Audio/video recording and communication devices in network communication with additional cameras |
US10516709B2 (en) | 2017-06-29 | 2019-12-24 | Cisco Technology, Inc. | Files automatically shared at conference initiation |
US10515117B2 (en) | 2017-02-14 | 2019-12-24 | Cisco Technology, Inc. | Generating and reviewing motion metadata |
US10516707B2 (en) | 2016-12-15 | 2019-12-24 | Cisco Technology, Inc. | Initiating a conferencing meeting using a conference room device |
US10542126B2 (en) | 2014-12-22 | 2020-01-21 | Cisco Technology, Inc. | Offline virtual participation in an online conference meeting |
US10574609B2 (en) | 2016-06-29 | 2020-02-25 | Cisco Technology, Inc. | Chat room access control |
US10579150B2 (en) | 2016-12-05 | 2020-03-03 | Google Llc | Concurrent detection of absolute distance and relative movement for sensing action gestures |
US10592867B2 (en) | 2016-11-11 | 2020-03-17 | Cisco Technology, Inc. | In-meeting graphical user interface display using calendar information and system |
US10706391B2 (en) | 2017-07-13 | 2020-07-07 | Cisco Technology, Inc. | Protecting scheduled meeting in physical room |
US10771621B2 (en) | 2017-10-31 | 2020-09-08 | Cisco Technology, Inc. | Acoustic echo cancellation based sub band domain active speaker detection for audio and video conferencing applications |
US10819920B1 (en) * | 2019-05-22 | 2020-10-27 | Dell Products L.P. | Augmented information handling system user presence detection |
CN112312058A (en) * | 2020-03-22 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Interaction method and device and electronic equipment |
US11169988B2 (en) | 2014-08-22 | 2021-11-09 | Google Llc | Radar recognition-aided search |
US11238382B1 (en) * | 2015-06-05 | 2022-02-01 | Steelcase Inc. | Threshold configuration and system for space |
US11294054B2 (en) | 2019-10-11 | 2022-04-05 | Dell Products L.P. | Information handling system infrared proximity detection with ambient light management |
US11334146B2 (en) | 2020-01-31 | 2022-05-17 | Dell Products L.P. | Information handling system peripheral enhanced user presence detection |
US11435447B2 (en) | 2019-10-11 | 2022-09-06 | Dell Products L.P. | Information handling system proximity sensor with mechanically adjusted field of view |
US11435475B2 (en) | 2019-10-11 | 2022-09-06 | Dell Products L.P. | Information handling system infrared proximity detection with frequency domain modulation |
US11513813B2 (en) | 2020-01-31 | 2022-11-29 | Dell Products L.P. | Information handling system notification presentation based upon user presence detection |
US20230120371A1 (en) * | 2021-10-15 | 2023-04-20 | Motorola Mobility Llc | Composite presentation surface and presenter imaging for a multiple camera transmitting device in a video communication session |
US11663343B2 (en) | 2020-01-31 | 2023-05-30 | Dell Products L.P. | Information handling system adaptive user presence detection |
US11662695B2 (en) | 2019-10-11 | 2023-05-30 | Dell Products L.P. | Information handling system infrared proximity detection with distance reduction detection |
Families Citing this family (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9354794B2 (en) * | 2014-07-07 | 2016-05-31 | Google Inc. | Method and system for performing client-side zooming of a remote video feed |
US10127783B2 (en) | 2014-07-07 | 2018-11-13 | Google Llc | Method and device for processing motion events |
US9420331B2 (en) | 2014-07-07 | 2016-08-16 | Google Inc. | Method and system for categorizing detected motion events |
US10140827B2 (en) | 2014-07-07 | 2018-11-27 | Google Llc | Method and system for processing motion event notifications |
US9501915B1 (en) | 2014-07-07 | 2016-11-22 | Google Inc. | Systems and methods for analyzing a video stream |
USD782495S1 (en) | 2014-10-07 | 2017-03-28 | Google Inc. | Display screen or portion thereof with graphical user interface |
US9361011B1 (en) | 2015-06-14 | 2016-06-07 | Google Inc. | Methods and systems for presenting multiple live video feeds in a user interface |
US10701318B2 (en) * | 2015-08-14 | 2020-06-30 | Pcms Holdings, Inc. | System and method for augmented reality multi-view telepresence |
KR102179958B1 (en) * | 2015-09-02 | 2020-11-17 | 삼성전자주식회사 | Large format display apparatus and control method thereof |
US10762712B2 (en) | 2016-04-01 | 2020-09-01 | Pcms Holdings, Inc. | Apparatus and method for supporting interactive augmented reality functionalities |
US10506237B1 (en) | 2016-05-27 | 2019-12-10 | Google Llc | Methods and devices for dynamic adaptation of encoding bitrate for video streaming |
US10957171B2 (en) | 2016-07-11 | 2021-03-23 | Google Llc | Methods and systems for providing event alerts |
US10380429B2 (en) | 2016-07-11 | 2019-08-13 | Google Llc | Methods and systems for person detection in a video feed |
US10192415B2 (en) | 2016-07-11 | 2019-01-29 | Google Llc | Methods and systems for providing intelligent alerts for events |
US11435739B2 (en) | 2017-02-08 | 2022-09-06 | L. Samuel A Kassatly | Interface and method for controlling the operation of an autonomously travelling object |
US11048407B1 (en) | 2017-02-08 | 2021-06-29 | Michelle M Kassatly | Interface and method for self-correcting a travel path of a physical object |
US11783010B2 (en) | 2017-05-30 | 2023-10-10 | Google Llc | Systems and methods of person recognition in video streams |
US10599950B2 (en) | 2017-05-30 | 2020-03-24 | Google Llc | Systems and methods for person recognition data management |
WO2018226508A1 (en) | 2017-06-09 | 2018-12-13 | Pcms Holdings, Inc. | Spatially faithful telepresence supporting varying geometries and moving users |
US10417991B2 (en) | 2017-08-18 | 2019-09-17 | Microsoft Technology Licensing, Llc | Multi-display device user interface modification |
US11237699B2 (en) * | 2017-08-18 | 2022-02-01 | Microsoft Technology Licensing, Llc | Proximal menu generation |
US11301124B2 (en) | 2017-08-18 | 2022-04-12 | Microsoft Technology Licensing, Llc | User interface modification using preview panel |
US10664688B2 (en) | 2017-09-20 | 2020-05-26 | Google Llc | Systems and methods of detecting and responding to a visitor to a smart home environment |
US11134227B2 (en) | 2017-09-20 | 2021-09-28 | Google Llc | Systems and methods of presenting appropriate actions for responding to a visitor to a smart home environment |
CN108173667B (en) * | 2018-01-11 | 2020-07-14 | 四川九洲电器集团有限责任公司 | Intelligent conference system and implementation method |
CN109192119A (en) * | 2018-09-06 | 2019-01-11 | 深圳市创维群欣安防科技股份有限公司 | A kind of automatic sensing control method and meeting plate based on meeting plate |
US11893795B2 (en) | 2019-12-09 | 2024-02-06 | Google Llc | Interacting with visitors of a connected home environment |
US11818506B2 (en) * | 2020-05-12 | 2023-11-14 | True Meeting Inc. | Circumstances based 3D representations of participants of virtual 3D communications |
Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5835083A (en) * | 1996-05-30 | 1998-11-10 | Sun Microsystems, Inc. | Eyetrack-driven illumination and information display |
US20080294917A1 (en) * | 2007-05-24 | 2008-11-27 | Broadcom Corporation | Power Management for Power-Over-Ethernet-Capable Switch |
US20090060093A1 (en) * | 2007-08-06 | 2009-03-05 | Mediaphy Corporation | Multi-function decoder engine in wireless receiver |
US20090123035A1 (en) * | 2007-11-13 | 2009-05-14 | Cisco Technology, Inc. | Automated Video Presence Detection |
US20100013925A1 (en) * | 2008-07-18 | 2010-01-21 | Fowler Daniel B | Portal proximate digital communications device |
US20100226487A1 (en) * | 2009-03-09 | 2010-09-09 | Polycom, Inc. | Method & apparatus for controlling the state of a communication system |
US20100231576A1 (en) * | 2009-03-13 | 2010-09-16 | Hong Fu Jin Precision Industry (Shenzhen) Co., Ltd | Digital photo frame with mirror function |
US20100315483A1 (en) * | 2009-03-20 | 2010-12-16 | King Keith C | Automatic Conferencing Based on Participant Presence |
US8127158B2 (en) * | 2005-05-30 | 2012-02-28 | Rambus Inc. | Self-powered devices and methods |
US20130085796A1 (en) * | 2011-10-03 | 2013-04-04 | Frank Ruffolo | Method and Apparatus for Work Management |
US20130152153A1 (en) * | 2011-12-07 | 2013-06-13 | Reginald Weiser | Systems and methods for providing security for sip and pbx communications |
US20130318521A1 (en) * | 2012-05-22 | 2013-11-28 | Cisco Technology, Inc. | Location-based power management for virtual desktop environments |
US20150189233A1 (en) * | 2012-04-30 | 2015-07-02 | Goggle Inc. | Facilitating user interaction in a video conference |
Family Cites Families (38)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3797678B2 (en) | 1994-05-26 | 2006-07-19 | 富士通株式会社 | Window and camera cooperative control method and apparatus |
US6259470B1 (en) | 1997-12-18 | 2001-07-10 | Intel Corporation | Image capture system having virtual camera |
US7015954B1 (en) | 1999-08-09 | 2006-03-21 | Fuji Xerox Co., Ltd. | Automatic video system using multiple cameras |
US6894714B2 (en) | 2000-12-05 | 2005-05-17 | Koninklijke Philips Electronics N.V. | Method and apparatus for predicting events in video conferencing and other applications |
JP2003219047A (en) * | 2002-01-18 | 2003-07-31 | Matsushita Electric Ind Co Ltd | Communication apparatus |
US7864210B2 (en) | 2005-11-18 | 2011-01-04 | International Business Machines Corporation | System and methods for video conferencing |
US9250703B2 (en) | 2006-03-06 | 2016-02-02 | Sony Computer Entertainment Inc. | Interface with gaze detection and voice input |
JP4644870B2 (en) * | 2006-03-30 | 2011-03-09 | 株式会社国際電気通信基礎技術研究所 | Content presentation device |
US10168801B2 (en) | 2006-08-31 | 2019-01-01 | Semiconductor Energy Laboratory Co., Ltd. | Electronic pen and electronic pen system |
US8279254B2 (en) * | 2007-08-02 | 2012-10-02 | Siemens Enterprise Communications Gmbh & Co. Kg | Method and system for video conferencing in a virtual environment |
US8319819B2 (en) * | 2008-03-26 | 2012-11-27 | Cisco Technology, Inc. | Virtual round-table videoconference |
US8941590B2 (en) | 2008-04-24 | 2015-01-27 | Oblong Industries, Inc. | Adaptive tracking system for spatial input devices |
US8130978B2 (en) | 2008-10-15 | 2012-03-06 | Microsoft Corporation | Dynamic switching of microphone inputs for identification of a direction of a source of speech sounds |
US8591039B2 (en) * | 2008-10-28 | 2013-11-26 | Smart Technologies Ulc | Image projection methods and interactive input/projection systems employing the same |
US8358328B2 (en) * | 2008-11-20 | 2013-01-22 | Cisco Technology, Inc. | Multiple video camera processing for teleconferencing |
US8243166B2 (en) * | 2009-01-20 | 2012-08-14 | Lockheed Martin Corporation | Automatic detection of blocked field-of-view in camera systems |
US8427100B2 (en) | 2009-02-06 | 2013-04-23 | Broadcom Corporation | Increasing efficiency of wireless power transfer |
KR101651859B1 (en) * | 2009-06-05 | 2016-09-12 | 삼성전자주식회사 | Method for providing UI for each user, and device applying the same |
US8390665B2 (en) * | 2009-09-03 | 2013-03-05 | Samsung Electronics Co., Ltd. | Apparatus, system and method for video call |
US8441515B2 (en) | 2009-09-17 | 2013-05-14 | Sony Corporation | Method and apparatus for minimizing acoustic echo in video conferencing |
WO2011091604A1 (en) | 2010-01-29 | 2011-08-04 | 华为终端有限公司 | Method, apparatus and system for video communication |
EP2410406A1 (en) | 2010-07-23 | 2012-01-25 | Anoto AB | Display with coding pattern |
US8823769B2 (en) * | 2011-01-05 | 2014-09-02 | Ricoh Company, Ltd. | Three-dimensional video conferencing system with eye contact |
CN102176733A (en) * | 2011-01-28 | 2011-09-07 | 宇龙计算机通信科技(深圳)有限公司 | Method, system and mobile terminal for controlling screen backlight |
KR101760424B1 (en) | 2011-05-20 | 2017-07-31 | 엘지전자 주식회사 | Mobile terminal and control method therof |
US20120293606A1 (en) | 2011-05-20 | 2012-11-22 | Microsoft Corporation | Techniques and system for automatic video conference camera feed selection based on room events |
WO2012170559A2 (en) | 2011-06-06 | 2012-12-13 | Array Telepresence, Inc. | Dual-axis image equalization in video conferencing |
US8698874B2 (en) | 2011-06-10 | 2014-04-15 | Microsoft Corporation | Techniques for multiple video source stitching in a conference room |
US9030520B2 (en) * | 2011-06-20 | 2015-05-12 | Polycom, Inc. | Automatic camera selection for videoconferencing |
JP6085907B2 (en) * | 2011-09-13 | 2017-03-01 | 株式会社リコー | Conference system, event management server, and program |
US8676116B2 (en) | 2011-10-07 | 2014-03-18 | Blackberry Limited | Electronic device with NFC antenna adjacent display and related methods |
US8803800B2 (en) | 2011-12-02 | 2014-08-12 | Microsoft Corporation | User interface control based on head orientation |
KR101332832B1 (en) * | 2012-03-06 | 2013-11-27 | 모젼스랩(주) | Indoor positioning method using motion recognition unit |
DE102012206295A1 (en) | 2012-04-17 | 2013-10-17 | Krones Ag | Filling plant for containers and method for operating the filling plant |
JP5751228B2 (en) | 2012-09-05 | 2015-07-22 | コニカミノルタ株式会社 | Conference support system, control device, and input terminal |
KR102081932B1 (en) * | 2013-03-21 | 2020-04-14 | 엘지전자 주식회사 | Display device and method for controlling the same |
US9363476B2 (en) | 2013-09-20 | 2016-06-07 | Microsoft Technology Licensing, Llc | Configuration of a touch screen display with conferencing |
US20150085060A1 (en) | 2013-09-20 | 2015-03-26 | Microsoft Corporation | User experience for conferencing with a touch screen display |
-
2013
- 2013-09-20 US US14/033,007 patent/US20150085060A1/en not_active Abandoned
-
2014
- 2014-09-17 EP EP14781749.8A patent/EP3047351A2/en not_active Withdrawn
- 2014-09-17 WO PCT/US2014/056108 patent/WO2015042160A2/en active Application Filing
- 2014-09-17 CN CN201480051934.6A patent/CN105683863A/en active Pending
-
2017
- 2017-03-08 US US15/453,278 patent/US9986206B2/en active Active
Patent Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5835083A (en) * | 1996-05-30 | 1998-11-10 | Sun Microsystems, Inc. | Eyetrack-driven illumination and information display |
US8127158B2 (en) * | 2005-05-30 | 2012-02-28 | Rambus Inc. | Self-powered devices and methods |
US20080294917A1 (en) * | 2007-05-24 | 2008-11-27 | Broadcom Corporation | Power Management for Power-Over-Ethernet-Capable Switch |
US20090060093A1 (en) * | 2007-08-06 | 2009-03-05 | Mediaphy Corporation | Multi-function decoder engine in wireless receiver |
US20090123035A1 (en) * | 2007-11-13 | 2009-05-14 | Cisco Technology, Inc. | Automated Video Presence Detection |
US20100013925A1 (en) * | 2008-07-18 | 2010-01-21 | Fowler Daniel B | Portal proximate digital communications device |
US20100226487A1 (en) * | 2009-03-09 | 2010-09-09 | Polycom, Inc. | Method & apparatus for controlling the state of a communication system |
US20100231576A1 (en) * | 2009-03-13 | 2010-09-16 | Hong Fu Jin Precision Industry (Shenzhen) Co., Ltd | Digital photo frame with mirror function |
US20100315483A1 (en) * | 2009-03-20 | 2010-12-16 | King Keith C | Automatic Conferencing Based on Participant Presence |
US20130085796A1 (en) * | 2011-10-03 | 2013-04-04 | Frank Ruffolo | Method and Apparatus for Work Management |
US20130152153A1 (en) * | 2011-12-07 | 2013-06-13 | Reginald Weiser | Systems and methods for providing security for sip and pbx communications |
US20150189233A1 (en) * | 2012-04-30 | 2015-07-02 | Goggle Inc. | Facilitating user interaction in a video conference |
US20130318521A1 (en) * | 2012-05-22 | 2013-11-28 | Cisco Technology, Inc. | Location-based power management for virtual desktop environments |
Cited By (121)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10009389B2 (en) | 2007-01-03 | 2018-06-26 | Cisco Technology, Inc. | Scalable conference bridge |
US9986206B2 (en) | 2013-09-20 | 2018-05-29 | Microsoft Technology Licensing, Llc | User experience for conferencing with a touch screen display |
US9363476B2 (en) | 2013-09-20 | 2016-06-07 | Microsoft Technology Licensing, Llc | Configuration of a touch screen display with conferencing |
US9632558B2 (en) * | 2014-03-07 | 2017-04-25 | Boe Technology Group Co., Ltd. | Power supply control method for display device and display device |
US20160274649A1 (en) * | 2014-03-07 | 2016-09-22 | Boe Technology Group Co., Ltd. | Power Supply Control Method for Display Device and Display Device |
US10509478B2 (en) | 2014-06-03 | 2019-12-17 | Google Llc | Radar-based gesture-recognition from a surface radar field on which an interaction is sensed |
US9575560B2 (en) | 2014-06-03 | 2017-02-21 | Google Inc. | Radar-based gesture-recognition through a wearable device |
US10948996B2 (en) | 2014-06-03 | 2021-03-16 | Google Llc | Radar-based gesture-recognition at a surface of an object |
US9971415B2 (en) | 2014-06-03 | 2018-05-15 | Google Llc | Radar-based gesture-recognition through a wearable device |
US20160034121A1 (en) * | 2014-07-30 | 2016-02-04 | Wal-Mart Stores, Inc. | Method and Apparatus for Automatically Displaying Multiple Presentations for Multiple Users |
US10642367B2 (en) | 2014-08-07 | 2020-05-05 | Google Llc | Radar-based gesture sensing and data transmission |
US9811164B2 (en) | 2014-08-07 | 2017-11-07 | Google Inc. | Radar-based gesture sensing and data transmission |
US20160041617A1 (en) * | 2014-08-07 | 2016-02-11 | Google Inc. | Radar-Based Gesture Recognition |
US9921660B2 (en) * | 2014-08-07 | 2018-03-20 | Google Llc | Radar-based gesture recognition |
US10291597B2 (en) | 2014-08-14 | 2019-05-14 | Cisco Technology, Inc. | Sharing resources across multiple devices in online meetings |
US10778656B2 (en) | 2014-08-14 | 2020-09-15 | Cisco Technology, Inc. | Sharing resources across multiple devices in online meetings |
US9933908B2 (en) | 2014-08-15 | 2018-04-03 | Google Llc | Interactive textiles |
US10268321B2 (en) | 2014-08-15 | 2019-04-23 | Google Llc | Interactive textiles within hard objects |
US9778749B2 (en) | 2014-08-22 | 2017-10-03 | Google Inc. | Occluded gesture recognition |
US11816101B2 (en) | 2014-08-22 | 2023-11-14 | Google Llc | Radar recognition-aided search |
US11169988B2 (en) | 2014-08-22 | 2021-11-09 | Google Llc | Radar recognition-aided search |
US10409385B2 (en) | 2014-08-22 | 2019-09-10 | Google Llc | Occluded gesture recognition |
US11221682B2 (en) | 2014-08-22 | 2022-01-11 | Google Llc | Occluded gesture recognition |
US10936081B2 (en) | 2014-08-22 | 2021-03-02 | Google Llc | Occluded gesture recognition |
US11163371B2 (en) | 2014-10-02 | 2021-11-02 | Google Llc | Non-line-of-sight radar-based gesture recognition |
US9600080B2 (en) | 2014-10-02 | 2017-03-21 | Google Inc. | Non-line-of-sight radar-based gesture recognition |
US10664059B2 (en) | 2014-10-02 | 2020-05-26 | Google Llc | Non-line-of-sight radar-based gesture recognition |
US10542126B2 (en) | 2014-12-22 | 2020-01-21 | Cisco Technology, Inc. | Offline virtual participation in an online conference meeting |
US11219412B2 (en) | 2015-03-23 | 2022-01-11 | Google Llc | In-ear health monitoring |
US10016162B1 (en) | 2015-03-23 | 2018-07-10 | Google Llc | In-ear health monitoring |
US9983747B2 (en) | 2015-03-26 | 2018-05-29 | Google Llc | Two-layer interactive textiles |
US9848780B1 (en) | 2015-04-08 | 2017-12-26 | Google Inc. | Assessing cardiovascular function using an optical sensor |
US10623576B2 (en) | 2015-04-17 | 2020-04-14 | Cisco Technology, Inc. | Handling conferences using highly-distributed agents |
US9948786B2 (en) | 2015-04-17 | 2018-04-17 | Cisco Technology, Inc. | Handling conferences using highly-distributed agents |
US11709552B2 (en) | 2015-04-30 | 2023-07-25 | Google Llc | RF-based micro-motion tracking for gesture tracking and recognition |
US10817070B2 (en) | 2015-04-30 | 2020-10-27 | Google Llc | RF-based micro-motion tracking for gesture tracking and recognition |
US10496182B2 (en) | 2015-04-30 | 2019-12-03 | Google Llc | Type-agnostic RF signal representations |
US10664061B2 (en) | 2015-04-30 | 2020-05-26 | Google Llc | Wide-field radar-based gesture recognition |
US10310620B2 (en) | 2015-04-30 | 2019-06-04 | Google Llc | Type-agnostic RF signal representations |
US10139916B2 (en) | 2015-04-30 | 2018-11-27 | Google Llc | Wide-field radar-based gesture recognition |
US10241581B2 (en) | 2015-04-30 | 2019-03-26 | Google Llc | RF-based micro-motion tracking for gesture tracking and recognition |
US10080528B2 (en) | 2015-05-19 | 2018-09-25 | Google Llc | Optical central venous pressure measurement |
US10088908B1 (en) | 2015-05-27 | 2018-10-02 | Google Llc | Gesture detection and interactions |
US10936085B2 (en) | 2015-05-27 | 2021-03-02 | Google Llc | Gesture detection and interactions |
US10155274B2 (en) | 2015-05-27 | 2018-12-18 | Google Llc | Attaching electronic components to interactive textiles |
US10203763B1 (en) | 2015-05-27 | 2019-02-12 | Google Inc. | Gesture detection and interactions |
US10572027B2 (en) | 2015-05-27 | 2020-02-25 | Google Llc | Gesture detection and interactions |
US9693592B2 (en) | 2015-05-27 | 2017-07-04 | Google Inc. | Attaching electronic components to interactive textiles |
US10376195B1 (en) | 2015-06-04 | 2019-08-13 | Google Llc | Automated nursing assessment |
US11238382B1 (en) * | 2015-06-05 | 2022-02-01 | Steelcase Inc. | Threshold configuration and system for space |
US10306313B2 (en) * | 2015-07-24 | 2019-05-28 | Samsung Electronics Co., Ltd. | Display apparatus and method for controlling a screen of display apparatus |
CN107637069A (en) * | 2015-07-24 | 2018-01-26 | 三星电子株式会社 | The method of display device and the screen for controlling display device |
US20170026700A1 (en) * | 2015-07-24 | 2017-01-26 | Samsung Electronics Co., Ltd. | Display apparatus and method for controlling a screen of display apparatus |
US11132065B2 (en) | 2015-10-06 | 2021-09-28 | Google Llc | Radar-enabled sensor fusion |
US11656336B2 (en) | 2015-10-06 | 2023-05-23 | Google Llc | Advanced gaming and virtual reality control using radar |
US11080556B1 (en) | 2015-10-06 | 2021-08-03 | Google Llc | User-customizable machine-learning in radar-based gesture detection |
US11175743B2 (en) | 2015-10-06 | 2021-11-16 | Google Llc | Gesture recognition using multiple antenna |
US10503883B1 (en) | 2015-10-06 | 2019-12-10 | Google Llc | Radar-based authentication |
US10300370B1 (en) | 2015-10-06 | 2019-05-28 | Google Llc | Advanced gaming and virtual reality control using radar |
US10310621B1 (en) | 2015-10-06 | 2019-06-04 | Google Llc | Radar gesture sensing using existing data protocols |
US11698439B2 (en) | 2015-10-06 | 2023-07-11 | Google Llc | Gesture recognition using multiple antenna |
US10908696B2 (en) | 2015-10-06 | 2021-02-02 | Google Llc | Advanced gaming and virtual reality control using radar |
US10459080B1 (en) | 2015-10-06 | 2019-10-29 | Google Llc | Radar-based object detection for vehicles |
US10540001B1 (en) | 2015-10-06 | 2020-01-21 | Google Llc | Fine-motion virtual-reality or augmented-reality control using radar |
US11256335B2 (en) | 2015-10-06 | 2022-02-22 | Google Llc | Fine-motion virtual-reality or augmented-reality control using radar |
US11698438B2 (en) | 2015-10-06 | 2023-07-11 | Google Llc | Gesture recognition using multiple antenna |
US10823841B1 (en) | 2015-10-06 | 2020-11-03 | Google Llc | Radar imaging on a mobile computing device |
US11385721B2 (en) | 2015-10-06 | 2022-07-12 | Google Llc | Application-based signal processing parameters in radar-based detection |
US11693092B2 (en) | 2015-10-06 | 2023-07-04 | Google Llc | Gesture recognition using multiple antenna |
US10401490B2 (en) | 2015-10-06 | 2019-09-03 | Google Llc | Radar-enabled sensor fusion |
US10817065B1 (en) | 2015-10-06 | 2020-10-27 | Google Llc | Gesture recognition using multiple antenna |
US10379621B2 (en) | 2015-10-06 | 2019-08-13 | Google Llc | Gesture component with gesture library |
US11481040B2 (en) | 2015-10-06 | 2022-10-25 | Google Llc | User-customizable machine-learning in radar-based gesture detection |
US10705185B1 (en) | 2015-10-06 | 2020-07-07 | Google Llc | Application-based signal processing parameters in radar-based detection |
US11592909B2 (en) | 2015-10-06 | 2023-02-28 | Google Llc | Fine-motion virtual-reality or augmented-reality control using radar |
US10768712B2 (en) | 2015-10-06 | 2020-09-08 | Google Llc | Gesture component with gesture library |
US9837760B2 (en) | 2015-11-04 | 2017-12-05 | Google Inc. | Connectors for connecting electronics embedded in garments to external devices |
US10291762B2 (en) | 2015-12-04 | 2019-05-14 | Cisco Technology, Inc. | Docking station for mobile computing devices |
US11140787B2 (en) | 2016-05-03 | 2021-10-05 | Google Llc | Connecting an electronic component to an interactive textile |
US10492302B2 (en) | 2016-05-03 | 2019-11-26 | Google Llc | Connecting an electronic component to an interactive textile |
US10175781B2 (en) | 2016-05-16 | 2019-01-08 | Google Llc | Interactive object with multiple electronics modules |
CN106094942A (en) * | 2016-06-23 | 2016-11-09 | 广州派诺网络技术有限公司 | Smart meeting room control method |
US11444900B2 (en) | 2016-06-29 | 2022-09-13 | Cisco Technology, Inc. | Chat room access control |
US10574609B2 (en) | 2016-06-29 | 2020-02-25 | Cisco Technology, Inc. | Chat room access control |
US11227264B2 (en) | 2016-11-11 | 2022-01-18 | Cisco Technology, Inc. | In-meeting graphical user interface display using meeting participant status |
US10592867B2 (en) | 2016-11-11 | 2020-03-17 | Cisco Technology, Inc. | In-meeting graphical user interface display using calendar information and system |
US10579150B2 (en) | 2016-12-05 | 2020-03-03 | Google Llc | Concurrent detection of absolute distance and relative movement for sensing action gestures |
US11233833B2 (en) | 2016-12-15 | 2022-01-25 | Cisco Technology, Inc. | Initiating a conferencing meeting using a conference room device |
US10516707B2 (en) | 2016-12-15 | 2019-12-24 | Cisco Technology, Inc. | Initiating a conferencing meeting using a conference room device |
US11044441B2 (en) * | 2017-01-13 | 2021-06-22 | Harman International Industries, Incorporated | Integrated audio/video collaboration system for video conference meetings |
US20190364246A1 (en) * | 2017-01-13 | 2019-11-28 | Harman International Industries, Incorporated | Integrated Audio/Video Collaboration System for Video Conference Meetings |
CN110169052A (en) * | 2017-01-13 | 2019-08-23 | 哈曼国际工业有限公司 | Integrated audio/video collaboration system for meeting |
US10979668B2 (en) | 2017-01-16 | 2021-04-13 | Amazon Technologies, Inc. | Audio/video recording and communication devices in network communication with additional cameras |
US10491860B2 (en) * | 2017-01-16 | 2019-11-26 | Amazon Technologies, Inc. | Audio/video recording and communication devices in network communication with additional cameras |
US10515117B2 (en) | 2017-02-14 | 2019-12-24 | Cisco Technology, Inc. | Generating and reviewing motion metadata |
US9942519B1 (en) | 2017-02-21 | 2018-04-10 | Cisco Technology, Inc. | Technologies for following participants in a video conference |
US10334208B2 (en) | 2017-02-21 | 2019-06-25 | Cisco Technology, Inc. | Technologies for following participants in a video conference |
US10440073B2 (en) | 2017-04-11 | 2019-10-08 | Cisco Technology, Inc. | User interface for proximity based teleconference transfer |
US10375125B2 (en) | 2017-04-27 | 2019-08-06 | Cisco Technology, Inc. | Automatically joining devices to a video conference |
US10404481B2 (en) | 2017-06-06 | 2019-09-03 | Cisco Technology, Inc. | Unauthorized participant detection in multiparty conferencing by comparing a reference hash value received from a key management server with a generated roster hash value |
US10375474B2 (en) | 2017-06-12 | 2019-08-06 | Cisco Technology, Inc. | Hybrid horn microphone |
US10477148B2 (en) | 2017-06-23 | 2019-11-12 | Cisco Technology, Inc. | Speaker anticipation |
US11019308B2 (en) | 2017-06-23 | 2021-05-25 | Cisco Technology, Inc. | Speaker anticipation |
US10516709B2 (en) | 2017-06-29 | 2019-12-24 | Cisco Technology, Inc. | Files automatically shared at conference initiation |
US10706391B2 (en) | 2017-07-13 | 2020-07-07 | Cisco Technology, Inc. | Protecting scheduled meeting in physical room |
US10084665B1 (en) | 2017-07-25 | 2018-09-25 | Cisco Technology, Inc. | Resource selection using quality prediction |
US10091348B1 (en) | 2017-07-25 | 2018-10-02 | Cisco Technology, Inc. | Predictive model for voice/video over IP calls |
US10225313B2 (en) | 2017-07-25 | 2019-03-05 | Cisco Technology, Inc. | Media quality prediction for collaboration services |
US11245788B2 (en) | 2017-10-31 | 2022-02-08 | Cisco Technology, Inc. | Acoustic echo cancellation based sub band domain active speaker detection for audio and video conferencing applications |
US10771621B2 (en) | 2017-10-31 | 2020-09-08 | Cisco Technology, Inc. | Acoustic echo cancellation based sub band domain active speaker detection for audio and video conferencing applications |
US10819920B1 (en) * | 2019-05-22 | 2020-10-27 | Dell Products L.P. | Augmented information handling system user presence detection |
US11662695B2 (en) | 2019-10-11 | 2023-05-30 | Dell Products L.P. | Information handling system infrared proximity detection with distance reduction detection |
US11435475B2 (en) | 2019-10-11 | 2022-09-06 | Dell Products L.P. | Information handling system infrared proximity detection with frequency domain modulation |
US11435447B2 (en) | 2019-10-11 | 2022-09-06 | Dell Products L.P. | Information handling system proximity sensor with mechanically adjusted field of view |
US11294054B2 (en) | 2019-10-11 | 2022-04-05 | Dell Products L.P. | Information handling system infrared proximity detection with ambient light management |
US11513813B2 (en) | 2020-01-31 | 2022-11-29 | Dell Products L.P. | Information handling system notification presentation based upon user presence detection |
US11663343B2 (en) | 2020-01-31 | 2023-05-30 | Dell Products L.P. | Information handling system adaptive user presence detection |
US11334146B2 (en) | 2020-01-31 | 2022-05-17 | Dell Products L.P. | Information handling system peripheral enhanced user presence detection |
CN112312058A (en) * | 2020-03-22 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Interaction method and device and electronic equipment |
US20230120371A1 (en) * | 2021-10-15 | 2023-04-20 | Motorola Mobility Llc | Composite presentation surface and presenter imaging for a multiple camera transmitting device in a video communication session |
US11838677B2 (en) * | 2021-10-15 | 2023-12-05 | Motorola Mobility Llc | Composite presentation surface and presenter imaging for a multiple camera transmitting device in a video communication session |
Also Published As
Publication number | Publication date |
---|---|
CN105683863A (en) | 2016-06-15 |
US20170180678A1 (en) | 2017-06-22 |
EP3047351A2 (en) | 2016-07-27 |
US9986206B2 (en) | 2018-05-29 |
WO2015042160A3 (en) | 2015-05-14 |
WO2015042160A2 (en) | 2015-03-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9986206B2 (en) | User experience for conferencing with a touch screen display | |
US9363476B2 (en) | Configuration of a touch screen display with conferencing | |
US10904486B2 (en) | Multi-participant live communication user interface | |
US10075491B2 (en) | Directing communications using gaze interaction | |
US9998508B2 (en) | Multi-site screen interactions | |
US10082886B2 (en) | Automatic configuration of an input device based on contextual usage | |
US10845909B2 (en) | Method, apparatus and computer-readable media for touch and speech interface with audio location | |
US9083816B2 (en) | Managing modality views on conversation canvas | |
US11184560B1 (en) | Use of sensor input to determine video feed to provide as part of video conference | |
JP2017108366A (en) | Method of controlling video conference, system, and program | |
WO2019217477A1 (en) | Multi-participant live communication user interface | |
US10474324B2 (en) | Uninterruptable overlay on a display | |
AU2019100499A4 (en) | Multi-participant live communication user interface | |
CN204721476U (en) | Immersion and interactively video conference room environment | |
AU2019266225B2 (en) | Multi-participant live communication user interface |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MICROSOFT CORPORATION, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FISH, NATHAN J.;WILLIAMS, ROBERT;CASE, CHARLIE W.;AND OTHERS;SIGNING DATES FROM 20130919 TO 20131006;REEL/FRAME:031847/0892 |
|
AS | Assignment |
Owner name: MICROSOFT CORPORATION, WASHINGTON Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE CORRECT INVENTOR ASSIGNMENTS WITH WRONG SERIAL NUMBERS PREVIOUSLY RECORDED ON REEL 031847 FRAME 0892. ASSIGNOR(S) HEREBY CONFIRMS THE NATHAN J. FISH, CHARLIE W. CASE, PETER R. OEHLER AND MICHAEL C. HILSDALE ASSIGNMENTS TO REFLECT THE SERIAL NUMBER 14/033,007.;ASSIGNORS:FISH, NATHAN J.;WILLAIMS, ROBERT;CASE, CHARLIE W.;AND OTHERS;SIGNING DATES FROM 20130926 TO 20140829;REEL/FRAME:033663/0690 |
|
AS | Assignment |
Owner name: MICROSOFT CORPORATION, WASHINGTON Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF INVENTOR NAME PREVIOUSLY RECORDED ON REEL 033663 FRAME 0690. ASSIGNOR(S) HEREBY CONFIRMS THE CORRECTION TO THE SPELLING OF ROBERT WILLIAMS;ASSIGNORS:FISH, NATHAN J.;WILLIAMS, ROBERT;CASE, CHARLIE W.;AND OTHERS;SIGNING DATES FROM 20130926 TO 20140829;REEL/FRAME:033689/0350 |
|
AS | Assignment |
Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034747/0417 Effective date: 20141014 Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:039025/0454 Effective date: 20141014 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |