EP3342158A1 - Système et procédé de vidéoconférences interactives - Google Patents

Système et procédé de vidéoconférences interactives

Info

Publication number
EP3342158A1
EP3342158A1 EP16840132.1A EP16840132A EP3342158A1 EP 3342158 A1 EP3342158 A1 EP 3342158A1 EP 16840132 A EP16840132 A EP 16840132A EP 3342158 A1 EP3342158 A1 EP 3342158A1
Authority
EP
European Patent Office
Prior art keywords
computing device
user computing
processor
audio
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP16840132.1A
Other languages
German (de)
English (en)
Other versions
EP3342158A4 (fr
Inventor
Edo Segal
Charles Miller
Dmytro Panin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Touchcast LLC
Original Assignee
Touchcast LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Touchcast LLC filed Critical Touchcast LLC
Publication of EP3342158A1 publication Critical patent/EP3342158A1/fr
Publication of EP3342158A4 publication Critical patent/EP3342158A4/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1827—Network arrangements for conference optimisation or adaptation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences

Definitions

  • the present application relates, generally, to content presentation and, more particularly, to a system and method for providing and interacting with content via interactive communication sessions.
  • Interactive and supplemental content that has been made available to viewers has been done through a decoupled, separate communication channel.
  • a producer can provide a separate communication channel with data, a video stream, or both at a URL associated with the broadcast.
  • a television station can have on-air programming and also provide supplemental content available through a website.
  • these communication channels are generally decoupled from one another. In other words, the broadcaster has only an indirect relationship to the viewer with regard to any supplemental content.
  • a networked communication session is defined vis-a-vis parameter information received from a first device, and access to the networked communication session is provided to the first device. Access to the networked communication session can be further provided to each of additional device(s) in accordance with information associated with each of the additional device(s).
  • a composited interactive audio/video feed is generated and transmitted that comprises audio/video input received during the networked communication session from each of the devices.
  • Each of the devices is configured via a gesture-based user interface to enable user- based selection and respective manipulation of at least a portion of the composited audio/video feed that results in a customized representation of the composited audio- video feed at a particular one device that is not represented at a particular other of the device(s).
  • at least one of the additional user computing device(s) is configured to present the composited audio/video feed on a display via an Internet media extender, wherein the display can be a television.
  • At least one processor receives from the first user computing device, information representing at least one video application ("vApp") that, when executed by the first user computing device and/or the at least one additional user computing device, results in functionality, information and/or content to be provided during the networked communication session.
  • vApp identification information representing the at least one vApp is transmitted is transmitted to at least one additional user computing device, and is usable to configure the at least one additional user computing device to execute the vApp.
  • the at least one processor receives from the first user computing device and/or the at least one additional user computing device, information representing the at least one other user computing device and providing, by the at least one processor, the respective access to the networked communication session to each of the at least one additional user computing device as a function of the information representing the at least one other user computing device.
  • FIG. 1 is a diagram illustrating an example hardware arrangement that operates for providing the systems and methods disclosed herein;
  • FIG. 2 is a block diagram that illustrates functional elements of a computing device in accordance with an embodiment
  • Fig. 3 is an example high-level diagram that illustrates interactivity between various ones of the devices illustrated in Fig. 1 ;
  • FIG. 4 illustrates an example implantation of an alternate arrangement
  • Fig. 6 illustrates a portion of a display screen that includes a graphical screen control that is selectable for transmitting an invitation to one or more user(s) to join an interactive conferencing session in accordance with an example implementation of the present application;
  • Fig. 7 illustrates a portion of a display screen that includes graphical screen controls for adding sharable content, muting a microphone and recording a session in accordance with an example implementation of the present application;
  • Fig 8 illustrates an example high-level diagram of an enterprise implementation, including a plurality of user computing devices, an Internet media extender and a television;
  • FIGs. 9A - 9D illustrate examples of sharing content between devices, in accordance with an example implementation of the present application
  • FIG. 10 illustrates an example set of applications and controls available via a mobile application and operating on user computing device during an interactive video conferencing session, in accordance with an example implementation of the present application
  • FIGs. 11 A-l IE illustrate examples of sharing content between devices, in accordance with an example implementation of the present application
  • FIGs. 12A-12B illustrate examples of sharing content between devices, in accordance with an example implementation of the present application
  • FIGs. 13A-13B illustrate an example user computing device configured and operational in accordance with the present application.
  • Fig. 14 is an example flow diagram illustrating example steps associated with an implementation of the present application. Detailed Description
  • the present application provides systems and methods for providing interactive video conferencing over one or more data communication networks, such as the Internet.
  • Devices operating, for example, iOS, ANDROID, WINDOWS MOBILE, BLACKBERRY, MAC OS, WINDOWS or other operating systems are configured with one or more software applications that provide functionality, such as with an interface for developing ("authoring") distributable coordinated presentations.
  • Such presentations can include interactive video having customizable and interactive functionality for and between devices with a plurality of end-users who receive the video.
  • the one or more software applications configure a user computing device with a viewing/interactive tool, referred to herein, generally, as a "consuming" interface for end-users who receive interactive video that are authored in accordance with the present application and usable for end-users to communicate (e.g., via interactive video conferencing functionality).
  • a viewing/interactive tool referred to herein, generally, as a "consuming" interface for end-users who receive interactive video that are authored in accordance with the present application and usable for end-users to communicate (e.g., via interactive video conferencing functionality).
  • client interface users may interact with each other and share interactive videos and other content as a function of touch and gestures, as well as graphical screen controls that, when selected, cause a computing device to execute one or more instructions and effect various functionality.
  • a smartphone or other mobile computing device can be configured via one or more applications in accordance with the ability to simulate a laser pointer, drawing tool, mouse, trackball, keyboard or other input device.
  • implementations of the present application provide a simple to use, informing and entertaining communications experience that incorporates content from a plurality of computing devices, e.g., smartphones, tablets, laptops and desktops, and enables live sharing in a real-time and conferencing capability therefore.
  • one or more televisions can be used for respective audio/visual display devices, and can provide feed from cameras and/or microphones configured with various local and/or remotely located computing devices that are communicating over data communication networks such as the Internet.
  • a television can be implemented in the present application in various ways, such as via an Internet media extender provided by APPLE TV, ROKU, AMAZON FIRE TV or GOOGLE
  • an Internet media extender refers, generally, to a category of devices that provide for content to be streamed to a television, surround sound devices, and the like. Unlike functionality provided by known Internet media extenders, however, the present application facilitates integrating audio/video input capabilities of computing devices (e.g., microphones, cameras and software that drive and enhance audio/visual captures) into video-conferencing capabilities. The present application facilitates one or more of: one-to- one (1 : 1) video conferencing; group video conferencing; sharing and/or viewing of content provided on a plurality of computing devices, and interactive computing activities.
  • computing devices e.g., microphones, cameras and software that drive and enhance audio/visual captures
  • content which can be formatted as and/or include images, audio/video content, website content, computer programs and/or content provided in various formats (collectively referred to herein, generally, as "vApps"), can be implemented vis-a-vis one or more mobile software applications.
  • vApp icons can be provided that represent vApps that are included with the conferencing sessions.
  • the user can interact with the respective vApp.
  • Functionality, information and/or content can be associated with the vApp and provided in a shared conferencing session, which is made available to user computing devices connected thereto.
  • the present application provides for interactive video conferencing that integrates audio/video input and output from individual mobile computing devices (e.g., smartphones and tablet computers) with Internet media extender devices (e.g., APPLE TV).
  • individual mobile computing devices e.g., smartphones and tablet computers
  • Internet media extender devices e.g., APPLE TV.
  • the present application provides a new form of live and interactive functionality that can make a person's living room or other residential viewing area into a high-end video conferencing suite.
  • Non-residential implementations are supported, as well, as shown and described in greater detail herein.
  • online collaborative services are provided, for example, including for webinars, webcasts, and meetings.
  • Internet technologies such as TCP/IP connectivity support web conferencing services, including sharing of audio, video, textual and various forms of multimedia content.
  • System 100 can include one or more data processing apparatuses 102 that are at least communicatively coupled to one or more user computing devices 104 across communication network 106.
  • Data processing apparatuses 102 and user computing devices 104 can include, for example, mobile computing devices such as tablet computing devices, smartphones, personal digital assistants or the like, as well as laptop computers and/or desktop computers.
  • one computing device may be configured as a data processing apparatus 102 and a user computing device 104, depending upon operations be executed at a particular time.
  • an audio/visual capture device 105 is depicted in Fig.
  • the audio/visual capture device 105 can be configured to interface with one or more data processing apparatuses 102 for producing high quality and interactive multimedia content, and supporting interactive video conferencing.
  • data processing apparatus 102 can be configured to access one or more databases for the present application, including image files, video content, documents, audio/video recordings, metadata and other information.
  • data processing apparatus 102 can access any required databases via communication network 106 or any other communication network to which data processing apparatus 102 has access.
  • Data processing apparatus 102 can communicate with devices comprising databases using any known communication method, including a direct serial, parallel, universal serial bus (“USB”) interface, or via a local or wide area network.
  • USB universal serial bus
  • Communication network 106 can be any communication network, but is typically the Internet or some other global computer network.
  • Data connections 108 can be any known arrangement for accessing communication network 106, such as the public internet, private Internet (e.g. VPN), dedicated Internet connection, or dial-up serial line interface
  • SLIPP/PPP protocol/point-to-point protocol
  • ISDN integrated services digital network
  • DSL digital subscriber line
  • ATM asynchronous transfer mode
  • User computing devices 104 preferably have the ability to send and receive data across communication network 106, and are equipped with web browsers, software applications, or other means, to provide received data on display devices incorporated therewith.
  • user computing device 104 may be personal computers such as Intel Pentium-class and Intel Core-class computers or Apple Macintosh computers, tablets, smartphones, but are not limited to such computers.
  • Other computing devices which can communicate over a global computer network such as palmtop computers, personal digital assistants (PDAs) and mass-marketed Internet access devices such as WebTV can be used.
  • PDAs personal digital assistants
  • the hardware arrangement of the present invention is not limited to devices that are physically wired to communication network 106, and that wireless communication can be provided between wireless devices and data processing apparatuses 102.
  • system 100 can include Internet media extender 110 that is communicatively coupled to television 112, such as via a high-definition multimedia interface (“HDMI”) or other connection.
  • HDMI high-definition multimedia interface
  • user computing device 104 provides user access to data processing apparatus 102 for the purpose of receiving and providing information.
  • data processing apparatus 102 The specific functionality provided by system 100, and in particular data processing apparatuses 102, is described in detail below.
  • System 100 preferably includes software that provides functionality described in greater detail herein, and preferably resides on one or more data processing apparatuses 102 and/or user computing devices 104.
  • One of the functions performed by data processing apparatus 102 is that of operating as a web server and/or a web site host.
  • Data processing apparatuses 102 typically communicate with communication network 106 across a permanent i.e., un-switched data connection 108. Permanent connectivity ensures that access to data processing apparatuses 102 is always available.
  • FIG. 2 illustrates, in block diagram form, an exemplary data processing apparatus 102 and/or user computing device 104 that can provide various functionality, as shown and described herein. Although not expressly indicated, one or more features shown and described with reference with Fig. 2 can be included with or in the audio/visual capture device 105, as well.
  • Data processing apparatus 102 and/or user computing device 104 may include one or more microprocessors 205 and connected system components (e.g., multiple connected chips) or the data processing apparatus 102 and/or user computing device 104 may be a system on a chip.
  • the data processing apparatus 102 and/or user computing device 104 includes memory 210 which is coupled to the microprocessor(s) 205.
  • the memory 210 may be used for storing data, metadata, and programs for execution by the microprocessor(s) 205.
  • the memory 210 may include one or more of volatile and non- volatile memories, such as Random Access Memory (“RAM”), Read Only Memory (“ROM”), Flash, Phase Change Memory (“PCM”), or other type.
  • RAM Random Access Memory
  • ROM Read Only Memory
  • PCM Phase Change Memory
  • the data processing apparatus 102 and/or user computing device 104 also includes an audio input/output subsystem 215 which may include one or more microphones and/or speakers.
  • a display controller and display device 220 provides a visual user interface for the user; this user interface may include a graphical user interface which, for example, is similar to that shown on a Macintosh computer when running Mac OS operating system software or an iPad, iPhone, or similar device when running iOS operating system software.
  • the data processing apparatus 102 and/or user computing device 104 also includes one or more wireless transceivers 230, such as an IEEE 802.11 transceiver, an infrared transceiver, a Bluetooth transceiver, a wireless cellular telephony transceiver (e.g., 1G, 2G, 3G, 4G), or another wireless protocol to connect the data processing system 100 with another device, external component, or a network.
  • wireless transceivers 230 such as an IEEE 802.11 transceiver, an infrared transceiver, a Bluetooth transceiver, a wireless cellular telephony transceiver (e.g., 1G, 2G, 3G, 4G), or another wireless protocol to connect the data processing system 100 with another device, external component, or a network.
  • Gyroscope/ Accelerometer 235 can be provided.
  • one or more buses may be used to interconnect the various modules in the block diagram shown in Fig. 2.
  • the data processing apparatus 102 and/or user computing device 104 may be a personal computer, tablet-style device, such as an iPad, a personal digital assistant (PDA), a cellular telephone with PDA-like functionality, such as an iPhone, a Wi-Fi based telephone, a handheld computer which includes a cellular telephone, a media player, such as an iPod, an entertainment system, such as a iPod touch, or devices which combine aspects or functions of these devices, such as a media player combined with a PDA and a cellular telephone in one device.
  • the data processing apparatus 102 and/or user computing device 104 may be a network computer or an embedded processing apparatus within another device or consumer electronic product.
  • the data processing apparatus 102 and/or user computing device 104 also includes one or more input or output (“I/O") devices and interfaces 225 which are provided to allow a user to provide input to, receive output from, and otherwise transfer data to and from the system.
  • I/O devices may include a mouse, keypad or a keyboard, a touch panel or a multi-touch input panel, camera, network interface, modem, other known I/O devices or a combination of such I/O devices.
  • the touch input panel may be a single touch input panel which is activated with a stylus or a finger or a multi-touch input panel which is activated by one finger or a stylus or multiple fingers, and the panel is capable of distinguishing between one or two or three or more touches and is capable of providing inputs derived from those touches to the data processing apparatus 102 and/or user computing device 104.
  • the I/O devices and interfaces 225 may include a connector for a dock or a connector for a USB interface, Fire Wire, etc. to connect the system 100 with another device, external component, or a network.
  • the I/O devices and interfaces can include gyroscope and/or accelerometer 227, which can be configured to detect 3-axis angular acceleration around the X, Y and Z axes, enabling precise calculation, for example, of yaw, pitch, and roll.
  • the gyroscope and/or accelerometer 227 can be configured as a sensor that detects acceleration, shake, vibration shock, or fall of a device 102/104, for example, by detecting linear acceleration along one of three axes (X, Y and Z).
  • the gyroscope can work in conjunction with the accelerometer, to provide detailed and precise information about the device's axial movement in space.
  • the 3 axes of the gyroscope combined with the 3 axes of the accelerometer enable the device to recognize approximately how far, fast, and in which direction it has moved to generate telemetry information associated therewith, and that is processed to generate coordinated presentations, such as shown and described herein.
  • Additional components can also be part of the data processing apparatus 102 and/or user computing device 104, and, in certain embodiments, fewer components than that shown in Fig. 2 may also be used in data processing apparatus 102 and/or user computing device 104.
  • aspects of the inventions may be embodied, at least in part, in software. That is, the computer- implemented methods may be carried out in a computer system or other data processing system in response to its processor or processing system executing sequences of instructions contained in a memory, such as memory 210 or other machine -readable storage medium.
  • the software may further be transmitted or received over a network (not shown) via a network interface device 225.
  • hardwired circuitry may be used in combination with the software instructions to implement the present embodiments.
  • the techniques are not limited to any specific combination of hardware circuitry and software, or to any particular source for the instructions executed by the data processing apparatus 102 and/or user computing device 104.
  • the present application provides improved processing techniques to prevent packet loss, to improve handling interruptions in communications, to reduce or eliminate latency and other issues associated with wireless technology.
  • Real Time Streaming Protocol can be implemented, for example, for sharing output associated with a camera, microphone and/or other output devices configured with a computing device.
  • RTSP is an effective (though not necessary in all implementations) network control protocol for entertainment and communications systems, including in connection with streaming output.
  • RTSP is used in the present application, at least in part, for establishing and controlling media sessions between various end points, including user computing devise 104, Internet media extender 110 and data processing apparatus 102.
  • one or more implementations of the present application can be configured to use Web Real-Time Communication (“WebRTC”) to support browser-to- browser applications, including in connection with voice, video chat, and peer-to-peer (“P2P”) file sharing.
  • WebRTC Web Real-Time Communication
  • P2P peer-to-peer
  • the present application avoids a need for either internal or external plugins to connect endpoints, including for voice/video or other communication sharing.
  • the present application implements WebRTC for applications and/or Internet web sites to capture and/or stream audio and/or video media, as well as to exchange data between browsers without requiring an intermediary.
  • the set of standards that comprises WebRTC makes it possible to share data and perform
  • WebRTC includes several interrelated APIs and protocols which work together.
  • At least one of the Internet media extender components 110 includes APPLE TV.
  • an Internet media extender 110 is installed (e.g., connected to a television set and connected to a Wi-Fi, Ethernet or other local area network)
  • a software application is installed on the Internet media extender 110, as well as at least one mobile computing device 104.
  • TV APP Internet media extender 110
  • MOBILE APP user computing device 104
  • the mobile computing device 104 e.g., an iPhone
  • the TV APP e.g., an iPhone
  • video content that is provided as a function audio/video output from the computing device (e.g., iPhone) is provided instantly on the television that is connected to the Internet media extender 110.
  • audio/video feed from the iPhone is provided on big screen.
  • the TV APP and the MOBILE APP may be configured as a single application (e.g., distributed as a single application), or may be provided as separate applications.
  • each of a plurality of participants operating, for example, user computing device 104 participate in an interactive video conference at least in part by establishing a data/communication session with the data processing apparatus 102.
  • a form of a star topology is established, in which data processing apparatus 102 is
  • the present application can implement a star topology in which a central node (e.g., a data processing apparatus 102) receives low resolution of video content from each of a plurality of computing devices (e.g., client devices 104).
  • the central node can be configured by executing program instructions to compose a single video comprising all of the video received from the various devices.
  • the single video can be provided substantially in real-time as one high-definition (“HD") video.
  • the central node can send the HD video to all of the computing devices operated by the various users, as well as to the device operated by the "presenter.”
  • each of the respective individual feeds from the respective devices is received by the data processing apparatus 102 and the video feeds (including, for example, images) are composed into a single video stream.
  • the video stream can be configured as a high definition stream (e.g., 1280x720 or higher resolution), and output to each of at least some of the respective user computing devices 104.
  • Fig. 3 is an example high-level diagram that illustrates interactivity between various ones of the devices illustrated in Fig. 1 , and identifies example communication protocols in one or more implementations of the present application.
  • the implementation illustrated in Fig. 3 is usable as a consumer (e.g., a residential) implementation, as well as an enterprise implementation.
  • WebRTC is shown with regard to communications between user computing devices 104 (shown as a CHROME BOOK and mobile computing device, e.g., a smart phone) and supporting browser-to-browser applications and P2P functionality.
  • RTSP is utilized in connection with user computing devices 104 and Internet media extender 110, thereby enabling presentation of audio/video content from devices 104 on television 112.
  • HTTP Live Streaming is utilized for HTTP-based media streaming.
  • HLS is a usable to parse a stream into a sequence of small HTTP-based file downloads, each download comprising a portion of the stream.
  • a client device can select from a number of different alternate streams containing the same material encoded at a variety of data rates, allowing the streaming session to adapt to an available data rate.
  • a M3U playlist containing the metadata for the various sub-streams which are available for download is also provided and downloaded.
  • a respective computing device 104 is illustrated as the "origin” (also referred to herein, generally, as a “presenter” device) that is executing the MOBILE APP and defining a session for respective other devices to use for, for example, interactive video conferencing.
  • the "origin" device 104 establishes an initial session and options are provided to invite other users (e.g., user computing devices 104 that are configured with the MOBILE APP) to join the conferencing session. Users who are invited to join the session can further invite other users, for example, when permission for extending invitations to other users has been made available (e.g., enabled) by the origin device.
  • the MOBILE APP can include instructions for enabling a processor associated with each respective user computing device 104 to generate and transmit invitations for users to join a respective conferencing session.
  • video sharing, video conferencing, sharing of multimedia content, data, documents and various files is supported, as shown and described in greater detail herein.
  • a plurality of interactive communication sessions can be defined by an origin device.
  • Each of the respective sessions can be defined and identified using a specific title or label. For example, "#APPDEV" can be used to define and identify an interactive communication session having a topic dedicated to software application development.
  • the origin device can, thereafter, transmit invitations to computing devices 104 associated with software engineers and other relevant parties to join the
  • Videoconferencing technology in accordance with the present application is, thereafter, available for the software engineers and other relevant parties and the user of the origin device 104, such as to confer over topics associated with software application development.
  • the same respective origin device 104 can define another respective session with a different topical focus, e.g., sales and entitled #SALES.
  • invitations to the #SALES session can be transmitted by the origin device to computing devices 104 associated with individuals in a sales and marketing department.
  • Videoconferencing technology in accordance with the present application is, thereafter, available for those one or more individuals to confer about topics associated with sales. In one or more
  • At least part of the respective groups of users is mutually exclusive, in that members of the "#APPDEV" session cannot participate in the #SALES session, and at least some of the members of the #SALES session cannot participate in the #APPDEV session.
  • an invitation is sent to a user of a computing device 104 for joining a session defined by a respective topic (e.g., #TOPIC)
  • the user affirmatively accepts the invitation and is, thereafter, authorized to join the session.
  • the user can select, via the MOBILE APP, an identifier representing the respect session (e.g., #TOPIC) provided, which causes the user computing device 104 to execute one or more instructions that enable the device 104 to connect to and/or join the session, and access materials associated therewith.
  • rules can be defined and/or enforced that restrict access to sessions and/or content to respective users.
  • a session defined as #TOPIC may be shared by seven users, however rules can be defined by a user of the origin computing device 104 and implemented that restricts all but three of the users from real-time video conferencing via the #TOPIC session.
  • Content associated with the #TOPIC session can be made available to all seven of the users.
  • Materials associated with a respective session can be stored (e.g., backed up) remotely, e.g., in the "cloud" and be available for access, archived and/or made available for users in the future. Such control can, be restricted from future access, as well.
  • communication sessions including interactive video among respective individuals and parties.
  • a plurality of parties can connect to a respective videoconferencing session in accordance with the present application.
  • a client/server model can be effective for handling the respective devices and management of data and communications thereof.
  • one or a few individuals connect to a respective videoconferencing session in accordance with the present application.
  • a P2P framework can be effective in an implementation.
  • FIG. 4 illustrates an example implementation showing an alternative arrangement 400 in which a plurality of users (1-n) operating user computing devices 104 are connected to the server (data processing apparatus 102) and sending individual video feeds and receiving back the composite video feed illustrating users 1-n.
  • the composed HD video stream that comprises the users' video streams can be disassembled by each of the respective user computing devices 104 that receive the composed video stream into individual elements, for example, each representing a respective user participating in the video conference. Other individual elements representing various users can be disassembled, as well.
  • the received video from the data processing apparatus 102 can be received by each respective client device 104, and then dissembled into independent portions.
  • a video matrix of 50 users is transmitted to each of the 50 client devices 104, and each device 104 dissembles the matrix into 50 individual and portions that can be manipulated, such as dragged around the display of the client device, resized, closed, or the like.
  • Each respective user can enjoy a custom and individualized layout of each of the respective feeds from the respective devices, as the disassembled portions can be remapped, such as on a user-defined or pre-defined grid.
  • the data processing apparatus 102 receives 51 streams of video, composes the streams into a canvas and outputs one frame (e.g., HD) at that moment of time.
  • a participant when a participant speaks or otherwise provides audio content in the conference, that user's device 104 may experience an echo, when that user's device 104 plays the audio.
  • the present application may be configured such that the client devices 104 are muted.
  • a limited number of participants may be permitted to contribute audio (e.g., speak) at a time. For example, three devices 104 of fifty devices 104 are configured to enable audio input, while the rest of the devices 104 are muted.
  • each speaking user's device 104 may be configured to silence the audio output originating from that user's device 104 to eliminate any echo.
  • the present application supports a form of audio session
  • a 4 th device 104 inputs audio that is distributed with the composited video provided by the server 102, one of the other three devices 104 is "bounced" and audio input for that device may be removed.
  • Various forms of audio moderation and/or control options are supported for the client devices 104. For example, a first-in-first-out arrangement is supported, such that as one device 104 is added for speech, the device 104 having the currently longest speech capability is removed.
  • auto-detect functionality is supported in which audio capability for devices 104 is automatically turned on and off as vocal input is detected.
  • a moderator assigns rights to the various devices for speech input.
  • Figs. 5A-5G illustrate an example implementation and show display screens 500, 510, 520, 530, 540, 550 and 560, representing an implementation of the present application in which a host user presenter is selecting content for recording interactive video content and providing an interactive conference in accordance with an example implementation.
  • a host user presenter is selecting content for recording interactive video content and providing an interactive conference in accordance with an example implementation.
  • a user can establish a video conference, record video content, share the content and interact with the users during the video conference.
  • Fig. 5H illustrates an example display screen 570 of a video conference provided on a client device 104 in accordance with an example implementation.
  • the video composed by the server 102 comprising the plurality of video feeds from the respective client devices 104 has been disassembled by the respective client device 102, and the various video feeds of the participants has been arranged according to the user's preference.
  • the relative positions and formats of the disassembled users' video feeds can be predefined by the user or in other default configuration, and/or can be manipulated for a particular video conference session. The respective manipulations can be saved and used in future video conference sessions to position/format the respective feeds in accordance with a previous session.
  • the MOBILE APP can configure a user computing device 104 to provide graphical screen controls that, when selected by a user, result in one or more instructions being executed by a processor associated with a user computing device 104 to generate and send an invitation to one or more other user(s).
  • An example interface including a graphical screen control 602 that is selectable for transmitting such an invitation to one or more second user computing devices 104 is illustrated in Fig. 6.
  • the invitation may be via the Internet media extender 110 (e.g., APPLE TV), user computing device 104 or other device, depending upon a respective implementation and/or context of use.
  • a user engaged in an interactive conference via the Internet media extender 110 and television 112 may use a remote control device in connection with making selections and issuing instructions, in one or more implementations.
  • An example virtual pointing device is shown and described in commonly assigned U.S. provisional patent application 62/105,682, filed on January 20, 2015, the entire contents of which are incorporated by reference as if set forth in its entirety, herein.
  • An invitation provided in accordance with the present application can include a hyperlink to a uniform resource locator ("URL") and can be sent via SMS, email, provided in the MOBILE APP, copied in memory, such as to a computing device "clipboard” or provided on an Internet web page, or distributed in other suitable ways Thereafter, at least one other user selects the hyperlink, such as via a mobile user computing device 104 (e.g., a smartphone, tablet or other computing device) that is configured by executing the MOBILE APP, and the user(s) is automatically connected via the communication session defined by the origin computing device 104.
  • a mobile user computing device 104 e.g., a smartphone, tablet or other computing device
  • a prompt to install the MOBILE APP on the device 104 can be provided.
  • the user computing device 104 can be routed to a site (e.g., APP STORE or ANDROID MARKET) to download/install the MOBILE APP.
  • a site e.g., APP STORE or ANDROID MARKET
  • the user can use the link or otherwise connect to the origin device's session.
  • the user is operating a mobile user computing device 104 that is not configured by executing the MOBILE APP, for example, when the user computing device 104 is a laptop computer, a desktop computer, or a network-based computer (e.g., a CHROMEBOOK), then the user can be prompted to launch a web browser software application (e.g., CHROME or SAFARI) and the user computing device 104 can connect to the session, for example via a hyperlink.
  • a web browser software application e.g., CHROME or SAFARI
  • hyperlinks to respective sessions can be persistent, and accordingly be repeatedly used for connection.
  • one or more names can be used to define and refer to a session, and shared in such ways that users can simply select the same link, select the hyperlink as provided in the web browser' s history or in some other consistent manner to reconnect to a session and/or access content/information associated with a respective session.
  • graphical screen controls section 702 is provided that includes controls for adding sharable content, muting a microphone and recording a session. It is to be appreciated that section 702 and the corresponding controls therein are exemplary and that many other options can be provided in section 702 (see, for example, controls 1002 in Fig. 10).
  • a business and/or enterprise implementation can integrate an Internet media extender and television to provide a video conferencing and/or data collaboration solution.
  • a group of people wish to start a data and video conference collaboration session. Some of the people are located in a conference room that includes a TV and a connected Internet media extender (e.g., APPLE TV). Others of the people are in various remote geographic locations, with some using mobile computing devices (e.g., smartphones or tablet computers) and some using desktop/laptop computers.
  • a user associated with the origin host starts the session via the Internet media extender via the TV APP and/or a mobile computing device 104 and via the MOBILE APP, which have been downloaded and installed on at least some of the respective devices 104 and 110 in the conference room and operated by the participants.
  • an initial configuration which may occur the first time the MOBILE APP and/or TV APP is launched, audio/video content from one or more of the computing devices 104 is provided instantly on the television 112 via the Internet media extender 110.
  • an invitation can be transmitted, e.g., via the Internet media extender or mobile computing device 104, to one or more other users' computing devices 104.
  • the invitation can include a hyperlink to a URL that can be sent via SMS, email, provided in the MOBILE APP or on an Internet web page. Users of computing devices 104 select the link, which configures the user computing device(s) 104 to launch the MOBILE APP and join the session automatically.
  • the present application supports integration of multiple cameras and microphones that can be connected remotely to an Internet media extender, such as APPLE TV.
  • a plurality of mobile computing devices 104 e.g., iPhone/iPad/laptop
  • This is similar, in practice, to a "TouchCast" studio multi-camera setup, which allows multiple cameras to feed into an authoring tool.
  • a description of such an authoring tool is shown and described in greater detail in commonly assigned U.S. Patent No. 9,363,448, issued June 7, 2016. Supporting live audio/video feed by multiple cameras provides an advantage and technological benefit for multiple people located in the same room and/or remotely located to utilize their respective mobile devices.
  • audio detection mechanisms can be employed such that when a user speaks, feed from the microphone and/or camera on that user's respective device is provided on audio output (e.g., speakers) associated with the television 112 (via, for example, the Internet media extender 110), as well as on connected computing devices 104 operated by people remotely located (i.e., not in the local setting).
  • audio output e.g., speakers
  • connected computing devices 104 operated by people remotely located (i.e., not in the local setting).
  • cameras associated with the connected computing devices 104 can be "cut to" via one of several ways.
  • the host user can make selections to switch input from various cameras/devices.
  • the MOBILE APP configures the respective computing devices 104 with automatic speaker detection, which operates to detect when a user is speaking and input from that user's respective
  • a user proactively takes control to have audio/video feed from his or her user computing device 104, which can be effected by simply tapping on the screen of the user's computing device 104, to make that user's device 104 provide the primary feed, and can be presented to the other user computing devices 104 in the session.
  • the present application supports video compositing on the TV APP and/or the MOBILE APP, which can include sharing of content between a plurality of devices.
  • the present application supports multiple configurations in which multiple users are presented during the same session. For example, a primary presenter is viewable on all the devices, and everyone else connected to the session views the primary presenter and/or content the primary presenter shares.
  • co- viewing is supported, in which a plurality (e.g., all) members of the session are visible on the screen at the same time.
  • live co-viewing of content viewed by participants is preferably synchronized.
  • content can include YouTube videos, and a group of viewers watch videos together and are in sync as they do so, allowing participants to control the playlist of upcoming content, effectively collaboratively creating a playlist.
  • Another example can include video streams that are live from an external feed.
  • Other examples include viewing a website, and reviewing images and videos from the users' mobile devices 104 (via same stream from device 104 to the Internet media extender 110).
  • a hybrid mode is supported in which all participants can be presented, and one or more instructions executing on a computing device 104/data processing apparatus 102 implement an algorithm that governs which respective user computing device 104 is featured, making some device(s) more prominent as a function of current activity (e.g., someone speaking).
  • multi-camera coverage is supported for a location (e.g., a conference room) which is configured by a primary camera positioned at or with the television 112 that is coupled to the Internet media extender 110, and that includes participants' user computing devices 104. In operation, content can cut between the full view of the room and the individual participants when they speak.
  • FIGs. 9A-9D illustrate examples of sharing content between devices 104, in accordance with an example implementation of the present application.
  • Examples in Figs. 9A-9D identify respective control over portions of content of interactive display screens of user computing devices 104, including as used to provide content on a plurality of devices 104, as well as for individual control over a respective user computing device 104.
  • individual portions can be sized, moved, or otherwise transformed in a respective user's user computing device 104, without affecting other devices 104.
  • Each of a plurality of users e.g., USER 1 and USER 2
  • the users are represented in video that is captured by cameras configured with the respective users' computing devices, and that is displayed substantially in real-time.
  • Fig. 10 illustrates an example set of applications and controls 1002 available via the MOBILE APP and operating on user computing device 104 during an interactive video conferencing session, in accordance with the present application.
  • controls 1002 options for drawing, and providing content from online sources (e.g. webpages, Wikipedia, news sources, maps, Twitter or the like), as well as controls for drawing tools, apps (e.g., calculator, image editing/controls and audio/video feed).
  • apps e.g., calculator, image editing/controls and audio/video feed.
  • Other activities can be integrated, such set forth in vApps, and in the context of communications.
  • games such as Tic/Tac/Toe, Chess, Backgammon, puzzle games, draw together, trivia, cards and table game.
  • Other games can include action games, such as first person shooter games.
  • virtual adventure and exploration is supported, such as GOOGLE MAPS and 360 views, and photo galleries (e.g., FLICKR, GOOGLE IMAGES), shopping galleries, planning tools (e.g., for travel, entertaining, ordering food, etc.), and various professional consultation is supported, such as telemedicine and other professional consultations.
  • photo galleries e.g., FLICKR, GOOGLE IMAGES
  • shopping galleries e.g., for travel, entertaining, ordering food, etc.
  • planning tools e.g., for travel, entertaining, ordering food, etc.
  • various professional consultation is supported, such as telemedicine and other professional consultations.
  • collaboration and collaborative tools include a collaborative whiteboard, document creation and editing, mood board collaboration, general brainstorming, reviewing comps, training and instruction (with real-time assessment), focus group input, and can include real-time voting, sharing, collective web site and/or web application use that includes (but is not limited to) documents, spreadsheets, content management, project management, calendar planning or the like.
  • the present application provides systems and methods for participating video conferencing and sharing that can be layered with interactive content, including content that is available over one or more data communication networks, such as the Internet. Further, one or more software applications provide a viewing/interactive tool for end-users who receive videos that are authored in accordance with the present application, including in an on-line interactive conference.
  • a client interface (which may be configured in a MOBILE APP, or provided via a standard web browser application or other suitable platform), users may interact with videos as a function of touch and gestures, as well as other suitable interfaces, such as provided via an application that configures a smartphone or other mobile computing device to simulate a laser pointer, drawing tool, mouse, trackball, keyboard or other input device.
  • a processor configured with code processes information representing a selection event that occurred in the display unit. For example, a user makes a selection in a remote control software application operating on his or her mobile computing device (e.g., iPhone) in a portion of the display unit while the interactive media content in the display unit is provided therein.
  • the processing that occurs can be to determine at least a relative time and location of the selection event that occurred in the second portion of the display.
  • the information representing the selection event can be stored in one or more databases that are accessible to at least one computing device.
  • the selection of an item can be processed to enable the interaction with at least a portion of the interactive media content at one of the remote devices associated with the selection event. This enables results of a respective interaction associated with the selection event to be viewable or otherwise provided at one particular remote device, but not viewable or otherwise provided at other of the remote devices.
  • Other functionality includes drawing and selection features, which is effective for explaining and highlighting features within a coordinated presentation, including during an interactive video conferencing session.
  • the present application supports providing virtual representations of respective users that are interfacing via a respective video conferencing session in accordance with the teachings herein.
  • one or more modules can be implemented to simulate the viewpoint for each of the respective users that one particular user is located "behind" the display screen configured with, or otherwise accessible by, user computing device 104.
  • a partial representation of a person can similarly be represented and displayed in dynamic ways to represent movement, such as in the context of an interactive video conferencing session.
  • Such functionality can be provided in a particularly configured vAPP.
  • An example is set forth in Figs. 1 lA-1 IE.
  • Fig. 11 A illustrates an example video conferencing session displayed on a user computing device 104, in which the session is between two users (USER 1 and USER 2).
  • writing virtual control e.g., icon
  • writing virtual control 1101 is included that, when selected, causes computing device 104 and/or data processing apparatus 102 to execute one or more instructions to enable a unique interactive environment which simulates the appearance of users.
  • the simulation effect can occur dynamically as a user interacts with user computing device 104, such as by drawing or writing on the screen, using his or her finger, an electronic passive or active stylus or other suitably configured writing device.
  • user computing device 104 Upon a determination by computing device 104 that a user is interacting accordingly, one or more processes can operate to detect and capture specific information associated with the interaction, such as that a user is drawing on his or her display with a stylus and the specific location where the stylus is in contact with the display.
  • the computing device 104 and/or 102 can alter the video representation of an interacting user (e.g., USER 1) on one or more of the computing devices operated by the respective other users during the interactive video conferencing session.
  • an interacting user e.g., USER 1
  • FIG. 1 IB An example is shown in a display of a computing device operated by USER 2 is shown, and in which the video representation of USER 1 has been enlarged and shaded as a function of one or more filter effects (e.g. shading and size).
  • a graphical representation of a human hand 1102 has been overlaid on the display of user computing device 104.
  • the hand 1102 is represented to be holding a writing instrument, such as a stylus (e.g., APPLE PENCIL). Furthermore, the writing instrument is configured to appear to be making contact with the surface of the display at the specific point 1104 at which USER 1 is interacting.
  • the altered representation of USER 1 can be provided on all of the computing devices of the interactive video conferencing session, including the computing device operated by USER 1. Alternatively, the computing device operated by USER 1 is not affected while USER 1 interacts, such as by drawing on his or her display screen.
  • USER 1 appears to be positioned on the other side or within the computing device 104 operated by another user (e.g., USER 2).
  • This can be implemented using one or more image and/or video editing techniques. For example, adjustments can be made to the video content to implement transparency, shading, size or other suitable effects, and one or more layer masks can be used to selectively apply the adjustment.
  • a video composite can be generated that dynamically changes (e.g., moves or changes positions) in accordance with respective user interaction and or activity.
  • Figs. 1 lB-1 ID illustrate video content showing USER 1 in an enlarged and shaded format, which occurs as a function of USER 1 interacting by writing on the display screen of his user computing device 104.
  • the video showing USER 1 Upon lifting his writing instrument away from the display screen, thereby ending his respective edits, the video showing USER 1 returns to its previous format (Fig. HE).
  • the user's writing or drawing can remain displayed on each of the other users' computing devices.
  • the present application provides for a realistic and interactive experience for users of an interactive video conferencing session.
  • a user e.g., USER 1
  • computing device 104 and/or 102 detects and monitors the activity substantially in real-time.
  • a portion of the display can be mapped as a series of coordinates and/or pixels, and the respective location of each interaction can be determined and used for setting a corresponding location on each user's computing device during an interactive video conferencing session.
  • a virtual hand 1102 can be generated and displayed on each of the other users' computing devices, with the specific point 1104 of the stylus represented as being held by the virtual hand 1102 positioned at the same coordinates.
  • the virtual hand 1102 moves and the specific point 1104 of the stylus moves to the same location(s).
  • the hand 1102 can be configured to turn and rotate, such as particular locations within the display screen, in order to provide a more realistic and accurate representation of someone writing or drawing.
  • NURBs Non-Uniform Rational Basis Splines
  • NURBs Non-Uniform Rational Basis Splines
  • Fig. 12A illustrates a display screen of a computing device operated by USER 2, and shows USER 1 drawing a landscape that includes mountains and a road. USER 1 is drawing the landscape to show USER 2 a type of photographic image that USER 1 would like to use for commercial purposes.
  • USER 2 selects an icon to browse for specific content, such as images that are stored on the computing device operated by USER 2. After locating a suitable image that is locally stored and USER's 2 computing device, the image is inserted and shown to USER 1 (Fig. 12B).
  • FIGs. 13A-13B illustrate example implementations of the present application from the perspective of a user (USER 1) drawing on a display.
  • USER 1 is preparing to draw on his display using a stylus, but has not yet made contact with the display.
  • Fig. 13B USER 1 has caused his stylus to make contact with the display and is drawing.
  • the enlarged and shaded representation of USER 1 is displayed on the computing device operated by USER 1.
  • Fig. 14 illustrates a flow diagram of steps SI 00 in connection with one example implementation of the present application.
  • a first user computing device 104 that represent a session (e.g., #SALES) (step S102).
  • a network session is defined (step S104).
  • access is provided to the first user computing device 104 (step S106).
  • the network session access can include, for example, functionality that is provided for presenter or origin devices, which can include additional rights than provided to participant or non-presenter devices.
  • information associated with additional computing device(s) 104 is received (step S108).
  • different access to the network session is provided for the additional computing device(s) (step 110).
  • step SI 12 audio and/or video (“audio/video”) input is received from each of the respective devices 104.
  • audio/video For example, feed from a camera and/or microphone that is operatively connected to each computing device 104 is received by data processing apparatus 102.
  • a composited audio/video feed is generated using the audio/video input (step SI 14), and the composited audio/video feed is transmitted to each of the devices 104 (step SI 16).
  • Each of the first user computing device 104 and the additional user computing devices 104 is configured via a gesture-based user interface to enable user-based selection and respective manipulation of at least a portion of the composited audio/video feed that results in a customized representation of the composited audio- video feed at a particular one of the at least one additional user computing device that is not represented at a particular other of the at least one additional user computing device. Thereafter, the process ends (step SI 18).
  • the present application can further include a feature that allows a user to simulate a laser pointer effect when presenting embedded content in a coordinated presentation.
  • the on-board gyroscope provided with a mobile computing device, such as a smartphone, can be employed to locate where laser pointer functionality effectively should appear in a coordinated presentation.
  • a mobile computing device such as a smartphone
  • vApps substantially as shown and described in co-pending and commonly assigned Patent
  • Application Serial Number 14/316,536) can be interacted with as a function of the mobile computing device simulating a laser pointer.
  • the user can perform various laser-pointer functionality, such as to navigate between slides, point to or identify respective portions of a display including in a coordinated presentation, or perform other automated tasks.
  • the pointer can be moved around the screen as a function of the gyroscope within the mobile computing device.
  • a mobile computing device that is configured with the MOBILE APP is configured to simulate the remote control, laser device and/or annotation and drawing tool.
  • various vApps can be included in a respective interactive video conferencing session and can be manipulated (including pointed at) by a user using the remote control. This enables a user to be decoupled from the respective authoring platform, such as the iPad or other tablet computer, by using a simulated remote control, for example, across the room.
  • content that is curated e.g., queued for inclusion in a video conferencing session, can be selected simply by pressing an option in a graphical user interface provided on the mobile computing device operating as the remote control.
  • Interactive elements e.g., vApps can be embedded in the conference session simply by the author selecting an option to include the element(s) in the remote control software app.
  • the author can add and/or remove interactive elements by selecting options in the remote control app operating on the mobile computing device, which effectively frees the author from being tied to the authoring tool (e.g., the iPad).
  • users or participants of a conferencing session of the present application can use a remote control, pointing and annotation functionality, including on their respective mobile computing devices (e.g., smartphones) to interact with coordinated presentations.
  • a viewer of a coordinated presentation can select a vApp during playback to be presented with the content therein, and thereafter highlight, draw on or perform other interactive functionality using the simulated remote control.
  • a virtual pointer, and annotating tool or other selection tool in a coordinated presentation can be remotely controlled.
  • a smartphone or other mobile computing devices effectively doubles as a mouse, selection device, drawing tool or other interactive device.
  • the mobile computing device and coordinated presentation authoring/playback device preferably communicate over Wi-Fi.
  • the remote can ask the "master" device via Wi-Fi or other protocol, such as Bluetooth, for permission to connect therewith.
  • the telematics of the mobile computing device such as an accelerometer and/or gyroscope, is employed over a digital IP connection to transmit to the presentation authoring and/or playback software, which in turn functions to control a simulated laser red dot, drawing tool or other functionality, which can be configured as a core function of the presentation authoring and/or playback application.
  • the presentation authoring and/or playback software which in turn functions to control a simulated laser red dot, drawing tool or other functionality, which can be configured as a core function of the presentation authoring and/or playback application.
  • a new form of remote control is provided by pairing a mobile computing device, such as a smartphone, with an authoring tool device, a display device, or other presentation device.
  • Various functionality provided in connection with coordinated presentations such as controlling teleprompters (e.g., speed), green screen functionality, whiteboard functionality, titles, interactive Web-based content, or the like, can be selected and controlled vis-a-vis the remote control in connection with the present application.
  • the present application further provides for simulating laser pointer control, annotation and drawing devices, such as for controlling publicly viewed or accessible displays.
  • the present application is also useful for public speaking or other public presentation activities.
  • the present application supports simulation of a laser pointer, annotation and drawing tool.
  • the present application provides a simple to use, yet powerful interactive remote video conferencing platform that incorporates a plurality of computing devices, e.g., smartphones, tablets, laptops and desktops, and enables live, realtime sharing and conferencing.
  • One or more televisions 112 can be implemented in the present application via an Internet media extender 110, and content can be provided from a plurality of remote sources, such as cameras and/or microphones configured with user computing devices 104 that are located remotely and communicating over the Internet.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Engineering & Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

Une session de communication en réseau est définie vis-à-vis d'informations de paramètres reçues en provenance d'un premier dispositif, et l'accès à la session de communication en réseau est accordé au premier dispositif. L'accès à la session de communication en réseau est en outre accordé à chaque dispositif parmi un ou plusieurs dispositifs supplémentaires en fonction d'informations associées audit ou à chacun desdits dispositifs supplémentaires. Un flux audio/vidéo composé interactif est généré et émis, qui comporte une entrée audio/vidéo reçue pendant la session de communication en réseau en provenance de chacun des dispositifs. Chacun des dispositifs est configuré via une interface d'utilisateur basée sur les gestes pour permettre une sélection par utilisateur et une manipulation respective d'au moins une partie du flux audio/vidéo composé, qui donne une représentation personnalisée du flux audio/vidéo composé au niveau d'un dispositif particulier qui n'est pas représentée au niveau d'un autre dispositif particulier parmi le ou les dispositifs.
EP16840132.1A 2015-08-25 2016-08-25 Système et procédé de vidéoconférences interactives Withdrawn EP3342158A4 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201562209727P 2015-08-25 2015-08-25
US201562242029P 2015-10-15 2015-10-15
US201662329081P 2016-04-28 2016-04-28
PCT/US2016/048720 WO2017035368A1 (fr) 2015-08-25 2016-08-25 Système et procédé de vidéoconférences interactives

Publications (2)

Publication Number Publication Date
EP3342158A1 true EP3342158A1 (fr) 2018-07-04
EP3342158A4 EP3342158A4 (fr) 2019-04-17

Family

ID=58101076

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16840132.1A Withdrawn EP3342158A4 (fr) 2015-08-25 2016-08-25 Système et procédé de vidéoconférences interactives

Country Status (2)

Country Link
EP (1) EP3342158A4 (fr)
WO (1) WO2017035368A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11374990B2 (en) 2020-09-14 2022-06-28 Box, Inc. Saving an overlay annotation in association with a shared document

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107045307A (zh) * 2017-05-04 2017-08-15 安徽庆睿实业有限责任公司 视频会议远程控制装置
US10579163B2 (en) * 2018-06-02 2020-03-03 Mersive Technologies, Inc. System and method of annotation of a shared display using a mobile device
US11196787B2 (en) * 2019-07-08 2021-12-07 Microsoft Technology Licensing, Llc Server-side rendered audio using client audio parameters
CN111711784B (zh) * 2020-06-15 2022-10-18 北京字节跳动网络技术有限公司 会议控制方法、装置、可读介质及电子设备
US11509863B2 (en) * 2021-03-22 2022-11-22 Google Llc Multi-user interaction slates for improved video conferencing

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006021444A2 (fr) * 2004-08-25 2006-03-02 Sony Ericsson Mobile Communications Ab Materiel electronique destine a un systeme de communication sans fil
US20080068448A1 (en) * 2006-09-18 2008-03-20 Hansen Robert A Method for adapting a device to participate in video conference calls
CN101286865B (zh) * 2008-05-14 2010-11-10 华为技术有限公司 音视频会议中实现电子白板的方法、装置及系统
US8487975B2 (en) * 2009-01-27 2013-07-16 Lifesize Communications, Inc. Conferencing system utilizing a mobile communication device as an interface
NO331338B1 (no) * 2009-06-24 2011-11-28 Cisco Systems Int Sarl Fremgangsmate og anordning for endring av en videokonferanse-layout
US8744420B2 (en) * 2010-04-07 2014-06-03 Apple Inc. Establishing a video conference during a phone call
US20150121250A1 (en) * 2013-10-31 2015-04-30 Avaya Inc. PROVIDING INTELLIGENT MANAGEMENT FOR WEB REAL-TIME COMMUNICATIONS (WebRTC) INTERACTIVE FLOWS, AND RELATED METHODS, SYSTEMS, AND COMPUTER-READABLE MEDIA
US9246961B2 (en) * 2013-11-27 2016-01-26 Facebook, Inc. Communication user interface systems and methods

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11374990B2 (en) 2020-09-14 2022-06-28 Box, Inc. Saving an overlay annotation in association with a shared document

Also Published As

Publication number Publication date
EP3342158A4 (fr) 2019-04-17
WO2017035368A1 (fr) 2017-03-02

Similar Documents

Publication Publication Date Title
US10033967B2 (en) System and method for interactive video conferencing
US10911716B2 (en) System and method for interactive video conferencing
US10531044B2 (en) Intelligent virtual assistant system and method
US11343293B1 (en) System and method of enabling a non-host, participant-initiated breakout session in a videoconferencing system, and simultaneously displaying a session view of a videoconferencing session and the participant-initiated breakout session
US11310463B2 (en) System and method for providing and interacting with coordinated presentations
EP3961984B1 (fr) Système et procédé de file d'attente de participation pour une visioconférence en ligne
WO2017035368A1 (fr) Système et procédé de vidéoconférences interactives
US10121512B2 (en) System and method for providing and interacting with coordinated presentations
US11457176B2 (en) System and method for providing and interacting with coordinated presentations
WO2019056001A1 (fr) Système et procédé de vidéoconférence interactive
US11405587B1 (en) System and method for interactive video conferencing
US20130117704A1 (en) Browser-Accessible 3D Immersive Virtual Events
US9666231B2 (en) System and method for providing and interacting with coordinated presentations
US10297284B2 (en) Audio/visual synching system and method
US10084849B1 (en) System and method for providing and interacting with coordinated presentations
US11659138B1 (en) System and method for interactive video conferencing
WO2020033896A1 (fr) Système et procédé de fourniture de présentations coordonnées et d'interaction avec celles-ci
WO2019036033A1 (fr) Système et procédé permettant de fournir des présentations coordonnées et d'interagir avec celles-ci
WO2018132514A1 (fr) Système et procédé d'assistant virtuel intelligent
EP3175372A1 (fr) Système et procédé permettant de fournir des présentations coordonnées et d'interagir avec celles-ci

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180326

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20190318

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 7/14 20060101AFI20190312BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20210302