JP6617641B2 - Conference display method, wearable system, and program executed by wearable device - Google Patents

Description

  The present invention relates to a conference display method, a wearable system, and a program executed by a wearable device.

  Conferences, once limited to conference rooms or office areas, are beginning to spread gradually across space, time, and equipment. Such distributed conferences are primarily related to groups of individuals, and the individuals who make up the groups communicate with each other and have access to the technical infrastructure necessary to share information. Or communicate from a phone-based setting. However, it is not easy to stay conscious of such a meeting when attendees are off-site while traveling or traveling (eg, in a hospital waiting room). Therefore, in order for a distributed conference to proceed properly, the method of representing the sharing of meeting attendees, files or screens, and other materials must be adapted to the context of each individual attendee.

Paul et al., “Ask an Expert: Mobile Workspaces for Collaborative Troubleshooting”, System Sciences (US), System Sciences (15) (IEEE) The 48th Annual International Conference of Hawaii, pages 442-451

  There is a need for a simple and non-intrusive tool that allows individual participation in a distributed conference.

  A first aspect relates to a conference between a plurality of attendees, and is a method executed by a wearable device worn by a user, the wearable device including a central processing unit, a display device, and a memory, The central processing unit extracts a plurality of key frames from each of a plurality of live conference streams, and sends one of the plurality of key frames from the plurality of live conference streams to the user at the display device. Displaying one of the plurality of key frames from one of the plurality of live conference streams when the input from the user is detected and the detected input from the user is a first type. And when the detected input from the user is the second type, the plurality of live conference streams from the other one of the plurality of live conference streams. To display one of the over frame.

  A second aspect is the method of the first aspect, wherein the first type of user input includes a first direction user gesture.

  A 3rd aspect is a method of a 2nd aspect, Comprising: Said 1st direction is a left-right direction.

  A fourth aspect is the method according to any one of the first to third aspects, wherein the second type of user input includes a user gesture in a second direction.

  A 5th aspect is a method of a 4th aspect, Comprising: Said 2nd direction is an up-down direction.

  A sixth aspect is the method according to any one of the first to fifth aspects, wherein when the detected input from the user is a third type, the displayed key frame is enlarged. Further included.

  A seventh aspect is the method of the sixth aspect, wherein the third type of user input includes a double tap gesture.

  An eighth aspect is the method according to any one of the first to seventh aspects, wherein when the detected input from the user is a fourth type, one of the plurality of live conference streams is selected. Further displaying to the user.

  A ninth aspect is the method of the eighth aspect, wherein the fourth type of user input includes directing a display of the wearable device to the face of the user.

  A tenth aspect is the method according to the eighth aspect, wherein when the user turns away from the display of the wearable device, one of the plurality of live conference streams is stopped from being displayed to the user. Further comprising.

  An eleventh aspect is the method according to any one of the first to tenth aspects, wherein each of the plurality of key frames is generated based on a difference between two key frames in a corresponding live conference stream. .

  A twelfth aspect is the method according to the eleventh aspect, wherein each of the plurality of key frames has a difference between two key frames in the corresponding live conference stream exceeding a predetermined threshold. Is generated.

  A thirteenth aspect is the method according to the twelfth aspect, wherein the predetermined threshold is determined based on a type of content in the corresponding live conference stream.

  A fourteenth aspect is the method according to any one of the first to thirteenth aspects, further including using the display device to display a chat message to the user.

  A fifteenth aspect is the method according to any one of the first to fourteenth aspects, further comprising receiving a chat input from the user and transferring the chat input to the plurality of meeting attendees.

  A sixteenth aspect is the method according to the fifteenth aspect, wherein the chat input is received from a user using a graphical user interface generated on the display device.

  A seventeenth aspect is the method according to the sixteenth aspect, wherein the graphical user interface includes at least one user selectable widget, and a corresponding chat input is generated on the widget selected by the user. The

  An eighteenth aspect is the method according to the fifteenth aspect, wherein the chat input is received from a user by converting the user's voice into a text chat message.

  A nineteenth aspect is the method according to any one of the first to eighteenth aspects, wherein the detected input from the user is to detect a word spoken by the user, and to detect the detected utterance word. Further converting to user input corresponding to one type or a second type.

  A twentieth aspect is a wearable system worn by a user, wherein a central processing unit, a display device, a memory storing a computer-executable instruction set, and a plurality of key frames from each of a plurality of live conference streams. Means for extracting; means for displaying one of the plurality of key frames from one of the plurality of live conference streams to the user on the display device; means for detecting input from the user; When the input from the user is the first type, another one of the plurality of key frames is displayed from one of the plurality of live conference streams, and the detected input from the user is the first type. If there are two types, one of the plurality of key frames is displayed from the other one of the plurality of live conference streams. It includes a control unit that, the, be performed in connection with the meeting between multiple attendees.

  A twenty-first aspect is a program that extracts a plurality of key frames from each of a plurality of live conference streams, and displays one of the plurality of key frames from one of the plurality of live conference streams on a display device. Display to the user, detect an input from the user, and when the detected input from the user is the first type, from one of the plurality of live conference streams to another one of the plurality of key frames. A plurality of attendees displaying one of the plurality of keyframes from the other one of the plurality of live conference streams when the detected user input is of the second type In connection with a conference between persons, the computer executes a process executed by a wearable device worn by the user.

  The present invention provides a simple and unobtrusive tool that allows individual participation in the progress of a distributed conference.

1 illustrates an embodiment of a system that enables a distributed conference with at least one attendee connecting to a conference using a wearable device such as a smartwatch. 1 illustrates an embodiment of a system that enables a distributed conference with at least one attendee connecting to a conference using a wearable device such as a smartwatch. Fig. 4 illustrates various embodiments of a graphical user interface screen of a software application executing on a user wearable device. The example of the operation sequence of the software application which performs a user's wearable apparatus is shown. An embodiment of a wearable computer system in which this embodiment can be developed will be described.

  In the following detailed description, reference is made to the accompanying drawings. In the accompanying drawings, components having similar functions are referred to by the same reference numerals. The accompanying drawings are intended to illustrate particular embodiments and implementations consistent with the principles of the invention and are not intended to be limiting. These implementations are described in sufficient detail to enable the invention to be practiced. Other implementations are also available, and structural changes and / or replacement of various components are possible without departing from the scope and spirit of the invention. The following detailed description should not be construed as limiting. Also, the various embodiments of the invention described may be implemented in the form of software running on a general purpose computer, may be implemented in the form of special purpose hardware, or software and hardware It may be implemented in combination.

  According to one aspect of the embodiments described herein, a wearable device such as a smartwatch known to those skilled in the art can be used to maintain basic awareness regarding conference audio and video content for conference attendees. Systems and related methods are provided. Embodiments of the described systems and methods also provide an essential interaction mechanism so that remote or mobile users can engage with distributed conferences without distracting from other tasks. In one embodiment, the described technique provides a non-intrusive way for a user to attend an ongoing distributed meeting using a smartwatch-based interface of a video conferencing application.

  In one or more embodiments, the described solution uses a keyframe concept. A key frame is a screen capture of a screen shared by attendees during a meeting and is recorded for later reference. The use of the above key frame, which is a capture of still images depicting screen content shared by attendees, does not display the real-time video stream of the conference, but allows the user to quickly get the current idea of the video stream in a distributed conference. Is to provide. As a result, the battery life of the wearable device of the user is not consumed.

  FIGS. 1A and 1B show two embodiments of a system that enables a distributed conference with at least one attendee connecting to a conference using a wearable device such as a smartwatch. An example system 100 shown in FIG. 1A includes a central server 101 and is communicatively connected to a distributed conference attendee computing system 102, 103, 104 via a computer network. In one or more embodiments, the data connection is performed using the HTTP protocol. The wearable device 105 worn by the conference participant is also connected to the central server 101 so as to be communicable. In one embodiment, the conference participant computing system 102, 103, 104 may include attendee face, associated voice or chat text messages, as well as attendee computer screen content shared with other conference attendees, for example. To generate an ongoing conference stream. In one embodiment, each of the attendee computing systems 102, 103, 104 generates a key frame based on the content of the participant's ongoing conference stream. The ongoing conference stream and generated keyframes are transferred from each of the computing systems 102, 103, 104 to the server 101. In other embodiments, the key frame may be generated at the server 101 using the content of the received conference stream.

  In one or more embodiments, the generated key frame and chat message (collectively referenced 107) are transferred from the central server 101 to the wearable device 105 via the network. In one or more embodiments, the generated key frame and chat message are displayed to the user on the display of the wearable device 105. On the other hand, the received voice is transferred by the wearable device 105 to a headset 106 worn by the user using, for example, a Bluetooth (registered trademark) wireless protocol known to those skilled in the art. In one or more embodiments, the user can send a chat text message back to the server 101 using the creative graphical user interface of the wearable device 105.

  In the modification 110 shown in FIG. 1B, a portable device 111 is added. In an embodiment, portable device 111 communicates with both central server 101 and wearable device 105. Communication with the central server may be performed using a cellular or WIFI data connection, and the connection with the wearable device 105 may be performed using a Bluetooth or WiFi data connection. In one embodiment, the voice or generated key frame and chat message (referred to collectively at 107) are first transferred from the central server 101 to a portable device 111 such as a smartphone. Next, the portable device 111 uses a Bluetooth wireless protocol or a wired connection, for example, to transfer the conference audio 109 to the headset 106 worn by the user and to display the generated key frame or chat message to the user. Forward to 105. In one or more embodiments, the portable device 111 also controls connection to the appropriate conference by the user.

  In one or a plurality of embodiments, the key frame generated by the server 101 and the parameters used for starting generation of the key frame are changed based on the content type shared by the user for a specific period. In one embodiment, the key frame generation system continuously calculates and monitors the difference (distance) between the previous video key frame and the subsequent video key frame of the conference video stream shared by each user, The difference (distance) is compared with a predetermined threshold value. When the threshold is exceeded, the generation of a new key frame is automatically started. The threshold value may be different as long as the content type is different.

  For example, in one embodiment, when a user shares a standard Webcam view, a new keyframe generation, eg, to avoid the same unrelated frame displaying the user's face Requires a certain level of view (video stream) change. Thus, for video content cases relating to the user's face, the threshold may be relatively high. On the other hand, when meeting participants share a slide show, a new key frame is generated for any view change. Therefore, the key frame generation threshold value in the slide show content may be extremely low.

  In one or more embodiments, the generated key frames are divided into user specific (distributed conference participant specific) key frame streams. Such a key frame stream may be supplied to the wearable device 105, displayed using a graphical user interface generated on the display of the wearable device 105, and selected by a conference attendee. In one or more embodiments, an application executed on wearable device 105 detects a predetermined user gesture and switches between the key frame streams based on the detected predetermined user gesture. In one or more embodiments, the user gesture may be detected using, for example, a touch screen interface of the user wearable device 105.

  In one embodiment, the software application of wearable device 105 changes to a different user stream by means of a sensed swipe up and down user gesture that may be performed using the user's finger or other suitable means, and the display device The content of the user-selected stream (e.g., display a key frame. On the other hand, in a similar or different embodiment, the detected user gesture swipes the software application of the wearable device 105 to the key in the particular stream. Cycle through frames, zoom in and out of keyframes with detected double-tap user gestures, and finally free up zoomed-in frames with two-finger gestures As will be appreciated by those skilled in the art, many other types of user gestures may be detected by a software application running on the wearable device 105, and thus the present invention is not limited to a particular user gesture. It is not limited to.

  Further, in one or more embodiments, navigation between key frames and streams may be performed using a speech recognition interface described below. In this embodiment, the software application executed by the wearable device 105 is a specific utterance command issued by the user, such as “next stream”, “previous stream”, “next frame”, “previous frame”, etc. Is detected. Upon detection of a specific user utterance command, the software application executed on wearable device 105 executes the corresponding command. As will be appreciated by those skilled in the art, many other types of user utterance commands may be detected by a software application running on wearable device 105, and thus the present invention is limited to specific utterance commands. It is not a thing.

  In one or more embodiments, whenever the latest key frame is viewed in the conference stream, a new or more recent key frame from the central server 101 is received by the wearable device 105 and the wearable device 105 The executed software application automatically moves to a new key frame and displays the newly received key frame to the user. This feature generates an automatic flow of key frames that are updated by objects discussed in a distributed conference. Thereby, the user can maintain the awareness of the visual content in the conference. In one or more embodiments, the wearable device 105 executes a new key frame received from the server 101 when the user is interacting with the key frame by zooming or panning. Software applications do not immediately display the most recently received keyframe to the user to avoid interruption of current activity by the user associated with the old keyframe.

  In one or more embodiments, the software application executing on wearable device 105 also includes another chat channel. The chat channel allows the user of wearable device 105 to view chat (text) messages sent from other conference attendees, eg, a predetermined “yes / no” given by a graphical user interface. You can send your message to the conference chat using the answer. In another embodiment, a software application running on wearable device 105 includes a voice-to-text conversion function that automatically converts user voice into text messages that are sent to other distributed meeting attendees through the chat channel. Speech-to-text conversion software is known by those skilled in the art, and any software can be used without limiting the scope of the invention.

  FIG. 2 illustrates various examples of graphical user interface screens for software applications executing on a user wearable device. In one or more embodiments, the wearable device 105 user may access both the chat view and the stream view from the graphical user interface menu screen 201 of the application shown in FIG. In one or more embodiments, one or more of the next screens include a panel 210 at the bottom of the screen to allow quick switching between both views.

  FIG. 2 also shows an example of the stream view screen 202. The current or history key frame is displayed to the user using this screen. The user can scroll the next or previous key frame by using a gesture that swipes left and right on the screen of the wearable device 105. FIG. 2 also shows an example of the stream view screen 203 with the panel 210 opened. FIG. 2 also shows an example of the chat view screen 204. As shown in FIG. 2, the chat view screen 205 includes Y ',' N ',' Recording ', and' Stream 'buttons. The 'Y' and 'N' buttons allow for a quick “yes / no” response, and the “record” button allows speech to text conversion. Further, the “stream” button enables navigation of the stream view screen 203.

  FIG. 2 also shows that the user swipes another stream displaying the slide show, as shown on screen 206. FIG. 2 also shows an example of a graphical user interface screen 207 that displays slide key frames. FIG. 2 also shows an example of a graphical user interface screen 208 that displays zoom with slide key frames. Finally, FIG. 2 also shows an example of a graphical user interface screen 209 that displays a zoom of slide key frames panned to different positions. Screens 202 to 209 include the navigation panel 210 described above.

  FIG. 3 shows an example of an operation sequence of a software application executed on the wearable device 105 of the user. First, in step 301, a software application executed on the wearable device 105 connects to a known conference. In step 302, the software executed on wearable device 105 registers a key frame corresponding to each stream of the remote user. At step 303, the software application running on wearable device 105 displays the key frames and allows swiping between the remote user's streams as well as the individual key frames. In step 304, the software executed on wearable device 105 enables zooming and panning of key frames on the display of the wearable device. In step 305, the software application executed on wearable device 105 is synchronized with the chat content. At step 306, the software application running on wearable device 105 allows the user to engage in chat via speech to text or a “yes / no” button. The above steps 302 to 306 may be executed in any suitable sequence. In one embodiment, the wearable device can perform all of this functionality via a middleware application running on the mobile device 111, such as a smartphone, even though it cannot be directly connected to the network.

  In one or more embodiments, wearable device 105 may be configured to display a live conference stream to a user. The live conference stream may be displayed when the user turns his face to the display of the wearable device 105 so as not to drain the battery. For this purpose, the wearable device 105 may include a plurality of posture / direction sensors such as a gyroscope. In addition, the software application executed on the wearable device 105 may provide a writing function that enables writing or other memo input during a conference.

  FIG. 4 shows an embodiment of a computer wearable system in which this embodiment can be developed. In one or more embodiments, the computer wearable system 105 is a smart watch.

  The computer wearable system 105 processes the data bus 404, which is a communication mechanism for transmitting information between the hardware components of the computer wearable system 105 or transmitting information between the hardware components, or connecting them to each other. A central processing unit (CPU or simply processor) 401 may be included that is electrically connected to the data bus 404 to perform other computational and control tasks. Computer wearable system 105 includes memory 412, such as random access memory (RAM) or other dynamic storage device, connected to data bus 404 for storing various information and instructions executed by processor 401. . Memory 412 may include a persistent storage device such as a magnetic disk, optical disk, solid state flash memory device, or other non-volatile solid state storage device.

  In one or more embodiments, the memory 412 may be used to store temporary variables or other intermediate information while executing instructions by the processor 401. In addition, the computer wearable system 105 further includes a variety of static information and instructions for the processor 401 such as firmware necessary for the operation of the computer wearable system 105, a basic input-output system (BIOS), and various types of the computer wearable system 105. In order to store the various configuration parameters, a read only memory (ROM or EPROM) 402 or other static storage device connected to the data bus 404 may be included.

  In one or more embodiments, the computer wearable system 105 may include a display device (display) 409. The display device 409 may be electrically connected to the data bus 404 and displays various information such as the user interface and key frames shown in FIG. 2 to the user of the computer wearable system 105. In an alternative embodiment, display device 409 may be associated with a graphics controller and / or graphics processor (not shown). The display device 409 may be implemented as a well-known LCD (liquid crystal display), or may be manufactured using TFT (thin-film transistor) or organic LED (organic light emitting diode) technology. In various embodiments, the display device 409 may be incorporated into a general enclosure along with the remaining components of the computer wearable system 105.

  In one or more embodiments, the computer wearable system 105 is electrically connected to the data bus 404 and, as is well known, such as an MPEG-3 file that is a recorded meeting audio component. And an audio (audio) playback device 425 configured to play audio tracks of various video files, or various video files such as MPEG-4 files. Thereby, the computer wearable system 105 may include a waveform (not shown) or speech processor or similar device.

  In one or more embodiments, the computer wearable system 105 may include one or more input devices such as a touch screen interface 410 that accepts user tactile commands. The touch screen interface 410 may operate based on resistance, sound, electrostatics, or other physical principles or effects known to those skilled in the art. The touch screen interface 410 used together with the display device 409 can make the display device 409 have a touch screen function. Accordingly, the display device 409 operating with the touch screen interface 410 may be referred to herein as a simple 'touch screen' or touch display device.

  The computer wearable system 105 further includes a camera 411 that captures the user's video and still images, all of which may be connected to the data bus 404 to convey information. Information may include, but is not limited to, images, videos, user commands to the processor 401.

  In one or more embodiments, the computer wearable system 105 is further configured to provide data relating to the acceleration and current orientation of the computer wearable system 105 connected to the processor 401 via the data bus 404. An orientation sensor 403 may be included. Orientation information may be obtained using all three axes of acceleration measurements including gravity. In one or more embodiments, the orientation metadata provided by the orientation sensor 403 is continuously recorded and recorded in the data storage 421. Furthermore, a voice acquisition (audio capture) module 406 may be included to acquire a chat message or utterance command using the user voice.

  In one or more embodiments, the computer wearable system 105 may further include a communication interface such as a network interface 405 connected to the data bus 404. The network interface 405 establishes a connection between the computer wearable system 105 and the Internet 424 using at least one of a WiFi interface (adapter) 407 and a mobile phone network (GSM (registered trademark) or CDMA) adapter 408. It may be configured. The network interface 405 may be configured to allow bidirectional data communication between the computer wearable system 105 and the Internet 424. The WiFi adapter 407 operates in accordance with well-known 802.11a, 802.11b, 802.11g and / or 802.11n and Bluetooth protocols. In the exemplary embodiment, WiFi adapter 407, cellular network (GSM or CDMA) adapter 408 sends and receives electrical or electromagnetic signals to carry digital data streams representing various types of information.

  In one or more embodiments, the Internet 424 typically provides data communication to other network resources via one or more subnetworks. Accordingly, the computer wearable system 105 can access various network resources located anywhere on the Internet 424 such as remote media servers, web servers, other content servers, and other network data storage resources. In one or more embodiments, the computer wearable system 105 is configured to send and receive messages, media, and other data including application program code over various networks, including the Internet 424, via the network interface 405. Is done. In the Internet example, when the computer wearable system 105 operates as a network client, the computer wearable system 105 may request code or data for an application program running on the computer wearable system 105. Similarly, the computer wearable system 105 may send various data or computer codes to other network resources.

  In one or more embodiments, the functions described herein are responsive to the processor 401 executing one or more sequences of one or more instructions contained in the memory 412 and the computer wearable system 105. Implemented by Such instructions may be read into memory 412 from other computer-readable media. By executing the sequence of instructions contained in memory 412, processor 401 performs the various process steps described herein. In alternative embodiments, hardware circuitry may be used in place of or in combination with software instructions to implement embodiments of the present invention. Thus, embodiments of the invention are not limited to any specific combination of hardware circuitry and / or software.

  The term “computer-readable medium” as used herein refers to any medium used to provide instructions to processor 401 for execution. A computer-readable medium is an example of a machine-readable medium that may carry instructions for implementing any of the methods and / or techniques described herein. Such a medium may take many forms, including but not limited to, non-volatile media and volatile media.

  Common forms of non-transitory computer readable media include, for example, floppy disks, hard disks, magnetic tapes, or any other magnetic media, CD-ROM, any other optical media, punch cards, paper Tape, physical media with any other hole pattern, RAM, PROM, EPROM, flash EPROM, flash drive, memory card, any other memory chip or cartridge, or any other computer readable Media. Various forms of computer readable media may be used to carry one or more sequences of one or more instructions to executing processor 401. For example, the instructions may first be transferred from a remote computer to a magnetic disk. Alternatively, the remote computer can load the instructions into dynamic memory and send the instructions over the Internet 424. Specifically, the computer instructions may be downloaded from a remote computer to the memory of the computer wearable system 105 via the Internet 424 using various well-known network data communication protocols.

  In one or a plurality of embodiments, the memory 412 of the computer wearable system 105 may store any of the following software programs, applications, or modules.

  1. An operating system (OS) 413. An operating system (OS) 413 implements basic system services and manages various hardware components of the computer wearable system 105. Embodiments of operating system 413 are well known and may include any of the currently known or later developed mobile operating systems.

2. Application 414. The application 414 may include a software application set executed by the processor 401 of the computer wearable system 105, for example. When the software application set is executed by the processor 401, the computer wearable system 105 is caused to execute a predetermined function such as the function shown in FIG. In one or more embodiments, the application 414 may include a creative conferencing application 415, as described below.

  3. Data storage 421. The data storage 421 may store a key frame 422 or a chat message 423, for example.

  In one or more embodiments, the creative conferencing application 415 includes a user interface generation module 416 that is configured to generate a user interface depicted on the display 409 of the computer wearable system 105. Further, the creative conference application 415 includes a user gesture detection module 417 that detects a user gesture connected to the touch screen 410, an audio detection module 418 that detects a user's utterance word, and a detected voice. A voice text conversion module 419 for converting into a command, a chat module 420 for enabling the chat function, and a chat message may be included.

  Finally, the processes and techniques described herein are not inherently related to any particular apparatus, and may be implemented by any suitable combination of components. In addition, various types of general purpose devices may be used in accordance with the teachings described herein. It is also useful to construct a special purpose device that performs the method described herein. Although the invention has been described in connection with specific examples, the specific examples are intended to be illustrative rather than limiting. Many different combinations of hardware, software, and firmware are suitable for carrying out the present invention. For example, the described software includes various programming languages and script languages such as assembler, C / C ++, Objective-C, Perl, shell, PHP, Java (registered trademark), and programming languages that are currently known or will be developed in the future. Or it can be implemented in a script language.

  Moreover, other implementations of the invention will be apparent from a review of the details of the invention and the practice described herein. Various aspects and / or components of the embodiments described herein may be used alone or in any combination in a system and method for visualizing a playback plan that automatically plays back a hypervideo according to the playback plan. Can be done.

401 CPU
409 Display device 412 Memory 424 Internet 411 Camera

Claims (21)

A method performed on a wearable device worn by a user in connection with a meeting between multiple attendees,
The wearable device includes a central processing unit, a display device, and a memory,
A plurality of key frames extracted from each of a plurality of live conference streams are transferred to the wearable device,
Said central processing unit,
One of the plurality of key frames from one of the previous SL multiple live conference stream displayed to the user on the display device,
Detecting input from the user,
If the detected input from the user is of the first type, display one of the plurality of key frames from one of the plurality of live conference streams;
When the detected input from the user is of the second type, one of the plurality of key frames is displayed from the other one of the plurality of live conference streams.
Method. The first type of user input includes a first direction user gesture;
The method of claim 1. The first direction is a left-right direction.
The method of claim 2. The second type of user input includes a second direction user gesture,
The method according to any one of claims 1 to 3. The second direction is a vertical direction.
The method of claim 4. Enlarging the displayed keyframe when the detected input from the user is of a third type;
Further including
The method according to any one of claims 1 to 5. The third type of user input includes a double tap gesture,
The method of claim 6. When the detected input from the user is a fourth type, one of the plurality of live conference streams is displayed to the user.
Further including
The method according to any one of claims 1 to 7. The fourth type of user input includes directing the display of the wearable device to the face of the user;
The method of claim 8. Stopping displaying one of the plurality of live conference streams to the user when the user turns away from the display of the wearable device;
Further including
The method of claim 8. Each of the plurality of key frames is generated based on a difference between two key frames in a corresponding live conference stream.
The method according to any one of claims 1 to 10. Each of the plurality of key frames is generated when a difference between two key frames in the corresponding live conference stream exceeds a predetermined threshold.
The method of claim 11. The predetermined threshold is determined based on a type of content in the corresponding live conference stream.
The method of claim 12. Using the display device to display a chat message to the user;
Further including
The method according to any one of claims 1 to 13. Receiving chat input from the user and transferring the chat input to the plurality of meeting attendees;
Further including
15. A method according to any one of claims 1 to 14. Receiving the chat input from a user using a graphical user interface generated on the display device;
The method of claim 15. The graphical user interface includes at least one user selectable widget, and a corresponding chat input is generated on the widget selected by the user.
The method of claim 16. Accepting the chat input from a user by converting the user's voice into a text chat message;
The method of claim 15. The detected input from the user is to detect a word spoken by the user and convert the detected spoken word to a user input corresponding to the first type or the second type;
Further including
The method according to any one of claims 1 to 18. A wearable system worn by the user,
A plurality of key frames extracted from each of a plurality of live conference streams are transferred to the wearable system,
A central processing unit;
A display device;
A memory for storing a computer-executable instruction set ;
Means for displaying to the user one at the display device among the plurality of key frames from one of the previous SL multiple live conference stream,
Means for detecting input from the user;
When the detected input from the user is the first type, another one of the plurality of key frames is displayed from one of the plurality of live conference streams, and the input from the detected user Control means for displaying one of the plurality of key frames from the other one of the plurality of live conference streams,
including,
A wearable system that runs in association with a meeting between multiple attendees. A program for causing a computer to execute a process related to a meeting between a plurality of attendees and executed by a wearable device worn by a user,
A plurality of key frames extracted from each of a plurality of live conference streams are transferred to the wearable device,
The processing is as follows:
One then displayed to the user at the display device among the plurality of key frames from one of the previous SL multiple live conference stream,
Detecting input from the user,
If the detected input from the user is of the first type, display one of the plurality of key frames from one of the plurality of live conference streams;
Displaying one of the plurality of keyframes from another one of the plurality of live conference streams when the detected input from the user is of a second type;
Including the program.

Images