WO2024171898A1 - 情報処理装置、情報処理方法及びコンピュータ読み取り可能な非一時的記憶媒体 - Google Patents

情報処理装置、情報処理方法及びコンピュータ読み取り可能な非一時的記憶媒体 Download PDF

Info

Publication number
WO2024171898A1
WO2024171898A1 PCT/JP2024/003919 JP2024003919W WO2024171898A1 WO 2024171898 A1 WO2024171898 A1 WO 2024171898A1 JP 2024003919 W JP2024003919 W JP 2024003919W WO 2024171898 A1 WO2024171898 A1 WO 2024171898A1
Authority
WO
WIPO (PCT)
Prior art keywords
information processing
processing device
lounge
terminal device
group
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2024/003919
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
和子 山田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Priority to JP2025501081A priority Critical patent/JPWO2024171898A1/ja
Publication of WO2024171898A1 publication Critical patent/WO2024171898A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems

Definitions

  • the present disclosure relates to an information processing device, an information processing method, and a computer-readable non-transitory storage medium.
  • a display device, camera, microphone, and speaker are provided at each location, and video footage and collected audio data at one location are output in real time from a speaker installed at the other location.
  • the above-mentioned technology has room for improvement in terms of realizing more comfortable communication even when a large number of information processing devices are connected to the system.
  • This disclosure provides a mechanism that allows multiple information processing devices to be connected while enabling more comfortable communication.
  • the information processing device disclosed herein includes a control unit.
  • a control unit When a first terminal device belonging to at least one of a plurality of groups selects one of the groups to which the first terminal device belongs as a destination group, the control unit notifies the first terminal device of information about a second terminal device connecting to the destination group.
  • the control unit permits the first terminal device to view data whose disclosure scope is the destination group.
  • FIG. 2 is a diagram for explaining an example of two-way telecommunication according to an embodiment of the present disclosure.
  • 1 is a diagram illustrating a schematic configuration of an information processing system according to an embodiment of the present disclosure.
  • FIG. 1 is a diagram for explaining an example of two-way telecommunication by an information processing device.
  • 11 is a diagram showing an example of a connection destination selection screen displayed on the information processing device when a user selects a communication partner;
  • FIG. FIG. 1 is a diagram for explaining an example of multiple lounges according to an embodiment of the present disclosure.
  • FIG. 13 is a diagram for explaining another example of multiple lounges according to an embodiment of the present disclosure.
  • FIG. 13 is a diagram showing an example of the types of lounges set in accordance with an embodiment of the present disclosure.
  • FIG. 2 is a block diagram illustrating a configuration example of a server device according to an embodiment of the present disclosure.
  • FIG. 11 is a diagram for explaining an example of connection destination information according to an embodiment of the present disclosure.
  • FIG. 1 illustrates an example of a lounge folder according to an embodiment of the present disclosure.
  • FIG. 13 is a diagram illustrating an example of authority for content according to an embodiment of the present disclosure.
  • FIG. 2 is a diagram for explaining an example of access to content according to an embodiment of the present disclosure.
  • FIG. 13 is a diagram illustrating an example of shared data according to an embodiment of the present disclosure.
  • FIG. 13 is a diagram for explaining an example of a lounge usage status according to an embodiment of the present disclosure.
  • FIG. 11 is a diagram for explaining an example of connection destination information according to an embodiment of the present disclosure.
  • FIG. 1 illustrates an example of a lounge folder according to an embodiment of the present disclosure.
  • FIG. 13 is a diagram illustrating an example of authority for content according to an embodiment of the
  • FIG. 2 is a diagram for explaining an example of a usage status of an information processing device according to an embodiment of the present disclosure.
  • FIG. 2 is a block diagram illustrating a configuration example of a management device according to an embodiment of the present disclosure.
  • 1 is a block diagram illustrating a configuration example of an information processing device according to an embodiment of the present disclosure.
  • FIG. 11 is a sequence diagram illustrating an example of a flow of a two-way communication process according to an embodiment of the present disclosure.
  • FIG. 11 is a diagram illustrating an example of bidirectional communication between multiple locations according to another embodiment of the present disclosure.
  • FIG. 11 is a sequence diagram illustrating an example of a flow of a multipoint connection process according to another embodiment of the present disclosure.
  • FIG. 13 is a diagram for explaining an example of a method for selecting a connection destination in the Suite mode according to another embodiment of the present disclosure.
  • FIG. 13 is a diagram for explaining an example of a method for selecting a connection destination in the convinced mode according to another embodiment of the present disclosure.
  • FIG. 11 is a diagram for explaining an example of a flow of a two-way communication process according to another embodiment of the present disclosure.
  • FIG. 2 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of an information processing device according to the present disclosure.
  • similar components of the embodiments may be distinguished by adding at least one different alphabet and number after the same reference numeral. However, if there is no particular need to distinguish between each of the similar components, only the same reference numeral will be used. For example, multiple components having substantially the same functional configuration will be distinguished as necessary, such as information processing device 10A1, information processing device 10A2, information processing device 10B1, and information processing device 10B2.
  • information processing device 10A1 and information processing device 10A2 when there is no need to distinguish between information processing device 10A1 and information processing device 10A2, they will be simply referred to as information processing device 10A. Also, when there is no need to distinguish between information processing device 10A1, information processing device 10A2, information processing device 10B1, and information processing device 10B2, they will be simply referred to as information processing device 10.
  • One or more of the embodiments (including examples, variations, and application examples) described below can be implemented independently. However, at least a portion of the embodiments described below may be implemented in appropriate combination with at least a portion of another embodiment. These embodiments may include novel features that are different from one another. Thus, these embodiments may contribute to solving different purposes or problems and may provide different effects.
  • FIG. 1 is a diagram for explaining an example of two-way telecommunication according to an embodiment of the present disclosure.
  • telepresence is performed using two information processing devices 10A1 and 10A2.
  • the information processing devices 10A1 and 10A2 are located in different spaces (locations).
  • the information processing device 10A1 is located at location A1
  • the information processing device 10A2 is located at location A2.
  • the information processing devices 10A1 and 10A2 are connected to each other via a network (not shown).
  • the information processing device 10 has a first display unit (table display 12a) and a second display unit (window display 12b).
  • the table display 12a is provided, for example, on the top plate of a table.
  • the table display 12a is, for example, a display device equipped with a touch panel.
  • the table display 12a presents display information to a user who uses the information processing device 10 and accepts operations by the user.
  • the display information displayed on the table display 12a includes, for example, various UIs (User Interfaces) such as still images, videos, menu screens, and control screens.
  • the window display 12b is disposed approximately vertically at one end of the table display 12a.
  • the window display 12b displays an image of the communication partner.
  • information processing devices 10A1 and 10A2 are located at bases A1 and A2, respectively.
  • user UA1 uses information processing device 10A1 at location A1.
  • User UA2 uses information processing device 10A2 at location A2.
  • users UA1 and UA2 perform two-way telecommunication at each location.
  • an image of user UA2 is displayed on window display 12b1 of information processing device 10A1.
  • An image of user UA1 is displayed on window display 12b2 of information processing device 10A2.
  • the table display 12a1 of the information processing device 10A1 and the table display 12a2 of the information processing device 10A2 each display, for example, the same information (document data in the example of FIG. 1).
  • the table display 12a has a touch panel and accepts operations from the user U0
  • the method of input from the user U0 is not limited to this.
  • a touch panel may be mounted on the window display 12b.
  • the information processing device 10 accepts operations from the user U0 using the touch panel mounted on the window display 12b.
  • the input method by user U0 is not limited to the above-mentioned method using a touch panel.
  • the information processing device 10 can accept operations from user U0 using various methods, such as voice, gestures, a keyboard, and a mouse.
  • the information processing device 10 has two display devices (a table display 12a and a window display 12b), but the number of display devices that the information processing device 10 has is not limited to two.
  • the information processing device 10 may have a window display 12b but not a table display 12a. In this way, the information processing device 10 may have one display device. Also, the information processing device 10 may have three or more display devices.
  • the table display 12a is described here as being provided on the top of the table, the location where the table display 12a is provided is not limited to the top of the table.
  • the table display 12a may be a tablet terminal placed on a desk.
  • the display that realizes the visual effect according to this embodiment is not limited to a display.
  • this display may be performed by a projector.
  • the visual effect according to this embodiment can be realized by appropriately projecting an image (e.g., an image of the communication partner) onto the top surface of a table or a wall using a projector.
  • the information processing system 1 provides, for example, a telepresence service.
  • the telepresence service is, for example, a service that connects distant spaces (locations) with video, audio, and other information channels, making it feel as if the locations are connected.
  • the telepresence service provided by the information processing system 1 connects physically separated locations (bases) together, allowing a user U0 to communicate with other users U0 from anywhere, anytime, regardless of distance.
  • the information processing device 10 realizes hands-free calling while displaying a life-size image of the communication partner on, for example, a large vertical screen (see FIG. 1). This allows the information processing system 1 to provide a communication service that allows the user to feel the space and presence of the communication partner as if the communication partner were actually there (in the same space).
  • a user U0 can have the experience of, for example, when a parent and child live apart, as if their living spaces were connected through windows and doors.
  • user U0 can explain products to customers who visit a store other than the one where user U0 is located (e.g., located far away) in the same way as if the customer were in the same store.
  • users U0 who are in different locations can hold a conference as if they were in the same room.
  • the information processing system 1 provides a telepresence service to the user U0.
  • FIG. 2 is a diagram showing a schematic configuration of an information processing system 1 according to an embodiment of the present disclosure.
  • the information processing system 1 shown in FIG. 2 includes a plurality of information processing devices 10A1, 10A2, ..., a server device 30, and a management device 40.
  • the information processing device 10, the server device 30, and the management device 40 are connected to each other via a network 20.
  • the network 20 is, for example, a LAN (Local Area Network) or the Internet.
  • the information processing devices 10 are arranged in different spaces (locations) and are used by a user U0 to perform two-way telecommunication.
  • FIG. 3 is a diagram for explaining an example of two-way telecommunication by an information processing device 10.
  • the information processing system 1 includes multiple information processing devices 10.
  • an information processing device 10 (not shown) is disposed at each of the locations A1 to A10.
  • an information processing device 10 disposed at a location An (n is a natural number) will be referred to as information processing device 10An (n is a natural number).
  • the multiple information processing devices 10 included in the information processing system 1 select a communication partner and perform two-way telecommunication (hereinafter, also simply referred to as communication or two-way communication). For example, in FIG. 3, the information processing device 10A1 at site A1 and the information processing device 10A2 at site A2 are connected and communicate with each other.
  • the information processing device 10 is assumed to be constantly connected to the communication partner. For example, once a communication partner is set, the information processing device 10 will automatically connect to the same communication partner from the previous time onwards and start two-way communication.
  • the information processing device 10 automatically starts up at the start time, connects to the same communication partner as the previous time, and automatically shuts down at the end time.
  • the opening time of the store can be set as the start time
  • the closing time can be set as the end time.
  • the information processing device 10 starts up at the opening time, connects to information processing devices 10 installed in other stores where staff are present, and shuts down at the closing time.
  • the communication partner of the information processing device 10 does not necessarily have to be the same partner each time.
  • the information processing device 10 may connect to and communicate with a communication partner different from the previous communication partner.
  • information processing device 10A4 at site A4 was previously connected to information processing device 10A7 at site A7 and performed two-way communication. Now (presently), information processing device 10A4 is connected to information processing device 10A9 at site A9 and performs two-way communication.
  • multiple information processing devices 10 that can be connected as communication partners belong to one group. That is, an information processing device 10 that belongs to one group selects an information processing device 10 to connect to from other information processing devices 10 that belong to the same group, and performs two-way communication.
  • the group to which the multiple information processing devices 10 belong is also called a "lounge.” That is, the information processing system 1 according to this embodiment virtually groups multiple information processing devices 10 by lounge.
  • the server device 30 notifies other information processing devices of information about the information processing devices 10 that are in a state where they can perform two-way communication. Furthermore, when the information processing devices 10 are connected to each other, the server device 30 can perform a synchronization process for the two-way communication. Furthermore, the server device 30 stores and manages data shared between the information processing devices 10.
  • the server device 30 executes processing to enable the information processing device 10 to perform smooth two-way communication.
  • the management device 40 manages the information processing devices 10 belonging to the lounge. For example, the management device 40 adds and deletes the information processing devices 10 belonging to the lounge. Lounge information and affiliation information on the information processing devices 10 belonging to the lounge are held by, for example, the server device 30. The management device 40 manages the information processing devices 10 belonging to the lounge by, for example, making a request to the server device 30 to register the information processing devices 10 in the lounge and a request to delete the information processing devices 10 from the lounge.
  • the information processing system 1 includes a management device 40 that is a device separate from the server device 30 and the information processing device 10.
  • the server device 30 and the information processing device 10 may each include the functions of the management device 40.
  • a user U0 with administrator privileges may access the information processing system 1 using the server device 30 or the information processing device 10, so that the server device 30 or the information processing device 10 functions as the management device 40.
  • various information devices such as a PC (Personal Computer) or a tablet terminal may function as the management device 40.
  • FIG. 4 is a diagram showing an example of a connection destination selection screen displayed on the information processing device 10 when the user U0 selects a communication partner.
  • FIG. 4 shows an example of a screen for selecting a communication partner (connection destination) when performing two-way communication between two locations.
  • the connection destination selection screen displays a list of locations (bases) that are candidate connection destinations.
  • bases locations that are candidate connection destinations.
  • the check box next to location A4 is checked. This indicates that user U0 has selected information processing device 10A4 located at location A4 as the communication partner. When user U0 presses the confirm button, information processing device 10A4 is determined as the communication partner.
  • the number of locations displayed at one time on the connection destination selection screen is limited depending on the size of the screen, etc. In the example of FIG. 4, the number of locations displayed at one time is seven. If the number of locations that user U0 can select, in other words, the number of information processing devices 10 belonging to the lounge, is seven or more, user U0 can scroll the screen to check locations that are not displayed.
  • any information processing device 10 that belongs to the lounge can perform two-way communication with any other information processing device 10.
  • anyone could belong to the lounge there is a risk that they may be connected to a communication partner with which they do not want to perform two-way communication.
  • the information processing system 1 provides at least one lounge and limits communication partners to information processing devices 10 that belong to the same lounge.
  • FIG. 5 is a diagram for explaining an example of multiple lounges according to an embodiment of the present disclosure.
  • the information processing system 1 has two lounges, lounge A0 and lounge B0.
  • Four information processing devices 10A1 to 10A4 belong to lounge A0.
  • Two information processing devices 10B1 and B2 belong to lounge B0.
  • the number of information processing devices 10 belonging to each lounge is not limited to the example in FIG. 5. If two or more information processing devices 10 belong to each lounge, the information processing devices 10 can perform two-way communication according to this embodiment. Therefore, the number of information processing devices 10 belonging to a lounge may be three, or may be five or more.
  • the communication partners of the information processing device 10 are limited to information processing devices 10 belonging to the same lounge.
  • information processing device 10A1 and information processing device 10A2 belonging to lounge A0 can perform two-way communication.
  • information processing device 10B1 and information processing device 10B2 belonging to lounge B0 can perform two-way communication.
  • Information processing devices 10 belonging to different lounges cannot perform two-way communication.
  • Information processing device 10A4 belonging to lounge A0 can perform two-way communication with information processing device 10A3 belonging to lounge A0, but cannot perform two-way communication with information processing device 10B1 belonging to lounge B0.
  • the information processing device 10A belonging to lounge A0 can see the other information processing devices 10A belonging to lounge A0, but cannot see the information processing device 10B belonging to lounge B0.
  • the list of connection destinations presented to the information processing device 10A belonging to lounge A0 includes location A0 where the information processing device 10A is installed, but does not include location B0 where the information processing device 10B is installed.
  • information processing device 10B belonging to lounge B0 can see other information processing devices 10B belonging to lounge B0, but cannot see information processing device 10A belonging to lounge A0.
  • the list of connection destinations presented to information processing device 10B belonging to lounge B0 includes location B0 where information processing device 10B is installed, but does not include location A0 where information processing device 10A is installed.
  • the information processing system 1 can further reduce an increase in the number of information processing devices 10 belonging to one lounge.
  • the information processing system 1 limits the information of communication partners presented to the information processing device 10 to information processing devices 10 that belong to the same lounge. This makes it easier for the information processing device 10 to find communication partners even if the number of information processing devices 10 included in the information processing system 1 increases.
  • connection destinations presented can be sorted and displayed, for example, in alphabetical order, alphabetical order, or by most or least frequent connection.
  • one information processing device 10 can belong to multiple lounges.
  • FIG. 6 is a diagram illustrating another example of multiple lounges according to an embodiment of the present disclosure.
  • the information processing system 1 has three lounges A0 to C0.
  • Lounge A0 is home to five information processing devices 10A1 to 10A5.
  • Lounge B0 is home to five information processing devices 10A3, 10A4, and 10B1 to 10B3.
  • Lounge C0 is home to five information processing devices 10A4, 10A5, and 10C1 to 10C3.
  • Information processing device 10A3 belongs to lounges A0 and B0.
  • Information processing device 10A4 belongs to lounges A0 to C0.
  • Information processing device 10A5 belongs to lounges B0 and C0. In this way, information processing device 10 belongs to at least one lounge.
  • the information processing device 10 can belong to multiple lounges, but the party with which it actually performs two-way communication is limited to an information processing device 10 that belongs to one of the multiple lounges. In other words, the information processing device 10 according to this embodiment selects one lounge from the multiple lounges to which it belongs and performs two-way communication.
  • a lounge that the information processing device 10 can select is referred to as the lounge to which this information processing device 10 belongs.
  • the information processing device 10 selecting a lounge from among the lounges to which it belongs in order to determine the communication partner with which it will perform two-way communication is also described as "connecting to a lounge.”
  • an information processing device 10 that belongs to multiple lounges connects to one of the lounges to which it belongs, and performs two-way communication with other information processing devices 10 that connect to the same lounge.
  • the information processing device 10 can only connect to one lounge.
  • information processing device 10A3 was previously connected to lounge B0 and engaged in two-way communication with information processing device 10B2, and is currently connected to lounge B0 and engaged in two-way communication with information processing device 10B1.
  • information processing device 10A4 was previously connected to lounge C0 and engaged in two-way communication with information processing device 10C1, and is currently connected to lounge B0 and engaged in two-way communication with information processing device 10B3.
  • information processing device 10C1 was previously connected to lounge C0 and engaged in two-way communication with information processing device 10A4, and is currently connected to lounge C0 and engaged in two-way communication with information processing device 10C2.
  • information processing device 10A5 was previously connected to lounge C0 and engaged in two-way communication with information processing device 10C2, and is currently connected to lounge C0 and engaged in two-way communication with information processing device 10C3.
  • the information processing device 10 belongs to multiple lounges, but connects to one lounge and performs two-way communication with the other information processing devices 10. This allows the user U0 who uses the information processing device 10 to communicate more comfortably, even if the information processing system 1 includes a large number of information processing devices 10.
  • information processing device 10 when information processing device 10 can belong to multiple lounges, handling of shared data becomes an issue.
  • information processing device 10A3, which belongs to lounges A0 and B0 can access the shared data of lounges A0 and B0, respectively.
  • information processing device 10A3 can perform two-way communication with information processing device 10B3, which belongs only to lounge B0. At this time, it is required to prevent information processing device 10B3 from viewing the shared data of lounge A0.
  • the server device 30 manages the shared data for each lounge.
  • the server device 30 notifies the information processing device 10 (an example of a first terminal device) of information regarding other information processing devices 10 (an example of a second terminal device) that are connected to a lounge (hereinafter also referred to as a destination lounge) that the information processing device 10 (an example of a first terminal device) has selected as a destination.
  • the information processing device 10 belongs to at least one of a plurality of groups. This allows the information processing device 10 to check which information processing devices 10 are already connected to the destination lounge, and to appropriately select a communication partner.
  • the server device 30 permits the information processing device 10 to view data whose disclosure scope is the connected lounge. This allows the information processing device 10 to view data whose disclosure scope is limited to the connected lounge.
  • the information processing system 1 can appropriately manage shared data for each lounge, enabling more secure two-way communication. As a result, even if the number of information processing devices 10 increases, the information processing system 1 can achieve more comfortable and secure communication.
  • a plurality of lounges are set.
  • the plurality of lounges according to this embodiment are classified into a plurality of types according to the degree of disclosure. That is, the degree of disclosure of each lounge is set according to the range of disclosure.
  • the plurality of lounges are set to any one of "public", “protected”, and “private” according to the range of disclosure.
  • All information processing devices 10 included in the information processing system 1 can connect to a lounge that is set to "public.” In other words, all information processing devices 10 included in the information processing system 1 can belong to a "public” lounge. In this way, no connection range is set for a "public" lounge.
  • the server device 30 allows the connection of the information processing device 10 that has made the connection request to this "public" lounge.
  • a lounge set to "protected” can be connected to information processing devices 10 belonging to the same organization (an example of a second group), such as a company or organization.
  • information processing devices 10 belonging to the same organization can belong to a "protected” lounge.
  • An organization can include at least one "protected” lounge.
  • the server device 30 allows this information processing device 10 to connect to the "protected” lounge.
  • a lounge that is set to "private” can be connected to an information processing device 10 that belongs to that lounge.
  • a pre-set information processing device 10 can connect to a "private” lounge.
  • the connection range of a "private” lounge is limited to the information processing device 10 to which it already belongs.
  • the server device 30 allows this information processing device 10 to connect to the "private” lounge.
  • FIG. 7 is a diagram showing an example of the types of lounges set in an embodiment of the present disclosure.
  • four organizations namely, companies g1 and g2, and organizations g3 and g4, receive telepresence services provided by the information processing system 1.
  • a lounge administrator is assigned to each organization to manage the lounges.
  • the lounge administrator manages the lounges created within the organization, for example, via management device 40.
  • one lounge administrator is assigned to each organization, i.e., the lounge administrator manages multiple lounges, but a lounge administrator may be assigned to each lounge. In this case, multiple lounge administrators are assigned within an organization.
  • lounges G11 and G12 are created by lounge administrator Ad1.
  • Lounge G11 is a "public” lounge.
  • Lounge G12 is a "protected” lounge.
  • Information processing devices 10G11 and 10G12 belonging to company g1 belong to lounges G11 and G12.
  • Information processing device 10G11 is connected to lounge G11.
  • Information processing device 10G12 is connected to lounge G12.
  • Lounge G11 is a "public" lounge. Therefore, although not shown in the figure, all information processing devices 10 included in information processing system 1 can belong to lounge G11.
  • Lounge G21 is created by lounge administrator Ad2 at company g2.
  • Lounge G21 is a "private" lounge.
  • Information processing devices 10G21 and 10G22 belonging to company g2 belong to lounge G21.
  • information processing devices 10G21 and 10G22 are connected to lounge G21.
  • Lounges G31 and G32 are created by lounge administrator Ad3 for group g3.
  • Lounge G31 is a "protected” lounge.
  • Lounge G32 is a "private” lounge.
  • Information processing devices 10G31 to 10G34 belonging to group g3 belong to lounge G31. Furthermore, information processing devices 10G31 and 10G32 are connected to lounge G31. Information processing devices 10G33 and 10G34 belong to lounge G32. Furthermore, information processing devices 10G33 and 10G34 are connected to lounge G32.
  • Lounge G41 is created by lounge administrator Ad4 for group g4.
  • Lounge G41 is a "private" lounge.
  • Information processing devices 10G41 and 10G42 which belong to group g4, belong to lounge G41.
  • information processing devices 10G41 and 10G42 are connected to lounge G41.
  • At least one lounge is created for each organization, and two-way communication is carried out by the information processing device 10 connected there.
  • the information processing devices 10 belonging to the lounge are managed by a lounge administrator Ad.
  • the lounge administrator Ad adds or removes the information processing device 10 from the lounge in response to a request from the information processing device 10.
  • information processing devices 10 belonging to a lounge may be added by, for example, the information processing device 10 other than the lounge administrator Ad.
  • the information processing device 10 adds information processing devices 10 belonging to other organizations to the lounge by inviting the information processing devices 10 belonging to other organizations.
  • the connection range (belonging range) of a "protected" lounge is limited to information processing devices 10 belonging to the organization.
  • the connection range of a "private" lounge is limited to information processing devices 10 belonging to this lounge. In this way, assume that another information processing device 10 not belonging to this lounge makes a connection request to a lounge with a limited connection range.
  • the server device 30 allows the other information processing device 10 to connect to the "private" lounge on the condition that it has received an invitation from an information processing device 10 belonging to this lounge.
  • information processing device 10G12 belonging to company g1 invites information processing device 10G21 belonging to company g2. This allows information processing device 10G21 to belong to a "protected" lounge G12 outside the organization (company g2) to which it belongs.
  • information processing device 10G22 belonging to company g2 invites information processing device 10G31 belonging to organization g3. This allows information processing device 10G31 to belong to a "private" lounge G22 outside the organization (organization g3) to which it belongs.
  • the lounge administrator Ad can freely create a lounge, and add and remove information processing devices 10 from the lounge. This allows the user U0 to enjoy the telepresence service more comfortably.
  • the information processing device 10 can belong to a lounge outside the organization to which it belongs, either by the lounge administrator Ad or by invitation from the information processing device 10. This allows the user U0 to enjoy the telepresence service more freely.
  • the information processing system 1 allows more flexibility in the interaction of user U0 using the lounge.
  • company g0 can create an event lounge for a limited period of time for events such as workshops and lectures, and allow event participants to temporarily belong to the event lounge, allowing more users U0 to interact within the lounge.
  • an information processing device 10 installed in a store of sales company g6 that sells product P1 connects to the lounge of manufacturing company g7 that manufactures product P1. This allows customers who visit the store to receive an explanation about product P1 directly from an employee of manufacturing company g7 via the information processing device 10. Also, by connecting the information processing device 10 to the lounge of manufacturing company g8 that manufactures product P2, customers can receive an explanation about product P2 directly from an employee of manufacturing company g8.
  • sales company g6 and manufacturing companies g7 and g8 are each separate organizations (companies).
  • information processing devices 10 belonging to different organizations can connect to the same lounge and perform two-way communication.
  • an information processing device 10 of sales company g6 can connect to the lounges of both manufacturing companies g7 and g8. In this case, it is required that data shared by the information processing device 10 of sales company g6 with manufacturing company g7 cannot be viewed by the information processing device 10 of manufacturing company g8.
  • the server device 30 allows the information processing device 10 to view data whose disclosure scope is the connected lounge.
  • the information processing device 10 of sales company g6 can view data shared in the lounge of manufacturing company g7 while connected to the lounge of manufacturing company g7.
  • the information processing device 10 of sales company g6 cannot view data shared in the lounge of manufacturing company g7.
  • the lounge administrator Ad and the information processing device 10 that sends the invitation may limit the period during which the information processing device 10 belonging to another organization may belong to the lounge of their own organization.
  • the information processing device 10 may set the period during which the information processing device 10 may belong, such as one hour, one day, or from ZY o'clock to ZZ o'clock on XX month YY day, and invite the information processing device 10 belonging to another organization to the lounge of their own organization.
  • one or two lounges are created for each organization, but the number of lounges created for each organization is not limited to this.
  • One or more lounges may be created for one organization.
  • Three or more lounges may also be created for one organization.
  • Table 1 shows the types of lounges according to this embodiment. As mentioned above, lounges are classified into three types: “public,” “protected,” and “private.”
  • Public lounges are created, modified, or deleted by the lounge administrator Ad.
  • Information (including shared data) about "public” lounges is obtained by all information processing devices 10. All information processing devices 10 can invite other information processing devices 10 to a "public" lounge.
  • a "protected” lounge is created, modified, or deleted by a lounge administrator Ad.
  • Information (including shared data) about a "protected” lounge is obtained by information processing devices 10 that belong to the same organization.
  • Information processing devices 10 that belong to the same organization can invite other information processing devices 10 to a "protected” lounge. Note that the same organization here is the organization in which the "protected" lounge is created.
  • “Private” lounges are created, modified, or deleted by a lounge administrator Ad.
  • Information about the "private" lounge is obtained by an information processing device 10 that belongs to the "private” lounge.
  • An information processing device 10 that belongs to a “private” lounge can invite other information processing devices 10 to the "private” lounge.
  • the addition, modification, or deletion of information processing devices 10 belonging to the "public" lounge is performed by the lounge administrator Ad. All information processing devices 10 belong to the "public” lounge. All information processing devices 10 can freely leave the "public” lounge.
  • the addition, modification, or deletion of information processing devices 10 belonging to the "private" lounge is performed by the lounge administrator Ad.
  • the information processing devices 10 added by the lounge administrator Ad belong to the "private” lounge.
  • the information processing devices 10 added by the lounge administrator Ad can freely leave the "private" lounge.
  • the number of types of lounges is not limited to three. There may be two or less types of lounges, or four or more types of lounges. For example, there may be two types of lounges, "protected” and "private.” Alternatively, a type other than the three types described above may be set for the lounge, such as a "limited” type in which no information processing device 10 can be added by anyone other than the lounge administrator Ad (in other words, the information processing device 10 cannot make an invitation).
  • Example of the configuration of the server device> 8 is a block diagram showing an example configuration of the server device 30 according to an embodiment of the present disclosure.
  • the server device 30 shown in FIG. 8 includes a communication unit 310, a storage unit 320, and a control unit 330.
  • the communication unit 310 is realized by, for example, a network interface card (NIC), a network interface controller, etc.
  • the communication unit 310 is connected to the network 20 (see FIG. 2 ) by wire or wirelessly, and transmits and receives information to and from the information processing device 10, the management device 40, etc. via the network 20.
  • NIC network interface card
  • the communication unit 310 is connected to the network 20 (see FIG. 2 ) by wire or wirelessly, and transmits and receives information to and from the information processing device 10, the management device 40, etc. via the network 20.
  • the storage unit 320 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk.
  • a semiconductor memory element such as a random access memory (RAM) or a flash memory
  • a storage device such as a hard disk or an optical disk.
  • the storage unit 320 stores various information related to the telepresence according to the embodiment.
  • the storage unit 320 stores information related to the lounge, information related to the information processing device 10, shared data, etc.
  • the control unit 330 is realized by, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), or the like executing a program stored inside the server device 30 using a RAM or the like as a working area.
  • the control unit 330 is a controller, and may be realized by, for example, an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • control unit 330 has a data transmission unit 331, a data reception unit 332, a device registration unit 333, a matching unit 334, a material management unit 335, and a situation presentation unit 336, and realizes or executes the information processing functions and actions described below.
  • the internal configuration of the control unit 330 is not limited to the configuration shown in FIG. 8, and may be other configurations as long as they perform the information processing described below.
  • the data transmission unit 331 transmits data to the information processing device 10, the management device 40, and the like via the communication unit 310.
  • the data transmission unit 331 transmits processing results of each unit of the control unit 330, and the like to the information processing device 10, the management device 40, and the like.
  • the data receiving unit 332 receives data from the information processing device 10, the management device 40, and the like via the communication unit 310.
  • the data receiving unit 332 outputs the received data to each unit of the control unit 330.
  • the device registration unit 333 accepts creation (registration) of a lounge and registration of the information processing device 10 belonging to the lounge in accordance with requests from the management device 40 and the information processing device 10.
  • the device registration unit 333 stores the accepted information on the lounge and information on the information processing device 10 in the storage unit 320.
  • device registration unit 333 receives a request to create a lounge from management device 40, it creates the lounge by storing lounge information about the lounge included in the creation request in storage unit 320.
  • the lounge information is included in the creation request, for example.
  • Device registration unit 333 can store identification information for identifying the lounge and the lounge information in storage unit 320 in association with each other.
  • the lounge information includes, for example, at least one of the following pieces of information: Lounge name; Information about the type of lounge (for example, public, protected, or private); Information about the organization that creates the lounge; Registration period of the lounge; and The upper limit of the number of information processing devices 10 that can belong to the lounge.
  • the registration period of a lounge is the period from when the lounge is created to when it is deleted. For example, when a lounge is to be created for an event, and it is desired to create the lounge for a limited period of time, the management device 40 can set the registration period of the lounge to match the duration of the event. In this case, the device registration unit 333 creates the lounge at the start date and time of the specified registration period, and deletes the lounge at the end date and time.
  • the maximum number of information processing devices 10 that can belong is information that specifies the maximum number of information processing devices 10 that can belong to the lounge. For example, when a maximum number of participants is set for an event, the management device 40 can set the maximum number of information processing devices 10 that can belong to the lounge in accordance with the maximum number of participants.
  • the device registration unit 333 notifies the sender of the registration request (e.g., the management device 40 or the information processing device 10) that the upper limit has been exceeded.
  • the device registration unit 333 may store the number of information processing devices 10 in the storage unit 320 as lounge information.
  • Change of lounge For example, when the device registration unit 333 receives a lounge change request from the management device 40, it changes the lounge based on the lounge information related to the lounge included in the change request, and updates the lounge information stored in the storage unit 320. Changes to the lounge include, for example, changes to the type of lounge, changes to the organization to which the lounge belongs, and changes to the registration period and upper limit number.
  • the device registration unit 333 when the device registration unit 333 receives a request to delete a lounge from the management device 40, it deletes the lounge by deleting the information about the lounge stored in the storage unit 320. Furthermore, the device registration unit 333 deletes information about the lounge to which the information processing device 10 belongs that is linked to the lounge to be deleted. When the information processing device 10 belongs only to the lounge to be deleted, the device registration unit 333 may delete information about the information processing device 10 together with the lounge.
  • the device registration unit 333 when the device registration unit 333 creates, modifies, or deletes a lounge, it notifies the management device 40 that the processing is complete.
  • the device registration unit 333 receives a registration request for the information processing device 10 from the management device 40, the device registration unit 333 registers the information processing device 10 based on the device information regarding the information processing device 10 included in the registration request. As a result, the information processing device 10 belongs to a lounge specified by the management device 40.
  • the device information includes, for example, at least one of the following pieces of information: Identification information of the information processing device 10 The lounge to which the information processing device 10 belongs The organization to which the information processing device 10 belongs Authority to invite other information processing devices 10
  • each information processing device 10 is assigned unique identification information that identifies the information processing device 10. This identification information may be included in the device information. Hereinafter, this identification information is also referred to as a device ID.
  • the invitation authority is the authority to invite other information processing devices 10 to the lounge to which the user belongs. For example, by limiting invitations to the lounge to information processing devices 10 that have this invitation authority, the information processing system 1 can provide telepresence services more securely.
  • the invitation authority may also include information regarding the scope in which invitations can be made (within the same organization, within a set organization, or across all organizations, etc.).
  • the device registration unit 333 for example, links the information processing device 10 to the lounge and organization to which it belongs and stores it in the storage unit 320. If an upper limit is set on the number of information processing devices 10 that can belong to a lounge, the device registration unit 333 updates the number of information processing devices 10 that belong to the lounge.
  • Modification of information processing device 10 For example, when the device registration unit 333 receives a change request for the information processing device 10 from the management device 40, the device registration unit 333 updates the information about the information processing device 10 stored in the storage unit 320 based on the device information included in the change request. Changes to the information processing device 10 include, for example, changes to the lounge and organization to which the information processing device 10 belongs, and changes to invitation authority.
  • the device registration unit 333 deletes the information processing device 10 by deleting the information of the information processing device 10 stored in the storage unit 320.
  • the device registration unit 333 updates the number of information processing devices 10 that belong to the lounge.
  • the device registration unit 333 that has registered, changed, or deleted an information processing device 10 notifies the management device 40 that the processing has been completed.
  • the management device 40 has been described as requesting registration, modification, and deletion of the information processing device 10, these requests may also be made by the information processing device 10.
  • the information processing device 10 itself that is the subject of registration may make a registration request.
  • an information processing device 10 belonging to a lounge may invite other information processing devices 10, thereby making a registration request for the other information processing devices 10.
  • the information processing device 10 having the invitation authority can make a request to the device registration unit 333 to register the other information processing device 10, in the same way as the management device 40.
  • the device registration unit 333 may keep the other information processing device 10 in a provisionally registered state. In this case, the device registration unit 333 officially registers the other information processing device 10 at the stage when the other information processing device 10 actually accesses the lounge.
  • the registration period may be limited.
  • the other information processing device 10 is automatically deleted by the device registration unit 333 after a certain period (registration period) has elapsed since registration.
  • the registration period may be specified by the inviting information processing device 10 when making the invitation, or may be determined in advance.
  • the processing unit that creates the lounge is not limited to the device registration unit 333.
  • a processing unit that creates the lounge such as a lounge registration unit, may be included in the control unit 330.
  • the matching unit 334 supports two-way communication between the information processing devices 10. For example, the matching unit 334 supports matching between information processing devices 10 that have the same connection destination.
  • the matching unit 334 when the matching unit 334 is notified by the information processing device 10 that it is online (or has started up), it notifies, for example, information about the lounge to which the information processing device 10 belongs. At this time, the matching unit 334 may provide the information processing device 10 with information about the usage status of the lounge, information about other information processing devices 10 connected to the lounge, and the like.
  • the matching unit 334 notifies the information processing device 10 of the destination information about the destination lounge.
  • the destination information includes, for example, a list of information processing devices 10 that are currently capable of two-way communication in the destination lounge (that is, online and has selected the destination lounge as its destination).
  • the destination information may also include information indicating whether the device itself has been selected as the partner for two-way communication, information about the previous destination, etc.
  • FIG. 9 is a diagram for explaining an example of connection destination information according to an embodiment of the present disclosure.
  • the connection destination information is displayed on the display 12 of the information processing device 10A1, for example, as a connection destination selection screen M1 shown in FIG. 9.
  • information processing device 10A1 when information processing device 10A1 connects to lounge A0, it transmits a request to acquire connection destination information to server device 30. Upon receiving the request to acquire connection destination information, matching unit 334 of server device 30 transmits connection destination information of lounge A0 to information processing device 10A1. Information processing device 10A1, which has received the connection destination information, displays connection destination selection screen M1 of FIG. 9 on display 12.
  • connection destination selection screen M1 displays a list of information processing devices 10A that are connected to lounge A0, excluding the information processing device itself (information processing device 10A1 in this case).
  • information processing device 10A1 information processing device 10A1 in this case.
  • four information processing devices 10A2, 10A3, 10A5, and 10A9 are connected to lounge A0.
  • connection destination selection screen M1 shows an icon indicating the status of the connection destination.
  • a white circle indicates the device itself (information processing device 10A1) and a black circle indicates the communication partner, and an icon in which a white circle and a black circle are connected by a line indicates that the two communication partners are the same.
  • the connection destination selection screen M1 shows the previous communication partner with this icon.
  • information processing device 10A3 is the previous communication partner of information processing device 10A1.
  • An icon with an arrow pointing to a white circle indicates that the other party has designated its own device (information processing device 10A1) as the connection destination.
  • information processing device 10A5 has selected (designated) information processing device 10A1 as the connection destination.
  • An icon with an arrow coming out of a white circle indicates that the device itself (information processing device 10A1) has been designated as the connection destination.
  • the check box next to information processing device 10A9 is checked, and information processing device 10A1 has selected (designated) information processing device 10A9 as the connection destination.
  • two-way communication can be freely performed if the connection destinations of information processing devices 10 in the same lounge match.
  • information processing device 10A5 has specified information processing device 10A1 as the connection destination, but information processing device 10A1 has not specified information processing device 10A5 as the connection destination, so information processing devices 10A5 and 10A1 cannot perform two-way communication.
  • information processing device 10A1 has specified information processing device 10A9 as the connection destination, but information processing device 10A9 has not specified information processing device 10A1 as the connection destination, and therefore information processing device 10A1 cannot connect to information processing device 10A9.
  • Information processing device 10A1 waits for a connection until information processing device 10A9 specifies its own device as the connection destination. When information processing device 10A9 specifies its own device as the connection destination, information processing device 10A1 becomes able to perform two-way communication with information processing device 10A9.
  • two-way communication can be performed if the connection destinations of the information processing devices 10 match, but cannot be performed if they do not match.
  • two-way communication is performed on the premise that the users U0 who use the information processing devices 10 have the intention to connect to each other.
  • the device name of the information processing device 10 is displayed on the connection destination selection screen M1 as device information, but the information displayed on the connection destination selection screen M1 is not limited to this.
  • the name of the location (base) where the information processing device 10 is installed may be displayed on the connection destination selection screen M1, or a nickname and an icon indicating the information processing device 10 may be displayed. In this way, information that can identify the information processing device 10 is displayed on the connection destination selection screen M1.
  • the information processing devices 10 displayed on the connection destination selection screen M1 may be sorted and displayed in alphabetical order, such as by device name.
  • the information processing devices 10 may be sorted and displayed in order of most or least frequent connection.
  • the material management unit 335 manages the shared data for each lounge.
  • the material management unit 335 stores in the storage unit 320 a folder (hereinafter, also referred to as a lounge folder) for managing the shared data for each lounge. Create a.
  • FIG. 10 is a diagram showing an example of a lounge folder according to an embodiment of the present disclosure.
  • the lounge folder is created under the Root Directory of the storage unit 320.
  • a materials folder for storing materials is created under the lounge folder.
  • the materials folder stores shared data (e.g., text data) to be shared in the lounge.
  • a Lounge A0 shared directory is created as a lounge folder under the Root Directory.
  • a Product A0 folder is created as a document folder under the Lounge A0 shared directory. Shared data such as text data can be stored in the Product A0 folder.
  • the Lounge B0 shared directory is created as a lounge folder under the Root Directory.
  • the Product B0 folder is created as a document folder under the Lounge B0 shared directory. Shared data such as text data can be stored in the Product B0 folder.
  • the Lounge C0 shared directory is created as a lounge folder under the Root Directory.
  • the Product C0 folder is created as a document folder under the Lounge C0 shared directory. Shared data such as text data can be stored in the Product C0 folder.
  • the information processing device 10 accesses the lounge folder of the connected lounge and acquires the material folder and the shared data stored in this material folder.
  • the information processing device 10 can display, for example, a list of the acquired shared data on the display 12.
  • the information processing device 10 acquires shared data from the server device 30 by specifying the path of the lounge folder in the configuration file of the information processing device 10.
  • the information processing device 10 accesses the lounge folder by specifying the path " ⁇ content-server.xxx.jp ⁇ share ⁇ groups ⁇ lounge name>".
  • the path name is shown when the server device 30 is a content server.
  • the server device 30 may be a content server.
  • the information processing system 1 may have a content server that holds shared data separate from the server device 30, and the shared data may be stored in this content server.
  • the information processing device 10 may download the entire set of shared data and store it as a cache in order to display thumbnails of the shared data and to speed up the display.
  • the lounge folder satisfies the following conditions.
  • the information processing device 10 can access the lounge folder of the connected lounge, but cannot access other lounge folders.
  • the information processing device 10 can download content from the lounge folder of the connected lounge, but cannot upload or delete content.
  • a content manager who manages shared data (content) can upload and delete content.
  • the information processing device 10 can access the lounge folder of the currently connected lounge and download and view the contents of the lounge folder.
  • the information processing device 10 cannot access the lounge folder of a lounge to which it is not currently connected, even if the lounge is a lounge to which it belongs, and cannot download or view the contents of this lounge folder.
  • the material management unit 335 permits the information processing device 10 to view shared data whose disclosure range is the connected lounge, but does not permit the information processing device 10 to view shared data whose disclosure range is lounges other than the connected lounge. If the information processing device 10 changes the connected lounge, the material management unit 335 permits the information processing device 10 to view shared data whose disclosure range is the new connected group.
  • the information processing device 10 When the information processing device 10 switches the destination lounge while content is stored in the cache, the information processing device 10 deletes the cache before connecting to the new lounge. In other words, the information processing device 10 deletes the content stored in the cache before switching the destination lounge. This prevents the information processing device 10 from viewing the shared data in the destination lounge from lounges other than the destination lounge, allowing the information processing system 1 to achieve more secure two-way communication.
  • the material management unit 335 also permits the content manager to upload and delete content (shared data). In this way, the material management unit 335 permits the information processing device 10 to view (Read) the content, and permits the content manager to view and write (Read/Write) the content.
  • one material folder is created for each lounge folder, but the number of material folders is not limited to one. For example, multiple material folders may be created in a lounge folder.
  • FIG. 11 is a diagram illustrating an example of permissions for content according to an embodiment of the present disclosure.
  • a connection to a lounge folder is set up for the information processing device 10.
  • an account in the example of FIG. 11, "did-xx_User" that has read permissions to the lounge folder of the lounge to which the information processing device 10 belongs is issued to the information processing device 10.
  • the timing at which an account is issued to the information processing device 10 may be the timing at which the information processing device 10 is registered in the server device 30.
  • the server device 30 registers the information processing device 10 and issues an account with Read permissions.
  • the content manager is also issued an account ("XX_Admin" in the example of Figure 11) with read/write privileges to the specified lounge folder.
  • the content manager can access the lounge folder by logging in with the account issued from a PC, for example.
  • FIG. 12 is a diagram illustrating an example of access to content according to an embodiment of the present disclosure.
  • User Group A0 connects to Lounge A0.
  • User Group A0 includes information processing devices 10 with accounts “did-01_User” and “did-02_User”. These accounts are permitted to read (Read), and the information processing devices 10 to which these accounts have been issued can read data in the shared directory of Lounge A0.
  • the content of Lounge A0 is managed by content administrators included in Content Administrator Group A0.
  • Content Administrator Group A0 includes content administrators with the accounts "RA-01_Admin” and "RA_02_Admin”. These accounts have read/write permissions, and content administrators who are issued these accounts can read and write data in the shared directory of Lounge A0.
  • User U0 of User Group B0 connects to Lounge B0.
  • User Group B0 includes information processing devices 10 with the accounts “did-01_User” and “did-03_User”. These accounts are permitted to read (Read), and the information processing devices 10 to which these accounts have been issued can read data in the shared directory of Lounge B0.
  • the content of Lounge B0 is managed by content administrators included in Content Administrator Group 0B.
  • Content Administrator Group B0 includes content administrators with the accounts "RB-01_Admin” and "RB_02_Admin”. These accounts have read/write permissions, and content administrators who are issued these accounts can read and write data in the shared directory of Lounge B0.
  • User U0 of User Group C0 connects to Lounge C0.
  • User Group C0 includes information processing devices 10 with the accounts “did-01_User” and “did-04_User”. These accounts are permitted to read, and the information processing devices 10 to which these accounts have been issued can read data in the shared directory of Lounge C0.
  • the content of Lounge C0 is managed by content administrators included in Content Administrator Group C0.
  • Content Administrator Group C0 includes content administrators with the accounts "RC-01_Admin” and "RC_02_Admin”. These accounts have read/write permissions, and content administrators who are issued these accounts can read and write data in the shared directory of Lounge C0.
  • the information processing device 10 to which the account "did-01_User" has been issued can connect to multiple lounges A0 to C0.
  • the information processing device 10 since the information processing device 10 can belong to multiple lounges, the information processing device 10 may have access rights (read authority) to multiple lounge folders.
  • one User Group contains two accounts, but the number of accounts contained in one User Group is not limited to two and may be three or more. Also, the number of content administrators contained in Content Administrator Group C0 is not limited to two and may be one or three or more.
  • the content manager may be the lounge manager described above, or may be a different manager from the lounge manager.
  • the lounge manager may manage the content, or a content manager different from the lounge manager may manage the content.
  • the information processing device 10 can access shared data using various protocols such as HTTPS (HyperText Transfer Protocol Secure), NFS (Network File System), and SMB (Server Message Block).
  • HTTPS HyperText Transfer Protocol Secure
  • NFS Network File System
  • SMB Server Message Block
  • the data shared within the lounge is not limited to data that is simultaneously viewed on the information processing devices 10 during two-way communication, such as conference materials.
  • the shared data may be any data that can be shared and viewed by the information processing devices 10 belonging to the lounge, and may be, for example, a bulletin board exclusively for the lounge.
  • the material management unit 335 creates, for example, a bulletin board folder separate from the material folder under the lounge folder.
  • the bulletin board folder stores data for the lounge-only bulletin board (for example, HTML files containing text and links, image files, etc.).
  • the information processing device 10 accesses the lounge-only bulletin board by referencing the bulletin board folder.
  • the information processing device 10 can also post on the lounge-only bulletin board.
  • the information processing device 10 has read/write authority for the bulletin board folder.
  • the material management unit 335 permits the information processing device 10 to read and write to the bulletin board folder of the connected lounge.
  • the material management unit 335 allows the information processing device 10 to read and write to the bulletin board folder, so that user U0 can communicate with other users U0 who belong to the lounge in addition to two-way communication.
  • shared data may include announcement data for events held in the lounge or in the information processing system 1.
  • the material management unit 335 creates an announcement folder under the lounge file.
  • the announcement folder stores the announcement data.
  • the information processing device 10 accesses the announcement data by referring to the announcement folder.
  • the information processing device 10 may also be able to write to the announcement data.
  • the information processing device 10 may have read/write authority to the announcement data folder.
  • the material management unit 335 permits the information processing device 10 to read and write to the announcement data folder of the connected lounge.
  • FIG. 13 is a diagram showing an example of shared data according to an embodiment of the present disclosure.
  • the shared data shown in FIG. 13 is event notification data.
  • the information processing device 10 obtains the notification data from the server device 30, it displays the data on the display 12.
  • two-way communication begins after the connection destinations of the information processing devices 10 match. Therefore, a waiting time may occur until the communication partner goes online and selects the device as the connection destination. Also, if an information processing device 10 connects to a lounge but another information processing device 10 is not connected to this lounge, a waiting time will occur until the other information processing device 10 connects to the lounge.
  • the information processing device 10 presents notification data to the user U0, allowing the user U0 to learn about events and other information.
  • the information displayed during the waiting time is not limited to announcements about events, etc.
  • various information such as wallpaper (background image), real-time images of spectacular views from around the world, and commercial content may be displayed on the information processing device 10 during the waiting time.
  • the material management unit 335 creates a background image folder under the lounge file.
  • the background image folder stores background image data.
  • the information processing device 10 accesses the background image data by referencing the background image folder.
  • the information processing device 10 may also be allowed to write to the background image data.
  • the information processing device 10 may have read/write authority to the background image data folder.
  • the material management unit 335 permits the information processing device 10 to read and write to the background image data folder of the connected lounge.
  • the material management unit 335 notifies the information processing device 10 of the URL of the commercial content, for example, in response to a request from the information processing device 10.
  • the information processing device 10 uses the acquired URL to access a content server that manages the commercial content and displays the commercial content.
  • the content server that manages the commercial content may be a content server operated by a system different from the information processing system 1 according to this embodiment.
  • the information processing device 10 notifies the user U0 with a message such as "Connecting shortly" and seamlessly switches to the video of the communication partner.
  • the status presenting unit 336 presents the usage status of the lounge to the user U0 in response to a request from the user U0.
  • This user U0 may be a user who performs two-way communication using the information processing device 10, or may be an administrator who manages the lounge and the information processing device 10 (for example, the above-mentioned lounge administrator and content administrator, etc.).
  • the usage status of the lounge includes information indicating, for example, which information processing device 10 is connected to and to what extent the information processing device 10 is being used.
  • user U0 can understand the relationships between the locations where the information processing devices 10 are introduced (installed).
  • the situation presenting unit 336 acquires usage information from the information processing device 10.
  • the usage information includes, for example, at least one of the following pieces of information.
  • the time when the two-way communication was established The time when the two-way communication was disconnected
  • the number of connections with other information processing devices 10 The number of smiles of the user U0
  • the number of people who participated in the two-way communication The number of connections to the lounge and the connection time
  • the status presentation unit 336 When the status presentation unit 336 acquires usage information from the information processing device 10, it statistically processes the usage information and stores it in the storage unit 320.
  • the status presentation unit 336 notifies the user U0 of the usage status of the lounge in response to a request from the user U0.
  • the status presentation unit 336 presents, for example, the usage frequency of the information processing devices 10 belonging to the lounge, the connection history (information indicating which information processing devices 10 were connected to each other), and the smile level to the user U0 as the usage status of the lounge.
  • FIG. 14 is a diagram for explaining an example of the usage status of a lounge according to an embodiment of the present disclosure.
  • FIG. 14 shows a usage status screen M2 presented to user U1.
  • the locations where the information processing devices 10 are installed are indicated by circles.
  • the size of the circle indicates the frequency of use of the information processing devices 10 installed at each location.
  • the largest circle indicates that the information processing device 10 has been used 20 times or more in a specified period.
  • the second largest circle indicates that the information processing device 10 has been used 10 times or more (less than 20 times) in a specified period.
  • the smallest circle indicates that the information processing device 10 has been used 5 times or more (less than 10 times) in a specified period.
  • the usage frequency of information processing devices 10 installed in Tokyo, Osaka, Fukuoka, Sapporo, Sendai, Nagoya, and Kobe is shown.
  • the usage frequency of the information processing device 10 installed in Osaka is the highest, and the usage frequency of the information processing device 10 installed in Sendai is the second highest.
  • the arrows displayed on the usage status screen M2 indicate the current (or previous) connection status. For example, a two-way arrow indicates that two-way communication is taking place. A one-way arrow indicates that one side has selected the device as a connection destination, but the other side has not.
  • the smile level is also an index showing the degree to which the communicating user U0 is smiling during communication. For example, if the smile level is 70 or higher, the relationship between the users U0 is "good.” If the smile level is 50 or lower, the relationship between the users U0 is “average.” If the smile level is 30 or lower, the relationship between the users U0 is in a "needs improvement" state.
  • the smile level is shown with an icon of a facial expression. For example, the relationship between the users U0 in Sendai and Nagoya is "good.” Furthermore, the relationship between the users U0 in Nagoya and Kobe is "average.”
  • the status presentation unit 336 presents to user U0 details of the usage status of the information processing device 10 located at that base.
  • FIG. 15 is a diagram for explaining an example of the usage status of an information processing device 10 according to an embodiment of the present disclosure.
  • a device status screen M3 showing the usage status of an information processing device 10 installed in Sendai is shown.
  • the device status screen M3 displays an icon representing the information processing device 10, the device name, the management organization that manages the information processing device 10, the installation location, the frequency of use, the connection history, and the smile level.
  • the connection history includes information indicating the connection destination (here, the base) and the number of connections.
  • an image of a car is displayed as an icon representing the information processing device 10.
  • "Sendai no Mado” is displayed as the device name of the information processing device 10.
  • "Company gA0" is displayed as the management organization. The location where the information processing device 10 is installed is the "Sendai branch office” of company gA0. In addition, the frequency of use of the information processing device 10 installed in the Sendai branch office is "twice a week.”
  • the connection history of the information processing device 10 shows that the number of connections to the destination "Tokyo” is “10 times,” the number of connections to the destination “Nagoya” is “7 times,” and the number of connections to the destination “Kobe” is “3 times.”
  • the smile level of user U0 who uses the information processing device 10 is 70.
  • the server device 30 may suggest to the lounge manager that a new lounge be created based on the usage status of the lounge.
  • the matching unit 334 of the server device 30 may automatically categorize (group) frequently connected information processing devices 10 based on the connection history of the information processing devices 10, and suggest the creation of a new lounge.
  • the device registration unit 333 creates a new lounge and adds the grouped information processing devices 10 to the new lounge.
  • the information processing system 1 can control the number of information processing devices 10 that belong to a lounge, and can prevent the number of information processing devices 10 that belong to one lounge from increasing too much.
  • Example of configuration of management device 16 is a block diagram showing an example of the configuration of a management device 40 according to an embodiment of the present disclosure.
  • the communication unit 410 is realized by, for example, a NIC, a network interface controller, etc.
  • the communication unit 410 is connected to the network 20 (see FIG. 2) by wire or wirelessly, and transmits and receives information to and from the server device 30 and the like via the network 20.
  • the storage unit 420 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk.
  • Control unit 430 is realized, for example, by a CPU, an MPU, a GPU, etc., executing a program stored in the server device using a RAM, etc. as a working area.
  • the control unit 430 is a controller, and may be realized, for example, by an integrated circuit such as an ASIC or an FPGA.
  • control unit 430 has a data transmission unit 431, a data reception unit 432, a registration request unit 433, and a material management unit 434, and realizes or executes the functions and actions of information processing described below.
  • the internal configuration of the control unit 430 is not limited to the configuration shown in FIG. 16, and may be other configurations as long as they perform the information processing described below.
  • the data transmission unit 431 transmits data to the server device 30 or the like via the communication unit 410.
  • the data transmission unit 431 transmits the processing results of each unit of the control unit 430 to the server device 30 or the like.
  • the data receiving unit 432 receives data from the server device 30 or the like via the communication unit 410.
  • the data receiving unit 432 outputs the received data to each unit of the control unit 430.
  • the registration request unit 433 requests the server device 30 to register a lounge and to register the information processing device 10. For example, the registration request unit 433 requests the server device 30 to create, change, or delete a lounge. The registration request unit 433 also requests the server device 30 to add, change, or delete the information processing device 10 from the lounge.
  • the material management unit 434 manages content such as shared data in the lounge. For example, the material management unit 434 requests the server device 30 to update or delete content such as shared data.
  • management device 40 has both a function for managing the lounge and a function for managing the content.
  • the function for managing the lounge and the function for managing the content may be implemented in separate devices.
  • Example of configuration of information processing device 17 is a block diagram showing an example of a configuration of an information processing device 10 according to an embodiment of the present disclosure.
  • the information processing device 10 shown in FIG. 17 includes a communication unit 110, an input/output unit 120, a storage unit 130, and a control unit 140.
  • the communication unit 110 is realized by, for example, a NIC, a network interface controller, etc.
  • the communication unit 110 is connected to a network 20 (see FIG. 2 ) by wire or wirelessly, and transmits and receives information to and from the server device 30, the management device 40, other information processing devices 10, etc. via the network 20.
  • the input/output unit 120 includes a user interface for exchanging information with the user U0.
  • the input/output unit 120 includes a camera 121, a microphone 122, a sensor 123, a touch panel display 124, a display 125, and a speaker 126.
  • the camera 121 is disposed, for example, around a display 125 of the information processing device 10, and captures an image of a user U0 positioned in front of the display 125.
  • the camera 121 is an input device that inputs an image of the user U0 to the information processing device 10.
  • the input/output unit 120 may include, for example, a plurality of cameras 121.
  • the microphone 122 is disposed, for example, around the display 125 and captures sounds around the display 125.
  • the microphone 122 is, for example, an input device that inputs the voice of the user U0 to the information processing device 10.
  • the input/output unit 120 may include, for example, a plurality of microphones 122.
  • the sensor 123 is, for example, a device that is disposed around the display 125 and senses the periphery of the display 125.
  • the sensor 123 is, for example, a depth sensor such as Kinect (registered trademark) that acquires depth information of a subject, or an infrared sensor.
  • the information processing device 10 uses the sensor 123 to recognize the face of the user U0 and sense the position of the user U0.
  • the sensor 123 is placed, for example, at a position where the face of the user U0 can be sensed and at a position where the entire body of the user U0 can be sensed.
  • the sensor 123 can be placed on the top of the information processing device 10, at a position where the entire space in which the information processing device 10 is placed can be viewed, on the ceiling, etc.
  • the input/output unit 120 may be equipped with multiple sensors 123.
  • the touch panel display 124 is an input/output device that corresponds to, for example, the table display 12a in Fig. 1.
  • the touch panel display 124 is placed, for example, at the hand of the user U0 and is used by the user U0 to share data with a communication partner.
  • the input/output unit 120 may include a plurality of touch panel displays 124.
  • the display 125 is an output device that corresponds to, for example, the window display 12b in Fig. 1.
  • the display 125 presents, for example, an image of a communication partner to the user U0.
  • the input/output unit 120 may include a plurality of displays 125.
  • the speaker 126 is, for example, an output device that is arranged near the display 125 of the information processing device 10 and outputs the sound of the communication partner.
  • the speaker 126 outputs, for example, the voice of the communication partner.
  • the input/output unit 120 may include a plurality of speakers 126.
  • the image of user U0 captured by camera 121 and the audio picked up by microphone 122 are transmitted to the communication partner via communication unit 110.
  • the image received from the communication partner is displayed on display 125, and the communication partner's audio is output from speaker 126.
  • the storage unit 130 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk.
  • Control unit 140 The control unit 140 is realized, for example, by a CPU, an MPU, a GPU, or the like, executing a program stored inside the information processing device 10 using a RAM or the like as a working area.
  • the control unit 140 is a controller, and may be realized, for example, by an integrated circuit such as an ASIC or an FPGA.
  • the control unit 140 has a data transmission unit 141, a data reception unit 142, a sensor control unit 143, a video control unit 144, an audio control unit 145, a body tracking unit 146, a face tracking unit 147, a statistical processing unit 148, and a connection processing unit 149.
  • the control unit 140 realizes or executes the information processing functions and actions described below.
  • the internal configuration of the control unit 140 is not limited to the configuration shown in FIG. 17, and may be other configurations as long as they perform the information processing described below.
  • the control unit 140 performs two-way communication with other information processing devices 10, for example, by establishing WebRTC (Web Real-Time Communication) P2P (Peer to Peer) communication with the other information processing devices 10.
  • WebRTC Web Real-Time Communication
  • P2P Peer to Peer
  • the data transmission unit 141 transmits data to the server device 30 or the like via the communication unit 410.
  • the data transmission unit 141 transmits the processing results of each unit of the control unit 430 to the server device 30 or the like.
  • the data receiving unit 142 receives data from the server device 30 or the like via the communication unit 410.
  • the data receiving unit 142 outputs the received data to each unit of the control unit 140.
  • the sensor control unit 143 controls the sensor 123 to obtain the sensing result of the user U0.
  • the sensor control unit 143 outputs the sensing result to the face tracking unit 147 and the body tracking unit 146.
  • the sensor control unit 143 controls the sensor 123 to sense the user U0 based on, for example, the face recognition result by the face tracking unit 147 and the person position recognition result by the body tracking unit 146.
  • the image control unit 144 controls the camera 121 to acquire an image of the user U0.
  • the image control unit 144 transmits the acquired image of the user U0 to a communication partner (another information processing device 10) via the data transmission unit 141.
  • the image control unit 144 outputs the image of the user U0 acquired from the camera 121 to the Face Tracking unit 147.
  • the image control unit 144 may perform image processing on the image acquired by the camera 121 based on the results of face recognition by the face tracking unit 147 and the results of person position recognition by the body tracking unit 146. For example, the image control unit 144 may transmit to the communication partner an image of a space that should be focused on according to the number of smiles detected by the face tracking unit 147.
  • the image control unit 144 also recognizes the context of each space based on, for example, the results of face recognition by the Face Tracking unit 147 and the results of person position recognition by the Body Tracking unit 146, and controls the camera 121 to preferentially capture the space in which the user U0 is present.
  • the image control unit 144 also controls the camera 121 to preferentially capture the space in which the user should be focused, based on the number of smiles detected by the Face Tracking unit 147, for example.
  • the video control unit 144 also causes images to be displayed on the touch panel display 124 and the display 125.
  • the video control unit 144 causes the display 125 to display an image of the communication partner acquired from another information processing device 10 with which two-way communication is being performed via the data receiving unit 142.
  • the video control unit 144 causes the touch panel display 124 to display shared data such as materials acquired from the server device 30.
  • the voice control unit 145 controls the microphone 122 to acquire the voice of the user U0.
  • the voice control unit 145 transmits the acquired voice of the user U0 via the data transmission unit 141 to a communication partner (another information processing device 10).
  • the audio control unit 145 also outputs the voice of the communication partner obtained from another information processing device 10 via the data receiving unit 142 from the speaker 126.
  • the body tracking unit 146 analyzes the sensing result of the sensor 123 and performs body tracking of the user U0.
  • the body tracking unit 146 outputs the body tracking result to the sensor control unit 143, the video control unit 144, and the statistical processing unit 148. do.
  • the face tracking unit 147 recognizes the face of the user U0 based on the image of the camera 121. For example, the face tracking unit 147 recognizes the face of the user U0 using AI (Artificial Intelligence) technology and performs face tracking. In addition, the face tracking unit 147 detects the number of times the user U0 smiles by using the result of the face recognition. The face tracking unit 147 transmits the result of the face tracking to the sensor control unit 143, the video control unit 144, and the statistical processing unit. Output to 148.
  • AI Artificial Intelligence
  • the statistical processing unit 148 notifies the server device 30 of usage information of the information processing device 10. For example, every time the information processing device 10 performs bidirectional communication (in other words, for each session), the statistical processing unit 148 notifies the server device 30 of the connection destination of the bidirectional communication, the connection time, and the number of times a smile has been detected, as usage information.
  • the statistical processing unit 148 acquires usage status from the server device 30, it presents the acquired usage status to the user U0 (see Figures 14 and 15).
  • the statistical processing unit 148 may notify the server device 30 of the usage information at each predetermined period, such as one day or one week, or after each predetermined number of sessions.
  • the above-mentioned usage information is an example.
  • the usage information may also include information such as the number of people detected by Body Tracking.
  • the statistical processing unit 148 notifies the server device 30 of usage information obtained, for example, by statistically processing the two-way communication. In this way, by performing statistical processing in the information processing device 10, the server device 30 can grasp the usage status in the lounge without acquiring personal information of the user U0.
  • connection processing unit 149 selects a lounge to connect to and an information processing device 10 (hereinafter, also referred to as a destination terminal) to communicate with in accordance with an instruction from the user U0. As a result, the connection processing unit 149 executes a connection process to start two-way communication.
  • an information processing device 10 hereinafter, also referred to as a destination terminal
  • connection processing unit 149 When the information processing device 10 starts up and goes online, the connection processing unit 149 notifies the server device 30 that it has gone online. After the notification, the connection processing unit 149 obtains information about connectable lounges (for example, a lounge list (see lounge selection screens M11 and M21 in FIG. 23)) from the server device 30.
  • connectable lounges for example, a lounge list (see lounge selection screens M11 and M21 in FIG. 23)
  • connection processing unit 149 selects the lounge to which to connect based on the acquired information about connectable lounges.
  • the connection processing unit 149 notifies the server device 30 of the selected lounge.
  • the connection processing unit 149 acquires information about the communicable information processing devices 10 (e.g., a connection destination list (see connection destination selection screen M1 in FIG. 9)) from the server device 30.
  • the connection processing unit 149 selects the destination terminal to communicate with this time from the destination list.
  • the connection processing unit 149 notifies the server device 30 of the destination terminal. If the destination terminal has selected its own device as the communication partner, the connection processing unit 149 starts two-way communication with the destination terminal. On the other hand, if the destination terminal has not selected its own device as the communication partner, the connection processing unit 149 waits until the destination terminal selects its own device.
  • connection processing unit 149 may reselect the destination terminal.
  • the connection processing unit 149 may reselect the destination terminal by first reselecting the lounge, or may reselect the destination terminal without changing the lounge.
  • the connection processing unit 149 requests the server device 30 to reselect the destination terminal.
  • the server device 30 receives the reselection request, it transmits to the connection processing unit 149 at least one of information about connectable lounges and information about communicable information processing devices 10s.
  • the server device 30 may reselect a destination terminal or may make an inquiry to the connection processing unit 149. If the connection processing unit 149 reselects a destination terminal, the server device 30 transmits to the connection processing unit 149 at least one of information about a connectable lounge and information about a communicable information processing device 10.
  • This certain period of time may be a preset time, or may be a time set by user U0 (or information processing device 10). Alternatively, a certain period of time may not be set, and a destination terminal may be reselected in response to a request from user U0. Alternatively, even if a certain period of time is set, a destination terminal may be reselected without waiting for the passage of the certain period of time if a request is made by user U0.
  • connection process by the connection processing unit 149 can be performed automatically without instructions from the user U0.
  • the connection processing unit 149 automatically selects this communication partner as the connection destination terminal after the information processing device 10 starts up.
  • connection processing unit 149 executes the connection process so that two-way communication with the communication partner begins at this start time. In this way, the connection processing unit 149 can automatically perform the connection process according to the schedule of user U0.
  • Example of two-way communication processing>> 18 is a sequence diagram showing an example of a flow of a two-way communication process according to an embodiment of the present disclosure.
  • two-way communication process is performed between information processing devices 10A1 and 10A2 connected to lounge A0. Also, it is assumed that information processing device 10A2 is connected to lounge A0 before information processing device 10A1.
  • step S101 when information processing device 10A1 selects lounge A0 as the connection destination, it notifies server device 30 of the connection to lounge A0 (step S101).
  • server device 30 notifies information processing device 10A2 of the connection of information processing device 10A1 to lounge A0 (step S102).
  • the server device 30 also notifies the information processing device 10A1 of the connection status of lounge A0 (step S103).
  • the connection status of lounge A0 includes, for example, a list of information processing devices 10A that are connected to lounge A0.
  • information processing device 10A1 selects information processing device 10A2 as the connection destination based on the connection status of lounge A0 (step S104) and notifies server device 30 of the destination terminal (information processing device 10A2 in this case) (step S105).
  • Server device 30 notifies information processing device 10A2 that it has been selected by information processing device 10A1 as the destination terminal (step S106).
  • Information processing device 10A2 selects information processing device 10A1 as the connection destination (step S107) and notifies server device 30 of the connection destination terminal (step S108). Server device 30 then notifies information processing device 10A1 that it has been selected as the connection destination terminal by information processing device 10A2 (step S109). After this, two-way communication (P2P communication) is started between information processing devices 10A1 and 10A2 (step S110).
  • P2P communication two-way communication
  • server device 30 transmits the data of lounge A0 to information processing device 10A1 (step S112).
  • server device 30 transmits the data of lounge A0 to information processing device 10A2 (step S114).
  • server device 30 transmits the shared data to information processing devices 10A1 and 10A2 after two-way communication is established between information processing devices 10A1 and 10A2, but the timing at which server device 30 transmits the shared data is not limited to this. Once information processing devices 10A1 and 10A2 have connected to lounge A0, server device 30 can transmit the shared data in response to a request from information processing devices 10A1 and 10A2.
  • two-way communication is established by selecting each other as the connection destination terminal. Also, in this embodiment, on the condition that information processing device 10A is connected to lounge A0, information processing device 10A is permitted to view the shared data in lounge A0.
  • Multipoint connection> ⁇ 4.1.1. Overview of multipoint connection>
  • two information processing devices 10 perform bidirectional communication, but three or more information processing devices 10 may perform bidirectional communication.
  • FIG. 19 is a diagram showing an example of two-way communication between multiple locations according to another embodiment of the present disclosure.
  • Tokyo is the main venue A1 of the event, where information processing device 10A1 is installed.
  • Nagoya is the sub-venue A2 of the event, where information processing device 10A2 is installed.
  • Osaka is the sub-venue A3 of the event, where information processing device 10A3 is installed.
  • Information processing devices 10A1 to 10A3 are connected to lounge A0 and communicate with each other bidirectionally.
  • the event organizer decides to give priority to displaying the main venue A1.
  • the information processing devices 10A2 and 10A3 display the video of the main venue A1 with priority, for example, in accordance with the decision result held by the server device 30.
  • the information processing device 10A2 installed in the sub-venue A2 basically displays images from the main venue A1, but also displays images from the sub-venue A3 depending on the situation.
  • the information processing device 10A2 switches the image to be displayed from the main venue A1 to the image of the sub-venue A3. For example, the information processing device 10A1 determines the number of event participants in the main venue A1 based on the number of people detected by the body tracking unit 146 of the information processing device 10A1.
  • the information processing device 10A2 switches the image displayed from the main venue A1 to the image of the sub-venue A3. For example, the information processing device 10A2 determines whether the sub-venue A3 is lively or not based on, for example, audio information acquired by the information processing device 10A3.
  • two-way communication between information processing devices 10A is initiated by each device selecting the other as a connection destination.
  • multipoint two-way communication is initiated by all connection destinations selecting all connection destinations except for the information processing device itself. In other words, multipoint two-way communication is not initiated unless any one information processing device 10A selects at least one of the remaining information processing devices 10A as a connection destination.
  • the remaining information processing devices 10A may perform a two-point (or multi-point) connection.
  • two-way communication between the two locations by information processing devices 10A1 and 10A3 may be performed until information processing device 10A2 is online. After that, when information processing device 10A2 goes online and selects information processing devices 10A1 and 10A3 as the connection destination, the two-way communication between the two locations switches to two-way communication between three locations.
  • information processing device 10A1 selects information processing devices 10A2 and 10A3 as connection destinations, and information processing device 10A3 selects information processing devices 10A1 and 10A2 as connection destinations.
  • information processing device 10A2 does not select information processing device 10A3 as a connection destination.
  • two-way communication among the three locations is not initiated. Instead, two-way communication between the two locations, information processing devices 10A1 and 10A3, may be initiated. Thereafter, if information processing device 10A2 also selects information processing device 10A3 as a connection destination, the two-way communication between the two locations is switched to two-way communication among the three locations.
  • Multipoint connection processing> 20 is a sequence diagram showing an example of a flow of a multipoint connection process according to another embodiment of the present disclosure.
  • the multipoint connection process is performed among the information processing devices 10A1 to 10A3 connected to the lounge A0. Also, it is assumed that the information processing devices 10A2 and 10A3 are connected to the lounge A0 before the information processing device 10A1.
  • information processing device 10A1 selects lounge A0 as the connection destination, it notifies server device 30 of the connection to lounge A0 (step S201).
  • Server device 30 notifies information processing devices 10A2 and 10A3 of the connection of information processing device 10A1 to lounge A0 (step S202).
  • the server device 30 also notifies the information processing device 10A1 of the connection status of lounge A0 (step S203).
  • the connection status of lounge A0 includes, for example, a list of information processing devices 10A that are connected to lounge A0.
  • information processing device 10A1 selects information processing devices 10A2 and 10A3 as destination terminals based on the connection status of lounge A0 (step S204), and notifies server device 30 of the destination terminals (information processing devices 10A2 and 10A3 in this case) (step S205).
  • Server device 30 notifies information processing devices 10A2 and 10A3 that they have been selected as destination terminals by information processing device 10A1 (step S206). In this way, when information processing device 10A1 selects multiple information processing devices 10A2 and 10A3 as destination terminals, server device 30 notifies all selected information processing devices 10A2 and 10A3 that they have been selected as destination terminals.
  • Information processing device 10A2 selects information processing devices 10A1 and 10A3 as connection destinations (step S207) and notifies server device 30 of the connection destination terminals (information processing devices 10A1 and 10A3 in this case) (step S208). Then, server device 30 notifies information processing devices 10A1 and 10A3 that they have been selected as connection destination terminals by information processing device 10A2 (step S209).
  • Information processing device 10A3 selects information processing devices 10A2 and 10A3 as connection destinations (step S210) and notifies server device 30 of the connection destination terminals (information processing devices 10A2 and 10A3 in this case) (step S211). Then, server device 30 notifies information processing devices 10A2 and 10A3 that they have been selected as connection destination terminals by information processing device 10A3 (step S212).
  • the information processing device 10A selected as the destination terminal selects all information processing devices 10A other than itself as destination terminals, thereby starting two-way communication between the information processing devices 10A selected as destination terminals. In other words, by selecting all information processing devices 10 from each other as destination terminals, two-way communication between multiple points is established. Note that, in this embodiment as well, on the condition that the information processing device 10A is connected to lounge A0, the information processing device 10A is permitted to view the shared data in this lounge A0.
  • P2P communication is basically established when the information processing device 10 selects a destination terminal (information processing device 10) to be a communication partner, and the destination terminal selects its own device as a communication partner. On the other hand, if the destination terminal is not started or if the destination terminal has not selected its own device as a communication partner, P2P communication is not established.
  • the information processing device 10 starts the P2P communication process by uniquely selecting a communication partner. In other words, the information processing device 10 cannot start P2P communication unless it selects a communication partner.
  • the information processing system 1 introduces an anyone mode in which a connection destination terminal is selected without specifying a specific communication partner.
  • 21 and 22 are diagrams for explaining an example of a method for selecting a connection destination in the Suite mode according to another embodiment of the present disclosure.
  • FIG. 21 shows a case where information processing device 10A1 located at base A1 selects a destination terminal in Suite mode. For example, information processing device 10A1 selects a destination terminal in Suite mode by making an optional connection request to server device 30 to wait for a connection from any information processing device 10A. In this case, information processing device 10A1 selects all information processing devices 10A2 to 10A4 connected to lounge A0 as destination terminals.
  • the information processing device 10A1 starts P2P communication with the information processing device 10 that selected the information processing device 10A1 as the destination terminal.
  • information processing device 10A4 selects information processing device 10A1 as the destination terminal.
  • P2P communication is established between information processing device 10A1 and information processing device 10A4.
  • FIG. 23 is a diagram for explaining an example of the flow of two-way communication processing according to another embodiment of the present disclosure.
  • the upper diagram of FIG. 23 shows an example of the flow of processing by information processing device 10A1.
  • the lower diagram of FIG. 23 shows an example of the flow of processing by information processing device 10A4.
  • lounge selection screens M11 and M21 for selecting a lounge are displayed.
  • the lounge selection screen M11 of information processing device 10A1 displays a list of lounges A0, B0, D0, and G0 to which information processing device 10A1 belongs.
  • information processing device 10A1 selects lounge A0.
  • the lounge selection screen M21 of the information processing device 10A4 displays a list of lounges A0, C0, D0, and E0 to which the information processing device 10A4 belongs. Here, for example, the information processing device 10A4 selects lounge A0.
  • connection destination selection screens M12 and M22 for selecting a connection destination terminal are displayed.
  • a list of points A2 to A4 is displayed on the connection destination selection screen M12 of information processing device 10A1 as information for identifying information processing devices 10A2 to 10A4 that will connect to lounge A0.
  • connection destination selection screen M12 also displays an icon indicating the selection status of the connection destination terminal.
  • the connection destination selection screen M12 displays an icon (represented by a white circle and an arrow pointing out from the white circle) indicating that information processing device 10A1 previously selected information processing device 10A3 as the connection destination terminal.
  • a standby screen M13 indicating that the information processing device 10A1 is waiting for a connection is displayed. If the information processing device 10A1 has not been selected as a connection destination terminal, the standby screen M13 is displayed until it is selected as a connection destination terminal.
  • a list of points A1 to A3 is displayed on the connection destination selection screen M22 of the information processing device 10A4 as information for identifying the information processing devices 10A1 to 10A3 that are to be connected to the lounge A0.
  • "Anyone" is displayed to select a connection destination without specifying the information processing device 10A.
  • connection destination selection screen M22 displays an icon indicating the selection status of the connection destination terminal.
  • the connection destination selection screen M22 displays an icon (represented by a white circle and an arrow pointing in the direction of the white circle) indicating that information processing device 10A3 has selected information processing device 10A4 as the connection destination terminal.
  • information processing device 10A1 selects a destination terminal in "Anyone” mode. Therefore, on destination selection screen M22, an icon (a white circle, an arrow pointing in the direction of this white circle, and an icon represented by the character string "Anyone") is displayed indicating that information processing device 10A1 has selected information processing device 10A4 as a destination terminal in "Anyone" mode.
  • an icon indicating that the two connection destinations match may be displayed on the connection destination selection screens M12 and M22, although this icon is not displayed on the connection destination selection screens M12 and M22.
  • information processing device 10A4 selects information processing device 10A1, which is set to Symphony mode.
  • information processing device 10A4 displays connection screen M24 indicating that it is currently connected to information processing device 10A1.
  • information processing device 10A1 displays connection screen M14 indicating that it is currently connected to information processing device 10A4.
  • P2P communication is established between the information processing device 10A selected first and the information processing device 10A1.
  • timing at which information processing devices 10A1 and 10A4 connect to lounge A0 may be the same or different.
  • information processing device 10A1 selects a connection destination in Suite mode, and then information processing device 10A4 selects information processing device 10A1 as a connection destination
  • the order of selection is not limited to this.
  • information processing device 10A4 may select information processing device 10A1 as a connection destination, and then information processing device 10A1 may select a connection destination in Suite mode.
  • information processing devices 10A1 and 10A4 are connected and P2P communication is established without information processing device 10A1 displaying standby screen M13.
  • the information processing device 10 selecting a connection destination terminal in Suite mode, the user U0 can, for example, meet new people, even strangers, and build new connections through the information processing system 1.
  • the destination terminals selected in the Teen mode are limited to information processing devices 10 that connect to the lounge.
  • lounges are classified into three types: “public,” “protected,” and “private.”
  • the information processing devices 10 that can be connected vary depending on the type of lounge.
  • the information processing device 10 can establish a connection that takes security and privacy into consideration depending on the type of lounge in which the anyone mode is set.
  • the lounge administrator can promote the creation of new connections while taking into consideration the security and privacy of the information processing device 10 by setting the type of lounge depending on the information processing device 10 that belongs to the lounge.
  • FIG. 24 is a hardware configuration diagram showing an example of the computer 1000 that realizes the functions of the information processing device 10 according to the present disclosure.
  • the information processing device 10 according to the embodiment will be described as an example of the computer 1000.
  • the computer 1000 has a CPU 1100, a RAM 1200, a ROM (Read Only Memory) 1300, a HDD (Hard Disk Drive) 1400, a communication interface 1500, and an input/output interface 1600. Each part of the computer 1000 is connected by a bus 1050.
  • the CPU 1100 operates based on the programs stored in the ROM 1300 or the HDD 1400 and controls each part. For example, the CPU 1100 loads the programs stored in the ROM 1300 or the HDD 1400 into the RAM 1200 and executes processes corresponding to the various programs.
  • the ROM 1300 stores boot programs such as the Basic Input Output System (BIOS) that is executed by the CPU 1100 when the computer 1000 starts up, as well as programs that depend on the hardware of the computer 1000.
  • BIOS Basic Input Output System
  • HDD 1400 is a recording medium readable by computer 1000 that non-temporarily records programs executed by CPU 1100 and data used by such programs.
  • HDD 1400 is a recording medium that records the image processing program related to the present disclosure, which is an example of program data 1450.
  • the communication interface 1500 is an interface for connecting the computer 1000 to an external network 1550 (e.g., the Internet).
  • the CPU 1100 receives data from other devices and transmits data generated by the CPU 1100 to other devices via the communication interface 1500.
  • the input/output interface 1600 is an interface for connecting the input/output device 1650 and the computer 1000.
  • the CPU 1100 receives data from an input device such as a keyboard or a mouse via the input/output interface 1600.
  • the CPU 1100 also transmits data to an output device such as a display, a speaker or a printer via the input/output interface 1600.
  • the input/output interface 1600 may also function as a media interface that reads programs and the like recorded on a specific recording medium.
  • Examples of media include optical recording media such as DVDs (Digital Versatile Discs) and PDs (Phase change rewritable Disks), magneto-optical recording media such as MOs (Magneto-Optical Disks), tape media, magnetic recording media, and semiconductor memories.
  • optical recording media such as DVDs (Digital Versatile Discs) and PDs (Phase change rewritable Disks)
  • magneto-optical recording media such as MOs (Magneto-Optical Disks)
  • tape media magnetic recording media
  • magnetic recording media and semiconductor memories.
  • the CPU 1100 of the computer 1000 executes an information processing program loaded onto the RAM 1200 to realize the functions of the control unit 140, etc.
  • the information processing program according to the present disclosure and data in the storage unit 130 are stored in the HDD 1400.
  • the CPU 1100 reads and executes the program data 1450 from the HDD 1400, but as another example, the CPU 1100 may obtain these programs from other devices via the external network 1550.
  • each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure.
  • the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc. This distribution and integration configuration may also be performed dynamically.
  • this embodiment can be implemented as any configuration that constitutes an apparatus or system, such as a processor as a system LSI (Large Scale Integration), a module that uses multiple processors, a unit that uses multiple modules, a set in which a unit is further enhanced with other functions, etc. (i.e., a configuration that constitutes part of an apparatus).
  • a processor as a system LSI (Large Scale Integration)
  • module that uses multiple processors
  • a unit that uses multiple modules a set in which a unit is further enhanced with other functions, etc.
  • a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing, are both systems.
  • this embodiment can be configured as a cloud computing system in which a single function is shared and processed collaboratively by multiple devices via a network.
  • the present disclosure can also be configured as follows. (1) a first terminal device that belongs to at least one of a plurality of groups, when the first terminal device selects one of the groups to which the first terminal device belongs as a destination group, notifying the first terminal device of information regarding a second terminal device that connects to the destination group; a control unit that permits the first terminal device to view data whose disclosure scope is the connection destination group; An information processing device comprising: (2) The information processing device described in (1), wherein, when the first terminal device changes the destination group, the control unit changes the data that the first terminal device is permitted to view to the data whose disclosure range is the changed destination group.
  • the second group includes at least one of the groups;
  • the information processing device according to any one of (1) to (6), wherein the control unit, when a terminal device belonging to the same second group requests connection to the group included in the second group, allows the terminal device to connect to the group.
  • the control unit when a connection request is made from a terminal device belonging to the group for which a connection range is set, the control unit allows the terminal device to connect to the group.
  • a first terminal device that belongs to at least one of a plurality of groups, when the first terminal device selects one of the groups to which the first terminal device belongs as a destination group, notifying the first terminal device of information regarding a second terminal device that connects to the destination group; permitting the first terminal device to view data whose disclosure scope is the connection destination group; 4.
  • An information processing method comprising: (17) a first terminal device that belongs to at least one of a plurality of groups, when the first terminal device selects one of the groups to which the first terminal device belongs as a destination group, notifying the first terminal device of information regarding a second terminal device that connects to the destination group; permitting the first terminal device to view data whose disclosure scope is the connection destination group;
  • a non-transitory computer-readable storage medium that stores a program that causes a computer to execute the above-mentioned operations.
  • REFERENCE SIGNS LIST 10 Information processing device 12 Display 20 Network 30 Server device 40 Management device 110, 310, 410 Communication unit 120 Input/output unit 121 Camera 122 Microphone 123 Sensor 124 Touch panel display 125 Display 126 Speaker 130, 320, 420 Memory unit 140, 330, 430 Control unit 141, 331, 431 Data transmission unit 142, 332, 432 Data reception unit 143 Sensor control unit 144 Video control unit 145 Audio control unit 148 Statistical processing unit 149 Connection processing unit 333 Device registration unit 334 Matching unit 335 Document management unit 336 Status presentation unit 433 Registration request unit 434 Document management unit

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Telephonic Communication Services (AREA)
PCT/JP2024/003919 2023-02-14 2024-02-06 情報処理装置、情報処理方法及びコンピュータ読み取り可能な非一時的記憶媒体 Ceased WO2024171898A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2025501081A JPWO2024171898A1 (https=) 2023-02-14 2024-02-06

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2023020579 2023-02-14
JP2023-020579 2023-02-14

Publications (1)

Publication Number Publication Date
WO2024171898A1 true WO2024171898A1 (ja) 2024-08-22

Family

ID=92421608

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2024/003919 Ceased WO2024171898A1 (ja) 2023-02-14 2024-02-06 情報処理装置、情報処理方法及びコンピュータ読み取り可能な非一時的記憶媒体

Country Status (2)

Country Link
JP (1) JPWO2024171898A1 (https=)
WO (1) WO2024171898A1 (https=)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005311527A (ja) * 2004-04-19 2005-11-04 Hitachi Ltd グループ通信システム、グループ通信システムの制御方法、情報処理装置、及びプログラム
JP2013029922A (ja) * 2011-07-27 2013-02-07 Canon Marketing Japan Inc 情報処理装置、制御方法およびプログラム
JP2013161481A (ja) * 2012-02-01 2013-08-19 Nhn Corp クラウドサーバとの双方向連動によってファイル共有を提供するグループメッセージングシステム、方法及びコンピュータ読み取り可能な記録媒体
JP2017211777A (ja) * 2016-05-24 2017-11-30 株式会社リコー 情報処理装置、情報処理プログラム、および情報処理システム
JP2017219906A (ja) * 2016-06-03 2017-12-14 株式会社リコー 情報処理装置、プログラム及びファイル共有方法
WO2022071340A1 (ja) * 2020-09-30 2022-04-07 ｊｉｎｊｅｒ株式会社 コミュニケーションシステム、コミュニケーション方法、及びコミュニケーションプログラム

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005311527A (ja) * 2004-04-19 2005-11-04 Hitachi Ltd グループ通信システム、グループ通信システムの制御方法、情報処理装置、及びプログラム
JP2013029922A (ja) * 2011-07-27 2013-02-07 Canon Marketing Japan Inc 情報処理装置、制御方法およびプログラム
JP2013161481A (ja) * 2012-02-01 2013-08-19 Nhn Corp クラウドサーバとの双方向連動によってファイル共有を提供するグループメッセージングシステム、方法及びコンピュータ読み取り可能な記録媒体
JP2017211777A (ja) * 2016-05-24 2017-11-30 株式会社リコー 情報処理装置、情報処理プログラム、および情報処理システム
JP2017219906A (ja) * 2016-06-03 2017-12-14 株式会社リコー 情報処理装置、プログラム及びファイル共有方法
WO2022071340A1 (ja) * 2020-09-30 2022-04-07 ｊｉｎｊｅｒ株式会社 コミュニケーションシステム、コミュニケーション方法、及びコミュニケーションプログラム

Also Published As

Publication number Publication date
JPWO2024171898A1 (https=) 2024-08-22

Similar Documents

Publication Publication Date Title
JP7632952B2 (ja) グループベースのコミュニケーションシステムにおけるアンビエントでアドホックなマルチメディアコラボレーション
US9661274B2 (en) Information processing system, information processing method, and program
US10417444B2 (en) Information processing system, service providing apparatus and method, information processing apparatus and method, recording medium, and program
US8861377B2 (en) Transmission management system, program, computer readable information recording medium, program providing system, and maintenance system
US20070005809A1 (en) Network information processing system and network information processing method
EP2624165A1 (en) Live representation of users within online systems
EP3131257B1 (en) Program, information processing apparatus, and information processing system for use in an electronic conference system
KR20120118019A (ko) 공간 통신 환경을 위한 웹 브라우저 인터페이스
JP2004171526A (ja) 遠隔会議システム及び遠隔会議支援方法、並びにコンピュータ・プログラム
US20240205367A1 (en) Multi-Device Teleconferences
JP7272097B2 (ja) 通信システム、端末装置、通信方法、プログラム
KR101720778B1 (ko) 클라우드 시스템 및 클라우드 시스템에서 컨텐츠를 디스플레이하는 방법
JP7135766B2 (ja) 通信システム、プログラム、端末装置
US9185144B2 (en) Apparatus, system, and method of managing data transmission, and recording medium storing transmission management program
JP2023048138A (ja) 仮想ミーティングセッションにおいてコンテントを配布する為の、コンピュータに実装された方法、コンピュータシステム、及びコンピュータ・プログラム
JP2006244504A (ja) 会議セッション向けの文書交換セッションを提供するシステム、オーディオ／ビデオ会議セッションを支援する文書交換装置、および会議セッション中に文書を交換する方法、該方法を実行する、または実行を支援するように適応された装置読み取り可能な命令の組を含む媒体または波形
WO2024171898A1 (ja) 情報処理装置、情報処理方法及びコンピュータ読み取り可能な非一時的記憶媒体
JP5587803B2 (ja) ネットワーク対応型の集合住宅用インターホンシステム
JP6464696B2 (ja) 制御システム、通信システム、制御方法、及びプログラム
WO2023153137A1 (ja) 情報処理装置、情報処理方法、記録媒体、サーバ装置
JP5830713B2 (ja) ネットワーク対応型の集合住宅用インターホンシステム
JP6954068B2 (ja) 通信端末、通信システム、発信方法、及びプログラム
JP5853198B2 (ja) ネットワーク対応型の集合住宅用インターホンシステム
JP2025181953A (ja) コミュニケーション支援システム及びプログラム
JP2016123011A (ja) 管理システム、通信端末、通信システム、管理方法、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24756746

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2025501081

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 24756746

Country of ref document: EP

Kind code of ref document: A1