JP7292765B1 - Communication controller and computer program - Google Patents

Abstract

An object of the present invention is to improve communication between a person who is actually located in a specific place (for example, an office) and a person who is trying to communicate via a network. A communication unit that communicates with another device via a network, and a space terminal that is installed in a space at a predetermined position. the video and the audio are not transmitted to the user terminal of the user in the first state, and the video and audio are transmitted to the user terminal of the user in the second state with respect to the space. and a control unit for transmitting. [Selection drawing] Fig. 1

Description

Article 30, Paragraph 2 of the Patent Act applies Kentaro Takashima, Yuya Murao, Keishiro Masuda, and Yukina Shibata will attend the 26th General Incorporated At the online venue for interactive presentation 3 of the Information Processing Society of Japan symposium INTERACTION 2022, the communication control device and computer program were released online.

Application of Article 30, Paragraph 2 of the Patent Law Kentaro Takashima, Yuya Murao, Keishiro Masuda, and Yukina Shibata, on March 31, 2022, posted a patent at the website address: http://jaist. ac. jp/~ktaka/lab/? on p=196 published a communication controller and a computer program.

Article 30, paragraph 2 of the Patent Act applies Seiwa Business Co., Ltd. held the 9th Work Style Reform EXPO 2022 at Tokyo Big Sight, 3-11-1 Ariake, Koto-ku, Tokyo on May 11, 2022. , published a communication control device and a computer program.

The present invention relates to technology for realizing online communication.

In recent years, due to the spread of remote work, there are more opportunities to work without going to work. Eliminating the need for commuting has produced positive effects, such as being able to use the time equivalent to commuting time for other things. In order to further increase the spread of such remote work, many techniques for holding conferences via networks have been proposed. For example, a technology has been proposed that enables a remote conference with a sense of reality like an actual conference (see Patent Literature 1).

JP 2022-054192 A

However, opportunities for communication with others, which was conventionally taken for granted in the workplace, are decreasing. For example, opportunities for communication between people who are actually at work and those who are working remotely are decreasing.

In view of the above circumstances, the present invention makes it possible to improve communication between a person who is actually located in a specific place (for example, a workplace) and a person who is trying to communicate via a network. The purpose is to provide technology.

According to one aspect of the present invention, a communication unit that communicates with another device via a network, and a space terminal that is installed in a space at a predetermined position receives video and audio captured via the network, The video and the audio are not transmitted to the user terminal of the user who is in the first state with respect to the space, and the video and the above are transmitted to the user terminal of the user who is in the second state with respect to the space. and a control unit that transmits voice.

According to one aspect of the present invention, a computer having a communication unit that communicates with another device via a network transmits video and audio captured by a space terminal installed in a space at a predetermined position via a network. receive and transmit the video to the user terminal of the user who is in the first state with respect to the space, but not the audio, and to the user terminal of the user who is in the second state with respect to the space A computer program for functioning as a communication control device having a control unit that transmits the video and the audio.

The present invention makes it possible to improve communication between a person who is actually located at a specific place (eg, workplace) and a person who is trying to communicate via a network.

1 is a system configuration diagram showing a specific example of a communication system 100 of the present invention; FIG. 2 is a schematic block diagram showing a specific example of the functional configuration of the user terminal 10; FIG. 2 is a schematic block diagram showing a specific example of the functional configuration of communication control device 20. FIG. 4 is a schematic block diagram showing a specific example of the functional configuration of the space terminal 40; FIG. FIG. 10 is a diagram showing a specific example of a location selection screen; FIG. 10 is a diagram showing a specific example of a space screen; A specific example of a space screen when a poke is performed in the space is shown. A specific example of the space screen when a predetermined react (react indicating a heart) is performed in the space is shown. FIG. 10 is a diagram showing a specific example of an archive screen;

Hereinafter, specific configuration examples of the present invention will be described with reference to the drawings. FIG. 1 is a system configuration diagram showing a specific example of a communication system 100 of the present invention. In the communication system 100, one or more bases called "locations" are provided. Each location is provided with one or more "spaces". Each location may be provided, for example, at a physically separate location. Each space may be provided at a shorter distance apart than the location. For example, each location may be provided in a different building, and each space may be provided in a different floor, a different room, or a different table within one location (single building). In the example of FIG. 1, two locations 30 are provided and two spaces are provided within each location 30 . One space terminal 40 is installed in each space. A plurality of space terminals 40 may be installed in one space.

A communication system 100 includes one or more user terminals 10 , a communication control device 20 , and a plurality of space terminals 40 installed in each space of each location 30 . Each device communicates data via the network 50 . The network 50 may be a network using wireless communication or a network using wired communication. Network 50 may be configured by combining a plurality of networks.

Here, the communication that takes place in the space will be explained. For each space, the user has three states, for example, "accessing" (first state), "logging in" (second state), and "away". The state of "accessing" is a state in which the user is accessing the space although he/she has not logged in to the space. The state of "login in" is a state in which the space is accessed and logged in to the space. The state of "away" is a state in which the user has not even accessed the space. For users who are "accessing", the video in that space is sent, but the audio in that space is not sent. For users who are "logged in", the video in that space is sent, and the audio in that space is also sent. Users who are "away" will not receive audio or video in that space. In this way, the data (video and audio) related to the space transmitted to each user terminal 10 is controlled according to the state of the user for that space. In the following description, users who are "accessing", "logged in", and "away from" a certain space are referred to as "access user", "login user", and "away user", respectively.

Communication between users takes place, for example, in a space. Communication that takes place in the space is between users who are actually located in the space that physically exists (hereinafter referred to as "space users") and users who have logged into the space using user terminals 10 ( This is performed by members belonging to a group that includes a login user) and a user accessing the space using the user terminal 10 (access user). The video and audio of the space user are acquired by the space terminal 40 installed at that position. The video acquired by the space terminal 40 is transmitted to the user terminals 10 of the login users and access users of the space. However, the acquired voice is transmitted only to the user terminal 10 of the logged-in user of the space, and is not transmitted to users (accessing users and leaving users) who have not logged into the space. As described above, actions performed on the space include access and login.

FIG. 2 is a schematic block diagram showing a specific example of the functional configuration of the user terminal 10. As shown in FIG. The user terminal 10 is configured using information equipment such as a smart phone, tablet, personal computer, portable game machine, stationary game machine, and dedicated equipment. The user terminal 10 includes a communication section 11 , an operation section 12 , a display section 13 , an imaging section 14 , an audio input section 15 , an audio output section 16 , a storage section 17 and a control section 18 .

The communication unit 11 is a communication device. The communication unit 11 may be configured as a network interface, for example. The communication unit 11 performs data communication with other devices via the network 50 under the control of the control unit 18 . The communication unit 11 may be a device that performs wireless communication, or may be a device that performs wired communication.

The operation unit 12 is configured using existing input devices such as a keyboard, pointing device (mouse, tablet, etc.), buttons, touch panel, and the like. The operation unit 12 is operated by the user when inputting user instructions to the user terminal 10 . The operation unit 12 may be an interface for connecting an input device to the user terminal 10 . In this case, the operation unit 12 inputs to the user terminal 10 an input signal generated according to the user's input in the input device. The operation unit 12 may be configured using a microphone and a voice recognition device. In this case, the operation unit 12 performs voice recognition of the words uttered by the user, and inputs the character string information of the recognition result to the user terminal 10 . The operation unit 12 may be configured in any way as long as it is configured to allow the user's instructions to be input to the user terminal 10 .

The display unit 13 is an image display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. The display unit 13 displays image data transmitted from the communication control device 20 . The display unit 13 may be an interface for connecting an image display device to the user terminal 10 . In this case, the display unit 13 generates a video signal for displaying image data, and outputs the video signal to an image display device connected thereto.

The imaging unit 14 is configured using a camera. The imaging unit 14 may be configured as a camera itself, or may be configured as an interface for connecting a camera as an external device to the user terminal 10 . The camera images a predetermined space according to its position. The camera is preferably provided at a position where the face of the user using the user terminal 10 can be imaged. For example, a camera may be provided so as to capture the face of the user viewing the display unit 13 . The imaging unit 14 outputs data of an image captured by the camera to the control unit 18 .

The voice input unit 15 is configured using a microphone. The voice input unit 15 may be configured as a microphone itself, or may be configured as an interface for connecting a microphone as an external device to the user terminal 10 . The microphone picks up the voice of the user who is having a conversation. The voice input unit 15 outputs voice data acquired by the microphone to the control unit 18 .

The audio output unit 16 is configured using an audio output device such as a speaker, headphones, or earphones. The audio output unit 16 may be configured as an audio output device itself, or may be configured as an interface for connecting an audio output device as an external device to the user terminal 10 . It is desirable that the audio output device output audio so that the user who is having a conversation can hear the audio. The audio output unit 16 outputs audio according to the audio signal output by the control unit 18 .

The storage unit 17 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The storage unit 17 stores data used by the control unit 18 . The storage unit 17 may function as the user information storage unit 171, for example.

The user information storage unit 171 stores information about the user who operates the user terminal 10 (hereinafter referred to as “user information”). User information may include, for example, user ID information. The user information may also include a user's handle name, user's icon data, user's attribute information, user's profile information, and user's presence information. A handle name is a name (nickname or real name) that a user uses when having a conversation in the communication system 100 . Icon data is image data used when a user converses in communication system 100 . The attribute information may include, for example, the user's age, sex, hometown, hobby, SNS application being used, and information on affiliation. Presence information is information that indicates the current status of a user. A current state may be, for example, information relating to whether the user is available to communicate with other users. More specifically, specific examples of presence information are defined such as that the user is busy, that the user is away from the desk, and that the user is ready to respond to calls from others. good too. Presence information may be configured to be freely configurable by the user.

The control unit 18 is configured using a processor such as a CPU (Central Processing Unit) and a memory. The control unit 18 functions as a display control unit 181, a space control unit 182, a conversation control unit 183, and an action control unit 184 by the processor executing programs. All or part of each function of the control unit 18 may be implemented using hardware such as an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The above program may be recorded on a computer-readable recording medium. Computer-readable recording media include portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, semiconductor storage devices (such as SSD: Solid State Drives), hard disks and semiconductor storage built into computer systems. It is a storage device such as a device. The above program may be transmitted via telecommunication lines.

The display control unit 181 receives display information from the communication control device 20 via the communication unit 11 . The display control unit 181 generates an image signal based on the acquired display information, and causes the display unit 13 to display the image signal. The display information may be, for example, image data representing the displayed image itself. In this case, it is the display information generator 233 of the communication control device 20 that generates the image data. The display information may be, for example, data needed to generate the displayed image (eg, information about participating users and video captured by the space terminal 40). In this case, the display control unit 181 generates image data to be displayed on the display unit 13 based on the display information. In this case, it is the display control unit 181 that generates the image data. The display control unit 181 also controls the display control unit 181 when the user of the own device is a logged-in user and the user of the own device has performed an operation to allow video transmission (for example, when the camera is turned on). ), the image captured by the imaging unit 14 is transmitted to the communication control device 20 . When the user of the device itself is an access user, or when the user of the device itself is a logged-in user but is not permitted to transmit an image, the display control unit 181 controls the image captured by the image capturing unit 14. The video is not transmitted to the communication control device 20.

The space control unit 182 controls spaces that are used when communication is performed via the communication control device 20 . Specifically, the space control unit 182 performs processing related to access to the space, login to the space, and leaving the space. For example, when the user instructs to access a space by operating the operation unit 12, the space control unit 182 performs processing for accessing the designated space. Specifically, space control unit 182 transmits information (including user identification information) for requesting access to the designated space to communication control device 20 . For example, when the user instructs to log in to a space by operating the operation unit 12, the space control unit 182 performs processing for logging in to the designated space. Specifically, the space control unit 182 transmits information (including user identification information) for requesting login to the specified space to the communication control device 20 .

The conversation control unit 183 controls at least a conversation with a space user of a space logged in by the user. A conversation between the user of the user terminal 10 and the space user is realized when the user of the user terminal 10 logs into one of the spaces. The conversation control unit 183 may further control conversations with other logged-in users of the space in which the user is logged in.

The conversation control unit 183 transmits, for example, voice data input from the voice input unit 15 to the communication control device 20 via the communication unit 11 . Upon receiving voice data from the communication control device 20 , the conversation control unit 183 outputs the received voice data from the voice output unit 16 . Note that the conversation control unit 183 does not transmit the voice data input from the voice input unit 15 to the communication control device 20 when the user of the own device is the access user or the away user.

The action control unit 184 controls actions that the user performs in a predetermined space or in a predetermined user. Actions performed by the user include, for example, "poke" and "react". "poke" is an action to make the target user or space aware of one's existence. When "poke" is performed, the user terminal 10 or the space terminal 40 outputs an output that has relatively less influence on the other party than "react". For example, when "poke" is performed, a short sound is output and a predetermined image is displayed on the screen. A "react" is an action to express one's emotions to a target user or space. When "react" is performed, the user terminal 10 or the space terminal 40 outputs an output that has a relatively large impact on the other party compared to "poke". For example, "react" may be provided with a plurality of types. For example, when a "heart" react is performed, a sound with a length of about several seconds to 10 seconds is output, and a plurality of heart images are displayed on the screen in a predetermined pattern. The behavior control unit 184 transmits information indicating the behavior specified by the user to the communication control device 20 .

FIG. 3 is a schematic block diagram showing a specific example of the functional configuration of the communication control device 20. As shown in FIG. The communication control device 20 is configured using an information processing device such as a personal computer or a server device, for example. The communication control device 20 includes a communication section 21 , a storage section 22 and a control section 23 .

The communication unit 21 is a communication device. The communication unit 21 may be configured as a network interface, for example. The communication unit 21 performs data communication with other devices via the network 50 under the control of the control unit 23 . The communication unit 21 may be a device that performs wireless communication, or may be a device that performs wired communication.

The storage unit 22 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. Storage unit 22 stores data used by control unit 23 . The storage unit 22 may function as a user information storage unit 221 and a space information storage unit 222, for example. The user information storage unit 221 stores information (user information) about multiple users who operate the user terminal 10 . The user information storage unit 221 may also store identification information indicating other users that the user is following in the communication system 100 . The user information storage unit 221 also stores information indicating the status of each user. The user's status is, for example, "accessing", "logging in", or "away". As information indicating the user status, the user information storage unit 171 also stores information indicating the space to be accessed in the case of "accessing", and indicates the space to be logged in in the case of "logging in". It also stores information.

The space information storage unit 222 stores information about spaces (hereinafter referred to as “space information”). Space information may include, for example, the ID of the space, the identity of the user currently accessing the space, and the identity of the user currently logged into the space.

The control unit 23 is configured using a processor such as a CPU and a memory. The control unit 23 functions as a user control unit 231, a space control unit 232, a display information generation unit 233, a conversation control unit 234, and an action control unit 235 by the processor executing programs. All or part of each function of the control unit 23 may be realized using hardware such as ASIC, PLD, FPGA, or the like. The above program may be recorded on a computer-readable recording medium. Computer-readable recording media include portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, semiconductor storage devices (such as SSD), and storage devices such as hard disks and semiconductor storage devices built into computer systems. It is a device. The above program may be transmitted via telecommunication lines.

The user control unit 231 performs control processing related to users. For example, the user control unit 231 may perform login processing (for example, authentication processing) for the user terminal 10 accessing the communication control device 20 . The user control section 231 may register the user information received from the user terminal 10 in the user information storage section 221 .

The space control unit 182 controls the state of each space of the user using the user terminal 10 . The space control unit 182 controls access, login, and leaving of the space. For example, when information for requesting access to a specified space is received from the user terminal 10, the space control unit 182 allows the user to access the specified space. In this case, the space control unit 182 records in the space information storage unit 222 that the user is accessing the designated space. For example, when information for requesting login to a specified space is received from the user terminal 10, the space control unit 182 causes the user to log in to the specified space. In this case, the space control unit 182 records in the space information storage unit 222 that this user is logging in to the specified space.

The display information generation unit 233 generates information (display information) necessary for generating images displayed on the user terminal 10 and the space terminal 40 . The display information may include, for example, information about the target space, information about the user of each user terminal 10 logging into the space, and information about the user of each user terminal 10 accessing the space.

The display information generation unit 233 receives data of images shot by each space terminal 40 via the network 50 . The display information generation unit 233 receives, via the network 50, video data captured by the user terminal 10 of each logged-in user. The display information may include video data captured by the space terminal 40 in that space. The display information may include video data captured by the user terminal 10 of the logged-in user of the space. The display information generator 233 transmits the generated display information to the user terminal 10 .

The conversation control unit 234 receives voice data from the user terminal 10 and the space terminal 40 of the logged-in user. The received audio data is data indicating ambient sounds and voices acquired by the audio input unit of each terminal. The conversation control unit 234 generates voice data to be output to the login user's user terminal 10 and the space terminal 40 (hereinafter referred to as "conversation voice data"), and controls the login user's user terminal 10 and the space terminal 40. Send conversation voice data to The conversation voice data may be, for example, voice data obtained by combining the voice input to the user terminal 10 of the logged-in user and the voice input to the space terminal 40 . By generating conversation voice data in this way, it becomes possible to achieve communication by voice conversation between each logged-in user of the space and the space user.

The behavior control unit 235 receives information indicating behavior from the user terminal 10 or the space terminal 40 . The action control unit 235 adds display and voice corresponding to the specified action (for example, “poke” and “react”) to the display information and conversation voice data of the space based on the received information indicating the action. do. When an action is performed in a space, a display or sound corresponding to the action may be transmitted to all of the user terminals 10 and space terminals 40 of the logged-in users of that space. When an action is performed for an individual user, a display or sound corresponding to the action may be transmitted to the user terminal 10 of that user. In this case, a display or sound corresponding to the action may be transmitted to the user terminal 10 of the user who performed the action.

FIG. 4 is a schematic block diagram showing a specific example of the functional configuration of the space terminal 40. As shown in FIG. The space terminal 40 is configured using an information device such as a smart phone, tablet, personal computer, stationary game machine, or dedicated device. The space terminal 40 preferably has a large image display device that allows multiple people to share and view the screen. The space terminal 40 includes a communication section 41 , an operation section 42 , a display section 43 , an imaging section 44 , an audio input section 45 , an audio output section 46 , a storage section 47 and a control section 48 . The space terminal 40 basically operates in the same manner as the user terminal 10 . The space terminal 40 differs from the user terminal 10 in that it is shared by, for example, a plurality of users (space users) and that it is used while logged into the space in which its own device is installed.

Next, screens displayed on the user terminal 10 or the space terminal 40 will be described. FIG. 5 is a diagram showing a specific example of the location selection screen. A location selection screen may be displayed on the user terminal 10 as an initial screen when logging into the communication system 100 . In the example of FIG. 5, a first location and a second location are displayed as selectable locations. A plurality of location thumbnail images 91 are displayed as images corresponding to the first location.

Each location thumbnail image 91 is an image captured by the space terminal 40 at different times. For example, each location thumbnail image 91 may be an image captured at predetermined intervals (for example, every 15 minutes, every 30 minutes, etc.). The space terminal 40 capturing the location thumbnail image 91 is the space terminal 40 installed in the space belonging to the location. For example, the location thumbnail image 91 of the first location is captured by the space terminal 40 of the first space or the space terminal 40 of the second space. All location thumbnail images 91 may be captured by the same space terminal 40 . The content of the location thumbnail image 91 (91_3) whose entirety is displayed may be changed according to the user's operation on the user terminal 10. FIG. For example, a plurality of location thumbnail images 91 displayed in a so-called revolver shape may be displayed by moving the images from top to bottom or from bottom to top according to the user's operation. By displaying in this way, it is possible to easily browse what kind of state the location (the first location in FIG. 5) was at different times. A predetermined image is displayed as the location thumbnail image 91 (91_6) of the second location.

When any one location is selected on the location selection screen, the space control unit 182 of the user terminal 10 transmits information indicating access to that location to the communication control device 20 . The space control unit 232 of the communication control device 20 may allow the user to access a predetermined initial space among spaces located at the selected location. Also, the space control unit 232 of the communication control device 20 may allow the user who has selected the location to select the space to be accessed.

When the space to be accessed by the user is determined, the display information generation unit 233 transmits the display information regarding the space to be accessed to the user terminal 10 currently accessing. The display control unit 181 of the user terminal 10 displays a screen (hereinafter referred to as "space screen") displayed when accessing the space. The space screen is transmitted to the user terminal 10 of the user who has logged in to the space, and is also transmitted to the space terminal 40 of the space and displayed on each terminal.

FIG. 6 is a diagram showing a specific example of the space screen. A space screen as shown in FIG. 6 may be displayed on the display screen 131 of the display unit 13 of the user terminal 10 . In the example of FIG. 6, the space screen displays four areas side by side.

A plurality of location thumbnail images 92 are displayed in the leftmost area of the space screen. The location thumbnail images 92 (92_1, 92_2) include location thumbnail images 92 of the location that the user is accessing and location thumbnail images 92 of other locations. By the user selecting and operating this location thumbnail image 92, the user can access the selected target location. That is, the space control unit 182 of the user terminal 10 transmits information indicating access to the selected location to the communication control device 20 in response to such an operation.

In the second area from the left of the space screen, there are "video channel" information indicating the space where communication using video and voice is taking place, and "audio channel" information indicating the space where communication using voice is taking place. Channel" information and archive information are displayed.

The third area from the left of the space screen is used as an image display area 94 . In the video display area 94, video captured by the space terminal 40 in that space is displayed as a moving image. Although network delays occur, the latest real-time video is displayed in the video display area 94 at that time. An access user and a login user can know the current situation of the space (for example, the situation of the space users located in the space) by viewing the video displayed in the video display area 94 .

In the video display area 94, thumbnail images 93 of login users who have logged in to the space may be displayed. For example, a thumbnail image 93 of the logged-in user may be displayed in a predetermined upper left area of the video display area 94 . In the example of FIG. 6, a thumbnail image 93_1 of a user whose user name is "AAA" and a thumbnail image 93_2 of a user whose user name is "BBB" are displayed.

The fourth area from the left of the space screen is used as the members area. Information of multiple users is displayed in the members area. As user information, a thumbnail image 95 of each user and the user name of each user are displayed. A poke button 96 used to "poke" the user is displayed near the user's information.

In the member's area, the information of each user of the logged-in user of this space, the access user of this space, and the absent user may be displayed. Away users include users who are accessing this space's location (e.g., accessing or logged into other spaces in the same location), users who are accessing other locations, and the communication system in the first place. 100 includes users who are not logged in.

Certain types of users may be displayed with images and characters in a manner different from other types of users. For example, logged-in users of this space, users accessing this space, and users accessing locations in this space are displayed in, for example, the first display mode), and users accessing other locations, A user who has not logged in to the communication system 100 in the first place may be displayed in the second display mode, for example. In the example of FIG. 6, the thumbnail images 95_1 to 95_3 are displayed in a display mode (first display mode) in which edges are drawn with solid lines, but the thumbnail images 95_4 to 95_5 are displayed in a display mode (second display mode) in which edges are drawn with dashed lines. display mode). The display mode may be a display mode in which the line types are different in this way, or a display mode in which the color of the lines, the thickness of the lines, the saturation, brightness, size, etc. of the thumbnail images are displayed differently. good too.

Buttons 901 for various operations may be displayed on the space screen. For example, a button for logging into the space (the space being accessed) may be displayed. Such a button for logging in may be displayed on the accessing user's space screen. For example, on the space screen of the logged-in user, a button 901_1 for turning on/off the image of the user, a button 901_2 for turning on/off the sound of the user, and a button 901_3 for turning the output of the sound on/off are displayed. Alternatively, a button 901_7 for logging out may be displayed.

For example, a button 901_4 for poke in the space may be displayed. FIG. 7 shows a specific example of a space screen when a space is poked. When the space is poked, a poke image 97 indicating that the poke has been made is displayed in the video display area 94 . The poke image 97 is not limited to the image shown in FIG. 7, and any image may be used. Also, at the timing when the poke image 97 is displayed, a sound corresponding to the poke may be output. Such sound output is performed by the conversation control unit 234, for example. That is, the sound corresponding to the poke is synthesized with the conversation voice data transmitted to the user terminal 10 and the space terminal 40 of the logged-in user of this space and transmitted.

The space screen may display information (hereinafter referred to as “log information”) regarding actions of a predetermined user such as a logged-in user. Such a display may be performed, for example, when a predetermined button (for example, Notes button 91_6) is operated. In FIG. 7, log information is displayed in the log information display area 98 . For example, information indicating that a certain user has poked or information indicating that a certain user has logged into a space may be displayed as log information.

For example, a button 901_5 for reacting to the space may be displayed. FIG. 8 shows a specific example of the space screen when a predetermined react (react indicating a heart) is performed in the space. When the space is reacted, a react image 99 indicating that the react has been performed is displayed in the video display area 94 . React image 99 need not be limited to the image shown in FIG. 8, and any image may be used. Also, at the timing when the react image 99 is displayed, a sound corresponding to the react may be output. Such sound output is performed by the conversation control unit 234, for example. That is, a sound corresponding to React is synthesized and transmitted with conversation voice data transmitted to the user terminal 10 and the space terminal 40 of the logged-in user of this space.

If a plurality of logged-in users perform the same type of reaction within a predetermined period of time (for example, within 1 second or within 5 seconds), the react images 99 corresponding to the reactions may be displayed at different image positions. . With this configuration, the react image 99 is displayed at a plurality of locations on the screen, and each user can easily determine that the react was performed by a plurality of persons. In accordance with this, it is possible to produce excitement in the space.

If a number of logged-in users equal to or greater than a predetermined threshold react within a predetermined period of time (for example, within 1 second, within 5 seconds), a special reaction image corresponding to the reaction may be displayed. For example, in the heart react shown in FIG. 8, more heart images may be displayed in a larger area (eg, the entire area) of the video display area 94 as special react images. With this configuration, a special reaction image that cannot normally be seen is displayed, and each user can easily determine that the reaction was performed by a larger number of people. In accordance with this, it is possible to produce a further excitement in the space.

FIG. 9 is a diagram showing a specific example of the archive screen. Thumbnail images of moving images or still images recorded in the past are displayed on the archive screen. Information indicating the evaluation given to the moving image or still image is displayed around each thumbnail image. For example, in the example of FIG. 9, a number indicating the number of users who have operated the heart mark is displayed in response to the user having a favorable impression operating the heart mark. A moving image or still image displayed on the archive screen may be recorded at a timing when a predetermined condition is satisfied. For example, a moving image or still image may be recorded when the number of reactions performed within a predetermined time exceeds a threshold. Also, a still image of each space image may be recorded at a predetermined cycle. Further, when the number of people appearing in the image display area 94 exceeds a predetermined threshold, the image may be recorded as a moving image or still image. These archived images may be viewable by multiple users simultaneously. In this case, for example, moving images may be played back synchronously by a plurality of users.

The access user can view the video captured by the space terminal 40 without having his/her own voice or video displayed on the space terminal 40 or the user terminal 10 of another logged-in user. At this time, the thumbnail image of the accessing user is also not displayed on the screen. Therefore, the access user can view the video captured by the space terminal 40 without showing his/her presence to other users such as the space user and the login user. However, the access user cannot hear the voice acquired by the space terminal 40 . By performing such control, it becomes possible for an access user to easily check the situation around the space. In addition, space users located around the space do not have to worry about their own voices being unwittingly obtained by access users, so they can work in the space without worry. In this way, it is possible to balance the needs of access users and the privacy of space users.

Although the embodiment of the present invention has been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and design and the like are included within the scope of the gist of the present invention.

DESCRIPTION OF SYMBOLS 100... Communication system, 10... User terminal, 20... Communication control apparatus, 30... Location, 40... Space terminal, 11... Communication part, 12... Operation part, 13... Display part, 14... Imaging part, 15... Voice input part 16... Audio output unit 17... Storage unit 171... User information storage unit 18... Control unit 181... Display control unit 182... Space control unit 183... Conversation control unit 184... Action control unit 21... Communication unit 22 Storage unit 221 User information storage unit 222 Space information storage unit 23 Control unit 231 User control unit 232 Space control unit 233 Display information generation unit 234 Conversation control Section 235 Action control section 41 Communication section 42 Operation section 43 Display section 44 Imaging section 45 Audio input section 46 Audio output section 47 Storage section 471 User information storage Part 48... Control part 481... Display control part 482... Space control part 483... Conversation control part 484... Action control part

Claims (2)

a communication unit that communicates with another device via a network;
A video and audio captured by a space terminal installed in a space, which is a predetermined position, are received via a network, and the video and audio are transmitted to the user terminal of the user who is in the first state with respect to the space. a control unit that transmits the video and the audio to the user terminal of the user who is in the second state with respect to the space;
with
The first state is a state in which the user is not logged in to the space but is accessing it, and the second state is a state in which the user accesses the space and then logs in to the space. A communication controller that is in the state of A computer equipped with a communication unit that communicates with other devices via a network,
A video and audio captured by a space terminal installed in a space, which is a predetermined position, are received via a network, and the video and audio are transmitted to the user terminal of the user who is in the first state with respect to the space. A computer program for functioning as a communication control device having a control unit that transmits the video and the audio to the user terminal of the user who is in the second state with respect to the space without transmitting the audio to the space. ,
The first state is a state in which the user is not logged in to the space but is accessing it, and the second state is a state in which the user accesses the space and then logs in to the space. A computer program that is in the state of doing .

Images