JP7194554B2 - Communication systems and programs - Google Patents

Description

The present invention relates to communication systems and programs.

For example, in Patent Document 1, a line-of-sight detection unit uses the position of the reference point of the corneal reflection image of the light source and the center position of the pupil in the photographed image captured by the photographing unit after the light emitting position of the light source is moved. It is disclosed that line-of-sight detection is performed by

JP 2014-188322 A

For example, there is a system that displays information about display contents of a display medium on a terminal. The user of the display medium and the user of the terminal communicate with each other through the display contents.
Here, for example, in a case where the user of the display medium and the user of the terminal are located apart from each other, if the user of the terminal can recognize that the user of the display medium visually recognizes the display content, the user of the terminal can It becomes easy to understand whether communication with the user of the medium is being achieved.

SUMMARY OF THE INVENTION It is an object of the present invention to make it easier for the user of a terminal to understand whether the user of the terminal and the user of the display medium are communicating with each other.

According to a first aspect of the present invention, an acquisition unit acquires line-of-sight information related to the line-of-sight of a user who uses a display medium, and content information related to display content displayed on a display unit of the display medium is acquired by a user different from that of the user. display control means for causing display on a terminal of another user; and output control means for causing the terminal to output visual information related to visual recognition of the display content by the user based on the line-of-sight information acquired by the acquisition means. The output control means is a communication system that causes the terminal to output information indicating that the display content is not viewed by the user when the display unit is not viewed by the user .
According to a second aspect of the present invention, an acquisition unit acquires line-of-sight information related to the line-of-sight of a user who uses a display medium, and content information related to the display content displayed on the display medium is acquired by another user different from the user. and output control means for causing the terminal to output trajectory information relating to the trajectory of the user's line of sight based on the line of sight information acquired by the acquisition means. is.
In the invention according to claim 3 , the display control means causes the terminal to display a related image related to the display content, and the output control means corresponds to an area of the display content visually recognized by the user. 3. The communication system according to claim 1, wherein a predetermined first image is displayed in said related image area.
The invention according to claim 4 further comprises an output device used by the user and capable of outputting voice, and establishment means for establishing voice communication with the terminal, wherein the display medium displays a picture and the 3. The communication system according to claim 1, wherein the content information is information about sentences related to the picture displayed on the display medium.
In the invention according to claim 5, the display medium is a display terminal having a display section for displaying information, and the display control means moves a predetermined second image on the display terminal. ,
3. The communication system according to claim 2 , wherein the output control means causes the terminal to display the trajectory of the movement of the second image, and causes the terminal to display the trajectory information .
According to a sixth aspect of the present invention, acquisition means for acquiring line-of-sight information related to the line-of-sight of a user who uses a display medium; output control means for causing the terminal to output visual information related to visual recognition of the display content by the user based on the line-of-sight information acquired by the acquisition means; and the user in the space position information acquisition means for acquiring position information relating to the position of the user, an output device capable of outputting voice used by the user, and establishment means for establishing voice communication with the terminal , wherein the output control means is 2. A communication system characterized by outputting to said terminal information relating to said position information acquired by said position information acquiring means.
According to a seventh aspect of the invention, a computer has an acquisition function for acquiring line-of-sight information related to the line-of-sight of a user who uses a display medium, and content information related to display content displayed on a display unit of the display medium is acquired by the user. A function to display on a terminal of another user different from the display, a function to output visual information related to visual recognition of the display content by the user based on the line-of-sight information acquired by the acquisition function, and the display and a function of causing the terminal to output information indicating that the display content is not being viewed by the user when the user is not viewing the part .
According to an eighth aspect of the present invention, a computer has an acquisition function for acquiring line-of-sight information related to the line-of-sight of a user who uses a display medium, and content information related to display content displayed on the display medium is acquired by a computer different from that of the user. A program for realizing a function of displaying on a terminal of another user and a function of outputting trajectory information related to the trajectory of the user's line of sight to the terminal based on the line of sight information acquired by the acquisition function. is.
The invention according to claim 9, wherein the display medium is a display terminal having a display unit for displaying information, and a function of causing a computer to move a predetermined second image on the display terminal; 9. The program according to claim 8, further realizing a function of displaying a trajectory of movement of said second image on said terminal and displaying said trajectory information on said terminal.
According to a tenth aspect of the invention, a computer has an acquisition function for acquiring line-of-sight information related to the line-of-sight of a user who uses a display medium, and content information related to the display content displayed on the display medium is acquired by a computer different from that of the user. a function of causing a terminal of another user to display; a function of causing the terminal to output visual information related to visual recognition of the display content by the user based on the line-of-sight information acquired by the acquisition function; A function of acquiring location information related to a location, an output device used by the user and capable of outputting voice, a function of establishing voice communication with the terminal, and a function of causing the terminal to output information related to the location information; It is a program to realize

According to the present invention, it is possible to make it easier for the user of the terminal to understand whether the user of the terminal and the user of the display medium are communicating with each other.

BRIEF DESCRIPTION OF THE DRAWINGS It is a figure which shows the whole structural example of the story-telling support system which concerns on this embodiment. 3 is a diagram illustrating an example hardware configuration of a management server, a requesting user's terminal, and a requested user's terminal; FIG. It is the figure which showed the functional structural example of a management server. FIG. 4 is a sequence diagram of the storytelling support system; FIG. 10 is a diagram showing an example of an image displayed on the terminal of the requesting user and an example of the image displayed on the terminal of the requested user; FIG. 10 is a diagram showing an example of an image displayed on the terminal of the requesting user and an example of the image displayed on the terminal of the requested user; FIG. 10 is a diagram showing an example of an image displayed on the terminal of the requesting user and an example of the image displayed on the terminal of the requested user; It is the flowchart which showed the flow of the process of the management server during reading of a picture book. It is the figure which showed the story-telling support system as a modification. It is the figure which showed an example of the picture book information management table. FIG. 10 is a diagram showing a display example of a picture book opened during reading and an image on the requested user's terminal;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
<Configuration of story-telling support system>
FIG. 1 is a diagram showing an example of the overall configuration of a storytelling support system 1 according to this embodiment.
A story-telling support system 1 according to the present embodiment is a communication system that supports story-telling of picture books by providing picture book information.

The storytelling support system 1 includes a management server 10 , a terminal 20 , a terminal 30 and a video camera 40 . The management server 10 and terminal 20, the management server 10 and terminal 30, and the management server 10 and video camera 40 are connected via a network.
The management server 10 provides information about pictures in picture books and information about sentences in picture books. Specifically, the management server 10 receives an application for use of the storytelling support system 1 from the terminal 20 . In addition, the management server 10 accepts an invitation from the terminal 30 to join the user group of the storytelling support system 1 . Then, when the terminal 30 accepts the request from the terminal 20 to read the picture book, the management server 10 transmits information about the pictures in the picture book to the terminal 20, and transmits information about the text of the picture book to the terminal 30. Send to In this embodiment, the user who requests the reading of the picture book is called the requesting user, and the user who is requested to read the picture is called the requested user. Note that when the requesting user and the requested user are not distinguished from each other, they are simply referred to as users.

The management server 10 is implemented by, for example, a computer. The management server 10 may be configured by a single computer, or may be implemented by distributed processing by a plurality of computers.

The terminal 20 is a terminal possessed by the requesting user.
The requesting user's terminal 20 includes an image display unit 21 and a camera 22 .
The image display unit 21 displays images. The camera 22 photographs a subject within the photographing area. The camera 22 is provided so that the requesting user enters the shooting area when the requesting user is visually recognizing the display content displayed on the requesting user's terminal 20 . The terminal 20 of the requesting user has a function of transmitting the video captured by the camera 22 to the management server 10 via the network.

The terminal 30 is a terminal possessed by the requested user.
The requested user's terminal 30 includes an image display unit 31 and a camera 32 .
The requested user's terminal 30 has the same configuration as the requesting user's terminal 20 .

For the terminal 20 of the requesting user and the terminal 30 of the requested user, a device that can be carried by the user, such as a mobile phone such as a smart phone, or a portable terminal device such as a tablet-type terminal, can be used. Note that the terminal 20 of the requesting user and the terminal 30 of the requested user may be realized by, for example, a computer or other information processing device.
The terminal 20 of the requesting user and the terminal 30 of the requested user according to the present embodiment are provided with touch panels, and the user touches the screen to operate and instruct the image displayed on the screen.

A video camera 40 photographs the interior of the space 50 . A space 50 is a space in which the requesting user exists when the picture book is read aloud. The space 50 may be, for example, a room where the requesting user lives.
The video camera 40 of this embodiment has a function of transmitting captured moving images to the management server 10 via the network.

If the network used for the connection between the management server 10 and the terminal 20, the connection between the management server 10 and the terminal 30, and the connection between the management server 10 and the video camera 40 is capable of transmitting and receiving data, the type is particularly For example, the Internet, LAN (Local Area Network), WAN (Wide Area Network), etc. may be used. A communication line used for data communication may be wired or wireless. Further, the configuration may be such that each device is connected via a plurality of networks or communication lines.

<Hardware configuration example>
FIG. 2 is a diagram showing a hardware configuration example of the management server 10, the requesting user's terminal 20, and the requested user's terminal 30. As shown in FIG.
As shown in FIG. 2, the management server 10, the terminal 20 of the requesting user, and the terminal 30 of the requested user are provided with a CPU (Central Processing Unit) 100a, which is computing means, and a memory 100c, which is main storage means. Each device also includes, as external devices, a magnetic disk device (HDD: Hard Disk Drive) 100g, a network interface 100f, a display mechanism 100d, an audio mechanism 100h, and an input device 100i such as a keyboard and mouse.

The memory 100c and the display mechanism 100d are connected to the CPU 100a via the system controller 100b. Also, the network interface 100f, the magnetic disk device 100g, the audio mechanism 100h and the input device 100i are connected to the system controller 100b via the bridge controller 100e. Each component is connected by various buses such as a system bus and an input/output bus.

A program for realizing each function is stored in the magnetic disk device 100g. Various functions are realized by loading this program into the memory 100c and executing processing based on this program by the CPU 100a.

<Functional configuration of management server>
Next, the functional configuration of the management server 10 will be described.
FIG. 3 is a diagram showing a functional configuration example of the management server 10. As shown in FIG.
The management server 10 includes a transmission/reception unit 11, a usage reception unit 12, a user management unit 13, a request reception unit 14, a communication control unit 15, an information management unit 16, a line-of-sight detection unit 17, and a position detection unit. 18 and an output content management unit 19 .

The transmitting/receiving unit 11 is a network interface for connecting with the terminal 20 of the requesting user, the terminal 30 of the requested user, and the video camera 40 via the network. As a result, the management server 10 exchanges data with the terminal 20 of the requesting user, the terminal 30 of the requested user, and the video camera 40 .

The usage accepting unit 12 accepts an application for using the storytelling support system 1 from the terminal 20 of the requesting user. Upon receiving a request for use from the terminal 20 of the requesting user, the usage reception unit 12 assigns a login ID to the terminal 20 of the requesting user and receives registration of a personal identification number from the terminal 20 of the requesting user. Then, use of the story-telling support system 1 by the terminal 20 of the requesting user whose login ID and password have been entered is permitted, and a user group of the story-telling support system 1 is created in which the requesting user who is permitted to use is a member of the group. do.

In addition, the usage reception unit 12 determines the requested user to be added to the usage group of the storytelling support system 1 . Specifically, the usage accepting unit 12 accepts designation of a user to be invited to the usage group from the terminal 20 of the requesting user. The designation of the user is performed by, for example, inputting the e-mail address of the user to be invited into the requesting user's terminal 20 . Then, the terminal 30 of the user designated as the requesting user is notified of an invitation to join the user group of the storytelling support system 1 . When the user's terminal 30 accepts the invitation to join the user group, the user reception unit 12 adds the user to the user group of the storytelling support system 1 as a requested user. The usage reception unit 12 transmits user information about each user in the usage group to the user management unit 13 in a format that allows identification of whether each user is a requesting user or a requested user.

The user management unit 13 manages users of the storytelling support system 1 . Specifically, the user management unit 13 associates and stores the requesting user and the requested user in each user group of the storytelling support system 1 .

The request receiving unit 14 receives a request for the requested user to read a picture book from the requesting user's terminal 20 . Specifically, the request receiving unit 14 receives a reading request from the requesting user by designating one of the requested users stored in association with the requesting user in the user management unit 13. Accepted from the terminal 20 . Upon receiving the request for story-telling, the request receiving unit 14 notifies the terminal 30 of the specified requested user that the requesting user has requested the story-telling. When the request for reading is accepted by the terminal 30 of the requested user, the request receiving unit 14 notifies the terminal 20 of the requesting user that the request for reading is accepted. Furthermore, it transmits to the communication control unit 15 start information indicating that the story-telling of the picture book is started. Furthermore, the terminal 20 of the requesting user accepts selection of a picture book to be read to the requested user from among a plurality of kinds of picture books. Then, the picture book information about the selected picture book is transmitted to the output content management unit 19 .

When the communication control unit 15 acquires the start information from the request reception unit 14, the communication control unit 15 establishes voice communication between the terminal 20 of the requesting user and the terminal 30 of the requested user. For voice communication, for example, a P2P (Peer to Peer) communication method or a VoIP (Voice over Internet Protocol) communication method is used.
Further, when the start information is acquired, the communication control unit 15 transmits a photographing instruction to the requesting user's terminal 20 via the transmitting/receiving unit 11, and causes the camera 22 of the requesting user's terminal 20 to start photographing.

The information management unit 16 stores information on a plurality of types of picture books. For example, the information management unit 16 stores pictures in picture books as image data, and stores sentences in picture books as text data. Further, the information management unit 16 associates and stores pictures and sentences corresponding to each page of the picture book. Picture books stored as image data are hereinafter referred to as picture information. Also, the sentences of the picture book stored as text data are referred to as sentence information.
The information management unit 16 also stores images displayed on the terminal 20 of the requesting user and the terminal 30 of the requested user during the reading of the picture book.

The line-of-sight detection unit 17 detects the line of sight of the requesting user. The line-of-sight detection unit 17 acquires, via the transmission/reception unit 11 , the moving image captured by the camera 22 of the terminal 20 of the requesting user. The line-of-sight detection unit 17 analyzes the acquired moving image and detects the requesting user's line of sight from the requesting user's eyes appearing in the moving image. Specifically, it detects whether or not the requesting user is visually recognizing the image display section 21 of the requesting user's terminal 20, and the area of the image display section 21 that is visually recognizable by the requesting user. The line-of-sight detection unit 17 detects the line of sight of the requesting user, for example, based on the positional relationship between the inner corner of the eye and the iris of the requesting user. Then, the detection result is transmitted to the output content management unit 19 as line-of-sight information regarding the user's line of sight.

The position detection unit 18 detects the position of the requesting user in the space 50 . The position detection unit 18 acquires the moving image captured by the video camera 40 via the transmission/reception unit 11 . The position detection unit 18 detects the position of the requesting user in the space 50 by analyzing the acquired moving image and identifying the requesting user appearing in the moving image. The position detection unit 18 identifies the requesting user, for example, based on the brightness, saturation, hue, etc. of the moving image. Then, the detection result is transmitted to the output content management unit 19 as the positional information regarding the position of the requesting user in the space 50 .

When the picture book information is acquired from the request receiving unit 14, the output content managing unit 19 transmits the picture information specified based on the picture book information among the picture information stored in the information managing unit 16 to the terminal 20 of the requesting user. do. Specifically, the output content management unit 19 identifies one picture book among the plurality of types of picture books stored in the information management unit 16 from the picture book information. Then, the picture information corresponding to the first page of the specified picture book is displayed on the image display section 21 of the terminal 20 of the requesting user.
In addition, the output content management unit 19 transmits text information specified based on the picture book information among the text information stored in the information management unit 16 to the terminal 30 of the requested user. Specifically, the output content management unit 19 causes the image display unit 31 of the requested user's terminal 30 to display text information corresponding to the first page of the picture book specified from the picture book information. In other words, text information stored in association with pictorial information to be displayed on the terminal 20 of the requesting user is displayed on the terminal 30 of the requested user. The text information displayed on the requested user's terminal 30 can be regarded as content information related to the display content displayed on the requesting user's terminal 20 . In addition, the output content management unit 19 causes the terminal 30 of the requested user to display the pictorial information displayed on the terminal 20 of the requesting user. The pictorial information displayed on the requested user's terminal 30 is regarded as content information related to the display content displayed on the requesting user's terminal 20 .

Further, when the line-of-sight information is acquired from the line-of-sight detection section 17, the output content management section 19 causes the terminal 30 of the requested user to output information about the line-of-sight information. Based on the acquired line-of-sight information, the output content management unit 19 determines whether or not the pictorial information displayed on the image display unit 21 of the requesting user's terminal 20 is visually recognized by the requesting user, and determines whether the image information is displayed on the image display unit 21. The area visually recognized by the requesting user is specified in the displayed picture information. When the output content management unit 19 identifies that the pictorial information displayed on the image display unit 21 is not viewed by the requesting user, the output content management unit 19 outputs information indicating that the requesting user has not viewed the pictorial information to the requested user. Output to the terminal 30 of the user. Further, when it is specified that the picture information is being viewed by the requesting user, the requested user's terminal 30 is caused to output information indicating that the requesting user is viewing the picture information. Note that the output content management unit 19 can be regarded as acquisition means for acquiring line-of-sight information.
Further, when the position information is acquired from the position detection unit 18, the output content management unit 19 causes the terminal 30 of the requested user to output information about the position information.

<Operational example of reading support system>
Next, an operation example of the storytelling support system 1 of the present embodiment will be described.
FIG. 4 is a sequence diagram of the storytelling support system 1. As shown in FIG.
As shown in FIG. 4, the requesting user uses the requesting user's terminal 20 to apply for use of the storytelling support system 1 (S101).
The usage acceptance unit 12 of the management server 10 accepts a usage application from the requesting user's terminal 20, and permits the requesting user to use the reading support system 1 (S102). Also, the terminal 20 of the requesting user is made to designate a user to be invited to the user group of the reading support system 1 (S103).

The requesting user designates a user to be invited to the user group (S104).
The usage reception unit 12 of the management server 10 notifies the terminal 30 of the requested user designated as the requesting user of the invitation to the usage group (S105).
The requested user accepts the invitation to the usage group using the requested user's terminal 30 (S106).
The usage reception unit 12 of the management server 10 notifies the terminal 20 of the requesting user that the invitation to the usage group of the requested user has been accepted (S107).

The requesting user makes a request to read aloud by designating the requested user (S108).
The request receiving unit 14 of the management server 10 notifies the terminal 30 of the requested user of the request for reading (S109).
The requested user accepts the request for reading (S110).

The communication control unit 15 of the management server 10 establishes voice communication between the terminal 20 of the requesting user and the terminal 30 of the requested user (S111).
The request receiving unit 14 of the management server 10 causes the terminal 20 of the requesting user to select a picture book that the requesting user wishes to read aloud (S112).
The requesting user selects a picture book to be read to the requested user from the picture books displayed on the image display unit 21 of the requesting user's terminal 20 (S113).

The output content management unit 19 of the management server 10 transmits the picture information corresponding to the first page of the picture book selected by the requesting user, among the picture information stored in the information management unit 16, to the terminal 20 of the requesting user. (S114). Also, the text information corresponding to the first page of the picture book selected by the requesting user is transmitted to the requested user's terminal 30 (S115).
As a result, the pictorial information is displayed on the image display section 21 of the terminal 20 of the requesting user (S116). Text information is displayed on the image display section 31 of the requested user's terminal 30 (S117).

As a result, the requested user starts reading the picture book to the requesting user. By using the story-telling support system 1 of the present embodiment, for example, even if the grandchild (an example of the requesting user) and the grandparents of the grandchild (an example of the requested user) live in places separated from each other , grandparents can communicate with their grandchildren. Also, for example, parents of grandchildren can ask their grandparents to read picture books to them, so that the time required for reading picture books can be used for other tasks such as preparing dinner. can.

<Example of image display during reading>
Next, display examples of an image displayed on the image display unit 21 of the requesting user's terminal 20 and an image displayed on the image display unit 31 of the requested user's terminal 30 during the reading of the picture book will be described. A case will be described below where "Mr. B" who is the requested user reads a picture book to "Mr. A" who is the requesting user.
5 to 7 are diagrams showing display examples of images on the terminal 20 of the requesting user and examples of display of images on the terminal 30 of the requested user.

As shown in FIG. 5, the image display section 21 of the terminal 20 of the requesting user displays a captured image 51 captured by the camera 32 of the terminal 30 of the requested user. In the illustrated example, the captured image 51 shows the requested user.
A picture screen 52 is displayed on the image display section 21 . A picture 53 is displayed on the picture screen 52 .

A text screen 71 is displayed on the image display section 31 of the requested user's terminal 30 . A sentence 72 is displayed on the sentence screen 71 . This text 72 is text information stored in the information management unit 16 in association with the picture 53 displayed on the terminal 20 of the requesting user.

Also, voice communication is performed between the terminal 20 of the requesting user and the terminal 30 of the requested user. When the requested user reads the text 72 displayed on the requested user's terminal 30 into the microphone (not shown) of the requested user's terminal 30, the speaker (not shown) of the requested user's terminal 20 reads: The words spoken by the requested user are output.

In the illustrated example, when the requested user reads out the sentence 72 "Miki-chan was looking for a bag." We understand that picture 53 is a picture of a girl looking for a bag. In this manner, the picture book is read aloud from the requested user to the requesting user.

A space plan view 73 is displayed on the image display section 31 of the terminal 30 of the requested user. A spatial plan view 73 is an image showing a plan view of an image in the space 50 (see FIG. 1) captured by the video camera 40 .

In addition, an absence notification section 74 is displayed on the image display section 31 . The absence notification portion 74 is an image for notifying that the requesting user is not present in the space 50 . In the illustrated example, the absence notification section 74 displays a message "*Mr. A is not in the room." The absence notification section 74 is displayed when the position detection section 18 detects that the requesting user is not shown in the video in the space 50 captured by the video camera 40 .
The requested user can prompt the requesting user to return to the space 50 by talking into the microphone (not shown) of the requested user's terminal 30 to return to the space 50 .

A picture screen 75 is displayed on the image display section 31 . A picture 76 is displayed on the picture screen 75 . This pictorial screen 75 is the same as the pictorial screen 52 displayed on the terminal 20 of the requesting user. The pictorial screen 75 is regarded as a related image related to the display content displayed on the terminal 20 of the requesting user.

In addition, a line-of-sight notifying section 77 is displayed on the image display section 31 . The line-of-sight notifying section 77 is an image for notifying that the line of sight of the requesting user is out of the pictorial screen 52 displayed on the terminal 20 of the requesting user. In the illustrated example, the line-of-sight notification unit 77 displays a message "*Mr. A is not looking at the picture." The line-of-sight notifying section 77 is displayed when the line-of-sight detection section 17 detects that the pictorial screen 52 displayed on the requesting user's terminal 20 is not visually recognized by the requesting user. Furthermore, at this time, a voice saying "I am not looking at the picture" is output from the microphone (not shown) of the terminal 30 of the requested user. Note that the out-of-line-of-sight notification unit 77 and the information of the voice "I am not looking at the picture" are regarded as visual information regarding visual recognition of the picture screen 52 by the requesting user.

A character display button 78 and a character non-display button 79 are also displayed on the image display section 31 . In the illustrated example, the character non-display button 79 is selected.

For example, when the requested user selects the character display button 78, the first character image 54 is displayed on the image display section 21 of the requesting user's terminal 20, as shown in FIG. The first character image 54 is displayed in any area of the picture screen 52 . In the illustrated example, the first character image 54 is displayed near the girl's head in the picture 53 . Also, in the illustrated example, an image simulating the requested user's face is displayed as the first character image 54 . As the first character image 54, for example, an image captured in advance by the requested user as an image to be displayed on the terminal 20 of the requesting user is used. As the first character image 54, an image taken in advance by the requesting user may be used. Further, as the first character image 54, an image of a specific character stored in the information management section 16 may be displayed.

By displaying the first character image 54 on the requesting user's terminal 20 , the requesting user's eyes can be attracted to the pictorial screen 52 . Here, it is assumed that the requesting user is visually recognizing the area X in the picture plane 52 . This area X is the area where the girl's head in the picture 53 is displayed in the picture screen 52 .

Also, the first character image 81 is displayed on the image display section 31 of the terminal 30 of the requested user. This first character image 81 is the same image as the first character image 54 displayed on the terminal 20 of the requesting user. The positional relationship between the picture 76 and the first character image 81 displayed on the requested user's terminal 30 is the same as the positional relationship between the picture 53 and the first character image 54 displayed on the requesting user's terminal 20. are the same. That is, the first character image 81 is displayed near the girl's head in the picture 76 .

A second character image 82 is also displayed on the image display section 31 . This second character image 82 is displayed in any area of the picture screen 75 . In the illustrated example, an image imitating the requesting user's face is displayed as the second character image 82 . As the second character image 82, for example, an image captured in advance by the requesting user as an image to be displayed on the terminal 30 of the requested user is used. As the second character image 82, an image previously captured by the requested user may be used. Further, as the second character image 82, an image of a specific character stored in the information management section 16 may be used.

The positional relationship between the picture 76 displayed on the requested user's terminal 30 and the second character image 82 is the position between the picture 53 displayed on the requesting user's terminal 20 and the area X visually recognized by the requesting user. Same as relationship. That is, the second character image 82 is displayed in the area of the pictorial screen 75 corresponding to the area visually recognized by the requesting user among the display contents displayed on the requesting user's terminal 20 . In the illustrated example, the second character image 82 overlaps the girl's head in the picture 76 and is displayed closer to the viewer than the girl in the drawing. Further, at this time, a voice saying "I am looking at a picture" is output from the microphone (not shown) of the terminal 30 of the requested user. The information of the second character image 82 and the voice "I am looking at the picture" are regarded as visual information regarding the visual recognition of the picture screen 52 by the requesting user.

A requesting user position image 80 is displayed on the image display section 31 . The requesting user position image 80 is an image for indicating the position of the requesting user in the space 50 . The requesting user position image 80 is displayed in a region of the spatial plan view 73 that is associated with the position of the requesting user in the space 50 . Here, the position of the requesting user is the position of the requesting user detected by the position detection unit 18 .
By visually recognizing the requesting user position image 80 , the requested user can read the picture book while grasping the position of the requesting user in the space 50 .

Further, as shown in FIG. 7, the first character image 54 displayed on the requesting user's terminal 20 moves on the picture screen 52 . This makes it possible to further attract the eye of the requesting user to the picture screen 52 . Here, it is assumed that the requesting user is visually recognizing the area X in the picture plane 52 . This area X is an area of the picture screen 52 where the girl's right hand in the picture 53 is displayed.

Also, the first character image 81 displayed on the requested user's terminal 30 moves on the picture screen 75 . Even while the first character image 81 is moving, the positional relationship between the picture 76 displayed on the requested user's terminal 30 and the first character image 81 is the same as the picture 53 displayed on the requesting user's terminal 20 . It is the same as the positional relationship with the one-character image 54 . Further, the picture screen 75 shows a first trajectory image 83 showing the trajectory of the movement of the first character image 81 . The arrow of the first trajectory image 83 indicates the moving direction of the first character image 81 . Also, the area where the circle mark of the first trajectory image 83 is displayed indicates the area where the first character image 81 is first displayed.

Also, the second character image 82 displayed on the requested user's terminal 30 moves on the picture screen 75 . Even while the second character image 82 is moving, the positional relationship between the picture 76 displayed on the requested user's terminal 30 and the second character image 82 is the same as the picture 53 displayed on the requesting user's terminal 20 and the requesting user's terminal 20 . This is the same as the positional relationship with the area X visually recognized by the user. Further, the picture screen 75 displays a second trajectory image 84 showing the trajectory of the movement of the second character image 82 . The arrow of the second trajectory image 84 indicates the moving direction of the second character image 82 . Also, the area where the circle mark of the second trajectory image 84 is displayed indicates the area where the second character image 82 is first displayed.
By visually recognizing the first trajectory image 83 and the second trajectory image 84, the requested user can recognize the relationship between the first character image 54 displayed on the terminal 20 of the requesting user and the line of sight of the requesting user. can.

<Processing of management server 10 during story-telling>
Next, processing of the management server 10 during reading of picture books will be described.
FIG. 8 is a flow chart showing the flow of processing by the management server 10 during the reading of a picture book.
First, the line-of-sight detection unit 17 determines whether or not a video has been acquired from the terminal 20 of the requesting user (S201). While the negative result continues, the line-of-sight detection unit 17 repeats the determination operation of step 201 .

On the other hand, when the line-of-sight detection unit 17 acquires the moving image, a positive result is obtained and the process proceeds to step 202 .
The line-of-sight detection unit 17 detects the line of sight of the requesting user appearing in the acquired moving image (S202). The line-of-sight detection unit 17 transmits the detection result to the output content management unit 19 as line-of-sight information.
Based on the line-of-sight information, the output content management unit 19 determines whether or not the pictorial screen 52 displayed on the requesting user's terminal 20 is being viewed by the requesting user (S203).

When a positive result is obtained, the output content management unit 19 causes the terminal 30 of the requested user to display the second character image 82 (see FIG. 6), and confirms that the requesting user is visually recognizing the pictorial screen 52. The requested user is notified that the requesting user is visually recognizing the picture in the picture book by causing the terminal 30 of the requested user to output a voice (S204).
Further, when a negative result is obtained in step 203, the output content management unit 19 causes the outside line of sight notification unit 77 (see FIG. 5) to be displayed on the requested user's terminal 30, and the requesting user displays the picture screen 52. The requested user is notified that the requesting user has not visually recognized the picture book by outputting the fact that the requested user's terminal 30 has not visually recognized the picture (S205).

As described above, in the present embodiment, the output content management unit 19 causes the terminal 30 of the requested user to output information regarding the visual recognition of the pictorial screen 52 by the requesting user based on the acquired line-of-sight information.
In this case, even when the requesting user and the requested user are located apart from each other, the requested user can recognize that the requesting user visually recognizes the pictorial screen 52 . Therefore, it becomes easy for the requested user to understand whether communication with the requesting user is being achieved.

<Modification>
Next, a modified example of the storytelling support system 1 will be described.
The display medium used by the requesting user is not limited to the terminal 20 of the requesting user.
FIG. 9 is a diagram showing a storytelling support system 1 as a modified example. In addition, the same code|symbol is used about the structure similar to the above.
A picture book 90 is provided in the storytelling support system 1 . The management server 10 and picture book 90 are connected via a network.

The picture book 90 is a book to be read aloud from the requested user to the requesting user. In the picture book 90 of the present embodiment, a picture is drawn and sentences for explaining the picture are written on each page.
A picture book 90 is attached with a plurality of identification stickers 91 , a reading device 94 and a video camera 95 .

The identification sticker 91 can be attached to and detached from the picture book 90 . In this embodiment, the requesting user attaches an identification sticker 91 to each page on the left side of the picture book 90 . An identifier 92 and an identification number 93 are displayed on the identification sticker 91 .

The identifier 92 is used to identify the page of the picture book 90 to which the identification seal 91 is attached. As the identifier 92, for example, a two-dimensional code such as a QR (Quick Response) code (registered trademark), a bar code, or the like is used.
The identification number 93 is a number that identifies the page of the picture book 90 associated with the identifier 92 . In this embodiment, the number displayed on the identification number 93 means the page number of the picture book 90 associated with the identifier 92 of the identification sticker 91 to which this identification number 93 is attached. That is, when the identification number 93 is "7" (see FIG. 9), the identifier 92 of the identification sticker 91 to which this identification number 93 is attached is associated with "page 7" of the picture book 90. FIG. The requesting user recognizes the page of the picture book 90 to which the one identification sticker 91 is attached from the identification number 93 displayed on the one identification sticker 91 .

The reader 94 reads the identifier 92 displayed on the identification sticker 91 . The reading device 94 is provided at a position where the identifier 92 attached to the picture book 90 can be read, for example. For example, a code reader is used as the reading device 94 . When the reading device 94 reads the identifier 92, the reading device 94 generates page identification information for identifying the page of the picture book 90 associated with the read identifier 92, and seal identification information for identifying the identification seal 91 to which the read identifier 92 is attached. Generate information. Then, the generated page identification information and sticker identification information are transmitted to the management server 10 .
The reading device 94 can advance and retreat with respect to the picture book 90 by moving in the direction of arrow A in the figure.

A video camera 95 shoots an object within the shooting area. The video camera 95 has a function of transmitting captured moving images to the management server 10 via the network. The video camera 95 is provided so that the requesting user enters the photographing area while the requesting user is reading the picture book 90 .

In a modified example, the usage accepting unit 12 (see FIG. 3) registers an identification sticker 91 to be attached to the picture book 90 of the requesting user upon receiving an application for usage from the terminal 20 of the requesting user. Registration of the identification sticker 91 is performed by, for example, inputting an identification ID attached to the identification sticker 91 .
Further, when the requesting user's terminal 20 is permitted to use the story-telling support system 1 , the usage accepting unit 12 transmits the information of the identification sticker 91 registered with the requesting user to the user management unit 13 .

The user management unit 13 associates and stores the requesting user and the identification sticker 91 registered with the requesting user.
When the requested user accepts the request for reading aloud from the requesting user, the request receiving unit 14 selects a picture book 90 that the requested user wants to read aloud from among a plurality of types of picture books 90 from the terminal 20 of the requesting user. accept. Then, the selection information indicating the selected picture book 90 is transmitted to the output content management section 19 .
The information management unit 16 stores information on a plurality of types of picture books 90 . The contents stored in the information management unit 16 will be detailed later.

The line-of-sight detection unit 17 acquires the moving image captured by the video camera 95 via the transmission/reception unit 11 . Then, the line of sight of the requesting user is detected from the acquired moving image, and transmitted to the output content management unit 19 as line of sight information on the line of sight of the user.

When the selection information is acquired from the request reception unit 14, the output content management unit 19 identifies the picture book 90 selected by the requesting user from the acquired selection information. The output content management unit 19 also identifies the requested user's terminal 30 to which text information is to be sent, based on the sticker identification information acquired from the reader 94 via the transmission/reception unit 11 . Specifically, when the sticker identification information is acquired, the identification sticker 91 is specified from the acquired sticker identification information, and the requesting user stored in association with the identification sticker 91 is specified in the user management unit 13. . Then, the terminal 30 of the requested user to whom the specified requesting user has requested the reading aloud to the request receiving unit 14 is set as the transmission target of the text information.

Further, when acquiring the page identification information, the output content management unit 19 identifies the page of the picture book 90 from the acquired page identification information. Then, among the text information stored in the information management unit 16, the text information of the specific page of the specific picture book 90 is displayed on the terminal 30 of the specific requested user. The process by which the output content management unit 19 displays text information of a specific page of a specific picture book 90 will be described in detail later.

<Contents stored in the information management section>
Next, the contents stored in the information management unit 16 will be described.
FIG. 10 is a diagram showing an example of the picture book information management table.
The picture book information management table shown in FIG. 10 is a table for associating and managing picture book pages and text information.

In the picture book information management table, the title of the picture book 90 is shown in "picture book". In addition, the sentences written in the picture book 90 are shown in the "sentence information". The “page” of the “text information” indicates the text written on the corresponding page of the picture book 90 . To give an example, on "pages 1-2" of "Miki-chan's Odekake", the sentence "Miki-chan at a certain house" written on pages 1-2 of the picture book 90 titled "Miki-chan's Odekake" It is shown.
Further, although illustration is omitted, for each "picture book", the "page" of the "text information" is associated with the picture information related to the picture drawn on the corresponding page of the picture book 90. FIG.

In the picture book information management table, for each "page", "sentence information" relating to sentences written on corresponding pages of the picture books 90 of the plurality of types is indicated. Therefore, even for the same "page", different "text information" is indicated for each "picture book".

<Processing of output content management section>
Processing of the output content management unit 19 will be described. When acquiring the selection information, the output content management unit 19 identifies the "picture book" indicated in the acquired selection information among the "picture books" indicated in the picture book information management table. Also, when the page identification information is acquired, the “page” including the page identified by the acquired page identification information is specified. Then, the text information indicated in the "page" of the specified "picture book" is displayed on the terminal 30 of the requested user.

<Relationship between the page of the opened picture book and the image displayed on the terminal>
Next, the relationship between the page of the picture book 90 opened during reading of the picture book 90 and the image displayed on the requested user's terminal 30 will be described. FIG. 11 is a diagram showing a display example of the picture book 90 being opened during reading and the image on the terminal 30 of the requested user.

As shown in FIG. 11, the requesting user has opened pages 3 and 4 of picture book 90 . A picture 201 of a girl is drawn on page 3 of the picture book 90, and sentences 202 for explaining the picture 201 are described. Here, it is assumed that the requesting user is visually recognizing the region X in the third page of the picture book 90 . This area X is the area where the left hand of the girl in the picture 201 is displayed in the third page of the picture book 90 .

Further, on page 3 of the picture book 90, an identification seal 91 with an identification number 93 of "3" is attached. When the identifier 92 displayed on the identification sticker 91 is read by the reading device 94 , the text screen 71 and the picture screen 75 are displayed on the requested user's terminal 30 .

A sentence 72 and a spatial plan view 73 are displayed on the sentence screen 71 . A requesting user position image 80 is also displayed in the space plan view 73 .
The text 72 displayed on the text screen 71 has the same contents as the text 202 described on page 3 of the picture book 90 .

A picture 76 , a second character image 82 and a page number 85 are displayed on the picture screen 75 .
The page number 85 indicates the page number associated with the text 72 displayed on the requested user's terminal 30 among all the pages of the picture book 90 .
The positional relationship between the picture 76 displayed on the requested user's terminal 30 and the second character image 82 is the same as that between the picture 201 displayed on the third page of the picture book 90 and the area X visually recognized by the requesting user. It is the same as the positional relationship. In the illustrated example, the second character image 82 overlaps the left hand of the girl in the picture 76 and is displayed closer to the viewer than the girl in the drawing.

At this time, voice communication is being performed between the terminal 20 of the requesting user and the terminal 30 of the requested user. When the requested user reads out the text displayed on the requested user's terminal 30 into the microphone (not shown) of the requested user's terminal 30, the requested The words read out to the requesting user are output.

For example, when the requested user reads aloud the text 72 "Today is a long-awaited outing. Miki-chan..." displayed on the text screen 71, the requesting user listens to the read-out story. , understands that the girl depicted in picture 201 of picture book 90 is about to leave. In this way, the picture book 90 is read aloud from the requested user to the requesting user.
Thus, the display medium used by the requesting user is not limited to the terminal 20 of the requesting user, and may be the picture book 90 .

In addition, although the configuration in which the reading device is attached to the picture book 90 has been described in the present embodiment, the present invention is not limited to this.
For example, the reading device may be attachable to the requesting user.

Further, in the present embodiment, it is explained that the terminal 20 of the requesting user is used to request the reading of the picture book 90, but the present invention is not limited to this.
For example, when the identifier 92 attached to the picture book 90 is read by the reading device, a request for storytelling may be transmitted to the management server 10 together with the page identification information and the sticker identification information. In this case, the requesting user does not need to perform an operation only for requesting reading aloud.

Further, the selection of the picture book 90 by the requesting user and the designation of the requested user who requests the reading may be executed by a reading device or other terminal. Furthermore, the voice transmitted from the terminal 30 of the requested user during reading may be output from a reading device capable of outputting voice or another terminal.
Further, the picture book 90 may be provided so that the requesting user can select the picture book 90 and specify the requested user who requests the reading. Further, the picture book 90 may be provided with an output device capable of outputting sound, and the sound transmitted from the requested user's terminal 30 during reading may be output from the output device of the picture book 90 .
That is, the terminal 20 of the requesting user may not be used for reading the picture book 90 .

Further, for example, the information management unit 16 may store the voice of the text related to the text information together with the text information. Then, the output content management unit 19 may cause the terminal 30 of the requested user to output the voice together with the text information. Also, instead of text information, only voice may be output to the terminal 30 of the requested user.

Also, in this embodiment, it has been described that one specific page in the picture book 90 is identified from the identifier 92, but the number of identified pages may be two or more.
Further, in the present embodiment, it has been described that text information is managed in the picture book information management table every two pages. Text information relating to less than a minute of text may be managed.

Further, in the present embodiment, the reading device is used to read the identifier 92, but for example, the terminal 20 of the requesting user may be used to read the identifier 92, and the generated information may be transmitted to the management server 10. .

In addition, in the present embodiment, it has been explained that when a user designated as a requesting user accepts an invitation to a user group, a requested user who is a target of a request to read a picture book is added, but this is not the only option. not.
For example, when a user applies for use of the story-telling support system 1 as a person who reads a picture book, the requested user who is the target of the request for story-telling may join. In this case, the requesting user may request the read aloud to the requested user outside the user group to which he/she belongs.

Further, for example, a picture 53 (see FIG. 5) and part or all of the text 72 associated with the picture 53 may be displayed on the terminal 20 of the requesting user.
Also, the message in the absence notification unit 74 (see FIG. 5) may be output by voice from the terminal 30 of the requested user. Also, this message may be output as an image and as a sound.

Further, in the present embodiment, the output content management unit 19 sets the condition for causing the terminal 30 of the requested user to display the out-of-line-of-sight notification unit 77 and to output the voice when the pictorial screen 52 is not visually recognized by the requesting user. Although it has been described that it is detected by the detection unit 17, it is not limited to this.
For example, the condition may be that the line-of-sight detection unit 17 detects that the image display unit 21 of the requesting user's terminal 20 is not visually recognized by the requesting user. Alternatively, for example, the line-of-sight detection unit 17 may detect that the terminal 20 of the requesting user is not being visually recognized by the requesting user. That is, the line-of-sight detection unit 17 may detect that a predetermined area is not visually recognized by the requesting user as a condition.
Alternatively, for example, the line-of-sight detection unit 17 may detect that a predetermined area has not been viewed by the requesting user for a predetermined period of time (for example, 5 seconds) or longer. This predetermined period is a threshold for the line-of-sight detection unit 17 to determine that the predetermined area is not visually recognized by the requesting user.

Further, when the line-of-sight detection unit 17 detects that the requesting user has visually recognized the first character image 54 (see FIG. 6) displayed on the terminal 20 of the requesting user, the terminal 30 of the requested user The one character image 81 and the second character image 82 may be superimposed and displayed. In this case, for example, the second character image 82 may be displayed so as to be positioned closer to the viewer than the first character image 81 in the figure.

Further, in the present embodiment, it has been described that the first character image 54 is displayed in any area of the picture screen 52, but the present invention is not limited to this.
For example, the first character image 54 may be displayed in either area on the picture screen 52 or the captured image 51 . That is, the first character image 54 may be displayed in any area on the image display section 21 of the terminal 20 of the requesting user.

Further, for example, when the requested user performs a so-called flick operation on the first character image 81 displayed on the requested user's terminal 30, a The first character image 54 may be moved. That is, the region where the first character image 54 is displayed on the image display unit 21 of the terminal 20 of the requesting user may be settable by the requested user. In this case, the requested user displays the first character image 54 in an area of the requesting user's terminal 20 that the requesting user wants the requesting user to see, such as the picture screen 52 displayed on the requesting user's terminal 20. can be done. In this case, the positional relationship between the picture 76 and the first character image 81 displayed on the requested user's terminal 30 is the same as the picture 53 and the first character image 54 displayed on the requesting user's terminal 20. may be the same as the positional relationship of

Further, in the present embodiment, it has been described that the picture screen 75 displayed on the image display unit 31 is the same as the picture screen 52 displayed on the terminal 20 of the requesting user, but the present invention is not limited to this. The image displayed on the image display unit 31 is not limited to the same image as the picture plane 52 as long as it is related to the picture plane 52 , such as an image similar to the picture plane 52 .

Further, in this embodiment, the positional relationship between the related image displayed on the terminal 30 of the requested user and the first character image 81 is the same as the picture 53 and the first character image 54 displayed on the terminal 20 of the requesting user. Although it has been described that it is the same as the positional relationship with , it is not limited to this. That is, the first character image 81 may be displayed in the area of the related image corresponding to the area in which the first character image 54 is displayed among the display contents displayed on the terminal 20 of the requesting user.

Further, in the present embodiment, the positional relationship between the related image displayed on the terminal 30 of the requested user and the second character image 82 is visually recognized by the requesting user and the picture 53 displayed on the terminal 20 of the requesting user. Although it has been described that the positional relationship is the same as the positional relationship with the region X where the region is located, the present invention is not limited to this. That is, the second character image 82 may be displayed in the area of the related image corresponding to the area visually recognized by the requesting user among the display contents displayed on the requesting user's terminal 20 .
In addition, without displaying the related image on the requested user's terminal 30, the requested user's terminal 30 is caused to display information about the area visually recognized by the requesting user in the image display section 21 of the requesting user's terminal 20. may

Further, in the present embodiment, the line-of-sight detection unit 17 detects the line-of-sight of the requesting user appearing in the moving image, but the present invention is not limited to this.
For example, at least one still image of the requesting user may be captured by the requesting user's terminal 20 or video camera 95 . Then, the line-of-sight detection unit 17 may detect the line of sight of the requesting user based on this still image.

Also, in the present embodiment, the position detection unit 18 detects the position of the requesting user in the space 50 shown in the moving image, but the present invention is not limited to this.
For example, at least one still image of the space 50 may be captured by the video camera 40 . Then, the position detection unit 18 may detect the position of the requesting user in the space 50 based on this still image.
In addition, images and moving images captured by the video camera 40 may be displayed on the terminal 30 of the requested user. In this case, the images and moving images captured by the video camera 40 are regarded as positional information regarding the position of the requesting user in the space 50 .

Further, in the present embodiment, an image related to a picture book is displayed on the terminal 20 of the requesting user and the terminal 30 of the requested user, but an image not related to the picture book may be displayed.

In addition, in the present embodiment, an image is displayed on a terminal operated by the user, such as the terminal 20 of the requesting user and the terminal 30 of the requested user. The image may be displayed on a display medium different from the terminal on which the user operates.

In the present embodiment, the information transmitted from the management server 10 is output to the terminal 20 of the requesting user and the terminal 30 of the requested user, thereby realizing reading a picture book. not.
For example, the terminal 20 of the requesting user and the terminal 30 of the requested user may have the function of the management server 10 . In other words, the terminal 20 of the requesting user and the terminal 30 of the requested user are connected to the transmission/reception unit 11, the usage reception unit 12, the user management unit 13, the request reception unit 14, the communication control unit 15, and the information management unit 16 of the management server 10. , line-of-sight detection unit 17, position detection unit 18, output content management unit 19, and the like.

Programs that implement the embodiments of the present invention can be stored in computer-readable recording media such as magnetic recording media (magnetic tapes, magnetic disks, etc.), optical recording media (optical disks, etc.), magneto-optical recording media, and semiconductor memories. It can be provided as stored. Moreover, it is also possible to provide using communication means, such as the internet.

Although the embodiments of the present invention have been described above, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is clear from the scope of claims that various modifications or improvements to the above embodiment are also included in the technical scope of the present invention.

DESCRIPTION OF SYMBOLS 1... Story-telling support system, 10... Management server, 11... Transmission/reception part, 12... Use reception part, 13... User management part, 14... Request reception part, 15... Communication control part, 16... Information management part, 17... Line-of-sight detection unit 18 Position detection unit 19 Output content management unit 20 Terminal 21 Image display unit 22 Camera 30 Terminal 31 Image display unit 32 Camera 40 Video camera 90...Picture book

Claims (10)

Acquisition means for acquiring line-of-sight information regarding the line of sight of a user who uses the display medium;
display control means for displaying, on a terminal of another user different from the user, content information relating to the display content displayed on the display unit of the display medium;
output control means for causing the terminal to output visual recognition information relating to visual recognition of the display content by the user based on the line-of-sight information acquired by the acquisition means;
with
The communication system , wherein the output control means causes the terminal to output information indicating that the display content is not viewed by the user when the display unit is not viewed by the user . Acquisition means for acquiring line-of-sight information regarding the line of sight of a user who uses the display medium;
Display control means for displaying content information related to display content displayed on the display medium on a terminal of another user different from the user;
output control means for causing the terminal to output trajectory information regarding the trajectory of the user's line of sight based on the line of sight information acquired by the acquisition means;
communication system with The display control means causes the terminal to display a related image related to the display content,
3. The method according to claim 1, wherein said output control means displays a predetermined first image in an area of said related image corresponding to an area visually recognized by said user among said display contents. communication system. further comprising an output device used by the user and capable of outputting voice, and establishing means for establishing voice communication with the terminal;
A picture is displayed on the display medium,
3. The communication system according to claim 1, wherein said content information is information relating to a sentence related to said picture displayed on said display medium. The display medium is a display terminal having a display unit for displaying information,
The display control means moves a predetermined second image on the display terminal,
3. The communication system according to claim 2 , wherein said output control means causes said terminal to display the locus of movement of said second image and causes said terminal to display said locus information . Acquisition means for acquiring line-of-sight information regarding the line of sight of a user who uses the display medium;
Display control means for displaying content information related to display content displayed on the display medium on a terminal of another user different from the user;
output control means for causing the terminal to output visual recognition information relating to visual recognition of the display content by the user based on the line-of-sight information acquired by the acquisition means;
a positional information obtaining means for obtaining positional information about the position of the user in space;
an output device used by the user and capable of outputting voice; an establishment means for establishing voice communication with the terminal;
with
The communication system, wherein the output control means causes the terminal to output the information related to the position information acquired by the position information acquisition means. to the computer,
an acquisition function for acquiring line-of-sight information related to the line-of-sight of a user who uses a display medium;
a function of displaying, on a terminal of another user different from the user, content information relating to the display content displayed on the display unit of the display medium;
a function of causing the terminal to output visual recognition information related to visual recognition of the display content by the user based on the line-of-sight information acquired by the acquisition function;
a function of causing the terminal to output information indicating that the display content is not being viewed by the user when the display unit is not being viewed by the user;
program to make it happen. to the computer,
an acquisition function for acquiring line-of-sight information related to the line-of-sight of a user who uses a display medium;
A function of displaying content information related to display content displayed on the display medium on a terminal of another user different from the user;
a function of causing the terminal to output trajectory information regarding the trajectory of the user's line of sight based on the line of sight information acquired by the acquisition function;
program to make it happen. The display medium is a display terminal having a display unit for displaying information,
to the computer,
a function of moving a predetermined second image on the display terminal;
a function of causing the terminal to display the trajectory of the movement of the second image and displaying the trajectory information on the terminal;
9. The program according to claim 8, for further realizing to the computer,
an acquisition function for acquiring line-of-sight information related to the line-of-sight of a user who uses a display medium;
A function of displaying content information related to display content displayed on the display medium on a terminal of another user different from the user;
a function of causing the terminal to output visual recognition information related to visual recognition of the display content by the user based on the line-of-sight information acquired by the acquisition function;
the ability to obtain location information about the user's position in space;
an output device used by the user and capable of outputting voice, and a function of establishing voice communication with the terminal;
a function of causing the terminal to output information related to the location information;
program to make it happen.

Images