JP7367909B2 - First terminal, server device, second terminal, information processing method, and program - Google Patents

Description

The present invention relates to an information system and the like having a first terminal and a second terminal that can communicate with each other.

Conventionally, there have been chat systems such as a chat system that improves screen visibility (Patent Document 1) and a chat system that takes security into consideration (Patent Document 2).

JP2017-42362A Japanese Patent Application Publication No. 2018-18482

However, in the conventional technology, it is not possible to fully grasp the state of the screen that the other party is viewing while communicating with the other party.

The first terminal of the first invention is a first terminal that can communicate with a second terminal, and includes a first receiving section that receives a first input that is an input from a first user, and a first terminal that transmits the first input. a first screen receiving section that receives screen information that is all or part of the screen information of the second terminal; and a first output section that outputs the screen information. .

With this configuration, it is possible to see the screen that the other party is viewing while communicating with the other party, so it is possible to input information to be sent to the other party while checking the situation of the other party.

In addition, the first terminal of the second invention further includes a first input receiving section that receives a second input that is an input of a second user to the second terminal, in addition to the first terminal of the first invention. One output unit is a first terminal that outputs screen information and second input.

With this configuration, it is possible to see the screen that the other party is viewing, so it is possible to communicate with the other party while checking the situation of the other party.

Furthermore, in the first terminal of the third invention, in contrast to the first or second invention, the first output section does not include predetermined information among all the information on the screen of the second terminal. This is the first terminal that outputs screen information.

With this configuration, information on the screen of the second terminal that should not be output does not need to be output on the first terminal.

Further, the first terminal of the fourth invention is a first terminal that does not transmit screen information of the first terminal, unlike any one of the first to third inventions.

With this configuration, the first user can see the screen that the second user is viewing while communicating with the second user, so the first user's privacy can be guaranteed while keeping track of the second user's situation.

Further, the first terminal of the fifth invention provides coordinates regarding the position of the pointer of the input means existing within the area of the screen information outputted by the first output unit in accordance with any one of the first to fourth inventions. The apparatus further includes a first processing section that acquires information, and the first transmitting section is a first terminal that transmits coordinate information.

With this configuration, the position of the pointer of the first user's input means can be transmitted to the second user.

Further, the server device of the sixth invention is a server device that supports communication between a first terminal and a second terminal, and is a server device that supports communication between a first terminal and a second terminal, and transmits screen information that is all or part of the screen of the second terminal to a second terminal. a server reception unit that receives from a terminal and receives a first input that is a first user's input from the first terminal; and a server transmission unit that transmits screen information to the first terminal and transmits the first input to the second terminal. This is a server device comprising a section.

With this configuration, it is possible to provide a server device that supports effective communication by showing the screen that the other party is viewing.

Further, in the server device of the seventh invention, in contrast to the sixth invention, the server receiving unit receives the second input that is the input of the second user from the second terminal, and the server transmitting unit receives the second input, which is the input of the second user, from the second terminal. This is a server device that sends input to the first terminal.

With this configuration, it is possible to provide a server device that supports effective communication by showing the screen that the other party is viewing.

In addition, in the server device of the eighth invention, in contrast to the sixth or seventh invention, the server transmitter transmits screen information that does not include predetermined information among all information on the screen of the second terminal. This is a server device that transmits the information to the first terminal.

With this configuration, information on the screen of the second terminal that should not be output does not need to be output on the first terminal.

Further, the server device of the ninth invention is different from any one of the fifth to seventh inventions in that the server transmitter does not transmit the screen information of the first terminal.

With this configuration, the first user can see the screen that the second user is viewing while communicating with the second user, so the first user's privacy can be guaranteed while keeping track of the second user's situation.

Further, the second terminal of the tenth invention is a second terminal that can communicate with the first terminal, and has a second acquisition unit that acquires screen information that is information on all or part of the screen of the second terminal. and a second transmitting section that transmits screen information, a second receiving section that receives a first input that is an input from a first user of the first terminal, and a second output section that outputs the first input. This is the second terminal.

With this configuration, screen information of the user's own screen can be transmitted to the first terminal of the communication partner.

Further, the second terminal of the eleventh invention is different from the tenth invention, further comprising a second reception unit that receives a second input that is an input from a second user to the second terminal, The transmitter is a second terminal that transmits the screen information and the second input.

With this configuration, screen information of the user's own screen can be transmitted while chatting.

Further, in the second terminal of the twelfth invention, in contrast to the tenth or eleventh invention, the second transmitter transmits predetermined information out of all the information on the screen of the second terminal. This is a second terminal that sends screen information that does not include screen information.

With this configuration, information on the screen of the second terminal that should not be output does not need to be output on the first terminal.

Further, the second terminal of the thirteenth invention is a second terminal that does not output the screen information of the first terminal, unlike any one of the tenth to twelfth inventions.

With this configuration, the first user can see the screen that the second user is viewing while communicating with the second user, so the first user's privacy can be guaranteed while keeping track of the second user's situation.

Further, the second terminal of the fourteenth invention is different from any one of the tenth to thirteenth inventions, in that the second receiving section receives the coordinate information from the first terminal, and uses the coordinate information. , further comprising a second processing section that configures a pointer, and the second output section is a second terminal that outputs the pointer.

With this configuration, the second user can know the position of the pointer of the first user's input means.

Further, the information system of the fifteenth invention is an information system comprising a first terminal and a second terminal capable of communicating, wherein the first terminal accepts a first input that is an input from a first user. a first reception unit, a first transmission unit that transmits the first input, a first screen reception unit that receives screen information that is information on all or part of the screen of the second terminal, and outputs the screen information. The second terminal includes a second acquisition unit that acquires screen information that is information about all or part of the screen of the second terminal, and a second transmission unit that transmits the screen information. The information system includes a second receiving section that receives a first input that is an input from a first user of a first terminal, and a second output section that outputs the first input.

With this configuration, it is possible to provide an information system in which the screen of the second terminal can be viewed on the first terminal.

Further, in the information system of the sixteenth invention, in contrast to the fifteenth invention, the first terminal has a first input receiving unit that receives a second input that is an input from a second user to the second terminal. The first output unit outputs the screen information and the second input, and the second terminal further includes a second reception unit that receives the second input that is input by the second user to the second terminal. The second transmitter is an information system that transmits the screen information and the second input.

With this configuration, it is possible to provide an information system in which the screen of the second terminal can be viewed on the first terminal.

Furthermore, in the information system of the seventeenth invention, in contrast to the fifteenth or sixteenth invention, the first output section outputs predetermined information from among all the information on the screen of the second terminal. This is an information system that outputs screen information that does not include screen information.

With this configuration, information on the screen of the second terminal that should not be output does not need to be output on the first terminal.

Further, the information system of the seventeenth invention is different from any one of the fifteenth to seventeenth inventions in that the second terminal does not output screen information of the first terminal.

With this configuration, the first user can see the screen that the second user is viewing while communicating with the second user, so the first user's privacy can be guaranteed while keeping track of the second user's situation.

According to the information system according to the present invention, since it is possible to see the screen that the other party is viewing, it is possible to clearly understand the situation of the other party while communicating with the other party.

Conceptual diagram of information system A in Embodiment 1 Block diagram of the information system A Flowchart explaining an example of the operation of the first terminal 1 Flowchart explaining an example of the operation of the server device 2 Flowchart explaining an example of the operation of the second terminal 3 A diagram showing an example of the screen of the second terminal 3 A diagram showing an example of the screen of the first terminal 1 A diagram showing an example of the screen of the second terminal 3 Diagram showing an example screen of the same terminal 1 Diagram showing an example screen of the same terminal 1 Overview of the computer system Block diagram of the computer system

Embodiments of the information system and the like will be described below with reference to the drawings. Note that in the embodiments, constituent elements with the same reference numerals perform similar operations, and therefore, repeated explanation may be omitted.

(Embodiment 1)

In this embodiment, an information system is provided that includes a first terminal and a second terminal that can communicate with each other, and displays all or a part of the screen of the second terminal on the first terminal, and input data to the first terminal. An information system for transmitting and outputting information to a second terminal will be described.

Further, in this embodiment, an information system including a first terminal and a second terminal capable of chatting, in which all or part of the screen of the second terminal is displayed on the first terminal, will be described.

Furthermore, in this embodiment, an information system including a server device that relays information between a first terminal and a second terminal will be described.

FIG. 1 is a conceptual diagram of an information system A in this embodiment. The information system A includes one or more first terminals 1, a server device 2, and one or more second terminals 3. Each of the one or more first terminals 1 and the server device 2 can communicate via a network such as the Internet. The server device 2 and one or more second terminals 3 can communicate via a network such as the Internet. The first terminal 1 and the second terminal 3 are, for example, a smartphone, a tablet terminal, a so-called personal computer, etc., and their types do not matter. The server device 2 is a so-called server, and may be of any type, such as a cloud server or an ASP server. The first terminal 1 and the second terminal 3 are, for example, a system for chatting. However, the message may be sent only from the first terminal 1 to the second terminal 3. The first user who is the user of the first terminal 1 may be a user who is in a position to provide information to the second user who is the user of the second terminal 3.

FIG. 2 is a block diagram of information system A in this embodiment.

The first terminal 1 includes a first storage section 11 , a first reception section 12 , a first reception section 13 , a first processing section 14 , a first output section 15 , and a first transmission section 16 . The first receiving section 13 includes a first input receiving section 131 and a first screen receiving section 132.

The server device 2 includes a server storage section 21, a server reception section 22, a server processing section 23, and a server transmission section 24.

The second terminal 3 includes a second storage section 31 , a second reception section 32 , a second reception section 33 , a second processing section 34 , a second output section 35 , and a second transmission section 36 . The second receiving section 33 includes a second input receiving section 331 . The second processing section 34 includes a second acquisition section 341.

The first storage unit 11 that constitutes the first terminal 1 stores various types of information. The various types of information include, for example, a first user identifier. The first user identifier is information that identifies the first user (here, for example, the administrator) who is the user of the first terminal 1, and is, for example, an ID. The first user identifier may be a phone number, credit card number, email address, or the like. Note that the first user identifier may be information that identifies the first terminal 1.

The first reception unit 12 receives input of instructions, information, etc. from the first user. The instructions, information, etc. are, for example, the first input. The first input is the first user's input. The content of the first input does not matter. The first input is, for example, text, but may also be an image, and the data type does not matter. The first input is, for example, text entered into a chat system. Furthermore, the first input may be, for example, a message, email, short message, or the like.

Instructions and information include, for example, coordinate information indicating the position of the pointer of an input means such as a mouse or pen on the screen, and coordinates indicating the relative position within the window of the pointer of an input means such as a mouse or pen. information, an event identifier of an event corresponding to a pressed button, an event identifier of an event corresponding to a selected menu item, etc.

The first reception unit 12 may receive the first image. The first image is an image acquired by the first terminal 1. The first image may be, for example, a video taken of the first user or a still image taken of the first user. When the first reception unit 12 receives the first image, the information system A may function as a video conference system. The video conference system is, for example, a system such as the so-called SKYPE (registered trademark).

In addition, reception here refers to the reception of information input from input devices such as keyboards, mice, touch panels, etc., reception of information transmitted via wired or wireless communication lines, optical disks, magnetic disks, semiconductor memory, etc. This concept includes receiving information read from a recording medium, taking pictures with a camera, etc.

Any input means such as a keyboard, mouse, or menu screen may be used for the first input. The first reception unit 12 may be realized by a device driver for input means such as a keyboard, control software for a menu screen, or the like.

The first receiving unit 13 receives various types of information. The various types of information include, for example, a second input, which will be described later, screen information, and a second image, which will be described later. The second image is an image acquired by the second terminal 3. The second image may be, for example, a moving image of the second user or a still image of the second user. Note that the first receiving unit 13 normally receives information from the server device 2, but may also receive information directly from the second terminal 3.

The first input receiving section 131 receives the second input. The second input is the second user's input to the second terminal 3. The content of the second input does not matter. The second input is, for example, text, but may also be an image or the like, and the data type does not matter. The second input is, for example, text entered into a chat system. Furthermore, the second input may be, for example, a message, email, short message, or the like.

The first screen receiving unit 132 receives screen information. The screen information is information about all or part of the screen of the second terminal 3. The screen information is, for example, a screenshot of the screen of the second terminal 3 or a part of the screenshot. The screen information is, for example, a screenshot of a window on the screen of the second terminal 3 or a part of the screenshot. A screenshot is the information on the screen as it is, but the data structure does not matter. It is preferable that the screen information is information on a screen that does not include predetermined information among all the information on the screen of the second terminal 3. The predetermined information is, for example, information instructed by the second terminal 3. The predetermined information is, for example, information in a window designated by the second terminal 3. The predetermined information is, for example, information managed by the server device 2. The predetermined information is, for example, the second user's personal information, such as a credit card number or bank account number, and is information that should be kept secret. The screen information may have any data structure such as HTML, XML, bitmap, etc.

The first processing unit 14 performs various processes. The various processes include, for example, a process of changing an instruction or information received by the first reception unit 12 into an instruction or information with a structure to be transmitted, or a process of changing the structure of the information received by the first reception unit 13 into an output structure. processing, etc.

Further, the various types of processing are, for example, processing that configures screen information in which part of the information received by the first screen receiving unit 132 is hidden. Hiding includes, for example, deleting, masking, etc.

Further, the various processes are, for example, processes that use inputs such as instructions and information received by the first reception unit 12 from the first user to configure auxiliary information that is information corresponding to the inputs. That is, the auxiliary information is information other than the first input, and is information acquired in response to the first user's operation. The auxiliary information includes, for example, coordinate information indicating the position of the pointer of an input means such as a mouse or pen on the screen, coordinate information indicating the relative position within the window of the pointer of an input means such as a mouse or pen, and press information. The event identifier of the event corresponding to the pressed button, the event identifier of the event corresponding to the selected menu item, etc. The auxiliary information may be a script, for example. In addition, various processes include, for example, only when a pointer of an input means such as a mouse or a pen exists within the area of screen information output by the first output unit 15, coordinates indicating the position of the pointer on the screen. This is a process of acquiring information or coordinate information indicating the relative position of the pointer within the window.

The first output unit 15 outputs the screen information received by the first screen receiving unit 132. The first output unit 15 outputs, for example, the screen information received by the first screen reception unit 132 and the second input received by the first input reception unit 131. For example, it is preferable that the first output unit 15 outputs screen information that does not include predetermined information among all the information on the screen of the second terminal 3. Note that the first output unit 15 outputting the screen information received by the first screen receiving unit 132 includes outputting part of the screen information received by the first screen receiving unit 132. You can think about it. In other words, the first output unit 15 may output screen information such that information that satisfies a predetermined condition is hidden from among the screen information received by the first screen reception unit 132. Furthermore, the information that satisfies the predetermined conditions is, for example, information in a window designated by the second terminal 3. The predetermined information is, for example, information managed by the server device 2. The predetermined information is, for example, the second user's personal information, such as a credit card number or bank account number, and is information that should be kept secret. Note that the predetermined conditions include, for example, information having a predetermined structure, information in a window identified by the window identifier of the window specified by the second terminal 3, and information in the window specified by the second terminal 3. For example, the information is in the field identified by the field identifier of the field indicated by .

Here, output usually refers to display on a display, projection using a projector, printing on a printer, sound output, transmission to an external device, storage on a recording medium, other processing devices or other programs, etc. You can think of it as a concept that includes passing processing results to.

The first transmitter 16 transmits the first input. This first input is information received by the first reception unit 12. The timing at which the first transmitter 16 transmits the first input does not matter. For example, the first transmitter 16 transmits the first input when the first receiver 12 receives an instruction from the first user. For example, when the input of the first input is confirmed, the first transmitter 16 transmits the first input. Note that, although the first transmitter 16 transmits the first input to the server device 2, for example, it may transmit the first input directly to the second terminal 3.

The first transmitter 16 is

A server storage unit 21 that constitutes the server device 2 stores various types of information. The various types of information include, for example, user information described later, chat information described later, screen information transmitted from the second terminal 3, and one or more web pages.

User information is information regarding a user, and has, for example, one or more attribute values. The user information is usually information regarding the second user who is the user of the second terminal 3. The one or more attribute values may be static attribute values or dynamic attribute values. Static attribute values are usually attribute values that do not change, but may also be considered to be attribute values that do not change from moment to moment. Static attribute values include, for example, name, age, address, telephone number, credit card number, email address, second terminal identifier, second user identifier, password, and the like. The second terminal identifier is information that identifies the second terminal 3, and is, for example, a cookie ID, a session identifier, an IP address, a MAC address, or the like. The second user identifier is information that identifies the second user, and is, for example, an ID. The first user identifier may be a phone number, credit card number, email address, or the like. A dynamic attribute value is an attribute value that can dynamically change due to a user's operation or the like. Dynamic attribute values include, for example, real-time dynamic attribute values and dynamic attribute values using historical information. A real-time dynamic attribute value is an attribute value that changes from moment to moment in real time. The real-time dynamic attribute values include, for example, the stay time of the web page currently viewed by the user, the number of web pages viewed during the current stay, and the like. The historical information-using dynamic attribute value is a dynamic attribute value that is acquired by also using the history of operation information from past visits. The dynamic attribute values using historical information include, for example, the number of purchases, the amount of purchase, the total amount of purchase, the average length of stay, the average number of PVs, and the number of visits.

The chat information is information regarding a chat (which may also be called a conversation) conducted between a first user who is a user of the first terminal 1 and a second user who is a user of the second terminal 3. Chat information includes a first input. Preferably, the chat information includes a second input. That is, the chat information includes a message sent from a first user to a second user, or a message sent from a second user to a first user. Chat information includes, for example, a user identifier that identifies the sender of the message. Chat information includes, for example, a user identifier that identifies the recipient of the message. Note that the user identifier is a first user identifier that is the user identifier of the user of the first terminal 1 or a second user identifier that is the user identifier of the user of the second terminal 3.

The web page is, for example, a web page viewed by the second user.

The server receiving unit 22 receives various types of information. The various types of information include, for example, screen information, first input, and second input.

The server reception unit 22 receives screen information from the second terminal 3. The screen information is information about all or part of the screen of the second terminal 3. The screen information that is part of the screen information is screen information that does not include predetermined information. Information that specifies predetermined information (hereinafter referred to as “specific information” as appropriate) is stored in the server storage unit 21, for example. The specific information is, for example, a specific attribute value of the user information, and is, for example, a credit card number.

Additionally, the server reception unit 22 receives a first input from the first terminal 1 . The first input is usually information input by the first user to the first terminal 1 for the second user.

It is preferable that the server receiving unit 22 receives the second input from the second terminal 3. The second input is an input to the second terminal 3 by the second user. The second input is usually information input by the second user to the second terminal 3 toward the first user.

Note that the server receiving unit 22 may receive the first image and the second image. Further, the server reception unit 22 may receive the screen information of the first terminal 1 from the first terminal 1. The screen information of the first terminal 1 is information on all or part of the screen of the first terminal 1. Further, the server reception unit 22 may receive supplementary information from the first terminal 1. Note that the auxiliary information is, for example, the above-mentioned coordinate information, event identifier, and the like.

The server processing unit 23 performs various processes. The various types of processing are, for example, processing for accumulating received information. The various types of processing are, for example, processing for configuring information to be transmitted from received information.

The various processes are, for example, a process of making predetermined information invisible from the screen information received by the server reception unit 22 from the second terminal 3 and configuring the screen information to be transmitted. For example, the server processing unit 23 acquires specific information from the server storage unit 21, processes the information specified by the specific information from among the received screen information in accordance with the specific information, and transmits the processed information. Configure screen information. The process of making the information specified by the specific information invisible is a process of deleting the information from the screen information, a process of masking the information in the screen information, or the like.

The server transmitter 24 transmits the screen information received by the server receiver 22 to the first terminal 1. The server transmitter 24 transmits the screen information configured by the server processor 23 to the first terminal 1. Note that the process of transmitting the screen information configured by the server processing unit 23 may be equated with the process of transmitting the screen information received by the server receiving unit 22.

The server transmitter 24 transmits the first input received by the server receiver 22 to the second terminal 3. Transmitting the first input received by the server receiving unit 22 may be equated with transmitting the first input configured for transmission by the server processing unit 23.

Note that it is preferable that the server transmitter 24 not transmit the screen information of the first terminal 1. When the first user of the first terminal 1 is an administrator or the like for the second user, it is preferable that the server transmitter 24 not transmit the screen information of the first terminal 1 to the second terminal 3. Further, the server transmitter 24 may transmit the auxiliary information to the second terminal 3.

Further, it is preferable that the server transmitter 24 transmits the second input received by the server receiver 22 to the first terminal 1.

Although the second terminal 3 can communicate with the first terminal 1, it is preferable not to output screen information of the first terminal 1. When the second terminal 3 does not output the screen information of the first terminal 1, it is preferable that the first terminal 1 does not transmit the screen information.

The second storage unit 31 that constitutes the second terminal 3 stores various types of information. The various types of information include, for example, a second user identifier. The second user identifier is information that identifies the second user, and is, for example, an ID. The second user identifier may be a phone number, email address, or the like. The second user identifier may be information that identifies the second terminal 3.

The second reception unit 32 receives a second input. The second input is the second user's input to the second terminal 3. The content of the second input does not matter. The second input is, for example, text, but may also be an image or the like, and the data type does not matter. Further, the second input is, for example, a message, email, short message, or the like.

The second reception unit 32 may receive the second image. The second image is an image acquired by the second terminal 3. The second image may be, for example, a moving image of the second user or a still image of the second user.

Any input means such as a keyboard, mouse, or menu screen may be used for the second input. The second reception unit 32 may be realized by a device driver for input means such as a keyboard, control software for a menu screen, or the like.

The second receiving unit 33 receives various information, instructions, and the like. The various information and instructions include, for example, a first input, a first image, and auxiliary information. Note that the second receiving unit 33 normally receives information from the server device 2, but may also receive information directly from the first terminal 1.

The second input receiving section 331 receives the first input. The first input is input by the first user of the first terminal 1.

The second processing unit 34 performs various processes. The various processes are, for example, processes performed by the second acquisition unit 341. The various processes include, for example, a process of changing instructions and information received by the second reception unit 32 into instructions and information with a structure to be transmitted, and a process of changing the structure of outputting the information received by the second reception unit 33. processing, etc.

The second processing unit 34 configures the output pointer using, for example, coordinate information that is auxiliary information. Note that the pointer is, for example, a mouse cursor. The second processing unit 34 executes, for example, a script that is auxiliary information.

The second acquisition unit 341 acquires screen information that is information about all or part of the screen of the second terminal 3. The second acquisition unit 341 takes a screenshot of the screen of the second terminal 3, for example. The second acquisition unit 341 generates, for example, a script that configures the screen of the second terminal 3. The script is, for example, XML or HTML. Note that, for example, it is suitable for the second acquisition unit 341 to acquire screen information in which predetermined information is hidden from all the information on the screen of the second terminal 3. It goes without saying that the screen information may also include, for example, pointer information of an input means such as a mouse or pen of the second terminal 3, input information to a text area other than chat, and the like. Further, the pointer information includes, for example, coordinate information indicating the position of the point, information on the shape of the pointer, and the like.

The screen information that is part of the information on the screen of the second terminal 3 is screen information that does not include predetermined information among all the information on the screen of the second terminal. The predetermined information is, for example, information set for the second terminal 3 by the second user. The predetermined information is, for example, information corresponding to a field identifier that identifies a field on the screen, and information in a window identified by a window identifier that identifies a window on the screen.

The second output section 35 outputs the first input received by the second input reception section 331. It is preferable that the second output unit 35 outputs the second input input by the second user. Further, the second output unit 35 outputs the pointer configured by the second processing unit 34. Further, the second output unit 35 may output the result of the second processing unit 34 executing the script.

The second transmitter 36 transmits the screen information acquired by the second acquirer 341. The second transmitter 36 transmits, for example, the screen information acquired by the second acquirer 341 and the second input received by the second receiver 32. Note that the timing at which the second transmitter 36 transmits the information does not matter. For example, upon receiving an instruction from the second user, the second transmitter 36 transmits the first input and/or screen information. Further, for example, the second transmitter 36 periodically transmits screen information. The second transmitter 36 transmits information to the server device 2, for example, but may also transmit information directly to the first terminal 1.

The first storage section 11, the server storage section 21, and the second storage section 31 are preferably non-volatile recording media, but may also be realized using volatile recording media.

The process by which information is stored in the first storage unit 11 or the like does not matter. For example, information may be stored in the first storage unit 11 or the like via a recording medium, or information transmitted via a communication line or the like may be stored in the first storage unit 11 or the like. Alternatively, information input via an input device may be stored in the first storage unit 11 or the like.

The first receiving section 13, first input receiving section 131, first screen receiving section 132, server receiving section 22, second receiving section 33, and second input receiving section 331 are usually realized by wireless or wired communication means. However, it may also be realized by means of receiving broadcasts.

The first processing section 14, the server processing section 23, the second processing section 34, and the second acquisition section 341 can usually be realized by an MPU, a memory, or the like. The processing procedure of the first processing unit 14 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

The first output section 15 and the second output section 35 may or may not include output devices such as a display and a speaker. The first output unit 15 may be realized by output device driver software, output device driver software and the output device, or the like.

The first transmitter 16, the server transmitter 24, and the second transmitter 36 are usually realized by wireless or wired communication means, but may also be realized by broadcast means.

Next, the operation of information system A will be explained. First, an example of the operation of the first terminal 1 will be explained using the flowchart of FIG. 3.

(Step S301) The first receiving unit 13 determines whether information has been received. If the information has been received, the process goes to step S302; if the information has not been received, the process goes to step S306.

(Step S302) The first processing unit 14 acquires screen information from the information received in step S301. Note that there may be cases where screen information cannot be acquired. Note that the screen information received in step S301 is received by the first screen receiving unit 132.

(Step S303) The first processing unit 14 acquires the second input etc. from the information received in step S301. Note that there may be cases where the second input or the like cannot be obtained. Further, the second input or the like is the second input, or the second input and the second image, or the like. Furthermore, the second input received in step S301 is received by the first input receiving unit 131.

(Step S304) The first processing unit 14 configures the screen to be output using one or more of the information acquired in step S302 and step S303. The method of configuring the screen does not matter. That is, for example, the position of the screen information acquired in step S302, the second input acquired in step S303, etc. on the screen does not matter. Note that the first processing unit 14 may configure the output screen so that predetermined information among the received screen information is hidden. Predetermined information includes, for example, information corresponding to a predetermined field identifier, information corresponding to a predetermined window identifier, and information having a predetermined structure (for example, a 16-digit number string). credit card number, etc.). The predetermined information is information specified by the above-described specific information. The specific information may be any information that can specify the information, such as a field identifier, a window identifier, information indicating the structure of information, etc.

(Step S305) The first output unit 15 outputs the screen configured in step S304. Return to step S301.

(Step S306) The first reception unit 12 determines whether or not the first input has been received. If the first input is accepted, the process goes to step S307; if the first input is not accepted, the process returns to step S301.

(Step S307) The first processing unit 14 configures the first input etc. to be transmitted using the first input received in step S306. Return to step S301. Note that the first input and the like to be transmitted are, for example, the first input and the first user identifier of the first storage unit 11.

Note that in the flowchart of FIG. 3, the process is ended by turning off the power or by an interrupt to end the process.

Next, an example of the operation of the server device 2 will be described using the flowchart of FIG. 4.

(Step S401) The server reception unit 22 determines whether or not the first input etc. have been received from the first terminal 1. If the first input or the like is received, the process goes to step S402, and if the first input or the like is not received, the process goes to step S405. Note that the first input, etc. includes, for example, the first input, the first user identifier of the first user who is the source of the first input, and the second user identifier of the second user who is the receiver of the first input. Further, the first input etc. is, for example, only the first input.

(Step S402) The server transmitter 24 transmits the first input etc. received in step S401 to the second terminal 3.

(Step S403) The server processing unit 23 configures information to be accumulated using the first input received in step S401. The information to be accumulated is, for example, the first input received in step S401 and time information. Note that the server processing unit 23 acquires time information from, for example, a clock (not shown), and configures information to be accumulated from the time information and the first input received in step S401.

(Step S404) The server processing unit 23 stores the information configured in step S403 in the server storage unit 21. Return to step S401.

(Step S405) The server reception unit 22 determines whether or not screen information etc. have been received from the second terminal 3. If the screen information etc. have been received, the process goes to step S406, and if the screen information etc. have not been received, the process returns to step S401. Note that the screen information and the like are, for example, screen information, a first user identifier, and a second user identifier. Further, the screen information etc. is, for example, only screen information. Further, the screen information etc. include, for example, the second input.

(Step S406) The server transmitter 24 transmits the screen information etc. received in step S405 to the first terminal 1.

(Step S407) The server processing unit 23 configures information to be accumulated using the screen information etc. received in step S405. The information to be accumulated is, for example, the screen information received in step S405 and time information. Note that the server processing unit 23 acquires time information from, for example, a clock (not shown), and configures information to be accumulated from the time information and the screen information received in step S405.

(Step S408) The server processing unit 23 stores the information configured in step S407 in the server storage unit 21. Return to step S401.

Note that in the flowchart of FIG. 4, the process is ended by turning off the power or by an interrupt to end the process.

Next, an example of the operation of the second terminal 3 will be explained using the flowchart of FIG.

(Step S501) The second receiving unit 33 determines whether information has been received. If the information is received, the process goes to step S502, and if the information is not received, the process goes to step S505.

(Step S502) The second processing unit 34 acquires the first input etc. from the information received in step S501. Note that there may be cases where the first input cannot be obtained. Note that the first input and the like are, for example, the first input and the screen information of the first terminal 1. Further, the first input etc. is, for example, only the first input.

(Step S503) The second processing unit 34 configures the screen to be output using the information acquired in step S502. The method of configuring the screen does not matter. That is, for example, the position of the first input acquired in step S502 within the screen does not matter.

(Step S504) The second output unit 315 outputs the screen configured in step S503. Return to step S501.

(Step S505) The second reception unit 32 determines whether or not the second input has been received. If the second input is accepted, the process goes to step S506, and if the second input is not accepted, the process goes to step S507.

(Step S506) The second processing unit 34 uses the second input received in step S505 to configure the second input, which is information to be transmitted. Then, the second transmitter 36 transmits the second input and the like. Return to step S501. Note that the second input and the like are, for example, the second input, the second user identifier, and the first user identifier.

(Step S507) The second processing unit 34 determines whether it is time to transmit screen information or the like. If it is the timing to transmit screen information, etc., the process advances to step S508, and if it is not the timing to transmit screen information, etc., the process returns to step S501.

(Step S508) The second acquisition unit 341 acquires screen information of the screen of the second terminal 3. Note that since the process of acquiring screen information is a known technique, detailed explanation will be omitted.

(Step S509) The second processing unit 34 configures information to be transmitted using the screen information acquired in step S508. Note that the information to be transmitted includes, for example, screen information and a second user identifier.

(Step S510) The second transmitter 36 transmits the information configured in step S509. Return to step S501.

Note that in the flowchart of FIG. 5, the process is ended by turning off the power or by an interrupt to end the process.

The specific operation of the information system A in this embodiment will be described below. A conceptual diagram of information system A is shown in FIG.

It is now assumed that in information system A, a first user (hereinafter referred to as administrator) and a second user (hereinafter referred to as user) are chatting. The first terminal 1, server device 2, and second terminal 3 that constitute the information system A perform the operations described above to realize a chat between the administrator and the user. Two specific examples of such cases will be described below.
(Specific example 1)

In specific example 1, it is assumed that the current screen of the second terminal 3 used by the user is shown in FIG. In FIG. 6, an area 601 displays the content of the chat on the second terminal 3.

It is assumed that the second processing unit 34 of the second terminal 3 has determined that it is time to transmit the screen information and the like. Next, the second acquisition unit 341 acquires screen information of the screen of the second terminal 3. Note that the screen information here is information for configuring the entire screen in FIG. 6, and is configured in HTML, for example.

Next, the second processing unit 34 uses the acquired screen information to configure information to be transmitted. The information to be transmitted includes the screen information of the screen shown in FIG. 6, the second user identifier of the second user who is the source of the screen information, and the first user identifier of the administrator.

Next, the second transmitter 36 transmits information including the screen information, the second user identifier, and the first user identifier to the server device 2.

Next, the server receiving unit 22 of the server device 2 receives screen information and the like from the second terminal 3. Next, the server transmitter 24 transmits the received screen information and the like to the first terminal 1.

Next, the server processing unit 23 obtains time information indicating the current time from, for example, a clock (not shown). Then, the server processing unit 23 configures information including the received screen information and the like and time information. Such information is information for recording information, and is referred to as history information. The history information includes screen information, a second user identifier, a first user identifier, and time information. Then, the server processing unit 23 stores the configured history information in the server storage unit 21.

Next, the first receiving unit 13 of the first terminal 1 receives screen information and the like from the server device 2 . The first processing unit 14 acquires screen information from the received information. The first processing unit 14 also obtains a second input from the received information.

Next, the first processing unit 14 configures an output screen using the acquired information. Next, the first output unit 15 outputs the configured screen. An example of such a screen is shown in FIG. 701 in FIG. 7 is a chat screen performed by the administrator. 702 is a screen that the user is viewing. In other words, 702 is information on the screen of the second terminal 3. The screen shown in FIG. 7 allows the administrator to chat appropriately while looking at the screen that the other user is viewing.
(Specific example 2)

In specific example 2, it is assumed that information system A implements a chat service in which an administrator provides customer service to users.

It is assumed that the current screen of the second terminal 3 used by the user in such a case is shown in FIG. In FIG. 8, an area 801 displays the content of the chat on the second terminal 3. In FIG. 8, there are no fields for user input and no second input is sent towards the first terminal 1.

It is assumed that the second processing unit 34 of the second terminal 3 has determined that it is time to transmit the screen information and the like. Next, the second acquisition unit 341 acquires screen information of the screen of the second terminal 3. Note that the screen information here is information for configuring the entire screen in FIG. 8.

Next, the second processing unit 34 uses the acquired screen information to configure information to be transmitted. It is assumed that the information to be transmitted includes the screen information of the screen shown in FIG. 8, the second user identifier of the second user who is the source of the screen information, and the first user identifier of the administrator.

Next, the second transmitter 36 transmits information including the screen information, the second user identifier, and the first user identifier to the server device 2.

Next, the server receiving unit 22 of the server device 2 receives screen information and the like from the second terminal 3. Next, the server transmitter 24 transmits the received screen information and the like to the first terminal 1.

Next, the server processing unit 23 obtains time information indicating the current time from, for example, a clock (not shown). Then, the server processing unit 23 configures information including the received screen information and the like and time information. Such information is information for recording information, and is referred to as history information. The history information includes screen information, a second user identifier, a first user identifier, and time information. Then, the server processing unit 23 stores the configured history information in the server storage unit 21.

Next, the first receiving unit 13 of the first terminal 1 receives screen information and the like from the server device 2 . The first processing unit 14 acquires screen information from the received information. The first processing unit 14 also obtains a second input from the received information.

Next, the first processing unit 14 configures an output screen using the acquired information. Next, the first output unit 15 outputs the configured screen. An example of such a screen is shown in FIG. 901 in FIG. 9 is a customer service screen performed by the administrator. Note that customer service can also be considered as an example of chatting. In addition, for customer service or chat, input (for example, the first input) may be transmitted only from one user such as the administrator. Also, 902 in FIG. In other words, 902 is information on the screen of the second terminal 3. The screen shown in FIG. 9 allows the administrator to chat appropriately while viewing the screen being viewed by the user on the other end of the communication.

In addition, in FIGS. 7 and 9, the screen information window of the screen viewed by the user of the second terminal 3 and the administrator's chat window overlapped. However, the arrangement and display mode of the received screen information window and the chat window do not matter. For example, as shown in FIG. 10, screen information (see 1001) of the screen that the user of the second terminal 3 is viewing may be placed in the screen of the administrator of the first terminal 1 in a PinP manner. .

As described above, according to the present embodiment, since it is possible to see the screen that the other party is viewing while communicating with the other party, it is possible to clearly understand the situation of the other party during communication with the other party.

Further, according to the present embodiment, since it is possible to see the screen that the other party is viewing while communicating such as chatting, it is possible to input information to be sent to the other party while checking the other party's situation.

Furthermore, according to the present embodiment, information on the screen of the second terminal that should not be output does not need to be output on the first terminal, so the privacy of the second user can be protected.

Furthermore, according to the present embodiment, the first user can see the screen that the second user is viewing while communicating with the second user. privacy can be guaranteed.

Note that in this embodiment, among the screen information of the second terminal 3, screen information that does not include predetermined information is outputted by the first terminal 1. Examples of such output control methods include the following methods (1) to (3), as described above.
(1) A method of not sending predetermined information from the second terminal 3 to the server device 2. (2) The server device 2 receives all the screen information of the second terminal 3, but from the server device 2 to the first terminal 1 (3) The first terminal 1 receives all the screen information of the second terminal 3, but the predetermined information of the screen information received by the first terminal 1 How not to output information

Further, the processing in this embodiment may be realized by software. Then, this software may be distributed by software download or the like. Furthermore, this software may be recorded on a recording medium such as a CD-ROM and distributed. Note that this also applies to other embodiments in this specification. Note that the software that implements the first terminal 1 in this embodiment is, for example, the following program. In other words, this program, for example, connects a computer to a first receiving section that receives a first input that is an input from a first user, a first transmitting section that sends the first input, and the entire screen of a second terminal or This is a program for functioning as a first screen receiving section that receives screen information that is part of the information, and a first output section that outputs the screen information.

Further, the software that implements the server device 2 is, for example, the following program. That is, this program, for example, connects a computer to a server receiving unit that receives screen information, which is information about all or part of the screen of a second terminal, from the second terminal, and transmits the screen information to the first terminal. This is a program for functioning as a server transmitter.

Further, the software that realizes the second terminal 3 is, for example, the following program. In other words, this program, for example, connects a computer to a second acquisition section that acquires screen information that is all or part of the screen of the second terminal, a second transmission section that transmits the screen information, and a first This is a program for functioning as a second receiving section that receives a first input that is an input from a first user of the terminal, and a second output section that outputs the first input.

Further, FIG. 11 shows the external appearance of a computer that executes the programs described in this specification and realizes the server device 2 and the like of the various embodiments described above. The embodiments described above may be implemented in computer hardware and computer programs executed thereon. FIG. 11 is an overview diagram of this computer system 300, and FIG. 12 is a block diagram of the system 300.

In FIG. 11, computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.

In FIG. 12, the computer 301 includes, in addition to a CD-ROM drive 3012, an MPU 3013, a bus 3014 connected to the CD-ROM drive 3012, a ROM 3015 for storing programs such as a boot-up program, and an MPU 3013. It is connected and includes a RAM 3016 for temporarily storing application program instructions and providing temporary storage space, and a hard disk 3017 for storing application programs, system programs, and data. Although not shown here, the computer 301 may further include a network card that provides connection to a LAN.

A program that causes the computer system 300 to execute the functions of the server device 2 of the above-described embodiment may be stored in the CD-ROM 3101, inserted into the CD-ROM drive 3012, and further transferred to the hard disk 3017. Alternatively, the program may be transmitted to the computer 301 via a network (not shown) and stored on the hard disk 3017. The program is loaded into RAM 3016 during execution. The program may be loaded directly from CD-ROM 3101 or the network.

The program does not necessarily include an operating system (OS) or a third party program that causes the computer 301 to execute the functions of the server device 2 of the above-described embodiment. The program need only contain those parts of the instructions that call the appropriate functions (modules) in a controlled manner to achieve the desired results. How computer system 300 operates is well known and will not be described in detail.

Further, the number of computers that execute the above program may be one or more. That is, centralized processing or distributed processing may be performed.

Furthermore, in each of the above embodiments, it goes without saying that two or more communication means existing in one device may be physically realized by one medium.

Further, in each of the embodiments described above, each process may be realized by being centrally processed by a single device, or may be realized by being distributedly processed by a plurality of devices.

It goes without saying that the present invention is not limited to the above-described embodiments, and that various modifications can be made, and these are also included within the scope of the present invention.

As described above, the information system according to the present invention allows the user to see the screen that the other party is viewing while communicating, so it has the effect of understanding the other party's situation, and is useful as a chat system or the like.

1 First terminal 2 Server device 3 Second terminal 11 First storage section 12 First reception section 13 First reception section 14 First processing section 15 First output section 16 First transmission section 21 Server storage section 22 Server reception section 23 Server processing section 24 Server transmission section 31 Second storage section 32 Second reception section 33 Second reception section 34 Second processing section 35 Second output section 36 Second transmission section 131 First input reception section 132 First screen reception section 331 Second input reception unit 341 Second acquisition unit

Claims (9)

a second terminal used by a second user viewing a web page; and a first terminal capable of communicating via chat while the second user views the web page,
a first reception unit that receives a first input that is an input from a first user who is a user of the first terminal and that includes chat information;
a first transmitter that transmits the first input;
a first screen receiving unit that receives screen information that is information about all or part of the screen of the second terminal and includes the content of the web page;
From the screen information received by the first screen receiving unit, information corresponding to a predetermined field identifier, information corresponding to a predetermined window identifier, information having a predetermined structure, or a credit card. a first processing unit that configures screen information such that personal information of the second user including a number or bank account number is hidden;
a first input receiving unit that receives a second input that is an input from a second user to the second terminal and that includes chat information;
A first terminal comprising a first output unit that outputs the screen information configured by the first processing unit and the second input during a chat between the first user and the second user. A server device that supports chat communication between a first terminal and a second terminal used by a second user viewing a web page while the second user is viewing the web page,
Screen information that is all or part of the screen of the second terminal and includes the content of the web page, and a second input that is input by the second user and includes chat information are input to the second terminal. a server receiving unit that receives from a terminal and receives a first input from the first terminal that is an input of a first user and that includes chat information;
From the screen information received by the server reception unit, information corresponding to a predetermined field identifier, information corresponding to a predetermined window identifier, information having a predetermined structure, or a credit card number or a server processing unit that configures screen information so that personal information of the second user including a bank account number is hidden;
A server device comprising: a server transmitting unit configured to transmit the screen information configured by the server processing unit and the second input to the first terminal, and transmit the first input to the second terminal. A second terminal that can communicate with the first terminal via chat while viewing a web page,
a second reception unit that receives a second input that is input from a second user and includes chat information;
Among all the information on the screen of the second terminal, information corresponding to a predetermined field identifier, information corresponding to a predetermined window identifier, information having a predetermined structure, or credit card number. or a second acquisition unit that acquires screen information in which the second user's personal information including the bank account number is hidden ;
a second transmitter that transmits the screen information and the second input;
a second receiving unit that receives a first input that is an input from a first user of the first terminal and that includes chat information;
and a second output section that outputs the first input,
The second receiving section includes:
receiving coordinate information from the first terminal;
further comprising a second processing unit that configures a pointer using the coordinate information,
The second output section is
A second terminal that outputs the pointer . An information processing method in a second terminal used by a second user viewing a web page, and a first terminal capable of communicating via chat while the second user views the web page, the method comprising: a first reception unit; An information processing method realized by a first transmitting section, a first screen receiving section, a first processing section, a first input receiving section, and a first output section,
a first reception step in which the first reception unit receives a first input that is input from a first user who is a user of the first terminal and that includes chat information;
a first transmitting step in which the first transmitter transmits the first input;
a first screen receiving step in which the first screen receiving unit receives screen information that is all or part of the screen of the second terminal and includes the content of the web page;
The first processing unit extracts information corresponding to a predetermined field identifier, information corresponding to a predetermined window identifier, and predetermined information from the screen information received in the first screen receiving step. a first processing step of configuring the screen information such that structured information or personal information of the second user including a credit card number or bank account number is hidden;
a first input receiving step in which the first input receiving unit receives a second input that is an input from a second user to the second terminal and that includes chat information; An information processing method comprising: a first output step of outputting the screen information configured in the first processing step and the second input during a chat between the first user and the second user. An information processing method in a server device that supports chat communication between a first terminal and a second terminal used by a second user viewing a web page while the second user is viewing the web page, the method comprising: An information processing method realized by a server receiving section, a server processing section, and a server transmitting section, the method comprising:
The server reception unit receives all or part of the screen of the second terminal, screen information including the content of the web page and input from the second user, and a second input including chat information. a first receiving step of receiving an input from the second terminal;
a second receiving step in which the server receiving unit receives a first input, which is an input from a first user and includes chat information, from the first terminal; and a second receiving step in which the server processing unit receives a first input in the first receiving step. From the received screen information, information corresponding to a predetermined field identifier, information corresponding to a predetermined window identifier, information having a predetermined structure, or a credit card number or bank account number is determined. a server processing step of configuring screen information such that personal information of the second user is hidden;
a first sending step in which the server sending unit sends the screen information configured in the server processing step and the second input to the first terminal;
An information processing method comprising: a second transmitting step in which the server transmitter transmits the first input to the second terminal. An information processing method in a second terminal capable of communicating with the first terminal via chat while viewing a web page, the method comprising: a second reception section, a second acquisition section, a second transmission section, and a second reception section. , an information processing method realized by a second output section and a second processing section ,
a second reception step in which the second reception unit receives a second input that is input from a second user and includes chat information;
The second acquisition unit acquires information corresponding to a predetermined field identifier, information corresponding to a predetermined window identifier, and a predetermined structure among all the information on the screen of the second terminal. a second obtaining step of obtaining screen information in which the second user's personal information including the credit card number or bank account number is hidden ;
a second transmitting step in which the second transmitter transmits the screen information and the second input;
a second receiving step in which the second receiving unit receives a first input that is an input from a first user of the first terminal and includes chat information;
a second output step in which the second output unit outputs the first input ;
the second receiving unit receiving coordinate information from the first terminal;
a second processing step in which the second processing unit configures a pointer using the coordinate information;
An information processing method comprising: the second output unit outputting the pointer . a second terminal used by a second user who views a web page; and a first terminal that allows chat communication while the second user views the web page;
a first reception unit that receives a first input that is an input from a first user who is a user of the first terminal and that includes chat information;
a first transmitter that transmits the first input;
a first screen receiving unit that receives screen information that is information about all or part of the screen of the second terminal and includes the content of the web page;
From the screen information received by the first screen receiving unit, information corresponding to a predetermined field identifier, information corresponding to a predetermined window identifier, information having a predetermined structure, or a credit card. a first processing unit that configures screen information such that personal information of the second user including a number or bank account number is hidden;
a first input receiving unit that receives a second input that is an input from a second user to the second terminal and that includes chat information;
A program for functioning as a first output unit that outputs the screen information configured by the first processing unit and the second input during a chat between the first user and the second user. A server device that supports chat communication between a first terminal and a second terminal used by a second user viewing a web page while the second user is viewing the web page;
Screen information that is all or part of the screen of the second terminal and includes the content of the web page, and a second input that is input by the second user and includes chat information are input to the second terminal. a server receiving unit that receives from a terminal and receives a first input from the first terminal that is an input of a first user and that includes chat information;
From the screen information received by the server reception unit, information corresponding to a predetermined field identifier, information corresponding to a predetermined window identifier, information having a predetermined structure, or a credit card number or a server processing unit that configures screen information so that personal information of the second user including a bank account number is hidden;
A program for functioning as a server transmitting unit that transmits the screen information configured by the server processing unit and the second input to the first terminal, and transmits the first input to the second terminal. A second terminal that can communicate with the first terminal via chat while viewing a web page.
a second reception unit that receives a second input that is input from a second user and includes chat information;
Among all the information on the screen of the second terminal, information corresponding to a predetermined field identifier, information corresponding to a predetermined window identifier, information having a predetermined structure, or credit card number. or a second acquisition unit that acquires screen information in which the second user's personal information including the bank account number is hidden ;
a second transmitter that transmits the screen information and the second input;
a second receiving unit that receives a first input that is an input from a first user of the first terminal and that includes chat information;
A program for functioning as a second output unit that outputs the first input ,
The second receiving section includes:
receiving coordinate information from the first terminal;
further comprising a second processing unit that configures a pointer using the coordinate information,
The second output section is
A program for causing the second terminal to function as a device that outputs the pointer .

Images