JP2014017610A - Interactive system using network - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an interactive system that allows a user and an operator to communicate by moving images and that prevents spoofing and uses a network.SOLUTION: An interactive system 1 comprises a first application capable of video chat and uses a network. The interactive system 1 comprises: first check means for checking a login ID and a terminal specific ID input from a user terminal 3; second check means for checking a login ID and a password input from an operator terminal 4; and notification means for notifying a display unit of the operator terminal having logged in a server via the second check means of user login if the user terminal logged in the server via the first check means.

Description

  The present invention relates to a system using a network, for example, an interactive system used for interpretation, makeup instruction, cooking instruction, guidance, and the like.

  In a system using a conventional network, a system that provides an interpretation service (for example, see Patent Document 1) and a business model that provides a concierge service (for example, see Patent Document 2) have been proposed.

  In the system of Patent Document 1, a host computer connected to a wired and / or wireless communication line network is waiting for an interpreter application on the communication line network in a state where it can be called from the communication line network. 1 or 2 or more interpreter employees are assigned and called, and the communication line of the interpreter applicant is automatically connected to the communication line of the interpreter, and the first interpreter language, second interpreter language, designation or presence of the specialized field, interpreter The assignment is performed from the top of the assignment priority order data of the number of combinations of items including the designation or presence of the level and the necessity of emergency interpretation.

  The business model of Patent Document 2 includes a center that is the main body of an interpreting service, a foreign client that has requested the interpreting service from the center, a conversation partner with whom the foreign client intends to interact in a destination area, In the interpretation service providing system consisting of four service providing members who are fluent in both the language of the destination area of the center and the preferred language of the foreign client and who have contracted service providing services with the center, Offering services on the WEB site for requests from foreign clients that are provided via a personal digital assistant held by the foreign client and displayed in real time on the WEB site managed by the center A program in which members with the highest adaptability are installed in advance. In automatically selected and said to be bound to the foreign client.

JP 2003-0336304 A JP 2002-312461 A

  Patent Documents 1 and 2 are both prior arts that use a telephone line network using a mobile phone or the like, and transmit and use a mobile phone from a user to a center or an operator.

  However, the prior arts in Patent Documents 1 and 2 are based on a voice call using a mobile phone or the like and using a telephone line network, and the user needs to explain the situation at the site to the operator through a call. Also, in the method of telephone connection from the user, the user can make a telephone connection to the center if the user knows the telephone number of the center even after the user's contract expires. If it does so, it may impersonate the user who has a valid contract, and there is a possibility that a service may be used, and if such a telephone call occurs frequently, there is a possibility that business may be hindered.

  On the other hand, in the case of a system using the Internet network, it is common to determine whether a user is valid or invalid based on a user ID and a password. However, it is difficult to prevent impersonation when these are leaked only by determination based on the user ID and password.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide an interactive system using a network that can communicate with a user and an operator using a moving image and suppress spoofing.

In order to achieve the above object, an interactive system using a network according to the present invention includes a server, a user terminal, and an operator terminal connected via a communication line,
The user terminal and the operator terminal include an imaging unit, a display unit, and a first application capable of video chatting,
When the server stores a preset user login ID, application ID, and terminal unique ID, and a preset operator login ID and password, application ID, the login ID, terminal unique ID input from the user terminal, First verification means for verifying, second verification means for verifying the login ID and password input from the operator terminal, and the user terminal logged in to the server via the first verification means A notification means for notifying the login of the user to the display unit of the operator terminal logged into the server via the second verification means,
When the user logs in to the server, the notification means displays user information and a notification button on the display unit of the logged-in operator terminal, and the operator clicks the notification button to activate the first application. And starting a video chat with the user using the application ID of the user.

  According to this structure, since a user terminal and an operator terminal are provided with an imaging part and a display part, communication by a moving image can be performed via a network. In addition, this system is configured to start / use video chat by clicking the notification button on the operator terminal in response to a user request and calling back to the user from the operator. One-sided connection from the side can be avoided.

  Here, the “first application capable of video chat” is installed and used in each of the user terminal and the operator terminal, and a unique ID is used as a telephone number so that the user and the operator can An application that can communicate by voice. For example, there are FaceTime (registered trademark), Skype (registered trademark), Tango (registered trademark), and the like.

  In addition, when the user logs in to the server, machine authentication can be performed with a login ID, a password, or the like, and further, human authentication can be performed when the operator visually recognizes user information displayed on the operator terminal. Moreover, since the terminal unique ID of the user terminal is also verified at the time of machine authentication, the user cannot log in to the server without using the terminal after inputting the login ID and password. With these configurations, the system can strongly suppress spoofing. Here, “user information” refers to user registration information registered in the server, such as a login ID. The “click” includes a touch panel tap.

  In addition, the user can use the system in various places if there is a network environment. Furthermore, since the operator can log in to the server at various places if there is a network environment, the operator can be prepared at various places such as places other than Japan. Note that operators may be consolidated in a center having a network environment.

In the interactive system using the network according to claim 2, the server, the user terminal, and the operator terminal are connected via a communication line,
The user terminal and the operator terminal include an imaging unit, a display unit, and a first application capable of video chatting,
The server is inputted from the user terminal, first storage means for storing a user login ID and password, application ID and hash information set in advance, and a operator login ID and password and application ID set in advance. First verification means for verifying login ID, password, hash information, second verification means for verifying login ID and password input from the operator terminal, and the user terminal is the first verification means Notification means for notifying a user login to the display unit of the operator terminal that has logged into the server via the second verification means when logging in to the server via
When the user logs in to the server, user information and a notification button are displayed on the display unit of the logged-in operator terminal by the notification unit, and when the operator clicks the notification button, the application is activated, A video chat with the user is started using the user's application ID.

  According to this configuration, the user terminal can be collated by “hash information” instead of the “terminal unique ID” in the invention. Here, “hash information” refers to, for example, a value (hash value) obtained by applying a predetermined hash function to the user's login ID, password, and information at the first login. By storing the hash information in the user terminal and the server, when the user logs in, the hash information stored in the user terminal and the server is collated, and whether the logged-in user terminal is a login by the registered terminal or not is determined. judge.

  An interactive system using a network according to claim 3 includes a plurality of the operator terminals, the user terminal is a portable terminal, and the user terminal and the operator terminal are used to log in to the server. Application launching means for launching the second application is provided. Here, the “portable terminal” refers to, for example, a mobile PC or a tablet terminal.

  In the interactive system using the network according to claim 4, when the user starts the second application, a plurality of language buttons are displayed on the display unit of the user terminal, and the user clicks a predetermined language button. The user terminal logs in to the server, and the notification button corresponding to the language selected by the user is displayed on the display unit of each operator terminal logged in to the server. An operator who first clicks starts a video chat with the user, and the user uses the operator as an interpreter.

  According to this configuration, the user can select a desired language from a plurality of languages and receive an interpretation service. Moreover, in the operator, the operator who can respond to a user's desired language provides an interpretation service. Here, the “plural language buttons” are, for example, English, Chinese, Korean, French, and the like. Languages other than those exemplified may be used. Furthermore, since this system is a system using moving images, “sign language” can be included in “a plurality of language buttons” and sign language interpretation is also possible.

  In the interactive system using the network according to claim 5, when the user starts the second application, a plurality of makeup buttons are displayed on the display unit of the user terminal, and the user clicks a predetermined makeup button. The user terminal logs in to the server, and the notification button corresponding to the makeup selected by the user is displayed on the display unit of each operator terminal logged in to the server. The operator who clicked first may start a video chat with the user, and the user may be able to teach a predetermined makeup from the operator.

  In the interactive system using the network according to claim 6, when the user starts the second application, a plurality of cooking buttons are displayed on the display unit of the user terminal, and the user clicks a predetermined cooking button. The user terminal logs in to the server, and the notification button corresponding to the dish selected by the user is displayed on the display unit of each operator terminal logged in to the server. The operator who clicked first may start a video chat with the user, and the user may teach a predetermined dish from the operator.

  In the interactive system using a network according to claim 7, when the user starts the second application, a plurality of service buttons are displayed on the display unit of the user terminal, and the user clicks a predetermined service button. The user terminal logs in to the server, and the notification button corresponding to the service selected by the user is displayed on the display unit of each operator terminal logged in to the server. The operator who clicks first may start a video chat with the user, and the user may be able to teach a predetermined service from the operator.

  The interactive system using the network according to claim 8 is a video captured by the imaging unit of the operator terminal on the display unit of the user terminal and the display unit of the operator terminal in a video chat state between the user and the operator. And an image captured by the imaging unit of the user terminal are displayed simultaneously.

  According to this configuration, the user can show the operator's situation and the signboard to the operator, and can facilitate accurate interpretation and signboard translation. Here, the video displayed on the user terminal and the operator terminal is displayed, for example, on the display unit of the operator terminal, in which the video captured at the user terminal is displayed larger and the video captured at the operator terminal is displayed smaller. It is convenient to display an image of the opposite size.

  The interactive system using a network according to claim 9, further comprising a second storage unit for storing the video chat information and the used user information after the server has ended the video chat. It is characterized by.

  According to this configuration, it is possible to provide a service suitable for each user by storing usage information for each user and using such information for marketing and analysis.

According to a tenth aspect of the present invention, there is provided a program for an interactive system using a network, in which a user terminal and an operator terminal having an imaging unit, a display unit, a first application capable of video chatting, and a server are connected via a communication line. A program of an interactive system using a connected network,
In the server, a first login step for storing a user login ID, an application ID, and a terminal unique ID set in advance, a login ID and password of a preset operator, and an application ID, and a login input from the user terminal A first collation number step for collating an ID and a terminal unique ID, a second collation step for collating a login ID and a password input from the operator terminal, and the user terminal using the first collation means A notification step of notifying the login of the user to the display unit of the operator terminal logged into the server via the second collating means when logging in to the server via,
In the operator terminal, when the user logs in to the server, the notification means displays user information and a notification button on the display unit of the logged-in operator terminal, and the operator clicks the notification button. An application start step for starting the first application and a video chat start step for starting a video chat with the user terminal using the user's application ID are provided.

  As described above, according to the present invention, since the user terminal and the operator terminal include the imaging unit and the display unit, an interactive service using a moving image can be provided using a network. In addition, for authentication of login from the user terminal to the server, authentication by the terminal is used to suppress login by impersonation of another person. Moreover, since it is the structure which starts a video chat from an operator terminal to a user terminal after notifying an operator terminal that the user terminal logged in to a server, the one-sided connection from a user can be avoided.

It is the schematic which shows the apparatus structure of the interactive system which concerns on one Embodiment of this invention. It is a block diagram which shows the structure of the server in FIG. It is a block diagram which shows the structure of the tablet-type user terminal in FIG. It is a block diagram which shows the structure of the tablet-type operator terminal in FIG. It is a flowchart which shows the flow of the whole interactive system which concerns on one Embodiment of this invention. (A) is a flow at the time of registration. (B) is a flow at the time of service. It is explanatory drawing which shows an example of the display screen of a user terminal. It is explanatory drawing which shows an example of the display screen of a user terminal. It is explanatory drawing which shows an example of the display screen of an operator terminal. It is explanatory drawing which shows an example of the display screen of an operator terminal. It is explanatory drawing which shows an example of the display screen of each terminal at the time of video chat. (A) is a user terminal. (B) is an operator terminal. It is the schematic which shows the apparatus structure of the interactive system which concerns on another embodiment of this invention. FIG. 10 is a block diagram of the server in FIG. 9. It is a block diagram of the user terminal in FIG. FIG. 10 is a block diagram of the operator terminal in FIG. 9. It is a flowchart which shows the flow of the whole interactive system which concerns on another embodiment of this invention. (A) is a flow at the time of registration. (B) is a flow at the time of service. It is explanatory drawing which shows an example of the display screen of a user terminal.

  Hereinafter, although one embodiment concerning the present invention is described based on a drawing, the present invention is not limited to the following embodiment. The first embodiment is an example when the interactive system is used for interpretation.

<First embodiment>
1. [Equipment configuration]
(1) Overall Configuration of Interactive System 1 As shown in FIG. 1, the interactive system 1 includes a server 2, a user terminal 3, an operator terminal 4, and a communication network 5. The user terminal 3 and the server 2 are connected via a communication network 5, and the operator terminal 4 and the server 2 are connected via a communication network 5. As a result, the user terminal 3 and the operator terminal 4 are connected to the server 2 via the communication network 5.

(2) Configuration of Server 2 The server 2 is a computer. As shown in FIG. 2, the server 2 includes a main body 21, a display unit 22 such as a display, and an input unit 23 such as a mouse and a keyboard. The main body 21 includes a CPU 21a, ROM 21b, RAM 21c, hard disk 21d, disk drive 21e, input / output interface 21f, communication interface 21g, and image output interface 21h. The CPU 21a, ROM 21b, RAM 21c, hard disk 21d, disk drive 21e, input / output interface 21f, communication interface 21g, and image output interface 21h are connected by a bus 21i.

  The CPU 21a executes a program loaded on the RAM 21c. Then, the server 2 functions as a server when the CPU 21a executes the server program 24 of the interactive system 1.

  The ROM 21b stores a program executed by the CPU 21a, data used for the program, and the like.

  The RAM 21c is used to read the program 24 recorded on the hard disk 21d. Further, it is also used as a work area for the CPU 21a when the CPU 21a executes the program.

  The hard disk 21d is installed with various programs to be executed by the CPU 21a, such as an operating system and application programs, and data used for executing these programs. The server program 24 is also installed in the hard disk 21d.

  The disk drive 21e is composed of, for example, a CD-ROM drive, a DVD-ROM drive, a BD-ROM drive, etc., and can read a program and data recorded on the recording medium 25. When used in the disk drive 21e, a CD-ROM, DVD-ROM, or BD-ROM is used as the recording medium 25, but a USB flash memory may be used.

  A user information database 26 is stored in the hard disk 21d. In the user information database 26, a login ID, a password, a terminal unique ID, a video chat ID, a use start date, and the like for each user are registered.

  A user history database 27 is stored in the hard disk 21d. In the user history database 27, the usage history, usage date and time, usage language, etc. for each user are registered.

  An operator information database 28 is stored in the hard disk 21d. In the operator information database 28, a login ID, a password, a video chat ID, a use start date, and the like for each operator are registered.

  The input / output interface 21f includes, for example, a serial interface such as USB and IEEE1394, a parallel interface such as SCSI, IDE, and IEEE1234, an analog interface such as a D / A converter and an A / D converter. An input unit 23 such as a keyboard or a mouse is connected to the input / output interface 21f.

  The communication interface 21g is an Ethernet (registered trademark) interface. A LAN is connected to the communication interface 21g by wire or wirelessly, and is connected to the user terminal 3 and the operator terminal 4 via the communication network 5. Thereby, the server 2, the user terminal 3, and the operator terminal 4 can transmit and receive data using the communication protocol.

  The image output interface 21h is connected to a display unit 22 such as a display, receives a video signal corresponding to image data from the CPU 21a, and displays an image (screen) on the display unit 22.

(3) Configuration of the user terminal 3 The user terminal 3 is a tablet terminal. Note that the user terminal 3 may be a mobile PC or the like instead of the tablet terminal. As illustrated in FIG. 3, the user terminal 3 includes a camera 31 (imaging unit), a touch panel display 32 (display unit) that also serves as an input unit, a microphone 33, and a speaker 34.

  The user terminal 3 includes a CPU 31a, ROM 31b, RAM 31c, hard disk 31d, wireless LAN adapter 31e, and input / output interface 31f. The CPU 31a, ROM 31b, RAM 31c, hard disk 31d, wireless LAN adapter 31e, and input / output interface 31f are connected by a bus 31g.

  The hard disk 31d includes an operating system and a video chat application A (first application) program, and a login application B (second application) program for logging in to the server 2 from the user terminal 3 and using the interactive system 1 Is installed. In addition, various programs and data for causing the CPU 31a to execute these operating systems and applications are also installed.

  Note that these application programs can be installed from a PC or the like via the input / output interface 31f, or can be installed from a communication line via a wireless LAN.

  In addition, the image captured by the camera 31 can be displayed on the display 32 in real time, and the captured image can be stored in the hard disk 31d.

  The display 32 is a display unit that also serves as a touch panel type input unit. An image displayed on the display 32 can be touched and input in the same manner as a mouse click. In addition to the input using the touch panel, an input device such as a keyboard can be separately connected to the input / output interface 31f for input. The microphone 33 is for inputting sound, and the speaker 34 is for outputting sound.

(4) Configuration of Operator Terminal 4 The operator terminal 4 is a tablet terminal. The operator terminal 4 may be a mobile PC or a desktop PC instead of a tablet terminal. As shown in FIG. 4, the operator terminal 4 includes a camera 41 (imaging unit), a touch panel display 42 (display unit) that also serves as an input unit, a microphone 43, and a speaker 44.

  The operator terminal 4 includes a CPU 41a, ROM 41b, RAM 41c, hard disk 41d, wireless LAN adapter 41e, and input / output interface 41f. The CPU 41a, ROM 41b, RAM 41c, hard disk 41d, wireless LAN adapter 41e, and input / output interface 41f are connected by a bus 41g.

  The hard disk 41 d is installed with an operating system and a video chat application A program, and a login application B ′ program for an operator to log in to the server 2 and use the interactive system 1. In addition, various programs and data for causing the CPU 41a to execute these operating systems and applications are also installed.

  In addition, the specifications of the login applications B and B 'are different for the user and the operator (see FIGS. 6 and 7). The login application B is for using the interactive system 1 by logging in to the server 2 at the user terminal 3, and the login application B ′ is a program that allows the operator terminal 4 to visually recognize the login of the user. Has been.

  The configuration of the other operator terminals 4 is the same as the configuration of the user terminal 3 described above, and thus the description thereof is omitted.

2. [Operation of interactive system 1]
(1) Registration of Operator Next, the operation of the interactive system 1 according to the present embodiment will be described with reference to the drawings. Before operating the interactive system 1, it is necessary to register user and operator information in the server 2 in advance.

  As shown in FIG. 5A, first, the administrator of the interactive system 1 transmits the login ID to the operator applicant and registers the login ID of the operator in the server 2. At this time, a URL for downloading the login application B ′ and the video chat application A for using the interactive system 1 to the operator terminal 4 is transmitted to the operator applicant, and the operator downloads these applications, Install in the operator terminal 4. Note that FaceTime is used as an example in the video chat application A of the present embodiment, and the operator registers a video chat ID (application ID (FaceTimeID)) when installing this.

  When the operator first accesses the server 2 from the operator terminal 4, the operator sets an arbitrary password (see FIG. 7a (B)). At this time, in the server 2, the password, the use start date (the date of the first login), and the video chat ID are registered in the operator information database 28 of the hard disk 21d in association with the login ID of the operator.

(2) User Registration On the other hand, as shown in FIG. 5A, the administrator of the interactive system 1 transmits a login ID to a user who wants to use the system, and the login ID of the user Is registered in the server 2. At this time, the URL for downloading the login application B and the video chat application A for using the interactive system 1 to the user terminal 3 is transmitted to the user, and the user downloads these applications, and the user terminal Install these in step 3. In addition, FaceTime is used as an example for the video chat application of the present embodiment, and the user registers a video chat ID (application ID (FaceTimeID)) when installing the same as in the case of an operator.

  Then, when the user first accesses the server 2 from the user terminal 3, the user sets an arbitrary password (see FIG. 6a (B)). At this time, in the server 2, in association with the login ID of the user, the password, the terminal unique ID of the user terminal 3, the use start date (the date of first login), the video chat ID, and the validity / invalidity of the contract period are It is registered in the user information database 26 of the hard disk 21d.

  With these pre-registrations, the login application B and the video chat application A are installed on the user terminal 3 and the operator terminal 4. Further, the server 2 stores user and operator information, respectively, and authentication can be performed when the user terminal 3 or the operator terminal 4 logs into the server 2. As a result, the user and the operator can use the interactive system 1. As described above, a plurality of users and operators are registered.

(3) Preparation of Operator Next, the administrator provides the operator terminal 4 in advance to a plurality of operators capable of interpreting any of English / Chinese / Korean / Sign language so that the user can use the interactive system 1. Tell 2 to log in. Each of the plurality of operators clicks the icon of the login application B ′ displayed on the display 42 of the operator terminal 4 to start this application (see FIG. 7A), and inputs the login ID and password to the server. 2 (see FIG. 7a (C)). As a result, the operator terminal 4 is logged in to the server 2 and a standby screen is displayed on the display 42 to prepare for user use. This standby screen is in a tabular format for each language, as shown in FIG.

(4) User use (step S1)
Next, a case where a pre-registered user uses the interactive system 1 will be described. As shown in FIG. 5B, the user who wants to use the interactive system 1 taps the login application B icon displayed on the display 32 of the user terminal 3 to start the login application B (FIG. 6a ( A)). Then, four types of language buttons, an English button 32a, a Chinese button 32b, a Korean button 32c, and a sign language button 32d, are displayed on the TOP screen (see FIG. 6A (C)).

(Step S2)
The user taps a language button that the user wants to use.

(Step S3)
At this time, the login application B determines whether or not the user terminal 3 is connected to the communication network 5. When the user terminal 3 is not connected to the communication network 5, an error message is displayed on the display 32. On the other hand, when connected to the communication network 5, data of the login ID and the terminal unique ID is transmitted from the user terminal 3 to the server 2 via the communication network 5.

(Step S4)
Then, the server 2 receives the login ID and terminal unique ID data, and retrieves the user login ID, terminal unique ID, and valid / invalid data of the contract period registered in advance from the user information database 26 of the hard disk 21d. . Then, the CPU 21a collates the received login ID and terminal unique ID with the registered ID and valid / invalid data of the contract period. When these IDs do not match or are invalid, an error message is transmitted from the server 2 to the user terminal 3, and the error message is displayed on the display 32 of the user terminal 3 (see FIG. 6a (D)). On the other hand, when these login IDs and terminal unique IDs match and the contract period is valid, a display to wait for an incoming call from the operator is displayed on the display 32 of the user terminal 3 (see FIG. 6B (E)).

(Step S5)
When the user is authenticated in step S <b> 4, the CPU 21 a of the server 2 transmits data notifying the user login to each operator terminal 4. In each operator terminal 4 that has received this, a language button corresponding to the language selected by the user is displayed in red in the table for each language on the standby screen displayed on the display 42, and the login ID of the user is also displayed. (See FIG. 7b (E)). Note that voice notification may be performed in accordance with the display of the login notification on the display 42.

(Step S6)
The operator who has received the user's login notification taps the notification button displayed in red if the language is interpretable. In this case, the process proceeds to step S6. On the other hand, if there is no operator who can respond due to congestion and the notification button is not tapped by any operator within a predetermined time (for example, 30 seconds), the display 32 of the user terminal 3 “is now busy”. Etc. is displayed (see FIG. 6B (F)).

  Since the login ID of the user is displayed on the display 42 of the operator terminal 4 in accordance with the display of the login notification, for example, the case where the user is registered in the black list is not supported. Thus, in addition to the machine authentication of the server 2, human authentication can be performed by visual recognition of the operator, and double authentication is possible.

  When the notification button is tapped by the operator, the CPU 41a of the operator terminal 4 automatically starts the video chat application A, retrieves the user's video chat ID data from the user information database 26 of the server 2, and displays the display 42. The user's video chat ID and call button are popped up (see FIG. 7b (F)). Then, the operator taps the call button and calls the user. When a plurality of operators tap the notification button, only the operator terminal 4 of the operator who first taps the notification button performs this operation.

(Step S7)
When the operator calls the user, the CPU 31a of the user terminal 3 automatically activates the video chat application A, and a call screen is displayed on the display 32 (see FIG. 6b (G)). When the user taps the call acceptance button, video chat with the operator is started.

  As shown in FIG. 8A, during video chat, the display 32 of the user terminal 3 has a large image (such as an operator's face) captured by the camera 41 of the operator terminal 4, and the camera 31 of the user terminal 3. The image (such as the user's face) captured in is displayed small. On the other hand, as shown in FIG. 8B, the display 42 of the operator terminal 4 has a large image (such as a user's face) captured by the camera 31 of the user terminal 3 and is captured by the camera 41 of the operator terminal 4. The image (such as the operator's face) is displayed small. In this state, the operator provides an interpretation service to the user. If the user wants to translate a signboard or the like as needed, the user can move the user terminal 3 to display the signboard image with the camera 31.

(Step S8)
When the video chat interpreting service is terminated, the user taps the call off button.

(Step S9)
Then, a predetermined questionnaire pops up on the display 42 of the operator terminal 4, and the corresponding operator performs a questionnaire for the user by radio buttons or text input (see FIG. 7B (G)). The questionnaire data input by the operator is transmitted from the operator terminal 4 to the server 2 and stored in the user history database 27 of the hard disk 21d of the server 2. The user history data can be confirmed at any time from the logged-in operator terminal 4 (see FIG. 7B (H)).

  As described above in steps S1 to S9, each operator sequentially provides an interpretation service according to usage by the user.

3. [Modified example of interactive system 1]
As described above, the interactive system 1 according to the present embodiment is an example of a system that prepares an operator that can handle English, Chinese, Korean, and sign language and responds to a user's interpretation request. In the interactive system 1, an operator capable of interpreting languages other than these can be prepared to deal with other languages. In addition to the interpreter, if an operator capable of making makeup is prepared and the language button displayed on the user terminal 3 is changed to a facial part button or the like, an interactive system for makeup guidance can be obtained. . If an operator capable of cooking instruction is prepared and displayed on a plurality of cooking buttons on the user terminal 3, an interactive system for cooking instruction can be provided. The same applies to various guides. Thus, it is possible to provide various interactive systems by changing the buttons displayed on the operator and the user terminal 3.

<Second embodiment>
1. [Equipment configuration]
Next, the interactive system 101 according to the second embodiment of the present invention will be described. As shown in FIG. 9, the interactive system 101 includes a server 120, a user terminal 130, an operator terminal 140, and a communication network 150, and the configuration of the apparatus and the interactive system 1 of the first embodiment is as follows. It is substantially the same (refer FIG. 10, FIG. 11, FIG. 12).

  The difference from the interactive system 1 of the first embodiment is mainly in “login application” and “user authentication” used for the user terminal. The login application B used for the user terminal 3 of the first embodiment is a stand-alone application that does not depend on WEB, whereas the login application C used for the user terminal 130 of the second embodiment is a WEB application.

  In addition, the user authentication in the first embodiment is based on the login ID, password, use start date (first login date), video chat ID, validity / invalidity of the contract period, and the terminal unique ID of the user terminal. Authenticate the device. On the other hand, in the second embodiment, the user terminal is authenticated by the login ID, the password, the use start date (the first login date), the video chat ID, the validity / invalidity of the contract period, and the hash information. That is, the user terminal is authenticated by “hash information” instead of the “terminal unique ID” in the first embodiment. As the hash information, a hash value obtained by applying a predetermined hash function to the user's login ID, password, and date / time information at the first login is used.

  The hash information is stored in the hard disk 131d of the user terminal and the hard disk 121d of the server 120. When the user logs in, the hash information is transmitted from the user terminal 130 to the server 120, and the hash stored in the hard disk 121d of the server 120 is stored. It is checked with the information whether or not the logged-in user terminal 130 is logged in by the registered terminal.

  As a result, a specific user terminal can be specified even on a PC that does not have a terminal unique ID or a terminal that cannot install the stand-alone login application, and impersonation can be suppressed. Hereinafter, the operation of the interactive system 101 will be described.

2. [Operation of Interactive System 101]
(1) Registration of Operator Before operating the interactive system 101, information on the user and the operator is registered in the server 120 in advance.

  As shown in FIG. 13A, first, the administrator of the interactive system 101 transmits a login ID to the operator applicant and registers the operator's login ID in the server 120. At this time, a URL for downloading the login application C ′ and the video chat application A for using the interactive system 101 to the operator terminal 140 is transmitted to the operator applicant, and the operator downloads these applications, Install in the operator terminal 140. The video chat application A uses FaceTime as an example, and the operator registers a video chat ID (application ID (FaceTimeID)) when installing the video chat application A.

  The operator sets an arbitrary password when accessing the server 120 from the operator terminal 140 for the first time. At this time, in the server 120, the password, the use start date (the date of the first login), and the video chat ID are registered in the operator information database 128 of the hard disk 121d in association with the login ID of the operator. The registration on the operator side is the same as in the interactive system 1.

(2) User Registration On the other hand, as shown in FIG. 13A, the administrator of the interactive system 101 transmits a login ID to a user who wants to use the system, and the login ID of the user Is registered in the server 120. At this time, the URL for downloading the login application C and the video chat application A for using the interactive system 101 to the user terminal 130 is transmitted to the user, and the user downloads these applications and the user terminal Install on 130. Also, FaceTime is used as an example in the video chat application A, and the user registers a video chat ID (application ID (FaceTimeID)) when installing the same as in the case of an operator.

  Then, when the user first accesses the server 120 from the user terminal 130, the user activates the login application C of the user terminal 130 and sets an arbitrary password on the setting screen (see FIG. 14). At this time, the server 120 associates the login ID of the user with the password, the hash information generated by applying the hash function to the login ID / password / access date / time data, and the use start date (the first login date) The video chat ID and the validity / invalidity of the contract period are registered in the user information database 126 of the hard disk 121d.

  With these pre-registrations, the login application C and the video chat application A are installed on the user terminal 130 and the operator terminal 140. In addition, user and operator information is registered in the server 120, and authentication can be performed when the user terminal 130 or the operator terminal 140 logs in to the server 120. As a result, the user and the operator can use the interactive system 101. As described above, a plurality of users and operators are registered.

(3) Preparation of Operator Next, the administrator provides the operator terminal 140 in advance to a plurality of operators capable of interpreting either English / Chinese / Korean / Sign language so that the user can use the interactive system 101. Tell 120 to log in. Each of the plurality of operators clicks on the icon of the login application C ′ displayed on the display 142 of the operator terminal 140 to start this application, and logs in to the server 120 by inputting a login ID and a password. As a result, the operator terminal 140 is logged into the server 120 and a standby screen is displayed on the display 142 to prepare for user use. The standby screen is in a tabular format for each language.

(4) User use (step S101)
Next, a case where a pre-registered user uses the interactive system 101 will be described. Note that the screen displayed on the user terminal 130 when using the interactive system 101 is substantially the same as that of the interactive system 1 except for the setting screen (FIG. 14). The screen displayed on the operator terminal 140 is substantially the same as in the interactive system 1. Therefore, the drawing of the display screen is omitted.

  As shown in FIG. 13B, the user who wants to use the interactive system 101 taps the icon of the login application C displayed on the display 132 of the user terminal 130. Then, the CPU 131a of the user terminal 130 activates the browser and transmits hash information and a login ID from the user terminal 130 to the server 120.

(Step S102)
The CPU 121a of the server 120 collates with the hash information and login ID of the user registered in advance from the hard disk 121d. If the hash information and the login ID do not match, the setting screen is displayed again. On the other hand, if they match, the process proceeds to step S103.

(Step S103)
When the hash information and the login ID are authenticated in step S102, a TOP screen is displayed on the display unit 132 of the user terminal 130. On the TOP screen, four types of language buttons, an English button 132a, a Chinese button 132b, a Korean button 132c, and a sign language button 132d, are displayed.

(Step S104)
Next, the user taps a language button that the user wants to use. Then, the hash information of the user terminal 130 is transmitted from the user terminal 130 to the server 120.

(Step S105)
Subsequently, the server 120 receives the hash information of the user terminal 130, and extracts the hash information of the user registered in advance and the valid / invalid data of the contract period from the user information database 126 of the hard disk 121d. And CPU121a collates hash information and confirms the validity / invalidity data of a contract period. If the hash information does not match or the contract period is invalid, an error message is transmitted from the server 120 to the user terminal 130, and the error message is displayed on the display 132 of the user terminal 130. On the other hand, if the hash information matches and the contract period is valid, the process proceeds to the following.

(Step S106)
When the user is authenticated in step S <b> 105, the CPU 121 a of the server 120 transmits data notifying the user login to each operator terminal 140. In each operator terminal 140 that has received this, a language button corresponding to the language selected by the user is displayed in red in the table for each language on the standby screen displayed on the display 142, and the login ID of the user is displayed together with this. Is done. Note that voice notification may be performed in accordance with the display of the login notification on the display 142.

  The operator who has received the user's login notification taps the notification button displayed in red if the language is interpretable. In this case, the process proceeds to step S108. On the other hand, if there is no operator who can respond due to congestion and the notification button is not tapped by any operator within a predetermined time (for example, 30 seconds), the display 132 of the user terminal 130 is “crowded now”. Error message is displayed.

  Since the login ID of the user is also displayed on the display 142 of the operator terminal 140 in accordance with the display of the login notification, for example, the case where the user is registered in the black list is not supported. Thus, in addition to the machine authentication of the server 120, human authentication can be performed by visual recognition of the operator, and double authentication is possible.

(Step S107)
When the notification button is tapped by the operator, the CPU 141a of the operator terminal 140 automatically activates the video chat application A, retrieves the user's video chat ID data from the user information database 126 of the server 120, and displays the user on the display 142. Video chat ID and call button will pop up. Then, the operator taps the call button and calls the user. When a plurality of operators tap the notification button, only the operator terminal 140 of the operator who first taps the notification button performs this operation.

(Step S108)
When the operator calls the user, the CPU 131a of the user terminal 130 automatically activates the video chat application A and a call screen is displayed on the display 132. When the user taps the call acceptance button, video chat with the operator is started.

(Step S109)
When the video chat interpreting service is terminated, the user taps the call off button.

(Step S110)
Then, a predetermined questionnaire pops up on the display 142 of the operator terminal 140, and the corresponding operator performs a questionnaire for the user by radio buttons or text input. The questionnaire data input by the operator is transmitted from the operator terminal 140 to the server 120 and stored in the user history database 127 of the hard disk 121d of the server 120.

  As described above in steps S101 to S110, each operator sequentially provides an interpretation service according to usage by the user.

<Third embodiment>
In the first embodiment and the second embodiment, a management side having an operator mainly uses an operator terminal to provide only a user terminal to a user who uses the system, or software is provided to a terminal owned by the user. An embodiment for installing and providing a service. On the other hand, 3rd embodiment is embodiment which provides a system as it is. Specifically, the system is provided to hospitals, nursing homes, commercial facilities, and the like. As an example, a case where the interactive system 1 is introduced into a hospital will be described.

  When introducing the interactive system 1 in a hospital, a doctor uses the operator terminal 4 and lends the user terminal 3 to a patient. Then, in response to the patient's request, the doctor performs video chat with the patient, and the patient explains his / her state, or shows the affected part imaged by the camera 31 to the doctor, and receives advice and prescription from the doctor. At this time, the patient may be in a hospital room or at home. If the advice is other than medical practice, a nurse or the like other than the doctor may use the operator terminal 4.

  In this case, for example, only one “doctor button” is displayed on the TOP screen of the user terminal 3, or when a plurality of doctors have the operator terminal 4, a plurality of “XX doctor buttons” are displayed. Or just do it. When the operator terminal 4 has a plurality of types of staff such as doctors, nurses, laboratory technicians, etc., the “doctor button”, “nurse button”, “inspection technician button”, etc. are displayed and the patient terminal is requested. It is also possible for these staff to respond.

  At this time, since the interactive system 1 only needs to connect each operator terminal 4 to the communication network 5, there is no need for doctors, nurses, laboratory technicians, etc. to consolidate in one place. You can respond while you are in

  Next, a case where the interactive system 1 is introduced into a commercial facility will be described as another example. When the interactive system 1 is introduced into a commercial facility, a guide staff in the commercial facility information or the like uses the operator terminal 4 and lends the user terminal 3 to a customer. When the customer wants to know how to get to the target store, or when he / she gets lost in the commercial facility, the guide staff performs a video chat with the customer and guides them according to the customer's request.

  In this case, for example, only one “guidance button” is displayed on the TOP screen of the user terminal 3, or when there are a plurality of pieces of information for each area, a plurality of “XX area buttons” are displayed. , Etc. In addition to these, an “emergency button” or the like may be displayed in case the customer becomes unwell.

  Moreover, when introducing into a commercial facility, the user terminal 3 provided to the customer may be replaced with a tablet-type terminal, and a smartphone-type terminal with a camera having a smaller size and better portability may be used.

<Other embodiments>
As described above, the preferred embodiments of the present invention have been described with reference to the drawings, but various additions, modifications, or deletions can be made without departing from the spirit of the present invention. The above-described embodiment is an embodiment when the interactive system of the present invention is applied to interpretation, medical care, and guidance. However, the present invention is not limited to this, and may be applied to various services such as makeup, cooking, and nursing care. it can. Further, the user terminal and the operator terminal are not limited to tablet terminals, and may be mobile PCs or desktop PCs. Therefore, such a thing is also included in the scope of the present invention.

  The interactive system using the network of the present invention is useful as a system in which teaching of various knowledge is provided to the user in an interactive manner using video, such as providing an interpretation service to the user.

DESCRIPTION OF SYMBOLS 1 Interactive system 2 Server 21 Main body 21a CPU
21b ROM
21c RAM
21d hard disk 21e disk drive 21f input / output interface 21g communication interface 21h image output interface 21i bus 22 display unit 23 input unit 24 program 25 storage medium 26 user information database 27 user history database 28 operator information database 3 user terminal 31 camera (imaging unit)
32 Display (display unit)
33 Microphone 34 Speaker 4 Operator terminal 41 Camera (imaging unit)
42 Display (display part)
43 Microphone 44 Speaker 5 Communication network A Video chat application (first application)
B, B 'Login application (second application)

Claims (10)

The server, user terminal and operator terminal are connected via a communication line,
The user terminal and the operator terminal are
An imaging unit, a display unit, and a first application capable of video chatting,
The server
A first storage means for storing a login ID, an application ID, and a terminal unique ID of a user set in advance, a login ID and password of an operator set in advance, and an application ID;
First verification means for verifying a login ID input from the user terminal and a terminal unique ID;
Second verification means for verifying a login ID and password input from the operator terminal;
Notification means for notifying the login of the user to the display unit of the operator terminal logged into the server via the second verification means when the user terminal has logged into the server via the first verification means And comprising
When the user logs in to the server, the notification means displays user information and a notification button on the display unit of the logged-in operator terminal, and the operator clicks the notification button to activate the first application. A network-based interactive system characterized by starting a video chat with a user using the user's application ID. The server, user terminal and operator terminal are connected via a communication line,
The user terminal and the operator terminal are
An imaging unit, a display unit, and a first application capable of video chatting,
The server
A first storage means for storing a login ID and password of the user set in advance, an application ID, hash information, a login ID and password of the operator set in advance, and an application ID;
First verification means for verifying a login ID, password, and hash information input from the user terminal;
Second verification means for verifying a login ID and password input from the operator terminal;
Notification means for notifying the login of the user to the display unit of the operator terminal logged into the server via the second verification means when the user terminal has logged into the server via the first verification means And comprising
When the user logs in to the server, user information and a notification button are displayed on the display unit of the logged-in operator terminal by the notification unit, and when the operator clicks the notification button, the application is activated, A network-based interactive system characterized by starting a video chat with a user using an application ID on the user side. The user terminal is a portable terminal,
A plurality of the operator terminals,
The interactive system using a network according to claim 1, wherein the user terminal and the operator terminal include application activation means for activating a second application for logging in to the server. When the user starts the second application, a plurality of language buttons are displayed on the display unit of the user terminal, and the user terminal logs into the server by clicking a predetermined language button,
The notification button corresponding to the language selected by the user is displayed on the display unit of each operator terminal logged into the server, and the operator who first clicked the notification button among a plurality of operators 4. The interactive system using a network according to claim 3, wherein a video chat is started and a user uses it as an interpreter. When the user starts the second application, a plurality of makeup buttons are displayed on the display unit of the user terminal, and the user terminal logs into the server by clicking a predetermined makeup button,
The notification button corresponding to the makeup selected by the user is displayed on the display unit of each operator terminal logged into the server, and the operator who first clicked the notification button among a plurality of operators The interactive system using a network according to claim 3, wherein a video chat is started and a user can teach a predetermined makeup from an operator. When the user starts the second application, a plurality of cooking buttons are displayed on the display unit of the user terminal, and the user terminal logs into the server by clicking a predetermined cooking button,
The notification button corresponding to the dish selected by the user is displayed on the display unit of each operator terminal logged into the server, and the operator who first clicked the notification button among the plurality of operators is the user. The interactive system using a network according to claim 3, wherein a video chat is started and a user can teach a predetermined dish from an operator. When the user starts the second application, a plurality of service buttons are displayed on the display unit of the user terminal, and the user terminal logs into the server by clicking a predetermined service button,
The notification button corresponding to the service selected by the user is displayed on the display unit of each operator terminal logged into the server, and the operator who first clicked the notification button among the plurality of operators 4. The interactive system using a network according to claim 3, wherein a video chat is started and a user can teach a predetermined service from an operator. In a video chat state between the user and the operator,
The video captured by the imaging unit of the operator terminal and the video captured by the imaging unit of the user terminal are simultaneously displayed on the display unit of the user terminal and the display unit of the operator terminal. An interactive system using the network according to claim 1. Furthermore, the server
The network according to any one of claims 1 to 8, further comprising second storage means for storing information on the video chat and user information used after the video chat is terminated. Interactive system. A program for an interactive system using a network in which a user terminal and an operator terminal having an imaging unit, a display unit, and a first application capable of video chat, an operator terminal, and a server are connected via a communication line. ,
In the server,
A first storage step for storing a user's login ID, application ID, and terminal-specific ID set in advance, a login ID and password of an operator set in advance, and an application ID;
A first collating step of collating a login ID input from the user terminal and a terminal unique ID;
A second verification step for verifying the login ID and password input from the operator terminal;
When the user terminal logs in to the server via the first collating means, a notification step of notifying the display of the operator terminal that has logged into the server via the second collating means of the user login In the operator terminal,
When the user logs in to the server, the notification unit displays user information and a notification button on the display unit of the logged-in operator terminal;
An application starting step of starting the first application by an operator clicking the notification button;
A program for an interactive system using a network, comprising: a video chat start step for starting a video chat with a user terminal using a user application ID.

Images