JP2022110547A - Remote interview system, terminal display method and program - Google Patents

Abstract

To provide a remote interview system, a terminal display method, and a program capable of improving the convenience of remote interviews by effectively utilizing the area of a system screen during a video call.SOLUTION: A remote interview system 1 that supports a video call between a plurality of user terminals 2 connected via a communication network 3 includes a screen generation unit 43 that generates a system screen 7 to be displayed on a user terminal during the video call, and a content generation unit 44 that generates a content used in the video call in a frame unit 71, and the screen generation unit generates a frame unit configured to freely appear and disappear on the system screen, and a plurality of camera frame units 72 that project camera images of the respective user terminals, displays the camera frame unit in the system screen and displays an operation tab 70 for allowing the frame unit to appear and disappear by the operation.SELECTED DRAWING: Figure 1

Description

There is an application for application of Article 30, Paragraph 2 of the Patent Law Published on the website (https://www.alphagorilla.co.jp/) and pamphlet on February 25, 2020 (see attachments 1 and 2) ) On March 18, 2020, etc., it will be published on the website at the address listed in the attachment (see attachments 1 to 12). Sign a contract to introduce the system of the present application and start using it

The present invention relates to a remote interview system, a terminal display method, and a program that support video calls.

In recent years, remote interview systems, in which users in remote locations make video calls, have rapidly spread, and are widely used not only in private use but also in the business scene. Although various applications have been developed with progress in communication technology, the screen display area of the user terminal used in the remote interview is limited. Therefore, although a large amount of information can be referred to on the display unit of the user terminal, how to display such information is a problem.

For example, Patent Literature 1 and Patent Literature 2 below propose user-friendly interfaces.

JP 2008-191357 A JP 2020-117093 A

The remote interview system that supports video calls is expected to be used in various scenes such as remote medical examination, job hunting, and individual interviews between schools and students. The system needs to be more convenient and safer than a real interview, and an interface that can be used without resistance even for the first time is required.

In the business scene, for example, when negotiating with a real estate agent or goods purchaser, getting an estimate from a moving company, inspecting various facilities, or inspecting the site of an accident, there is no need for face-to-face communication. Furthermore, there is a need for a system that can perform a series of actions such as selecting a property, checking the site and goods, exchanging quotes and contracts, and making payments through video calls.

In order to solve such problems, the present invention provides a remote interview system, a terminal display method, and a program that can effectively utilize the area of the system screen during a video call and improve the convenience of remote interviews. It is in.

In order to achieve the above object, the remote interview system of the present invention is a remote interview system that supports video calls between a plurality of user terminals connected via a communication network, wherein the user A screen generation unit that generates a system screen to be displayed on the terminal, and a content generation unit that generates content used in the video call in the frame unit, wherein the screen generation unit can freely appear on the system screen. and a plurality of camera frame portions for projecting camera images of the respective user terminals. It is characterized by displaying an operation tab that allows haunting.

A terminal display method for a remote interview system according to the present invention is a terminal display method for a remote interview system that supports a video call between a plurality of user terminals connected via a communication network, the terminal display method comprising: In the system screen displayed on the user terminal, there is an operation tab that displays a camera frame part that projects the camera image of each of the user terminals and that allows the frame part in which the content used in the video call is generated to appear. When the operation tab is displayed and the operation tab is operated, the frame portion is displayed so as to slide laterally and protrude.

Further, a program for a remote interview system according to the present invention causes a processor to execute the terminal display method described above.

According to the remote interview system, the terminal display method, and the program of the present invention, it is possible to effectively utilize the area of the system screen during the video call and improve the convenience of the remote interview.

1 is a system system diagram of a remote interview system and a block diagram of a server according to an embodiment of the present invention; FIG. (a) is a block diagram of a host terminal in the same embodiment, and (b) is a block diagram of a guest terminal in the same embodiment. FIG. 4 is a diagram showing a schematic flowchart up to the start of a video call in the remote interview system of the same embodiment; (a) and (b) are the figures which showed typically an example of the system screen displayed on the display part of the host terminal in the same embodiment. It is the figure which showed typically an example of the system screen displayed on the display part of the host terminal in the same embodiment. It is the figure which showed typically an example of the system screen displayed on the display part of the host terminal in the same embodiment. It is the figure which showed typically an example of the system screen displayed on the display part of the host terminal in the same embodiment. It is the figure which showed typically an example of the system screen displayed on the display part of the host terminal in the same embodiment. It is the figure which showed typically an example of the system screen displayed on the display part of the host terminal in the same embodiment. (a) and (b) are diagrams schematically showing an example of a system screen displayed on the touch panel of the guest terminal in the same embodiment. FIG. 4 is a diagram schematically showing an example of a system screen displayed on the touch panel of the guest terminal in the same embodiment; FIG. 4 is a diagram schematically showing an example of a system screen displayed on the touch panel of the guest terminal in the same embodiment; (a) and (b) are diagrams schematically showing an example of a system screen displayed on the touch panel of the guest terminal in the same embodiment. (a) and (b) are schematic diagrams for further explaining the configuration of the operation tabs of the system screen in the same embodiment, and (c) and (d) are the operation tabs of the system screen in the same embodiment. It is the figure which showed the modification typically. (a) and (b) are diagrams schematically showing modifications of the frame portion of the system screen in the same embodiment. It is the figure which showed typically an example of the service history table memorize|stored in the history information storage part of the server in the same embodiment.

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the accompanying drawings.

The remote interview system 1 in this embodiment is a system that supports video calls between a plurality of user terminals 2, 2, . . . connected via a communication network 3 such as the Internet. The remote interview system 1 includes a screen generation unit 43 that generates a system screen 7 displayed on the user terminal 2 during a video call, a content generation unit 44 that generates content used in the video call in a frame unit 71, It has The screen generation unit 43 generates a frame portion 71 configured to freely appear on the system screen 7 and a plurality of camera frame portions 72 for projecting camera images of the respective user terminals 2 . The remote interview system 1 is configured to display a camera frame portion 72 in the system screen 7 and to display an operation tab 70 that allows the system screen 7 to appear and disappear by an operation.

Although the present invention can be modified or substituted, an example in which the remote interview system 1 is applied as a business negotiation support tool for car sales will be described in detail below. Moreover, the description herein of the exemplary embodiments is not intended to limit the invention to the particular forms disclosed.

<Remote interview system>
First, as shown in FIG. 1, the remote interview system 1 of the present embodiment comprises a server 4 and a plurality of user terminals 2, 2 via a communication network 3, and is in a state in which mutual communication is possible under a secure environment. used in The communication network 3 may be a circuit-switched network such as a public switched telephone network (PSTN) or a packet-based network such as the Internet, and the communication standard is not particularly limited as long as it is a communication network capable of video calls. Communication network 3 includes any network that provides data communication via radio signals. Optional networks include, for example, wireless local area networks (WLANs) using WiFi/WiMax communications. By accessing the server 4 through the communication network 3, the user terminals 2, 2 can acquire the system screen 7 (interface) shown in FIG.

<Server>
The server 4 is composed of an information processing device such as a computer, and is managed by the administrator terminal 10 of the service provider of the remote interview system 1 . The server 4 may be a single server, or may be composed of a plurality of servers such as an application server and a database server, and may be dedicated or general-purpose. A firewall may of course be provided between the server 4 and the communication network 3 . The server 4 includes, as shown in FIG. At least a part 47 and a chat processing part 48 are provided.

The control unit 40 includes a CPU, and the CPU executes various programs stored in the storage unit 42 to execute various processes. The communication unit 41 executes transmission and reception of data and the like with the user terminals 2, 2, . . . For example, the communication unit 41 receives a terminal change operation at the user terminal 2 and transmits a read code to the user terminal 2 that has performed the terminal change operation. The storage unit 42 stores various programs and data necessary for the server 4 to operate. Specifically, various programs such as an operating system (OS), a video call establishment application program, a terminal change application program, a screen sharing application program, and a content editing application program are stored. The storage unit 42 also stores the file dropped on the system screen 7 . The storage unit 42 includes a user information storage unit 42a and a history information storage unit 42b. The user information storage unit 42a stores user information (login ID (identifier for identifying the user), mobile phone number, etc.) who uses the service of the remote interview system 1 (hereinafter referred to as service). Since this service is not limited to video calls, it is also possible to exchange messages (chat) and share files. ), to store shared files, etc. The screen generator 43 generates the system screen 7 displayed on the user terminals 2, 2 during a video call between the user terminals 2, 2. FIG. Here, the system screen 7 means a screen displayed on the display unit 54 or the touch panel 64 of the user terminals 2, 2 while the application of the remote interview system 1 is running (see FIG. 4, etc.).

The screen generator 43 generates the system screen 7 . Specifically, the screen generation unit 43 generates a frame portion 71 configured to freely appear and appear in the system screen 7, and a plurality of camera frame portions 72 for projecting camera images of the user terminals 2, 2 (FIG. 7 etc.). The screen generation unit 43 generates frame portions 71 separately for the left and right sides of the system screen 7, and generates the frame portions 71 so as to slide laterally and protrude when an operation of the operation tab 70 is detected. Further, when a terminal change operation is performed during a video call, the screen generator 43 generates a screen that displays the read code converted by the code converter 46 . The screen generating unit 43 also generates a screen for iconifying the file dropped on the system screen 7 and displaying the file on the system screen 7 .

The content generation unit 44 generates the content used in the video call in the frame portion 71 . In the case of car sales, the contents assumed here include contents for referring to the inventory list, contents for reviewing quotations and sales contracts, contents for settlement by card, etc., and contents that can be exchanged between the user terminals 2, 2. Point to chat, etc. The content generation unit 44 generates the content posted in the frame portion 71 of the transmission source user terminal (host terminal 5) so that the user can operate and edit such as character input, search, and selection. The frame part 71 of (guest terminal 6) generates so that the content based on the selection operation performed on the source user terminal side is displayed.

Upon receiving a mail destination from the user terminal 2, the mail generating and transmitting unit 45 generates a simple mail including access permission information for starting a video call session with the source user terminal 2 (host terminal 5), The mail is sent to the destination user terminal 2 (guest terminal) of the mail destination.

The code conversion unit 46 converts the access permission information assigned to the video call between the user terminals 2, 2 into a read code when detecting a terminal switching operation performed in the user terminal 2 (host terminal 5).

The detection unit 47 detects that a file has been dropped onto the system screen 7 during a video call.

The chat processing unit 48 automatically posts to each of the user terminals 2 the access permission information that allows access to the file dropped in the system screen 7 on the chat conversation screen.

<User terminal>
In the present embodiment, the user terminals 2, 2 are assumed to be a host terminal 5 used by a salesperson or the like at a car dealer, and a guest terminal 6 used by a customer who is considering purchasing a car. . The host terminal 5 may be a notebook or desktop personal computer, a tablet terminal, or a smart phone. In short, any terminal device can be used as the host terminal 5 as long as it can make a video call via the communication network 3 and can transmit and receive data, files, etc. to and from the server 4 . In this embodiment, a case where a personal computer is used as the host terminal 5 will be described. The host terminal 5 is a user terminal that performs service usage registration, that is, provides personal information/corporation information such as a telephone number and e-mail address, and a password to the service provider for registration to use the service. The host terminal 5 includes a control unit 50, a communication unit 51, a storage unit 52, a camera/speaker/microphone 53, a display unit 54, and an operation unit 55, as shown in FIG. The control unit 50 includes a CPU, and the CPU executes a predetermined program stored in the storage unit 52 to execute various processes. The communication unit 51 transmits and receives data, files, etc. to and from the server 4 . The storage unit 52 includes a memory such as a ROM and a RAM, and an HDD, and stores computer programs and the like for transmitting and receiving various data. The camera 53a in the camera/speaker/microphone 53 is a camera capable of transmitting its own moving image in a video call, the speaker 53b is a speaker capable of outputting the voice of the other party, and the microphone 53c is a microphone capable of transmitting voice in a video call. , is not particularly limited. The display unit 54 is a user interface that displays various types of information under the control of the control unit 50, and is composed of a liquid crystal panel or the like. An operation unit 55 is a user interface that receives user operations, and includes a keyboard and a mouse.

The guest terminal 6 can also be a personal computer, a tablet terminal, etc. In short, any terminal device can be used as long as it can make a video call via the communication network 3 and can send and receive data, files, etc. to and from the server 4, and is not particularly limited. . In this embodiment, a case where a smartphone is used as the guest terminal 6 will be described. The guest terminal 6 is a user terminal that has not been registered for use of the service, in other words, is a user terminal that does not need to be registered for use of the service. As shown in FIG. A unit 62 , a camera/speaker/microphone 63 and a touch panel 64 are provided. The control unit 60 includes a CPU, and the CPU executes a predetermined program stored in the storage unit 62 to execute various processes. The communication unit 61 transmits and receives data, files, etc. to and from the server 4 . The storage unit 62 is composed of a memory such as a ROM and a RAM, and an HDD, and stores computer programs and the like for transmitting and receiving various data. The touch panel 64 is a user interface that displays various types of information under the control of the control unit 60 and receives a tap operation by the user, and is configured by a display that can detect contact with an external object. The camera/speaker/microphone 63 may be any device that enables a video call in the same manner as the host terminal 5 .

<Basic flow until video call start of remote interview system>
Next, with reference to FIGS. 3 to 6, 10, 11, etc., an example of basic operations up to the start of a video call using the remote interview system 1 will be described together with examples of display on the display section 54 and the touch panel 64. FIG. Here, we will explain how a car salesperson starts business negotiations with a new customer using video calls for the first time. Also, here, an example will be described in which a user's login ID for accessing the server 4 on the host terminal 5 side has already been issued and the password setting has been completed. Needless to say. Furthermore, the host terminal 5 of the user terminals 2 may be configured to install a dedicated module when using the service, or may be configured to use a browser.

First, the salesperson of the host terminal 5 activates an application installed in the host terminal 5 or accesses a predetermined URL to open a login screen. Then, the ID and password are entered on the login information input screen (S100, see FIG. 4A), and the login ID information is transmitted. At the server 4, authentication processing is executed based on the transmitted login information (S101). When the authentication process is completed, the predetermined system screen 7 is read out (S102) and transmitted to the host terminal 5. FIG.

When the authentication process is correctly executed, the system screen 7 is displayed on the display unit 54 of the host terminal 5 (see FIG. 4(b)). FIG. 4B shows the system screen 7 when the remote interview system 1 is activated. When an operation tab 70a provided on the left side of the operation tabs 70 displayed on the system screen 7 is clicked, a frame portion 71a protrudes and a video call reservation page 71aa for inputting guest information of a customer to be invited to a video call appears. It is displayed in the system screen 7 (S103, see FIG. 5). Then, the guest name and mobile phone number of the new customer are entered in predetermined input fields on the video call reservation page 71aa of the frame portion 71a, and the video call issue button a (see FIG. 5) is clicked. Guest information is then sent to the server 4 . The mail generation/sending unit 45 generates a simple mail based on the acquired guest information. In the simple mail, a simple mail is generated in which the access permission information enabling the start of the video call is linked, and is sent to the mobile phone number (S104). The simple mail referred to here is mail sent using, for example, SMS (Short Message Service) or MMS (Multimedia Messaging Service) that can use a mobile phone number as a destination. The simple email sent to the guest terminal 6 is not limited to any specific text example. Any text that is easy to understand for the customer who receives it will suffice. Also, here, the access permission information linked to the simple mail means information about a link that is connected to the host terminal 5 so as to be able to make a video call, and is described as being a URL, but is not limited to this. In addition, the mode of linking the access permission information to the simple mail is not limited to the example of displaying the URL, and even if the URL is converted into a two-dimensional code such as a QR code (registered trademark), the URL can be accessed by clicking on it. It may be an iconized one.

When the simple mail arrives at the guest terminal 6, the customer taps the linked URL to access the URL (S106). When access to a predetermined URL is detected, a screen requesting permission to access the camera (63) of the guest terminal 6 is displayed (S107, see FIG. 10(b)). When the access to the camera 63a is permitted by the customer's operation, the image from the camera 63a is displayed, and when the access to the camera 53a is canceled, the system screen 7 is displayed without the image from the camera 63a. A call is started (S108, see FIG. 11). On the other hand, the server 4 generates a video call issuing screen with the guest terminal 6 directed to the host terminal 5, that is, a video call issuing page 71ab (see FIG. 6) (S105) and transmits it to the host terminal 5. FIG. Then, the video call issue page 71ab on the system screen 7 of the host terminal 5 is updated, and a new reservation is displayed (S109). When it is detected that the start button b (see FIG. 6) of the video call issuance page 71ab has been clicked by the salesperson, the video call is started (S110). File and chat exchanges between the host terminal 5 and the guest terminal 6 after the start of the video call are stored as a history log in the history information storage unit 42b (S111).

<Modified example of the flow up to the start of the video call of the remote interview system>
The flow up to the start of the video call is not limited to the above. For example, a flow for setting the video call reservation date and video call start time may be added to the above flow. Further, for example, a video call reservation may be made from the home page of the company (a car sales company in this embodiment). In this case, a reservation form is set up in which the customer who accesses the company's website can input the reservation date and time, the customer's name, the mobile phone number, or the e-mail address. Then, when the communication unit 41 of the server 4 receives the input information of the reservation form, it may be configured to notify the host terminal 5 that the video call has been reserved. As for the notification method, an e-mail may be sent to a predetermined e-mail address, or if an application for the service is installed in the host terminal 5, a notification flag may be set on the icon of the application. In this case, reservation date and time information may be included as guest information in step S103 of FIG. 3, and the reservation date and time information may be included in the simple mail generated in step S104 of FIG.

FIG. 16 schematically shows an example of the service history table stored in the history information storage unit 42b. As shown in the figure, the service history table T includes "user ID", "video call URL", "guest name", "guest information", "file log" and the like. Here, an example is shown in which the video call reservation date and time is also included as the management information “video call reservation date and time”. The "user ID" is an account set by the service provider, but it also includes an e-mail address, etc., arbitrarily changed to text by the user. Management information such as "video call URL", "guest name", "guest information", "file log", "video call reservation date and time" is stored in association with the "user ID" as shown in FIG. Therefore, only the user having the "user ID" associated with the "video call URL" and the guest invited by the user can access the corresponding "video call URL". Also, a predetermined “video call URL” associated with a predetermined “user ID” is used between users (customers in this embodiment) invited by users (sales representatives in this embodiment) who are permitted by ID authentication. Valid only in Therefore, when the customer invited by the salesperson is not using the service, for example, even if the customer accesses the URL linked to the simple email after the video call, the customer cannot use the service. .

According to the above configuration, by accessing the access permission information (URL) from the user terminal 2 that has received the simple mail, it is possible to easily start a video call with the source user terminal, that is, the host terminal 5 . At this time, the side that receives the simple mail, ie, the guest terminal 6 side, can make a video call without login authentication or the like, simply by informing the destination (mobile phone number) of the simple mail. Therefore, by providing a mobile phone number as personal information, a customer who intends to purchase a car can easily and securely access the service without downloading an application or registering as a member. You can have a video call with a sales representative under the environment.

<About the system screen on the host terminal side>
Next, the display of the system screen 7 on the host terminal 5 during service provision will be described with reference to FIGS. 4 to 9. FIG.

FIG. 4(a) shows a login screen for receiving service provision, as described above. When the login information is entered from this system screen 7 and the server 4 correctly executes the authentication process, the screen transitions to the screen shown in FIG. 4(b). FIG. 4(b) shows the system screen 7 before starting a video call with the customer.

As shown in FIG. 4(b), the system screen 7, which has a horizontally long rectangular shape in accordance with the shape of the display unit 54 of the host terminal 5, displays images of the user who makes the video call, specifically, images captured by the cameras 53a and 63a. a camera frame portion 72 for projecting both the salesperson and the customer, a frame portion 71 configured to freely appear in the system screen 7, and an operation tab 70 for operating the appearance of the frame portion 71. The camera frame portion 72 includes a host camera frame portion 72a for projecting an image (salesperson) captured by the camera 53a on the host terminal 5 side, and a guest camera frame for projecting an image (customer) captured by the camera 63a on the guest terminal 6 side. and a portion 72b. The camera frame portion 72 is generated so as to display the image of the user in a small size and the image of the other party of the video call in a large size. Therefore, on the system screen 7 of the host terminal 5 side, the guest camera frame portion 72b is displayed largely in the substantially central area of the system screen 7, and the host camera frame portion 72a is displayed small in the upper left of the system screen 7.

The frame portion 71 is generated in a substantially rectangular shape separately for the left and right sides of the system screen, and is generated so that the frame portion 71 slides in the horizontal direction and protrudes when an operation of the operation tab 70 is detected. FIG. 4B shows a state in which the left and right frame portions 71a and 71b are hidden and stored, and only the operation tabs 70 (70a and 70b) are displayed on the left and right. The operation tabs 70a and 70b are displayed in convex shapes on the edge portions 70c and 70d on the protruding sides of the left and right frame portions 71a and 71b, respectively. In the semicircular convex operation tabs 70a and 70b, direction indications of ">" and "<" suggesting the direction in which the frame portions 71a and 71b are pulled out are made. According to this, it can be intuitively recognized that the frame portions 71a and 71b are pulled out toward the center of the system screen 7 by clicking the operation tabs 70a and 70b. Also, since the frame portions 71a and 71b are generated on both the left and right sides, the amount of information that can be referred to within the system screen 7 can be greatly increased. Furthermore, since various pages can be added to the frame portions 71a and 71b as shown in FIGS. Further, when the operation tabs 70a and 70b are operated, the frame portions 71a and 71b are displayed by sliding in the horizontal direction, so that the system screen 7 area can be effectively utilized. For example, when it is desired to have a face-to-face meeting while confirming the customer's face during a video call, the frame portions 71a and 71b may be stored as shown in FIG. 4(b). Moreover, even when the frame portions 71a and 71b are pulled out, the guest camera frame portion 72b is displayed largely in the approximate center of the system screen 7, so that business negotiations can be conducted as if they were actually having a meeting. .

The lower column of the system screen 7 is an operation area 73 in which various operation buttons are displayed side by side. Here, a terminal change button 73a that enables switching to another terminal during a video call, a camera switching button 73b that changes the direction of shooting with the camera 53a, a camera off button 73c that stops shooting with the camera 53a, a video call , a shooting button 73d for taking a screenshot of the system screen 7 as it is, and a business card display button 73e for displaying the business card of the salesperson. The terminal change button 73a and the like are displayed as pictogram icons. As a result, the user can intuitively understand the operation functions, so even users who use the service for the first time can easily use it. Further, the arrangement order of various operation buttons in the operation area 73 may be generated so that the user can change the arrangement order by dragging and dropping according to the content of the business negotiation.

The terminal change button 73a is a button for changing the terminal used during the video call. When the terminal change button 73a is clicked, the read code converted by the code conversion unit 46 is displayed in the center of the system screen 7 (not shown). When the salesperson reads the reading code with the camera of the terminal they want to change, they can access the "video call URL" on the read terminal. Therefore, for example, if a customer wishes to see the actual car (a specific item) that the customer is considering purchasing during a video call business meeting, the salesperson can easily change the device from a personal computer to a smartphone. For customers, even in remote web negotiations, they can see actual purchases, not photos or catalogs. Also, the shooting button 73d is convenient because the screen displayed during the negotiation can be taken as it is. If the screen shot file is automatically posted on the chat page 71bc, it will remain as a history and will be saved at the next negotiation, so that subsequent negotiations can be conducted smoothly.

5 and 6 are diagrams showing display examples of the left frame portion 71a, showing a state in which the entire frame portion 71a is pulled out. The frame portion 71a can be pulled out up to about one third of the system screen 7 on the horizontally long system screen. The frame portion 71a is generated so as to include content that does not need to be shared with the guest terminal 6 side, and FIG. 5 shows an example in which a video call reservation page 71aa is displayed as an example. This video call reservation page 71aa is content used by users who have registered to receive the service, and this content is intentionally restricted so that it is not displayed on the guest terminal 6. FIG. A salesperson who receives a video call request from a customer activates the system screen 7, logs in from the login screen (see FIG. 4(a)), clicks the operation tab 70a, and protrudes the frame portion 71a. After that, the video call reservation page 71aa is opened. Then, by inputting the guest name and mobile phone number from the video call reservation page 71aa and clicking the video call issue button a, the video call can be reserved with the customer.

FIG. 6 shows a display example of a video call issuing page 71ab as the content loaded in the left frame portion 71a. A video call reservation list is generated and displayed on the video call issuing page 71ab. In the reservation list, the date and time of the video reservation and the name of the customer are displayed, and the information is updated sequentially. If the salesperson clicks the start button b displayed on the video call issuance page 71ab, the video call with the customer is started. configured to start.

As described above, if the content generated in the frame portion 71a is information that does not need to be shared with the customer, the use of the left frame portion 71a and the right frame portion 71b can be segregated. In this embodiment, the frame portion 71a on the left side is content that is essential for establishing a video call, but is also content that is assumed to be rarely seen during a video call. The system screen 7 can be effectively used by storing the frame portion 71a. Further, as shown in FIG. 6, if personal information and company information of other customers are posted in the left frame portion 71a, it is possible to prevent operation errors such as inadvertent sharing of information with customers.

7 to 9 are diagrams showing display examples of the right frame portion 71b, showing a state in which the entire frame portion 71b is pulled out. The frame portion 71b can be pulled out up to about half the system screen 7 on the horizontally long system screen. Also, as shown in FIG. 7 and the like, even when the frame portion 71b is pulled out, the off button 75 is generated at a position where it can be visually recognized, and the terminal change button 73a, which is likely to be used during business negotiations by video call, is placed on the left side. is generated in Therefore, it is possible to improve the operability even when the frame portion 71b is referred to. Even when the frame portion 71b is pulled out in this way, the guest camera frame portion 72b is displayed in a large size, so that the information in the frame portion 71b can be referred to while interviewing the customer. Also, the meeting can proceed while visually recognizing the host camera frame portion 72a at the upper left corner. The frame portion 71b is generated so as to include content shared with the guest terminal 6 side, and FIG. 7 shows an example in which an inventory reference page 71bb is displayed as an example. The inventory reference page 71bb is a page where a user can select a vehicle while browsing the inventory status of the vehicle. The content posted on the stock reference page 71bb may be retrieved from the stock reference page of the home page of the company and displayed. On the host terminal 5 side, it is possible to search by entering a keyword matching the customer's request in the input field c provided on the inventory reference page 71bb, or to search by selecting a car company, vehicle type, and the like. If the search function is a function unique to the system screen 7 on the host terminal 5 side, the salesperson can proceed with the negotiation while leading it in accordance with the customer's request. When a car of interest is found, the check box d is marked and detailed information of the car can be confirmed by clicking the details button e. At this time, as shown in FIG. 12, the guest terminal 6 displays the same stock information as the host terminal 5 side, but generates a system screen 7 so as not to display unnecessary stock for the search function and the customer. , and is intentionally displayed differently.

In FIG. 7 and the like, icons 74a and 74b of files shared in the business negotiation are displayed at the lower left of the guest camera frame portion 72b of the system screen 7. FIG. These icons 74a and 74b are files dropped on the system screen 7 by the salesperson during business negotiations by video call. 74. For example, if there is a file saved in the host terminal 5 that is effective for business negotiations and the customer wants to share it, the salesperson can drag the shared file and drop it onto the system screen 7, and the host terminal 5 The file is stored in the drop storage area 74 on the side. At this time, the file is stored in the history information storage unit 42b of the server 4 by dropping the file. When the file is opened on the host terminal 5 side, the contents of the file are displayed in a large size on the system screen 7 (not shown), and the dropped file is also displayed on the guest terminal 6 side, allowing both parties to share the file. become. Since the guest terminal 6 can share files via the storage unit 42 of the server 4 instead of sharing the screen itself of the host terminal 5, both the host terminal 5 side and the guest terminal 6 side can share. You can open/close, enlarge/reduce, and download files independently of each other.

According to the above, the same file in a clear state can be visually recognized by the host terminal 5 and the guest terminal 6 as compared with the case of sharing the screen of the host terminal 5 and referring to the file. In addition, files can be easily shared during a video call by simply dropping them, so even if you are using the service for the first time, you can easily share files with customers. Also, since the shared file is iconized and saved in the drop save area 74, confirmation after saving is easy. Furthermore, once the video call is terminated and resumed and the session is called again, the icons 74a and 74b displayed in FIG. 7 are also displayed again, so that the dropped file can be opened. Then, if the salesperson performs an operation of dropping and opening a file, the file can be shared with the guest terminal 6, that is, an operation similar to that of transmitting the file to the guest terminal 6 can be performed. It can be said that it is very simple compared with the operation.

FIG. 8 shows a display example of a chat page 71bc as content mounted in the right frame portion 71b. Chat can be performed between the host terminal 5 and the guest terminal 6 on this chat page 71bc. When a message is sent from the message column g, the camera images of the host camera frame portion 72a and the guest camera frame portion 72b may be captured and displayed as the speaker's icon f. You may input and set a photograph, a name, a company name, etc. which are displayed on f. In this case, it is possible to immediately intuitively recognize from which side the caller of the chat is calling. The storage unit 42 stores video calls, chats, and file transmission/reception between the host terminal 5 and the guest terminals 6, and these contents are stored in the access permission information assigned to the "user ID", that is, the "video call URL". Associate and store. Therefore, even after the terminal is changed or the video call itself is temporarily terminated, it is possible to continue based on the content of the previous session. Furthermore, the chat processing unit 48 automatically sends access permission information, specifically link addresses, to the conversation screen of the chat page 71bc to the host terminal 5 and the guest terminal 6 so that the file dropped in the system screen 7 can be accessed. Posted in. Therefore, by looking at the chat page 71bc, it is possible to check the chat history, the exchange history of the file, and the file itself.

FIG. 9 shows a display example of an estimate page 71ba as content mounted in the right frame portion 71b. This estimate page 71ba contains information that allows a specific estimate to be presented when purchasing a car. The operation at this time is generated so that it can be performed only on the host terminal 5 side, and it is generated so that the estimate can be reviewed according to the customer's request while performing a video call. Also, this estimate page 71ba is generated so that a sales contract form is displayed when the sales contract button h of the radio button is clicked. Therefore, by utilizing the frame portion 71b on the right side, it is possible to select a car while sharing the same information as the customer. It is configured so that it can also be exchanged.

As described above, if the content generated in the frame portion 71b is information that needs to be shared with the customer and contains various content necessary for business negotiations, it will be different from a real face-to-face business negotiation for the user. You can receive service without feeling. At this time, the information to be shared with the customer is not simply summarized in the frame portion 71b, but by categorizing each page (71ba to 71bc) into categories suitable for business negotiations and laying them out, a user interface that is extremely easy to use is created. realizable. Further, the frame portions 71a and 71b can appear and disappear by clicking the operation tabs 70a and 70b. Therefore, the operability of displaying and hiding the frame portions 71a and 71b can be improved without interfering with the display of the camera frame portion 72. FIG. The frame portions 71a and 71b may appear and disappear in such a manner that both users can individually operate the operation tab 70, but only the host terminal 5 side may be operable. In this case, the customer side can proceed with business negotiations passively without any particular operation. In this case, for example, on the side of the host terminal 5, when it is desired to check the customer's facial expression while referring to the stock reference page 71bb, the operation tab 70b is clicked, and the frame portion 71b immediately retracts. The entire area of the guest camera frame portion 72b can be displayed. Since the frame portions 71a and 71b are generated on both the left and right sides in this manner, the amount of information that can be referred to by the frame portions 71a and 71b can be increased.

<About the system screen on the guest terminal side>
Next, the display of the system screen 7 on the guest terminal 6 when the service is provided will be described with reference to FIGS. 10 to 13. FIG. 10 to 13 are used for items common to the host terminal 2, but the screen generator 43 is for the host terminal 5 and for the guest terminal. It is programmed to generate screens corresponding to each of the 6. In the following, differences from the configuration of the system screen 7 for the host terminal 5 will be mainly described.

FIG. 10(a) is a diagram schematically showing a state in which a simple mail delivered to the guest terminal 6 is opened on the touch panel 64 of the guest terminal 6. FIG. FIG. 10(b) is a diagram schematically showing a display screen for obtaining access permission to the camera 63a. First, the customer taps the URL linked to the simple mail shown in FIG. 10(a). Then, a screen requesting permission to access the camera 63a (FIG. 10B) is displayed. Here, when an operation to permit or cancel access to the camera 63 a is performed, a video call is started and the system screen 7 is activated on the guest terminal 6 .

FIG. 11 is a diagram schematically showing an example of a state in which access to the cameras 53a and 63a of both the host terminal 5 and the guest terminal 6 is permitted, video calls are enabled, and service provision is started. The system screen 7 has a vertically long rectangular shape in accordance with the shape of the touch panel 64 of the guest terminal 6, and the system screen 7 displays the image of the user making the video call, specifically the salesperson and the customer photographed by the cameras 53a and 63a. a camera frame portion 72 for projecting both of them, a frame portion 71 configured to freely appear and appear in the system screen 7, and an operation tab 70 for operating the appearance and disappearance of the frame portion 71. FIG. The camera frame portion 72 includes a host camera frame portion 72a for projecting an image (salesperson) captured by the camera 53a on the host terminal 5 side, and a guest camera frame for projecting an image (customer) captured by the camera 63a on the guest terminal 6 side. and a portion 72b. On the system screen 7 on the guest terminal 6 side, the host camera frame portion 72a is displayed large over almost the entire system screen 7, and the guest camera frame portion 72b is displayed small at the upper left of the system screen 7. FIG. Although an example in which access to the cameras 53a and 63a of both the host terminal 5 and the guest terminal 6 is permitted is described here, the present invention is not limited to this. Often, in that case, the guest camera frame portion 72b is displayed in an off state.

In the guest terminal 6 as well, the lower column of the system screen 7 is an operation area 73 in which various operation buttons are displayed side by side. Here, a camera switching button 73b for changing the shooting direction with the camera 63a, a camera off button 73c for stopping shooting with the camera 63a, and an off button 75 for ending the video call are arranged from the left side. On the guest terminal 6 side, the terminal change button 73a and the photographing button 73d are not provided because the guest terminal 6 side has the minimum necessary functions and is configured so as not to make the customer side troublesome operations as much as possible. It may also be generated on the side.

In the example of FIG. 11, a business card display i is displayed above the system screen 7 (frontmost) so as to overlap the host camera frame portion 72a. This business card display i is the business card of the person in charge of sales, and is displayed on the guest terminal 6 side as shown in FIG. This allows customers to verify the name of their sales representative.

FIG. 12 is a diagram schematically showing a display example of a state in which a business negotiation is in progress by video call with the host terminal 5, and is a diagram corresponding to FIG. 7 on the host terminal 5 side. The frame portion 71 is generated in a substantially rectangular shape only on the right side, and is generated so that the right frame portion 71b slides in the lateral direction and protrudes when an operation of the operation tab 70b is detected. The operation tab 70b is displayed in a convex shape on an edge portion 70d of the projecting side of the right frame portion 71b. Note that FIG. 11 shows a state in which the right frame portion 71b is hidden and stored, and only the operation tab 70b is displayed on the right side, and no frame portion is provided on the left side.

The frame portion 71b can be pulled out up to about one-half of the system screen 7 on the vertically long system screen. In addition, in the frame portion 71b, an estimate page 71ba, an inventory reference page 71bb, and a chat page 71bc are generated in the same manner as on the host terminal 5 side. What can be done is restricted to the chat page 71bc only. As a result, the salesperson can take the lead in proceeding with the negotiations, and the customer side can proceed with the negotiations as they proceed while looking at the system screen 7 . In addition, on the guest terminal 6 side, since the frame part 71b is configured with a focus on clearly conveying necessary information in an easy-to-understand manner so as not to overload the customer with information, an estimate page 71ba and an inventory reference page 71bb are configured. is different from that on the host terminal 5 side. For example, as for the cars displayed on the inventory reference page 71bb, a plurality of cars can be browsed on the host terminal 5 side (see FIG. 7), but only one car is displayed on the guest terminal 6 side. Then, according to the customer's request, this inventory reference page 71bb enlarges and displays the image of the car of "3,850,000 yen" by the operation of the salesperson, and enlarges and displays it on the system screen 7 of the guest terminal 6 side. The state shown is represented in FIG. Especially when the guest terminal 6 is a small terminal such as a smart phone, the display area is about 1/6 to 1/8 smaller than the display area of a desktop personal computer. The problem is that by restricting or simplifying the content posted in the frame portion 71b in this way, it becomes easier for customers to obtain the information they want.

FIGS. 13A and 13B are diagrams schematically showing a display example of a state in which a business negotiation is in progress by video call with the host terminal 5. When the terminal used on the host terminal 5 side is changed from a personal computer to a smartphone. shows an example in which the terminal has been changed. It is effectively used when the customer wants to see the actual car, not the photos or catalogs. Therefore, in this case, the host terminal 5 is switched (switched) from the personal computer to the smart phone, so the camera image mounted on the smart phone is displayed in the host camera frame portion 72a. FIG. 13(a) shows a state in which a car seat of a purchase candidate is displayed according to a customer's request. FIG. 13(b) also shows a state in which the vicinity of the shift lever of the candidate car is shown. At this time, since the host camera frame portion 72a is displayed in a large size on the system screen 7 of the guest terminal 6, the customer can confirm the car of the purchase candidate in the same way as seeing it in real life. In particular, when the purchase target is a specific item such as a used car, business negotiations can proceed while confirming the degree of scratches and dirt on the seat.

<Operation tab>
14A and 14B are diagrams for further explaining the configuration of the operation tab 70 on the system screen 7. FIG. As shown in FIG. 14(a), the operation tab 70 according to the present embodiment has the frame portions 71a and 71b retracted. , 71b are displayed so as to face the drawing direction. Then, as shown in FIG. 14(b), the operation tab 70b of the frame portion 71b pulled out is generated so that the orientation of the direction display is switched to the retraction direction. According to this, when the frame portions 71a and 71b are retracted, the operation tabs 70a and 70b imply the existence of the frame portions 71a and 71b. The moving direction (sliding direction) of 71b can also be implied. Therefore, by clicking the operation tabs 70a and 70b, the user can intuitively recognize that the frame portions 71a and 71b are pulled out toward the center of the system screen 7, and even a user who uses the service for the first time can easily understand the operation method. can recognize.

14(c) and (d) are diagrams schematically showing modifications of the operation tab 70 and the like of the system screen 7. FIG. It is desirable that the operation tab 70 be positioned at the edge of the projecting side of the frame portion 71 . Therefore, if the frame portion 71 is configured to protrude from the upper and lower sides instead of the left and right sides, the upper and lower operation tabs 70 may be generated as shown in FIG. 14(c). Also, the operation tab 70 may be generated so that it can be moved and arranged at any desired position by the user, as shown in FIG. 14(d). Further, the operation area 73 described above may be generated on the upper side as shown in FIG. 14(d) instead of the lower side of the system screen 7 as shown in FIG. 14(a) and the like. Also, although not shown, it may be on the left side or the right side.

<The haunting of the frame part>
FIGS. 15(a) and 15(b) show modified examples of the appearance and retraction directions of the frame portions 71a and 71b.

In the above-described embodiment, an example in which the frame portions 71a and 71b appear and disappear from the left and right has been described, but the present invention is not limited to this. As shown in FIG. Alternatively, as shown in FIG. 15B, it may be generated so as to protrude obliquely from the left corner. The shape of the frame portions 71a and 71b is not limited to square, and may be fan-shaped as shown in FIG. 15(b).

As described above, the configuration and mode of the remote interview system 1 according to the present invention are not limited to the above embodiments. For example, in the above embodiment, a two-party call was explained as an example, but two or more parties may be involved. Moreover, although the example which exchanges with a personal computer and a smart phone as the user terminal 2 was demonstrated, smart phones may be sufficient. Although an example of selling a car has been described, if the content mounted on the frame section 71 is changed, it can be used for any type of industry and for any purpose. For example, a website may be displayed within the frame portion 71 as the content of the frame portion 71, or a share button (not shown) may be provided within the frame portion 71, and when the share button is clicked, the same screen as that of the guest terminal 6 may be displayed. It may be made available for sharing. For example, when used for telemedicine, the host terminal 5 is used by a doctor, and the guest terminal 6 is used by a patient. When used for job hunting, the host terminal 5 is used by personnel personnel, and the guest terminal 6 is used by job applicants for personal interviews at schools. In this case, it is assumed that the host terminal 5 is a teacher and the guest terminal 6 is a student. In such a case as well, the frame portion 71a on the left side contains content that enables confirmation of the history of communication with other users and is not displayed on the guest terminal 6 side, and the frame portion 71b on the right side contains a video Information that you want to share with the person you are talking to should be loaded. Even in that case, instead of sharing all the information as in the above embodiment, it is sufficient that the host terminal 5 side leads and generates content that can provide the other party with necessary information. In addition, even if it is used as a business tool, it is not limited to the case of car sales, and can be used simply face-to-face in situations such as business negotiations with real estate agents and goods purchasers, estimates from moving companies, facility inspections, site inspections of accident situations, etc. In addition to the need to make a call with a video call, it is possible to select a property, check the site and goods, exchange quotations and contracts, make payments, etc., all through video calls.

Further, in order to enhance security, a step may be added in which a customer who has not registered to use the service enters a password or an authentication code before accessing the URL. Also, when the customer accesses the URL linked to the simple mail, a cookie is given to the guest terminal 6 as guest terminal identification information, and the guest terminal identification information given as "video call URL". (cookie) may be associated with and stored. Furthermore, according to the above-described embodiment, simply by entering guest information from the video call reservation page 71aa on the host terminal 5 side and clicking the video call issuing button a, a simple email containing access permission information (URL) is sent to the customer. can be sent, the simple mail may be sent at the reservation date and time desired by the customer, or may be sent in advance. Further, according to this embodiment, the second and subsequent video calls with the customer can be made in the same way, and a simple e-mail containing the associated and stored access permission information can be sent to the guest terminal 6. You can easily start a video call with

Furthermore, the configuration of the system screen 7 is not limited to the illustrated example. The number of camera frame portions 72 is generated by the number of user terminals 2 that make video calls. . For example, the entire system screen 7 may be displayed when the frame portion 71 is pulled out and protruded. Also, the arrangement position and size of the camera frame portion 72 may be changed by the user as appropriate. Furthermore, the appearance/appearance operation of the frame portion 71b by the host terminal 5 side may be configured to be linked with the guest terminal 6 side, or may be operated individually. A configuration linked to the operation by the host terminal 5 side has the advantage that the host terminal 5 side can easily take the lead. In the above-described embodiment, it is assumed that the guest terminal 6 uses a smartphone, so the drop storage area 74 and the drop operation are not detectable. In the above-described embodiment, an example of performing a click or tap operation is described as an operation method, but the operation method is not limited to this, and a case of performing an operation by voice recognition is not excluded.

1 remote interview system 2 user terminal 3 communication network 4 server 43 screen generation unit 44 content generation unit 45 mail generation and transmission unit 5 host terminal 6 guest terminal 7 system screen 70 operation tab 71 frame unit 72 camera frame unit

Claims (8)

A remote interview system that supports video calls between multiple user terminals connected via a communication network,
a screen generation unit that generates a system screen to be displayed on the user terminal during the video call;
a content generation unit that generates content used in the video call in the frame unit;
The screen generation unit generates a frame portion configured to freely appear and appear on the system screen, and a plurality of camera frame portions for projecting camera images of the user terminals,
A remote interview system, wherein the system screen displays the camera frame portion and an operation tab that enables the frame portion to appear and disappear by an operation. In claim 1,
The remote interview system, wherein the operation tab is generated so as to be displayed in a convex shape on an edge portion of the projecting side of the frame portion. In claim 1 or claim 2,
The screen generation section generates the frame sections separately on the left and right sides of the system screen, and generates the frame sections so as to slide horizontally and protrude when an operation of the operation tab is detected. Remote interview system. In any one of claims 1 to 3,
When receiving an email destination from said user terminal, an email that generates a simple email containing access permission information for starting a video call session with the sending user terminal and sends it to said email destination user terminal. A remote interview system, further comprising a generator and transmitter. In claim 4,
The content generation unit generates the content in the frame section of the transmission source user terminal so that the content can be operated and edited, such as character input, search, and selection,
A remote interview system, wherein content is generated so as to be displayed in the frame portion of the destination user terminal based on a selection operation performed on the source user terminal side. In claim 4 or claim 5,
The remote interview system, wherein the content generation unit generates content to be shared between the user terminals in one of the left and right frame portions, and generates non-shared content in the other frame portion. A terminal display method for a remote interview system that supports video calls between a plurality of user terminals connected via a communication network,
In the system screen displayed on the user terminal during the video call, a camera frame part showing the camera image of each of the user terminals is displayed, and a frame part in which the content used in the video call is generated appears. Display the operation tab that allows you to
A terminal display method, wherein when the operation tab is operated, the frame portion slides in the horizontal direction and is displayed so as to protrude. A program for causing a computer to execute the terminal display method according to claim 7 .

Images