JP7200628B2 - Information processing system, information processing device, information processing method and program - Google Patents

Description

The present invention relates to an information processing system, an information processing device, an information processing method, and a program.

2. Description of the Related Art In an office, business is carried out using various devices. By utilizing various devices and applications, it is possible to expect efficiency improvement of business.

As one of them, a technique of automatically storing image data of an image captured by a terminal device in a predetermined storage destination is known. Specifically, for example, by installing a dedicated application on the terminal device, the terminal device stores the image data captured after reading the QR code (registered trademark) in the storage destination indicated by the QR code. It has been known.

However, conventionally, no consideration has been given to associating image data with imaging conditions, such as the location and time period in which the image data stored in the storage destination was imaged.

SUMMARY OF THE INVENTION It is an object of the present invention to store image data in association with the conditions under which the image data was captured.

The disclosed technology is an information processing system including an intermediary device that can communicate with a device and an information processing device that can communicate with the intermediary device, wherein identification information specifying a service is transmitted from the device to the mediation device . Specific information for specifying an output device for displaying input information, a receiving unit that accepts, and a service that activates the imaging function of the device corresponding to the identification information and uploads the captured image data. A transmitting unit that transmits an execution request of a process to be implemented to the device, image data that is associated with the specific information after being imaged by the imaging function, and image data that is imaged by the imaging function are stored. and an image data storage unit.

The image data and the conditions under which the image data was captured can be stored in association with each other.

1 is a diagram illustrating a configuration example of an information processing system according to a first embodiment; FIG. It is a figure which shows the hardware structural example of the server apparatus of 1st embodiment. It is a figure which shows the hardware structural example of the user terminal of 1st embodiment. It is a figure which shows the hardware structural example of the mediation apparatus of 1st embodiment. It is a figure for explaining the outline of the first embodiment. It is a figure which shows the functional structural example of each apparatus of 1st embodiment. FIG. 10 is a sequence diagram for explaining an example of a processing procedure executed in response to activation of the intermediary device according to the first embodiment; It is a figure which shows the structural example of the apparatus information storage part of 1st embodiment. It is a figure which shows the structural example of the registration information storage part of 1st embodiment. It is a figure which shows the structural example of the application information storage part of 1st embodiment. FIG. 4 is a diagram illustrating generation and allocation of passcodes according to the first embodiment; FIG. 4 is a diagram showing a display example of a passcode on the output device of the first embodiment; FIG. 7 is a sequence diagram for explaining an example of a processing procedure for uploading image data from a student terminal to a server device according to the first embodiment; It is a figure which shows the structural example of the account information storage part of 1st embodiment. FIG. 10 is a diagram showing a display example on the student terminal according to the first embodiment; FIG. It is a figure explaining the utilization scene of the information processing system of 1st embodiment. It is a figure which shows an example of the lesson information storage part of 1st embodiment. It is a figure which shows an example of the answer information storage part of 1st embodiment. It is a figure which shows an example of the blackboard information storage part of 1st embodiment. It is a figure which shows an example of the installation information storage part of 1st embodiment. It is a figure which shows an example of the passcode history storage part of 1st embodiment. It is a figure which shows an example of the display history memory|storage part of 1st embodiment. FIG. 7 is a diagram showing an example of a processing procedure for displaying an attendance list on the teacher terminal according to the first embodiment; FIG. 4 is a diagram showing a display example of the teacher terminal according to the first embodiment; FIG. 10 is a diagram for explaining an outline of a second embodiment; FIG.

(First embodiment)
Embodiments will be described below based on the drawings. FIG. 1 is a diagram illustrating a configuration example of an information processing system.

In the information processing system 1 shown in FIG. 1, the server device 10 and the user environment E1 can communicate via a wide area network N1 such as the Internet. However, the network N1 may be a network accessible within a predetermined range, such as an intranet.

The user environment E1 is a system environment in an organization such as a company or an educational institution such as a school in which one or more output devices 50 and one or more intermediary devices 20 are installed. The output device 50 is a device that displays an input image on a display unit, and may be, for example, a projector, an electronic blackboard, or the like. In the user environment E1, each output device 50 is connected to the mediation device 20 corresponding thereto. That is, the output device 50 and the intermediary device 20 are in one-to-one correspondence. The output device 50 and the intermediary device 20 are connected via an interface conforming to a standard capable of transmitting images, such as HDMI (registered trademark) (High-Definition Multimedia Interface). Note that, for example, a computer such as an HDMI (registered trademark) dongle or a stick PC may be used as the intermediary device 20 .

For example, the output device 50 and the intermediary device 20 may be connected by a cable (for example, an HDMI (registered trademark) cable, etc.) compatible with the interface. Alternatively, the connector corresponding to the interface of mediation device 20 and the connector corresponding to the interface of output device 50 may be directly connected. For example, the intermediate device 20 may be inserted into a connector of the output device 50 to connect the two. Alternatively, the intermediary device 20 and the output device 50 may be connected by wireless communication, or may be connected via a network.

By connecting the output device 50 and the mediation device 20 as described above, the mediation device 20 can transmit an image to be displayed to the output device 50 .

The intermediary device 20 is connected to the network N1 via a LAN or the like within the user environment E1. The intermediary device 20 may be wirelessly connected to a LAN or the like within the user environment E1. The intermediary device 20 has an internal web browser, and by means of the web browser, executes processing according to a processing execution request regarding image data transmitted from the server device 10 to control the output device 50 (execution of the processing). output the result to the output device 50).

Specifically, in the present embodiment, the intermediary device 20 causes the output device 50 to output (display) the image data. In other words, the intermediary device 20 mediates the output (display) of the image by the output device 50 for the data transmitted from the server device 10 .

Further, in the present embodiment, the intermediary device 20 causes the output device 50 to output (display) specific information for specifying the output device 50 . This specific information is information that can be obtained only when the user of the user terminal 40 is in the vicinity of the output device 50, and is information that changes over time.

In this embodiment, when image data is transmitted (uploaded) from the user terminal 40 to the server device 10, the user terminal 40 attaches specific information to the uploaded image data.

Thereby, the server device 10 can manage the specific information as information indicating the position and time zone of the user terminal 40 when the image data was uploaded. In other words, according to the present embodiment, the server apparatus 10 can manage uploaded image data in association with information indicating the location and time period when the image data was captured.

Further, when the user terminal 40 reads a QR code or the like, the server device 10 of the present embodiment causes the user terminal 40 to activate the imaging function, and associates the captured image data and specific information with the QR code. Send to the specified storage destination.

Therefore, in the present embodiment, captured image data can be transmitted to a designated storage destination (upload destination) simply by holding the user terminal 40 over the QR code.

The user terminals 30 and 40 are information processing terminals carried by each user in the user environment E1. For example, smart phones, tablet terminals, PCs, mobile phones, or the like may be used as the user terminals 30 and 40 . Note that the user terminals 30 and 40 can be connected to the network N1 without going through a LAN or the like in the user environment E1 (for example, through a mobile communication network or the like). However, the user terminals 30 and 40 may be connectable to the network within the user environment E1.

In the present embodiment, for example, when image data uploaded from the user terminal 40 to the server device 10 via the network N1 is specified by the user terminal 30, an image specified via the mediation device 20 is displayed. Data may be displayed on the output device 50 .

The server device 10 is one or more computers that execute processing for realizing output by the output device 50 for image data specified from the user terminals 30 and 40 by simple operations using the user terminals 30 and 40. be.

In addition, the server device 10 is one or more computers that execute a process of storing image data captured by the user terminals 30 and 40 in a preset storage destination by a simple operation using the user terminals 30 and 40. is. Note that the server device 10 may be installed in the user environment E1.

FIG. 2 is a diagram illustrating a hardware configuration example of a server device. The server device 10 of FIG. 2 has a drive device 100, an auxiliary storage device 102, a memory device 103, a CPU 104, an interface device 105, etc., which are connected to each other via a bus B. FIG.

A program for realizing processing in the server device 10 is provided by a recording medium 101 such as a CD-ROM. When the recording medium 101 storing the program is set in the drive device 100 , the program is installed from the recording medium 101 to the auxiliary storage device 102 via the drive device 100 . However, the program does not necessarily need to be installed from the recording medium 101, and may be downloaded from another computer via the network. The auxiliary storage device 102 stores installed programs, as well as necessary files and data.

The memory device 103 reads out and stores the program from the auxiliary storage device 102 when a program activation instruction is received. The CPU 104 executes functions related to the server device 10 according to programs stored in the memory device 103 . The interface device 105 is used as an interface for connecting to a network.

FIG. 3 is a diagram illustrating a hardware configuration example of a user terminal; In this embodiment, the user terminals 30 and 40 have the same hardware configuration, and FIG. 3 illustrates the hardware configuration of the user terminal 30 as an example.

3, the user terminal 30 has a CPU 301, a ROM 302, a RAM 303, a touch panel 304, an auxiliary storage device 305, a short-range wireless communication device 306, a digital camera 307, and the like.

The ROM 302 and auxiliary storage device 305 store programs and the like installed in the user terminal 30 . The RAM 303 reads and stores the program from the ROM 302 or the auxiliary storage device 305 when a program activation instruction is received. The CPU 301 implements functions related to the user terminal 30 according to programs stored in the RAM 303 .

The touch panel 304 is an electronic component having both an input function and a display function, and performs information display, reception of user input, and the like. The touch panel 304 includes an output device 311, an input device 312, and the like.

The output device 311 is a liquid crystal display or the like, and has a display function of the touch panel 304 . The input device 312 is an electronic component that includes a sensor that detects contact of a contact with the output device 311 . The contact object refers to an object that contacts the contact surface (surface) of the touch panel 304 . Examples of such objects include a user's finger, a dedicated or common pen, and the like. Note that the touch panel 304 does not necessarily have to be provided, and the user terminal 30 may have the output device 311 and the input device 312 separately. Also, the output device 311 may be externally connected to the user terminal 30 . Further, the input device 312 is not limited to sensors that detect contact, and includes electronic components such as hardware keys, keyboards, and mice.

The short-range wireless communication device 306 is hardware for performing short-range wireless communication. In this embodiment, the near field communication device 306 reads information stored on the NFC tag. That is, in this embodiment, the short-range wireless communication device 306 is preferably an NFC reader. The digital camera 307 may be a general digital camera having an imaging function and may be built in the user terminal 30 as an electronic component, or may be externally connected to the user terminal 30 .

Note that the user terminals 30 and 40 of this embodiment may not have the touch panel 304, the digital camera 307, and the short-range wireless communication device 306, for example. The output device 311 of the user terminals 30 and 40 of this embodiment may be a display, and the input device 312 may be a keyboard, pointing device, or the like.

FIG. 4 is a diagram illustrating a hardware configuration example of an intermediary device. The intermediary device 20 of FIG. 4 has an auxiliary storage device 201, a memory device 202, a CPU 203, a communication interface 204, an image interface 205, and the like.

A program that implements processing in mediation device 20 is installed in auxiliary storage device 201 . The auxiliary storage device 201 stores installed programs, as well as necessary files and data.

The memory device 202 reads the program from the auxiliary storage device 201 and stores it when a program activation instruction is received. The CPU 203 executes functions related to the intermediary device 20 according to programs stored in the memory device 202 . A communication interface 204 is a physical interface for connecting to a network. Image interface 205 is a physical interface for transmission of images to output device 50 .

FIG. 5 is a diagram for explaining the outline of this embodiment. In FIG. 5, the information processing system 1 of the present embodiment is introduced into an educational site such as a school, the user terminal 30 is mainly used by teachers, and the user terminal 40 is mainly used by students. is shown. In the following description, the user terminal 30 will be called the teacher terminal 30 and the user terminal 40 will be called the student terminal 40 .

Specifically, FIG. 5 shows a case where a test is given during a certain lecture and the image data of the test answer sheet is stored in the server device 10 for the teacher to view. The background of this usage scene is described below.

Generally, the completed answer sheets are submitted to the teacher for grading, and if the answer sheets are returned to the students after grading is complete. For this reason, if students want to self-grade the contents of the answer sheet, it is necessary to memorize the test questions and the contents of the answer sheet, but it is necessary to remember the details of the answer sheet. is often difficult.

Also, if the teacher wants the students to review the test questions after the test is over, the teacher should mark them promptly and return the graded answer sheets to the students, but always mark them promptly. is not always possible.

For this reason, in educational settings, immediately after a test is conducted, a copy (copy or photo) of the answer sheet with the answers filled in is taken, and the completed answer sheet is returned to the student. However, the task of copying the answer sheets of all the students is very troublesome and imposes a burden on the teacher.

Therefore, in the present embodiment, only by the student taking an image of his/her completed answer sheet with the student terminal 40, the taken image data is transmitted to the storage destination specified by the teacher in advance.

In the information processing system 1 of the present embodiment, the teacher terminal 30 requests the server device 10 to generate specific information (step S1). Upon receiving the request, the server device 10 generates specific information and requests the intermediary device 20 to execute processing for outputting the specific information (step S2).

The intermediary device 20 receives the processing execution request and causes the output device 50 to display the specific information 51 (step S3).

The output device 50 of this embodiment is, for example, a display device installed in a lecture room where lectures are held. Specifically, the output device 50 may be, for example, an electronic blackboard or the like that displays images and documents that are viewed by both the student and the teacher.

In this embodiment, when the student terminal 40 is held over the QR code 52 pasted in advance on the answer sheet P, the student terminal 40 activates the QR code reading function to read the QR code 52 (step S4). In the following description, the QR code pasted (associated) on the answer sheet may be called an answer QR code.

The answer QR code 52 may be issued by the information processing system 1 for each educational institution, for example. Further, the answer QR code 52 is embedded with information specifying the storage destination of the image data transmitted from the student terminal 40 .

When the student terminal 40 reads the answer QR code 52, the student terminal 40 accesses the server device 10 (step S5), and receives an imaging function activation instruction from the server device 10 (step S6).

When the student terminal 40 receives an instruction to activate the imaging function, it displays an input screen for inputting the specific information 51. When the specific information 51 is input by the student, the camera function is activated and a photographing screen of the answer sheet P is displayed. display. Then, when the student terminal 40 receives an operation to capture an image of the answer sheet P from the student, the student terminal 40 captures an image of the answer sheet P (step S7).

Subsequently, the student terminal 40 attaches the input specific information 51 to the image data of the captured answer sheet P, and transmits the image data to the storage location indicated by the answer QR code 52 (step S8).

The server device 10 stores the image data received from the student terminal 40 in the specified storage destination (step S9).

In the present embodiment, as described above, the specific information output from the server device 10 by the instruction of the teacher terminal 30 is added to the image data of the image captured by the student terminal 40, and stored in the server device 10. Image data and specific information can be associated. That is, according to this embodiment, the teacher who instructed the server device 10 to output the specific information and the student who sent the image data can be managed in association with each other.

Further, in the present embodiment, the student terminal 40 realizes a function of transmitting captured image data to a specified storage destination according to an instruction from the server device 10 . Therefore, according to the present embodiment, there is no need to install a dedicated application, procedures such as pre-setting are not required, and image data can be stored in a designated storage destination with a simple procedure.

Further, in this embodiment, all the image data of the answer sheet imaged by the student terminal 40 is automatically stored in the specified storage destination.

Therefore, if the present embodiment is applied, the teacher does not have to make a copy of the answer sheet when returning the completed answer sheet to the student, thus reducing the burden on the teacher. In addition, by applying this embodiment, students can obtain their own filled-in answer sheets immediately after the end of the test, so that they can use them for self-grading, review, and the like.

In addition, in FIG. 5, the object to be imaged by the student terminal 40 is the answer sheet P, but the object is not limited to this. In this embodiment, if a QR code 53 is assigned in advance to a whiteboard WB or the like installed in the lecture room, image data of the blackboard written on the board during the lecture can be transferred to the designated storage destination by the same mechanism. can be sent. In the following description, the QR code pasted (associated) on the whiteboard WB may be called a blackboard QR code.

Therefore, for example, when a student makes a presentation using the whiteboard WB or the like or writes an answer to a question during a lecture, the blackboard QR code 53 given to the whiteboard WB by the student terminal 40 is read and an image of the whiteboard WB is captured, the image data of the whiteboard WB written on the board can be transmitted to a designated storage destination.

The specific information 51 may be information assigned to identify the output device 50, and may be composed of any information such as numbers, characters, symbols, and graphics. Further, the specific information 51 may be displayed on the output device 50 as a two-dimensional code such as a QR code (registered trademark). Further, the specific information 51 may be a beacon signal or the like transmitted from the output device 50 or a transmitter associated with the output device 50 . Further, the specific information 51 may be transmitted by wireless communication from the output device 50 or a transmitter associated with the output device 50 .

In the following description, the specific information is explained as a passcode, which is an example of the specific information. Details of the specific information will be described later.

FIG. 6 is a diagram showing a functional configuration example of each device. In FIG. 6, the teacher terminal 30 has a control section (operating system section) 31, a browser section 32, and the like. Each of these units is implemented by one or more programs installed in the teacher terminal 30 causing the CPU 301 to execute.

The control unit 31 receives an operation from the user of the teacher terminal 30 and activates the browser unit 32 . The browser unit 32 is, for example, a general Web browser, and executes processing according to HTML (HyperText Markup Language) data, scripts (for example, JavaScript (registered trademark)), and the like. Also, when the browser unit 32 is activated, it transmits an initial access URL to the server device 10 .

At this time, the browser unit 32 also transmits to the server device 10 the registration ID given as option information to the initial access URL together with the initial access URL. A registration ID is identification information that identifies a service, and is associated in advance with an application that implements the service.

In addition, the browser unit 32 accesses an application associated with the registration ID among the applications of the server device 10 according to the redirect request from the server device 10 in response to the access to the initial access URL. A redirect request is a response from the server device 10 in response to access to the initial access URL.

The browser unit 32 acquires data (HTML data, script, etc.) indicating a processing execution request to the teacher terminal 30 from the accessed application.

Note that the initial access URL indicates the URL to be accessed first when the teacher terminal 30 first accesses the server device 10 .

The student terminal 40 of this embodiment has a control unit (operating system unit) 41, a browser unit 42, and the like. Each of these units is implemented by processing that one or more programs installed in the student terminal 40 cause the CPU of the student terminal 40 to execute.

The control unit 41 receives an operation from the user of the student terminal 40 and activates the browser unit 42 . The browser unit 42 is, for example, a general web browser, and displays various screens.

The intermediary device 20 has a communication control unit 21, a browser management unit 22, a browser unit 23, and the like. Each of these units is implemented by one or more programs installed in the intermediation device 20 causing the CPU 203 to execute the processing.

The communication control unit 21 connects a two-way communication path (establishes a communication session) with the communication unit 11 of the server device 10, and functions as an end point on the intermediary device 20 side in the communication path (communication session). Communication via the communication path (communication session) notifies the server device 10 of the state of the intermediary device 20, and indicates that image data to be displayed on the output device 50 by the intermediary device 20 is input to the server device 10. A notification can be received from the server device 10 . Inputting image data to the server device 10 means uploading image data to the server device 10 from the teacher terminal 30 or the student terminal 40 .

The browser management unit 22 activates the browser unit 23 in kiosk mode. The kiosk mode is a mode in which the use of the intermediary device 20 is limited to displaying web pages. Note that the kiosk mode is merely an example, and other modes may be used as long as they are capable of displaying web pages.

The browser unit 23 is, for example, a general web browser, and executes processing according to HTML data, scripts, and the like.

The browser unit 23 accesses the initial access URL in response to activation. At this time, in the server device 10, the identification information of the browser unit 23 (hereinafter referred to as "browser ID") is given as optional information to the initial access URL.

The browser unit 23 accesses the application associated with the browser ID among the applications of the server device 10 according to the redirect request in response to the access to the initial access URL. The browser unit 23 acquires data (HTML data, scripts, etc.) indicating a process execution request to the intermediary device 20 from this application.

The server device 10 has a communication unit 11 , an application determination unit 12 , an input application group 13 , an output application 14 , a specific information allocation unit 15 and a storage control unit 16 . Each of these units is implemented by one or more programs installed in the server device 10 causing the CPU 104 to execute the processing.

The server device 10 also includes an application information storage unit 121, a device information storage unit 122, an account information storage unit 123, a registration information storage unit 124, a lesson information storage unit 125, an answer information storage unit 126, a blackboard information storage unit 127, an installation It has an information storage unit 128 , a passcode history storage unit 129 , and a display history storage unit 130 . Each of these storage units can be implemented using, for example, the auxiliary storage device 102 or a storage device that can be connected to the server device 10 via a network.

The communication unit 11 performs processing for establishing communication between the server device 10 and the intermediary device 20 and communication between the server device 10 and the teacher terminal 30 and the student terminal 40 . In other words, the communication unit 11 is an example of a transmission unit that transmits information and a reception unit that receives information in the server device 10 .

The application determination unit 12 corresponds to the initial access URL. The application determination unit 12 refers to the registration information storage unit 124 to determine an application corresponding to option information (registration ID or browser ID) attached to the initial access URL in response to access to the initial access URL.

After determining the application corresponding to the option information, the application determination unit 12 transmits a response including a redirect request including the URL for this application to the source of access to the initial access URL.

The input application group 13 and the output application 14 are examples of applications that the server device 10 has.

The input application group 13 is a group of applications that execute processing according to their intended use, and each application transmits HTML data, scripts, etc. for executing processing according to their intended use to the teacher terminal 30 .

The input application group 13 of the present embodiment includes, for example, a teacher portal application that causes the teacher terminal 30 to display a portal screen menu for the teacher, and an attendance display application that causes the teacher terminal 30 to display the output status of students. App included.

The input application group 13 also includes a camera application (hereinafter referred to as camera application). The camera application is an application that realizes a service that activates the camera function of the student terminal 40 and transmits captured image data to the server device 10 when the answer QR code or the blackboard QR code is read. The input application group 13 also includes a schedule application that causes the teacher terminal 30 to display a subject input screen for accepting subject input.

The output application 14 includes an application for outputting the passcode generated by the specific information allocation unit 15 . Specifically, the output application 14 may be, for example, HTML data and a script for causing the intermediary device 20 to draw a passcode. Further, the output application 14 may cause the output device 50 to execute a process of transmitting a passcode by wireless communication, or may cause the output device 50 or a process associated with the output device 50 to transmit a beacon signal. It may be executed by the transmitter.

The output application 14 also includes an application for causing the mediation device 20 to acquire (download) and draw image data stored in the answer information storage unit 126 and the blackboard information storage unit 127 . Specifically, the output application 14 transmits to the mediation device 20 HTML data, scripts, and the like for causing the mediation device 20 to execute the acquisition and drawing.

The specific information assigning unit 15 generates a passcode and causes the output device 50 to display the passcode via the mediation device 20 . The specific information assigning unit 15 of the present embodiment generates passcodes so that the passcodes displayed on the output device 50 are different. Generation of the passcode by the specific information assigning unit 15 will be described later.

The storage control unit 16 stores image data uploaded to the server device 10 by the input application group 13, a passcode output from the output device 50 via the mediation device 20 by the output application 14, and the like in each storage unit. . Details of the storage control unit 16 will be described later.

The application information storage unit 121 stores information (for example, URL, etc.) for each application (in this embodiment, the input application group 13 and the output application 14) of the server apparatus 10. FIG.

The account information storage unit 123 stores identification information and the like of users who can use applications in the server device 10 .

The device information storage unit 122 stores information indicating the state of each intermediation device 20 arranged in the user environment E1.

The registration information storage unit 124 stores, for each registration ID, identification information of an application that executes image data input processing, identification information of an application that executes image data output processing, and an intermediary device to which image data is input. 20, the identification information of the browser unit 23 and the like are stored.

The lesson information storage unit 125 stores information about lessons. Specifically, the class information storage unit 125 includes the type of lecture, lecture room, lecture time, information specifying the teacher, information specifying image data captured during the lecture, and the like.

The answer information storage unit 126 and the blackboard information storage unit 127 are examples of an image data storage unit that stores image data.

The answer information storage unit 126 stores, for example, image data of answer sheets captured by the student terminals 40 . The blackboard information storage unit 127 stores image data of blackboards and whiteboards installed in a lecture room or the like.

In the answer information storage unit 126 and the blackboard information storage unit 127, the passcode given to the image data stored therein, the information specifying the student who captured the image data, and the like are stored together with the image data.

The installation information storage unit 128 stores information indicating the browser ID that displayed the passcode during the lecture.

The passcode history storage unit 129 stores information indicating the history of passcodes output via the output application 14 . The display history storage unit 130 stores information indicating the history of image data displayed on the output device 50 by the browser unit 23 of the mediation device 20 .

The details of each storage unit described above will be described later.

A processing procedure executed in the information processing system 1 will be described below. FIG. 7 is a sequence diagram for explaining an example of a processing procedure executed in response to activation of an intermediary device according to the first embodiment; Specifically, FIG. 7 shows the processing procedure until the passcode is displayed on the output device 50 .

When a user such as a teacher turns on the intermediary device 20 (step S701), the communication control unit 21 establishes a communication path for asynchronously receiving a request from the communication unit 11 of the server device 10. 11 (step S702). At this time, the communication control unit 21 notifies the communication unit 11 of the communication ID, which is the identification information of itself (the communication control unit 21). The communication unit 11 updates the device information storage unit 122 based on the notified communication ID (hereinafter referred to as "target communication ID").

FIG. 8 is a diagram illustrating a configuration example of a device information storage unit. 8, the device information storage unit 122 stores communication IDs, address information, status information, browser IDs and browser statuses, passcodes, etc. in association with tenant IDs.

The tenant ID is identification information of a party (tenant) who concludes a contract for using the service provided by the server device 10 . For example, the user environment E1 may correspond to one tenant.

The communication ID is identification information of the communication control unit 21 of each intermediary device 20 placed in the tenant associated with the tenant ID. If the mediation device 20 has only one communication control unit 21 , the communication ID may be identification information for identifying the mediation device 20 .

The address information is the local IP address of mediation device 20 . The status information is information indicating whether or not the communication control unit 21 associated with the communication ID is currently connected to the server device 10 (a state in which a communication path has been established) (“not connected”).

The browser ID is identification information of the browser section 23 corresponding to the communication control section 21 associated with the communication ID. In this embodiment, the browser ID is identification information of the browser section 23 included in the same intermediary device 20 as the communication control section 21 related to the communication ID.

The browser state is information indicating the activation state of the browser unit 23 associated with the browser ID. For example, if the target communication ID notified to the communication unit 11 is "Eg001-01", the status information corresponding to the communication ID in the device information storage unit 122 is changed to "connected" as shown in FIG. Be changed.

The passcode is generated by the specific information assigning unit 15 when the communication path with the intermediation device 20 is established, and is associated with the communication ID (intermediation device 20). As for the passcode, when there are a plurality of browser IDs associated with the communication ID, a passcode may be generated for each browser ID.

Next, the communication control unit 21 searches the browser management unit 22 to acquire the browser ID, for example, using SNMP (Simple Network Management Protocol) (step S703), and , the browser ID, which is the identification information of the browser unit 23 managed by the browser management unit 22, is obtained (step S704).

In the present embodiment, an example in which the intermediation device 20 includes the communication control unit 21 and the browser management unit 22 is shown. In order to make it possible to use a plurality of browser management units 22 and 23 by communicating with the unit 32 via the same network, the browser management unit 22 is searched using SNMP or the like. . Therefore, the search of the browser management unit 22 is not necessarily essential, and the acquisition destination (browser management unit 22) from which the communication control unit 21 acquires the browser ID may be set in advance.

Subsequently, the communication control unit 21 notifies that the browser unit 23 corresponding to the acquired browser ID (in this embodiment, the browser unit 23 of the intermediary device 20) becomes available. An ID (hereinafter referred to as "target browser ID") is specified and transmitted to the communication unit 11 (step S705).

Upon receiving the notification, the communication unit 11 updates the device information storage unit 122 (FIG. 8) based on the target browser ID specified in the notification. Specifically, in the device information storage unit 122, the value of the browser state corresponding to the target browser ID is updated from "power off" to "power on."

Subsequently, the communication control unit 21 designates the target browser ID and initial access URL, and requests the browser management unit 22 to activate the browser unit 23 associated with the target browser ID (step S706). The initial access URL is the URL that the browser unit 23 should access first, as described above, and is preset in the browser management unit 22 .

In response to the request from the communication control unit 21, the browser management unit 22 activates the browser unit 23 associated with the target browser ID in kiosk mode (step S707). At this time, the browser management section 22 inputs the initial access URL to the browser section 23 . The browser unit 23 transmits an HTTP request to the input initial access URL in response to activation in the kiosk mode (step S708). The HTTP request includes the target browser ID.

Upon receiving the HTTP request, the application determination unit 12 of the server device 10 transmits a response (HTTP response) including a redirect request to the browser unit 23 (step S709).

The redirect request includes the URL of the application associated with the browser ID as the redirect destination. In addition, the redirect request includes the target browser ID included in the communication URL and the HTTP request as notification information to the redirect destination. Note that the communication URL is the URL of the communication control unit 21 .

Note that the application determination unit 12 refers to the registration information storage unit 124 and the application information storage unit 121 to identify the URL of the application associated with the target browser ID.

FIG. 9 is a diagram showing a configuration example of a registration information storage unit. 9, the registration information storage unit 124 has a registration ID, an In application ID, an Out application ID, and a browser ID as information items, and the value of the item "registration ID" corresponds to the value of the other items. attached and stored.

The In application ID is the ID of an application that controls the input of image data in the service corresponding to the registered ID (hereinafter referred to as "application ID"). The Out application ID is an application ID of an application that controls the output of image data in the service corresponding to the registration ID.

In the present embodiment, the application indicated by the In application ID associated with the registration ID in the registration information storage unit 124 is the application included in the input application group 13 . Further, in the present embodiment, the application indicated by the Out application ID associated with the registration ID in the registration information storage unit 124 is the output application 14 .

For example, the registration ID "Tag_Ed" is associated with the In application ID "AP_EdPortal" and is not associated with the Out application ID. Therefore, it can be seen that the service corresponding to the registration ID "Tag_Ed" provides a service related to image data input control. Note that the In application ID “AP_EdPortal” indicates an application ID of an application, among the applications included in the input application group 13, that executes the process of displaying the menu of the teacher's portal screen.

Also, the registration ID “Tag_St” is associated with the In application ID “AP_Stcamera”, and is not associated with the Out application ID. Therefore, it can be seen that the service corresponding to the registration ID "Tag_St" provides a service related to controlling the input of image data. In other words, in the case of the student terminal 40 to which only the service corresponding to the registration ID “Tag_St” is provided, the server device 10 does not have the function of transmitting the processing execution request to the mediation device 20. .

Note that the In application ID "AP_Stcamera" is an application of an application included in the input application group 13 that activates the camera of the student terminal 40 and executes processing for transmitting image data captured by the camera to a storage destination. Indicates an ID.

In FIG. 9, the registration ID "Tag_StPhotoCode" is associated with the In application ID "AP_StPhoto" and the Out application ID "AP_PhotoDoc", but not with the browser ID.

In this embodiment, the registration ID, the In application ID, and the Out application ID are associated with each other in this way. indicates a state in which the In such a case, the service and the browser ID are associated with each other based on the passcode.

In the following description, information including the value of the item "registration ID" and the values of other items in the registration information storage unit 124 is called tag information.

Moreover, FIG. 10 is a figure which shows the structural example of an application information storage part. 10, the application information storage unit 121 stores an application ID, an application type, a URL, a compatible browser, and the like for each application that the server device 10 has.

The application type indicates the type of the application associated with the application ID based on the relationship with the image data. "In" indicates an application (corresponding to the In application ID described above) that controls the input of image data. "Out" indicates an application that controls the output of image data (corresponding to the Out application ID described above). URL is the URL of the application associated with the application ID.

The compatible browser indicates the type of browser that operates the application associated with the application ID. In the example of FIG. 10, the types of browsers are a terminal browser indicating the browser units of the teacher terminal 30 and student terminals 40 and a device browser indicating the browser unit 23 of the output device 50 .

The application determination unit 12 refers to the registration information storage unit 124 to identify the Out application ID associated with the target browser ID, and refers to the application information storage unit 121 to identify the Out application ID associated with the target browser ID. Identifies the URL that is Here, it is assumed that the target browser ID is "BROWSER1". In this case, the URL of the application (output application 14) whose application ID is "AP_PhotoDoc" (hereinafter, "output application URL") is specified.

Also, the application determination unit 12 automatically generates the communication URL of the communication control unit 21 related to the target communication ID based on the address information associated with the target browser ID in the device information storage unit 122 (FIG. 8).

Subsequently, the browser unit 23 transmits (redirects) an HTTP request to the redirect destination output application URL (that is, the output application 14) in accordance with the redirect request (S710). The HTTP request includes the communication URL and browser ID included in the redirect request.

In response to the HTTP request, the output application 14 provides the browser unit 23 with a script for causing the browser unit 23 to connect to the communication URL included in the HTTP request and a user interface for displaying the passcode. A response including display data for drawing is transmitted to the browser unit 23 (S711). Note that the script and the display data are examples of data indicating a process execution request to the intermediary device 20 . For example, the script may be a program of another format, and the display data may be data of another format.

Upon receiving the response, the browser section 23 executes the script included in the response and establishes a communication path with the communication control section 21 identified by the communication URL (S712). The communication path is a communication path for transmitting the notification received by the communication control unit 21 from the server device 10 to the browser unit 23 . A websocket may be used for the communication path.

Subsequently, the browser unit 23 draws a screen based on the display data included in the response (hereinafter referred to as "display screen") in a predetermined area (for example, video memory) of the memory device 103 (S713). . For example, the display screen is a screen on which a passcode generated by the server device 10 is displayed. The content (display screen) drawn by the browser unit 23 is output to the output device 50 via an interface such as HDMI (registered trademark), and is output (displayed) by the output device 50 .

Next, the server device 10 uses the specific information allocation unit 15 to generate and allocate passcodes that do not overlap for a certain period of time to the group of browser IDs associated with the tenant IDs. A passcode notification in which the browser ID and the passcode are associated is distributed to the communication control unit 21 (S714). At this time, the specific information allocation unit 15 associates the generated passcode with the browser ID and stores it in the device information storage unit 122 (FIG. 8).

In this embodiment, the fixed period is, for example, about several days, and the fixed interval is about several minutes (for example, 15 minutes).

Upon receiving the passcode notification, the communication control unit 21 notifies the passcode to the browser unit 23 specified by the browser ID associated with the passcode (S715). The browser unit 23 displays the passcode on part of the display screen of the output device 50 (S716).

In the example of FIG. 8, two browser IDs are associated with the communication ID "Eg001-01". In this case, the passcode corresponding to the browser ID “BROWSER1” whose activation state is “power ON” is displayed on the output device 50 by the intermediary device 20 .

Generation and allocation of passcodes by the specific information allocation unit 15 of the present embodiment will be described below with reference to FIG. FIG. 11 is a diagram for explaining passcode generation and assignment.

The passcode of this embodiment is, for example, a four-digit number. The specific information allocation unit 15 of this embodiment generates and allocates a passcode for each browser ID (intermediary device 20) associated with the tenant ID. Specifically, the specific information assigning unit 15 generates a random 4-digit number and assigns it to the intermediary device 20 as a passcode.

For example, when there are a plurality of intermediary devices 20 (intermediary devices 20 in the user environment E1) associated with tenant IDs, the specific information allocation unit 15 assigns passcodes to each intermediary device 20. try not to Furthermore, the specific information assigning unit 15 periodically changes the passcode assigned to each intermediary device 20 .

The example of FIG. 11 shows a case where one tenant ID has three intermediary devices 20, ie, intermediary devices 20-1, 20-2, and 20-3.

In this case, the specific information assigning unit 15 assigns the passcodes “1234”, “2293”, and “8341” to the intermediary devices 20 for 15 minutes from 10:00, for example. Further, the specific information assigning unit 15 assigns the passcodes “3256”, “5671”, and “4252” to the intermediary devices 20 for 15 minutes from 10:15.

Thus, in this embodiment, a different passcode is assigned to each intermediary device 20, and the passcode assigned to the intermediary device 20 is changed periodically. Therefore, according to the present embodiment, based on the passcode attached to the image data transmitted from the student terminal 40, it is possible to specify the time zone and place where the image data was captured.

FIG. 12 is a diagram showing a display example of the passcode on the output device. A passcode 51 notified from the server device 10 is displayed on the screen of the output device 50 .

Next, a processing procedure for uploading image data from the student terminal 40 to the server device 10 will be described with reference to FIG. FIG. 13 is a sequence diagram for explaining an example of a processing procedure for uploading image data from a student terminal to a server device according to the first embodiment.

In the student terminal 40 of this embodiment, the control unit 41 detects that the student who is the user has pointed the student terminal 40 at the answer QR code (step S1301).

Subsequently, the student terminal 40 reads the answer QR code (step S1302), and obtains the registration ID embedded in the answer QR code and the initial access URL (step S1303).

Upon reading the answer QR code, the student terminal 40 activates the browser unit 42 and connects to the initial access URL destination embedded in the QR code (step S1304).

Upon activation, the browser unit 42 automatically transmits an HTTP request to the application determination unit 12 corresponding to the initial access URL embedded in the answer QR code (step S1305). The HTTP request includes account information as optional information in addition to the registration ID obtained from the answer QR code.

As described above, in the present embodiment, the registration ID, which is identification information for specifying the service provided by the server device 10, and the initial access URL corresponding to the application determination unit 12 are embedded in the answer QR code. In other words, it can be said that the answer QR code of the present embodiment embeds information specifying the server device 10 as the storage destination in which the image data captured by the student terminal 40 is stored.

The account information is information that includes the student's user ID and the tenant ID of the user environment E1, or information that can specify the user ID and the tenant ID. For example, cookies or the like may be used as account information.

When the student terminal 40 is already logged in, the application determination unit 12 of the server apparatus 10, upon receiving the HTTP request, transmits an HTTP request (redirect) to the browser unit 42 (step S1306). This HTTP request contains the camera URL (that is, the camera application 13-1). The camera application 13 - 1 is one of the applications included in the input application group 13 .

Upon receiving the HTTP request (redirect), the browser unit 42 proceeds to step S1314, which will be described later.

Further, when the student terminal 40 is not already logged in, upon receiving the HTTP request, the application determination unit 12 sends the browser unit 42 an HTTP request containing the login URL (that is, the login application 13-2). redirect) is transmitted (step S1307).

Upon receiving the HTTP request, the browser unit 42 requests the login application 13-2 to display the login screen (step S1308). Upon receiving the display request, the login application 13-2 transmits display data for displaying the login screen on the browser unit 42 (step S1309).

The browser unit 42 displays a login screen based on the display data (step S1310).

When the browser unit 42 receives the input of the account information on the login screen (step S1311), the browser unit 42 transmits a login request in which the input account information is associated with the registration ID read from the answer QR code to the server device 10 (step S1311). S1312).

The server device 10 causes the application determination unit 12 to refer to the account information storage unit 123, perform login processing, and perform an HTTP request (redirect) to the URL associated with the registration ID (step S1313). Here, the URL associated with the registration ID is the camera URL (ie camera application 13-1).

Here, the account information storage unit 123 will be described with reference to FIG. 14 . FIG. 14 is a diagram illustrating a configuration example of an account information storage unit according to the first embodiment;

The account information storage unit 123 of this embodiment has a tenant ID, a user ID, and a password as information items.

In this embodiment, it is assumed that a common user ID is assigned to students, and a user ID is assigned to each teacher. The password is a password determined according to each user ID.

Returning to FIG. 13, the browser unit 42 receives the HTTP request including the camera URL and connects to the camera application 13-1 (step S1314).

The camera application 13-1 includes display data of an input screen for inputting a class number, a script for executing a process of transmitting the class number input to the input screen, and captured image data to the server device 10, is sent to the browser unit 42 (step S1315).

In other words, the server device 10 activates the imaging function of the student terminal 40 by using the camera application 13-1 associated with the registration ID received from the student terminal 40, and uploads the image data captured by the imaging function. An execution request is sent to the student terminal 40 . In other words, the browser unit 42 acquires an answer reading application (a script for transmitting the input class number and the captured image data to the server device 10) from the camera application 13-1. The browser unit 42 activates the answer reading application, and displays an input screen for the student number, class number, and passcode (step S1316).

When the browser unit 42 accepts the input of the student number, class number, and passcode on the input screen (step S1317), it holds the student number, class number, and passcode (step S1318).

Subsequently, the browser unit 42 accepts the operation of the start button for capturing the image of the answer sheet (step S1319), and displays the operation screen of the camera of the student terminal 40 (step S1320).

In addition, upon receiving the operation of the image capture button (step S1321), the browser section 42 instructs the control section 41 to capture image data (step S1322). The control unit 41 passes the image data captured by the camera to the browser unit 42 (step S1323).

The browser unit 42 attaches the registration ID, the student number, the class number, and the passcode to the image data, and transmits the image data to the communication unit 11 of the server device 10 (step S1324).

The image data received by the communication unit 11 is stored in the answer information storage unit 126 or the like by the storage control unit 16 .

Here, a display example of the student terminal 40 will be described with reference to FIG. FIG. 15 is a diagram showing a display example on the student terminal according to the first embodiment. FIG. 15A shows an example of the login screen displayed in step S1310 of FIG. FIG. 15B shows an example of the input screen displayed in step S1316 of FIG. FIG. 15C is a diagram showing an example of the camera operation screen displayed in step S1320 of FIG.

A screen 151 in FIG. 15A has input fields 151a and 151b for inputting a user ID and a password, respectively.

In this embodiment, the user ID and password that are input to the student terminal 40 are common to each tenant ID, but are not limited to this. The user ID and password may be set individually by the student who is the user of the student terminal 40 . In that case, the user ID and password for each student may be stored in the account information storage unit 123 as account information.

A screen 152 shown in FIG. 15B has entry fields 152a, 152b, and 152c for entering a student number, class number, and passcode, respectively. A student number is, for example, a number assigned to each individual student. A student number may be determined, for example, for each lecture a student takes. In this case, for example, the student number may be assigned according to the order of entry into the lecture room where the lecture is held.

Note that in the present embodiment, if a user ID is given to each individual student, the user ID and student number are linked, so there is no need to enter the student number on the screen 152 . Therefore, in that case, the input field 152a becomes unnecessary.

The class number is the name of the lecture that the student takes. It should be noted that the entry field 152b is not displayed on the screen 152 when the class number is embedded in the answer QR code 52. FIG. The passcode is entered by the student by viewing the passcode displayed on the output device 50 .

Note that the class number and passcode may be required to be input only when capturing the image of the answer sheet, and may not be required to be input when capturing the image of the whiteboard WB.

When the start button 152d is operated on the screen 152, the browser section 42 of the student terminal 40 causes the display to transition to the imaging screen. That is, the start button 152d is an operation button for transitioning the display of the student terminal 40 to the imaging screen.

A screen 153 shown in FIG. 15(C) is an example of an imaging screen in which the camera is activated and an image 153a of the completed answer sheet P is displayed. When the operation button 153b is operated on the screen 153, the image data obtained by capturing the image of the answer sheet P is transmitted to the storage location indicated by the answer QR code.

Next, processing of the storage control unit 16 of the server device 10 will be described. A usage scene of the information processing system 1 when describing storage of data by the storage control unit 16 will be described below. FIG. 16 is a diagram for explaining usage scenes of the information processing system of the first embodiment.

A user environment E1-1 represents an educational site where the information processing system 1 is introduced. In a lecture room A001, which is the user environment E1-1, an output device 50 and whiteboards WB1 and WB2 are installed. there is

The user ID of the teacher of this lecture is "tanaka@". Further, in the example of FIG. 16, a user ID is assigned to each individual student. The student with the user ID "saito@" who is the user of the student terminal 40-2 and the student with the user ID "ando@" who is the user of the student terminal 40-3 are present. Other students also participate in the lecture titled "Mathematics A_01".

Also, in the example of FIG. 16 , the teacher terminal 30 requests the server device 10 to display the passcode, and the passcode 51 is displayed on the output device 50 via the intermediary device 20 .

In the following description, in the lecture titled "Mathematics A_01", for example, at the beginning of the lecture, answer sheets are distributed to the students in the lecture room, and the students give presentations using whiteboards WB1 and WB2 and test will be explained assuming that

Each of the answer sheets and the whiteboards WB1 and WB2 has an answer QR in which a registration ID associated with the camera application 13-1 included in the input application group 13 and a URL corresponding to the application determination unit 12 are embedded. A code 52 and a blackboard QR code 53 are attached in advance.

Information indicating that the QR code corresponds to the answer sheet is embedded in the answer QR code 52, and information indicating that the QR code corresponds to the whiteboard WB is embedded in the blackboard QR code 53. It may be embedded.

For example, the blackboard QR code 53 may be embedded with a registration ID that specifies an application that stores image data in association with the teacher's user ID regardless of which terminal the image of the whiteboard WB is captured. good.

In the example of FIG. 16, the teacher requests the submission of image data of the whiteboards WB1 and WB2 on which the content of the presentation is described, and asks the students to whom the answer sheets have been distributed to submit the image data of the completed answer sheets. In addition, the teacher requests that each image data be submitted within the lecture time.

The student who is the user of the student terminal 40-1 and the student who is the user of the student terminal 40-2, who are attending the lecture, use the student terminals 40-1 and 40-2 to answer the answer sheets P1 and P2, respectively. Hold it over the QR code 52.

When the student terminals 40-1 and 40-2 read the answer QR code 52, they activate the camera function according to the procedure described with reference to FIG. Then, when the student terminals 40-1 and 40-2 accept the input of the account information of each student and the passcode 51, and then accept the image capturing operation, images of the answer sheets P-1 and P-2 are captured. Then, the captured image data is transmitted to the server device 10 .

Students who have given presentations using the whiteboards WB1 and WB2 hold their own student terminals 40 over the blackboard QR codes 53 of the whiteboards WB1 and WB2. When the student terminal 40 reads the blackboard QR code 53, it activates the camera function according to the processing procedure described with reference to FIG. When the image capturing operation is accepted, images of the whiteboards WB1 and WB2 are captured, and the captured image data is transmitted to the server device 10 .

It should be noted that in the present embodiment, when uploading image data obtained by imaging the whiteboard WB, it is not necessary to enter a passcode.

Also, the student who is the user of the student terminal 40-3 who received the answer sheet leaves the lecture room A001 after receiving the answer sheet, fills in the answers on the answer sheet in another place, and sends the QR code 52 to the student. Assume that the terminal 40-3 is held up.

In this case, since the student cannot see the passcode displayed on the output device 50, it is assumed that the passcode is not input and the image data of the completed answer sheet P3 is transmitted to the server device 10.例文帳に追加

The storage of image data by the storage control unit 16 of the server device 10 will be described below with reference to FIGS. 17 to 20. FIG.

FIG. 17 is a diagram illustrating an example of a lesson information storage unit according to the first embodiment; The lesson information storage unit 125 of this embodiment has tenant ID, lesson number, lecture room number, start time, lesson time, teacher, and content ID as information items.

A class number is information that uniquely identifies a lecture, and may be a lecture name. The lecture room number is information specifying the lecture room used for the lecture, and may be the name of the lecture room. The start time indicates the start time of the lecture specified by the lecture number, and the class time indicates the class hours of the lecture specified by the lecture number. The teacher is the user ID of the teacher who gives the lecture identified by the class number, and the content ID indicates the type of image data associated with the lecture identified by the class number.

Among the items of information included in the lesson information storage unit 125, values of items other than the item "content ID" are stored based on a predetermined timetable or the like. The item “content ID” value is stored according to the type of image data received by the storage control unit 16 of the server device 10 from the student terminal 40 .

In the following description, the information stored in the lesson information storage unit 125 may be called lesson information.

In FIG. 17, it can be seen that the lecture with the lecture title "Mathematics A_01" will be given by the teacher with the user ID "tanaka@" in the lecture room "A001" from 10:00 on October 25th for 60 minutes.

In the example of FIG. 17, the lecture name "Mathematics A_01" is associated with the content IDs "Answer_Mathematics A01", "WB_Mathematics A01", and "Display_Mathematics A01". In other words, it can be seen that three types of image data are associated with the lecture title "Mathematics A_01".

The content ID “Answer_Mathematics A01” indicates that the type of image data is image data of an answer sheet. The content ID “WB_Mathematics A01” indicates that the type of image data is whiteboard image data. The content ID “display_mathematics A01” is information associated with the browser ID that displayed the passcode during the lecture with the lecture name “mathematics A_01”.

When the storage control unit 16 of this embodiment receives the image data of the answer sheet and the class number from the student terminal 40, the value of the item "content ID" corresponding to the class number in the class information storage unit 125 is: "Answer_Mathematics A01" is stored. Then, the storage control unit 16 stores the received image data in the answer information storage unit 126 in association with the content ID value “answer_math A01”.

Further, when the storage control unit 16 receives the image data of the whiteboard WB from the student terminal 40, the storage control unit 16 stores “WB_mathematics A01” as the value of the item “content ID” in the lesson information storage unit 125, The received image data is stored in the blackboard information storage unit 127 .

In addition, the storage control unit 16 of the present embodiment, when displaying a passcode on the output device 50 via the mediation device 20 during the lecture, sets the value of the item "content ID" in the class information storage unit 125 to "Display_Mathematics A01" is stored, and the browser ID of the intermediary device 20 is stored in the installation information storage unit 128. FIG.

FIG. 18 is a diagram showing an example of an answer information storage unit according to the first embodiment. The answer information storage unit 126 of this embodiment includes content D, user ID, student number, file ID, upload time, and passcode as information items. In the following description, the information stored in the answer information storage unit 126 may be called answer information.

Image data of an answer sheet imaged by the student terminal 40 is stored in the answer information storage unit 126 . The user ID in the answer information storage unit 126 indicates account information given to the image data, and the file ID indicates identification information for specifying the image data. In the answer information storage unit 126, the upload time indicates the time when the image data was uploaded, and the passcode indicates the passcode given to the image data.

In the example of FIG. 18, the image data of the answer sheet whose content ID is "answer_mathematics A01" is stored. Specifically, in the example of FIG. 18, the user ID "tokiwa@", the student with the user ID "saito@", and the student with the user ID "ando@" are uploaded from the student terminals 40, respectively. Image data of the answer sheet is stored.

Here, the answer information including the user ID "ando@" has the passcode "0000", indicating that the passcode was not entered when the image data was sent.

FIG. 19 is a diagram illustrating an example of a blackboard information storage unit according to the first embodiment; The blackboard information storage unit 127 has content ID, user ID, file ID, and date as information items. In the following description, the information stored in the blackboard information storage unit 127 may be called blackboard information.

In the blackboard information storage unit 127, the file ID is identification information that identifies the image data of the whiteboard WB, and the date indicates the date and time when the image data was captured.

In the example of FIG. 19, the image data of the whiteboard WB whose content ID is "WB_Mathematics A01" is stored.

FIG. 20 is a diagram illustrating an example of an installation information storage unit according to the first embodiment; The installation information storage unit 128 associates content IDs and browser IDs as information items.

In the example of FIG. 20, the content ID "display_mathematics A01" is associated with the browser ID "BROWSER1". Therefore, it can be seen from FIG. 20 that the passcode was displayed by the intermediary device 20 having the browser indicated by "BROWSER1" in the lecture with the lecture name "Mathematics A01".

As described above, the storage control unit 16 of the present embodiment can store the image data uploaded from the student terminal 40 for each type of imaging object based on the information stored in advance in the lesson information storage unit 125. can.

Further, the storage control unit 16 of the present embodiment stores information indicating the history of passcodes displayed on the output device 50 by the mediation device 20 in the passcode history storage unit 129 . FIG. 21 is a diagram illustrating an example of a passcode history storage unit according to the first embodiment;

The passcode history storage unit 129 of this embodiment has date and time, browser ID, and passcode as information items. In the example of FIG. 21, it can be seen that the passcode displayed for the browser ID "BROWSER1" changes at intervals of 15 minutes.

In addition, the storage control unit 16 of this embodiment stores information indicating the history of image data displayed via the mediation device 20 in the display history storage unit 130 . 22 is a diagram illustrating an example of a display history storage unit according to the first embodiment; FIG.

The display history storage unit 130 of this embodiment has date and time, browser ID, user ID, and file ID as information items. The date and time indicates the date and time when the image data specified by the file ID was displayed on the output device 50 via the intermediary device 20 specified by the browser ID. The user ID indicates a user ID associated with the user terminal that has requested the mediation device 20 to display the image data.

In this manner, the storage control unit 16 of the present embodiment associates and stores the passcode and image data with the browser unit 23 of the mediation device 20 that displays the passcode and image data.

Next, the operation of the teacher terminal 30 in the information processing system 1 will be described. The server device 10 of the present embodiment refers to the information stored in each of the storage units described above, and causes the teacher terminal 30 to display information indicating the attendance information of the students in each lecture.

FIG. 23 is a diagram illustrating an example of a processing procedure for displaying an attendance list on the teacher terminal according to the first embodiment.

In the teacher terminal 30 of this embodiment, the controller 31 detects that the teacher presses the URL shortcut icon displayed on the teacher terminal 30 (step S2301).

The URL shortcut icon displayed on the teacher terminal 30 is embedded with an initial access URL for connecting to the server device 10 and a registration ID “Tag_Ed” indicating a service provided to the teacher terminal 30 . In other words, the URL shortcut icon is embedded with tag information including the initial access URL and the registration ID. The registration ID “Tag_Ed” is associated with the application ID “AP_EdPortal” in the registration information storage unit 124 .

When the teacher terminal 30 detects that the URL shortcut icon has been pressed, the teacher terminal 30 activates the browser unit 32 and connects to the initial access URL destination embedded in the URL shortcut icon (step S2302).

Upon activation, the browser unit 32 automatically transmits an HTTP request to the application determination unit 12 corresponding to the initial access URL embedded in the URL shortcut icon (step S2303). The HTTP request includes, in addition to the registration ID, account information including the teacher's user ID and the tenant ID of the user environment E1.

Upon receiving the HTTP request, the application determination unit 12 of the server device 10 authenticates the account information included in the HTTP request. If the authentication is successful, step S2304 and subsequent steps are executed. Authentication is performed by, for example, whether the account information included in the HTTP request is registered in the account information storage unit 123 .

When the authentication succeeds, the application determination unit 12 transmits a response (HTTP response) including a redirect request to the browser unit 32 (step S2304).

Subsequently, in accordance with the redirect request, the browser unit 32 transmits an HTTP request (redirect) to the redirect destination teacher portal URL (that is, the teacher portal application 13-3) (step S2305).

In response to the HTTP request, the teacher portal application 13-3 transmits the display data of the input screen for inputting the class number and the class number input on the input screen to the browser unit 32 of the teacher terminal 30 to the server device 10. and a script for executing the process is sent to the browser unit 32 (step S2306).

Upon receiving this response, the browser unit 32 generates an input screen for the class number based on the display data, displays the input screen on the output device 311, and receives the input of the class number. 13-4 (step S2307).

The attendance display application 13-4 transmits to the browser unit 32 display data for causing the browser unit 32 to draw a screen showing the attendance status of the student in the class indicated by the class number (step S2308). Based on this display data, the browser unit 32 displays an attendance screen showing the status of attendance (step S2309).

A display example on the teacher terminal 30 of this embodiment will be described below with reference to FIG. FIG. 24 is a diagram showing a display example of the teacher's terminal according to the first embodiment.

A screen 241 shown in FIG. 24 is an attendance screen displayed on the teacher terminal 30 in step S2309 of FIG.

A screen 241 displays information 242 about the lecture identified by the class number, and information 243 indicating the status of the student's attendance at the lecture identified by the class number.

The information 243 indicating the status of attendance includes, as information items, user ID, student number, answer submission, lecture attendance, attendance, and additional column.

The value of the item "answer submission" indicates whether or not the image data of the answer sheet has been submitted. Specifically, the value of the item "submit answer" indicates whether image data corresponding to the lecture name indicated in the information 242 and corresponding to the user ID is stored in the answer information storage unit 126. .

The value of the item "lecture attendance" indicates whether or not the user has attended the lecture. Specifically, the value of the item "lecture attendance" corresponds to the lecture name in the answer information storage unit 126, and the upload time of the image data corresponding to the user ID is the time when the passcode was displayed. It indicates whether or not they match.

The value of the item "attendance" indicates whether or not the student corresponding to the user ID attended the lecture and submitted the answer sheet. The value of the item "supplementary column" indicates supplementary information regarding the judgment of attendance.

In this embodiment, the server device 10 stores the lesson information storage unit 125 shown in FIG. 17, the answer information storage unit 126 shown in FIG. 18, and the passcode history storage unit 129 shown in FIG. refer to

The teacher application 13-3 extracts the answer information including the class number and the corresponding user ID in the answer information storage unit 126, and the upload time and passcode included in each answer information are within class hours, and , determines whether or not the passcode matches the passcode displayed on the output device 50 at the upload time. Then, the teacher application 13-3 reflects the result in the values of the items "lecture attendance", "attendance", and "additional column" of the information 243 indicating the attendance status.

In the example of FIG. 24, the passcode of the answer information including the user ID "ando@" does not match the passcode displayed at the time of uploading. The value is "x".

As described above, according to the present embodiment, it is possible to determine whether or not the passcode is uploaded from a position where the passcode displayed on the output device 50 can be seen.

Also, in this embodiment, the passcode is dynamically changed. Furthermore, the present embodiment has a passcode history storage unit 129 that stores information indicating the display history of passcodes. Therefore, in the present embodiment, the passcode can be used to determine the time zone in which the image data was uploaded.

In other words, the passcode of the present embodiment can be used as information specifying the location where the image data was uploaded and the time period during which the image data was uploaded. In other words, the passcode can be used as information for determining whether or not the image data was uploaded in the lecture room during the lecture.

In this embodiment, the passcode is a four-digit number displayed on the output device 50 via the mediation device 20, but is not limited to this.

In this embodiment, instead of the passcode, a password or the like given orally by the subject in which the lecture is given may be used. Also, in this embodiment, a QR code may be displayed on the output device 50 instead of the passcode. In this case, the student inputs the passcode by reading the QR code with the student terminal 40 .

Also, in this case, the QR code displayed on the output device 50 may be used as the answer QR code to be pasted on the answer sheet. In that case, the QR code to be displayed on the output device 50 may be embedded with the same information as the answer QR code pasted on the answer sheet.

Also, in the present embodiment, the passcode is displayed on the output device 50 and input to the student terminal 40, but the method of acquiring the passcode by the student terminal 40 is not limited to this. For example, the passcode may be transmitted by wireless communication or the like from a device associated with the server device 10 . Specifically, for example, the passcode may be transmitted as a beacon signal.

In this case, the student terminal 40 does not display a passcode entry field as shown in the screen 152 shown in FIG. 15B. Further, in this case, the student terminal 40 receives the transmitted passcode when, for example, the start button 152d for transitioning to the photographing screen of the answer sheet is operated, and acquires the passcode. good.

Also, in this embodiment, the information included in the answer QR code pasted on the answer sheet is assumed to be the registration ID and the initial access URL, and the account information, student number, and class number are assumed to be entered by the student into the student terminal 40. However, it is not limited to this.

In the answer QR code of the present embodiment, for example, when common account information is given to all students, a registration ID, an initial access URL, and account information may be embedded.

Furthermore, in addition to the record ID, initial access URL, and account information, the class number may be embedded in the answer QR code of this embodiment.

In this way, the more information embedded in the answer QR code, the less information the student has to input to the student terminal 40, thus reducing the time and effort of the student to input information.

In this embodiment, the user environment has been described as an educational site, but the present invention is not limited to this. The user environment may be, for example, a meeting room of a company, or any other environment as long as it is required to add information indicating a specific condition to image data captured by a user terminal. can be Here, the specific condition is the condition that the user terminal is in a position where a passcode that changes with the passage of time can be acquired, and the information indicating the specific condition is the passcode (specific information).

(Second embodiment)
A second embodiment will be described below with reference to the drawings. The second embodiment differs from the first embodiment in that a passcode is not entered when uploading image data. Therefore, in the following second embodiment, the differences from the first embodiment will be explained, and those having the same functional configuration as the first embodiment will be the same as those used in the explanation of the first embodiment. Reference numerals are assigned and descriptions thereof are omitted.

FIG. 25 is a diagram for explaining the outline of the second embodiment. In this embodiment, when uploading the image data of the completed answer sheet P from the student terminal 40, the input of the passcode is not required.

In this embodiment, when the student terminal 40 reads the answer QR code 52 pasted on the answer sheet P, the screen 154, which is an input screen, is displayed on the student terminal 40 by the same procedure as the processing procedure shown in FIG. Let Screen 154 corresponds to the input screen displayed in step S1316 of FIG.

In the present embodiment, since the input of the passcode is not required, the screen 154 displays an input field 154a for the student number and an input field 154b for the class number.

When the student number and the class number are entered on the screen 154, the student terminal 40 uploads the image data to the server device 10A in the same procedure as the procedure after step S1317 in FIG.

In this embodiment, since a passcode is not entered, the image data is assigned a student number and a class number and uploaded to the server apparatus 10A.

The server device 10A has, for example, an image data storage unit 125A that stores image data. In the image data storage unit 125A of this embodiment, a folder F1 is provided for each class number, and subordinately there are folders F1 for each date and time when the lecture indicated by the class number was held. Under the folder F2, a folder F3 for each student number is provided. Folders F1, F2, and F3 are storage areas provided in image data storage unit 125A.

When the image data assigned with the class number and the student number is uploaded from the student terminal 40, the server device 10A of the present embodiment refers to the class number and the student number by the storage control unit 16. FIG.

Then, in the image data storage unit 125A, the storage control unit 16 subordinates to the folder F1 corresponding to the class number assigned to the image data, and in the folder F2 having the date corresponding to the date and time when the image data was uploaded, The image data is stored in the folder F3 corresponding to the student number.

In other words, the storage control unit 16 stores the image data in the class information storage unit 125A for each group classified by class number, date, and student number.

The date and time when the image data is uploaded is the date and time when the server device 10A receives the image data.

Therefore, in this embodiment, the student simply holds the student terminal 40 over the answer QR code 52, inputs the student number and class number on the displayed input screen 154, and captures the image of the answer sheet P. The image data of the paper P is stored in the folder F3 of the corresponding student number.

Therefore, according to the present embodiment, captured image data can be uploaded to a specific storage location by a simple procedure without setting the student terminals 40 in advance.

In the present embodiment, the folder F2 and the folder F3 are provided under the folder F1 provided for each class number, but the present invention is not limited to this. Only the folder F1 and the folder F2 may be provided in the image data storage unit 125A.

In this embodiment, the class number and date are group identification information for grouping image data. In the present embodiment, by adding group identification information to image data and uploading it to the server device 10A, the uploaded image data can be stored in folders for each group.

Therefore, according to this embodiment, for example, when a teacher selects desired image data from among the image data stored in the image data storage unit 125A, it is enough to open the folder in which the corresponding image data is stored. , the desired image data can be easily selected.

Further, according to this embodiment, when image data is uploaded, it is automatically stored in the designated folder. Therefore, according to the present embodiment, after uploading the image data, there is no need to organize the image data such as sorting the image data stored in the image data storage unit 125A into folders.

In this embodiment, the class number and student number are input to the student terminal 40 by the student, but the present invention is not limited to this.

In this embodiment, for example, the answer sheet P is provided with a student number entry field 54 and a class number entry field 55 . The student terminal 40 may convert the handwritten characters entered in the entry fields 54 and 55 from the image data of the answer sheet P into text data using an OCR (Optical Character Recognition) function or the like, and add the text data to the image data.

Further, in this embodiment, the student number and the class number may be input from the input screen 154 and read from the entry fields 54 and 55 . If the entered student number and class number match the student number and class number read from the entry fields 54 and 55, the student number and class number may be added to the image data.

Further, in this embodiment, if common account information is given to the students, the account information and the class number may be embedded in the answer QR code 52 . In this case, the student only needs to enter the student number, which saves the student's input work.

In this embodiment, the user environment is an educational site, but the user environment is not limited to an educational site. The user environment may be, for example, a corporate conference room.

Also, in the present embodiment, the answer QR code 52 is pasted on the answer sheet P, which is the object to be imaged, but the present invention is not limited to this. The QR code corresponding to the answer QR code 52 does not have to be pasted on the object to be imaged, as long as it is associated with the object to be imaged.

Specifically, for example, before capturing an image of an object, a QR code prepared in advance and embedded with a registration ID and an initial access URL is read by a user terminal, and after the camera function is activated in the user terminal, a predetermined An imaging target whose image is captured within a time period may be used as the imaging target associated with the QR code.

Note that the server device 10, mediation device 20, output devices such as the output device 50, and user terminals 30 and 40 in the above embodiments may each be constructed by a single computer, or each part (function or means) may be It may be constructed by a plurality of computers divided and arbitrarily assigned.

Note that each function of the embodiments described above can be realized by one or a plurality of processing circuits. Here, the "processing circuit" in this specification means a processor programmed by software to perform each function, such as a processor implemented by an electronic circuit, or a processor designed to perform each function described above. devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays) and conventional circuit modules.

Although the present invention has been described above based on each embodiment, the present invention is not limited to the requirements shown in the above embodiments. These points can be changed within the scope of the present invention, and can be determined appropriately according to the application form.

1 Information processing system 10 Server device 11 Communication unit 12 Application determination unit 13 Input application group 14 Output application 15 Specific information allocation unit 16 Storage control unit 20 Intermediary device 21 Communication control unit 22 Browser management unit 23 Browser unit 30 Teacher terminal (user terminal )
31, 41 control units 32, 42 browser unit 40 student terminal (user terminal)
50 Output device 121 Application information storage unit 122 Device information storage unit 123 Account information storage unit 124 Registration information storage unit 125 Class information storage unit 126 Answer information storage unit 127 Blackboard information storage unit 128 Installation information storage unit 129 Passcode history storage unit 130 Display history storage

Japanese Patent No. 6098193

Claims (12)

An information processing system including an intermediary device communicable with a device and an information processing device communicable with the intermediary device,
a receiving unit that receives, from the device, identification information for specifying a service and specific information for specifying an output device for displaying information input to the intermediary device;
a transmission unit that activates the imaging function of the device corresponding to the identification information and transmits to the device a request to execute processing for realizing a service for uploading captured image data;
An information processing system comprising an image data storage unit storing image data captured by the imaging function and associated with the specific information, and image data captured by the imaging function . The specific information is
2. The information processing system according to claim 1, wherein said information indicates that said device was located in a room containing said intermediary device. 3. The information processing system according to claim 1, wherein said specific information is information updated with the passage of time, and is information specifying a time zone in which said image data was captured. The identification information is information embedded in a two-dimensional code associated with the object to be imaged,
The specific information is
information displayed on an output device by the intermediary device in response to an output request from the information processing device;
The transmission unit
Display data for receiving the identification information and displaying an input screen for the specific information, and a request to execute processing for transmitting the specific information input to the input screen to the information processing device, to the device. send and
The receiving unit
4. The information processing system according to any one of claims 1 to 3, wherein the specific information input to said input screen is received from said device. The specific information is embedded in a two-dimensional code together with the identification information,
4. The information processing system according to claim 3, wherein the information is information read by the device. The two-dimensional code is
6. The information processing system of claim 5, wherein account information corresponding to said device is included. The specific information is
information transmitted by wireless communication from a transmitter associated with the intermediary device;
4. The information processing system according to claim 3, wherein said device receives said specific information when it comes within a predetermined range from said intermediary device. The transmission unit
Execution of processing for receiving the identification information and transmitting display data for displaying a group information input screen indicating a group of the device and information input to the group information input screen to the information processing device. sending a request to the device;
The receiving unit
receiving the group information input to the group information input screen from the device;
The uploaded image data is
8. The information processing system according to claim 1, stored in a storage area associated with said group information in said image data storage unit. Included in the information processing system according to any one of claims 1 to 8,
A device that, when held over a two-dimensional code associated with an object to be imaged, reads information embedded in the two-dimensional code and transmits the information to the information processing device. An information processing device that communicates with an intermediary device that can communicate with a device,
a receiving unit that receives, from the device, identification information for specifying a service and specific information for specifying an output device for displaying information input to the intermediary device;
a transmission unit that activates the imaging function of the device corresponding to the identification information and transmits to the device a request to execute processing for realizing a service for uploading captured image data;
An information processing apparatus, comprising: image data captured by the imaging function and an image data storage section storing the specific information in association with each other. An information processing method by an information processing system including an intermediary device communicable with a device and an information processing device communicable with the intermediation device,
The information processing device
receiving, from the device, identification information for specifying a service and specific information for specifying an output device for displaying information input to the intermediary device;
Sending to the device a request to execute a process for realizing a service for activating the imaging function of the device and uploading the captured image data corresponding to the identification information,
An information processing method , wherein image data captured by the imaging function and associated with the specific information and image data captured by the imaging function are stored in an image data storage unit . An information processing device that communicates with an intermediary device that can communicate with the device,
a process of receiving, from the device, identification information for specifying a service and specific information for specifying an output device for displaying information input to the intermediary device;
A process of transmitting to the device a request to execute a process for realizing a service for activating the imaging function of the device and uploading captured image data corresponding to the identification information;
An information processing program for executing a process of storing image data captured by the imaging function and associated with the specific information and image data captured by the imaging function in an image data storage unit.

Images