JP7014141B2 - Information processing system, information processing device, information processing method and program - Google Patents

Description

The present invention relates to an information processing system, an information processing device, an information processing method and a program.

In the office, work is carried out using various devices. By utilizing various devices and applications, it can be expected that business efficiency will be improved.

As one of them, there is known a technique of automatically storing image data of an image captured by a terminal device in a predetermined storage destination. Specifically, for example, by installing a dedicated application on the terminal device, the terminal device stores the image data captured after reading the QR code (registered trademark) in the storage destination indicated by the QR code. It has been known.

However, in the conventional technology, it is necessary to set in advance such as installing a dedicated application on the terminal device. For this reason, a user who has few opportunities to use the above-mentioned functions must install and pre-configure the application in order to give the terminal device a function that is rarely used, and the procedure is complicated.

The present invention has been made in view of the above points, and an object of the present invention is to store image data in a storage destination designated by a simple procedure.

The disclosed technology is an information processing system including an information processing device capable of communicating with a device, in which a receiving unit that receives identification information for identifying a service from the device and an image pickup function of the device are activated and imaged. A transmission unit that transmits a processing execution request for realizing the service specified by the identification information to upload the image data to the device, an image data storage unit that stores the image data captured by the image pickup function, and the image data storage unit. Has.

Image data can be stored in the specified storage destination with a simple procedure.

It is a figure which shows the structural example of the information processing system of 1st Embodiment. It is a figure which shows the hardware configuration example of the server apparatus of 1st Embodiment. It is a figure which shows the hardware configuration example of the user terminal of 1st Embodiment. It is a figure which shows the hardware configuration example of the intermediary device of 1st Embodiment. It is a figure for demonstrating the outline of the 1st Embodiment. It is a figure which shows the functional composition example of each apparatus of 1st Embodiment. It is a sequence diagram for demonstrating an example of the processing procedure executed in response to the activation of the intermediary apparatus of 1st Embodiment. It is a figure which shows the structural example of the device information storage part of 1st Embodiment. It is a figure which shows the structural example of the registration information storage part of 1st Embodiment. It is a figure which shows the configuration example of the application information storage part of 1st Embodiment. It is a figure explaining the generation and allocation of the passcode of 1st Embodiment. It is a figure which shows the display example of the passcode in the output device of 1st Embodiment. It is a sequence diagram for demonstrating an example of the processing procedure of uploading image data from a student terminal of 1st Embodiment to a server apparatus. It is a figure which shows the structural example of the account information storage part of 1st Embodiment. It is a figure which shows the display example in the student terminal of 1st Embodiment. It is a figure explaining the use scene of the information processing system of 1st Embodiment. It is a figure which shows an example of the lesson information storage part of 1st Embodiment. It is a figure which shows an example of the answer information storage part of 1st Embodiment. It is a figure which shows an example of the blackboard information storage part of 1st Embodiment. It is a figure which shows an example of the installation information storage part of 1st Embodiment. It is a figure which shows an example of the passcode history storage part of 1st Embodiment. It is a figure which shows an example of the display history storage part of 1st Embodiment. It is a figure which shows an example of the processing procedure which displays the list of attendance on the teacher terminal of 1st Embodiment. It is a figure which shows the display example of the teacher terminal of 1st Embodiment. It is a figure for demonstrating the outline of the 2nd Embodiment.

(First embodiment)
Hereinafter, embodiments will be described based on the drawings. FIG. 1 is a diagram showing a configuration example of an information processing system.

In the information processing system 1 shown in FIG. 1, the server device 10 and the user environment E1 can communicate with each other via a wide area network N1 such as the Internet. However, the network N1 may be a network that can be accessed within a predetermined range, such as an intranet.

The user environment E1 is a system environment in an organization such as a company in which one or more output devices 50 and one or more intermediary devices 20 are installed, or in an educational institution such as a school. The output device 50 is a device that displays an input image on a display unit, and may be, for example, a projector, an electronic blackboard, or the like. In the user environment E1, each output device 50 is connected to the corresponding intermediary device 20. That is, there is a one-to-one correspondence between the output device 50 and the intermediary device 20. The output device 50 and the intermediary device 20 are connected via an interface conforming to a standard capable of transmitting an image, such as HDMI (registered trademark) (High-Definition Multimedia Interface). For example, a computer such as an HDMI (registered trademark) dongle or a stick PC may be used as the intermediary device 20.

For example, the output device 50 and the intermediary device 20 may be connected by a cable corresponding to the interface (for example, an HDMI (registered trademark) cable or the like). Alternatively, the connector of the intermediary device 20 corresponding to the interface and the connector of the output device 50 for the interface may be directly connected. For example, both may be connected by inserting the intermediary device 20 into the connector of the output device 50. Alternatively, the intermediary device 20 and the output device 50 may be connected by wireless communication or may be connected via a network.

By connecting the output device 50 and the intermediary device 20 as described above, the intermediary device 20 can transmit the image to be displayed to the output device 50.

The intermediary device 20 is connected to the network N1 via a LAN or the like in the user environment E1. The intermediary device 20 may be wirelessly connected to a LAN or the like in the user environment E1. The intermediary device 20 is provided with a Web browser inside, and the Web browser executes a process according to a process execution request for image data transmitted from the server device 10 to control the output device 50 (execution of the process). Output the result to the output device 50).

Specifically, in the present embodiment, the intermediary device 20 causes the output device 50 to output (display) the image data. That is, the mediation device 20 mediates the output (display) of the image by the output device 50 for the data transmitted from the server device 10.

Further, in the present embodiment, the intermediary device 20 outputs (displays) specific information for specifying the output device 50 from the output device 50. This specific information is information that can be acquired only when the user of the user terminal 40 is in the vicinity of the output device 50, and is information that changes with the passage of time.

Then, in the present embodiment, when the image data is transmitted (uploaded) from the user terminal 40 to the server device 10, the user terminal 40 is made to add specific information to the uploaded image data.

As a result, the server device 10 can manage the specific information as information indicating the position and time zone of the user terminal 40 when the image data is uploaded. In other words, according to the present embodiment, the server device 10 can manage the uploaded image data in association with the information indicating the place and time zone in which the image data is captured.

Further, in the server device 10 of the present embodiment, when the QR code or the like is read by the user terminal 40, the user terminal 40 activates an image pickup function, and the captured image data and the specific information correspond to the QR code. Send to the attached storage destination.

Therefore, in the present embodiment, the captured image data can be transmitted to the designated storage destination (upload destination) simply by holding the user terminal 40 over the QR code.

The user terminals 30 and 40 are information processing terminals carried by each user in the user environment E1. For example, a smartphone, a tablet terminal, a PC, a mobile phone, or the like may be used as the user terminals 30 and 40. The user terminals 30 and 40 can be connected to the network N1 without going through a LAN or the like in the user environment E1 (for example, via a mobile communication network or the like). However, the user terminals 30 and 40 may be connectable to the network in the user environment E1.

In the present embodiment, for example, when the image data uploaded from the user terminal 40 to the server device 10 via the network N1 is designated by the user terminal 30, the image designated via the intermediary device 20 is received. The data may be displayed on the output device 50.

The server device 10 is one or more computers that execute a process for realizing output by the output device 50 with respect to the image data specified from the user terminals 30 and 40 by a simple operation using the user terminals 30 and 40. be.

Further, the server device 10 is one or more computers that execute a process of storing image data captured by the user terminals 30 and 40 in a preset storage destination by a simple operation using the user terminals 30 and 40. Is. The server device 10 may be installed in the user environment E1.

FIG. 2 is a diagram showing a hardware configuration example of the server device. The server device 10 of FIG. 2 has a drive device 100, an auxiliary storage device 102, a memory device 103, a CPU 104, an interface device 105, and the like, which are connected to each other by a bus B, respectively.

The program that realizes the processing in the server device 10 is provided by a recording medium 101 such as a CD-ROM. When the recording medium 101 storing the program is set in the drive device 100, the program is installed in the auxiliary storage device 102 from the recording medium 101 via the drive device 100. However, the program does not necessarily have to be installed from the recording medium 101, and may be downloaded from another computer via the network. The auxiliary storage device 102 stores the installed program and also stores necessary files, data, and the like.

The memory device 103 reads and stores the program from the auxiliary storage device 102 when the program is instructed to start. The CPU 104 executes the function related to the server device 10 according to the program stored in the memory device 103. The interface device 105 is used as an interface for connecting to a network.

FIG. 3 is a diagram showing an example of hardware configuration of a user terminal. In the present embodiment, the user terminals 30 and 40 have the same hardware configuration, and in FIG. 3, the hardware configuration of the user terminal 30 will be described as an example.

In FIG. 3, the user terminal 30 includes a CPU 301, a ROM 302, a RAM 303, a touch panel 304, an auxiliary storage device 305, a short-range wireless communication device 306, a digital camera 307, and the like.

The ROM 302 and the auxiliary storage device 305 store programs and the like installed in the user terminal 30. The RAM 303 reads and stores the program from the ROM 302 or the auxiliary storage device 305 when the program is instructed to start. The CPU 301 realizes the function related to the user terminal 30 according to the program stored in the RAM 303.

The touch panel 304 is an electronic component having both an input function and a display function, and displays information, accepts input from a user, and the like. The touch panel 304 includes an output device 311, an input device 312, and the like.

The output device 311 is a liquid crystal display or the like, and is responsible for the display function of the touch panel 304. The input device 312 is an electronic component that includes a sensor that detects contact with the output device 311. The contact object means an object that comes into contact with the contact surface (surface) of the touch panel 304. Examples of such an object include a user's finger, a dedicated or general pen, and the like. The touch panel 304 does not necessarily have to be provided, and the user terminal 30 may separately include the output device 311 and the input device 312. Further, the output device 311 may be externally connected to the user terminal 30. Further, the input device 312 is not limited to a sensor that detects contact, but also includes electronic components such as a hardware key, a keyboard, and a mouse.

The short-range wireless communication device 306 is hardware for performing short-range wireless communication. In the present embodiment, the short-range wireless communication device 306 reads the information stored in the NFC tag. That is, in the present embodiment, the NFC reader is suitable for the short-range wireless communication device 306. The digital camera 307 is a general digital camera having an image pickup function and may be built in the user terminal 30 as an electronic component or may be externally connected to the user terminal 30.

The user terminals 30 and 40 of the present embodiment may not have, for example, a touch panel 304, a digital camera 307, or a short-range wireless communication device 306. The output device 311 of the user terminals 30 and 40 of the present embodiment may be a display, and the input device 312 may be a keyboard, a pointing device, or the like.

FIG. 4 is a diagram showing a hardware configuration example of the intermediary device. The mediation device 20 in FIG. 4 includes an auxiliary storage device 201, a memory device 202, a CPU 203, a communication interface 204, an image interface 205, and the like.

The program that realizes the processing in the intermediary device 20 is installed in the auxiliary storage device 201. The auxiliary storage device 201 stores the installed program and also stores necessary files, data, and the like.

The memory device 202 reads and stores the program from the auxiliary storage device 201 when the program is instructed to start. The CPU 203 executes the function related to the intermediary device 20 according to the program stored in the memory device 202. Communication interface 204 is a physical interface for connecting to a network. The image interface 205 is a physical interface for transmitting an image to the output device 50.

FIG. 5 is a diagram for explaining an outline of the present embodiment. In FIG. 5, when the information processing system 1 of the present embodiment is introduced in an educational field such as a school, the user terminal 30 is mainly used by a teacher, and the user terminal 40 is mainly used by a student. Is shown. In the following description, the user terminal 30 is referred to as a teacher terminal 30, and the user terminal 40 is referred to as a student terminal 40.

Specifically, FIG. 5 shows a case where a test is performed during a certain lecture and the image data of the test answer sheet is stored in the server device 10 for the teacher to view. The background of this usage scene will be described below.

Generally, the completed answer sheet is submitted to the teacher for scoring, and if the answer sheet is returned to the student, it will be after the scoring is completed. For this reason, if a student wants to self-assess what he / she has filled out on the answer sheet, he / she needs to memorize the test questions and what he / she wrote on the answer sheet, but memorize the details of the answer sheet. Things are often difficult.

Also, if the teacher wants the student to review the test questions after the test is complete, the teacher must promptly score and return the graded answer sheet to the student, but always promptly. Is not always possible.

For this reason, in the field of education, immediately after the test, a copy (copy or photo) of the answer sheet with the answer is taken and the completed answer sheet is returned to the student. The task of making a copy of the answer sheet for all the students is very complicated and burdensome for the teacher.

Therefore, in the present embodiment, the student simply captures an image of his / her own completed answer sheet on the student terminal 40, and the captured image data is transmitted to a storage destination designated in advance by the teacher.

In the information processing system 1 of the present embodiment, the teacher terminal 30 requests the server device 10 to generate specific information (step S1). Upon receiving the request, the server device 10 generates a specific information and makes a request for execution of a process of outputting the specific information to the intermediary device 20 (step S2).

Upon receiving the processing execution request, the intermediary device 20 causes the output device 50 to display the specific information 51 (step S3).

The output device 50 of the present embodiment is, for example, a display device installed in a lecture room or the like where a lecture is given. Specifically, the output device 50 may be, for example, an electronic blackboard or the like for displaying an image or a document to be viewed by both the student and the teacher.

Further, in the present embodiment, when the student terminal 40 is held over the QR code 52 previously attached to the answer sheet P, the QR code reading function is activated to read the QR code 52 (step S4). In the following description, the QR code attached (associated) to the answer sheet may be referred to as the answer QR code.

The answer QR code 52 may be, for example, issued by the information processing system 1 for each educational institution. Further, in the answer QR code 52, information for specifying the storage destination of the image data transmitted from the student terminal 40 is embedded.

When the student terminal 40 reads the answer QR code 52, it accesses the server device 10 (step S5) and receives an instruction to activate the image pickup function from the server device 10 (step S6).

When the student terminal 40 receives an instruction to activate the imaging function, an input screen for inputting the specific information 51 is displayed, and when the specific information 51 is input by the student, the camera function is activated and the shooting screen of the answer sheet P is taken. Is displayed. Then, when the student terminal 40 receives the operation of capturing the image of the answer sheet P from the student, the student terminal 40 captures the image of the answer sheet P (step S7).

Subsequently, the student terminal 40 adds the input specific information 51 to the image data of the captured answer sheet P, and transmits it to the storage destination indicated by the answer QR code 52 (step S8).

The server device 10 stores the image data received from the student terminal 40 in the designated storage destination (step S9).

In the present embodiment, the specific information output from the server device 10 according to the instruction of the teacher terminal 30 is added to the image data of the image captured by the student terminal 40 and stored in the server device 10. Image data can be associated with specific information. That is, according to the present embodiment, it is possible to manage the teacher who instructed the server device 10 to output the specific information in association with the student who transmitted the image data.

Further, in the present embodiment, the student terminal 40 realizes a function of transmitting the captured image data to a designated storage destination according to an instruction from the server device 10. Therefore, according to the present embodiment, it is not necessary to install a dedicated application, a procedure such as presetting is not required, and image data can be stored in a designated storage destination by a simple procedure.

Further, in the present embodiment, all the image data of the answer sheet captured by the student terminal 40 is automatically stored in the designated storage destination.

Therefore, if this embodiment is applied, the teacher does not need to make a copy of the answer sheet when returning the completed answer sheet to the student, and the burden on the teacher is reduced. In addition, if this embodiment is applied, the student can obtain the completed answer sheet immediately after the end of the test, and can be used for self-scoring, review, and the like.

Further, in FIG. 5, the subject of the image taken by the student terminal 40 is the answer sheet P, but the subject is not limited to this. In the present embodiment, if the QR code 53 is given to the whiteboard WB or the like installed in the lecture room in advance, the image data of the blackboard written on the board during the lecture can be transferred to the storage destination designated by the same mechanism. Can be sent. In the following description, the QR code attached (associated) to the whiteboard WB may be referred to as a blackboard QR code.

Therefore, for example, when a student makes a presentation using a whiteboard WB or the like or writes an answer to a question during a lecture, the blackboard QR code 53 assigned to the whiteboard WB by the student terminal 40 is used. If the image of the whiteboard WB is captured by reading the above, the image data of the whiteboard WB written on the board can be transmitted to the designated storage destination.

The specific information 51 may be any information assigned to specify the output device 50, and may be composed of any information such as numbers, characters, symbols, and figures. Further, the specific information 51 may be displayed on the output device 50 as a two-dimensional code such as a QR code (registered trademark). Further, the specific information 51 may be a beacon signal or the like transmitted from the output device 50 or a transmitter or the like associated with the output device 50. Further, the specific information 51 may be transmitted by wireless communication from the output device 50 or a transmitter associated with the output device 50.

In the following description, the specific information will be described as a passcode which is an example of the specific information. Details of the specific information will be described later.

FIG. 6 is a diagram showing a functional configuration example of each device. In FIG. 6, the teacher terminal 30 has a control unit (operating system unit) 31, a browser unit 32, and the like. Each of these parts is realized by a process of causing the CPU 301 to execute one or more programs installed in the teacher terminal 30.

The control unit 31 activates the browser unit 32 in response to an operation from the user of the teacher terminal 30. The browser unit 32 is, for example, a general Web browser, and executes processing according to HTML (HyperText Markup Language) data, a script (for example, Javascript (registered trademark)), or the like. Further, when the browser unit 32 is started, the initial access URL is transmitted to the server device 10.

At this time, the browser unit 32 transmits to the server device 10 not only the initial access URL but also the registration ID assigned as optional information to the initial access URL. The registration ID is identification information that identifies the service, and is associated with the application that realizes the service in advance.

Further, the browser unit 32 accesses the application associated with the registration ID among the applications possessed by the server device 10 in accordance with the redirect request from the server device 10 in response to the access to the initial access URL. The redirect request is a response from the server device 10 in response to the access to the initial access URL.

The browser unit 32 acquires data (HTML data, a script, etc.) indicating a processing execution request to the teacher terminal 30 from the accessed application.

The initial access URL indicates the URL to be accessed first when the teacher terminal 30 first accesses the server device 10.

The student terminal 40 of the present embodiment has a control unit (operating system unit) 41, a browser unit 42, and the like. Each of these parts is realized by a process in which one or more programs installed in the student terminal 40 are executed by the CPU of the student terminal 40.

The control unit 41 activates the browser unit 42 in response to an operation from the user of the student terminal 40. The browser unit 42 is, for example, a general Web browser, and displays various screens and the like.

The intermediary device 20 includes a communication control unit 21, a browser management unit 22, a browser unit 23, and the like. Each of these parts is realized by a process of causing the CPU 203 to execute one or more programs installed in the intermediary device 20.

The communication control unit 21 connects a bidirectional communication path (establishes a communication session) with the communication unit 11 of the server device 10, and functions as an end point on the mediation device 20 side in the communication path (communication session). By communicating via the communication path (communication session), the state of the intermediary device 20 is notified to the server device 10, and the image data to be displayed by the intermediary device 20 on the output device 50 is input to the server device 10. Notifications can be received from the server device 10. The fact that the image data is input to the server device 10 means that the image data is uploaded to the server device 10 from the teacher terminal 30 or the student terminal 40.

The browser management unit 22 activates the browser unit 23 in the kiosk mode. The kiosk mode is a mode in which the use of the intermediary device 20 is limited to the display of a Web page. The kiosk mode is just an example, and may be another mode as long as it can display a Web page.

The browser unit 23 is, for example, a general Web browser, and executes processing according to HTML data, a script, or the like.

The browser unit 23 accesses the initial access URL according to the activation. At this time, in the server device 10, the identification information of the browser unit 23 (hereinafter referred to as “browser ID”) is added as optional information to the initial access URL.

The browser unit 23 accesses the application associated with the browser ID among the applications possessed by the server device 10 in accordance with the redirect request corresponding to the access to the initial access URL. The browser unit 23 acquires data (HTML data, a script, etc.) indicating a processing execution request to the intermediary device 20 from this application.

The server device 10 includes a communication unit 11, an application determination unit 12, an input application group 13, an output application 14, a specific information allocation unit 15, and a storage control unit 16. Each of these parts is realized by a process of causing the CPU 104 to execute one or more programs installed in the server device 10.

Further, the server device 10 is provided with an application information storage unit 121, a device information storage unit 122, an account information storage unit 123, a registration information storage unit 124, a class information storage unit 125, an answer information storage unit 126, a blackboard information storage unit 127, and the like. It has an information storage unit 128, a passcode history storage unit 129, and a display history storage unit 130. Each of these storage units can be realized by using, for example, a storage device that can be connected to the auxiliary storage device 102 or the server device 10 via a network.

The communication unit 11 performs processing for establishing communication between the server device 10 and the intermediary device 20, and communication between the server device 10 and the teacher terminal 30 and the student terminal 40. In other words, the communication unit 11 is an example of a transmission unit that transmits information and a reception unit that receives information in the server device 10.

The application determination unit 12 corresponds to the initial access URL. In response to the access to the initial access URL, the application determination unit 12 determines an application corresponding to the option information (registration ID or browser ID) given to the initial access URL with reference to the registration information storage unit 124.

When the application determination unit 12 determines the application corresponding to the option information, the application determination unit 12 transmits a response including a redirect request including a URL to this application to the access source to the initial access URL.

The input application group 13 and the output application 14 are examples of applications included in the server device 10.

The input application group 13 is an application group for executing a process according to the purpose, and each application transmits HTML data, a script, and the like for executing the process according to the use to the teacher terminal 30.

The input application group 13 of the present embodiment is, for example, a teacher portal application that causes the teacher terminal 30 to execute a process of displaying a menu of a portal screen for a teacher, or an attendance display that causes the teacher terminal 30 to display the output status of a student. Includes apps.

Further, the input application group 13 includes a camera application (hereinafter referred to as a camera application). The camera application is an application that realizes a service of activating the camera function on the student terminal 40 and transmitting the captured image data to the server device 10 when the answer QR code or the blackboard QR code is read. Further, the input application group 13 includes a schedule application that causes the teacher terminal 30 to execute a process of displaying a subject input screen that accepts subject input.

The output application 14 includes an application for outputting the passcode generated by the specific information allocation unit 15. Specifically, the output application 14 may be, for example, HTML data and a script for causing the intermediary device 20 to draw the passcode. Further, the output application 14 may cause the output device 50 to execute a process of transmitting a passcode by wireless communication, or a process of transmitting a beacon signal is associated with the output device 50 or the output device 50. It may be executed by the transmitter.

Further, the output application 14 includes an application for causing the intermediary device 20 to acquire (download) and draw image data stored in the answer information storage unit 126 and the blackboard information storage unit 127. Specifically, the output application 14 transmits HTML data, a script, and the like for causing the intermediary device 20 to execute the acquisition and drawing to the intermediary device 20.

The specific information allocation unit 15 generates a passcode and causes the output device 50 to display the passcode via the intermediary device 20. The specific information allocation unit 15 of the present embodiment generates a passcode so that the passcodes displayed on the output device 50 are different from each other. The generation of the passcode by the specific information allocation unit 15 will be described later.

The storage control unit 16 stores the image data uploaded to the server device 10 by the input application group 13, the passcode output from the output device 50 via the intermediary device 20 by the output application 14, and the like in each storage unit. .. Details of the storage control unit 16 will be described later.

The application information storage unit 121 stores information (for example, URL, etc.) about each of the applications (in this embodiment, the input application group 13 and the output application 14) of the server device 10.

The account information storage unit 123 stores identification information and the like of users who can use the application in the server device 10.

The device information storage unit 122 stores information indicating the state of the intermediary device 20 for each intermediary device 20 arranged in the user environment E1.

The registration information storage unit 124 contains identification information of an application that executes image data input processing, identification information of an application that executes image data output processing, and an intermediary device that is an input destination of image data for each registration ID. The identification information and the like of the browser unit 23 of 20 are stored.

The lesson information storage unit 125 stores information about the lesson. Specifically, the lesson information storage unit 125 includes a lecture type, a lecture room, a lecture time, information for identifying a teacher, information for specifying image data captured during a lecture, and the like.

The answer information storage unit 126 and the blackboard information storage unit 127 are examples of image data storage units in which image data is stored.

The answer information storage unit 126 stores, for example, image data of the answer sheet captured by the student terminal 40. The blackboard information storage unit 127 stores image data of a blackboard or a whiteboard installed in a lecture room or the like.

In the answer information storage unit 126 and the blackboard information storage unit 127, the passcode assigned to the image data stored in each, the information for identifying the student who captured the image data, and the like are stored together with the image data.

The installation information storage unit 128 stores information indicating a browser ID displaying a passcode during the lecture.

The passcode history storage unit 129 stores information indicating the history of the passcode output via the output application 14. The display history storage unit 130 stores information indicating the history of image data displayed on the output device 50 by the browser unit 23 of the intermediary device 20.

Details of each of the above-mentioned storage units will be described later.

Hereinafter, the processing procedure executed in the information processing system 1 will be described. FIG. 7 is a sequence diagram for explaining an example of a processing procedure executed in response to activation of the intermediary device of the first embodiment. Specifically, FIG. 7 shows a processing procedure until the passcode is displayed on the output device 50.

When the power of the intermediary device 20 is turned on by a user such as a teacher (step S701), the communication control unit 21 sets a communication path for asynchronously receiving a request from the communication unit 11 of the server device 10. Establish with 11 (step S702). At this time, the communication control unit 21 notifies the communication unit 11 of the communication ID, which is the identification information of itself (communication control unit 21). The communication unit 11 updates the device information storage unit 122 based on the notified communication ID (hereinafter, referred to as “target communication ID”).

FIG. 8 is a diagram showing a configuration example of the device information storage unit. In FIG. 8, the device information storage unit 122 stores a communication ID, address information, state information, a browser ID and a browser state, a passcode, and the like in association with the tenant ID.

The tenant ID is identification information of a contractor (tenant) of a service contract provided by the server device 10. For example, the user environment E1 may correspond to one tenant.

The communication ID is identification information of the communication control unit 21 of each intermediary device 20 arranged in the tenant related to the tenant ID. When the intermediary device 20 includes only one communication control unit 21, the communication ID may be identification information for identifying the intermediary device 20.

The address information is the local IP address of the intermediary device 20. The state information is information indicating whether or not the communication control unit 21 related to the communication ID is connected to the server device 10 (a state in which a communication path is established) (“not connected”).

The browser ID is identification information of the browser unit 23 corresponding to the communication control unit 21 related to the communication ID. In the present embodiment, the browser ID is the identification information of the browser unit 23 included in the same intermediary device 20 as the communication control unit 21 related to the communication ID.

The browser state is information indicating the activation state of the browser unit 23 related to the browser ID. For example, if the target communication ID notified to the communication unit 11 is "Eg001-01", the state information corresponding to the communication ID in the device information storage unit 122 is set to "connecting" as shown in FIG. Be changed.

The passcode is generated by the specific information allocation unit 15 when the communication path with the intermediary device 20 is established, and is associated with the communication ID (intermediary device 20). As for the passcode, if there are a plurality of browser IDs associated with the communication ID, a passcode may be generated for each browser ID.

Subsequently, the communication control unit 21 searches for the browser management unit 22 using, for example, SNMP (Simple Network Management Protocol) or the like in order to acquire the browser ID (step S703), and the found browser management unit 22 is used. Acquires the browser ID, which is the identification information of the browser unit 23, which is the management target of the browser management unit 22 (step S704).

In the present embodiment, an example in which the communication control unit 21 and the browser management unit 22 are provided in the intermediary device 20 is shown, but the communication control unit 21 of the intermediary device 20 is a browser of another intermediary device 20. In order to make a plurality of browser management units 22 and browser units 23 available by communicating with the unit 32 via the same network, the browser management unit 22 is being searched for using SNMP or the like. .. Therefore, the search of the browser management unit 22 is not always indispensable, and the acquisition destination (browser management unit 22) from which the communication control unit 21 acquires the browser ID may be set in advance.

Subsequently, the communication control unit 21 notifies the browser of the browser unit 23 that the browser unit 23 (the browser unit 23 of the intermediary device 20 in this embodiment) corresponding to the acquired browser ID is available. An ID (hereinafter referred to as “target browser ID”) is specified and transmitted to the communication unit 11 (step S705).

Upon receiving this notification, the communication unit 11 updates the device information storage unit 122 (FIG. 8) based on the target browser ID specified in the notification. Specifically, in the device information storage unit 122, the value of the browser state corresponding to the target browser ID is updated from "power off" to "power on".

Subsequently, the communication control unit 21 specifies the target browser ID and the initial access URL, and requests the browser management unit 22 to start the browser unit 23 related to the target browser ID (step S706). As described above, the initial access URL refers to the URL that the browser unit 23 should first access, and is preset in the browser management unit 22.

The browser management unit 22 activates the browser unit 23 related to the target browser ID in the kiosk mode in response to the request from the communication control unit 21 (step S707). At this time, the browser management unit 22 inputs the initial access URL into the browser unit 23. The browser unit 23 transmits an HTTP request to the input initial access URL in response to the activation in the kiosk mode (step S708). The HTTP request includes the target browser ID.

When the application determination unit 12 of the server device 10 receives the HTTP request, the application determination unit 12 transmits a response including the redirect request (HTTP response) to the browser unit 23 (step S709).

The redirect request includes the URL of the application associated with the browser ID as the redirect destination. Further, the redirect request includes a communication URL and a target browser ID included in the HTTP request as notification information to the redirect destination. The communication URL is the URL of the communication control unit 21.

The application determination unit 12 refers to the registration information storage unit 124 and the application information storage unit 121 to specify the URL of the application associated with the target browser ID.

FIG. 9 is a diagram showing a configuration example of the registration information storage unit. In FIG. 9, the registration information storage unit 124 has a registration ID, an In application ID, an Out application ID, and a browser ID as information items, and the value of the item “registration ID” corresponds to the value of other items. It is attached and remembered.

The In application ID is an ID of an application that controls input of image data (hereinafter referred to as "application ID") in a service corresponding to a registration ID. The Out application ID is an application ID of an application that controls the output of image data in the service corresponding to the registration ID.

In the present embodiment, in the registration information storage unit 124, the application indicated by the In application ID associated with the registration ID is an application included in the input application group 13. Further, in the present embodiment, the application indicated by the Out application ID associated with the registration ID in the registration information storage unit 124 is the output application 14.

For example, the registration ID "Tag_Ed" is associated with the In-appli ID "AP_EdPortal", and the Out-appli ID is not associated with it. Therefore, it can be seen that the service corresponding to the registration ID "Tag_Ed" provides a service related to control of image data input. The In application ID "AP_EdPortal" indicates the application ID of the application included in the input application group 13 that executes the process of displaying the menu of the portal screen for the teacher.

Further, the registration ID "Tag_St" is associated with the In-appli ID "AP_Stcamera", and the Out-appli ID is not associated with it. Therefore, it can be seen that the service corresponding to the registration ID "Tag_St" provides a service related to control of image data input. That is, in the case of the student terminal 40 in which only the service corresponding to the registration ID "Tag_St" is provided, the server device 10 does not have the function of transmitting the processing execution request to the intermediary device 20. ..

The In application ID "AP_Stcamera" is an application of the application included in the input application group 13 that activates the camera of the student terminal 40 and executes a process of transmitting the image data captured by the camera to the storage destination. Indicates an ID.

Further, in FIG. 9, the registration ID “Tag_StPhotoCode” is associated with the In application ID “AP_StPhoto” and the Out application ID “AP_PhotoDoc”, and the browser ID is not associated with the registration ID “Tag_StPhotoCode”.

In the present embodiment, when the registration ID, the In app ID, and the Out app ID are associated with each other and the browser ID is not associated, the service is confirmed but the browser ID is determined. It shows the state that it is not. In such a case, the service and the browser ID are associated with each other based on the passcode.

In the following description, in the registration information storage unit 124, information including the value of the item "registration ID" and the value of other items is referred to as tag information.

Further, FIG. 10 is a diagram showing a configuration example of the application information storage unit. In FIG. 10, the application information storage unit 121 stores an application ID, an application type, a URL, a corresponding browser, and the like for each application included in the server device 10.

The application type indicates the type of the application related to the application ID based on the relationship with the image data. “In” indicates that the application controls the input of image data (corresponding to the above-mentioned In application ID). "Out" indicates that the application controls the output of image data (corresponding to the above-mentioned Out application ID). The URL is the URL of the application related to the application ID.

The compatible browser indicates the type of browser that operates the application related to the application ID. In the example of FIG. 10, the types of browsers are a browser for a terminal showing the browser unit of the teacher terminal 30 and the student terminal 40, and a browser for the device showing the browser unit 23 of the output device 50.

The application determination unit 12 refers to the registration information storage unit 124 to specify the Out application ID associated with the target browser ID, and refers to the application information storage unit 121 to be associated with the Out application ID. Identify the URL you are using. Here, it is assumed that the target browser ID is "BROWSER1". In this case, the URL of the application (output application 14) whose application ID is "AP_PhotoDoc" (hereinafter, "output application URL") is specified.

Further, the application determination unit 12 automatically generates the communication URL of the communication control unit 21 related to the target communication ID based on the address information associated with the target browser ID in the device information storage unit 122 (FIG. 8).

Subsequently, the browser unit 23 transmits (redirects) the HTTP request to the output application URL (that is, the output application 14) which is the redirect destination in accordance with the redirect request (S710). The HTTP request includes the communication URL and browser ID included in the redirect request.

In response to the HTTP request, the output application 14 provides the browser unit 23 with a script for causing the browser unit 23 to execute a connection to the communication URL included in the HTTP request and a user interface for displaying the passcode. A response including display data for drawing is transmitted to the browser unit 23 (S711). The script and the display data are examples of data indicating a processing execution request to the intermediary device 20. For example, the script may be a program of another format, and the display data may be data of another format.

Upon receiving the response, the browser unit 23 executes the script included in the response to establish a communication path with the communication control unit 21 identified by the communication URL (S712). The communication path is a communication path for the communication control unit 21 to transmit the notification received from the server device 10 to the browser unit 23. Websocket may be used for the communication path.

Subsequently, the browser unit 23 draws a screen based on the display data included in the response (hereinafter, referred to as “display screen”) in a predetermined area (for example, a video memory) of the memory device 103 (S713). .. For example, the display screen is a screen on which the passcode generated by the server device 10 is displayed. The drawing content (display screen) by the browser unit 23 is output to the output device 50 via an interface such as HDMI (registered trademark), and is output (displayed) by the output device 50.

Next, the server device 10 generates and assigns a passcode that does not overlap for a certain period to the browser ID group associated with the tenant ID by the specific information allocation unit 15, and assigns the passcode to the intermediary device 20 at regular intervals. A passcode notification in which the browser ID and the passcode are associated with each other is delivered to the communication control unit 21 of the above (S714). At this time, the specific information allocation unit 15 stores the generated passcode in the device information storage unit 122 (FIG. 8) in association with the browser ID.

The fixed period of the present embodiment is, for example, about several days, and the fixed interval is about several minutes (for example, 15 minutes).

When the communication control unit 21 receives the passcode notification, the communication control unit 21 notifies the browser unit 23 specified by the browser ID corresponding to the passcode of the passcode (S715). The browser unit 23 displays the passcode on a part of the display screen of the output device 50 (S716).

In the example of FIG. 8, two browser IDs are associated with the communication ID "Eg001-01". In this case, the passcode corresponding to the browser ID "BROWSER1" whose activation state is "power ON" is displayed on the output device 50 by the intermediary device 20.

Hereinafter, the generation and allocation of the passcode by the specific information allocation unit 15 of the present embodiment will be described with reference to FIG. 11. FIG. 11 is a diagram illustrating the generation and allocation of passcodes.

The passcode of this embodiment is, for example, a four-digit number. The specific information allocation unit 15 of the present embodiment generates and assigns a passcode for each browser ID (intermediary device 20) associated with the tenant ID. Specifically, the specific information allocation unit 15 generates a random 4-digit number and assigns it to the intermediary device 20 as a passcode.

Further, in the specific information allocation unit 15, for example, when there are a plurality of intermediary devices 20 (intermediary devices 20 in the user environment E1) associated with the tenant ID, the passcodes assigned to each intermediary device 20 are duplicated. Try not to. Further, the specific information allocation unit 15 periodically changes the passcode assigned to each intermediary device 20.

In the example of FIG. 11, a case where three intermediary devices 20 of the intermediary devices 20-1, 20-2, and 20-3 exist in one tenant ID is shown.

In this case, the specific information allocation unit 15 assigns passcodes "1234", "2293", and "8341" to each of the intermediary devices 20 for 15 minutes from 10:00, for example. Further, the specific information allocation unit 15 assigns passcodes "3256", "5671", and "4252" to each of the intermediary devices 20 for 15 minutes from 10:15.

As described above, in the present embodiment, a different passcode is assigned to each intermediary device 20, and further, the passcode assigned to the intermediary device 20 is periodically changed. Therefore, according to the present embodiment, it is possible to specify the time zone and place where the image data is captured based on the passcode given to the image data transmitted from the student terminal 40.

FIG. 12 is a diagram showing an example of displaying a passcode in an output device. On the screen of the output device 50, the passcode 51 notified from the server device 10 is displayed.

Next, with reference to FIG. 13, a processing procedure for uploading image data from the student terminal 40 to the server device 10 will be described. FIG. 13 is a sequence diagram for explaining an example of a processing procedure for uploading image data from the student terminal of the first embodiment to the server device.

In the student terminal 40 of the present embodiment, the control unit 41 detects that the student terminal 40 is pointed at the answer QR code by the student who is the user (step S1301).

Subsequently, the student terminal 40 reads the answer QR code (step S1302), and acquires the registration ID embedded in the answer QR code and the initial access URL (step S1303).

When the student terminal 40 reads the answer QR code, it activates the browser unit 42 and connects to the initial access URL embedded in the QR code (step S1304).

The browser unit 42 automatically transmits an HTTP request to the application determination unit 12 corresponding to the initial access URL embedded in the answer QR code according to the activation (step S1305). The HTTP request includes account information as optional information in addition to the registration ID obtained from the answer QR code.

As described above, in the present embodiment, the registration ID, which is the identification information for identifying the service provided by the server device 10, and the initial access URL corresponding to the application determination unit 12 are embedded in the answer QR code. That is, it can be said that the answer QR code of the present embodiment contains information that identifies the server device 10 that is the storage destination in which the image data captured by the student terminal 40 is stored.

The account information is information including a student user ID and a tenant ID of the user environment E1, or information that can identify the user ID and the tenant ID. For example, Cookie or the like may be used as account information.

When the student terminal 40 is already logged in, the application determination unit 12 of the server device 10 transmits the HTTP request (redirect) to the browser unit 42 when the HTTP request is received (step S1306). This HTTP request includes a camera URL (ie, camera app 13-1). The camera application 13-1 is one of the applications included in the input application group 13.

Upon receiving the HTTP request (redirection), the browser unit 42 proceeds to step S1314, which will be described later.

Further, when the student terminal 40 is not already logged in, when the application determination unit 12 receives the HTTP request, the application determination unit 12 makes an HTTP request (that is, the login application 13-2) including the login URL (that is, the login application 13-2) to the browser unit 42. Redirect) is transmitted (step S1307).

Upon receiving the HTTP request, the browser unit 42 requests the login application 13-2 to display the login screen (step S1308). The login application 13-2 receives the display request and transmits display data for displaying the login screen to the browser unit 42 (step S1309).

The browser unit 42 displays the login screen based on the display data (step S1310).

When the browser unit 42 accepts the input of the account information on the login screen (step S1311), the browser unit 42 transmits a login request in which the input account information is associated with the registration ID read from the answer QR code to the server device 10 (step). S1312).

The server device 10 refers to the account information storage unit 123 by the application determination unit 12, performs a login process, and makes an HTTP request (redirect) to the URL associated with the registration ID (step S1313). Here, the URL associated with the registration ID is the camera URL (that is, the camera application 13-1).

Here, the account information storage unit 123 will be described with reference to FIG. FIG. 14 is a diagram showing a configuration example of the account information storage unit of the first embodiment.

The account information storage unit 123 of the present embodiment has a tenant ID, a user ID, and a password as information items.

In the present embodiment, a common user ID is given to the students, and a user ID is given to each teacher for the teachers. The password is a password determined according to each user ID.

Returning to FIG. 13, the browser unit 42 receives the HTTP request including the camera URL and connects to the camera application 13-1 (step S1314).

The camera application 13-1 includes a script for executing a process of transmitting the display data of the input screen for inputting the lesson number, the lesson number input to the input screen, and the captured image data to the server device 10. A response including the above is transmitted to the browser unit 42 (step S1315).

That is, the server device 10 activates the image pickup function of the student terminal 40 by the camera application 13-1 associated with the registration ID received from the student terminal 40, and uploads the image data captured by the image pickup function. The execution request is transmitted to the student terminal 40. In other words, the browser unit 42 acquires an answer reading application (a script for executing a process of transmitting the input lesson number and the captured image data to the server device 10) from the camera application 13-1. The browser unit 42 activates the answer reading application and displays the input screen of the student number, the lesson number, and the passcode (step S1316).

When the browser unit 42 accepts the input of the student number, the lesson number, and the passcode on the input screen (step S1317), the browser unit 42 holds the student number, the lesson number, and the passcode (step S1318).

Subsequently, the browser unit 42 accepts an operation on the start button for capturing an image of the answer sheet (step S1319), and displays the operation screen of the camera of the student terminal 40 (step S1320).

Further, when the browser unit 42 accepts the operation of the image pickup button (step S1321), the browser unit 42 instructs the control unit 41 to image the image data (step S1322). The control unit 41 passes the image data captured by the camera to the browser unit 42 (step S1323).

The browser unit 42 assigns the registration ID, the student number, the lesson number, and the passcode to the image data, and transmits the image data to the communication unit 11 of the server device 10 (step S1324).

The image data received by the communication unit 11 is stored in the answer information storage unit 126 or the like by the storage control unit 16.

Here, a display example of the student terminal 40 will be described with reference to FIG. FIG. 15 is a diagram showing a display example in the student terminal of the first embodiment. FIG. 15A shows an example of the login screen displayed in step S1310 of FIG. FIG. 15B shows an example of the input screen displayed in step S1316 of FIG. FIG. 15C is a diagram showing an example of a camera operation screen displayed in step S1320 of FIG.

The screen 151 of FIG. 15A has input fields 151a and 151b in which a user ID and a password are input, respectively.

In the present embodiment, the user ID and password input in the student terminal 40 are common to each tenant ID, but the user ID and password are not limited to this. The user ID and password may be set for each individual by the student who is the user of the student terminal 40. In that case, the user ID and password for each student may be stored in the account information storage unit 123 as account information.

The screen 152 shown in FIG. 15B has input fields 152a, 152b, and 152c in which the student number, the lesson number, and the passcode are input, respectively. The student number is, for example, a number given to each individual student. The student number may be determined for each lecture that the student receives, for example. In this case, for example, the student number may be assigned according to the order of entering the lecture room where the lecture is given.

In this embodiment, when the user ID is given to each individual student, the user ID and the student number are associated with each other, so that it is not necessary to input the student number on the screen 152. Therefore, in that case, the input field 152a becomes unnecessary.

The lesson number is the name of the lecture that the student takes. When the lesson number is embedded in the answer QR code 52, the input field 152b is not displayed on the screen 152. The passcode is input by the student by visually observing the passcode displayed on the output device 50.

It should be noted that the lesson number and the passcode may be required to be input only when the image of the answer sheet is captured, and may not be required to be input when the image of the whiteboard WB is captured.

When the start button 152d is operated on the screen 152, the browser unit 42 of the student terminal 40 shifts the display to the image pickup screen. That is, the start button 152d is an operation button for transitioning the display of the student terminal 40 to the image pickup screen.

The screen 153 shown in FIG. 15C is an example of an imaging screen in which the camera is activated and the image 153a of the completed answer sheet P is displayed. When the operation button 153b is operated on the screen 153, the image data in which the image of the answer sheet P is captured is transmitted to the storage destination indicated by the answer QR code.

Next, the processing of the storage control unit 16 of the server device 10 will be described. The usage scene of the information processing system 1 when explaining the storage of data by the storage control unit 16 will be described below. FIG. 16 is a diagram illustrating a usage scene of the information processing system of the first embodiment.

The user environment E1-1 indicates an educational site in which the information processing system 1 is introduced. In the lecture room A001, which is the user environment E1-1, an output device 50, whiteboards WB1 and WB2 are installed, and a lecture with the lecture name "Mathematics A_01" is given by a teacher who is a user of the teacher terminal 30. There is.

The user ID of the teacher in this lecture is "tanaka @". Further, in the example of FIG. 16, a user ID is given to each individual student, and the lecture with the lecture name “Mathematics A_01” includes a student with a user ID “tokiwa @” who is a user of the student terminal 40-1. A student with a user ID "saito @" who is a user of the student terminal 40-2 and a student with a user ID "ando @" who is a user of the student terminal 40-3 are present. In addition, other students also participate in the lecture with the lecture name "Mathematics A_01".

Further, in the example of FIG. 16, a passcode display request is made from the teacher terminal 30 to the server device 10, and the passcode 51 is displayed on the output device 50 via the intermediary device 20.

In the following explanation, in the lecture with the lecture name "Mathematics A_01", for example, at the beginning of the lecture, an answer sheet is distributed to the students in the lecture room, and the students give a presentation using the whiteboards WB1 and WB2 and a test. Will be explained as if it was done.

Answer QR in which the registration ID associated with the camera application 13-1 included in the input application group 13 and the URL corresponding to the application determination unit 12 are embedded in each of the answer sheet and the whiteboards WB1 and WB2. The code 52 and the blackboard QR code 53 are attached in advance.

The answer QR code 52 contains information indicating that the QR code corresponds to the answer sheet, and the blackboard QR code 53 contains information indicating that the QR code corresponds to the whiteboard WB. It may be embedded.

For example, the blackboard QR code 53 may have a registration ID that identifies an application that performs a process of associating and storing image data with a teacher's user ID, regardless of which terminal captures the image of the whiteboard WB. good.

In the example of FIG. 16, the teacher requests the submission of image data of the whiteboards WB1 and WB2 in which the content of the presentation is described, and submits the image data of the completed answer sheet to the students who distributed the answer sheet. It is assumed that the teacher requests that each image data be submitted within the lecture time.

The student who is the user of the student terminal 40-1 and the student who is the user of the student terminal 40-2 who are attending the lecture use the student terminals 40-1 and 40-2 as the answer sheets P1 and P2, respectively. Hold it over the QR code 52.

When the student terminals 40-1 and 40-2 read the answer QR code 52, they activate the camera function according to the processing procedure described with reference to FIG. Then, when the student terminals 40-1 and 40-2 receive the image pickup operation after receiving the account information of each student and the input of the passcode 51, the student terminals 40-1 and 40-2 capture the images of the answer sheets P-1 and P-2. Then, the captured image data is transmitted to the server device 10.

Further, a student who gives a presentation or the like using the whiteboards WB1 and WB2 holds his / her student terminal 40 over the blackboard QR code 53 of the whiteboards WB1 and WB2. When the student terminal 40 reads the blackboard QR code 53, the student terminal 40 activates the camera function according to the processing procedure described with reference to FIG. When the image pickup operation is accepted, the images of the whiteboards WB1 and WB2 are captured, and the captured image data is transmitted to the server device 10.

In this embodiment, the passcode does not have to be input when uploading the image data obtained by capturing the image of the whiteboard WB.

In addition, the student who is the user of the student terminal 40-3 who received the answer sheet leaves the lecture room A001 after receiving the answer sheet, fills in the answer of the answer sheet at another place, and then the student enters the QR code 52. It is assumed that the terminal 40-3 is held over.

In this case, since the student cannot visually recognize the passcode displayed on the output device 50, it is assumed that the image data of the answer sheet P3 that has not been input and has been entered is transmitted to the server device 10.

Hereinafter, storage of image data by the storage control unit 16 of the server device 10 will be described with reference to FIGS. 17 to 20.

FIG. 17 is a diagram showing an example of the lesson information storage unit of the first embodiment. The lesson information storage unit 125 of the present embodiment has a tenant ID, a lesson number, a lecture room number, a start time, a lesson time, a teacher, and a content ID as information items.

The lesson number is information that uniquely identifies the lecture, and may be the lecture name. The lecture room number is information that identifies the lecture room used for the lecture, and may be the name of the lecture room. The start time indicates the start time of the lecture specified by the lecture number, and the lesson time indicates the lesson time of the lecture specified by the lecture number. The teacher is a user ID of the teacher who gives the lecture specified by the lesson number, and the content ID indicates the type of image data associated with the lecture specified by the lesson number.

Among the information items included in the lesson information storage unit 125, the values of the items other than the item "content ID" are stored based on a predetermined timetable or the like. The item "content ID" value is stored according to the type of image data received from the student terminal 40 by the storage control unit 16 of the server device 10.

In the following description, the information stored in the lesson information storage unit 125 may be referred to as lesson information.

In FIG. 17, it can be seen that the lecture with the lecture name “Mathematics A_01” is given by the teacher with the user ID “tanaka @” for 60 minutes from 10:00 on October 25 in the lecture room “A001”.

Further, in the example of FIG. 17, the lecture name “Mathematics A_01” is associated with the content IDs “Answer_Mathematics A01”, “WB_Mathematics A01”, and “Display_Mathematics A01”. That is, it can be seen that the lecture name "Mathematics A_01" is associated with three types of image data.

The content ID "answer_math A01" indicates that the type of image data is the image data of the answer sheet. The content ID "WB_Mathematics A01" indicates that the type of image data is whiteboard image data. The content ID "display_math A01" is information associated with the browser ID whose passcode is displayed during the lecture of the lecture name "math A_01".

When the storage control unit 16 of the present embodiment receives the image data of the answer sheet and the lesson number from the student terminal 40, the storage control unit 16 sets the value of the item "content ID" corresponding to the lesson number of the lesson information storage unit 125 to the value. Stores "answer_math A01". Then, the storage control unit 16 stores the image data received by the answer information storage unit 126 in association with the value of the content ID, "answer_math A01".

Further, when the storage control unit 16 receives the image data of the whiteboard WB from the student terminal 40, the storage control unit 16 stores "WB_math A01" in the value of the item "content ID" of the lesson information storage unit 125. The received image data is stored in the blackboard information storage unit 127.

Further, when the storage control unit 16 of the present embodiment displays the passcode on the output device 50 via the intermediary device 20 during the lecture, the value of the item "content ID" of the lesson information storage unit 125 is set to the value. The "display_math A01" is stored, and the browser ID of the intermediary device 20 is stored in the installation information storage unit 128.

FIG. 18 is a diagram showing an example of the answer information storage unit of the first embodiment. The answer information storage unit 126 of the present embodiment includes the content D, the user ID, the student number, the file ID, the upload time, and the passcode as information items. In the following description, the information stored in the answer information storage unit 126 may be referred to as answer information.

The answer information storage unit 126 stores image data of the answer sheet captured by the student terminal 40. The user ID in the answer information storage unit 126 indicates the account information given to the image data, and the file ID indicates the identification information that identifies the image data. Further, in the answer information storage unit 126, the upload time indicates the time when the image data was uploaded, and the passcode indicates the passcode given to the image data.

In the example of FIG. 18, the image data of the answer sheet whose content ID is "answer_math A01" is stored. Specifically, in the example of FIG. 18, the data was uploaded from the student terminals 40 of the student with the user ID "tokiwa @", the student with the user ID "saito @", and the student with the user ID "ando @". The image data of the answer sheet is stored.

Here, it can be seen that the answer information including the user ID "ando @" has a passcode of "0000" and the passcode was not input when the image data was transmitted.

FIG. 19 is a diagram showing an example of a blackboard information storage unit according to the first embodiment. The blackboard information storage unit 127 has a content ID, a user ID, a file ID, and a date as information items. In the following description, the information stored in the blackboard information storage unit 127 may be referred to as blackboard information.

In the blackboard information storage unit 127, the file ID is the identification information for specifying the image data of the whiteboard WB, and the date indicates the date and time when the image data was captured.

In the example of FIG. 19, the image data of the whiteboard WB whose content ID is "WB_Math A01" is stored.

FIG. 20 is a diagram showing an example of the installation information storage unit of the first embodiment. In the installation information storage unit 128, the content ID and the browser ID are associated with each other as information items.

In the example of FIG. 20, the content ID “display_math A01” is associated with the browser ID “BROWSER1”. Therefore, from FIG. 20, it can be seen that in the lecture with the lecture name “Mathematics A01”, the passcode was displayed by the intermediary device 20 having the browser indicated by “BROWSER1”.

As described above, the storage control unit 16 of the present embodiment can store the image data uploaded from the student terminal 40 for each type of the image pickup target based on the information stored in advance in the lesson information storage unit 125. can.

Further, the storage control unit 16 of the present embodiment stores information indicating the history of the passcode displayed on the output device 50 by the intermediary device 20 in the passcode history storage unit 129. FIG. 21 is a diagram showing an example of the passcode history storage unit of the first embodiment.

The passcode history storage unit 129 of the present embodiment has a date and time, a browser ID, and a passcode as information items. In the example of FIG. 21, it can be seen that the passcode displayed in the browser ID "BROWSER1" changes at 15-minute intervals.

Further, the storage control unit 16 of the present embodiment stores information indicating the history of image data displayed via the intermediary device 20 in the display history storage unit 130. FIG. 22 is a diagram showing an example of the display history storage unit of the first embodiment.

The display history storage unit 130 of the present embodiment has a date and time, a browser ID, a user ID, and a file ID as information items. The date and time indicate the date and time when the image data specified by the file ID is displayed on the output device 50 via the intermediary device 20 specified by the browser ID. The user ID indicates a user ID associated with the user terminal that has requested the intermediary device 20 to display image data.

As described above, the storage control unit 16 of the present embodiment stores the passcode and the image data in association with the browser unit 23 of the intermediary device 20 displaying the passcode and the image data.

Next, the operation of the teacher terminal 30 in the information processing system 1 will be described. The server device 10 of the present embodiment refers to the information stored in each of the above-mentioned storage units, and causes the teacher terminal 30 to display information indicating information on attendance of students in each lecture.

FIG. 23 is a diagram showing an example of a processing procedure for displaying a list of attendance on the teacher terminal of the first embodiment.

In the teacher terminal 30 of the present embodiment, the control unit 31 detects that the teacher presses the URL shortcut icon displayed on the teacher terminal 30 (step S2301).

The URL shortcut icon displayed on the teacher terminal 30 has an initial access URL for connecting to the server device 10 and a registration ID "Tag_Ed" indicating a service provided to the teacher terminal 30. In other words, tag information including the initial access URL and the registration ID is embedded in the URL shortcut icon. The registration ID "Tag_Ed" is associated with the application ID "AP_EdPortal" in the registration information storage unit 124.

When the teacher terminal 30 detects that the URL shortcut icon is pressed, it activates the browser unit 32 and connects to the initial access URL destination embedded in the URL shortcut icon (step S2302).

The browser unit 32 automatically transmits an HTTP request to the application determination unit 12 corresponding to the initial access URL embedded in the URL shortcut icon in response to activation (step S2303). The HTTP request includes account information including a teacher's user ID and a tenant ID of the user environment E1 in addition to the registration ID.

Upon receiving the HTTP request, the application determination unit 12 of the server device 10 authenticates the account information included in the HTTP request. If the authentication is successful, step S2304 and subsequent steps are executed. Authentication is performed, for example, by whether or not the account information included in the HTTP request is registered in the account information storage unit 123.

If the authentication is successful, the application determination unit 12 transmits a response (HTTP response) including a redirect request to the browser unit 32 (step S2304).

Subsequently, the browser unit 32 transmits an HTTP request (redirect) to the teacher portal URL (that is, the teacher portal application 13-3) which is the redirect destination in accordance with the redirect request (step S2305).

In response to the HTTP request, the teacher portal application 13-3 transmits the display data of the input screen for inputting the lesson number to the browser unit 32 of the teacher terminal 30 and the lesson number input in the input screen to the server device 10. A response including a script for executing the process is transmitted to the browser unit 32 (step S2306).

When the browser unit 32 receives this response, it generates an input screen for the lesson number based on the display data, displays the input screen on the output device 311, and when the input of the lesson number is accepted, the lesson number is displayed as an attendance display application. Notify 13-4 (step S2307).

The attendance display application 13-4 transmits display data to the browser unit 32 to draw a screen indicating the attendance status of the students in the class indicated by the lesson number on the browser unit 32 (step S2308). Based on this display data, the browser unit 32 displays an attendance screen showing the attendance status (step S2309).

Hereinafter, a display example in the teacher terminal 30 of the present embodiment will be described with reference to FIG. 24. FIG. 24 is a diagram showing a display example of the teacher terminal of the first embodiment.

The screen 241 shown in FIG. 24 is an attendance screen displayed on the teacher terminal 30 in step S2309 of FIG. 23.

On the screen 241 the information 242 about the lecture specified by the lesson number and the information 243 indicating the attendance status of the student in the lecture specified by the lesson number are displayed.

The information 243 indicating the attendance status includes a user ID, a student number, an answer submission, lecture attendance, attendance, and a supplementary column as information items.

The value of the item "submit answer" indicates whether or not the image data obtained by capturing the answer sheet is submitted. Specifically, the value of the item "submit answer" indicates whether or not the image data corresponding to the lecture name shown in the information 242 and corresponding to the user ID is stored in the answer information storage unit 126. ..

The value of the item "Lecture attendance" indicates whether or not the lecture was taken. Specifically, the value of the item "lecture attendance" corresponds to the lecture name in the answer information storage unit 126, and the upload time of the image data corresponding to the user ID is the time when the passcode is displayed. Indicates whether or not they match.

The value of the item "Attendance" indicates whether or not the student corresponding to the user ID attended the lecture and submitted the answer sheet. The value of the item "supplementary column" indicates supplementary information regarding the determination of attendance.

In the present embodiment, in the server device 10, the lesson information storage unit 125 shown in FIG. 17, the answer information storage unit 126 shown in FIG. 18, and the passcode history storage unit 129 shown in FIG. 21 are combined with the teacher application 13-3. To refer to.

The teacher application 13-3 extracts the answer information including the lesson number and the corresponding user ID in the answer information storage unit 126, and the upload time and the passcode included in each answer information are within the lesson time and , It is determined whether or not the passcode matches the passcode displayed on the output device 50 at the upload time. Then, the teacher application 13-3 reflects the result in the values of the items "lecture attendance", "attendance", and "supplementary column" of the information 243 indicating the attendance situation.

In the example of FIG. 24, since the passcode of the answer information including the user ID "ando @" does not match the passcode displayed at the upload time, the item "lecture attendance" corresponding to the user ID "ando @" The value is "x".

As described above, according to the present embodiment, it is possible to determine whether or not the passcode is uploaded to the image data from a position where the passcode displayed on the output device 50 can be visually recognized.

Further, in the present embodiment, the passcode is dynamically changed. Further, in the present embodiment, it has a passcode history storage unit 129 in which information indicating the display history of the passcode is stored. Therefore, in the present embodiment, it can be used to determine the time zone in which the image data is uploaded based on the passcode.

That is, the passcode of the present embodiment can be used as information for specifying the position where the image data is uploaded and the time zone when the image data is uploaded. In other words, the passcode can be used as information for determining whether or not the image data upload was performed in the lecture room during the lecture time.

In the present embodiment, the passcode is a 4-digit number displayed on the output device 50 via the intermediary device 20, but is not limited to this.

In this embodiment, instead of the passcode, a password or the like notified orally by the subject to be lectured may be used. Further, in the present embodiment, the QR code may be displayed on the output device 50 instead of the passcode. In this case, the student has entered the passcode by reading the QR code with the student terminal 40.

Further, in this case, the QR code displayed on the output device 50 may be used as the answer QR code to be attached to the answer sheet. In that case, the same information as the answer QR code pasted on the answer sheet may be embedded in the QR code displayed on the output device 50.

Further, in the present embodiment, the passcode is displayed on the output device 50 and input to the student terminal 40, but the method of acquiring the passcode by the student terminal 40 is not limited to this. The passcode may be transmitted by wireless communication or the like from, for example, a device associated with the server device 10. Specifically, for example, the passcode may be transmitted as a beacon signal.

In this case, the student terminal 40 does not display the passcode input field as shown in the screen 152 shown in FIG. 15 (B). Further, in this case, even if the student terminal 40 obtains the passcode by receiving the transmitted passcode, for example, when the start button 152d for transitioning to the shooting screen of the answer sheet is operated. good.

Further, in the present embodiment, the information included in the answer QR code pasted on the answer sheet is used as the registration ID and the initial access URL, and the account information, the student number, and the lesson number are input by the student to the student terminal 40. However, it is not limited to this.

In the answer QR code of this embodiment, for example, when common account information is given to all the students, the registration ID, the initial access URL, and the account information may be embedded.

Further, in addition to the recording ID, the initial access URL, and the account information, the lesson number may be embedded in the answer QR code of the present embodiment.

In this way, as the amount of information embedded in the answer QR code is increased, the amount of information that the student inputs to the student terminal 40 is reduced, and the time and effort for inputting the student's information is reduced.

In this embodiment, the user environment is described as an educational site, but the present embodiment is not limited to this. The user environment may be, for example, a conference room of a company, and may be an environment in which it is required to add information indicating that the image data captured by the user terminal is captured under a specific condition. Any environment may be used. Here, a specific condition is a condition that the user terminal is in a position where a passcode that changes with the passage of time can be acquired, and information indicating a specific condition is a passcode (specific). Information).

(Second embodiment)
The second embodiment will be described below with reference to the drawings. The second embodiment is different from the first embodiment in that the passcode is not input when uploading the image data. Therefore, in the second embodiment below, the differences from the first embodiment will be described, and those having the same functional configuration as the first embodiment are used in the description of the first embodiment. A code is added and the description thereof will be omitted.

FIG. 25 is a diagram for explaining the outline of the second embodiment. In the present embodiment, when uploading the image data of the completed answer sheet P from the student terminal 40, the input of the passcode is not required.

In the present embodiment, when the student terminal 40 reads the answer QR code 52 attached to the answer sheet P, the student terminal 40 displays the screen 154, which is an input screen, by the same procedure as the processing procedure shown in FIG. Let me. The screen 154 corresponds to the input screen displayed in step S1316 of FIG.

In this embodiment, since the input of the passcode is not required, the student number input field 154a and the lesson number input field 154b are displayed on the screen 154.

When the student number and the lesson number are input on the screen 154, the student terminal 40 uploads the image data to the server device 10A by the same procedure as the processing procedure after step S1317 in FIG.

In this embodiment, since the passcode is not input, the student number and the lesson number are assigned to the image data, and the server device 10A is uploaded.

The server device 10A has, for example, an image data storage unit 125A for storing image data. In the image data storage unit 125A of the present embodiment, a folder F1 is provided for each lesson number, and a folder F1 for each date and time when the lecture indicated by the lesson number is given is provided under the folder F1. A folder F3 for each student number is provided under the folder F2. The folders F1, F2, and F3 are storage areas provided in the image data storage unit 125A.

When the image data to which the lesson number and the student number are assigned is uploaded from the student terminal 40, the server device 10A of the present embodiment refers to the lesson number and the student number by the storage control unit 16.

Then, in the image data storage unit 125A, the storage control unit 16 is under the subordinate of the folder F1 corresponding to the lesson number assigned to the image data, and in the folder F2 having the date and time when the image data was uploaded and the date corresponding to the image data. Image data is stored in the folder F3 corresponding to the student number.

In other words, the storage control unit 16 stores the image data in the lesson information storage unit 125A for each group classified by the lesson number, the date, and the student number.

The date and time when the image data was uploaded is the date and time when the server device 10A received the image data.

Therefore, in the present embodiment, the student simply holds his / her student terminal 40 over the answer QR code 52, inputs the student number and the lesson number on the displayed input screen 154, and captures the image of the answer sheet P. The image data of the paper P is stored in the folder F3 of the corresponding student number.

Therefore, according to the present embodiment, the captured image data can be uploaded to a specific storage destination by a simple procedure without making preset settings for the student terminal 40.

In this embodiment, the folders F2 and the folder F3 are provided under the folder F1 provided for each lesson number, but the present invention is not limited to this. In the image data storage unit 125A, only the folder F1 and the folder F2 may be provided.

In the present embodiment, the lesson number and the date are group identification information for grouping the image data. In the present embodiment, by adding group identification information to the image data and uploading it to the server device 10A, the uploaded image data can be stored in a folder for each group.

Therefore, according to the present embodiment, for example, when the teacher obtains desired image data from the image data stored in the image data storage unit 125A, the teacher may open the folder in which the corresponding image data is stored. , The desired image data can be easily selected.

Further, according to the present embodiment, when the image data is uploaded, it is automatically stored in a designated folder. Therefore, according to the present embodiment, it is not necessary to organize the image data by dividing the image data stored in the image data storage unit 125A into folders after uploading the image data.

In the present embodiment, the lesson number and the student number are input to the student terminal 40 by the student, but the present invention is not limited to this.

In the present embodiment, for example, the answer sheet P is provided with a student number entry field 54 and a lesson number entry field 55. The student terminal 40 may use the OCR (Optical Character Recognition) function or the like to convert the handwritten characters entered in the entry fields 54 and 55 from the image data of the answer sheet P into text data and add the handwritten characters to the image data.

Further, in the present embodiment, the student number and the lesson number may be input from the input screen 154 and may be read from the entry fields 54 and 55. Then, when the input student number and class number and the student number and class number read from the entry fields 54 and 55 match, the student number and class number may be added to the image data.

Further, in the present embodiment, when the common account information is given to the students, the account information and the lesson number may be embedded in the answer QR code 52. In this case, the student only has to enter the student number, which can reduce the time and effort of the student.

In this embodiment, the form in which the user environment is used as the educational site has been described, but the user environment is not limited to the educational site. The user environment may be, for example, a conference room of a company.

Further, in the present embodiment, the answer QR code 52 is attached to the answer sheet P, which is the object to be imaged, but the present invention is not limited to this. The QR code corresponding to the answer QR code 52 does not have to be attached to the image pickup object, and may be associated with the image pickup object.

Specifically, for example, before imaging a certain object to be imaged, a QR code prepared in advance in which a registration ID and an initial access URL are embedded is read by the user terminal, and after the camera function is activated in the user terminal, a predetermined value is specified. The image pickup object whose image is captured within the time may be used as the image pickup object associated with the QR code.

The server device 10, the intermediary device 20, the output devices such as the output device 50, and the user terminals 30 and 40 in the above embodiment may be constructed by a single computer, or each part (function or means) may be constructed. It may be divided and built by a plurality of arbitrarily assigned computers.

It should be noted that each function of the embodiment described above can be realized by one or a plurality of processing circuits. Here, the "processing circuit" as used herein is a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, or a processor designed to execute each function described above. It shall include devices such as ASIC (Application Specific Integrated Circuit), DSP (digital signal processor), FPGA (field programmable gate array) and conventional circuit modules.

Although the present invention has been described above based on each embodiment, the present invention is not limited to the requirements shown in the above embodiments. With respect to these points, the gist of the present invention can be changed to the extent that the gist of the present invention is not impaired, and can be appropriately determined according to the application form thereof.

1 Information processing system 10 Server device 11 Communication unit 12 App judgment unit 13 Input application group 14 Output application 15 Specific information allocation unit 16 Storage control unit 20 Mediation device 21 Communication control unit 22 Browser management unit 23 Browser unit 30 Teacher terminal (user terminal) )
31, 41 Control unit 32, 42 Browser unit 40 Student terminal (user terminal)
50 Output device 121 App information storage unit 122 Device information storage unit 123 Account information storage unit 124 Registration information storage unit 125 Class information storage unit 126 Answer information storage unit 127 Blackboard information storage unit 128 Installation information storage unit 129 Passcode history storage unit 130 Display history storage

Japanese Patent No. 6098193

Claims (11)

An information processing system that includes an information processing device that can communicate with equipment.
A receiver that receives identification information that identifies the service from the device,
A transmission unit that activates the image pickup function of the device and uploads the captured image data, and transmits a process execution request for realizing the service specified by the identification information to the device.
An information processing system including an image data storage unit for storing image data captured by the image pickup function. The identification information is
The information processing system according to claim 1, which is associated with an object to be imaged and is read by the device. The information processing system according to claim 2, wherein the identification information is information embedded in a two-dimensional code. The receiving unit receives information identifying the user of the device together with the image data, and receives the information.
The information processing system according to claim 3, wherein the image data is stored in the image data storage unit with information for identifying the user and a date and time when the image data is received. The information that identifies the user is
The information processing system according to claim 4, which is information embedded in the two-dimensional code. The transmitter is
Display data for displaying an input screen for information specifying a storage destination of the image data in response to the identification information, and an execution request for a process of transmitting the information input to the input screen to the information processing apparatus. , To the device,
The receiver is
Upon receiving the information input to the input screen to specify the storage destination of the image data,
The information processing system according to any one of claims 1 to 5, wherein the uploaded image data is stored in a storage area specified by the information specifying the storage destination in the image data storage unit. An information processing system including an apparatus and an information processing apparatus capable of communicating with the apparatus.
The information processing device is
A receiver that receives identification information that identifies the service from the device,
A first transmission unit that activates the image pickup function of the device and uploads the captured image data, and transmits a process execution request for realizing the service specified by the identification information to the device.
It has an image data storage unit for storing image data captured by the image pickup function, and has an image data storage unit.
The device is
Has a browser part
The browser part is
The identification information that identifies the service is transmitted to the information processing device, and the information processing device is transmitted.
An information processing system that transmits image data captured by the image pickup function activated based on an execution request received from the information processing device to the information processing device. It is included in the information processing system according to any one of claims 1 to 7 .
A device that reads information embedded in the two-dimensional code and transmits it to the information processing device when it is held over the two-dimensional code associated with the image-imaging object. An information processing device that can communicate with equipment
A receiver that receives identification information that identifies the service from the device,
A transmission unit that activates the image pickup function of the device and uploads the captured image data, and transmits a process execution request for realizing the service specified by the identification information to the device.
An information processing device including an image data storage unit for storing image data captured by the image pickup function. It is an information processing method by an information processing system including an information processing device capable of communicating with a device.
The information processing device
Upon receiving the identification information that identifies the service from the device,
A request for execution of a process for realizing the service specified by the identification information, which activates the image pickup function of the device and uploads the captured image data, is transmitted to the device.
An information processing method for storing image data captured by the image pickup function in an image data storage unit. For information processing devices that can communicate with devices
The process of receiving identification information that identifies the service from the device,
A process of transmitting an execution request of a process of realizing the service specified by the identification information, which activates the image pickup function of the device and uploads the captured image data, to the device.
An information processing program that executes a process of storing image data captured by the image pickup function in an image data storage unit.

Images