WO2015178014A1 - Système, serveur, procédé et programme de prise en charge d'apprentissage - Google Patents

Système, serveur, procédé et programme de prise en charge d'apprentissage Download PDF

Info

Publication number
WO2015178014A1
WO2015178014A1 PCT/JP2015/002510 JP2015002510W WO2015178014A1 WO 2015178014 A1 WO2015178014 A1 WO 2015178014A1 JP 2015002510 W JP2015002510 W JP 2015002510W WO 2015178014 A1 WO2015178014 A1 WO 2015178014A1
Authority
WO
WIPO (PCT)
Prior art keywords
page
learning support
information
unit
learner
Prior art date
Application number
PCT/JP2015/002510
Other languages
English (en)
Japanese (ja)
Inventor
平石　明
Original Assignee
株式会社スプリックス
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社スプリックス filed Critical 株式会社スプリックス
Priority to JP2016520934A priority Critical patent/JPWO2015178014A1/ja
Publication of WO2015178014A1 publication Critical patent/WO2015178014A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student

Definitions

  • the present invention relates to a learning support system, a learning support server, a learning support method, and a learning support program that support learning using teaching materials.
  • Such a learning support system is configured, for example, by connecting a learner terminal such as a tablet terminal and a learning support server via a communication network.
  • the learning support server provides learning content (text, images, audio, video, etc.) such as lectures, exercises, and commentary on the exercises to the learner terminal, and the learner outputs the learning content at the learner terminal and learns I do.
  • the exercise problem is transmitted from the learning support server to the learner terminal
  • the learner's answer to the exercise problem is transmitted from the learner terminal to the learning support server
  • the explanation content for the exercise problem is transmitted from the learning support server to the learner terminal.
  • a bidirectional learning support system for transmitting is also known (for example, Patent Documents 1 and 2).
  • such a learning support system provides efficient learning support using information processing, such as managing the learner's learning history and presenting problems according to the learner's academic ability. Yes.
  • An object of the present invention is to provide a novel learning support system, a learning support server, a learning support method, and a learning support program that support learning of a learner who learns using teaching materials.
  • a learning support system includes a first control unit for generating problem information indicating the content of a problem included in a teaching material, a comment content storage unit that stores comment content, and the problem information And a second control unit that retrieves the commentary content corresponding to the problem and acquires the corresponding commentary content from the commentary content storage unit.
  • the block diagram which shows the structure of the learner terminal of the 1st Embodiment of this invention The figure which shows the example of a screen of the display panel at the time of designation
  • designated of the question location of the 1st Embodiment of this invention The figure which shows the example of a screen of the designated question location of the 1st Embodiment of this invention
  • the block diagram which shows the structure of the learning assistance server of the 1st Embodiment of this invention The figure which shows the data structure of the reference page information database of the 1st Embodiment of this invention
  • the figure which shows the data structure of the problem database of the 1st Embodiment of this invention The figure which shows the data structure of the description content database of the 1st Embodiment of this invention
  • the figure which shows the data structure of the comment content link database of the 2nd Embodiment of this invention The figure which shows the example of the search result screen of the 2nd Embodiment of this invention
  • the figure which shows the data structure of the teaching material database of the 3rd Embodiment of this invention The figure which shows the data structure of the reference page information database of the 3rd Embodiment of this invention.
  • the learning support system according to the embodiment of the present invention will be described.
  • the embodiment described below shows an example when the present invention is implemented, and the present invention is not limited to the specific configuration described below.
  • a specific configuration according to the embodiment may be adopted as appropriate.
  • the 1-1 aspect of the present invention is the first control unit for generating problem information indicating the content of the problem included in the teaching material, the comment content storage unit for storing comment content, and the problem information
  • a learning support system comprising: a second control unit that searches for commentary content corresponding to a problem and obtains the corresponding commentary content from the commentary content storage unit.
  • a 1-2 aspect of the present invention is the learning support system according to the 1-1 aspect, wherein the learning support system includes a learner terminal and a learning support server that can communicate with each other via a communication network.
  • the first control unit is provided in the learner terminal
  • the comment content storage unit and the second control unit are provided in the learning support server
  • the learner terminal further includes the first control.
  • a terminal transmission unit that transmits the problem information generated by the unit to the learning support server, and the learning support server further includes a server reception unit that receives the problem information transmitted from the terminal transmission unit; And a server transmission unit that transmits the comment content acquired by the second control unit to the learner terminal.
  • a 1-3 aspect of the present invention is the learning support system according to the 1-1 or 1-2 aspect, wherein the problem information is a problem image obtained by photographing the teaching material. To do. With this configuration, the learner can easily generate problem information with a simple operation of photographing the teaching material.
  • the problem information is a feature amount extracted from a problem image obtained by photographing a teaching material. It is characterized by being. With this configuration, it is not necessary to send an image from the learner terminal to the learning support server, and the communication load can be reduced.
  • the commentary content is a moving image.
  • a learning support server capable of communicating with a learner terminal via a communication network, a receiving unit for receiving problem information transmitted from the learner terminal, and an explanation content.
  • the learning support server automatically acquires the commentary content corresponding to the problem information, Since it is transmitted to the learner's terminal, the learner can obtain explanation content for the problem transmitted by himself / herself relatively quickly.
  • a 1-7th aspect of the present invention is a learning support method in a learning support server that is communicable with a learner terminal via a communication network and includes a comment content storage unit that stores comment content.
  • the learning support method includes a reception step of receiving problem information transmitted from the learner terminal, an acquisition step of acquiring comment content corresponding to the problem indicated by the problem information from the comment content storage unit, and the acquisition step. And transmitting the comment content acquired in this way to the learner's terminal.
  • commentary content is prepared in the commentary content storage unit, and when the learner's terminal sends problem information to the learning support server, the learning support server automatically searches for commentary content corresponding to the problem information and learns. Since it is transmitted to the learner terminal, the learner can obtain the explanation content for the problem transmitted by himself / herself relatively quickly.
  • a computer of a learning support server that is communicable with a learner terminal via a communication network and includes a comment content storage unit that stores comment content is provided by the learner terminal.
  • a receiving unit that receives the transmitted problem information, a control unit that acquires comment content corresponding to the problem indicated by the problem information from the comment content storage unit, and the comment content acquired by the control unit as the learner It has a configuration that functions as a transmission unit that transmits to a terminal.
  • a 2-1 aspect of the present invention is a learning support system that supports learning using a learning material, and includes a page information generation unit for generating page information that is information on a page of the learning material, and the page information generation A reference page for storing reference page information indicating the contents of each of a plurality of pages of the teaching material, and a specification information generation unit for generating question part specification information for specifying a question part in the page information generated by the part A page search unit that searches a page corresponding to the page information generated by the page information generation unit from an information storage unit, and a plurality of items corresponding to a plurality of problems included in the page searched by the page search unit
  • the system includes a comment content specifying unit that specifies comment content corresponding to the problem specified by the question location specifying information from the comment content.
  • This configuration also enables learners to learn using non-electronic materials such as textbooks and problem collections.
  • the page is first searched to identify the page, and then the commentary content is identified using the question location designation information. This makes it easy to identify the commentary content requested by the learner. .
  • the reference page information storage unit uses, as the reference page information, a feature amount extracted from each of a plurality of pages of the teaching material.
  • the page search unit is generated by the page information generation unit using the feature amount stored in the reference page information storage unit and the feature amount extracted from the page of the teaching material.
  • a learning support system that searches for a page corresponding to the page information. With this configuration, it is possible to search for pages quickly and accurately using feature amounts.
  • a 2-3 aspect of the present invention is the learning support system according to the 2-2 aspect, comprising a learner terminal and a learning support server, wherein the page information generation unit and the designation information generation unit Provided in the learner terminal, wherein the page search unit and the comment content specifying unit are provided in the learning support server, and the learner terminal transmits the page information and the question location designation information to the learning support server.
  • the learning support server further includes a feature amount extraction unit that extracts a feature amount from the page information, and the page search unit includes the feature amount extracted by the feature amount extraction unit and the reference page information storage unit.
  • the page corresponding to the page information generated by the page information generation unit is searched using the feature amount stored in the page, and the learning support server is further specified by the comment content specifying unit
  • the commentary content A learning support system comprising the server transmission unit for transmitting to the serial learner terminal.
  • the 2-4th aspect of the present invention is the learning support system according to the 2nd-2 aspect, comprising a learner terminal and a learning support server, wherein the page information generation unit and the designation information generation unit Provided in the learner terminal, the learner terminal further comprising a feature quantity extraction unit that extracts a feature quantity from the page information, and the page search unit and the comment content specifying unit are provided in the learning support server.
  • the page information generation unit uses the feature amount as the page information, the learner terminal transmits the page information and the question location designation information to the learning support server, and the page search unit includes the feature amount.
  • the support server further includes the explanation console.
  • a learning support system comprising the server transmission unit that transmits the commentary content identified in the learner terminal by Ntsu particular unit. With this configuration, data transmitted from the learner terminal to the learning support server can be reduced.
  • a 2-5th aspect of the present invention is the learning support system according to the 2nd-2 aspect, comprising a learner terminal and a learning support server, wherein the page information generation unit, the specified information generation unit, and the page search Is provided in the learner terminal, the commentary content specifying unit is provided in the learning support server, and the learner terminal receives the page search result and the question location designation information in the page search unit.
  • the learning support server transmits the comment content specified by the comment content specifying unit to the learner terminal. With this configuration, data transmitted from the learner terminal to the learning support server can be further reduced.
  • the question location specifying information indicates a point position of the question location in the page information. It is characterized by being information. With this configuration, the learner can specify the question part by a simple operation of specifying one point in the generated page information.
  • the question location specifying information is information indicating a region of the question location in the page information It is characterized by.
  • the learning support server sends the explanation content from the learning support server to the learner terminal.
  • a search result screen generation unit that generates a search result screen including link information for transmitting the search information, and the learning support server transmits the search result screen to the learner support terminal, and from the learner terminal.
  • the commentary content storage unit stores commentary content corresponding to the problem included in each of the plurality of pages stored in the reference page information storage unit The comment content requested to be transmitted is read out and transmitted to the learner terminal.
  • the learner first receives a search result screen including link information, confirms that the commentary content has been properly identified, and then instructs the learning support server that transmits the commentary content. Can do.
  • the reference page information storage section associates teaching material information with the reference page information.
  • the page search unit refers to the learning material storage unit that stores information on the learning material used by the user for each user of the learner terminal, narrows the learning material, and then selects the page. It is characterized by searching a page corresponding to information. With this configuration, first, the learning material is specified, and then the page for the page information is searched with reference to the reference page information of the corresponding learning material, so that the search accuracy is improved.
  • the 2-10th aspect of the present invention is the learning support system according to any one of the 2-1 to 2-8 aspects, wherein the page search unit cannot search a page corresponding to the page information.
  • a screen for inputting information of the teaching material of the page information generated by the page information generation unit is presented to the learner.
  • the learning support server can know the teaching material in which the reference page information is not stored in the reference page information storage unit, and the administrator of the learning support server effectively stores the reference page in the reference page information storage unit. Information can be enhanced.
  • the 2nd-11th aspect of the present invention is the learning support system according to any one of the 2-1st to 2-8th aspects, wherein the page search unit cannot search a page corresponding to the page information.
  • a message that prompts the learner to generate page information is output to the learner.
  • the learner terminal can regenerate the page information so that the corresponding commentary content can be obtained.
  • the 2nd-12th aspect of the present invention is the learning support system according to any one of the 2nd-1st to 2-8th aspects, in the case where the page retrieval unit cannot retrieve a page corresponding to the page information.
  • a message notifying that the learning material is not registered is output to the learner.
  • the learner terminal cannot obtain the corresponding commentary content because it is not a deficiency in the page information generation method, it can be known that the teaching material has not been registered, the generation of page information wasted, And repeated transmissions can be avoided.
  • a 2nd-13th aspect of the present invention is a learning support system for supporting learning using a learning material, comprising a page information generating unit for generating page information which is information on a page of the learning material, and a plurality of learning materials.
  • a page search unit that searches for a page corresponding to the page information generated by the page information generation unit from a reference page information storage unit that stores reference page information indicating the contents of each page for each page, and the reference Problems included in pages searched by the page search unit from the description content link storage unit storing link information to the description content corresponding to the problems included in each of the plurality of pages stored in the page information storage unit
  • a search result screen generation unit that reads the link information corresponding to the link information, generates a search result screen including the read link information, and a display unit that displays the search result screen.
  • a feature amount extraction unit for extracting feature amounts as page information of the page from the image of the teaching material page, and question location designation information for designating a question location in the image are generated.
  • a learning support server that constitutes a learning support system together with a learner terminal including a designation information generation unit that performs, and a transmission unit that transmits the feature amount and the question location designation information to the learning support server, wherein the learner From the receiving unit that receives the feature amount and the question location designation information transmitted from the terminal, and from the reference page information storage unit that stores the feature amount extracted from each of a plurality of pages of the teaching material as the reference page information, the receiving unit A page search unit for searching for a page having a feature quantity as reference page information corresponding to the feature quantity received in the step, and a plurality of explanations corresponding to a plurality of problems included in the page searched by the page search unit.
  • a comment content specifying unit for specifying commentary content corresponding to the problem specified by the question location specification information, and transmission for transmitting link information to the commentary content specified by the comment content specifying unit to the learner terminal And a section.
  • a feature amount extraction unit for extracting feature amounts as page information of the page from the image of the teaching material page, and question location designation information for designating a question location in the image are generated.
  • a learning support method in a learning support server that constitutes a learning support system together with a learner terminal including a designation information generation unit that performs transmission, and a transmission unit that transmits the feature amount and the question location designation information to the learning support server.
  • a comment content specifying step for identifying comment content corresponding to the problem specified by the question location specification information, and the comment content specified in the comment content specifying step Transmitting the link information to the learner terminal. Also with this configuration, first, a page search is performed to identify the page, and then the commentary content is identified using the question location designation information. Therefore, it is easy to identify the commentary content requested by the learner.
  • a 3-1 aspect of the present invention is a learning support system that supports learning using a learning material, and includes a problem information generation unit for generating problem information indicating the content of a problem included in the learning material, The comment content corresponding to the problem indicated by the problem information generated by the problem information generation unit with reference to the comment content link storage unit storing the link information of the problem comment content included in each of the plurality of pages
  • a search result screen generation unit that generates a search result screen indicating a search result using the read link information and the problem information generated by the problem information generation unit, and the search And an output unit for outputting the search result screen generated by the result screen generation unit.
  • This configuration also enables learners to learn using non-electronic materials such as textbooks and problem collections.
  • the search result screen is generated using information indicating the content of the learner's teaching material, so that the convenience of the learner is improved.
  • a third aspect of the present invention is characterized in that in the learning support system according to the third aspect, the problem information is an image obtained by imaging the teaching material.
  • the system further comprises a problem identification unit that identifies a problem corresponding to the problem information generated by the problem information generation unit, and the search result screen generation unit includes commentary content corresponding to the problem identified by the problem identification unit
  • the link information is read out.
  • the search result screen generation unit reads the link information in the image generated by the problem information generation unit.
  • the search result screen is generated with a mark indicating that the link information exists at the position of the problem.
  • the search result screen generating unit generates the search result screen including the link information in the mark. To do.
  • the learner terminal can request transmission of commentary content through an intuitive operation of instructing a mark.
  • the search result screen generating unit includes the search result screen including a representative image of the commentary content corresponding to the read link information. Is generated.
  • the learner terminal can request transmission of the commentary content after confirming the representative image of the commentary content.
  • the 3-7th aspect is characterized in that, in the learning support system according to the 3-6th aspect, the search result screen generation unit generates the search result screen including the link information in the representative image.
  • the learner terminal can request transmission of commentary content through an intuitive operation of instructing a representative image.
  • the learner terminal can specify the question location in the teaching material image, so that convenience when asking a question is improved.
  • the search result screen generation unit includes the question location designation information in the image generated by the problem information generation unit.
  • the search result screen is generated using the image of the question location specified by the above.
  • the search result screen includes the image of the question part specified on the learner's terminal, so the image of the part that is not related to the question is excluded and It is possible to confirm the presence / absence of the link information of the commentary content only for the relevant part.
  • a learning support server that constitutes a learning support system together with a learner terminal having a problem information generating unit for generating problem information indicating the content of a problem included in a teaching material.
  • the learning support server refers to the comment content link storage unit that stores link information of the comment content of the problem included in each of the plurality of pages of the teaching material, and the problem information generated by the problem information generation unit A search that reads the link information of the commentary content corresponding to the problem indicated by, and generates a search result screen showing the search result using the read link information and the problem information generated by the problem information generation unit A result screen generation unit, and a transmission unit that transmits the search result screen generated by the search result screen generation unit to the learner terminal.
  • the search result screen is generated using information indicating the contents of the learner's teaching materials, so that the convenience of the learner is improved.
  • the third to eleventh aspects of the present invention provide learning support in a learning support server that constitutes a learning support system together with a learner terminal that includes a problem information generation unit for generating problem information indicating the content of a problem included in a teaching material.
  • This learning support method is generated by the problem information generation unit with reference to a description content link storage unit that stores link information of problem description content included in each of a plurality of pages of the teaching material.
  • the search result screen showing the search result using the link information of the commentary content corresponding to the problem indicated by the problem information and using the read link information and the problem information generated by the problem information generating unit
  • Tsu characterized in that it comprises a flop. Even with this configuration, in the learner terminal, the search result screen is generated using information indicating the contents of the learner's teaching materials, so that the convenience of the learner is improved
  • FIG. 1 is a diagram showing the overall configuration of the learning support system according to the first embodiment of this invention.
  • the learning support system 100 includes a learner terminal 10 and a learning support server 20.
  • the learning support server 20 is connected to the network NW.
  • the learner terminal 10 performs information communication with the learning support server 20 via the network NW.
  • the learner terminal 10 is connected to the network NW by performing wireless communication with a wireless base station connected to the network NW.
  • the learner terminal 10 is realized, for example, by installing a learning support application program in a portable information terminal such as a smartphone or a tablet PC, or a computer such as a personal computer.
  • the learning support server 20 includes a web server and a database.
  • the network NW is the Internet.
  • the learner terminal 10 is a terminal used by the learner S at an arbitrary place.
  • the learner S who is a user learns using a non-electronic teaching material (hereinafter simply referred to as “teaching material”) such as a textbook or a collection of questions about a portion that needs to be explained.
  • a non-electronic teaching material such as a textbook or a collection of questions about a portion that needs to be explained.
  • the non-electronic teaching material is typically a paper-based teaching material, but an electronic book that does not include a link to an address on the network is also included in the non-electronic teaching material.
  • Learning support of the learner S is performed by the learning support system 100 as follows, for example.
  • the learner terminal 10 a learning support application program (hereinafter referred to as “application”) is launched, and a corresponding portion of the teaching material is photographed according to the guidance of the application. Then, the image data of the learning material obtained by photographing is transmitted from the learner terminal 10 to the learning support server 20.
  • application a learning support application program
  • the database of the learning support server 20 stores commentary contents (in this embodiment, commentary videos) for each part of the teaching material.
  • the learning support server 20 extracts commentary content corresponding to the location indicated by the image data transmitted from the learner terminal 10 from the database, and transmits it to the learner terminal 10.
  • the learner S can receive the commentary content at the learner terminal 10 and view it. That is, the learner S can view commentary contents such as commentary videos at a point where a part that is not known during learning using the teaching material is photographed and transmitted.
  • commentary contents in this embodiment, commentary videos
  • FIG. 2 is a block diagram illustrating a configuration of the learner terminal according to the first embodiment of this invention.
  • the learner terminal 10 includes an input unit 11, an output unit 12, a control unit 13, an image generation unit 14, and a transmission / reception unit 15.
  • the control unit 13 includes a designation information generation unit 131 and a transmission data generation unit 132.
  • the input unit 11 includes a touch panel, physical buttons, and a microphone.
  • the learner S can make various inputs via the input unit 11.
  • the output unit 12 includes a display panel and a speaker. The learner S can make various inputs according to the screen displayed on the display panel.
  • the comment content received from the learning support server 20 is output from the output unit 12. When the commentary content is a moving image, the moving image is displayed on the display panel, and sound is output from the speaker.
  • the control unit 13 is realized by a computer including a processor, a RAM, a storage, and the like of the learner terminal 10 executing a learning support application program.
  • the processing includes generation of question location designation information and generation of transmission data, which will be described later.
  • these processing functions are expressed as a designation information generation unit 131 and a transmission data generation unit 132.
  • the image generation unit 14 is a camera that generates an image by photographing.
  • the image generation unit 14 includes an optical system, an image sensor, and an image processing circuit, and converts an optical image incident on the image sensor through the optical system into an electrical signal using the image sensor.
  • the image processing circuit generates image data based on the electrical signal input from the image sensor.
  • the image generated by the image processing circuit is displayed on the display panel at a predetermined frame rate.
  • the image processing circuit creates and stores an image file (hereinafter also simply referred to as “image”) from the electrical signal at this time.
  • image an image file
  • the learner S takes a picture of the question part when there is a part (hereinafter referred to as “question part”) for which explanation is desired during learning using the teaching material.
  • the image generation unit 14 generates an image of the teaching material.
  • the image generation unit 14 may be a scanner that reads a learning material, and may be a means for capturing a display screen when the learning material is an electronic book.
  • the image generation unit 14 corresponds to a “page information generation unit” of the present invention.
  • the control unit 13 controls the display on the display panel of the output unit 12 to display a message that prompts the learner S to photograph the entire page of the teaching material.
  • the designation information generating unit 131 displays the captured image on the display panel, and the learner S displays an image of the entire page (hereinafter, “page”).
  • page The question part in "Image" is specified.
  • This page image corresponds to “page information” of the present invention, and this page information corresponds to “problem information” of the present invention.
  • FIG. 3 is a diagram showing a screen example of the display panel when the question location is specified according to the first embodiment of this invention.
  • a page image is displayed on the screen, and a question location designation frame 121 is displayed superimposed on the page image.
  • the question location designation frame 121 is a rectangular frame indicating the region of the question location in the page image, and can be arbitrarily enlarged or reduced in the vertical direction and the horizontal direction.
  • the learner S can drag the upper and lower sides of the question location designation frame 121 in the vertical direction and drag the left and right sides in the left and right directions to make the question location designation frame 121 in an arbitrary position and size. .
  • FIG. 4 is a diagram illustrating a screen example of a designated question location according to the first embodiment of this invention. The learner S can confirm the designated question location on this screen.
  • FIG. 5 is a diagram illustrating a data configuration of transmission data according to the first embodiment of this invention.
  • the transmission data generation unit 132 includes date and time information indicating the current date and time, a user ID given to each learner, a page image file that is an image file of a page image generated by photographing in the image generation unit 14, and Transmission data including the question location designation information generated by the designation information generation unit 131 is generated.
  • This transmission data corresponds to “problem information” of the present invention.
  • the transmission / reception unit 15 transmits the transmission data to the learning support server 20 according to the control of the control unit 13 based on the operation of the learner S.
  • the transceiver 15 may be, for example, a wireless LAN communication module or a mobile phone communication module.
  • the transmission / reception unit 15 also receives the commentary content transmitted from the learning support server 20.
  • the configuration of the learner terminal 10 for viewing the content after the transmission / reception unit 15 receives the commentary content will be described later.
  • FIG. 6 is a block diagram illustrating a configuration of the learning support server according to the first embodiment of this invention.
  • the learning support server 20 includes a transmission / reception unit 21, a control unit 22, a reference page information database 23, a problem database 24, an explanation content link database 25, and an explanation content database 26.
  • the transmission / reception unit 21 transmits various data to the network NW, and receives the data via the network NW.
  • the transmission / reception unit 21 particularly receives transmission data (see FIG. 5) from the learner terminal 10 and transmits a search result screen to the learner terminal 10 that has transmitted the transmission data. , Streaming commentary content.
  • the control unit 22 is realized by a computer including the processor, RAM, ROM, storage, and the like of the learning support server 20 executing a learning support application program.
  • the processing includes extraction of feature values from page images, page search, problem identification, search result screen generation, stream distribution, and the like.
  • FIG. 7 is a diagram showing a data configuration of the reference page information database according to the first embodiment of this invention.
  • the reference page information database 23 a record is created and stored for each page of a plurality of teaching materials.
  • Each record is configured by associating a page ID for specifying a page and a feature amount of a reference page image as reference page information.
  • the feature quantity is expressed in the form of a feature vector.
  • the alphabet of page ID is information for specifying the teaching material, and the number of page ID indicates the number of pages.
  • FIG. 8 is a diagram showing a data configuration of the problem database according to the first embodiment of this invention.
  • the problem database 24 stores at least one record for each problem.
  • Each record includes the page ID of the page describing the problem, the problem position data indicating the problem position in the page, the problem theme that is a character string indicating the theme of each problem, and the problem ID assigned to each problem. It is stored in association. As shown in FIG. 8, each page ID is associated with a plurality of problem position data included in the page.
  • the problem position data is data indicating the position of a point in the page image.
  • the point position is set at a location indicating the main contents of each problem.
  • a plurality of problem position data may be set for one problem. In this case, a plurality of records are generated and stored for the problem.
  • Problem themes include, for example, “distribution law”, “factorization”, “square root”, “square root (sentence problem)”, “expansion”, “circumference angle theorem” (see FIG. 10), “three squares theorem” Use ”(see FIG. 10),“ Parallel to line segment ratio ”(see FIG. 14), and the like.
  • FIG. 9 is a diagram showing a data configuration of the commentary content database according to the first embodiment of this invention.
  • the comment content link database 25 stores a record for each problem.
  • Each record stores a problem ID, link information, and a thumbnail image in association with each other.
  • the link information is information for accessing the commentary video file from the learner terminal 10 and requesting streaming delivery of the commentary video file.
  • the thumbnail image is a representative image indicating the contents of the commentary video, and in this embodiment, the image at the start of the commentary video is the thumbnail image.
  • the comment content link database 25 a plurality of records having different link information (different comment contents) may be created for one problem.
  • the commentary video database 26 stores commentary movie files as commentary content.
  • the commentary moving image database 26 corresponds to the “description content storage unit” of the present invention.
  • the address of the storage area of each commentary video file is stored as link information in the commentary content link database 25.
  • the commentary movie file is a commentary movie file.
  • the commentary video was created by taking a picture of the teacher explaining the problem using a whiteboard.
  • the content of the explanation video is not limited to the content (solution explanation) that explains the solution of the exercise problem associated with the exercise problem in the problem collection, but is associated with, for example, the paragraph or keyword of the explanatory text in the textbook
  • the contents (lectures) that explain the corresponding part in detail or simply can be used.
  • the content of the commentary movie is a solution explanation, the content is not a general solution to the corresponding exercise problem but a content that explains how to actually solve the exercise problem.
  • the feature amount extraction unit 221 extracts a feature amount from a page image of a page image file in the transmission data (hereinafter referred to as “photographed page image”). This photographed page image corresponds to the “problem image” of the present invention.
  • the page search unit 222 searches for a page using the feature amount.
  • the page search unit 222 uses a feature amount extracted from the photographed page image as a query, and corresponds to the photographed page image from a plurality of pages (hereinafter, “registered pages”) stored in the reference page information database 23. Search the registration page.
  • the reference page information database 23 stores the feature amount of the reference page image as reference page information for each page of a plurality of teaching materials. This feature amount is also generated in the same manner as described below.
  • the feature amount stored in the reference page information database 23 may be extracted by the feature amount extraction unit 221 or may be extracted by another device.
  • a local feature amount is adopted as the feature amount of the image.
  • the feature quantity extraction unit 221 first extracts a feature point by applying an algorithm (corner detector) for extracting a corner point (corner) to the photographed page image.
  • an algorithm corner detector
  • a plurality of feature points are extracted from one image, and the feature amount extraction unit 221 calculates a feature amount for each of the plurality of feature points.
  • the feature amount extraction unit 221 performs the following processing for each extracted feature point.
  • the feature quantity extraction unit 221 sets a predetermined region in the vicinity of the feature point (for example, a square region of W ⁇ W pixels centered on the feature point) as the neighborhood region, and sets each pixel in the neighborhood region in the x direction and By differentiating each in the y direction, the edge gradient direction and the edge strength are calculated for each pixel in the neighboring region. Then, the feature amount extraction unit 221 generates an edge gradient direction histogram by quantizing the edge gradient direction and taking the sum of the edge intensities for each quantized edge gradient direction of the pixels in the neighborhood region. Is a local feature.
  • the page retrieval unit 222 retrieves a plurality of feature points of a plurality of registered pages stored in the reference page information database 23 for each of a plurality of feature points of the photographed page image, and local features of the feature points of the photographed page image. A feature point (corresponding point) having a local feature amount most similar to the amount is searched. At this time, for example, the page search unit 222 can express the local feature amount in a vector format (feature vector), and use the square value of the L2 norm of the feature vector as the similarity between the local feature amounts. Then, as a result of performing this search for a plurality of feature points of the photographed page image, the page search unit 222 determines that the registered page that has the most corresponding points is the registered page corresponding to the photographed page image.
  • the page search unit 222 passes the page ID of the registered page to the problem specifying unit 223.
  • the problem specifying unit 223 specifies the problem stored in the problem database 24 using the question location designation information in the transmission data and the page ID obtained by the page search unit 222.
  • the problem specifying unit 223 refers to the problem database 24, and the point position indicated by the problem position data from the records having the page ID that matches the page ID obtained by the page search unit 222 is the question location designation information. By identifying the record included in the question location shown, the problem specified by the question location specification information is specified.
  • the problem identification unit 223 passes the problem ID and problem theme of the identified problem to the search result screen generation unit 224.
  • the search result screen generation unit 224 acquires the question link information and the thumbnail image of the record having the question ID obtained by the question specifying unit 223 from the comment content link database 25, and the question from the learner terminal 10 A search result screen that is a screen for responding to is generated.
  • the configuration including the problem specifying unit 223 and the search result screen generating unit 224 corresponds to the “explanatory content specifying unit” of the present invention.
  • FIG. 10 is a diagram illustrating an example of a search result screen according to the first embodiment of this invention.
  • the search result screen includes a trimmed image 51 of the question part and a thumbnail 52 of the explanation movie, and link information is embedded in the thumbnail 52 of the explanation movie.
  • the trimmed image 51 is generated using the captured page image and question location designation information included in the transmission data. Specifically, the image is generated by trimming an image within the frame of the question location indicated by the question location designation information from the photographed page image.
  • serial number marks 511 and 512 are attached to the trimmed image 51 for each problem. These serial number marks 511 and 512 indicate that there is link information in the problem included in the question part, that is, that there is an explanation movie and it has been searched. Link information is embedded in the serial number marks 511 and 512. The superposition position when superimposing the serial number mark on the trimming image is determined according to the problem position data of the corresponding record among the records stored in the explanation content link database 25. Instead of the serial number marks 511 and 512, simple marks without serial numbers may be employed.
  • the thumbnail image of the commentary video is appended with the serial number of the serial number mark and the problem theme acquired from the problem identification unit 223.
  • link information is embedded in the thumbnail image, and when the thumbnail image is tapped, distribution of the commentary video is requested using the link information. Further, link information is also embedded in the serial number mark superimposed on the image of the question location, and distribution of the corresponding commentary video is requested by tapping the serial number mark.
  • the transmission / reception unit 21 transmits the examination result screen generated by the search result screen generation unit 224 to the learner terminal 10 that has transmitted the transmission data.
  • the learner terminal 10 receives the search result screen transmitted from the learning support server 20, and the control unit 13 displays the search result screen on the display panel of the output unit 12.
  • the control unit 13 uses the link information and the learning support server A distribution request command for requesting the distribution of the commentary video is transmitted to 20.
  • the transmission / reception unit 21 of the learning support server 20 When the transmission / reception unit 21 of the learning support server 20 receives the distribution request command, it passes it to the distribution processing unit 225.
  • the distribution processing unit 24 reads the commentary moving image file designated by the distribution request command from the commentary content database 26 and performs streaming distribution to the learner terminal 10 via the transmission / reception unit 21.
  • the learner terminal 10 receives the streaming distribution, displays a moving image on the display panel of the output unit 12, and outputs sound from the speaker.
  • the learning support server 20 when a “question” is made by photographing a learning material at the learning terminal 10 and transmitting the image to the learning support server 20, a page is transmitted to the transmission data. Since the entire image and the question location designation information are included, the learning support server 20 first performs a search by image matching on the entire page image in the page search unit 222, and then in the problem identification unit 223. The problem at the position designated as the question part can be specified. This improves the accuracy of problem identification.
  • the question location designation information is obtained by searching the page having the problem position data existing in the frame indicated by the question location designation information. You can identify problems that exist in the frame shown. This process merely involves examining the inclusive relation between the frame and the point position, and the processing load can be reduced.
  • the learner S uses a learning material in which the commentary video is not stored in the commentary content database 26 of the learning support server 20, and the page is generated by photographing such a learning material. There is a case in which a photographed page image is transmitted. Further, as described above, when the learner terminal 10 causes the learner S to shoot a learning material, a message prompting the learner S to shoot a page of the learning material or the entire page is displayed on the display panel. Even if the learner S does not shoot a page or the entire page despite this message, the page search unit 222 may not be able to search for a page.
  • the page search unit 222 searches the reference page information database 23 and, if the corresponding record is not searched, determines whether the page image in the transmission data is a page or the entire page. Specifically, the page search unit 222 determines whether or not there is an image edge corresponding to the edge of the page of the teaching material at the top and bottom of the photographed page image. If the edge of the image cannot be detected in the upper and lower parts of the photographed page image, the page search unit 222 returns error information indicating that the entire page is not photographed to the learner terminal 10 via the transmission / reception unit 21. .
  • the page search unit 222 searches the reference page information database 23, and when the corresponding record is not searched, when the edge of the image is detected at the upper part and the lower part of the photographed page image, the explanation content of the teaching material is learned. Error information that is not stored in the support server 20 (the teaching material is not registered) is transmitted to the learning terminal 10.
  • the learner terminal 10 When the learner terminal 10 receives the error information, the learner terminal 10 displays a message prompting again to shoot the entire page according to the content, or displays a message indicating that the teaching material is not registered. When a message indicating that the learning material is not registered is displayed, the message display screen includes an input field for the learner S to enter the name of the learning material that the learner S is using.
  • the learner S When the message indicating that the learning material is not registered is displayed, the learner S enters the name of his / her learning material in the input field.
  • the transmission / reception unit 15 of the learner terminal 10 transmits the name of the unregistered teaching material input in the input field to the learning support server 20 under the control of the control unit 13 based on the operation of the learner S.
  • the learner server 20 stores the name of the transmitted unregistered teaching material in a storage medium (not shown).
  • the operator of the learning support server 20 can know the learning materials used by the learner S by referring to the information of the unregistered learning materials, and prepare a new commentary content for the learning materials. Can do.
  • FIG. 11 is a block diagram showing the configuration of the learner terminal of the learning support system according to the second embodiment of the present invention
  • FIG. 12 shows the learning support of the learning support system according to the second embodiment of the present invention. It is a block diagram which shows the structure of a server.
  • the learner S takes a page image so that one page of the teaching material fits in the image when making a question.
  • the question part is not specified, and link information and thumbnail images are provided from the learning support server 20 'for all problems included in the photographed page image.
  • the same components as those of the first embodiment are denoted by the same reference numerals, and the description thereof is omitted as appropriate.
  • the control unit 13 does not include the designation information generation unit 131 as compared with the learner terminal 10 of the first embodiment.
  • the transmission data generation unit 132 generates transmission data including date and time information, a user ID, and a page image file, and transmits the transmission data to the learning support terminal 20 ′.
  • FIG. 13 is a diagram illustrating a data structure of the comment content link database according to the second embodiment of this invention.
  • the comment content link database 25 ′ of the present embodiment stores a page ID, problem position data, problem theme, link information, and thumbnail image file in association with each record.
  • the page search unit 222 refers to the reference page information database 23 to search for a registered page corresponding to the photographed page image included in the transmission data.
  • the page ID of the page is generated as a search result screen.
  • the search result screen 223 refers to the explanation content link database 25 'and generates a search result screen using all records having the corresponding page ID.
  • FIG. 14 is a diagram illustrating an example of a search result screen according to the second embodiment of this invention.
  • the search result screen includes a photographed page image 53 and a commentary video thumbnail 54.
  • explanation movie reproduction marks 531 to 534 are added so as to be superimposed on the problem in which the explanation movie is obtained.
  • These marks 531 to 534 indicate that a commentary video about the problem can be provided.
  • link information to the corresponding commentary video is embedded in the marks 531 to 534.
  • the learner S does not need to specify the question part after shooting the page including the part to be asked, Operation can be simplified.
  • the photographed page image of the search result screen transmitted from the image support server 20 ′ to the learner terminal 10 ′ is marked with a problem that does not require commentary, and link information to the commentary video is provided.
  • the learner S only needs to ignore the mark and request distribution of commentary videos for problems that do not require commentary, and there is no particular inconvenience.
  • FIG. 15 is a block diagram illustrating a configuration of a learning support server in the learning support system according to the third embodiment of this invention.
  • the page search unit 222 searches for records having reference page information corresponding to the photographed page image among the records stored in the reference page information database 23.
  • the learning support server 20 ′′ performs this page search after narrowing down teaching materials.
  • the learning support server 20 ′′ of the present embodiment includes a teaching material database 27 as shown in FIG.
  • FIG. 16 is a diagram illustrating a data configuration of the teaching material database according to the third embodiment of this invention. As shown in FIG. 16, in the learning material database, for each learner who is a user, the user ID and the learning material ID of the learning material used by the user are associated.
  • the learner can register his / her teaching materials in the teaching material database 27 from the learner terminal 10.
  • the learning support server 20 ′′ provides a screen for learning material registration to the learner terminal 10. On this screen, it is possible to select a learning material that can be registered, that is, a learning material for which explanation content is prepared in the learning support server 20 ′′.
  • the learning material database 27 stores the learning material ID of the learning material for the user.
  • FIG. 17 is a diagram showing a data configuration of the reference page information database according to the third embodiment of the present invention.
  • Each page record stores a learning material ID, a page ID, and a feature amount extracted from the reference page image in association with each other.
  • the page search unit 222 ′′ receives the transmission data from the learner terminal 10, the page search unit 222 ′′ refers to the learning material database 27 and acquires the learning material ID corresponding to the user ID included in the transmission data.
  • the page search unit 222 ′′ refers to the record having the acquired teaching material ID among the records stored in the reference page information database 23, and searches the registered page corresponding to the captured page image included in the transmission data. If there is no corresponding record in the above search, the page search unit 222 ′′ also searches for records of other teaching materials. That is, the page search unit 222 ′′ searches the learning material database 27 with priority on the learning material page associated with the user ID of the learner.
  • the page search unit 222 ′′ passes the result to the problem specifying unit 223, and uses the learning material ID and the user ID associated with the corresponding registered page. In association therewith, it is added to the teaching material database 27. That is, the page search unit 222 ′′ automatically registers the learning material in the learning material database 27 when the photographed page image is matched with the image of the learning material not registered in the learning material database 27.
  • the search of the page is performed with priority given to the learning material used by the learner, so that the search of the page becomes faster and the question is asked.
  • the waiting time of the learner from when the search result screen is returned can be reduced.
  • the image generation unit 14 generates a page image as page information indicating the entire page of the teaching material
  • the reference page information database 23 stores the feature amount of the reference page image as reference page information.
  • the page search unit searches for the corresponding page using the feature amount of the page image and the feature amount of the reference page image.
  • the page information indicating the entire page of the teaching material is not limited to the image, and character information, audio information, etc. Other types of information may be used.
  • the photographed page image is transmitted as page information from the learner terminal 10 to the learning support server 20, and the photographed page image is extracted by the feature amount extraction unit 221 of the learning support server 20.
  • the learner terminal 10 is provided with a feature amount extraction unit 221, and the learner terminal 10 receives not the captured page image but the feature amount extracted therefrom from the learner terminal 10. You may make it transmit as page information.
  • the feature amount extraction unit 221 provided in the learner terminal 10 corresponds to the “page information generation unit” of the present invention together with the image generation unit 14. That is, the page information, which is information on the entire page of the teaching material, may be a page image or a feature amount extracted from the page image. The feature amount at this time corresponds to “problem information” of the present invention.
  • the learner terminal 10 includes not only the feature amount extraction unit 221 but also a page search unit 222, and the registered page corresponding to the photographed page image is referred to the reference page information database 23 using the extracted feature amount of the photographed page image. May be extracted from In this case, from the learner terminal 10, the search result in the page search unit 222 (that is, the page ID of the registered page searched) and the question location designation information are transmitted to the learning support server 20. In this case, the reference page information database 23 may be provided in the learner terminal 10. This search result corresponds to “problem information” of the present invention.
  • the learner terminal 10 includes not only the feature amount extraction unit 221 and the page search unit 222 but also a problem specifying unit 223, and specifies a problem from the searched registration page based on the question location designated by the learner. May be.
  • the problem ID of the identified problem is transmitted from the learner terminal 10 to the learning support server 20.
  • the reference page information database 23 and the problem database 24 may be provided in the learner terminal 10.
  • the problem ID corresponds to “problem information” of the present invention.
  • the learner terminal 10 may include a search result screen generation unit 224 as well as the feature amount extraction unit 221, the page search unit 222, and the problem identification unit 223. In this case, that is, all the functions of the control unit 22 of the learning support server 20 may be provided in the learner terminal 10. Further, the learning support system 100 may be configured by the learner terminal 10 alone, and communication may not be required for the learning support operation described above.
  • the problem identification unit 223 uses the question location designation information in the transmission data and the page ID obtained by the page search unit 222 to store the problem stored in the problem database 24.
  • the search result screen generation unit 224 acquires the link information and the thumbnail image of the problem of the record having the problem ID obtained by the problem identification unit 223 from the comment content link database 25.
  • the problem database 24 and the comment content database 25 are not provided separately, but as a single database, each problem record in the database is the page ID of the page in which the problem is described, and the problem position in the page.
  • the problem position data indicating the link information to the commentary content may be stored in association with each other.
  • the configuration including the problem specifying unit 223 and the search result screen generating unit 224 also specifies the commentary content corresponding to the problem specified by the question location specification information from the one database as the commentary content specifying unit. Then, a search result screen using the link information may be generated.
  • the learning support server determines whether or not the captured page image of the entire page has been obtained. However, whether or not the captured page image is an image of the entire page. This determination may be made at the learner terminal. In this case, when the learner terminal determines that the photographed page image is not a photograph of the entire page, the learner terminal cancels the photographed page image and prompts the user to redo the photographing so as to photograph the page or the entire page. Display a message.
  • the reference page information database 23 stores a plurality of feature values extracted from the image of the registered page as reference page information. Instead of this feature value, reference page information is used as reference page information. Text data of character strings included in each page of each learning material may be stored.
  • the page search unit 222 performs character recognition on the captured page image in the transmission image and acquires text data. Then, the page search unit 222 performs page search by matching the text data obtained by character recognition with the text data stored in the reference page information database 23.
  • the reference page information database 23 may store image data of a registered page as reference page information.
  • data indicating the point position in the page image is stored in the problem database 24 as the problem position data indicating the position of each problem.
  • each data in the page image is stored.
  • Data indicating the problem area may be stored.
  • the problem specifying unit 223 specifies the problem when a predetermined ratio (for example, 70%) or more of the area is included in the frame indicated by the question location specifying information included in the transmission data.
  • the question location designation information is information indicating the region in the captured page image.
  • the question location specifying information is information indicating the point position in the captured page image as the question location. May be.
  • the problem specifying unit 223 determines that the problem is the point position problem closest to the point position indicating the question location. Identify.
  • the problem specifying unit 223 specifies a problem in an area including a point position indicating a question location included in transmission data. Is identified.
  • problem position data indicating the position of each problem is stored in the problem database 24.
  • an image of each problem hereinafter referred to as a “reference problem image”
  • the problem specifying unit 223 performs matching between the partial image of the area specified by the question location specifying information in the captured page image included in the transmission data and the reference problem image stored in the problem database 23. The page is searched.
  • the search result screen including link information to the commentary content is first transmitted to the learner terminal, and distribution is performed when the learner S requests a commentary video using the link information.
  • the processing unit 225 has streamed the commentary video, the transmission of the search result screen may be omitted.
  • each explanation movie file is stored in the explanation content database 26 in association with the problem ID.
  • the delivery processing unit 225 delivers the commentary video associated with the identified problem ID to the learner terminal by streaming.
  • streaming distribution may be performed in order, and link information and thumbnail images may be transmitted to the learner terminal for comment content waiting for the turn.
  • the components of the learning support server in the above embodiment may be provided in a separate device.
  • the comment content database 26 and the distribution processing unit 225 may be provided in a comment content server different from other configurations.
  • all the databases, the transmission / reception unit, and the control unit may be configured as separate devices.
  • the commentary content is a moving image, but the commentary content is not limited to this, and may be various types of content that can be distributed from the learning support server, such as images, sounds, and texts.
  • the learner S has taken an image of the entire page in order to acquire the information of the entire page of the learning material.
  • the registered page is searched using information on a partial area of the learning material page. It may be possible.
  • an image of only a partial area of the page (hereinafter referred to as “captured partial image”) is obtained by the learner terminal 10 shooting a partial area of the page.
  • This captured partial image also corresponds to the “problem image” of the present invention, like the above-described captured page image.
  • the question part may be specified as in the first embodiment or not as in the second embodiment.
  • FIG. 18 is a diagram showing an example of the data structure of the reference problem information database of this modification.
  • the reference problem information database 23 ′ can be used in place of the reference page information database 23 of the above embodiment.
  • a record is created and stored for each problem.
  • Each problem is given a problem ID, and the feature value of the problem is associated with each problem ID in the form of a feature vector in the reference problem information database 23 ′.
  • the feature amount extraction unit 221 extracts feature amounts from the captured partial images in the same manner as in the above embodiment.
  • the page search unit 222 uses a feature amount extracted from the captured partial image as a query, and uses a plurality of problems stored in the reference problem information database 23 '(hereinafter referred to as "registration problem"). Search the registration problem corresponding to the captured partial image.
  • the reference page information database 23 of the above embodiment may be used instead of the reference problem information database 23 ′.
  • the page search unit 222 determines that the registered page including the most corresponding points is the registered page corresponding to the captured partial image, as in the above embodiment.
  • the image generation unit 14 takes a picture by the operation of the learner S to generate a page image file, and the transmission data including the page image file is generated by the operation of the learner S. That is, the shooting of the teaching material is a still shooting in which one image file is generated according to the release operation by the learner S.
  • AR Augmented ity Reality
  • processing may be performed. In the AR processing, even if there is no release operation of the learner S, capture is repeatedly performed by the image sensor of the image generation unit 14, and the subsequent processing is performed each time.
  • an image of a teaching material photographed at a predetermined frame rate is displayed on the display panel of the learner terminal 10 and is superposed on the image, and a serial number mark including link information to an explanation video (see FIG. 10) is displayed.
  • the search result screen generation unit 224 is provided in the learner terminal 10. Instead of generating the search result screen, the search result screen generation unit 224 generates a serial number mark to be superimposed on the image, and adds the generated mark to the image captured at a predetermined frame rate and displayed on the display panel. Superimpose.
  • the learner S simply holds the learner terminal 10 over the learning material, and obtains an image of the learning material on which a mark including link information to the explanation video is superimposed on the display panel of the learner terminal 10. be able to.
  • the problem information is an image file or a feature amount obtained from an image.
  • the problem information of the present invention is not limited to this.
  • the problem information may be text data obtained by performing character recognition on an image, for example.
  • the problem information is generated by photographing the teaching material with the image generation unit 14, but the problem information may be generated by the learner S reading the question part of the teaching material. That is, the problem information may be voice data, feature data extracted from the voice data, or text data obtained by performing voice recognition on the voice data (hereinafter, “voice recognition text”). .
  • the reference page information database 23 stores feature data for each page of a plurality of teaching materials or for each problem of a plurality of pages of a plurality of teaching materials. .
  • a voice recognition process is performed instead of the feature quantity extraction process in the feature quantity extraction unit 221, and each page of a plurality of teaching materials is stored in the reference page information database 23, or Text data is stored for each question on a plurality of pages of a plurality of teaching materials.
  • the search result screen generation unit 224 generates a search result screen including link information to the commentary video.
  • the content of the voice recognized on the search result screen may be displayed as text.
  • the search result screen generation unit 224 may be omitted, and if the problem identification unit 223 succeeds in identifying the problem, the distribution processing unit 225 may start distributing the corresponding commentary video without generating the search result screen. .
  • commentary videos for learners have been provided on the Internet.
  • the learner views the video in order according to the order provided by the explanation video provider, or an index attached to the explanation video (for example, the video).
  • the present invention is based on conventional learning using non-electronic teaching materials such as learners actively reading textbooks and solving problem collections, and distribution of commentary videos there. Planning a combined learning support.
  • the learner when a learner makes a question while learning using a learning material, the learner is provided with a commentary video about the question portion of the learning material.
  • An operation for a question to a learner terminal by a learner is equivalent to an action of asking a teacher a question that is not known in conventional learning.
  • the content of the commentary video is not a general solution, it is a content that explains how to actually solve the exercise problem, so it is exactly the same as a teacher teaching you how to solve a problem you do not understand An effect is obtained. That is, according to the learning support system of the embodiment of the present invention, a learning environment is provided in which questions can be asked to the teacher anytime and anywhere in learning using textbooks and problem collections.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Electrically Operated Instructional Devices (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

La présente invention concerne un système de prise en charge d'apprentissage (100) qui comprend le terminal d'un apprenant (10) et un serveur de prise en charge d'apprentissage (20) capables de communiquer l'un avec l'autre par l'intermédiaire d'un réseau de communication. Le terminal de l'apprenant (10) comprend une unité de commande (13) pour générer des informations de problème représentant le contenu d'un problème inclus dans un matériel pédagogique, et un émetteur-récepteur (25) pour transmettre les informations de problème générées par l'unité de commande (13) au serveur de prise en charge d'apprentissage (20). Le serveur de prise en charge d'apprentissage (20) comprend un émetteur-récepteur (21) pour recevoir les informations de problème transmises par l'émetteur-récepteur (15), une base de données de contenus pédagogiques (26) pour stocker un contenu pédagogique et une unité de commande (22) pour acquérir, de la base de données de contenus pédagogiques (26), un contenu pédagogique correspondant à un problème indiqué par les informations de problème. L'émetteur-récepteur (21) transmet le contenu pédagogique acquis par l'unité de commande (22) au terminal de l'apprenant (10).
PCT/JP2015/002510 2014-05-23 2015-05-19 Système, serveur, procédé et programme de prise en charge d'apprentissage WO2015178014A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2016520934A JPWO2015178014A1 (ja) 2014-05-23 2015-05-19 学習支援システム、学習支援サーバ、学習支援方法、及び学習支援プログラム

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2014107544 2014-05-23
JP2014107553 2014-05-23
JP2014-107553 2014-05-23
JP2014-107544 2014-05-23

Publications (1)

Publication Number Publication Date
WO2015178014A1 true WO2015178014A1 (fr) 2015-11-26

Family

ID=54553695

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/002510 WO2015178014A1 (fr) 2014-05-23 2015-05-19 Système, serveur, procédé et programme de prise en charge d'apprentissage

Country Status (2)

Country Link
JP (1) JPWO2015178014A1 (fr)
WO (1) WO2015178014A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6308482B1 (ja) * 2017-03-06 2018-04-11 弘道 外山 学習支援システム、学習支援サーバ、学習支援方法、学習支援プログラムおよび学習支援システムの運用方法
JP2020134878A (ja) * 2019-02-25 2020-08-31 株式会社教育情報サービス 学習システム、動画自動生成方法及びプログラム
JP2021060440A (ja) * 2019-10-03 2021-04-15 Ａｓａｔｅｃ株式会社 カード学習システム及びカード学習方法

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013222406A (ja) * 2012-04-18 2013-10-28 Setsuo Kimura 画像検索システム、画像検索装置およびコンピュータプログラム

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013222406A (ja) * 2012-04-18 2013-10-28 Setsuo Kimura 画像検索システム、画像検索装置およびコンピュータプログラム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"Tenohira Katei Kyoshi Snapstudy/Snasuta", IPHONE SAISHIN NINKI APPLICATION RANKING BEST 300 [IOS-APP, 25 February 2014 (2014-02-25), Retrieved from the Internet <URL:http://ios-app.jp/625692675.html> [retrieved on 20150716] *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6308482B1 (ja) * 2017-03-06 2018-04-11 弘道 外山 学習支援システム、学習支援サーバ、学習支援方法、学習支援プログラムおよび学習支援システムの運用方法
JP2018146799A (ja) * 2017-03-06 2018-09-20 弘道 外山 学習支援システム、学習支援サーバ、学習支援方法、学習支援プログラムおよび学習支援システムの運用方法
JP2020134878A (ja) * 2019-02-25 2020-08-31 株式会社教育情報サービス 学習システム、動画自動生成方法及びプログラム
JP2021060440A (ja) * 2019-10-03 2021-04-15 Ａｓａｔｅｃ株式会社 カード学習システム及びカード学習方法

Also Published As

Publication number Publication date
JPWO2015178014A1 (ja) 2017-04-20

Similar Documents

Publication Publication Date Title
US10339383B2 (en) Method and system for providing augmented reality contents by using user editing image
CN103140862B (zh) 用户界面系统及其操作方法
JP4818274B2 (ja) 画像センサを備えた装置へマルチメディア・データを配信する方法
CN103607457B (zh) 笔记处理方法、装置、终端、服务器及系统
CN103310663B (zh) 一种智能点读方法、设备及系统
JP2014238742A (ja) 情報処理システムおよび情報処理方法
KR102183363B1 (ko) 증강 현실 및 복합 현실을 이용한 정보 검색 장치 및 방법
WO2015178014A1 (fr) Système, serveur, procédé et programme de prise en charge d&#39;apprentissage
JP2012190303A (ja) コメント共有システム、方法、ならびにプログラム
JP2014238815A (ja) 情報処理システム、情報提供方法、端末装置およびプログラム
KR101928524B1 (ko) 강의 콘텐츠 제공 장치 및 그 방법
CN109697242A (zh) 拍照搜题方法、装置、存储介质和计算设备
JP6398552B2 (ja) 表示制御プログラム、表示制御方法及び表示制御装置
CN108351973A (zh) 控制图像处理设备的方法
CN106202539B (zh) 聚合搜索方法及装置
JP2017090478A (ja) 手書き情報処理装置
JP6324284B2 (ja) グループ学習システム
CN104978389A (zh) 方法、系统、服务器和客户端
JP2018005931A (ja) 情報処理システム、情報処理方法および外部システム
KR20140025720A (ko) 교재의 인식 코드를 이용하여 멀티미디어 콘텐츠를 제공하는 학습 시스템 및 방법
CN208922253U (zh) 视频智能推送装置
CN112307877A (zh) 信息处理方法、信息处理装置及计算机可读取的存储介质
JP6221107B2 (ja) 制御装置及びプログラム
KR101723500B1 (ko) 정보 제공 장치 및 그 방법
JP2016535356A (ja) 製品説明の照会方法、装置、システムおよびクライアント

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15796482

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2016520934

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15796482

Country of ref document: EP

Kind code of ref document: A1