WO2020199318A1 - 书本点读互动设备及其控制方法、计算机可读存储介质 - Google Patents

书本点读互动设备及其控制方法、计算机可读存储介质 Download PDF

Info

Publication number
WO2020199318A1
WO2020199318A1 PCT/CN2019/087152 CN2019087152W WO2020199318A1 WO 2020199318 A1 WO2020199318 A1 WO 2020199318A1 CN 2019087152 W CN2019087152 W CN 2019087152W WO 2020199318 A1 WO2020199318 A1 WO 2020199318A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
book
reading
interactive device
input information
Prior art date
Application number
PCT/CN2019/087152
Other languages
English (en)
French (fr)
Inventor
张震
张大刚
胡峰
Original Assignee
麦片科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 麦片科技(深圳)有限公司 filed Critical 麦片科技(深圳)有限公司
Publication of WO2020199318A1 publication Critical patent/WO2020199318A1/zh

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/332Query formulation
    • G06F16/3329Natural language query formulation or dialogue systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user

Definitions

  • This application relates to the field of point-reading technology, and in particular to a book-point-reading interactive device and its control method, and computer-readable storage media.
  • the traditional reading pen is small in size and easy to carry. It is a high-tech learning tool that breaks through traditional thinking. It enhances children's interest in learning by clicking where to read. Compared with products with screens, the reading pen has no effect on children's vision, and there is almost no risk of myopia.
  • the reading pens on the market have a single form of reading, and students can only passively receive the content sent by the reading pen, that is, students mainly "click” content and pictures, and the reading pen is configured to "read” content and play Picture-related sounds or sound effects lead to poor learning effects for students.
  • the main purpose of this application is to provide a book point-reading interactive device and its control method, as well as a computer-readable storage medium, aiming to obtain information input in multiple ways when the user uses the book-point-reading interactive device for point reading. , And give feedback based on the input information, guide users to learn, realize the learning interaction between the user and the book-reading interactive device, and ensure the user's learning effect.
  • the present application provides a method for controlling an interactive device for reading books.
  • the method for controlling an interactive device for reading books includes the steps:
  • the input information includes at least one of voice input information, click input information, handwriting input information, gesture input information, and environmental information;
  • the form of outputting the feedback information by the book point-and-reading interactive device includes at least one of voice output, vibration output, text and graphic output, signal light output, and remote output.
  • the method before the step of receiving input information, the method further includes:
  • the method further includes:
  • the book-reading interactive device is controlled to output the prompt information again.
  • the step of receiving the task instruction and controlling the book point-reading interactive device to output prompt information includes:
  • the step of generating feedback information of the input information according to the input information includes:
  • the feedback information is generated according to the score information.
  • the step of generating rating information of the input information according to the input information includes:
  • the score information of the input information is generated according to the comparison result of the input information and the standard information.
  • the method further includes:
  • the method further includes:
  • the method for controlling the interactive device for reading books further includes:
  • the method for controlling the interactive device for reading books further includes:
  • the method for controlling the interactive device for reading books further includes:
  • the method for controlling the interactive device for reading books further includes:
  • the method further includes:
  • the step of receiving input information includes:
  • the step of receiving input information includes:
  • the step of receiving input information includes:
  • the environmental information includes weather information.
  • this application also provides a book point-and-read interactive device.
  • the book point-and-read interactive device includes a memory, a processor, and a book point-and-read device that is stored in the memory and can run on the processor.
  • a control program of an interactive device when the control program of the book-reading interactive device is executed by the processor, the steps of the control method of any of the above-mentioned book-reading interactive devices are implemented.
  • the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a control program for the book-reading interactive device, and the control program of the book-reading interactive device is processed When the device is executed, the steps of the method for controlling the interactive device for reading the book described in any one of the above are implemented.
  • the book point-reading interactive device and its control method, and computer-readable storage medium proposed in the embodiments of the present application when input information is detected, generate feedback information of the input information according to the input information, and control the book-point-reading interactive device Output the feedback information, obtain the information input in multiple ways when the user uses the book point-and-read interactive device for point-and-read, and provide feedback according to the input information, guide the user to learn, and realize the user and the book point-and-read interactive device The information interaction between them improves the learning efficiency of users.
  • FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in a solution of an embodiment of the present application
  • FIG. 2 is a schematic flowchart of an embodiment of a method for controlling a book-reading interactive device according to this application;
  • FIG. 3 is a schematic flowchart of another embodiment of a method for controlling a book-reading interactive device according to this application;
  • FIG. 4 is a schematic flowchart of another embodiment of a method for controlling a book-reading interactive device according to this application;
  • FIG. 5 is a schematic flowchart of another embodiment of a method for controlling a book-reading interactive device according to this application.
  • the input information includes at least one of voice input information, click input information, handwriting input information, gesture input information, and environmental information;
  • the point-reading form of the point-reading pen is single, the user can only passively receive the content sent by the point-reading pen, that is, the user mainly "clicks" content and pictures, and the point-reading pen is configured to "read" content Sounds or sound effects related to playing pictures result in poor user learning.
  • This application provides a solution that receives input information, generates feedback information of the input information based on the input information, and controls the book point-reading interactive device to output the feedback information.
  • the user uses the book point-reading interactive device to click In the process of reading, obtain the information input in various ways, and provide feedback according to the input information, guide the user to learn, realize the information interaction between the user and the book-reading interactive device, and improve the user's learning efficiency.
  • FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in a solution of an embodiment of the present application.
  • the terminal in the embodiment of this application is a book-point-reading interactive device, which may include a pen-like device, etc., or a smart device with voice, handwriting, and point-reading functions.
  • the user can perform point-and-read interaction on a paper medium. Smart devices for user learning.
  • this application is not only applied to pen-shaped devices, but also to related devices such as story robots and picture book reading robots that are common in the market. These devices generally use cameras to perceive information recorded on paper media, or directly recognize specific information at a user-specified location on paper media, and adopt information input methods such as voice, click on the screen, and image recognition, as well as voice, screen display and other information
  • the output mode for feedback can be used as the terminal of the embodiment of this application.
  • the terminal may include a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002.
  • the communication bus 1002 may be configured to realize connection and communication between these components.
  • the user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
  • the network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).
  • the memory 1005 can be a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage.
  • the memory 1005 may also be a storage device independent of the foregoing processor 1001.
  • the terminal may also include a camera, RF (Radio Frequency (RF) circuits, sensors, audio circuits, WiFi modules, LEDs, display screens, vibration components, etc.
  • sensors such as motion sensors and other sensors.
  • the gravity acceleration sensor can detect the magnitude of acceleration in various directions (usually three axes), and can detect the magnitude and direction of gravity when stationary, and can be set as an application that recognizes the posture of the mobile terminal (such as shaking, waving). Tap, flip), vibration recognition related functions (such as pedometer, tap), etc.
  • terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or fewer components than shown in the figure, or combine some components, or arrange different components.
  • the memory 1005 which is a computer storage medium, may include an operating system, a network communication module, a user interface module, and a control program of a book point-and-read interactive device.
  • the network interface 1004 is mainly set to connect to the back-end server and perform data communication with the back-end server;
  • the user interface 1003 is mainly set to connect to the client (user side) to perform data communication with the client;
  • the processor 1001 can be set to call the control program of the book point-reading interactive device stored in the memory 1005 and perform the following operations:
  • the input information includes at least one of voice input information, click input information, handwriting input information, gesture input information, and environmental information;
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • Control the book reading interactive device to output the feedback information in at least one form of voice output, vibration output, text and graphic output, signal light output, and remote output.
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • the book-reading interactive device is controlled to output the prompt information again.
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • the feedback information is generated according to the score information.
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • the score information of the input information is generated according to the comparison result of the input information and the standard information.
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the control program of the book point-reading interactive device stored in the memory 1005, and also perform the following operations:
  • the method for controlling the interactive device for reading books includes the following steps:
  • Step S10 receiving input information, and generating feedback information of the input information according to the input information, wherein the input information includes at least one of voice input information, click input information, handwriting input information, gesture input information, and environment information ;
  • the user when the user uses the book-point-reading interactive device, the user can input information through the user's voice input or click input, and the book-point-reading interactive device automatically obtains information.
  • the book point-and-read interactive device can provide corresponding feedback to the user based on the input information.
  • the input information can be voice input information, click input information, handwriting input information, gesture input information, and environmental information. At least one of them. For example, when the voice input by the user is detected, the input voice can be scored or judged whether it is right or wrong.
  • the user clicks to input information the specific content of the input can be obtained according to the click area, and the click input information can also be passed Click on the pen tip of the interactive device to read the book.
  • the trajectory obtains the information input by the user.
  • the code can be a code that supports point reading or handwriting synchronization, such as multimedia printed reading (MPR, Multimedia Print Reader) code, etc.
  • MPR Multimedia Print Reader
  • users input information through gestures, they can detect acceleration in multiple directions through the motion sensor in the book-reading interactive device, and recognize user gestures, such as shaking, swiping, flipping, etc., to obtain the preset corresponding to the gesture Information, and enter the preset information.
  • you can also use the book point-and-read interactive device to perform geographic location positioning, and obtain various environmental information of the user's location, such as weather information, based on location information.
  • the interactive devices for reading books are mostly used in the study of English subjects, and are configured to enhance users' speaking ability.
  • the interactive device for reading books can also be set up for learning other courses such as language and mathematics.
  • the book-point-reading interactive device can assist the user in recitation of the text, and prompt and correct it when the user recites.
  • the book-reading interactive device can also be set to dial the idea of solving the problem, or to judge whether the answer is right or wrong.
  • the reminder content of the exercises can also be pushed through the network to terminals such as smart phones bound with the same account for display.
  • terminals such as smart phones bound with the same account for display.
  • the user writes the answers to the exercises through the book point-reading interactive device, he can construct virtual answer content in the intelligent system according to the writing track of the book point-reading interactive device. Determine whether the content of the answer is correct.
  • the user uses the book point-and-read interactive device to read popular science point-reading books, it can help the user understand in a more intuitive way, for example, output relevant pictures or video information to the bound smartphone or smart TV according to the user's input information Wait for the terminal and configure it for the user to view.
  • standard information that is, standard answers, can be obtained.
  • scores are calculated according to preset rules, and score information is generated, thereby generating feedback information based on the score information.
  • a user wants to view his own ranking he can enter a ranking instruction to view the rating and ranking information corresponding to the user .
  • Step S20 controlling the book-reading interactive device to output the feedback information.
  • the feedback information may be at least one of voice feedback, vibration feedback, display feedback, signal light feedback, or remote feedback
  • the feedback mode may be determined according to the detected input information. For example, when giving feedback to the voice information input by the user, you can control the book-reading interactive device to configure the output mode of voice, vibration, text and graphics display, signal light flashing or remote screen projection to feed back to the user, and form interactive communication with the user , In this way, users can know the evaluation of their input voice, so as to make further improvements.
  • the book reading interactive device can be controlled to switch to the corresponding scene mode, and after the switching is successful, it will prompt by voice, vibration, text and graphic display, signal light flashing or remote screen projection.
  • the text and graphic display can be output by displaying text or graphics on the screen, the blinking of the signal light can output corresponding feedback information through the color, blinking frequency and brightness of the signal light, and the remote projection can send the information to be output to Terminals such as smart phones, smart TVs, and computers output.
  • Terminals such as smart phones, smart TVs, and computers output.
  • the remote projection can send the information to be output to Terminals such as smart phones, smart TVs, and computers output.
  • Terminals such as smart phones, smart TVs, and computers output.
  • it can output various environmental feedbacks such as weather information, so as to give users tips and care in life.
  • the method further includes:
  • Step S30 receiving a task instruction, and controlling the book point-reading interactive device to output prompt information.
  • the book-clicking interactive device will prompt the user to make the user know how to input information and what information content should be input.
  • the book point-reading interactive device When receiving a task instruction, it is necessary to control the book point-reading interactive device to output corresponding prompt information according to the task instruction.
  • control the book point-reading interactive device to read the code in the point-reading corresponding to the book point-reading interactive device, and then obtain and output the prompt information corresponding to the task instruction according to the code.
  • the task instruction generally contains the selection information of the application scenario, and the user will Place the book-reading interactive device on the content of the book that needs to be read.
  • Book point-reading interactive devices are usually equipped with corresponding point-to-read. Each part of the point-to-read content corresponds to a different code.
  • the code corresponds to prompt information and feedback rules for input information, which are not specifically limited here.
  • the prompt information can be the voice prompt information output by the book point-and-read interactive device, or the video or voice content can be transmitted through wireless means such as network or Bluetooth Remote screen output to smart phones, smart TVs, computers and other terminals.
  • the book-reading interactive device After the book-reading interactive device is turned on, it first reads the user's historical learning progress information, as well as environmental information such as the geographic location and weather, and feeds it back to the user.
  • the user After the user triggers the task instruction, it is based on the application scenario and Encoding obtains the cloud or built-in topic content, and outputs it, and configures it to prompt the user. For example, in a user follow-up scenario, a standard voice is output to prompt the user to follow-up, and feedback is provided according to the content of the user's follow-up, and configured to guide the user to learn.
  • a user follow-up scenario a standard voice is output to prompt the user to follow-up, and feedback is provided according to the content of the user's follow-up, and configured to guide the user to learn.
  • the role-based reading scenario control the book reading interactive device to output a preset voice for dialogue with the user, and evaluate the user's voice content, and suggest improvements to the user in terms of fluency, accuracy, and completeness.
  • the book-reading interactive device can be controlled to output game rules and related prompts, and the user can communicate with the book-reading interactive device through voice communication to complete game tasks, thereby stimulating the user's interest in learning.
  • start timing After controlling the book point-reading interactive device to output prompt information, start timing to obtain the first time length. If the first time length is greater than the first preset time period and the input information is not received, control the book point-reading interactive device again The prompt information is output to realize the purpose of prompting the user again.
  • the user is guided to input information based on the prompt information output by the book-reading interactive device, and the feedback information is claimed and output based on the input information, thereby realizing the information between the user and the book-reading interactive device Interaction, guide users to learn, improve users' learning efficiency.
  • the method further includes:
  • Step S40 generating learning record information according to the input information and the feedback information
  • input information and corresponding feedback information are continuously generated, and from the input information and feedback information, the user's learning process can be clearly understood, so Input information and feedback information can be integrated to generate learning record information.
  • Input information and feedback information can be integrated to generate learning record information.
  • part of the content can also be extracted to generate learning record information, which is configured to facilitate storage and reading.
  • Step S50 Send the learning record information to the server.
  • the learning record information can be stored in a storage device associated with the book-reading interactive device, or the cloud storage address corresponding to the book-reading interactive device can be obtained by binding a personal account.
  • the learning record information is uploaded to the corresponding location in the server through network transmission for storage, and configured to facilitate users to view and synchronize the learning record information of different devices. For example, users can issue learning record viewing instructions to control the book reading interactive device to obtain and output learning record information. In this way, users can view learning record information from multiple devices such as mobile phones, computers, smart TVs, and play point reading Or share the learning record information.
  • the learning record information can also be output, so that users can understand the progress of historical learning, and make targeted improvements, or generate corresponding information based on the learning situation of different users. Personalized study guidance and review, etc.
  • the user obtains the last learning content and generates multiple questions according to preset rules, and asks the user to answer within a specified time. If the user does not answer or the answer is wrong within the preset time, the book is controlled The click-and-read interactive device outputs the correct answer. If the user inputs the correct answer within the preset time, the book-click interactive device is controlled to output prompt information.
  • learning guide information can also be generated based on the learning record information to prompt the user accordingly. For example, when the current user is determined to be good or average based on the learning record information, the learning guide information that recommends the user to perform more advanced learning content is generated , And output through voice or other means, or, when it is determined that the current user has read a certain content too many times within a preset time according to the learning record information, it generates learning guidance information that advises the user to learn other content, and through voice or Output in other ways.
  • learning record information is generated according to the input information and the feedback information, and sent to the server, which is convenient for the user to view and review, and improves the learning efficiency of the user when using the interactive device for reading books. .
  • the method further includes:
  • Step S60 determining that the book-point-reading interactive device is turned on, and record the working hours of the book-point-reading interactive device;
  • Step S70 It is determined that the working duration is greater than the preset duration, and a voice message prompting a rest is output.
  • the book-reading interactive device when the book-reading interactive device is turned on, it starts timing, that is, the working time.
  • the working time is longer than the preset time, the user needs to take a break, so a prompt message is output and configured to remind the user.
  • the user is not necessarily learning when the book-reading interactive device is turned on. Therefore, the user's learning time can also be judged according to the input time of the input information and the output time of the feedback information, and prompt when the learning time is too long The user takes a break.
  • the book-reading interactive device prompts the user to take a break, and obtains the time of rest, that is, the second duration, when the second duration is greater than the second preset duration and the The input information indicates that the user's rest time is over and the user has not yet started learning, so the book-reading interactive device can be controlled to output voice information prompting to continue learning, achieving the purpose of asking the user whether to continue learning.
  • an embodiment of the present application also proposes a book point-and-read interactive device.
  • the book point-and-read interactive device includes: a memory, a processor, and a book point-and-read interaction that is stored on the memory and can run on the processor.
  • the control program of the device when the control program of the book-reading interactive device is executed by the processor, the steps of the method for controlling the book-clicking interactive device as described in the above embodiment are implemented.
  • an embodiment of the present application also proposes a computer-readable storage medium.
  • the computer-readable storage medium stores a control program for a book-reading interactive device, and the control program of the book-reading interactive device is controlled by the processor. When executed, the steps of the method for controlling the interactive device for reading books as described in the above embodiment are realized.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Artificial Intelligence (AREA)
  • User Interface Of Digital Computer (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

一种书本点读互动设备及其控制方法、计算机可读存储介质,方法包括以下步骤:接收输入信息,根据输入信息生成输入信息的反馈信息(S10);控制书本点读互动设备输出反馈信息(S20)。

Description

书本点读互动设备及其控制方法、计算机可读存储介质
本申请要求2019年04月02日提交中国专利局、申请号为201910264238.8、发明名称为“书本点读互动设备及其控制方法、计算机可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及点读技术领域,尤其涉及书本点读互动设备及其控制方法、计算机可读存储介质。
背景技术
目前,智能手机、pad(portable android device 平板电脑)、学习机为终端的学习类app(Application 应用程序)应运而生,在互动性方面大大提高了使用者的学习兴趣。但在学习过程中,用手点击屏幕的方式成为学生学习过程中的主要交互方式,即使用户脱离了书本,导致学生长时间盯着屏幕,使得学生的视力下降,且不利于学生专注力的培养。
而传统的点读笔体积小巧,方便携带,是突破传统思维的高科技学习工具。它通过点到哪里读到哪里的方式,提高孩子的学习兴趣。相比于带屏幕的产品而言,点读笔对孩子的视力没有任何影响,几乎没有近视的风险。
但是,市面上的点读笔的点读形式单一,学生只能被动地接收点读笔发出的内容,即学生主要进行“点”内容和图片,点读笔被配置为“读”内容和播放图片相关声音或音效,导致学生学习效果较差。
因此,本领域的技术人员亟需提供一种基于设备上面的相关学习类app,且不依赖大屏幕的交互方式,使得学生能够对书本保持比较大的关注度,从而提高学生的学习效果。
发明内容
本申请的主要目的在于提供一种书本点读互动设备及其控制方法、计算机可读存储介质,旨在通过在用户使用书本点读互动设备进行点读的过程中,获取多种方式输入的信息,并根据输入的信息进行反馈,引导用户学习,实现用户与书本点读互动设备之间的学习交互,保障了用户的学习效果。
为实现上述目的,本申请提供一种书本点读互动设备的控制方法,所述书本点读互动设备的控制方法包括步骤:
接收输入信息,根据所述输入信息生成所述输入信息的反馈信息,其中,所述输入信息包括语音输入信息、点击输入信息、手写输入信息、手势输入信息以及环境信息中的至少一个;以及
控制书本点读互动设备输出所述反馈信息。
可选地,所述书本点读互动设备输出所述反馈信息的形式包括语音输出、震动输出、文字图形输出、信号灯输出以及远程输出中的至少一个。
可选地,所述接收输入信息的步骤之前,还包括:
接收任务指令,控制所述书本点读互动设备输出提示信息。
可选地,所述控制所述书本点读互动设备输出提示信息的步骤之后,还包括:
获取所述书本点读互动设备输出所述提示信息后的第一时长;以及
确定所述第一时长大于第一预设时长,确定未接收到所述输入信息,控制所述书本点读互动设备再次输出所述提示信息。
可选地,所述接收任务指令,控制所述书本点读互动设备输出提示信息的步骤包括:
接收所述任务指令,控制所述书本点读互动设备读取与所述书本点读互动设备对应的点读书中的编码;
根据所述编码获取与所述任务指令对应的提示信息;以及
输出所述提示信息。
可选地,所述根据所述输入信息生成所述输入信息的反馈信息的步骤包括:
根据所述输入信息生成所述输入信息的评分信息;以及
根据所述评分信息生成所述反馈信息。
可选地,所述根据所述输入信息生成所述输入信息的评分信息的步骤包括:
获取标准信息;
比较所述输入信息与所述标准信息;以及
根据所述输入信息与所述标准信息的比较结果生成所述输入信息的评分信息。
可选地,所述根据所述输入信息生成所述输入信息的评分信息的步骤之后,还包括:
根据多个所述评分信息生成评分排名信息;以及
接收排名指令,输出所述评分排名信息。
可选地,所述控制书本点读互动设备输出所述反馈信息的步骤之后,还包括:
根据所述输入信息和所述反馈信息生成学习记录信息;以及
将所述学习记录信息发送至服务器。
可选地,所述书本点读互动设备的控制方法还包括:
确定所述书本点读互动设备开启,接收所述服务器发送的学习记录信息;以及
输出所述学习记录信息。
可选地,所述书本点读互动设备的控制方法还包括:
接收学习记录查看指令;
获取所述服务器发送的学习记录信息;以及
输出所述学习记录信息。
可选地,所述书本点读互动设备的控制方法还包括:
获取所述学习记录信息;
根据所述学习记录信息生成学习引导信息;以及
输出所述学习引导信息。
可选地,所述书本点读互动设备的控制方法还包括:
确定所述书本点读互动设备开启,记录所述书本点读互动设备的工作时长;以及
确定所述工作时长大于预设时长,输出提示休息的语音信息。
可选地,所述输出提示休息的语音信息的步骤之后,还包括:
获取输出提示休息的语音信息后的第二时长;以及
确定所述第二时长大于第二预设时长,确定未接收到所述输入信息,输出提示继续学习的语音信息。
可选地,所述接收输入信息的步骤包括:
接收手写输入指令,控制所述书本点读互动设备获取点读书中的编码;
根据所述编码的获取顺序生成手写轨迹信息;以及
输入所述手写轨迹信息。
可选地,所述接收输入信息的步骤包括:
接收手势输入指令,控制所述书本点读互动设备获取加速度方向;
根据所述加速度方向生成手势信息;以及
输入所述手势信息对应的预设信息。
可选地,所述接收输入信息的步骤包括:
获取所述书本点读互动设备的位置信息;
根据所述位置信息生成所述环境信息;以及
输入所述环境信息。
可选地,所述环境信息包括天气信息。
为实现上述目的,本申请还提供一种书本点读互动设备,所述书本点读互动设备包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的书本点读互动设备的控制程序,所述书本点读互动设备的控制程序被所述处理器执行时实现如上所述任一项所述的书本点读互动设备的控制方法的步骤。
此外,为实现上述目的,本申请还提供一种计算机可读存储介质,所述计算机可读存储介质上存储有书本点读互动设备的控制程序,所述书本点读互动设备的控制程序被处理器执行时实现如上所述中任一项所述的书本点读互动设备的控制方法的步骤。
本申请实施例提出的书本点读互动设备及其控制方法、计算机可读存储介质,在检测到输入信息时,根据所述输入信息生成所述输入信息的反馈信息,并控制书本点读互动设备输出所述反馈信息,通过在用户使用书本点读互动设备进行点读的过程中,获取多种方式输入的信息,并根据输入的信息进行反馈,引导用户学习,实现用户与书本点读互动设备之间的信息交互,提高用户的学习效率。
附图说明
图1是本申请实施例方案涉及的硬件运行环境的终端结构示意图;
图2为本申请书本点读互动设备的控制方法的一实施例的流程示意图;
图3为本申请书本点读互动设备的控制方法另一实施例的流程示意图;
图4为本申请书本点读互动设备的控制方法再一实施例的流程示意图;
图5为本申请书本点读互动设备的控制方法又一实施例的流程示意图。
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。
具体实施方式
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不限定本申请。
本申请实施例的主要解决方案是:
接收输入信息,根据所述输入信息生成所述输入信息的反馈信息,其中,所述输入信息包括语音输入信息、点击输入信息、手写输入信息、手势输入信息以及环境信息中的至少一个;以及
控制书本点读互动设备输出所述反馈信息。
由于现有技术中,点读笔的点读形式单一,用户只能被动地接收点读笔的发出的内容,即用户主要进行“点”内容和图片,点读笔被配置为“读”内容和播放图片相关声音或音效,导致用户学习效果较差。
本申请提供一种解决方案,接收输入信息,根据所述输入信息生成所述输入信息的反馈信息,并控制书本点读互动设备输出所述反馈信息,通过在用户使用书本点读互动设备进行点读的过程中,获取多种方式输入的信息,并根据输入的信息进行反馈,引导用户学习,实现用户与书本点读互动设备之间的信息交互,提高用户的学习效率。
如图1所示,图1是本申请实施例方案涉及的硬件运行环境的终端结构示意图。
本申请实施例终端为书本点读互动设备,可包括笔状设备等,或是具有语音、手写和点读功能的智能设备,用户可在纸质媒介上进行点读互动的智能设备、可引导用户学习的智能设备。
需要说明的是,本申请不仅应用在笔状设备上,还应用在目前市场比较常见的故事机器人、绘本阅读机器人等相关设备中。这些设备一般通过摄像头感知纸质媒介上记载的信息,或是直接识别纸质媒介上用户指定位置的特定信息,并且采用语音、点击屏幕、识别图像等信息输入方式,以及语音、屏幕显示等信息输出方式进行反馈,均可作为本申请的实施例终端。
如图1所示,该终端可以包括:处理器1001,例如CPU,网络接口1004,用户接口1003,存储器1005,通信总线1002。其中,通信总线1002可以设置为实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard),可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。
可选地,终端还可以包括摄像头、RF(Radio Frequency,射频)电路,传感器、音频电路、WiFi模块、LED、显示屏、震动部件等等。其中,传感器比如运动传感器以及其他传感器。作为运动传感器的一种,重力加速度传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可以设置为识别移动终端姿态的应用(比如摇动、挥击、翻转)、振动识别相关功能(比如计步器、敲击)等。
本领域技术人员可以理解,图1中示出的终端结构并不构成对终端的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。
如图1所示,作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及书本点读互动设备的控制程序。在图1所示的终端中,网络接口1004主要设置为连接后台服务器,与后台服务器进行数据通信;用户接口1003主要设置为连接客户端(用户端),与客户端进行数据通信;而处理器1001可以设置为调用存储器1005中存储的书本点读互动设备的控制程序,并执行以下操作:
接收输入信息,根据所述输入信息生成所述输入信息的反馈信息,其中,所述输入信息包括语音输入信息、点击输入信息、手写输入信息、手势输入信息以及环境信息中的至少一个;以及
控制书本点读互动设备输出所述反馈信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
控制所述书本点读互动设备以语音输出、震动输出、文字图形输出、信号灯输出以及远程输出中的至少一种形式输出所述反馈信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
接收任务指令,控制所述书本点读互动设备输出提示信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
获取所述书本点读互动设备输出所述提示信息后的第一时长;以及
确定所述第一时长大于第一预设时长,确定未接收到所述输入信息,控制所述书本点读互动设备再次输出所述提示信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
接收所述任务指令,控制所述书本点读互动设备读取与所述书本点读互动设备对应的点读书中的编码;
根据所述编码获取与所述任务指令对应的提示信息;以及
输出所述提示信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
根据所述输入信息生成所述输入信息的评分信息;以及
根据所述评分信息生成所述反馈信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
获取标准信息;
比较所述输入信息与所述标准信息;以及
根据所述输入信息与所述标准信息的比较结果生成所述输入信息的评分信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
根据多个所述评分信息生成评分排名信息;以及
接收排名指令,输出所述评分排名信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
根据所述输入信息和所述反馈信息生成学习记录信息;以及
将所述学习记录信息发送至服务器。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
确定所述书本点读互动设备开启,接收所述服务器发送的学习记录信息;以及
输出所述学习记录信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
接收学习记录查看指令;
获取所述服务器发送的学习记录信息;以及
输出所述学习记录信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
获取所述学习记录信息;
根据所述学习记录信息生成学习引导信息;以及
输出所述学习引导信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
确定所述书本点读互动设备开启,记录所述书本点读互动设备的工作时长;以及
确定所述工作时长大于预设时长,输出提示休息的语音信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
获取输出提示休息的语音信息后的第二时长;以及
确定所述第二时长大于第二预设时长,确定未接收到所述输入信息,输出提示继续学习的语音信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
接收手写输入指令,控制所述书本点读互动设备获取点读书中的编码;
根据所述编码的获取顺序生成手写轨迹信息;以及
输入所述手写轨迹信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
接收手势输入指令,控制所述书本点读互动设备获取加速度方向;
根据所述加速度方向生成手势信息;以及
输入所述手势信息对应的预设信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
获取所述书本点读互动设备的位置信息;
根据所述位置信息生成所述环境信息;以及
输入所述环境信息。
进一步地,处理器1001可以调用存储器1005中存储的书本点读互动设备的控制程序,还执行以下操作:
根据所述位置信息生成所述天气信息;以及
输入所述天气信息。
参照图2,在一实施例中,所述书本点读互动设备的控制方法包括以下步骤:
步骤S10,接收输入信息,根据所述输入信息生成所述输入信息的反馈信息,其中,所述输入信息包括语音输入信息、点击输入信息、手写输入信息、手势输入信息以及环境信息中的至少一个;
在本实施例中,在用户使用书本点读互动设备的过程中,可通过用户语音输入或点击输入、书本点读互动设备自动获取等方式输入信息。在检测到输入的信息时,书本点读互动设备可以根据输入信息对用户做出相应的反馈,其中,输入信息可以是语音输入信息、点击输入信息、手写输入信息、手势输入信息以及环境信息中的至少一个。例如,在检测到用户输入的语音时,可对输入的语音进行评分判定或是正误判断,在用户通过点击输入信息时,则可以根据点击区域获取输入的具体内容,点击输入信息也可以是通过书本点读互动设备的笔尖进行点击。由于点击输入的局限性,用户通过点击方式输入大量内容比较耗时,输入效率较低,因此,用户可优先使用点击方式选择书本点读互动设备的具体应用场景,切换应用场景以及对于书本点读互动设备的其他指令式操作。例如,在用户选择跟读场景时,对用户跟读的语音与标准语音进行对比,配置为对用户发音不准的地方进行纠正,形成学习互动。在用户通过手写输入信息时,可使用书本点读互动设备在对应的点读本上划过一片区域,由于点读本上设有编码,可根据编码生成书本点读互动设备划过的轨迹,再根据轨迹获取用户输入的信息,其中,编码可以是支持点读或者手写笔迹同步的编码,例如多媒体印刷读物(MPR,Multimedia Print Reader)码等。在用户通过手势输入信息时,可通过书本点读互动设备内的运动传感器检测多个方向上的加速度,识别出用户手势动作,比如摇动、挥击、翻转等,从而获取与手势对应的预设信息,并输入所述预设信息。此外,还可通过书本点读互动设备进行地理位置定位,根据位置信息获取用户所在地的多种环境信息,例如天气信息等。
目前书本点读互动设备多用在英语学科的学习中,配置为提升用户的口语能力。当然,书本点读互动设备也可设置为语文、数学等其他课程的学习。例如,在使用书本点读互动设备进行语文方面的学习时,书本点读互动设备可辅助用户进行课文背诵,在用户背诵时进行提示和纠正。在用户遇到生字生词时,也可控制书本点读互动设备进行提示,并要求用户进行跟读。在用户完成作业或习题时,书本点读互动设备还可设置为解题思路的点拨,或是答案的正误判断。由于语音输出方式不够直观,因此也可将习题的提示内容通过网络推送至绑定有相同账号的智能手机等终端进行显示。在用户通过书本点读互动设备书写习题答案时,可根据书本点读互动设备书写轨迹,即根据书本点读互动设备在点读书中划过的编码顺序在智能系统中构建虚拟的答案内容,从而判断答案内容是否正确。此外,在用户使用书本点读互动设备阅读科普类点读本时,可通过更直观的方式帮助用户进行理解,例如,根据用户的输入信息输出相关图片或视频信息至绑定的智能手机、智能电视等终端,配置为方便用户进行查看。在生成反馈信息时,可获取标准信息,即标准答案,根据标准信息与输入信息的比较结果,根据预设规则计算得分,并生成评分信息,从而根据评分信息生成反馈信息。当然,也可将每个用户的评分信息上传至服务器端,根据多个评分信息生成评分排名信息,在用户想要查看自己的排名时,可输入排名指令,从而查看该用户对应的评分排名信息。
步骤S20,控制书本点读互动设备输出所述反馈信息。
在本实施例中,反馈信息可以是语音反馈、震动反馈、显示反馈、信号灯反馈或是远程反馈中的至少一种,反馈方式可根据检测到的输入信息进行确定。例如,在对用户输入的语音信息进行反馈时,可控制书本点读互动设备配置为语音、震动、文字图形显示、信号灯闪烁或远程投屏的输出方式反馈给用户,与用户之间形成互动交流,这样,用户可以知晓自己输入语音的评价情况,从而做出进一步改进。在对用户点击输入的信息进行应用场景切换时,可控制书本点读互动设备切换为对应的场景模式,并在切换成功后通过语音、震动、文字图形显示、信号灯闪烁或远程投屏等方式提示用户,其中,文字图形显示可通过在屏幕上显示文字或图形进行输出,信号灯闪烁可通过信号灯的颜色、闪烁频率以及亮度等来输出相应的反馈信息,远程投屏可以将需输出的信息发送至智能手机、智能电视、电脑等终端进行输出。在获取环境信息时,则可输出天气信息等多种环境反馈,从而给予用户生活上的提示和关怀。
在本实施例公开的技术方案中,通过在用户使用书本点读互动设备进行点读的过程中,获取多种方式输入的信息,并根据输入的信息进行反馈,引导用户学习,实现用户与书本点读互动设备之间的信息交互,提高用户的学习效率。
在另一实施例中,如图3所示,在上述图2所示的实施例基础上,步骤S10之前,还包括:
步骤S30,接收任务指令,控制所述书本点读互动设备输出提示信息。
在本实施例中,一般情况下,在用户通过书本点读互动设备输入信息之前,书本点读互动设备都会对用户进行提示,使用户知晓应该如何输入信息以及输入怎样的信息内容。在接受到任务指令时,需要根据任务指令控制书本点读互动设备输出对应的提示信息。首先,控制书本点读互动设备读取与书本点读互动设备对应的点读书中的编码,再根据编码获取与任务指令对应的提示信息并进行输出。由于用户在使用书本点读互动设备时一般存在某种使用需求,即在某种应用场景中通过书本点读互动设备进行点读,因此,任务指令中一般包含应用场景的选择信息,并且用户会将书本点读互动设备放在需要进行点读的书本内容上。书本点读互动设备通常配备有对应的点读书,点读书中每一部分内容对应不同的编码,编码对应提示信息以及针对输入信息的反馈规则,在此不做具体限定。在接收到任务指令时,控制书本点读互动设备获取编码,再通过网络或书本点读互动设备连接的存储器文件获取提示信息,并进行输出。由于点读书中的部分内容可用在多个应用场景中,因此存在一个编码对应多种应用场景下的提示信息的情况。根据编码获取与任务指令中的应用场景的选择信息对应的提示信息,其中,提示信息可以是书本点读互动设备输出的语音提示信息,也可通过网络或蓝牙等无线方式将视频或语音内容传输至智能手机、智能电视、电脑等终端进行远程投屏输出。例如,在书本点读互动设备开机后,首先读取用户历史学习进度信息,以及所在地理位置和天气等环境信息,并反馈给用户,在用户触发任务指令后,根据任务指令对应的应用场景和编码获取云端或内置的题目内容,并进行输出,配置为提示用户。比如,在用户跟读场景下,输出标准语音提示用户进行跟读,并根据用户跟读的内容进行反馈,配置为引导用户学习。在分角色点读场景中,控制书本点读互动设备输出预设语音与用户进行对话,并对用户语音内容进行评价,可从流利度、准确度和完整度等方面向用户提出改善的建议。此外,在游戏场景中,可控制书本点读互动设备输出游戏规则内容和相关提示,用户与书本点读互动设备之间语音交流,完成游戏任务,从而激发用户的学习兴趣。控制所述书本点读互动设备输出提示信息后,开始计时,得到第一时长,若第一时长大于第一预设时长,且未接收到所述输入信息,控制所述书本点读互动设备再次输出所述提示信息,实现再次提示用户的目的。
在本实施例公开的技术方案中,根据书本点读互动设备输出的提示信息,引导用户输入信息,并根据输入信息声称反馈信息并进行输出,实现了用户与书本点读互动设备之间的信息交互,引导用户学习,提高了用户的学习效率。
在再一实施例中,如图4所示,在图2至图3任一实施例所示的基础上,步骤S20之后,还包括:
步骤S40,根据所述输入信息和所述反馈信息生成学习记录信息;
在本实施例中,在用户使用书本点读互动设备进行学习的过程中,会不断地产生输入信息和对应的反馈信息,并且从输入信息和反馈信息中,可以清楚知晓用户的学习过程,因此可将输入信息和反馈信息进行整合,生成学习记录信息。在输入信息和反馈信息的内容较多时,也可提取部分内容生成学习记录信息,配置为便于存储和读取。
步骤S50,将所述学习记录信息发送至服务器。
在本实施例中,所述学习记录信息可保存在与书本点读互动设备关联的存储设备中,也可通过绑定个人账号的方式,获取与书本点读互动设备对应的云端存储地址,配置为保存在服务器端。生成学习记录信息后,将学习记录信息通过网络传输的方式上传至服务器中的对应位置进行存储,配置为方便用户进行查看以及对不同设备端学习记录信息进行同步。例如,用户可发出学习记录查看指令,控制书本点读互动设备获取并输出学习记录信息,这样,用户可从多个手机、电脑、智能电视等多个设备端查看学习记录信息,以及播放点读书中的内容等,或者将学习记录信息进行分享。此外,每次在书本点读互动设备开启时,也可输出所述学习记录信息,从而使用户可以了解历史学习进度,并有针对性地做出改进,或是根据不同用户的学习情况生成对应的个性化学习指导和复习等。例如,在抢答场景下,获取用户上一次学习的内容并根据预设规则生成多个问题,并要求用户在指定时间内进行做答,若预设时间内用户未作答或答案错误,则控制书本点读互动设备输出正确答案,若预设时间内用户输入正确答案,则控制书本点读互动设备输出提示信息。在抢答结束后统计用户得分并进行存储,配置为激发用户的竞争意识以及学习兴趣。此外,还可根据学习记录信息生成学习引导信息,以对用户进行相应的提示,例如在根据学习记录信息判定当前用户学习较好或一般时,生成建议用户进行更高级的学习内容的学习引导信息,并通过语音或者其他方式进行输出,又或者,在根据学习记录信息判定当前用户在预设时间内点读某一内容次数过多时,生成建议用户学习其他内容的学习引导信息,并通过语音或者其他方式进行输出。
在本实施例公开的技术方案中,根据所述输入信息和所述反馈信息生成学习记录信息,并发送至服务器,方便用户进行查看和复习,提高了用户使用书本点读互动设备时的学习效率。
在又一实施例中,如图5所示,在图2至图4任一实施例所示的基础上,步骤S20之后,还包括:
步骤S60,确定所述书本点读互动设备开启,记录所述书本点读互动设备的工作时长;
步骤S70,确定所述工作时长大于预设时长,输出提示休息的语音信息。
在本实施例中,在书本点读互动设备开启时,开始进行计时,即工作时长,在工作时长大于预设时长时,用户需要进行休息,因此输出提示信息,配置为提醒用户。此外,在书本点读互动设备开启状态下,用户并不一定是在学习中,因此也可根据输入信息的输入时长和反馈信息的输出时长来判断用户的学习时间,在学习时间过长时提示用户进行休息。例如,本次学习时间大于30分钟时,书本点读互动设备提示用户进行休息,并获取休息的时间即第二时长,在所述第二时长大于第二预设时长,且未接收到所述输入信息,表示用户休息时间结束,并且用户还未开始学习,因此可控制所述书本点读互动设备输出提示继续学习的语音信息,实现了询问用户是否继续学习的目的。
在本实施例公开的技术方案中,通过在所述书本点读互动设备开启时,记录所述书本点读互动设备的工作时长,并在所述工作时长大于预设时长时,输出提示休息的语音信息,使用户在使用书本点读互动设备时可以劳逸结合,进一步提高了用户的学习效率。
此外,本申请实施例还提出一种书本点读互动设备,所述书本点读互动设备包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的书本点读互动设备的控制程序,所述书本点读互动设备的控制程序被所述处理器执行时实现如上实施例所述的书本点读互动设备的控制方法的步骤。
此外,本申请实施例还提出一种计算机可读存储介质,所述计算机可读存储介质上存储有书本点读互动设备的控制程序,所述书本点读互动设备的控制程序被所述处理器执行时实现如上实施例所述的书本点读互动设备的控制方法的步骤。
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。

Claims (20)

  1. 一种书本点读互动设备的控制方法,其中,所述书本点读互动设备的控制方法包括步骤:
    接收输入信息,根据所述输入信息生成所述输入信息的反馈信息,其中,所述输入信息包括语音输入信息、点击输入信息、手写输入信息、手势输入信息以及环境信息中的至少一个;以及
    控制书本点读互动设备输出所述反馈信息。
  2. 如权利要求1所述的书本点读互动设备的控制方法,其中,所述书本点读互动设备输出所述反馈信息的形式包括语音输出、震动输出、文字图形输出、信号灯输出以及远程输出中的至少一个。
  3. 如权利要求1所述的书本点读互动设备的控制方法,其中,所述接收输入信息的步骤之前,还包括:
    接收任务指令,控制所述书本点读互动设备输出提示信息。
  4. 如权利要求3所述的书本点读互动设备的控制方法,其中,所述控制所述书本点读互动设备输出提示信息的步骤之后,还包括:
    获取所述书本点读互动设备输出所述提示信息后的第一时长;以及
    确定所述第一时长大于第一预设时长,确定未接收到所述输入信息,控制所述书本点读互动设备再次输出所述提示信息。
  5. 如权利要求3所述的书本点读互动设备的控制方法,其中,所述接收任务指令,控制所述书本点读互动设备输出提示信息的步骤包括:
    接收所述任务指令,控制所述书本点读互动设备读取与所述书本点读互动设备对应的点读书中的编码;
    根据所述编码获取与所述任务指令对应的提示信息;以及
    输出所述提示信息。
  6. 如权利要求1所述的书本点读互动设备的控制方法,其中,所述根据所述输入信息生成所述输入信息的反馈信息的步骤包括:
    根据所述输入信息生成所述输入信息的评分信息;以及
    根据所述评分信息生成所述反馈信息。
  7. 如权利要求6所述的书本点读互动设备的控制方法,其中,所述根据所述输入信息生成所述输入信息的评分信息的步骤包括:
    获取标准信息;
    比较所述输入信息与所述标准信息;以及
    根据所述输入信息与所述标准信息的比较结果生成所述输入信息的评分信息。
  8. 如权利要求6所述的书本点读互动设备的控制方法,其中,所述根据所述输入信息生成所述输入信息的评分信息的步骤之后,还包括:
    根据多个所述评分信息生成评分排名信息;以及
    接收排名指令,输出所述评分排名信息。
  9. 如权利要求1所述的书本点读互动设备的控制方法,其中,所述控制书本点读互动设备输出所述反馈信息的步骤之后,还包括:
    根据所述输入信息和所述反馈信息生成学习记录信息;以及
    将所述学习记录信息发送至服务器。
  10. 如权利要求9所述的书本点读互动设备的控制方法,其中,所述书本点读互动设备的控制方法还包括:
    确定所述书本点读互动设备开启,接收所述服务器发送的学习记录信息;以及
    输出所述学习记录信息。
  11. 如权利要求9所述的书本点读互动设备的控制方法,其中,所述书本点读互动设备的控制方法还包括:
    接收学习记录查看指令;
    获取所述服务器发送的学习记录信息;以及
    输出所述学习记录信息。
  12. 如权利要求9所述的书本点读互动设备的控制方法,其中,所述书本点读互动设备的控制方法还包括:
    获取所述学习记录信息;
    根据所述学习记录信息生成学习引导信息;以及
    输出所述学习引导信息。
  13. 如权利要求1所述的书本点读互动设备的控制方法,其中,所述书本点读互动设备的控制方法还包括:
    确定所述书本点读互动设备开启,记录所述书本点读互动设备的工作时长;以及
    确定所述工作时长大于预设时长,输出提示休息的语音信息。
  14. 如权利要求1所述的书本点读互动设备的控制方法,其中,所述输出提示休息的语音信息的步骤之后,还包括:
    获取输出提示休息的语音信息后的第二时长;以及
    确定所述第二时长大于第二预设时长,确定未接收到所述输入信息,输出提示继续学习的语音信息。
  15. 如权利要求1所述的书本点读互动设备的控制方法,其中,所述接收输入信息的步骤包括:
    接收手写输入指令,控制所述书本点读互动设备获取点读书中的编码;
    根据所述编码的获取顺序生成手写轨迹信息;以及
    输入所述手写轨迹信息。
  16. 如权利要求1所述的书本点读互动设备的控制方法,其中,所述接收输入信息的步骤包括:
    接收手势输入指令,控制所述书本点读互动设备获取加速度方向;
    根据所述加速度方向生成手势信息;以及
    输入所述手势信息对应的预设信息。
  17. 如权利要求1所述的书本点读互动设备的控制方法,其中,所述接收输入信息的步骤包括:
    获取所述书本点读互动设备的位置信息;
    根据所述位置信息生成所述环境信息;以及
    输入所述环境信息。
  18. 如权利要求17所述的书本点读互动设备的控制方法,其中,所述环境信息包括天气信息。
  19. 一种书本点读互动设备,其中,所述书本点读互动设备包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的书本点读互动设备的控制程序,所述书本点读互动设备的控制程序被所述处理器执行时实现如下步骤:
    接收输入信息,根据所述输入信息生成所述输入信息的反馈信息,其中,所述输入信息包括语音输入信息、点击输入信息、手写输入信息、手势输入信息以及环境信息中的至少一个;以及
    控制书本点读互动设备输出所述反馈信息。
  20. 一种计算机可读存储介质,其中,所述计算机可读存储介质上存储有书本点读互动设备的控制程序,所述书本点读互动设备的控制程序被处理器执行时实现如下步骤:
    接收输入信息,根据所述输入信息生成所述输入信息的反馈信息,其中,所述输入信息包括语音输入信息、点击输入信息、手写输入信息、手势输入信息以及环境信息中的至少一个;以及
    控制书本点读互动设备输出所述反馈信息。
PCT/CN2019/087152 2019-04-02 2019-05-16 书本点读互动设备及其控制方法、计算机可读存储介质 WO2020199318A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910264238.8A CN110019757A (zh) 2019-04-02 2019-04-02 书本点读互动设备及其控制方法、计算机可读存储介质
CN201910264238.8 2019-04-02

Publications (1)

Publication Number Publication Date
WO2020199318A1 true WO2020199318A1 (zh) 2020-10-08

Family

ID=67190579

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/087152 WO2020199318A1 (zh) 2019-04-02 2019-05-16 书本点读互动设备及其控制方法、计算机可读存储介质

Country Status (2)

Country Link
CN (1) CN110019757A (zh)
WO (1) WO2020199318A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111968424A (zh) * 2020-08-27 2020-11-20 北京大米科技有限公司 交互式学习方法、装置、系统及计算机存储介质
CN112287705A (zh) * 2020-10-21 2021-01-29 北京大米科技有限公司 点读设备的交互方法、装置、存储介质及点读设备
CN112541493B (zh) * 2020-12-17 2022-09-30 北京字节跳动网络技术有限公司 题目讲解方法、装置和电子设备

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101149812A (zh) * 2006-09-22 2008-03-26 北京清华同方思科系统技术有限公司 基于纸面书写的互动信息服务方法、服务系统及互动读物
JP2008226097A (ja) * 2007-03-15 2008-09-25 Toshiba Corp タッチパネルシステム
CN103514423A (zh) * 2012-06-26 2014-01-15 深圳市高德讯科技有限公司 一种可答题的点读笔及点读笔的答题方法
CN104900093A (zh) * 2015-06-25 2015-09-09 武汉委托帮教育科技有限公司 一种学习设备及其使用方法
CN206348967U (zh) * 2016-09-20 2017-07-21 深圳市本顿科技有限公司 一种儿童学前平板电脑
CN106980459A (zh) * 2017-03-31 2017-07-25 广州华多网络科技有限公司 基于触屏设备的点读方法及装置
CN108536287A (zh) * 2018-03-26 2018-09-14 深圳市深晓科技有限公司 一种根据用户指示读书的方法及装置
CN109165336A (zh) * 2018-08-23 2019-01-08 广东小天才科技有限公司 一种信息输出控制方法及家教设备
CN109448453A (zh) * 2018-10-23 2019-03-08 北京快乐认知科技有限公司 基于图像识别追踪技术的点读问答方法与系统

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090204391A1 (en) * 2008-02-12 2009-08-13 Aruze Gaming America, Inc. Gaming machine with conversation engine for interactive gaming through dialog with player and playing method thereof
CN201503645U (zh) * 2009-06-05 2010-06-09 深圳市博悟电子技术有限公司 一种基于手机的分体式多功能点读学习机
CN107037715A (zh) * 2017-05-02 2017-08-11 捷开通讯(深圳)有限公司 具有点读备注与交互功能的智能手表及其备注交互方法
CN107748645A (zh) * 2017-09-27 2018-03-02 努比亚技术有限公司 点读方法、移动终端及计算机可读存储介质
CN108037882A (zh) * 2017-11-29 2018-05-15 佛山市因诺威特科技有限公司 一种点读方法及系统
CN109240582A (zh) * 2018-08-30 2019-01-18 广东小天才科技有限公司 一种点读控制方法及智能设备

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101149812A (zh) * 2006-09-22 2008-03-26 北京清华同方思科系统技术有限公司 基于纸面书写的互动信息服务方法、服务系统及互动读物
JP2008226097A (ja) * 2007-03-15 2008-09-25 Toshiba Corp タッチパネルシステム
CN103514423A (zh) * 2012-06-26 2014-01-15 深圳市高德讯科技有限公司 一种可答题的点读笔及点读笔的答题方法
CN104900093A (zh) * 2015-06-25 2015-09-09 武汉委托帮教育科技有限公司 一种学习设备及其使用方法
CN206348967U (zh) * 2016-09-20 2017-07-21 深圳市本顿科技有限公司 一种儿童学前平板电脑
CN106980459A (zh) * 2017-03-31 2017-07-25 广州华多网络科技有限公司 基于触屏设备的点读方法及装置
CN108536287A (zh) * 2018-03-26 2018-09-14 深圳市深晓科技有限公司 一种根据用户指示读书的方法及装置
CN109165336A (zh) * 2018-08-23 2019-01-08 广东小天才科技有限公司 一种信息输出控制方法及家教设备
CN109448453A (zh) * 2018-10-23 2019-03-08 北京快乐认知科技有限公司 基于图像识别追踪技术的点读问答方法与系统

Also Published As

Publication number Publication date
CN110019757A (zh) 2019-07-16

Similar Documents

Publication Publication Date Title
WO2020199318A1 (zh) 书本点读互动设备及其控制方法、计算机可读存储介质
WO2011078540A2 (en) Mobile device and related control method for external output depending on user interaction based on image sensing module
WO2014010974A1 (en) User interface apparatus and method for user terminal
WO2016072674A1 (en) Electronic device and method of controlling the same
WO2010143843A2 (ko) 컨텐츠 브로드캐스트 방법 및 이를 적용한 디바이스
WO2017082519A1 (ko) 응답 메시지를 추천하는 사용자 단말 장치 및 그 방법
WO2014196758A1 (en) Portable apparatus and screen displaying method
WO2015030461A1 (en) User device and method for creating handwriting content
WO2019112342A1 (en) Voice recognition apparatus and operation method thereof cross-reference to related application
WO2014098528A1 (en) Text-enlargement display method
WO2021096233A1 (en) Electronic apparatus and control method thereof
WO2020130691A1 (en) Electronic device and method for providing information thereof
WO2017209568A1 (ko) 전자 장치 및 그의 동작 방법
WO2014035199A1 (en) User interface apparatus in a user terminal and method for supporting the same
WO2019039739A1 (en) DISPLAY APPARATUS AND METHOD FOR CONTROLLING THE SAME
WO2016182361A1 (en) Gesture recognition method, computing device, and control device
WO2021060728A1 (ko) 사용자 발화를 처리하는 전자 장치 및 그 작동 방법
WO2018124355A1 (ko) 오디오 장치 및 그 제어방법
WO2020159302A1 (ko) 증강 현실 환경에서 다양한 기능을 수행하는 전자 장치 및 그 동작 방법
WO2011145848A2 (ko) 온라인 교육 시스템 및 이를 위한 통신 단말기
WO2021071285A1 (en) Electronic device, method and non-transitory storage medium for optical character recognition
WO2020101174A1 (ko) 개인화 립 리딩 모델 생성 방법 및 장치
WO2017116203A1 (ko) 외국어 독해 지원 방법 및 장치
EP3039512A1 (en) User device and method for creating handwriting content
WO2020087552A1 (zh) 一种点读验证装置以及点读答题验证评分方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19923440

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19923440

Country of ref document: EP

Kind code of ref document: A1