WO2020125501A1 - 光标定位方法、交互投影装置及教育系统 - Google Patents

光标定位方法、交互投影装置及教育系统 Download PDF

Info

Publication number
WO2020125501A1
WO2020125501A1 PCT/CN2019/124361 CN2019124361W WO2020125501A1 WO 2020125501 A1 WO2020125501 A1 WO 2020125501A1 CN 2019124361 W CN2019124361 W CN 2019124361W WO 2020125501 A1 WO2020125501 A1 WO 2020125501A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
grayscale
preset
display screen
coordinates
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/124361
Other languages
English (en)
French (fr)
Inventor
高向阳
程俊
郭海光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Institute of Advanced Technology of CAS
Original Assignee
Shenzhen Institute of Advanced Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Institute of Advanced Technology of CAS filed Critical Shenzhen Institute of Advanced Technology of CAS
Publication of WO2020125501A1 publication Critical patent/WO2020125501A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip

Definitions

  • the invention belongs to the technical field of multimedia, and particularly relates to a cursor positioning method, an interactive projection device and an education system.
  • the learning machine is a portable learning device that is more popular among the student community.
  • the early learning machine was connected to a TV, using the TV screen for output and display, and then gradually turned to a variety of smaller electronic devices.
  • some learning machines can show students various teaching content in the form of projection.
  • the user can receive the data fed back by the user through the mouse, keyboard, and touch screen on the learning machine, so as to achieve a complete teaching interaction.
  • teaching content in the form of projection, it is difficult to obtain the data input by the user through the projection device, that is, the teaching content can only be displayed to the user through projection, and the user's click, selection, and input to the displayed teaching content cannot be known.
  • Such feedback data is not conducive to the integrity of teaching.
  • embodiments of the present invention provide a cursor positioning method, an interactive projection device, and an education system to solve the problem that the existing projection-based multimedia system cannot obtain data fed back by the user.
  • a first aspect of an embodiment of the present invention provides a cursor positioning method, including: acquiring a filtered projection image and converting the projection image into a grayscale image; if the grayscale image contains a target object, then Pixels in the grayscale image whose grayscale value is not greater than the first preset grayscale threshold are taken as non-target pixels; the average value of the grayscale values of all the non-target pixels is counted, and according to the preset mapping Relationship, the mapping value of the average value is used as the second gray threshold; if the shape of the area covered by a plurality of pixels whose gray values are not less than the second gray threshold in the gray image is the preset Shape, the area is used as the target object; according to the coordinate mapping relationship between the preset projection image and the terminal display screen, the corresponding coordinates of the center of gravity of the target object in the projection image in the terminal display screen are calculated, As the coordinates of the cursor in the terminal display screen.
  • a second aspect of an embodiment of the present invention provides an interactive projection apparatus, including: a camera, a microprocessor, and a data light processing projector; the data light processing projector is configured to project onto a preset plane to generate The projected image; the camera is used to obtain the filtered projected image; the microprocessor is used to convert the filtered projected image into a grayscale image; the microprocessor is also used to If the grayscale image contains a target object, the pixel points in the grayscale image whose grayscale value is not greater than the first preset grayscale threshold are regarded as non-target pixel points; the microprocessor is also used to count all An average value of the gray values of the non-target pixels, and according to a preset mapping relationship, the mapped value of the average value is used as a second gray threshold; the microprocessor is also used to If the shape of the area covered by a plurality of pixels with a gray value not less than the second gray threshold is a preset shape, then the area is used as the target object; the microprocessor is also
  • a third aspect of the embodiments of the present invention provides an education system, which includes: a light source, a terminal device, a server, and an interactive projection device; the light source is used to transmit onto a projection image generated by the interactive projection device Light rays to form a light spot of a preset shape on the projected image; the interactive projection device is used to project onto a preset plane to generate a projected image; and obtain the filtered projected image and filter the projected image
  • the projected image after the light is converted into a grayscale image; if the grayscale image contains the target object, the pixel points in the grayscale image whose grayscale value is not greater than the first preset grayscale threshold are used as non-target pixel points Count the average value of the gray values of all the non-target pixels, and use the mapped value of the average value as the second gray threshold according to the preset mapping relationship; if there are multiple grays in the gray image If the shape of the area covered by the pixels whose degree value is not less than the second gray threshold is a preset shape, then
  • the embodiment of the present invention has the following beneficial effects: after the user irradiates the projection image with light, the filtered projection image is obtained, and the projection image is converted into a grayscale image;
  • the grayscale value is not greater than the average value of the grayscale values of the pixels of the first preset grayscale threshold, and the mapped value of the average value is used as the second grayscale threshold; if multiple grayscale values in the grayscale image are not less than the first
  • the shape of the area covered by the pixels of the two gray thresholds is a preset shape, and the area is used as the target object; according to the coordinate mapping relationship between the preset projection image and the terminal display screen, the center of gravity coordinates of the target object in the projection image are calculated
  • the corresponding coordinates in the terminal display screen are used as the coordinates of the cursor in the terminal display screen, so as to determine the position of the cursor on the terminal display screen according to the position of the target object irradiated by the user on the projected image on the projected image to complete the feedback to the user
  • FIG. 1 is an implementation flowchart of a cursor positioning method according to Embodiment 1 of the present invention
  • Embodiment 2 is a schematic block diagram of an interactive projection device provided by Embodiment 2 of the present invention.
  • Embodiment 3 is a schematic diagram of a system architecture of an education system provided in Embodiment 3 of the present invention.
  • FIG. 1 shows an implementation process of a cursor positioning method provided by an embodiment of the present invention. Details are as follows:
  • a filtered projection image is acquired, and the projection image is converted into a grayscale image.
  • an interactive projection device first projects onto a plane to generate a projected image, thereby displaying teaching content to student users.
  • Student users can emit strong light, laser or infrared light to the projected image through a light-emitting source to form a bright spot on the projected image.
  • the final purpose is to determine the position of the cursor in the terminal display screen according to the position of the bright spot on the projected image, so as to provide prerequisites for subsequent user feedback operations such as clicking and selecting.
  • the movement trajectory of a bright spot on the projected image will naturally correspond to a written handwriting, so positioning the cursor according to the position of the bright spot on the projected image will also in a certain processing mode, with the continuous movement of the bright spot, in The corresponding text is displayed on the terminal display.
  • positioning the cursor on the terminal screen is a prerequisite for implementing data feedback for student users.
  • the embodiments of the present invention mainly introduce a method of positioning the cursor.
  • the projection image formed on the plane is captured by the filter-equipped camera.
  • the filter in order to highlight this bright spot and avoid the interference of other light, a large amount of visible light needs to be filtered through the filter.
  • the filtered image obtained by filtering the light is converted into a grayscale image, most pixels correspond to a completely black color, and some pixels correspond to a darker color, among which A few pixels correspond to relatively bright colors.
  • These relatively bright pixels are the bright spots generated by the user illuminating the projected image through the light source.
  • the bright spots are covered on the grayscale image The target area needs to be detected. Understandably, the gray value of the target object is higher.
  • the area covered on the grayscale image by the bright spot generated by the user illuminating the projected image through the interactive pen is the target object that needs to be detected. Understandably, the grayscale value of the target object is relatively high.
  • the embodiment of the present invention only roughly judges by a fixed first gray threshold Whether the gray image contains the target object, and further for the specific situation of the gray image, dynamically determine a second gray threshold, and locate the specific position information of the target object based on the dynamically determined second gray threshold.
  • the embodiment of the present invention detects whether there is a pixel with a gray value greater than the first preset gray threshold in the gray image; if there is a gray value greater than the first in the gray image Pixels with a preset grayscale threshold are determined to contain a target object in the grayscale image, and if there are pixels with grayscale values not greater than the first preset grayscale threshold in the grayscale image, The grayscale image does not contain the target object.
  • the fixed first gray threshold selected here is not very high, just make a rough sketch about whether it contains the target object In order to avoid the subsequent unnecessary calculation process for the projection image without user illumination.
  • the grayscale image does not contain the target object, then return to the step of acquiring the filtered projection image and converting the projection image into a grayscale image.
  • the average value of the gray values of all the non-target pixels is counted, and the mapped value of the average value is used as the second gray threshold according to a preset mapping relationship.
  • the average value of the gray values of all non-target pixels in the current gray image can well reflect the intensity of light emitted by different filters, different interactive pens, and the interference of light in different environments, etc.
  • the area is used as the target object.
  • the pen tip of the interactive pen can be specially designed through the material of the catheter and the structure, so that the light emitted by the interactive pen forms a bright spot with a special shape on the projected image, for example, a bright spot with a cross shape.
  • this step it is only necessary to determine whether the shape of the area covered by a plurality of pixels adjacent to the batch whose gray value is not less than the second gray threshold is a preset shape, and it can be determined whether the area is The area where the target object is located.
  • the corresponding coordinates of the center of gravity of the target object in the grayscale image in the terminal display screen are calculated as the terminal display screen
  • the target object will cover multiple pixels in the grayscale image.
  • the embodiment of the present invention selects the coordinates of the center of gravity of the target object to represent the target object in the grayscale The position in the image.
  • a three-point correction algorithm may be used to calculate the coordinates of the center of gravity of the target object in the projected image in the terminal display screen.
  • the filtered projection image is obtained, and the projection image is converted into a grayscale image; the grayscale value of pixels in the grayscale image whose grayscale value is not greater than the first preset grayscale threshold The average value of the average value, and use the mapped value of the average value as the second gray threshold; if the shape of the area covered by the pixels with gray values not less than the second gray threshold in the gray image is the preset shape, then Use this area as the target object; according to the coordinate mapping relationship between the preset projection image and the terminal display screen, calculate the corresponding coordinates of the center of gravity of the target object in the projection image on the terminal display screen, as the coordinates of the cursor in the terminal display screen, thus According to the position of the target object irradiated by the user on the projected image on the projected image, the position of the cursor on the display screen of the terminal is determined to complete the reception and analysis of the data fed back by the user.
  • FIG. 2 shows a schematic block diagram of an interactive projection device. For ease of description, only parts related to the embodiment of the present invention are shown.
  • the device includes a data light processing projector 201, an optical machine drive board 202, a WiFi module 203, a microprocessor 204, and a camera 206.
  • the data light processing projector 201 is used to project onto a preset plane to generate a projection image
  • the camera 203 is used to obtain the filtered projection image
  • the microprocessor 204 is configured to convert the filtered projection image into a grayscale image
  • the microprocessor 204 is further configured to, if the grayscale image contains a target object, use pixel points in the grayscale image whose grayscale value is not greater than a preset first grayscale threshold as non-target pixel points ;
  • the microprocessor 204 is further configured to count the average value of the gray values of all the non-target pixels, and use the mapped value of the average value as the second gray threshold according to a preset mapping relationship;
  • the microprocessor 204 is further configured to: if the shape of the area covered by a plurality of pixels in the grayscale image whose grayscale value is not less than the second grayscale threshold is a preset shape, then Area as the target object;
  • the microprocessor 204 is also used to calculate the corresponding coordinates of the center of gravity of the target object in the projected image in the terminal display screen according to the preset mapping relationship between the projected image and the terminal display screen, as Coordinates of the cursor in the terminal display screen.
  • microprocessor is also used for:
  • the grayscale image contains a target object.
  • the calculating the corresponding coordinates of the center of gravity coordinates of the target object in the grayscale image in the terminal display screen according to the coordinate mapping relationship between the preset grayscale image and the terminal display screen includes:
  • a three-point calibration algorithm is used to calculate the corresponding coordinates of the center of gravity of the target object in the grayscale image in the terminal display screen according to the coordinate mapping relationship between the preset grayscale image and the terminal display screen.
  • the optical machine driving board is used to receive the projection data of the microprocessor and control the data light processing projector to project onto a preset plane.
  • the WiFi module is used to enable the interactive projection device and the server to complete data interaction.
  • the camera includes an infrared light lens, a visible light lens, a light sensing device, and a signal processing module.
  • the infrared light lens is used to obtain infrared light
  • the visible light lens is used to obtain visible light
  • the light sensing device is used to image the obtained light
  • the signal processing module is used to process the imaging of the light sensing device and send it to the microprocessor .
  • the filtered projection image is obtained, and the projection image is converted into a grayscale image; the pixels in the grayscale image whose grayscale value is not greater than the preset first grayscale threshold The average value of the gray value of the gray value, and the mapped value of the average value is used as the second gray threshold; if the shape of the area covered by the pixels with gray values not less than the second gray threshold in the gray image is the pre- The shape is set as the target object; according to the preset mapping relationship between the projected image and the terminal display screen, the coordinates of the center of gravity of the target object in the projected image in the terminal display screen are calculated as the terminal display screen The coordinates of the cursor, so as to determine the position of the cursor on the display screen of the terminal according to the position of the target object irradiated by the user on the projected image, so as to complete the reception and analysis of the data fed back by the user.
  • the system includes a light source, an interactive projection device 32, a support structure 33, a server 34, and a user terminal 35.
  • the light emitting source 31 may be an interactive pen, including a dry battery 311, a contact switch structure 312, and an infrared diode 313.
  • the interactive projection device 32 includes a main control module 321, a projection module 322, a WIFI module 323, an audio acquisition module 324, an audio playback module 325, a storage module 326, a first image acquisition module 327, a second image acquisition module 328, and a power management module 329 .
  • the projection module 322 includes a data light processing projector 3221 and an optical machine drive board 3222.
  • the audio collection module 324 includes a signal processing circuit 3241 and a microphone 3242.
  • the audio playback module 325 includes an audio amplification circuit 3251 and a speaker 3252.
  • the first image acquisition module 327 includes an infrared light lens 3271, a first light sensing device 3272, and a first signal processing unit 3273.
  • the second image acquisition module 328 includes a visible light lens 3281, a second light sensing device 3282, and a second signal processing unit 3283.
  • the power management module 329 includes a rechargeable battery 3291, a charging circuit 3292, and a voltage conversion circuit 3293.
  • the light-emitting source is configured to emit light onto the projection image generated by the interactive projection device to form light of a preset shape on the projection image;
  • the interactive projection device is configured to project onto a preset plane to generate a projection image; and obtain a filtered projection image, and convert the filtered projection image into a grayscale image; If the grayscale image contains a target object, the pixel points in the grayscale image whose grayscale value is not greater than the first preset grayscale threshold are taken as non-target pixel points; the grayscale values of all the non-target pixel points are counted The average value of, and the mapping value of the average value is used as the second gray threshold according to the preset mapping relationship; if multiple gray values in the gray image are not less than the pixels of the second gray threshold If the shape of the area covered by the dot is a preset shape, the area is used as the target object; according to the coordinate mapping relationship between the preset projection image and the terminal display screen, the target object in the filtered projection image is calculated The coordinates of a pixel in the corresponding coordinates in the terminal display screen are used as the coordinates of the cursor in the terminal display screen, and the coordinates of the
  • the server is configured to send the coordinates of the cursor to the terminal device
  • the terminal device is configured to receive the coordinates of the cursor and display the cursor on the display screen of the terminal according to the coordinates of the cursor.
  • the server is further configured to send instructional data to the interactive projection device, so that the interactive projection device generates a projection image corresponding to the instructional data after projecting onto a preset plane.
  • the terminal device is also used to complete data interaction with other terminal devices through the server.
  • the light-emitting source is also used to: after receiving the user's pressing on the preset position on the light-emitting source, light up the infrared diode in the light-emitting source to project the image generated by the interactive projection device Infrared rays are emitted.
  • the main control module includes but is not limited to a microprocessor and other supporting circuits.
  • the microprocessor can specifically adopt an ARM chip, and can support I2C, UART, USB and other interface communications.
  • the above-mentioned projection module may include, but is not limited to, an optomechanical component and an optomechanical driving board.
  • the optomechanical component is connected to the microprocessor through the optomechanical driving board.
  • the optomechanical component may be a data light processing projector or other types of optomechanical components.
  • the optomechanical component is also connected with a heat sink and other corresponding structures to achieve the fixation and installation of the optomechanical component.
  • the above-mentioned first image acquisition module is used to acquire the light spot position information of the interactive pen on the projection plane.
  • the first image acquisition module may include an infrared light lens, a light sensing device and a signal processing unit.
  • the infrared light lens performs image detection on a specific field of infrared light, and then the main control module passes the camera field of view and projection view The calibration of the field obtains the relative relationship, thereby calculating the position of the light spot on the projection plane.
  • the above communication module may be specifically a wired communication module or a wireless communication module, and the wireless communication module may be specifically a WIFI module, a Bluetooth module, a Zigbee module, or the like.
  • the shape of the light-emitting source may be a pen, and the interactive pen may include an infrared diode, a dry battery, a switch circuit, and the like.
  • the light source in the interactive pen may also be LED or laser.
  • Student users can use the interactive pen to write on the projection plane. In the writing process, in fact, a bright spot will be formed in the projected image at every moment. Continuous detection by the cursor positioning method described in the first embodiment can naturally be based on The trajectory generated by the student user on the projected image and the writing trajectory generated on the display screen of the user terminal.
  • the interaction process between the light source and the interactive projection device can be specifically as follows: the interactive projection device projects courseware, homework questions and other teaching content onto the projection plane. Student users use the interactive pen to write on the projection plane. Specifically, when the tip of the interactive pen is When the projection plane touches, the infrared light source in the interactive pen is triggered to emit light, leaving a corresponding light spot on the projection plane. When the pen tip is not in contact with the projection plane, the light source in the interactive pen does not emit light.
  • the first image acquisition module in the interactive projection device will capture the image of the projection plane to obtain the writing
  • the image of the trajectory includes a light spot
  • the main control module recognizes the image to obtain the coordinates of each light spot under the coordinate system of the projection plane area, and forms a writing trajectory according to the light spot coordinates and frame timing of each frame of image, Then form a figure, line or text according to the writing trajectory, and finally project the figure, line or text to the corresponding position on the projection plane.
  • the displayed trajectory can be basically the same as the handwriting speed, so that student users can write and interact on the projection plane through the interactive pen.
  • the server is in communication connection with the interactive projection device and is used to manage the interactive projection device and store teaching content information and student work information. Management of interactive projection device information and management of education-related courseware, question bank and other teaching content through the server.
  • Each interactive projection device can represent a user, and the user's information is stored on the server.
  • the server also stores student homework information, including homework to be completed, homework completed, homework that has been revised, and homework to be reviewed and revised. Of course, historical job information is also stored on the server.
  • the teaching contents such as question bank, courseware, homework, etc. are stored on the server, which is convenient for teachers to arrange homework, online tutoring and online correction of homework.
  • the teacher user terminal is in communication with the server to implement the teacher user's review and correction of student work.
  • the teacher user terminal may be a terminal such as a mobile phone, a tablet computer, or a computer, and corresponding management software runs on the terminal. Through the teacher user's terminal, the teacher user can perform teaching-related work, such as assignment assignment, courseware projection, assignment correction, online tutoring, etc.
  • the system can also automatically complete some or all of the corrections. That is, after the students submit the assignments, the server can automatically correct the corresponding topics that need to be automatically corrected according to the previous correction settings. After the correction, in order to ensure accuracy, the teacher user can perform supplementary correction through the teacher user terminal to finally complete the correction.
  • the teaching content is projected onto the projection plane through the interactive projection device, and the student user can use the interactive pen to write on the projection plane, that is, the interactive pen can act as a pen that can be written on the projection plane, so that the student user can use
  • Interactive pens are used for homework, and online review and correction of student homework are also realized through the server and the teacher user terminal.
  • the use of special projection equipment and interactive pens for auxiliary teaching shields the undesirable content other than learning and improves the effect of auxiliary teaching.
  • the interactive pen is provided with a switch button, through which the light emission of the internal light source can be controlled, instead of controlling the light emission of the internal light source by pressing the pen tip contact mentioned above
  • a switch button through which the light emission of the internal light source can be controlled, instead of controlling the light emission of the internal light source by pressing the pen tip contact mentioned above
  • the switch button due to the need to frequently press the switch button for the switch button mode, if the light source is not turned off when not in use, the light source of the interactive pen may illuminate the eyes of the student user, causing some damage to the eyes and also wasting the battery of the interactive pen Power.
  • pressing the tip of the pen tip is safer and more energy efficient.
  • the light source inside the interactive pen is not limited to the infrared light source mentioned above, it may also be an LED light source, a laser light source, or the like.
  • the first image acquisition module is a lens module corresponding to the light source.
  • the interactive pen can also be powered by an external power supply without a battery.
  • the above system may further include a bracket structure for supporting and fixing the interactive projection device and adjusting the projection direction of the interactive projection device.
  • Parent user terminal connected to the server.
  • the above-mentioned system may also include a parent user terminal through which the parent user can view the student's homework completion and learning status.
  • This embodiment is based on the mobile terminal and the software-assisted teaching system. Since the dedicated projection equipment and interactive pen are used for the auxiliary teaching, undesirable content other than learning is shielded, and the auxiliary teaching effect is improved.
  • the projection module may include a data light processing projector and an optical machine drive board, and the optical machine assembly is connected to the main control module through the optical machine drive board.
  • the first image acquisition module includes an infrared light lens module, a first light sensing device connected to the infrared light lens module, and a first signal processing unit connected to the first light sensing device.
  • the above-mentioned interactive projection device further includes a second image acquisition module connected to the main control module and used to acquire student work images.
  • the second image acquisition module includes a visible light lens module, a second light-sensitive device connected to the visible light lens module, and a second signal processing unit connected to the second light-sensitive device.
  • the above-mentioned interactive projection device further includes an audio playback module and an audio collection module respectively connected to the main control module.
  • the audio playback module may include an audio amplification circuit and a speaker, and the speaker is connected to the main control module through the audio amplification circuit.
  • the audio collection module may include a signal processing circuit and a microphone, and the microphone is connected to the main control module through the signal processing circuit.
  • the above-mentioned interactive projection device may further include a video display module, which is used to realize a video call between a teacher user and a student user.
  • a video display module which is used to realize a video call between a teacher user and a student user.
  • teacher users can tutor students' homework online to achieve an effect similar to on-site tutoring.
  • the second image acquisition module Through the second image acquisition module, the process of students' homework can be viewed.
  • the teacher user terminal is a computer.
  • the computer can be connected to multiple interactive projection devices through the server to enable the teacher to interact with multiple students.
  • the user's user device can obtain the student's homework image; when the teacher needs to tutor a certain student, he can conduct online tutoring through voice calls, video calls, etc. to achieve the effect of on-site tutoring.
  • the above-mentioned interactive projection device may be powered by an external power supply, or may be powered by a battery, or may include a dual power supply system.
  • the above-mentioned interactive projection device further includes a power management module connected to the main control module.
  • the power management module includes a rechargeable battery, a charging circuit connected to the rechargeable battery, and a voltage conversion circuit connected to the charging circuit.
  • the power management module can realize the power supply of each part of the interactive projection device by the battery.
  • the external input voltage is converted into the voltage required by the battery through a voltage conversion circuit.
  • the rechargeable battery may be a lithium battery.
  • the battery can be used alone to power each part of the interactive projection device, or to power the interactive projection when the external power supply fails, that is, when the external power supply is cut off or malfunctions, it automatically switches to battery power to ensure interactive projection Equipment power supply stability.
  • the above-mentioned interactive projection device further includes a storage module
  • the storage module may include corresponding storage devices such as a cache and a memory, and the storage device may store relevant teaching content delivered by the server.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Human Computer Interaction (AREA)
  • Position Input By Displaying (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

一种光标定位方法、交互投影装置及教育系统，该方法包括：获取滤光后的投影图像，并将所述投影图像转换为灰度图像（S101）；将所述灰度图像中灰度值不大于第一预设灰度阈值的像素点作为非目标像素点（S103）；统计全部所述非目标像素点的灰度值的平均值，并根据预设的映射关系，将所述平均值的映射值作为第二灰度阈值（S104）；若所述灰度图像中多个灰度值不小于所述第二灰度阈值的像素点所覆盖的区域的形状为预设的形状，则将所述区域作为目标对象（S105）；根据预设的投影图像与终端显示屏的坐标映射关系，计算所述灰度图像中所述目标对象中一像素点的坐标在所述终端显示屏中对应的坐标，作为所述终端显示屏中所述光标的坐标（S106），从而根据用户照射在投影图像上的目标对象在投影图像上的位置，确定终端显示屏上光标的位置，以完成对用户反馈的数据的接收和分析。

Description

光标定位方法、交互投影装置及教育系统 技术领域
本发明属于多媒体技术领域，尤其涉及光标定位方法、交互投影装置及教育系统。
 背景技术
随着科技的不断发展，电子产品也逐渐融入人们的学习生活中，而针对教育方面也出现了多种学习机产品。学习机是学生群体中比较普及的一种便携式学习设备。早期的学习机和电视机连接，利用电视屏幕进行输出和显示，后来逐步转向各种尺寸较小的电子设备。当前为了更好地向学生展示教学内容，有的学习机开始可以通过投影的形式向学生展示各种教学内容。
然而，先前通过固定的屏幕显示教学内容的学习机，用户可以通过学习机上的鼠标、键盘以及触摸屏接收用户反馈的数据，以实现完整的教学互动。但是通过投影的形式进行教学内容的展示时，却难以通过投影设备获取用户输入的数据，即只能通过投影向用户展示教学内容，而无法获知用户对于所展示的教学内容的点击、选择以及输入等反馈的数据，不利于教学的完整性。
 技术问题
有鉴于此，本发明实施例提供了光标定位方法、交互投影装置及教育系统，以解决现有基于投影的多媒体系统无法获取用户反馈的数据的问题。
 技术解决方案
本发明实施例的第一方面提供了一种光标定位方法，包括：获取滤光后的投影图像，并将所述投影图像转换为灰度图像；若所述灰度图像中包含目标对象，则将所述灰度图像中灰度值不大于第一预设灰度阈值的像素点作为非目标像素点；统计全部所述非目标像素点的灰度值的平均值，并根据预设的映射关系，将所述平均值的映射值作为第二灰度阈值；若所述灰度图像中多个灰度值不小于所述第二灰度阈值的像素点所覆盖的区域的形状为预设形状，则将所述区域作为目标对象；根据预设的投影图像与终端显示屏的坐标映射关系，计算所述投影图像中所述目标对象的重心坐标在所述终端显示屏中对应的坐标，作为所述终端显示屏中所述光标的坐标。
本发明实施例的第二方面提供了一种交互投影装置，包括：包括：摄像头、微处理器以及数据光处理投影机；所述数据光处理投影机，用于向预设平面进行投影，生成投影图像；所述摄像头，用于获取滤光后的投影图像；所述微处理器，用于将所述滤光后的投影图像转换为灰度图像；所述微处理器，还用于若所述灰度图像中包含目标对象，则将所述灰度图像中灰度值不大于第一预设灰度阈值的像素点作为非目标像素点；所述微处理器，还用于统计全部所述非目标像素点的灰度值的平均值，并根据预设的映射关系，将所述平均值的映射值作为第二灰度阈值；所述微处理器，还用于若所述灰度图像中多个灰度值不小于所述第二灰度阈值的像素点所覆盖的区域的形状为预设形状，则将所述区域作为目标对象；所述微处理器，还用于根据预设的投影图像与终端显示屏的坐标映射关系，计算所述投影图像中所述目标对象的重心坐标在所述终端显示屏中对应的坐标，作为所述终端显示屏中所述光标的坐标。
本发明实施例的第三方面提供了教育系统，其特征在于，包括：发光源、终端设备、服务器以及交互投影装置；所述发光源，用于向所述交互投影装置生成的投影图像上发射光线，以在所述投影图像上形成预设形状的光点；所述交互投影装置，用于向预设平面进行投影，生成投影图像；并获取滤光后的投影图像，并将所述滤光后的投影图像转换为灰度图像；若所述灰度图像中包含目标对象，则将所述灰度图像中灰度值不大于第一预设灰度阈值的像素点作为非目标像素点；统计全部所述非目标像素点的灰度值的平均值，并根据预设的映射关系，将所述平均值的映射值作为第二灰度阈值；若所述灰度图像中多个灰度值不小于所述第二灰度阈值的像素点所覆盖的区域的形状为预设形状，则将所述区域作为目标对象；根据预设的投影图像与终端显示屏的坐标映射关系，计算所述滤光后的投影图像中所述目标对象的重心坐标在所述终端显示屏中对应的坐标，作为所述终端显示屏中所述光标的坐标，并将所述光标的坐标发送至所述服务器；所述服务器，用于将所述光标的坐标发送至所述终端设备；所述终端设备，用于接收所述光标的坐标，并根据所述光标的坐标在所述终端显示屏上显示光标。
 有益效果
本发明实施例与现有技术相比存在的有益效果是：在用户通过光线向投影图像进行照射后，获取滤光后的投影图像，并将投影图像转换为灰度图像；将灰度图像中灰度值不大于第一预设灰度阈值的像素点的灰度值的平均值，并将平均值的映射值作为第二灰度阈值；若灰度图像中多个灰度值不小于第二灰度阈值的像素点所覆盖的区域的形状为预设形状，则将该区域作为目标对象；根据预设的投影图像与终端显示屏的坐标映射关系，计算投影图像中目标对象的重心坐标在终端显示屏中对应的坐标，作为终端显示屏中光标的坐标，从而根据用户照射在投影图像上的目标对象在投影图像上的位置，确定终端显示屏上光标的位置，以完成对用户反馈的数据的接收和分析。
 附图说明
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1是本发明实施例一提供的光标定位方法的实现流程图；
图2是本发明实施例二提供的交互投影装置原理框图；
图3是本发明实施例三提供的教育系统的一种系统架构示意图。
 本发明的实施方式
以下描述中，为了说明而不是为了限定，提出了诸如特定系统结构、技术之类的具体细节，以便透彻理解本发明实施例。然而，本领域的技术人员应当清楚，在没有这些具体细节的其它实施例中也可以实现本发明。在其它情况中，省略对众所周知的系统、装置、电路以及方法的详细说明，以免不必要的细节妨碍本发明的描述。
为了说明本发明所述的技术方案，下面通过具体实施例来进行说明。
实施例一
图1示出了本发明实施例提供的光标定位方法的实现流程，详述如下：
在S101中，获取滤光后的投影图像，并将所述投影图像转换为灰度图像。
在本发明实施例中，一个交互投影装置首先向一个平面进行投影，生成一个投影图像，从而向学生用户展示教学内容。学生用户可以通过一个发光源向投影图像发射强光线、激光或红外光线，以在投影图像上形成亮点。
可以理解地，在本发明实施例中最终的目的是根据该亮点在投影图像上的位置，确定出终端显示屏中光标的位置，从而为后续的用户反馈的诸如点击、选择等操作提供前提条件。此外，一个亮点在投影图像上的移动轨迹自然会对应一个书写的笔迹，所以根据亮点在投影图像上的位置对光标进行定位，也会在一定的处理模式下，随着亮点的连续移动，在终端显示屏上显示出对应的文字。
基于上述的应用场景，对终端屏幕上的光标进行定位是实现学生用户完成数据反馈的前提，本发明实施例主要对光标定位的方法进行介绍。
本发明实施例通过该有滤光片的摄像头拍摄平面上形成的投影图像，，如上文介绍的应用场景，该投影图像上可能还有一个由发光源照射形成的亮点。在本发明实施例中，
可以理解地，为了突出这个亮点，避免其他光线的干扰，因此需要通过滤光片过滤掉大量的可见光。在本发明实施例中，经过滤光后获取的投影图像在转换为灰度图像后，大部分的像素点对应的颜色是全黑的，有部分的像素点对应的颜色较暗，其中还有很少量的像素点对应的颜色相对较亮，这些相对较亮的像素点即是用户通过发光源照射投影图像所产生的亮点，在本发明实施例中，将该亮点在灰度图像上覆盖的区域作为需要被检测出的目标对象。可以理解地，目标对象的灰度值较高。
在S102中，判断所述灰度图像中是否包含目标对象。
如上文所述，用户通过交互笔照射投影图像所产生的亮点在灰度图像上覆盖的区域作为需要被检测出的目标对象，可以理解地，目标对象的灰度值相对较高。
值得注意地，虽然目标对象的灰度值相对较高，但是由于不同的滤光片、不同的交互笔发射光线的强度以及不同环境中光线的干扰等因素都会影响灰度图像上各个像素点的灰度值，所以如果简单的通过设定一个固定灰度值阈值筛选目标对象很有可能出现错选和漏选的情况，所以本发明实施例只是通过一个固定的第一灰度阈值粗略地判断灰度图像中是否含有目标对象，再进一步的针对灰度图像的具体情况，动态地确定一个第二灰度阈值，并基于这个动态确定地第二灰度阈值定位目标对象具体的位置信息。
基于上述理论，本发明实施例检测所述灰度图像中是否存在灰度值大于所述第一预设灰度阈值的像素点；若所述灰度图像中存在灰度值大于所述第一预设灰度阈值的像素点，则判定所述灰度图像中包含目标对象，若所述灰度图像中存在灰度值不大于所述第一预设灰度阈值的像素点，则判定所述灰度图像中不包含目标对象。
可以理解地，考虑到有些灰度图像中目标对象的灰度值也不是很高，所以在此选定的固定的第一灰度阈值并不很高，只是对是否含有目标对象做一个大致粗略的判断，以避免对于无用户照射的投影图像进行后续不必要的计算过程。
若所述灰度图像中不包含目标对象，则返回执行获取滤光后的投影图像，并将所述投影图像转换为灰度图像的步骤。
在S103中，若所述灰度图像中包含目标对象，则将所述灰度图像中灰度值不大于第一预设灰度阈值的像素点作为非目标像素点。
在S104中，统计全部所述非目标像素点的灰度值的平均值，并根据预设的映射关系，将所述平均值的映射值作为第二灰度阈值。
可以理解地，当前的灰度图像中所有非目标像素点的灰度值的平均值可以很好地反应受到不同的滤光片、不同的交互笔发射光线的强度以及不同环境中光线的干扰等因素影响下的灰度图像的整体情况。所以根据预设的等比映射关系，计算出的所有非目标像素点的灰度值的平均值对应的第二灰度阈值可以更加精准地筛选出目标对象所覆盖的像素点。
在S105中，若所述灰度图像中多个灰度值不小于所述第二灰度阈值的像素点所覆盖的区域的形状为预设形状，则将所述区域作为目标对象。
在本发明实施例中，考虑到太阳光可能被聚焦到投影图像或者一些含有与交互笔的光源类似的光源发射的光线可能落在投影图像上，所以灰度图像上可能存在多个区域的像素点的灰度值高于第二灰度阈值。为了解决这个问题，本发明实施例中交互笔的笔头可通过导管材料以及结构的特殊设计，使得由交互笔射出的光线在投影图像上形成有特殊形状的亮点，例如：十字状的亮点。
在本步骤中，只需要判断多个由灰度值不小于所述第二灰度阈值的批次邻接的像素点所覆盖的区域的形状是否为预设形状，就可以判断出该区域是否为目标对象所在的区域。
在S106中，根据预设的投影图像与终端显示屏的坐标映射关系，计算所述灰度图像中所述目标对象中一像素点的坐标在所述终端显示屏中对应的坐标，作为所述终端显示屏中所述光标的坐标。
优选地，根据预设的投影图像与终端显示屏的坐标映射关系，计算所述灰度图像中所述目标对象的重心坐标在所述终端显示屏中对应的坐标，作为所述终端显示屏中所述光标的坐标
可以理解地，目标对象在灰度图像中会覆盖多个像素点，为了更精准的标识目标对象在灰度图像中的位置，本发明实施例选择目标对象的重心的坐标表征目标对象在灰度图像中的位置。
可选地，在本发明实施例中，可以通过三点校正算法计算所述投影图像中所述目标对象的重心坐标在所述终端显示屏中对应的坐标。
在本发明实施例中，通过获取滤光后的投影图像，并将投影图像转换为灰度图像；将灰度图像中灰度值不大于第一预设灰度阈值的像素点的灰度值的平均值，并将平均值的映射值作为第二灰度阈值；若灰度图像中多个灰度值不小于第二灰度阈值的像素点所覆盖的区域的形状为预设形状，则将该区域作为目标对象；根据预设的投影图像与终端显示屏的坐标映射关系，计算投影图像中目标对象的重心坐标在终端显示屏中对应的坐标，作为终端显示屏中光标的坐标，从而根据用户照射在投影图像上的目标对象在投影图像上的位置，确定终端显示屏上光标的位置，以完成对用户反馈的数据的接收和分析。
实施例二
对应于上文实施例所述的光标定位方法，图2示出了一种交互投影装置原理框图，为了便于说明，仅示出了与本发明实施例相关的部分。
参照图2，该装置包括：数据光处理投影机201，光机驱动板202，WiFi模组203，微处理器204以及摄像头206。
其中，所述数据光处理投影机201，用于向预设平面进行投影，生成投影图像；
所述摄像头203，用于获取滤光后的投影图像；
所述微处理器204，用于将所述滤光后的投影图像转换为灰度图像；
所述微处理器204，还用于若所述灰度图像中包含目标对象，则将所述灰度图像中灰度值不大于预设的第一灰度阈值的像素点作为非目标像素点；
所述微处理器204，还用于统计全部所述非目标像素点的灰度值的平均值，并根据预设的映射关系，将所述平均值的映射值作为第二灰度阈值；
所述微处理器204，还用于若所述灰度图像中多个灰度值不小于所述第二灰度阈值的像素点所覆盖的区域的形状为预设的形状，则将所述区域作为目标对象；
所述微处理器204，还用于根据预设的投影图像与终端显示屏的坐标映射关系，计算所述投影图像中所述目标对象的重心坐标在所述终端显示屏中对应的坐标，作为所述终端显示屏中所述光标的坐标。
可选地，所述微处理器还用于：
在所述将所述滤光后的投影图像转换为灰度图像之后，检测所述灰度图像中是否存在灰度值大于所述预设的第一灰度阈值的像素点；
若所述灰度图像中存在灰度值大于所述预设的第一灰度阈值的像素点，则判定所述灰度图像中包含目标对象。
可选地，所述根据预设的灰度图像与终端显示屏的坐标映射关系，计算所述灰度图像中所述目标对象的重心坐标在所述终端显示屏中对应的坐标，包括：
通过三点校准算法根据预设的灰度图像与终端显示屏的坐标映射关系，计算所述灰度图像中所述目标对象的重心坐标在所述终端显示屏中对应的坐标。
可选地，所述光机驱动板用于接收微处理器的投影数据，控制所述数据光处理投影机向预设平面进行投影。
可选地，所述WiFi模组用于使所述交互投影装置与服务器完成数据交互。
可选地，所述摄像头包括红外光镜头、可见光镜头以及光感器件、信号处理模块。其中红外光镜头用于获取红外光，可见光镜头用于获取可见光，光感器件用于将获取的光线进行成像，所述信号处理模块用于对光感器件的成像进行处理并发送至微处理器。
可以理解地，在本发明实施例中，获取滤光后的投影图像，并将投影图像转换为灰度图像；将灰度图像中灰度值不大于预设的第一灰度阈值的像素点的灰度值的平均值，并将平均值的映射值作为第二灰度阈值；若灰度图像中多个灰度值不小于第二灰度阈值的像素点所覆盖的区域的形状为预设的形状，则将该区域作为目标对象；根据预设的投影图像与终端显示屏的坐标映射关系，计算投影图像中目标对象的重心坐标在终端显示屏中对应的坐标，作为终端显示屏中光标的坐标，从而根据用户照射在投影图像上的目标对象在投影图像上的位置，确定终端显示屏上光标的位置，以完成对用户反馈的数据的接收和分析。
实施例三
参见图3示出的教育系统的一种系统架构示意图，该系统包括发光源、交互投影装置32、支架结构33、服务器34以及用户终端35。
发光源31可以为交互笔，包括干电池311、触头开关结构312、红外二级管313。交互投影装置32包括主控模块321、投影模块322、WIFI模块323、音频采集模块324、音频播放模块325、存储模块326、第一图像采集模块327、第二图像采集模块328以及电源管理模块329。
投影模块322包括数据光处理投影机3221和光机驱动板3222。音频采集模块324包括信号处理电路3241和麦克风3242。音频播放模块325包括音频放大电路3251和扬声器3252。第一图像采集模块327包括红外光镜头3271、第一光感器件3272以及第一信号处理单元3273。第二图像采集模块328包括可见光镜头3281、第二光感器件3282以及第二信号处理单元3283。电源管理模块329包括可充电电池3291、充电电路3292以及电压转换电路3293。
在本发明实施例中，所述发光源，用于向所述交互投影装置生成的投影图像上发射光线，以在所述投影图像上形成预设形状的光；
可选地，所述交互投影装置，用于向预设平面进行投影，生成投影图像；并获取滤光后的投影图像，并将所述滤光后的投影图像转换为灰度图像；若所述灰度图像中包含目标对象，则将所述灰度图像中灰度值不大于第一预设灰度阈值的像素点作为非目标像素点；统计全部所述非目标像素点的灰度值的平均值，并根据预设的映射关系，将所述平均值的映射值作为第二灰度阈值；若所述灰度图像中多个灰度值不小于所述第二灰度阈值的像素点所覆盖的区域的形状为预设形状，则将所述区域作为目标对象；根据预设的投影图像与终端显示屏的坐标映射关系，计算所述滤光后的投影图像中所述目标对象中一像素点的坐标在所述终端显示屏中对应的坐标，作为所述终端显示屏中所述光标的坐标，并将所述光标的坐标发送至所述服务器；
可选地，所述服务器，用于将所述光标的坐标发送至所述终端设备；
可选地，所述终端设备，用于接收所述光标的坐标，并根据所述光标的坐标在所述终端显示屏上显示光标。
可选地，所述服务器还用于向所述交互投影装置发送教学数据，以使所述交互投影装置向预设平面进行投影后，生成与所述教学数据对应的投影图像。
可选地，所述终端设备还用于通过所述服务器与其他终端设备完成数据交互。
可选地，所述发光源还用于：在接收到用户对于发光源上预设位置的按压后，点亮所述发光源内的红外二极管，以向所述交互投影装置生成的投影图像上发射红外线。
在本发明实施例中，上述主控模块包括但不限于微处理器和其他支持电路。微处理器可以具体采用ARM芯片，可支持I2C、UART、USB等接口通信。上述投影模块可以包括但不限于光机组件和光机驱动板，光机组件通过光机驱动板与微处理器连接。该光机组件可以为数据光处理投影机，也可以为其它类型的光机组件。该光机组件还与散热片、其他相应结构连接，以实现光机组件的固定和安装。
上述第一图像采集模块用于采集交互笔在投影平面上的光点位置信息。一般情况下，该第一图像采集模块可以包括红外光镜头、光感器件和信号处理单元，通过红外光镜头对红外光特定视场进行图像检测，然后主控模块通过对摄像头视场和投影视场的标定获取相对关系，从而计算出投影平面上的光点位置。上述通信模块可以具体为有线通信模块或无线通信模块，无线通信模块可以具体为WIFI模块、蓝牙模块、Zigbee模块等。
上述发光源的形状可以外现为笔，该交互笔可以包括红外二极管、干电池、开关电路等。当然，该交互笔内的光源还可以为LED或激光。学生用户可以使用该交互笔在投影平面上进行书写，在书写过程中，实际上每一时刻在投影图像中会形成一个亮点，通过实施例一所述的光标定位方法进行连续检测，自然可以根据学生用户在投影图像上的生成轨迹，生成在用户终端显示屏上的书写轨迹。
发光源和交互投影装置的交互过程可以具体为：交互投影装置将课件、作业题等教学内容投影至投影平面，学生用户使用交互笔在投影平面上进行书写，具体地，当交互笔的笔尖与投影平面接触时，则触发交互笔内的红外光源发光，在投影平面上留下相应的光点，笔尖与投影平面不接触时，交互笔内的光源不发光。学生用户使用交互笔进行连续的移动即书写时，会在投影平面上留下呈一定轨迹的多个光点；交互投影装置内的第一图像采集模块会拍摄投影平面的图像，以获得包含书写轨迹的图像，该图像内包括有光点；主控模块识别该图像，以获得各个光点在投影平面区域坐标系下的坐标，根据每一帧图像的光点坐标和帧时序形成书写轨迹，再根据书写轨迹形成图形、线条或文字，最后将该图形、线条或文字投影至投影平面的相应位置。显示的轨迹基本能和手写的速度保持一致，实现了学生用户通过交互笔在投影平面上进行书写交互。
服务器与交互投影装置通信连接，用于管理交互投影装置，存储教学内容信息和学生作业信息。通过服务器进行交互投影装置信息的管理以及教育相关的课件、题库等教学内容的管理。每一台交互投影装置可以代表一个用户，在服务器上有各用户的信息存储。该服务器上还存储有学生作业信息，包含待完成的作业、已完成的作业、已批改的作业以及待审核批改作业等。当然，服务器上也存储有历史作业信息。服务器上存储有题库、课件、作业等教学内容，方便老师布置作业，也方便老师在线辅导，在线批改作业。
教师用户终端与服务器通信连接，用于实现教师用户对学生作业的审核批改。该教师用户终端可以具体为手机、平板电脑、电脑等终端，该终端上运行有相应的管理软件。通过该教师用户的终端，教师用户可以进行教学相关工作，例如，布置作业、课件投影、作业批改、在线辅导等。
需要说明的是，为了减轻教师批改作业的负担，系统也可以自动完成一部分或全部的批改，即学生提交作业之后，服务器可以根据预先的批改设置，对需要自动批改的相应题目进行自动批改，自动批改之后，为了保证准确性，教师用户可以通过教师用户终端进行补充批改，以最终完成批改。
本实施例通过交互投影装置将教学内容投影至投影平面，学生用户可以使用交互笔在所述投影平面上进行书写，即交互笔可以充当可在投影平面上书写的笔，以使学生用户可以使用交互笔进行作业，还通过服务器和教师用户终端实现学生作业的在线审核批改。相较于基于移动终端和软件的辅助教学系统，由于使用专用的投影设备、交互笔进行辅助教学，屏蔽了学习以外的不良内容，提高了辅助教学效果。
在本发明实施例中，该交互笔设置有开关按键，通过该开关按键可以控制内部光源的发光与否，而不采用上文提及的通过按压笔尖触头的方式控制内部光源的发光与否，但由于开关按键方式需要频繁地按开关按键，假如在未使用时没有关掉光源，交互笔的光源可能会照射到学生用户的眼睛，对眼睛造成一定的危害，也会浪费交互笔的电池电量。相较之下，通过按压笔尖触头方式更加安全、节能。
该交互笔内部的光源不限于上文提及的红外光光源，其还可以为LED光源、激光光源等。当为非红外光光源时，上述第一图像采集模块为与光源对应的镜头模组。在其他一些情况下，交互笔内也可以没有电池，而是通过外加电源供电。
在一些实施例中，上述系统还可以包括还包括用于支撑和固定交互投影设备，以及调整交互投影设备的投影方向的支架结构。与服务器连接的家长用户终端。
可以理解的是，当没有上述支架结构时，可以通过人工调整投影方向，但这种方式不方便。为了提高系统的便利性和智能化，可以增加一个支架架构，以实现投影方向调整功能。
教师用户可以通过教师用户终端对学生的学习状况进行查看，为了进一步提高辅导教学效果，上述系统还可以包括家长用户终端，家长用户可以通过该终端对学生的作业完成情况、学习情况等进行查看。
本实施例基于移动终端和软件的辅助教学系统，由于使用专用的投影设备、交互笔进行辅助教学，屏蔽了学习以外的不良内容，提高了辅助教学效果。
在一些实施例中，其中，投影模块可以包括数据光处理投影机和光机驱动板，光机组件通过光机驱动板与主控模块连接。第一图像采集模块包括红外光镜头模组、与红外光镜头模组连接的第一光感器件以及与第一光感器件连接的第一信号处理单元。
为了更好地得知各个学生的情况，可以采集学生作业的图像发送至服务器，方便教师用户查看每个学生的作业情况。
可选地，上述交互投影设备还包括与主控模块连接，用于采集学生作业图像的第二图像采集模块。更具体地，该第二图像采集模块包括可见光镜头模组、与可见光镜头模组连接的第二光感器件以及与第二光感器件连接的第二信号处理单元。
为了使得教师用户可以通过语音通话辅导学生，以进一步提高辅助教学效果。可选地，上述交互投影设备还包括分别与主控模块连接的音频播放模块、音频采集模块。更具体地，音频播放模块可以包括音频放大电路和扬声器，扬声器通过音频放大电路与主控模块连接。音频采集模块可以包括信号处理电路和麦克风，麦克风通过信号处理电路与主控模块连接。
当然，上述交互投影设备还可以包括视频显示模块，用于实现教师用户和学生用户的视频通话。通过音频播放模块、音频采集模块，甚至于视频显示模块，教师用户可以在线辅导学生作业，以达到类似现场辅导的效果。通过第二图像采集模块可以查看学生写作业的过程。例如，教师用户终端为电脑端，该电脑可以通过服务器与多个交互投影设备进行连接，以实现教师与多个学生互动，当教师需要查看某一个学生是否在写作业时，则可以查看该学生用户对于的用户设备，以获取到该学生的作业图像；当教师需要辅导某一个学生时，则可以通过语音通话、视频通话等方式进行在线辅导，以达到现场辅导的效果。
上述交互投影设备可以由外部电源供电，也可以由电池供电，也可以包括双供电系统。
可选地，上述交互投影设备还包括与主控模块连接的电源管理模块，更具体地，电源管理模块包括可充电电池、与可充电电池连接的充电电路以及与充电电路连接的电压转换电路。
该电源管理模块可以实现电池对交互投影设备各部分的供电。通过电压转换电路将外部输入电压转换成电池所需要的电压。
上述可充电电池可以为锂电池。该电池可以单独用于为交互投影设备的各部分供电，也可以在外部电源出现故障时为交互投影供电，即，当外部电源被切断或故障时，则自动切换至电池供电，以保证交互投影设备的供电稳定性。
当然，上述交互投影设备还包括存储模块，该存储模块可以包括缓存、内存等相应的存储设备，该存储设备可以存储服务器下发的相关教学内容。
以上所述实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围，均应包含在本发明的保护范围之内。

Claims (10)

  1. 一种光标定位方法，其特征在于，包括：
    获取滤光后的投影图像，并将所述投影图像转换为灰度图像；
    若所述灰度图像中包含目标对象，则将所述灰度图像中灰度值不大于第一预设灰度阈值的像素点作为非目标像素点；
    统计全部所述非目标像素点的灰度值的平均值，并根据预设的映射关系，将所述平均值的映射值作为第二灰度阈值；
    若所述灰度图像中多个灰度值不小于所述第二灰度阈值的像素点所覆盖的区域的形状为预设形状，则将所述区域作为目标对象；
    根据投影图像与终端显示屏的坐标映射关系，计算所述灰度图像中所述目标对象中一像素点的坐标在所述终端显示屏中对应的坐标，作为所述终端显示屏中所述光标的坐标。
  2. 如权利要求1所述的光标定位方法，其特征在于，在所述将所述投影图像转换为灰度图像之后，还包括：
    若所述灰度图像中存在灰度值大于所述第一预设灰度阈值的像素点，则判定所述灰度图像中包含目标对象。
  3. 如权利要求1所述的光标定位方法，其特征在于，所述根据投影图像与终端显示屏的坐标映射关系，计算所述灰度图像中所述目标对象中一像素点的坐标在所述终端显示屏中对应的坐标，包括：
    通过三点校准算法根据投影图像与终端显示屏的坐标映射关系，计算所述灰度图像中所述目标对象中一像素点的坐标在所述终端显示屏中对应的坐标。
  4. 一种交互投影装置，其特征在于，包括：摄像头、微处理器以及数据光处理投影机；
    所述数据光处理投影机，用于向预设平面进行投影，生成投影图像；
    所述摄像头，用于获取滤光后的投影图像；
    所述微处理器，用于将所述滤光后的投影图像转换为灰度图像；
    所述微处理器，还用于若所述灰度图像中包含目标对象，则将所述灰度图像中灰度值不大于第一预设灰度阈值的像素点作为非目标像素点；
    所述微处理器，还用于统计全部所述非目标像素点的灰度值的平均值，并根据预设的映射关系，将所述平均值的映射值作为第二灰度阈值；
    所述微处理器，还用于若所述灰度图像中多个灰度值不小于所述第二灰度阈值的像素点所覆盖的区域的形状为预设形状，则将所述区域作为目标对象；
    所述微处理器，还用于根据预设的投影图像与终端显示屏的坐标映射关系，计算所述投影图像中所述目标对象中一像素点的坐标在所述终端显示屏中对应的坐标，作为所述终端显示屏中所述光标的坐标。
  5. 如权利要求4所述的交互投影装置，其特征在于，所述微处理器还用于：
    若所述灰度图像中存在灰度值大于所述第一预设灰度阈值的像素点，则判定所述灰度图像中包含目标对象。
  6. 如权利要求4所述的交互投影装置，其特征在于，所述根据预设的投影图像与终端显示屏的坐标映射关系，计算所述投影图像中所述目标对象的重心坐标在所述终端显示屏中对应的坐标，包括：
    通过三点校准算法根据投影图像与终端显示屏的坐标映射关系，计算所述灰度图像中所述目标对象中一像素点的坐标在所述终端显示屏中对应的坐标。
  7. 一种教育系统，其特征在于，包括：发光源、终端设备、服务器以及交互投影装置；
    所述发光源，用于向所述交互投影装置生成的投影图像上发射光线，以在所述投影图像上形成预设形状的光；
    所述交互投影装置，用于向预设平面进行投影，生成投影图像；并获取滤光后的投影图像，并将所述滤光后的投影图像转换为灰度图像；若所述灰度图像中包含目标对象，则将所述灰度图像中灰度值不大于第一预设灰度阈值的像素点作为非目标像素点；统计全部所述非目标像素点的灰度值的平均值，并根据预设的映射关系，将所述平均值的映射值作为第二灰度阈值；若所述灰度图像中多个灰度值不小于所述第二灰度阈值的像素点所覆盖的区域的形状为预设形状，则将所述区域作为目标对象；根据预设的投影图像与终端显示屏的坐标映射关系，计算所述滤光后的投影图像中所述目标对象中一像素点的坐标在所述终端显示屏中对应的坐标，作为所述终端显示屏中所述光标的坐标，并将所述光标的坐标发送至所述服务器；
    所述服务器，用于将所述光标的坐标发送至所述终端设备；
    所述终端设备，用于接收所述光标的坐标，并根据所述光标的坐标在所述终端显示屏上显示光标。
  8. 权利要求7所述的教育系统，其特征在于，所述服务器还用于向所述交互投影装置发送教学数据，以使所述交互投影装置向预设平面进行投影后，生成与所述教学数据对应的投影图像。
  9. 如权利要求7所述的教育系统，其特征在于，所述终端设备还用于通过所述服务器与其他终端设备完成数据交互。
  10. 如权利要求7所述的教育系统，其特征在于，所述发光源还用于：在接收到用户对于发光源上预设位置的按压后，点亮所述发光源内的红外二极管，以向所述交互投影装置生成的投影图像上发射红外线。
PCT/CN2019/124361 2018-12-17 2019-12-10 光标定位方法、交互投影装置及教育系统 Ceased WO2020125501A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811543570.X 2018-12-17
CN201811543570.XA CN109814770B (zh) 2018-12-17 2018-12-17 光标定位方法、交互投影装置及教育系统

Publications (1)

Publication Number Publication Date
WO2020125501A1 true WO2020125501A1 (zh) 2020-06-25

Family

ID=66602065

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/124361 Ceased WO2020125501A1 (zh) 2018-12-17 2019-12-10 光标定位方法、交互投影装置及教育系统

Country Status (2)

Country Link
CN (1) CN109814770B (zh)
WO (1) WO2020125501A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109814770B (zh) * 2018-12-17 2020-11-03 中国科学院深圳先进技术研究院 光标定位方法、交互投影装置及教育系统
CN110365958A (zh) * 2019-08-05 2019-10-22 薄涛 投影互动方法、服务器、教学系统和存储介质
CN110458909A (zh) * 2019-08-05 2019-11-15 薄涛 处理投影图像的方法、服务器、教学系统和介质
CN116110048A (zh) * 2021-11-08 2023-05-12 广东小天才科技有限公司 一种光标生成方法、光标生成装置及扫描笔

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102622108A (zh) * 2012-01-18 2012-08-01 深圳市中科睿成智能科技有限公司 一种交互式投影系统及其实现方法
US20130044146A1 (en) * 2007-04-24 2013-02-21 Yoshiki Kurokawa Display device, display driver and image display method
CN102945091A (zh) * 2012-11-20 2013-02-27 深圳市中科睿成智能科技有限公司 一种基于激光投影定位的人机交互方法与系统
CN106911921A (zh) * 2017-05-12 2017-06-30 安徽大学 基于单个摄像机的投影仪红外触控和自动对焦方法
CN108288276A (zh) * 2017-12-29 2018-07-17 安徽慧视金瞳科技有限公司 一种投影交互系统中触摸模式下的干扰滤除方法
CN109814770A (zh) * 2018-12-17 2019-05-28 中国科学院深圳先进技术研究院 光标定位方法、交互投影装置及教育系统

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101840062A (zh) * 2009-08-21 2010-09-22 深圳先进技术研究院 交互式投影系统及交互方法
CN107132987A (zh) * 2017-06-05 2017-09-05 京东方科技集团股份有限公司 投影屏幕、图像合成装置和投影系统
CN107682595B (zh) * 2017-08-14 2019-12-13 中国科学院深圳先进技术研究院 一种交互投影方法、系统及计算机可读存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130044146A1 (en) * 2007-04-24 2013-02-21 Yoshiki Kurokawa Display device, display driver and image display method
CN102622108A (zh) * 2012-01-18 2012-08-01 深圳市中科睿成智能科技有限公司 一种交互式投影系统及其实现方法
CN102945091A (zh) * 2012-11-20 2013-02-27 深圳市中科睿成智能科技有限公司 一种基于激光投影定位的人机交互方法与系统
CN106911921A (zh) * 2017-05-12 2017-06-30 安徽大学 基于单个摄像机的投影仪红外触控和自动对焦方法
CN108288276A (zh) * 2017-12-29 2018-07-17 安徽慧视金瞳科技有限公司 一种投影交互系统中触摸模式下的干扰滤除方法
CN109814770A (zh) * 2018-12-17 2019-05-28 中国科学院深圳先进技术研究院 光标定位方法、交互投影装置及教育系统

Also Published As

Publication number Publication date
CN109814770B (zh) 2020-11-03
CN109814770A (zh) 2019-05-28

Similar Documents

Publication Publication Date Title
WO2020125501A1 (zh) 光标定位方法、交互投影装置及教育系统
CN105361429B (zh) 基于多通道交互的智能学习平台及其交互方法
CN102707817B (zh) 激光书写系统
US9148573B2 (en) Non-uniform correction illumination pattern
US20110102599A1 (en) Mobile terminal including projector and control method thereof
US8827461B2 (en) Image generation device, projector, and image generation method
CN105094386A (zh) 手写输入输出系统、手写输入薄板、信息输入系统、信息输入辅助薄板
CN102945091B (zh) 一种基于激光投影定位的人机交互方法与系统
CN106843530A (zh) 光学信号输出、处理装置、方法及系统以及成像装置
CN104965625B (zh) 一种可视化教学展示系统
CN209591141U (zh) 一种辅助教学系统
CN103680225A (zh) 教学一体机及其多输入显示方法
CN112631445A (zh) 触控显示系统、触控显示方法、触控笔及介质
CN102193687A (zh) 基于labview的多点触控屏交互系统
US20130084555A1 (en) Information providing system
CN112506398B (zh) 图文显示方法及用于其的装置、计算机可读介质
CN104866120B (zh) 可穿戴智能指环多媒体投影系统
US20130084553A1 (en) Information providing system
CN202976036U (zh) 集触摸与光电笔书写的多点互动影像装置
JP2017117434A (ja) 座標検出システム、座標検出方法、画像処理装置、及びプログラム
JP2020144413A (ja) 表示方法および表示装置
CN103996315A (zh) 一种新型的无线多媒体互动教学系统的系统安全设置方法
CN201903865U (zh) 一种交互式投影仪
KR20180113066A (ko) 스마트 칠판 시스템 및 상기 스마트 칠판 시스템을 이용한 스마트 필기 방법
CN204759365U (zh) 可穿戴智能指环多媒体投影系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19898782

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19898782

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 10.11.2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19898782

Country of ref document: EP

Kind code of ref document: A1