TW202016904A - Object teaching projection system and method thereof - Google Patents

Abstract

The invention provides an object teaching projection system and method thereof. The object teaching projection system comprises an object projection remote control device and at least one computer device. The object projection remote control device comprises a touch display interface and an object projection control program having a splitting screen operating element. The computer device comprises a display unit. When the splitting screen operating element is clicked, the object projection control program enters a splitting screen mode, generates a splitting screen command, and transmits the splitting screen command to the computer device. Thus, the object projection remote control device and the computer device splits out a plurality of image frames from a frame displayed on the touch display interface and the display unit according to the splitting screen command, and sequentially projects each of object images to the corresponding image frame according to the captured time of each object image.

Description

Physical teaching projection system and method

The present invention relates to a projection system and method, in particular to a system and method for projecting objects to be taught.

In the traditional teaching method, teachers often use chalk or whiteboard pen to write teaching content on the blackboard or whiteboard. However, the dust of chalk or the chemical odor emitted by the whiteboard pen is easy to cause harm to human health. Therefore, many teachers have changed the way to present the teaching content by projection.

To use the projection method for teaching, the teaching content to be projected must be stored in the computer device. Then, using a projector to project the teaching content stored in the computer device on a screen or a projection area of a wall, the teacher can then teach the projected content.

In the past, the teaching method of projection was used, and the teaching content was standard and must be pre-stored in the computer device. Such teaching methods are not flexible and lively enough, and the pre-existing teaching content may not be sufficient to allow students to effectively understand clearly. Therefore, it is often necessary to cooperate with a real physical or physical operation to help explain.

In view of this, in order to improve the quality of teaching, the present invention provides a mechanism for projecting the actual objects that are intended to be taught, which can be further added to the original teaching content, so that students can easily understand the actual teaching content, so that students can easily understand the actual teaching content. The effect will be the purpose of the present invention.

An object of the present invention is to provide a physical teaching projection system and method, in which the speaker assists teaching by means of physical projection, and divides the projected picture into a plurality of image frames so that multiple physical images can be projected simultaneously To improve the listener's understanding of the recognition of physical objects or the operation of physical objects, in addition, it also provides the function of a brush to draw lines or notes on the physical image, so as to supplement some of the teaching content of the physical objects, so add the physical objects to the original teaching The projection makes it easier for listeners to understand the actual teaching content to enhance the effectiveness of learning.

In order to achieve the above object, the present invention provides a physical teaching projection system, including: a physical projection remote control device, including: an image capturing unit that performs multiple image captures on at least one physical object to generate multiple physical images A first data storage unit, which stores a physical projection control program and multiple physical images; a touch display interface, the physical projection control program is displayed on the touch display interface; and an image processor, image processor Connected to the image capture unit, the first data storage unit and the touch-sensitive display interface; and at least one computer device, the communication connection to the physical projection remote control device, including: a second data storage unit, the physical camera device sequentially transmits each physical image To the computer device, the computer device uses the second data storage unit to store each physical image; at least one display unit for projecting at least one physical image; and a control module connected to the second data storage unit and the display unit, wherein the physical projection control The program includes a plurality of operating elements. The operating elements are displayed on the touch display interface. When each operating element is clicked or operated, a corresponding command will be generated and sent to the computer device. The control module of the computer device The instruction of a command to perform a related projection control action on the physical image; wherein the operating element of the physical projection control program includes a split screen operating element, when the split screen operating element is clicked, the physical projection control program enters a split screen mode, Generate a split screen command, send the split screen command to the computer device, the image processor and the control module cut out multiple image frames in the touch display interface and the display unit screen according to the split screen command, and according to each physical image The captured time sequentially projects each physical image in the corresponding image frame.

In an embodiment of the invention, one of the image frames is projected with real-time captured real images, and the other image frames are respectively projected with previously captured real images.

In an embodiment of the present invention, the control module of the computer device is provided with a plurality of hot keys, each command is matched with a corresponding hot key, and when the computer device receives the command, the hot key matched by the command is activated to start The hotkey of will perform the related projection manipulation on the physical image.

In an embodiment of the invention, each hot key represents a single keyboard key or a combination of multiple keyboard keys.

In an embodiment of the invention, when one of the image frames of the touch-sensitive display interface is clicked, the control module of the computer device controls the corresponding image frame projected on the display unit to perform high-brightness display.

In an embodiment of the present invention, when one of the image frames of the touch-sensitive display interface is clicked, the control module of the computer device controls the real image projected on the corresponding image frame projected on the display unit to be enlarged and projected to the entire display unit Screen.

In an embodiment of the invention, the physical projection control program includes at least one image replacement operation element, and the operation of the image replacement operation element is used to replace the actual image projected in the image frame.

In an embodiment of the present invention, the physical projection control program includes a pen operation element. When the pen operation element is clicked, the physical projection control program provides the function of a pen. The pen is used to project objects in one of the image frames. Perform line drawing or annotation on the image content of the image.

In an embodiment of the present invention, the physical image in which the line drawing or annotation is completed will be stored in the first data storage unit of the physical imaging device and the second data storage unit of the computer device.

In an embodiment of the present invention, the physical projection control program includes an eraser operation element. When the eraser operation component is clicked, the physical projection control program provides an eraser function. The eraser is used to select one of the image frames. Delete the line or annotation on the projected real image.

In an embodiment of the invention, the display unit is a projection device connected to a computer device.

The invention also provides a physical teaching projection method, which is applied to a physical teaching projection system. The physical teaching projection system includes a physical projection remote control device and a computer device. The physical projection remote control device includes an image processor and a touch Display interface and an image capture unit, and the computer device includes a control module and at least one display unit. The steps of the physical teaching projection method include: multiple image captures of at least one physical object through the image capture unit Generate multiple physical images; send each physical image to the computer device in sequence; display a physical projection control program on the touch-sensitive display interface; Send the split screen command to the computer device; make the image processor and control module cut out multiple image frames in the screen of the touch display interface and the display unit according to the split screen command; and make the image processor and control module according to The time when each physical image is captured sequentially projects each physical image in the corresponding image frame.

In an embodiment of the present invention, the method further includes the following steps: clicking on one of the image frames of the touch-sensitive display interface to generate a high-brightness mark instruction; and controlling the projection corresponding to the high-brightness mark instruction on the display unit High-brightness display is performed on the physical image in the image frame.

In an embodiment of the invention, the method further includes the following steps: clicking one of the image frames of the touch-sensitive display interface to generate an image enlargement instruction; and controlling the image frame corresponding to the projection on the display unit according to the instruction of the image enlargement instruction The physical image of is enlarged to the entire screen of the display unit.

In an embodiment of the present invention, it further includes a step of performing a line drawing or annotation operation on the image content of the physical image projected on the display unit by clicking a pen operation element of the physical projection control program.

In an embodiment of the present invention, it further includes a step of deleting the line or annotation on the image content of the physical image by clicking an eraser operation element of the physical projection control program.

Please refer to FIG. 1, which is a system architecture diagram of an embodiment of the physical teaching projection system of the present invention. As shown in FIG. 1, the physical teaching projection system 100 of the present invention includes a physical projection remote control device 10 and a computer device 30. The physical projection remote control device 10 communicates with the computer device 30 in a wireless manner. In an embodiment of the present invention, the physical projection remote control device 10 and the computer device 30 use a network connection to establish a communication connection and transmit information through a wireless communication module. The wireless communication module is a Bluetooth communication module, an infrared communication module or other short-distance communication module. In the present invention, the computer device 30 is used to project a physical image, and the physical projection remote control device 10 controls the physical image projected by the computer device 30 in a remote control manner.

The physical projection remote control device 10 is a portable mobile vehicle, such as a smart phone or tablet computer, which includes an image processor 11, a first data storage unit 13, and a touch-sensitive display interface 15 And an image capture unit 17. The image processor 11 is connected to the first data storage unit 13, the touch display interface 15 and the image capturing unit 17. The physical projection remote control device 10 uses the image capturing unit 17 to perform multiple image captures on at least one physical object 20 to generate multiple physical images 111, 112, 113, 119, and convert the physical images 111, 112, 113, 119 is stored in the first data storage unit 13 and transmits physical images 111, 112, 113, 119 to the computer device 30. Furthermore, the first data storage unit 13 stores a physical projection control program 12. The physical projection control program 12 is an application program (APP) for a mobile phone or a tablet, which can be displayed on the touch display interface 15 and includes a plurality of operating elements 121. Each operation element 121 represents a manipulation action to be executed, and a corresponding command 123 will be generated when clicked. When the user wants to perform a specific control on the physical images 111, 112, 113 and/or 119 projected by the computer device 10, they can click on the corresponding operating element 121, and the physical projection control program 12 will issue a The specific instruction 123 is to the computer device 30. After receiving the specific command 123, the computer device 30 can perform corresponding control actions on the projected physical images 111, 112, 113, and/or 119 according to the instructions of the specific command 123, so that remote control is used for control The projected physical images 111, 112, 113 and/or 119.

In addition, the computer device 30 includes a control module 31, a second data storage unit 33, and a display unit 35. The control module 31 is connected to the second data storage unit 33 and the display unit 35. The second data storage unit 33 is used to store the physical images 111, 112, 113, 119 transmitted by the physical projection remote control device 10, and the display unit 35 is used to project the physical images 111, 112, 113, and/or 119. In an embodiment of the present invention, the control module 31 has a firmware built-in, and the control module 31 determines the command 123 issued by the physical projection remote control device 10 in a firmware manner, according to the instruction 123 to the display unit 35 The projected physical images 111, 112, 113, and/or 119 perform corresponding manipulation operations. Or, in another embodiment of the present invention, the control module 31 is a stylized program module, and the control module 31 judges the command 123 issued by the physical projection remote control device 10 in a software manner according to the instruction of the command 123 A corresponding manipulation action is performed on the physical objects 111, 112, 113, and/or 119 projected by the display unit 35. Or in another embodiment of the present invention, the control module 31 is provided with a plurality of hot keys 32, each command 123 is matched with a corresponding hot key 32, when the computer device 30 receives the physical projection remote control device 10 When the command 123 is activated, the control module 31 activates the matching hotkey 32, and the activated hotkey 32 will perform corresponding manipulation operations on the projected physical images 111, 112, 113, and/or 119. Each hot key 32 of the present invention represents a single keyboard key or a combination of multiple keyboard keys, for example: ctrl+1, shift+R, and so on.

When the physical teaching projection system 100 of the present invention performs the manipulation of the physical images 111, 112, 113 and/or 119, the physical images 111, 112, 113 and/or 119 and the operating element 121 of the physical projection control program 12 are simultaneously presented in the physical projection The touch display interface 15 of the remote control device 10 and the display unit 35 of the computer device 30, and the image processor 11 of the physical projection remote control device 10 will also perform relative operations on the instructions 123. Then, when the user uses the physical projection control program 12 to operate the physical images 111, 112, 113, and/or 119 presented on the touch-sensitive display interface 15, synchronization is achieved for the physical objects projected on the display unit 35 of the computer device 30 Manipulation of images 111, 112, 113 and/or 119. Furthermore, the display unit 35 of the computer device 30 is a large-size display screen electrically connected to the computer device 30, or one or more small-size display screens electrically connected to the computer device 30, or A projection device connected to a computer device 30 projects the physical images 111, 112, 113, and/or 119 onto a projection area. In the present invention, a large-size display screen, a small-size display screen, or a projection area can be used to project the physical images 111, 112, 113, and/or 119.

Next, the physical teaching projection system 100 of the present invention controls a projected physical image 111, 112, 113, and/or 119 in a specific manner as follows: First, further refer to FIG. 2 for the touch display interface of the present invention 15 and a schematic diagram of a split screen according to an embodiment of the display unit 35. As shown in FIG. 2, the operation element 121 of the physical projection control program 12 of the present invention includes a split screen/single-screen operation component 1211. By clicking the split screen/single-screen operation component 1211, the operation of the physical projection control program 12 is switched In a split screen mode or operate in a single screen mode. When the physical projection control program 12 operates in the split-screen mode, a split-screen command will be generated, and the split-screen command will be sent to the computer device 30, and the image processor 11 and the control module 31 will display on the touch-sensitive display interface 15 and A plurality of image frames 511, 512, 513, and 514 are cut out from the screen of the display unit 35, and each physical image is sequentially projected according to the time captured by the image capturing unit 17 according to the respective physical images 111, 112, 113, 119 111, 112, 113, 119 are in the corresponding video frames 511, 512, 513, 514. For example, the image frame 511 is a real-time image frame, which will project the latest real-time captured physical image 111, and the other image frames 512, 513, and 514 respectively project the physical images 112, 113, 119.

Further, taking an application example for illustration, the speaker uses the physical projection remote control device 10 to capture images of multiple angles of an actual object 20 of an insect (such as a beetle) to generate physical images 111, 112, and 113 of different angles 119, for example, the physical image 111 is the front image of the beetle, the physical image 112 is the back image of the beetle, the physical image 113 is the right image of the beetle, and the physical image 119 is the left image of the beetle, and the multiple angles captured The beetle physical images 111, 112, 113, and 119 are projected in the corresponding image frames 511, 512, 513, and 514, respectively. Then, the listener looks at the projected beetle images 111, 112, 113, 119 at multiple angles to learn more about the appearance of the insect and its body structure.

Or, in another application example, the physical projection remote control device 10 can perform image capture on the physical object 20 of a chemical experiment procedure to generate physical image 111, 112, 113, 119 of multiple operation steps, for example, the physical image 119 is The physical image of the first operation step, the physical image 113 is the physical image of the second operation step, the physical image 112 is the physical image of the third operation step, and the physical image 111 is the physical image of the last operation step, and the captured The physical images 111, 112, 113, and 119 of the multiple operation steps will be projected in the corresponding image frames 511, 512, 513, and 514, respectively. Then, the speaker (such as a teacher) of the physical projection remote control device 10 can sequentially explain the operation steps through the projected physical images 111, 112, 113, 119, so that the lecturer (such as the student) can understand the chemical experiment more clearly To complete the chemical experiment in order.

In the above embodiment, the image processor 11 and the control module 31 divide the screen of the touch display interface 15 and the display unit 35 into four image frames according to the split screen instruction. Of course, in yet another embodiment of the present invention, the image processor 11 and the control module 31 may also divide the screens of the touch-sensitive display interface 15 and the display unit 35 into two, six, and eight according to the split screen instruction Or other number of image frames, here, it is not limited to this.

Next, in an embodiment of the present invention, when one of the image frames 511, 512, 513, or 514 of the touch display interface 15 is clicked, for example: clicking the image frame 511, the physical projection control program 12 will generate a high brightness And send high-brightness marking instructions to the computer device 30. The control module 31 of the computer device 30 controls the physical image 111, 112, 113, or 119 in the corresponding image frame 511, 512, 513, or 514 projected on the display unit 35 according to the high-brightness marking instruction to perform high-brightness Show. For example, as shown in FIG. 2, when the image frame 511 of the touch-sensitive display interface 15 is clicked once, the physical projection control program 12 will generate a mark instruction indicating the high-brightness display of the image frame 511 and send it to the computer device 30, Then, the control module 31 of the computer device 30 controls the image frame 511 of the display unit 35 to perform high-brightness display according to the instruction of the marking instruction. Here, the high-brightness display function is used to remind the listener in the actual projection teaching that the presenter explains which physical image 111/112/113/119 in the image frame 511/512/513/514.

The physical projection control program 12 of the present invention still includes at least one operation element 1212 for image replacement. The image replacement operation element 1212 will be displayed on the image frames 512, 513, and 514, respectively. The user of the physical projection remote control device 10 performs the image replacement operation element 1212 to operate from the first data storage unit 13 and/or The second data storage unit 23 selects another previously captured physical image and replaces the physical image 112, 113, or 119 currently projected in the image frame 512, 513, or 514.

In an embodiment of the present invention, when one of the image frames 511, 512, 513, or 514 of the touch-sensitive display interface 15 is clicked, for example: clicking the image frame 511 twice, the physical projection control program 12 will generate an image enlargement command and Send the image enlargement instruction to the computer device 30. The control module 31 of the computer device 30 controls the physical image 111, 112, 113, or 119 projected in the corresponding image frame 511, 512, 513, or 514 projected on the display unit 35 according to the instruction of the image enlargement instruction to the display unit The entire screen of 35, such as a full screen. For example, as shown in FIG. 2, when the image frame 511 of the touch display interface 15 is clicked twice, the physical projection control program 12 will generate a command indicating the enlargement of the physical image 111 in the image frame 511 and send it to the computer Device 30, the control module 31 of the computer device 30 controls the physical image 111 in the image frame 511 of the display unit 35 to project in a full-screen manner according to the instruction of the enlarged image. At this time, the physical projection control program 12 will Operate in single-screen mode, as shown in Figure 3.

Continuing to refer to FIG. 3, the physical projection control program 12 of the present invention further includes a pen operating element 1213 and an eraser operating element 1216. When the brush operation element 1213 is selected, the physical projection control program 12 provides a brush 1214 function. The user can use the pen 1214 to draw the line 1215 or annotation (note of text or pattern) to the physical image 111; afterwards, the physical projection remote control device 10 and the computer device 30 respectively draw the line 1215 or the completed physical image 111 respectively Recorded in the data storage unit 13,23. Or, as shown in FIG. 4, when the eraser operation element 1216 is clicked, the physical projection control program 12 provides the function of an eraser 1217. The eraser 1217 is used to draw the line 1215 or annotation on the physical image 111 After deletion, the physical projection remote control device 10 and the computer device 30 record the deleted line drawing 1215 or the annotated physical image 111 in the data storage units 13, 23, respectively.

In summary, the physical teaching projection system 100 of the present invention assists teaching by means of physical projection, and can divide the projected picture into a plurality of image frames 511, 512, 513, and 514, so that multiple physical images can be simultaneously projected 111, 112, 113 or 119 to improve the listener's understanding of the recognition of the physical object 20 or the operation of the physical object 20. In addition, the function of the brush 1214 is also provided to draw a line 1215 or annotation on the physical image 111 to supplement some teaching content of the physical object 20. Therefore, the projection of objects is further added to the original teaching to make it easier for the listener to understand the actual teaching content to enhance the effectiveness of learning.

The above is only one of the preferred embodiments of the present invention and is not intended to limit the scope of the implementation of the present invention, that is, any changes in shape, structure, features and spirit described in the patent application of the present invention Modifications should be included in the patent application scope of the present invention.

100: Physical teaching projection system 10: Computer device 11: Image processor 111: Physical image 112: Physical image 113: Physical image 119: Physical image 12: Physical projection control program 121: Operating element 1211: Split screen/single screen operating element 1212: Operation element for image replacement 1213: Pen operation element 1214: Pen 1215: Line drawing 1216: Eraser operation element 1217: Eraser 123: Instruction 13: First data storage unit 15: Touch display interface 17: Image capture Access unit 20: physical object 30: computer device 31: control module 32: hot key 33: second data storage unit 35: display unit 511: image frame 512: image frame 513: image frame 514: image frame

Fig. 1: System architecture diagram of an embodiment of the physical teaching projection system of the present invention.

Fig. 2 is a schematic diagram of a split screen according to an embodiment of the touch display interface and the display unit of the present invention.

Fig. 3: A schematic diagram of a single screen of an embodiment of the touch display interface and the display unit of the present invention.

Fig. 4: A schematic diagram of a single screen of an embodiment of the touch display interface and the display unit of the present invention.

100: physical teaching projection system

10: Computer device

11: Image processor

111: physical image

112: physical image

113: physical image

119: physical image

12: physical projection control program

121: Operating elements

123: instruction

13: The first data storage unit

15: Touch display interface

17: Image capture unit

20: physical

30: Computer device

31: Control module

32: Hotkey

33: Second data storage unit

35: display unit

Claims (16)

A kind of physical teaching projection system, including: a physical projection remote control device, including: an image capturing unit, for at least one physical image capturing multiple times, to generate multiple physical images; to generate multiple physical images; Store a physical projection control program and multiple physical images; 　　　　　　　　 a touch display interface, the physical projection control program is displayed on the touch display interface; and an image processor, the image processor is connected to the image capture Unit, the first data storage unit and the touch-sensitive display interface; and at least one computer device that is communicatively connected to the physical projection remote control device, including: 　　　　　　　　 a second data storage unit, the physical camera device sequentially transmits the physical objects An image to the computer device, the computer device uses the second data storage unit to store each of the physical images; 　　　　　　　　 at least one display unit for projecting at least one physical image; and a control module connected to the second data storage unit and The display unit, wherein the physical projection control program includes a plurality of operation elements, the operation elements are displayed on the touch display interface, and when each operation element is clicked or operated, a corresponding command will be generated and transmitted To the computer device, the control module of the computer device performs related projection control actions on the physical image according to the instruction of each of the instructions; 　　　　　　 wherein the operating element of the physical projection control program includes a split screen operating element, When the split screen operation element is clicked, the physical projection control program enters a split screen mode, generates a split screen command, sends the split screen command to the computer device, the image processor and the control module according to the split screen The instruction cuts out a plurality of image frames in the screen of the touch-sensitive display interface and the display unit, and sequentially projects each of the physical images in the corresponding image frame according to the time when each of the physical images is captured. As described in item 1 of the patent application scope, a physical teaching projection system, wherein one of the image frames is projected with the real-time captured physical image, and the other image frames are respectively projected with the previously captured physical image. The physical teaching projection system as described in item 1 of the patent application scope, wherein the control module of the computer device is provided with a plurality of hot keys, and each of the commands is matched with a corresponding hot key when the computer device receives When the instruction is reached, the hotkey matched by the instruction is activated, and the activated hotkey will perform a related projection manipulation action on the physical image. As described in item 3 of the patent application scope, the physical teaching projection system, wherein each of the hot keys represents a single keyboard key or a combination of multiple keyboard keys. The physical teaching projection system as described in item 1 of the patent scope, wherein when one of the image frames of the touch-sensitive display interface is clicked, the control module of the computer device controls the corresponding projection projected on the display unit The image frame performs high-brightness presentation. The physical teaching projection system as described in item 1 of the patent scope, wherein when one of the image frames of the touch-sensitive display interface is clicked, the control module of the computer device controls the corresponding projection projected on the display unit The physical image in the image frame is enlarged and projected onto the entire screen of the display unit. The physical teaching projection system as described in item 1 of the patent application scope, wherein the physical projection control program includes at least one image replacement operation element, and the operation of the image replacement operation element is used to replace the projected image in the image frame Physical image. The physical teaching projection system as described in item 1 of the patent application scope, wherein the physical projection control program includes a pen operating element, and when the pen operating element is clicked, the physical projection operating program provides the function of a pen, using the The brush is used to draw lines or mark the image content of the physical image projected in one of the image frames. The physical teaching projection system as described in item 8 of the patent application scope, wherein the physical image after the line drawing or annotation is stored in the first data storage unit of the physical shooting device and the second data storage unit of the computer device in. The physical teaching projection system as described in item 8 of the patent application scope, wherein the physical projection control program includes an eraser operation element, and when the eraser operation element is clicked, the physical projection control program provides an eraser function, Use the eraser to delete the line or annotation on the real image projected in one of the image frames. As described in Item 1 of the patent application scope, the physical teaching projection system, wherein the display unit is a projection device connected to the computer device. A physical teaching projection method, which is applied to a physical teaching projection system. The physical teaching projection system includes a physical projection remote control device and a computer device. The physical projection remote control device includes an image processor and a touch display An interface and an image capture unit, and the computer device includes a control module and at least one display unit, the steps of the physical teaching projection method include: Through the image capture unit to perform multiple image captures for at least one physical object In order to generate multiple physical images; send the physical images to the computer device in sequence to generate the image; click to display a physical projection control program on the touch display interface; A split screen command and send the split screen command to the computer device; the image processor and the control module cause the image processor and the control module to cut out multiple images in the touch display interface and the screen of the display unit according to the split screen command Frame; and the image processor and the control module sequentially project each physical image in the corresponding image frame according to the time when each physical image is captured. The project teaching method as described in item 12 of the patent application scope further includes the following steps: click one of the image frames of the touch display interface to generate a high-brightness marking instruction; and according to the high-brightness marking instruction In order to control the high-brightness display of the real image projected in the image frame corresponding to the display unit. The project teaching method as described in item 12 of the patent application scope further includes the following steps: 　　 Click one of the image frames of the touch display interface to generate an image enlargement instruction; and control according to the instruction of the image enlargement instruction The physical image projected in the image frame corresponding to the display unit is enlarged to the entire screen of the display unit. The physical teaching projection method as described in item 12 of the patent application scope further includes a step: 　　clicking on a brush control element of the physical projection control program to draw a line on the image content of the physical image projected on the display unit Or annotated operations. The physical teaching projection method as described in item 15 of the patent application scope further includes a step of: deleting the line or annotation on the image content of the physical image by clicking an eraser control element of the physical projection control program operating.

Images