AU2021103434A4 - A wireless system for real-time and interactive free-hand sketching/editing of ppt - Google Patents
A wireless system for real-time and interactive free-hand sketching/editing of ppt Download PDFInfo
- Publication number
- AU2021103434A4 AU2021103434A4 AU2021103434A AU2021103434A AU2021103434A4 AU 2021103434 A4 AU2021103434 A4 AU 2021103434A4 AU 2021103434 A AU2021103434 A AU 2021103434A AU 2021103434 A AU2021103434 A AU 2021103434A AU 2021103434 A4 AU2021103434 A4 AU 2021103434A4
- Authority
- AU
- Australia
- Prior art keywords
- ppt
- hand
- free
- smart device
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 15
- 230000003287 optical effect Effects 0.000 claims abstract description 29
- 238000012806 monitoring device Methods 0.000 claims description 10
- 230000003278 mimic effect Effects 0.000 claims description 3
- 238000000034 method Methods 0.000 abstract description 11
- 230000008901 benefit Effects 0.000 abstract description 4
- 230000008447 perception Effects 0.000 abstract description 2
- 230000000007 visual effect Effects 0.000 abstract description 2
- 230000001953 sensory effect Effects 0.000 abstract 1
- 238000012986 modification Methods 0.000 description 9
- 230000004048 modification Effects 0.000 description 9
- 230000009471 action Effects 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 230000006698 induction Effects 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
- G06F3/0308—Detection arrangements using opto-electronic means comprising a plurality of distinctive and separately oriented light emitters or reflectors associated to the pointing device, e.g. remote cursor controller with distinct and separately oriented LEDs at the tip whose radiations are captured by a photo-detector associated to the screen
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention discloses a Wireless System for Real-Time and Interactive Free-Hand
Sketching/Editing of PPT, a low cost, hardware/software combination system that adds value to
current-day smart PPT based teaching methods. The proposed system uses optical hand gesture
motion recognition to enable real-time PPT editing/free-hand sketching using wireless, non
contact methods for highlighting specific content. The advantage of the proposed system is it
greatly improvises and advances the PPT based teaching methods, promotes efficient out-reach
of delivered education content, increases the eye-ear sensory co-ordination and perception.
Altogether, this provides an even better visual and intuitive understanding of concepts compared
to present day PPT teaching methods and also proves to be a valuable tool that increases the
listener's concentration/understandability in virtual/online PPT sessions.
1/3
DRAWINGS
All the red sketches/free-hand written
text on the wall projected PPT are live
Wall projected PPT edits/free-hand drawing done using hand
gesturing of the optical pointer by the
Slide 1: Live free-hand sketches demo presenter.
4 1. Smart device built-in camera first
records the light movements of hand
-2 gestures.
2. This is then overlayed as sketches on
Presenter doing free- - - :--- the PPT slide using a special software.
hand estures using 3. As the sketches are overlayed on the
the optical pointer * slide, they are also recreated/displayed
sr d in real-time on the wall.
r mart device
a withabiltin
-l camera and it
field of view Audience
Presenteris
freely moving
while presenting
as well as optical
hand gesturing
Fig. 1
Description
1/3
All the red sketches/free-hand written text on the wall projected PPT are live Wall projected PPT edits/free-hand drawing done using hand gesturing of the optical pointer by the Slide 1: Live free-hand sketches demo presenter.
4 1. Smart device built-in camera first records the light movements of hand -2 gestures. 2. This is then overlayed as sketches on Presenter doing free- -- :- - the PPT slide using a special software. hand estures using 3. As the sketches are overlayed on the the optical pointer * slide, they are also recreated/displayed sr d in real-time on the wall. r mart device a withabiltin -l camera and it field of view Audience Presenteris freely moving while presenting as well as optical hand gesturing
Fig. 1
[0001] The present invention relates to the field of educational teaching/training technologies applied for students as well as different organizations.
[0002] In many educational teaching/trainings content are delivered to the audience (students/employees etc.) either in direct presence or virtual (online) modes using power-point presentations (PPT). This practice is in contrast to olden days where black-board was the way to teach and deliver live content to audience.
[0003] PPT presentation share become very popular over black-board teaching methods since they provide a better visual, graphical and intuitive understanding of the concepts that makes them more teacher-friendly as well as audience-friendly. Having said that, PPT presentations are not without limitations and they lack some features such as:
(1) Real-time (or on-the-go) editing/free-hand drawing of PPT content in a live and interactive manner is generally difficult unlike in black-board teaching methods. This feature is very much needed for a teacher/presenter because it is effective in grabbing and retaining the attention of the audience who get lost or become uninterested otherwise.
(2) The presenter is also mostly required to stay close to the projected display wall, but he/she cannot move freely around the room while simultaneously performing real time editing/highlighting of specific PPT content from a distance in a wireless, non contact manner.
[0004] Hence in our invention, we are proposing a custom hardware/software system for educational content delivery using advanced smart features. The invented smart features greatly improvise and advance the modern-day educational content delivery/teaching methods for the audience (students/employees/trainers etc.).
[0005] More specifically, the present subject matter is related to creating a hardware/software system that enables presenters (teachers/trainers/virtual speakers etc.) to edit/free-hand sketch educational PPT content in a live, interactive and real-time manner by non-contact, wireless, free hand gesturing method.
[0006] The primary object of the present invention is to design a hardware/software system that enables real-time, interactive and live editing/free-hand sketching of educational presentation (PPT) content in a wireless and non-contact manner.
[0007] Another object of the present invention is to create a system greatly improvises and advances present-day educational content delivery/teaching methods.
[0008] Another object of the present invention is to create a system for an efficient and economical teaching mechanism.
[0009] Another object of the present invention is to create an appealing and intuitive system for all kind of audiences.
[0010] These and other aspects of the embodiments herein will be better appreciated and understood when considered in conjunction with the following description and the accompanying drawings. It should be understood, however, that the following descriptions, while indicating preferred embodiments and numerous specific details thereof, are given by way of illustration and not of limitation. Many changes and modifications may be made within the scope of the embodiments herein without departing from the spirit thereof, and the embodiments herein include all such modifications.
[0011] The various embodiments of the present invention disclose a system that enables real-time,
interactive and live editing/free-hand sketching of educational presentation (PPT) content in a wireless and
non-contact manner, the system comprising: A smart device (Laptop, tablet, mobile or PC etc.), an optical pointer and a monitoring device with an optical camera and a projector.
[0012] According to an embodiment of the present invention, the projector is connected to the smart device wherein the PPT is uploaded and the projector projects the content. Further the monitoring device with an optical camera is connected to the smart device with optical range covering the entire projected wall.
[0013] According to an embodiment of the present invention the optical pointer such as LED pointer or Laser Pointer, the light of the pointer is focused on the projected wall by the user and various hand gestures are made through the pointer as writing/drawing on a piece of paper or blackboard.
[0014] According to an embodiment of the present invention the smart device is provided with a pre-deposited instruction to mimic the movement of the light movements recorded by the Optical camera and overlays these light movements onto the PPT slide.
[0015] According to an embodiment to the present invention the monitoring device, captures the gestures on the wall records and transmit the said data to the smart device, wherein the pre-installed instruction runs the data at real time wherein the motion of the optical pointer on the PPT projected wall are over laid as sketches on PPT as mimicking the gestures of the optical pointer. As the sketches are overlaid on the PPT, they are displayed on the Projected PPT in real time.
[0016] According to an embodiment to the present invention, the user a through the LED optical pointer for pinpointing specific content in the PPT. The user does a free-hand sketches on the PPT (Examples: circle certain content to highlight, tick or wrong mark certain things, even free-hand write some text etc.), it is recorded processed and displayed in real-time, wherein to perform real time, interactive editing/free-hand sketches or drawing on the displayed PPT content.
[0017] These and other aspects of the embodiments herein will be better appreciated and understood when considered in conjunction with the following description and the accompanying drawings. It should be understood, however, that the following descriptions, while indicating the preferred embodiments and numerous specific details thereof, are given by way of illustration and not of limitation. Many changes and modifications may be made within the scope of the embodiments herein without departing from the spirit thereof, and the embodiments herein include all such modifications.
[0018] The system can be applied to all types of educational content delivery such as for students in schools and colleges, in companies for employees training, in professional conferences for talks by eminent people etc.
[0019] The system is not only applicable for direct (in presence) presentation, but it also applicable for virtual online presentations which is becoming more prevalent now-a-days.
[0020] The importance and advantage of the system is increased further when it's applied to virtual teaching/training presentations because there is complete coherence or correlation between presenter's words and actions in virtual mode too. The eye-to-ear co-ordination and perception/understanding of the talk is increased for the audience. Without presenter's actions or gestures (live highlighting, editing, free-hand sketching etc.) to see, the talks cannot be easily followed or easily understood by the audience and hence the efficiency/outreach of the presentations is greatly decreased.
[0021] The invented system is only a low-cost system which is affordable and appealing to all class of audience including rural audience who will find live and interactive editing to be graphically intuitive to understand.
[0022] The invented system is completely wireless and non-contact and the presenter has the full flexibility to move freely around the room while at the same time present and edit/free-hand sketch PPT content in real-time. The invented system does not restrict free interaction and movement of the speaker.
[0023] The other objects, features and advantages will occur to those skilled in the art from the following description of the preferred embodiment and the accompanying drawings in which;
[0024] FIG 1 represents a graphical illustration of the real-time and interactive PPT content creation/editing system for smart educational content delivery.
[0025] FIG 2 represents a block diagram of the real-time and interactive PPT content creation/editing system for smart educational content delivery.
[0026] Fig. 3 represents a flow chart of the real-time and interactive PPT content creation/editing system for smart educational content delivery.
[0027] Although the specific features of the present invention are shown in some drawings and not in others.
[0028] This is done for convenience only as each feature may be combined with any or all of the other features in accordance with the present invention.
[0029] In the following detailed description, a reference is made to the accompanying drawings that form a part hereof, and in which the specific embodiments that may be practiced is shown by way of illustration. These embodiments are described in sufficient detail to enable those skilled in the art to practice the embodiments and it is to be understood that other changes may be made without departing from the scope of the embodiments. The following detailed description is therefore not to be taken in a limiting sense. The various embodiments of the present invention provide a medium frequency induction hardening for induction hardening components of smaller dimension.
[0030] The various embodiments of the present invention disclose a system that enables real-time,
interactive and live editing/free-hand sketching of educational presentation (PPT) content in a wireless and
non-contact manner, the system comprising: A smart device (Laptop, tablet, mobile or PC etc.), An optical pointer and a monitoring device with an optical camera and a projector, Wherein the smart device is connected to monitoring device with a built-in camera which records the light movements of the optical pointer in real-time. The built-in camera of the smart device has a field of view that covers the full displayed PPT size.
[0031] According to an embodiment of the present invention the optical pointer consists of buttons to navigate the PPT slides which is Bluetooth connected to the smart device. A long press of one of the buttons indicates "Erase mode". (b) In the erase mode, the presenter as before focuses the light on the wall and he can do a "Cross mark" or "Erase gesturing action". The software part described below captures this action and erases that specific overlaid content and to revert back the "erase mode", a long press needs to be done again. Further the optical pointer such as LED pointer or
Laser Pointer, the light of the pointer is focused on the projected wall by the user and various hand gestures are made through the pointer as writing/drawing on a piece of paper or blackboard.
[0032] According to an embodiment of the present invention the smart device is provided with a pre-deposited instruction to mimic the movement of the light movements recorded by the Optical camera and overlays these light movements onto the PPT slide.
[0033] According to an embodiment of the present invention, the pre-deposited instruction is custom written software written using high level languages runs on the background in the smart device. This software gets information of the light movements from the monitoring system and overlays these light movements onto the PPT slide.
[0034] According to an embodiment of the present invention, the screen size of the smart device is mapped to the size of the projector wall at pixel level by the software plug-in once at the start of the presentation. Further the light movements are recorded by the monitoring device with the built in camera, wherein transmits to smart device as input by the software plug-in. The light movements will be recorded as dynamic movement from pixel to pixel. After screen-to-screen pixel remapping is done, the remapped movements are then overlaid using pen or pencil sketch on the PPT slide.
[0035] According to the embodiment of the present invention, the software plug-in functions in edit/erase mode. In edit mode, pencil or pen sketch is overlaid on the PPT slide. In the erase mode, the overlaid sketch is removed. The two modes are differentiated by "long press" of the optical pointer navigation buttons. For the erase mode to function properly, the software plugin saves or remembers the previously overlaid content. Further the software plug-in is also programmed to include an advanced graphics mode. In this mode, apart from the simple edit/erase functions, a small palette to choose color, built-in shapes and symbols etc. is included.
[0036] According to an embodiment of the present invention, the smart device such as Laptop, tablet, mobile or PC etc. is connected to a projector wherein it projects an offline created PPT on the display wall. The user explains the contents of the displayed PPT. The optical pointer such as the LED optical pointer for pinpointing specific content in the PPT, the user by means of the system do free-hand sketches on the PPT (Examples: circle certain content to highlight, tick or wrong mark certain things, even free-hand write some text etc.), in real-time and to perform real-time, interactive editing/free-hand sketches or drawing on the displayed PPT contentWhenever the presenter wants to highlight some PPT content, he performs hand gestures using the LED pointer. The hand gestures are displayed on the wall as light movements.
[0037] It is noted that the above-described examples of the present invention is for the purpose of illustration only. Although the present invention has been described in conjunction with a specific example thereof, numerous modifications may be possible without materially departing from the teachings and advantages of the subject matter described herein. Other substitutions, modifications and changes may be made without departing from the spirit of the present solution. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and/or all of the steps of any method or process so disclosed, may be combined in any combination, except combinations where at least some of such features and/or steps are mutually exclusive.
[0038] Although the embodiments herein are described with various specific embodiments, it will be obvious for a person skilled in the art to practice the embodiments herein with modifications.
[0039] It is to be understood that the phraseology or terminology employed herein is for the purpose of description and not of limitation. Therefore, while the embodiments herein have been described in terms of preferred embodiments, those skilled in the art will recognize that the embodiments herein can be practiced with modifications. However, all such modifications are deemed to be within the scope of the claims.
Claims (4)
1. A Wireless System for Real-Time and Interactive Free-Hand Sketching/Editing of PPT, the system comprising;
a smart device, a monitoring device with a built-in camera, an optical pointer and a projector wherein the smart device is connected to monitoring device with a built-in camera which records the light movements of the optical pointer in real-time. wherein the smart device is characterized with a pre-deposited instruction to mimic the movement of the light movements recorded by the Optical camera and overlays these light movements onto the PPT slide.
2. The system as claimed in claim 1 wherein the built-in camera of the monitoring device is connected to the smart device has a field of view that covers the full displayed PPT size and records the movement and transmit to the smart device.
3. The system as claimed in claim 1, the optical pointer consists of buttons to navigate the PPT slides which is connected via bluetooth to the smart device wherein the light of the pointer is focused on the projected wall by the user and various hand gestures are made through the pointer for writing/drawing/deleting.
4. The system as claimed in claim 1, the screen size of the smart device is mapped to the size of the projector wall at pixel level by the software plug-in once at the start of the presentation. Further the light movements are recorded by the monitoring device with the built-in camera, wherein transmits to smart device as input by the software plug-in wherein, the light movements will be recorded as dynamic movement from pixel to pixel after screen-to-screen pixel remapping is done, the remapped movements are then overlaid using pen or pencil sketch on the PPT slide.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2021103434A AU2021103434A4 (en) | 2021-06-17 | 2021-06-17 | A wireless system for real-time and interactive free-hand sketching/editing of ppt |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2021103434A AU2021103434A4 (en) | 2021-06-17 | 2021-06-17 | A wireless system for real-time and interactive free-hand sketching/editing of ppt |
Publications (1)
Publication Number | Publication Date |
---|---|
AU2021103434A4 true AU2021103434A4 (en) | 2022-03-31 |
Family
ID=80855669
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
AU2021103434A Ceased AU2021103434A4 (en) | 2021-06-17 | 2021-06-17 | A wireless system for real-time and interactive free-hand sketching/editing of ppt |
Country Status (1)
Country | Link |
---|---|
AU (1) | AU2021103434A4 (en) |
-
2021
- 2021-06-17 AU AU2021103434A patent/AU2021103434A4/en not_active Ceased
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9164590B2 (en) | System and method for automated capture and compaction of instructional performances | |
Anderson et al. | Use of classroom presenter in engineering courses | |
US20120254773A1 (en) | Touch screen based interactive media sharing | |
AU2021261950A1 (en) | Virtual and augmented reality instruction system | |
CN102903265A (en) | Method for automatically recording classroom teaching | |
Chen et al. | Ivrnote: design, creation and evaluation of an interactive note-taking interface for study and reflection in vr learning environments | |
CN102722336A (en) | Office wireless speaking system and synchronous tracking method for synchronous tracking of editing and demonstration operation | |
Maclaren | The new chalkboard: the role of digital pen technologies in tertiary mathematics teaching | |
Rogers et al. | Integrating a Single Tablet PC in Chemistry, Engineering, and Physics Courses. | |
KR20170098617A (en) | Customized training service level management system and method using a digital pen and a cloud server | |
AU2021103434A4 (en) | A wireless system for real-time and interactive free-hand sketching/editing of ppt | |
Muehlbradt et al. | Exploring the design of audio-kinetic graphics for education | |
Toto et al. | One step beyond: Lecturing with a tablet pc | |
CN100370396C (en) | Intelligent computer and device for displaying mark position and playing device for playing filmslide | |
Friedland et al. | Educational multimedia systems: the past, the present, and a glimpse into the future | |
Fu et al. | Research on remote learning in multimodal interaction | |
KR20130113218A (en) | A electronic note function system and its operational method thereof | |
KR101632174B1 (en) | Method for producing educational material and educational material system | |
Lui et al. | Gesture-Based interaction for seamless coordination of presentation aides in lecture streaming | |
Xiang et al. | Use of wireless tablet PCs as an effective learning and teaching enhancement tool | |
McCorkle et al. | The Lightboard: A faculty introduction to the development of supplemental learning media | |
Behm et al. | Enhancing accessibility of engineering lectures for deaf & hard of hearing (DHH): real-time tracking text displays (RTTD) in classrooms | |
Maclaren | Enhancing the teaching of mathematically intensive STEM disciplines at a tertiary level through the use of pen-enabled tablet PCs | |
Gale et al. | Teaching a foreign language with video podcast assignments: Examples from an American Sign Language course | |
Di Mascio | Teaching Architectural Design in a Time of Change: Digital Tools and Methodologies |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FGI | Letters patent sealed or granted (innovation patent) | ||
MK22 | Patent ceased section 143a(d), or expired - non payment of renewal fee or expiry |