AU2021103434A4 - A wireless system for real-time and interactive free-hand sketching/editing of ppt - Google Patents

A wireless system for real-time and interactive free-hand sketching/editing of ppt Download PDF

Info

Publication number
AU2021103434A4
AU2021103434A4 AU2021103434A AU2021103434A AU2021103434A4 AU 2021103434 A4 AU2021103434 A4 AU 2021103434A4 AU 2021103434 A AU2021103434 A AU 2021103434A AU 2021103434 A AU2021103434 A AU 2021103434A AU 2021103434 A4 AU2021103434 A4 AU 2021103434A4
Authority
AU
Australia
Prior art keywords
ppt
hand
free
smart device
real
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
AU2021103434A
Inventor
Viswanathan Balasubramanian
Srinivasan Devaraju
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
K Ramakrishnan College of Engineering
Original Assignee
K Ramakrishnan College of Engineering
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by K Ramakrishnan College of Engineering filed Critical K Ramakrishnan College of Engineering
Priority to AU2021103434A priority Critical patent/AU2021103434A4/en
Application granted granted Critical
Publication of AU2021103434A4 publication Critical patent/AU2021103434A4/en
Ceased legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means
    • G06F3/0308Detection arrangements using opto-electronic means comprising a plurality of distinctive and separately oriented light emitters or reflectors associated to the pointing device, e.g. remote cursor controller with distinct and separately oriented LEDs at the tip whose radiations are captured by a photo-detector associated to the screen
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/02Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • G06V40/28Recognition of hand or arm movements, e.g. recognition of deaf sign language

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention discloses a Wireless System for Real-Time and Interactive Free-Hand Sketching/Editing of PPT, a low cost, hardware/software combination system that adds value to current-day smart PPT based teaching methods. The proposed system uses optical hand gesture motion recognition to enable real-time PPT editing/free-hand sketching using wireless, non contact methods for highlighting specific content. The advantage of the proposed system is it greatly improvises and advances the PPT based teaching methods, promotes efficient out-reach of delivered education content, increases the eye-ear sensory co-ordination and perception. Altogether, this provides an even better visual and intuitive understanding of concepts compared to present day PPT teaching methods and also proves to be a valuable tool that increases the listener's concentration/understandability in virtual/online PPT sessions. 1/3 DRAWINGS All the red sketches/free-hand written text on the wall projected PPT are live Wall projected PPT edits/free-hand drawing done using hand gesturing of the optical pointer by the Slide 1: Live free-hand sketches demo presenter. 4 1. Smart device built-in camera first records the light movements of hand -2 gestures. 2. This is then overlayed as sketches on Presenter doing free- - - :--- the PPT slide using a special software. hand estures using 3. As the sketches are overlayed on the the optical pointer * slide, they are also recreated/displayed sr d in real-time on the wall. r mart device a withabiltin -l camera and it field of view Audience Presenteris freely moving while presenting as well as optical hand gesturing Fig. 1

Description

1/3
DRAWINGS
All the red sketches/free-hand written text on the wall projected PPT are live Wall projected PPT edits/free-hand drawing done using hand gesturing of the optical pointer by the Slide 1: Live free-hand sketches demo presenter.
4 1. Smart device built-in camera first records the light movements of hand -2 gestures. 2. This is then overlayed as sketches on Presenter doing free- -- :- - the PPT slide using a special software. hand estures using 3. As the sketches are overlayed on the the optical pointer * slide, they are also recreated/displayed sr d in real-time on the wall. r mart device a withabiltin -l camera and it field of view Audience Presenteris freely moving while presenting as well as optical hand gesturing
Fig. 1
A WIRELESS SYSTEM FOR REAL-TIME AND INTERACTIVE FREE-HAND SKETCHING/EDITING OF PPT TECHNICAL FIELD
[0001] The present invention relates to the field of educational teaching/training technologies applied for students as well as different organizations.
BACKGROUNDART
[0002] In many educational teaching/trainings content are delivered to the audience (students/employees etc.) either in direct presence or virtual (online) modes using power-point presentations (PPT). This practice is in contrast to olden days where black-board was the way to teach and deliver live content to audience.
[0003] PPT presentation share become very popular over black-board teaching methods since they provide a better visual, graphical and intuitive understanding of the concepts that makes them more teacher-friendly as well as audience-friendly. Having said that, PPT presentations are not without limitations and they lack some features such as:
(1) Real-time (or on-the-go) editing/free-hand drawing of PPT content in a live and interactive manner is generally difficult unlike in black-board teaching methods. This feature is very much needed for a teacher/presenter because it is effective in grabbing and retaining the attention of the audience who get lost or become uninterested otherwise.
(2) The presenter is also mostly required to stay close to the projected display wall, but he/she cannot move freely around the room while simultaneously performing real time editing/highlighting of specific PPT content from a distance in a wireless, non contact manner.
[0004] Hence in our invention, we are proposing a custom hardware/software system for educational content delivery using advanced smart features. The invented smart features greatly improvise and advance the modern-day educational content delivery/teaching methods for the audience (students/employees/trainers etc.).
[0005] More specifically, the present subject matter is related to creating a hardware/software system that enables presenters (teachers/trainers/virtual speakers etc.) to edit/free-hand sketch educational PPT content in a live, interactive and real-time manner by non-contact, wireless, free hand gesturing method.
OBJECT OF THE INVENTION
[0006] The primary object of the present invention is to design a hardware/software system that enables real-time, interactive and live editing/free-hand sketching of educational presentation (PPT) content in a wireless and non-contact manner.
[0007] Another object of the present invention is to create a system greatly improvises and advances present-day educational content delivery/teaching methods.
[0008] Another object of the present invention is to create a system for an efficient and economical teaching mechanism.
[0009] Another object of the present invention is to create an appealing and intuitive system for all kind of audiences.
SUMMARY OF THE INVENTION
[0010] These and other aspects of the embodiments herein will be better appreciated and understood when considered in conjunction with the following description and the accompanying drawings. It should be understood, however, that the following descriptions, while indicating preferred embodiments and numerous specific details thereof, are given by way of illustration and not of limitation. Many changes and modifications may be made within the scope of the embodiments herein without departing from the spirit thereof, and the embodiments herein include all such modifications.
[0011] The various embodiments of the present invention disclose a system that enables real-time,
interactive and live editing/free-hand sketching of educational presentation (PPT) content in a wireless and
non-contact manner, the system comprising: A smart device (Laptop, tablet, mobile or PC etc.), an optical pointer and a monitoring device with an optical camera and a projector.
[0012] According to an embodiment of the present invention, the projector is connected to the smart device wherein the PPT is uploaded and the projector projects the content. Further the monitoring device with an optical camera is connected to the smart device with optical range covering the entire projected wall.
[0013] According to an embodiment of the present invention the optical pointer such as LED pointer or Laser Pointer, the light of the pointer is focused on the projected wall by the user and various hand gestures are made through the pointer as writing/drawing on a piece of paper or blackboard.
[0014] According to an embodiment of the present invention the smart device is provided with a pre-deposited instruction to mimic the movement of the light movements recorded by the Optical camera and overlays these light movements onto the PPT slide.
[0015] According to an embodiment to the present invention the monitoring device, captures the gestures on the wall records and transmit the said data to the smart device, wherein the pre-installed instruction runs the data at real time wherein the motion of the optical pointer on the PPT projected wall are over laid as sketches on PPT as mimicking the gestures of the optical pointer. As the sketches are overlaid on the PPT, they are displayed on the Projected PPT in real time.
[0016] According to an embodiment to the present invention, the user a through the LED optical pointer for pinpointing specific content in the PPT. The user does a free-hand sketches on the PPT (Examples: circle certain content to highlight, tick or wrong mark certain things, even free-hand write some text etc.), it is recorded processed and displayed in real-time, wherein to perform real time, interactive editing/free-hand sketches or drawing on the displayed PPT content.
[0017] These and other aspects of the embodiments herein will be better appreciated and understood when considered in conjunction with the following description and the accompanying drawings. It should be understood, however, that the following descriptions, while indicating the preferred embodiments and numerous specific details thereof, are given by way of illustration and not of limitation. Many changes and modifications may be made within the scope of the embodiments herein without departing from the spirit thereof, and the embodiments herein include all such modifications.
ADVANTAGEOUS EFFECTS OF THE INVENTION
[0018] The system can be applied to all types of educational content delivery such as for students in schools and colleges, in companies for employees training, in professional conferences for talks by eminent people etc.
[0019] The system is not only applicable for direct (in presence) presentation, but it also applicable for virtual online presentations which is becoming more prevalent now-a-days.
[0020] The importance and advantage of the system is increased further when it's applied to virtual teaching/training presentations because there is complete coherence or correlation between presenter's words and actions in virtual mode too. The eye-to-ear co-ordination and perception/understanding of the talk is increased for the audience. Without presenter's actions or gestures (live highlighting, editing, free-hand sketching etc.) to see, the talks cannot be easily followed or easily understood by the audience and hence the efficiency/outreach of the presentations is greatly decreased.
[0021] The invented system is only a low-cost system which is affordable and appealing to all class of audience including rural audience who will find live and interactive editing to be graphically intuitive to understand.
[0022] The invented system is completely wireless and non-contact and the presenter has the full flexibility to move freely around the room while at the same time present and edit/free-hand sketch PPT content in real-time. The invented system does not restrict free interaction and movement of the speaker.
BRIEF DESCRIPTION OF THE DRAWINGS
[0023] The other objects, features and advantages will occur to those skilled in the art from the following description of the preferred embodiment and the accompanying drawings in which;
[0024] FIG 1 represents a graphical illustration of the real-time and interactive PPT content creation/editing system for smart educational content delivery.
[0025] FIG 2 represents a block diagram of the real-time and interactive PPT content creation/editing system for smart educational content delivery.
[0026] Fig. 3 represents a flow chart of the real-time and interactive PPT content creation/editing system for smart educational content delivery.
[0027] Although the specific features of the present invention are shown in some drawings and not in others.
[0028] This is done for convenience only as each feature may be combined with any or all of the other features in accordance with the present invention.
DESCRIPTION OF EMBODIMENTS
[0029] In the following detailed description, a reference is made to the accompanying drawings that form a part hereof, and in which the specific embodiments that may be practiced is shown by way of illustration. These embodiments are described in sufficient detail to enable those skilled in the art to practice the embodiments and it is to be understood that other changes may be made without departing from the scope of the embodiments. The following detailed description is therefore not to be taken in a limiting sense. The various embodiments of the present invention provide a medium frequency induction hardening for induction hardening components of smaller dimension.
[0030] The various embodiments of the present invention disclose a system that enables real-time,
interactive and live editing/free-hand sketching of educational presentation (PPT) content in a wireless and
non-contact manner, the system comprising: A smart device (Laptop, tablet, mobile or PC etc.), An optical pointer and a monitoring device with an optical camera and a projector, Wherein the smart device is connected to monitoring device with a built-in camera which records the light movements of the optical pointer in real-time. The built-in camera of the smart device has a field of view that covers the full displayed PPT size.
[0031] According to an embodiment of the present invention the optical pointer consists of buttons to navigate the PPT slides which is Bluetooth connected to the smart device. A long press of one of the buttons indicates "Erase mode". (b) In the erase mode, the presenter as before focuses the light on the wall and he can do a "Cross mark" or "Erase gesturing action". The software part described below captures this action and erases that specific overlaid content and to revert back the "erase mode", a long press needs to be done again. Further the optical pointer such as LED pointer or
Laser Pointer, the light of the pointer is focused on the projected wall by the user and various hand gestures are made through the pointer as writing/drawing on a piece of paper or blackboard.
[0032] According to an embodiment of the present invention the smart device is provided with a pre-deposited instruction to mimic the movement of the light movements recorded by the Optical camera and overlays these light movements onto the PPT slide.
[0033] According to an embodiment of the present invention, the pre-deposited instruction is custom written software written using high level languages runs on the background in the smart device. This software gets information of the light movements from the monitoring system and overlays these light movements onto the PPT slide.
[0034] According to an embodiment of the present invention, the screen size of the smart device is mapped to the size of the projector wall at pixel level by the software plug-in once at the start of the presentation. Further the light movements are recorded by the monitoring device with the built in camera, wherein transmits to smart device as input by the software plug-in. The light movements will be recorded as dynamic movement from pixel to pixel. After screen-to-screen pixel remapping is done, the remapped movements are then overlaid using pen or pencil sketch on the PPT slide.
[0035] According to the embodiment of the present invention, the software plug-in functions in edit/erase mode. In edit mode, pencil or pen sketch is overlaid on the PPT slide. In the erase mode, the overlaid sketch is removed. The two modes are differentiated by "long press" of the optical pointer navigation buttons. For the erase mode to function properly, the software plugin saves or remembers the previously overlaid content. Further the software plug-in is also programmed to include an advanced graphics mode. In this mode, apart from the simple edit/erase functions, a small palette to choose color, built-in shapes and symbols etc. is included.
[0036] According to an embodiment of the present invention, the smart device such as Laptop, tablet, mobile or PC etc. is connected to a projector wherein it projects an offline created PPT on the display wall. The user explains the contents of the displayed PPT. The optical pointer such as the LED optical pointer for pinpointing specific content in the PPT, the user by means of the system do free-hand sketches on the PPT (Examples: circle certain content to highlight, tick or wrong mark certain things, even free-hand write some text etc.), in real-time and to perform real-time, interactive editing/free-hand sketches or drawing on the displayed PPT contentWhenever the presenter wants to highlight some PPT content, he performs hand gestures using the LED pointer. The hand gestures are displayed on the wall as light movements.
[0037] It is noted that the above-described examples of the present invention is for the purpose of illustration only. Although the present invention has been described in conjunction with a specific example thereof, numerous modifications may be possible without materially departing from the teachings and advantages of the subject matter described herein. Other substitutions, modifications and changes may be made without departing from the spirit of the present solution. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and/or all of the steps of any method or process so disclosed, may be combined in any combination, except combinations where at least some of such features and/or steps are mutually exclusive.
[0038] Although the embodiments herein are described with various specific embodiments, it will be obvious for a person skilled in the art to practice the embodiments herein with modifications.
[0039] It is to be understood that the phraseology or terminology employed herein is for the purpose of description and not of limitation. Therefore, while the embodiments herein have been described in terms of preferred embodiments, those skilled in the art will recognize that the embodiments herein can be practiced with modifications. However, all such modifications are deemed to be within the scope of the claims.

Claims (4)

1. A Wireless System for Real-Time and Interactive Free-Hand Sketching/Editing of PPT, the system comprising;
a smart device, a monitoring device with a built-in camera, an optical pointer and a projector wherein the smart device is connected to monitoring device with a built-in camera which records the light movements of the optical pointer in real-time. wherein the smart device is characterized with a pre-deposited instruction to mimic the movement of the light movements recorded by the Optical camera and overlays these light movements onto the PPT slide.
2. The system as claimed in claim 1 wherein the built-in camera of the monitoring device is connected to the smart device has a field of view that covers the full displayed PPT size and records the movement and transmit to the smart device.
3. The system as claimed in claim 1, the optical pointer consists of buttons to navigate the PPT slides which is connected via bluetooth to the smart device wherein the light of the pointer is focused on the projected wall by the user and various hand gestures are made through the pointer for writing/drawing/deleting.
4. The system as claimed in claim 1, the screen size of the smart device is mapped to the size of the projector wall at pixel level by the software plug-in once at the start of the presentation. Further the light movements are recorded by the monitoring device with the built-in camera, wherein transmits to smart device as input by the software plug-in wherein, the light movements will be recorded as dynamic movement from pixel to pixel after screen-to-screen pixel remapping is done, the remapped movements are then overlaid using pen or pencil sketch on the PPT slide.
AU2021103434A 2021-06-17 2021-06-17 A wireless system for real-time and interactive free-hand sketching/editing of ppt Ceased AU2021103434A4 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2021103434A AU2021103434A4 (en) 2021-06-17 2021-06-17 A wireless system for real-time and interactive free-hand sketching/editing of ppt

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
AU2021103434A AU2021103434A4 (en) 2021-06-17 2021-06-17 A wireless system for real-time and interactive free-hand sketching/editing of ppt

Publications (1)

Publication Number Publication Date
AU2021103434A4 true AU2021103434A4 (en) 2022-03-31

Family

ID=80855669

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2021103434A Ceased AU2021103434A4 (en) 2021-06-17 2021-06-17 A wireless system for real-time and interactive free-hand sketching/editing of ppt

Country Status (1)

Country Link
AU (1) AU2021103434A4 (en)

Similar Documents

Publication Publication Date Title
US9164590B2 (en) System and method for automated capture and compaction of instructional performances
Anderson et al. Use of classroom presenter in engineering courses
US20120254773A1 (en) Touch screen based interactive media sharing
AU2021261950A1 (en) Virtual and augmented reality instruction system
CN102903265A (en) Method for automatically recording classroom teaching
Chen et al. Ivrnote: design, creation and evaluation of an interactive note-taking interface for study and reflection in vr learning environments
CN102722336A (en) Office wireless speaking system and synchronous tracking method for synchronous tracking of editing and demonstration operation
Maclaren The new chalkboard: the role of digital pen technologies in tertiary mathematics teaching
Rogers et al. Integrating a Single Tablet PC in Chemistry, Engineering, and Physics Courses.
KR20170098617A (en) Customized training service level management system and method using a digital pen and a cloud server
AU2021103434A4 (en) A wireless system for real-time and interactive free-hand sketching/editing of ppt
Muehlbradt et al. Exploring the design of audio-kinetic graphics for education
Toto et al. One step beyond: Lecturing with a tablet pc
CN100370396C (en) Intelligent computer and device for displaying mark position and playing device for playing filmslide
Friedland et al. Educational multimedia systems: the past, the present, and a glimpse into the future
Fu et al. Research on remote learning in multimodal interaction
KR20130113218A (en) A electronic note function system and its operational method thereof
KR101632174B1 (en) Method for producing educational material and educational material system
Lui et al. Gesture-Based interaction for seamless coordination of presentation aides in lecture streaming
Xiang et al. Use of wireless tablet PCs as an effective learning and teaching enhancement tool
McCorkle et al. The Lightboard: A faculty introduction to the development of supplemental learning media
Behm et al. Enhancing accessibility of engineering lectures for deaf & hard of hearing (DHH): real-time tracking text displays (RTTD) in classrooms
Maclaren Enhancing the teaching of mathematically intensive STEM disciplines at a tertiary level through the use of pen-enabled tablet PCs
Gale et al. Teaching a foreign language with video podcast assignments: Examples from an American Sign Language course
Di Mascio Teaching Architectural Design in a Time of Change: Digital Tools and Methodologies

Legal Events

Date Code Title Description
FGI Letters patent sealed or granted (innovation patent)
MK22 Patent ceased section 143a(d), or expired - non payment of renewal fee or expiry