CN107424215A - A kind of interactive digital scribble system - Google Patents

A kind of interactive digital scribble system Download PDF

Info

Publication number
CN107424215A
CN107424215A CN201710546177.5A CN201710546177A CN107424215A CN 107424215 A CN107424215 A CN 107424215A CN 201710546177 A CN201710546177 A CN 201710546177A CN 107424215 A CN107424215 A CN 107424215A
Authority
CN
China
Prior art keywords
scribble
module
image
coordinate
infrared
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710546177.5A
Other languages
Chinese (zh)
Inventor
朱伟豪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Mengba Mdt Infotech Ltd
Original Assignee
Guangzhou Mengba Mdt Infotech Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Mengba Mdt Infotech Ltd filed Critical Guangzhou Mengba Mdt Infotech Ltd
Priority to CN201710546177.5A priority Critical patent/CN107424215A/en
Publication of CN107424215A publication Critical patent/CN107424215A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)

Abstract

The present invention relates to image processing field, a kind of interactive digital scribble system is specifically disclosed, camera scan module, scanner scanning module and electronics canvas module including obtaining scribble image, the scribble image processing module handled scribble image, threedimensional model display module, system display module, infrared pick-up head coordinate transferring, infrared ray identification equipment coordinate transferring, interactive trigger module.It is an advantage of the invention that newly-increased electronics painting canvas, remains the interest that scribble is started;Using image processing techniques and threedimensional model, solid, dynamic scribble are shown by projecting apparatus or display screen;By the improvement to painting canvas of scribbling, the interest that scribble is started is remained;Using infrared ray identification technology, increase newly interactive with people.

Description

A kind of interactive digital scribble system
Technical field
The present invention relates to image processing field, particularly relates to a kind of interactive digital scribble system.
Background technology
Scribble refers generally to scrawl the image or picture write without basis on wall, is one of key element of hip-hop four, roadside culture it is important Part.Tradition scribble is scribbled, in a manner of plane, static on wall in the above typically using wall as painting canvas Show.See in a sense, scribble also have it is certain destructive and dangerous, especially may and city management Personnel clash.
Scribble is as one of mode for being easiest to attracting sight, in public places or in business activity, energy of scribbling Play increase flow of the people effect.But because the job step for making wall scribble is more and cumbersome, worked caused by renewal iteration Amount is big, meanwhile, antigraffiti effect is also confined to static state.At present, also have digital scribble, can will scribble directly by projecting apparatus or Display screen is shown, reduce renewal iteration caused by workload, but the flatness due to scribble, nature static and with people without It is interactive, it is impossible to meet the needs of public place or business activity institute are to flow of the people.
Ordinary numbers scribble directly shows scribble, and centre have ignored " painting " this very the key link.Reduce scribble Interest and it is interactive with people.Meanwhile plane, static scribble really degree scribbled than threedimensional model dynamic it is low.
The content of the invention
It is an object of the invention to provide a kind of interactive digital scribble system, electronics painting canvas is increased newly, remain what scribble was started It is interesting;Using image processing techniques and threedimensional model, solid, dynamic scribble are shown by projecting apparatus or display screen;It is logical The improvement to painting canvas of scribbling is crossed, remains the interest that scribble is started;Using infrared ray identification technology, the interaction with people has been increased newly Property.
To achieve these goals, present invention employs following technical scheme:A kind of interactive digital scribble system, including Camera scan module, scanner scanning module and the electronics canvas module of scribble image are obtained, scribble image is handled Scribble image processing module, threedimensional model display module, system display module, infrared pick-up head coordinate transferring is red Outside line identification equipment coordinate transferring, interactive trigger module;
Camera scan module:The real-time pictures for including scribble are obtained using camera, and are saved in computer, it is to be coated Crow image processing module uses;
Scanner scanning module:Material object scribble is saved in computer using scanner, image processing module to be scribbled Use;
Electronics canvas module:The module can be made as moving APP, the scribble that will be scribbled on mobile phone or flat board, pass through nothing Gauze network is sent to scribble image processing module, and image processing module to be scribbled uses;
Scribble image processing module:Scribble image is handled using OpenCV, finally giving can be in threedimensional model The image used on display module;
Threedimensional model display module:By in the scribble image assignment after processing to threedimensional model, and threedimensional model is shown Onto the interface of system display module;
System display module:Show that threedimensional model is scribbled using display screen or projecting apparatus;
Infrared ray identification equipment coordinate transferring:Two-dimensional space coordinate is got using infrared ray identification equipment, is passed through Coordinate transformation, current screen coordinate is converted to, treats that interactive trigger module uses;
Interactive trigger module:According to the screen coordinate got, the program event of correspondence position is triggered.
Wherein, processing of the scribble image processing module to image of scribbling includes expansion process, binary conversion treatment, edge Detection, image outline segmentation and extraction, image level correction, image deformity correction.
Wherein, the infrared ray identification equipment coordinate transferring includes infrared pick-up head coordinate transferring, infrared Line radar fix modular converter.
Wherein, the infrared radar coordinate transferring includes infrared radar, and two are got using infrared radar Dimension space coordinate, according to radar fix rule, by coordinate transformation, current screen coordinate is converted to, treats that interactive trigger module makes With.
Wherein, the infrared pick-up head coordinate transferring includes infrared pick-up head, is obtained using infrared pick-up head The infrared coordinate point in REAL TIME INFRARED THERMAL IMAGE picture is taken, infrared coordinate point is converted into current screen coordinate using OpenCV, treats interaction Trigger module uses.
The beneficial effects of the present invention are:The present invention uses a kind of improved image processing techniques, with reference to threedimensional model and Infrared ray identification technology, by scanner, the first-class external input device of shooting, scribble is digitized, finally with dynamic three-dimensional Model, shown and scribbled by output equipments such as projecting apparatus or display screens.And by infrared ray identification technology, people can be with three-dimensional Model carries out interactive.
Improve the painting canvas form of scribble, increase electronics painting canvas newly, be no longer limited to it is traditional scribble material, in mobile phone and It can all be scribbled on tablet personal computer.
Brief description of the drawings
Technical scheme in order to illustrate the embodiments of the present invention more clearly, it is required in being described below to embodiment to use Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only the present invention in order to illustrate more clearly of this hair Bright embodiment or technical scheme of the prior art, below by the required accompanying drawing used in embodiment or description of the prior art It is briefly described, for those of ordinary skill in the art, on the premise of not paying creative work, can also basis These accompanying drawings obtain other accompanying drawings.
Fig. 1 is the scribble image processing flow figure of this scribble system;
Fig. 2 is the interactive processing flow chart of this scribble system.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.It is based on Embodiment in the present invention, those of ordinary skill in the art are obtained every other under the premise of creative work is not made Embodiment, belong to the scope of protection of the invention.
A kind of interactive digital scribble system as shown in Fig. 1~2, including the camera scan module of acquisition scribble image, Scanner scanning module and electronics canvas module, the scribble image processing module handled scribble image, threedimensional model show Show module, system display module, infrared pick-up head coordinate transferring, infrared ray identification equipment coordinate transferring, interaction Trigger module.
Camera scan module:The real-time pictures for including scribble are obtained using camera, and are saved in computer, it is to be coated Crow processing module uses.
Scanner scanning module:Material object scribble is saved in computer using scanner, processing module to be scribbled uses.
Electronics canvas module:The functional module can be made as moving APP, the scribble that will be scribbled on mobile phone or flat board, lead to Cross wireless network and be sent to interactive digital scribble system, image processing module to be scribbled uses.
Scribble image processing module:Expansion process, binary conversion treatment, rim detection are carried out to scribble image using OpenCV (accumulated probability Hough transformation), image outline split with extraction, the correction of image deformity correction, image level, finally giving can be with The image used on threedimensional model.
Threedimensional model display module:By in the scribble image assignment after processing to threedimensional model, and threedimensional model is shown Onto interactive digital scribble system interface.
System display module:Interactive digital scribble system interface is shown using display screen or projecting apparatus.
The infrared ray identification equipment coordinate transferring includes infrared pick-up head coordinate transferring, infrared radar Coordinate transferring.
Infrared pick-up head coordinate transferring:The infrared coordinate in REAL TIME INFRARED THERMAL IMAGE picture is obtained using infrared pick-up head Point, infrared coordinate point is converted into current screen coordinate using OpenCV, treats that interactive trigger module uses.
OpenCV (Open Source Computer Vision Library) be one based on (increasing income) distribution across flat Platform computer vision storehouse, it may operate in Linux, Windows and Mac OS operating systems.Its lightweight and efficiently, by A series of C functions and a small amount of C++ class are formed, while provide the interface of the language such as Python, Ruby, MATLAB, realize figure As many general-purpose algorithms in terms of processing and computer vision.
Infrared radar coordinate transferring:Two-dimensional space coordinate is got using infrared radar, according to radar fix Rule, by coordinate transformation, current screen coordinate is converted to, treats that interactive trigger module uses.
Interactive trigger module:According to the screen coordinate got, the program event of correspondence position is triggered.Such as:Play three Dimension module animation, moving three dimension model and scaling threedimensional model etc..
It is right using improved image processing techniques after obtaining scribble by external input device, mobile phone or tablet personal computer Scribble is extracted, identified, being corrected, and then shows scribble on threedimensional model.It is (infrared by infrared ray identification equipment Line radar, infrared pick-up head) coordinate points are obtained, improved coordinate treatment technology, effective screen coordinate point is converted into, Realize the interactive event in corresponding screen coordinate point.
Obtained by external equipments such as camera, scanners and applied the scribble finished writing, can also be in mobile phone, tablet personal computer Directly scribble, generation scribble, then scribble is digitized, by image processing techniques, scribble is shown on threedimensional model.Adopt With infrared ray identification technology, infrared detection is carried out to projection wall or display screen, whenever someone touches wall or display , all can be in the location triggered response events during screen, threedimensional model can respond corresponding event, so as to reach interaction effect.
The newly-increased electronics painting canvas of the present invention, can be scribbled by mobile phone, tablet personal computer, remain the interest that scribble is started. Three-dimensional, dynamic threedimensional model scribble is realized using image processing techniques and threedimensional model, effectively can be obtained external equipment Scribble be converted into image workable for threedimensional model, using threedimensional model, scribble is more three-dimensional, lively.Meanwhile by projecting apparatus Or display screen displaying scribble is eliminated to be scribbled using wall and updates job step caused by iteration.Skill is identified using infrared ray Art, scribble and the interaction of people are increased newly.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all essences in the present invention God any modification, equivalent substitution and improvements made etc., should be included in the scope of the protection with principle.

Claims (5)

  1. The system 1. a kind of interactive digital is scribbled, it is characterised in that:Camera scan module, scanner including obtaining scribble image Scan module and electronics canvas module, the scribble image processing module handled scribble image, threedimensional model display module, System display module, infrared pick-up head coordinate transferring, infrared ray identification equipment coordinate transferring, interactive trigger mode Block;
    Camera scan module:The real-time pictures for including scribble are obtained using camera, and are saved in computer, treat scribble figure As processing module uses;
    Scanner scanning module:Material object scribble is saved in computer using scanner, image processing module to be scribbled uses;
    Electronics canvas module:The module can be made as moving APP, the scribble that will be scribbled on mobile phone or flat board, pass through wireless network Network is sent to scribble image processing module, and image processing module to be scribbled uses;
    Scribble image processing module:Scribble image is handled using OpenCV, finally giving can show in threedimensional model The image used in module;
    Threedimensional model display module:By in the scribble image assignment after processing to threedimensional model, and threedimensional model is shown to and is Unite on the interface of display module;
    System display module:Show that threedimensional model is scribbled using display screen or projecting apparatus;
    Infrared ray identification equipment coordinate transferring:Two-dimensional space coordinate is got using infrared ray identification equipment, passes through coordinate Conversion, is converted to current screen coordinate, treats that interactive trigger module uses;
    Interactive trigger module:According to the screen coordinate got, the program event of correspondence position is triggered.
  2. A kind of 2. interactive digital scribble system according to claim 1, it is characterised in that:The scribble image processing module Processing to image of scribbling includes expansion process, binary conversion treatment, rim detection, image outline segmentation and extraction, image level Correction, image deformity correction.
  3. A kind of 3. interactive digital scribble system according to claim 1, it is characterised in that:The infrared ray identification equipment is sat Marking modular converter includes infrared pick-up head coordinate transferring, infrared radar coordinate transferring.
  4. A kind of 4. interactive digital scribble system according to claim 3, it is characterised in that:The infrared radar coordinate turns Mold changing block includes infrared radar, and two-dimensional space coordinate is got using infrared radar, according to radar fix rule, passes through seat Subscript conversion, current screen coordinate is converted to, treats that interactive trigger module uses.
  5. A kind of 5. interactive digital scribble system according to claim 3, it is characterised in that:The infrared pick-up head coordinate Modular converter includes infrared pick-up head, obtains the infrared coordinate point in REAL TIME INFRARED THERMAL IMAGE picture using infrared pick-up head, uses Infrared coordinate point is converted to current screen coordinate by OpenCV, treats that interactive trigger module uses.
CN201710546177.5A 2017-07-06 2017-07-06 A kind of interactive digital scribble system Pending CN107424215A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710546177.5A CN107424215A (en) 2017-07-06 2017-07-06 A kind of interactive digital scribble system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710546177.5A CN107424215A (en) 2017-07-06 2017-07-06 A kind of interactive digital scribble system

Publications (1)

Publication Number Publication Date
CN107424215A true CN107424215A (en) 2017-12-01

Family

ID=60427456

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710546177.5A Pending CN107424215A (en) 2017-07-06 2017-07-06 A kind of interactive digital scribble system

Country Status (1)

Country Link
CN (1) CN107424215A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110163942A (en) * 2018-07-18 2019-08-23 腾讯科技(深圳)有限公司 A kind of image processing method and device
CN113342165A (en) * 2021-05-31 2021-09-03 关键 Natural display system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201181561Y (en) * 2008-04-24 2009-01-14 黄振武 Interactive glass image system
CN202422001U (en) * 2011-12-15 2012-09-05 西安天动数字科技有限公司 Interactive graffiti entertainment system
CN105653036A (en) * 2015-12-31 2016-06-08 深圳市路通网络技术有限公司 Scrawling augmented reality method and system
CN105854296A (en) * 2016-04-21 2016-08-17 苏州探寻文化科技有限公司 Interactive experience system based on augmented reality
CN106814963A (en) * 2016-12-15 2017-06-09 苏州大学 A kind of human-computer interaction system and method based on 3D sensor location technologies

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201181561Y (en) * 2008-04-24 2009-01-14 黄振武 Interactive glass image system
CN202422001U (en) * 2011-12-15 2012-09-05 西安天动数字科技有限公司 Interactive graffiti entertainment system
CN105653036A (en) * 2015-12-31 2016-06-08 深圳市路通网络技术有限公司 Scrawling augmented reality method and system
CN105854296A (en) * 2016-04-21 2016-08-17 苏州探寻文化科技有限公司 Interactive experience system based on augmented reality
CN106814963A (en) * 2016-12-15 2017-06-09 苏州大学 A kind of human-computer interaction system and method based on 3D sensor location technologies

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110163942A (en) * 2018-07-18 2019-08-23 腾讯科技(深圳)有限公司 A kind of image processing method and device
CN110163942B (en) * 2018-07-18 2023-02-14 腾讯科技(深圳)有限公司 Image data processing method and device
CN113342165A (en) * 2021-05-31 2021-09-03 关键 Natural display system

Similar Documents

Publication Publication Date Title
CN101189570B (en) Image displaying apparatus
US20170372449A1 (en) Smart capturing of whiteboard contents for remote conferencing
CN106816077A (en) Interactive sandbox methods of exhibiting based on Quick Response Code and augmented reality
CN109815843A (en) Object detection method and Related product
CN108919955B (en) Virtual sand painting interaction combination method based on multi-body feeling equipment
JP2006189712A (en) Information presenting apparatus, information presenting method and program
CN104052976A (en) Projection method and device
CN107423008A (en) A kind of multi-cam picture fusion method and scene display device in real time
CN108989678A (en) A kind of image processing method, mobile terminal
CN102298786A (en) Virtual drawing implementation device and method for the same
CN107424215A (en) A kind of interactive digital scribble system
US20170315609A1 (en) Method for simulating and controlling virtual sphere in a mobile device
CN107862713A (en) Video camera deflection for poll meeting-place detects method for early warning and module in real time
CN109669537B (en) A kind of man-machine interactive system based on computer virtual interface
CN109376618A (en) Image processing method, device and electronic equipment
CN101581998B (en) Infrared ray and double-camera combined multipoint positioning touch device and method thereof
CN108234932B (en) Method and device for extracting personnel form in video monitoring image
CN210691314U (en) Access control system and login device based on in vivo detection
CN111641860A (en) Curtain wall display control method, control device, computer equipment and storage medium
CN107864333A (en) Image processing method, device, terminal and storage medium
CN109885172B (en) Object interaction display method and system based on Augmented Reality (AR)
WO2021035674A1 (en) Image generating method and apparatus, movable platform, and storage medium
CN203117946U (en) Mobile terminal
US20170169572A1 (en) Method and electronic device for panoramic video-based region identification
KR102103614B1 (en) A method for shadow removal in front projection systems

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20171201

RJ01 Rejection of invention patent application after publication