CN104461318B - Reading method based on augmented reality and system - Google Patents
Reading method based on augmented reality and system Download PDFInfo
- Publication number
- CN104461318B CN104461318B CN201310669737.8A CN201310669737A CN104461318B CN 104461318 B CN104461318 B CN 104461318B CN 201310669737 A CN201310669737 A CN 201310669737A CN 104461318 B CN104461318 B CN 104461318B
- Authority
- CN
- China
- Prior art keywords
- image
- visual marker
- augmented reality
- point
- chosen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/14—Image acquisition
- G06V30/142—Image acquisition using hand-held instruments; Constructional details of the instruments
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of reading method and system based on augmented reality, the main technical schemes being related to include：Image is taken in image acquisition units, and at least selected frame images above being ingested in image, and, more than one visual marker is loaded on chosen image, it allows users to touch one of those above visual marker by selected and point, to which output is at least to the service request that obtains resource corresponding with chosen visual marker and/or at least making selected functional unit execute the control instruction of selected action.The present invention by using the augmented reality based on image recognition, can by arbitrary books, object or scene combination diversified forms multimedia messages and show, to give the more good and interactive experience of user.
Description
Technical field
The present invention relates to a kind of reading method and systems, more particularly to a kind of to be based on image recognition augmented reality（AR）
Intelligent point-reading system and method, belong to augmented reality and image identification technical field.
Background technology
Point-of-reading system（For example, point reader and talking pen etc.）It is modern digital information technology and newest teaching demand perfection knot
A kind of sound interactive learning product closed, it can become textual books teaching material can need having for arbitrary sounding by study
Sound teaching material.
Wherein, talking pen is audio files to be implanted into books, user using the technology for adding print Quick Response Code on books
Certain one page that Selective artery embolization is read in use, at will clicks the contents such as pattern, word, the number on this page, talking pen is all
The audio files of corresponding content can be read by the way that the high speed camera assembled in nib identifies bookish Quick Response Code.
And the principle that point reader uses is to pre-set corresponding books to pronunciation file in making file processes
" the longitude and latitude position " of content.Textbook is placed on machine tablet by user, with the bookish word of dedicated pen point, picture, number
The contents such as word, machine will send out corresponding sound.
But the content and form of existing point-of-reading system is very dull, and what user can only be passive receives information, therefore
User can not be given（Especially child or certain special populations）Good experience.
Invention content
In view of this, it is an object of the present invention to provide a kind of reading method based on augmented reality, behaviour
Make simplicity, user can be given and have more the sense of reality, and interactive good experience.
To achieve the goals above, technical solution provided by the invention is as follows：
A kind of reading method based on augmented reality, including：
Image, and at least selected frame images above being ingested in image are taken in image acquisition units,
And more than one visual marker is loaded on chosen image, it allows users to touch by selected and point
One of those above visual marker, to which output is at least obtaining the clothes of resource corresponding with chosen visual marker
It is engaged in asking and/or at least executes the selected control instruction acted to make to select functional unit.
Further, this method may also include：One of those above visual marker is touched by selected and point, to obtain
Take and/or play multimedia resource corresponding with chosen visual marker.
Further, this method may also include：One of those above visual marker is touched by selected and point, to defeated
Go out control instruction corresponding with chosen visual marker, selected equipment is made to execute selected action, and/or, receive to select equipment
Output, corresponding with chosen visual marker feedback signal.
Further, this method may also include：
Examination is ingested image, and the selected image for wherein include specific identification information, and adds on chosen image
Carry more than one visual marker.
As one of wherein optional embodiment, this method may also include：
According to the specific identification information, multimedia resource corresponding with chosen image is obtained, and the multimedia provides
There is also correspondences between the visual marker of source and load on chosen image.
Further, this method may include：
It is shot with image acquisition units and/or scans true or dummy object, to take in image；
Alternatively, the image data of computer-reader form is received with image acquisition units, to take in image.
As more one of preferred embodiment, this method further includes：Load is corresponding on chosen image increases
Strong reality view.
Further, this method may also include：At least by chosen image and/or more matchmakers corresponding with chosen image
Body resource is stored in local and/or high in the clouds storage unit.
As the typical embodiment case of one of which, it is somebody's turn to do the reading method based on augmented reality and may include walking as follows
Suddenly：
S1. more than one printed articles and more than one multimedia resources are provided, and in selected printed article and selected multimedia
Correspondence is established between resource；
S2. a printed article is selected, and obtains multimedia resource corresponding with the printed article；
S3. the image for selecting the page in the printed article is taken in image acquisition units, and is loaded on the image of the page
More than one visual marker；
S4. it selectes and puts and touch one of those above visual marker, it is corresponding to chosen visual marker to play
Multimedia resource.
Another object of the present invention is to provide a kind of point-of-reading systems based on augmented reality comprising：
Image acquisition units, at least taking in image；
Point reads unit, at least to screen and select the frame images above being ingested in image, and in chosen image
Upper more than one visual marker of load allows users to touch one of those above visual marker by selected and point, from
And it exports at least to the service request that obtains resource corresponding with chosen visual marker and/or at least making selected work(
It can the selected control instruction acted of unit execution.
Functions described herein unit can be selected from certain physical machines by electric drive, hydraulic-driven or air stream drives
Tool etc. also can be certain virtual units, and without being limited thereto.
Further, described image collecting unit includes：
Can captured in real-time and/or scanning is true and/or dummy object, and obtain the element of image,
Alternatively, the image data of computed readable form can be received, to obtain the element of image.
Further, it is integrally disposed in a terminal to read unit for described image collecting unit and point,
Alternatively, described image collecting unit and point read discrete units setting, and connected through communication module.
As one of optional embodiment, the point-of-reading system may also include：
Storage unit is at least deposited to store the image being ingested and/or multimedia resource corresponding with chosen image
It is stored in local and/or high in the clouds.
Further, the point reading unit includes：
Display unit, at least to show the image being ingested,
Data processing unit, at least to from screening and selected be ingested more than the frame in image in the image being ingested
Image, and more than one visual marker is loaded on chosen image, and the tactile operational order of point of user is received and handles,
To realize multimedia acquisition and/or broadcasting,
And touch control operation unit, at least with allowing the user to touch more than one visual marker by selected and point
And send out a little tactile operational order.
As more one of preferred embodiment, the display unit and touch control operation unit are integrally disposed in a touch-control
In display unit.
Further, it includes finger touching operation, gesture identification operation, mouse touching behaviour that the point in this method, which touches mode,
Make, pen operation or the touching operation of class object can be touched, but not limited to this.
Further, the multimedia resource is at least selected from character, document, figure, audio, video, dummy model or super
Grade link, but not limited to this.
Further, the multimedia resource may also include augmented reality view.
Further, described image collecting unit includes image camera-shooting and recording device（Such as camera, video camera, camera）Or
Scanner.
Compared with prior art, the present invention at least has the advantages that：By using the enhancing based on image recognition
Reality technology, can by arbitrary books, object or scene combination diversified forms multimedia messages and show, to give user
More good and interactive experience.
Description of the drawings
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments described in invention, for those of ordinary skill in the art, without creative efforts,
Other drawings may also be obtained based on these drawings.
Fig. 1 is a kind of schematic diagram of the reading method based on augmented reality in an exemplary embodiments of the invention；
Fig. 2 is a kind of structure diagram of the point-of-reading system based on augmented reality in one embodiment of this invention；
Fig. 3 is a kind of flow chart of the reading method based on augmented reality in one embodiment of this invention；
Fig. 4 is the particular flow sheet that touch event is executed in a specific embodiment of the invention.
Specific implementation mode
In order to make those skilled in the art more fully understand the technical solution in the present invention, below in conjunction with of the invention real
The attached drawing in example is applied, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described implementation
Example is only a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, this field is common
The every other embodiment that technical staff is obtained without making creative work, should all belong to protection of the present invention
Range.
One aspect of the present invention provides a kind of reading method based on augmented reality, including：
Image, and at least selected frame images above being ingested in image are taken in image acquisition units,
And more than one visual marker is loaded on chosen image, it allows users to touch by selected and point
One of those above visual marker, to which output is at least obtaining the clothes of resource corresponding with chosen visual marker
It is engaged in asking and/or at least executes the selected control instruction acted to make to select functional unit.
Another aspect provides a kind of point-of-reading systems based on augmented reality comprising：
Image acquisition units, at least taking in image；
Point reads unit, at least to screen and select the frame images above being ingested in image, and in chosen image
Upper more than one visual marker of load allows users to touch one of those above visual marker by selected and point, from
And it exports at least to the service request that obtains resource corresponding with chosen visual marker and/or at least making selected work(
It can the selected control instruction acted of unit execution.
Wherein, as a kind of feasible embodiment, the present invention can be by being shot with image acquisition units and/or being scanned
True or dummy object, to take in image.
It more specifically says, process may include：With with entity image camera-shooting and recording device or scanning device shooting or
True or dummy object is scanned, for example, picture, books, model or certain scenes, to take in image；
Alternatively, shot with virtual image camera-shooting and recording device or scanning device or scan dummy object, to take in image, this
Kind mode can be applied in the virtual environments such as online game.
Wherein, typical described image collecting unit may include image camera-shooting and recording device（Such as camera, video camera, photograph
Machine etc.）, scanner etc., but not limited to this.
And as another feasible embodiment, the present invention also can be computer-readable by being received with image acquisition units
The image data of form, to take in image.
In other words, the present invention can also belong to or the non-true or virtual image for belonging to point-of-reading system of the present invention takes in equipment
Or after scanning device obtains image, the image acquisition units of the present invention are transmitted further to, to complete the intake of image.
This embodiment is particularly suitable to need to obtain image from distal end, and needs to read in the point for locally completing point read operation
System needs to carry out particular device, place for example, in the special occasions operation such as mine, construction site, sea or space
Telesecurity monitors or the situation of operation.
Obvious, to reach such purpose, it usually needs read that communication is arranged between unit in image acquisition units and point
Module enables the rwo to realize interaction of data etc..
Further, the selection standard of particular picture can be pre-established in the present invention, for example, can prespecified institute
The specific identification information that should include in the picture to be chosen, for example, specific word or code（Such as bar code, Quick Response Code）, it is special
Whether fixed graphic structure etc. then, can be by differentiating in image comprising above-mentioned after image acquisition units take in image
Specific identification information therefrom selectes required image.
Further, after selecting out required image, visual marker can be directly loaded on this image, wherein
According to the difference of image, the quantity of visual marker, form and distributing position on the image can respective changes.
It, can also be after selecting out required image, according to the image and as more one of preferred embodiment
Including specific identification information, corresponding augmented reality view is loaded on the image first, for example, threedimensional model, video, dynamic
Draw etc., visual marker is then reloaded, it is of course also possible to load the augmented reality approach and visual marker simultaneously.
Wherein, visual marker can be word, figure（Such as, circle, rectangle, polygon or other arbitrary irregular shapes
The figure of state）, three-dimensional model or dynamic marks, and it is without being limited thereto.
As wherein more one of preferred embodiment, aforementioned visual marker can also be with it is contained on selected digital image
The same or similar figure such as some figures, label, label etc..For example, when taking in a certain authentic item in real time with camera etc.
（For example, a certain books）Specific image（For example, the image of certain one page or the image at a certain visual angle, and exist in the picture
One or more label, for example, the video markers such as the audio indicias such as toy trumpet, video camera）When, then it can add on the specific image
Carry visual marker identical as the mark position on the specific image, homomorphosis（For example, toy trumpet shape, video camera shape can
It is marked depending on changing）, in this way, user extremely convenient can differentiate, choose and play the multimedia resource etc. corresponding to visual marker.
Further, method of the invention may also include：One of those above visual marker is touched by selected and point,
To obtain and/or play multimedia resource corresponding with chosen visual marker.
Further, it can in advance be obtained corresponding to specific image according to specific identification information above-mentioned in the present invention
Multimedia resource, and make between the visual marker of the multimedia resource and load on chosen image that there is also corresponding
Relationship.
The link information for obtaining corresponding multimedia resource or request are used alternatively, can also be loaded in visual marker,
And when point touches visual marker, activate the link information or request, to from local and/or high in the clouds storage unit obtain with
Play multimedia resource.
Therefore, as a more preferred embodiment, it may also include local and/or high in the clouds in point-of-reading system of the invention
Storage unit, or also can be local server and/or cloud server.
Also, it is further, in the present invention, can also at least by chosen image and/or with chosen image phase
The multimedia resource answered is stored in local and/or high in the clouds storage unit.
By previous designs so that point-of-reading system of the invention at least has there are two types of operating mode, including：
1, work online pattern：Image is taken in real time by image acquisition units, and is loaded on image selected wherein
Visable indicia, user touch visable indicia by point, obtain in real time, play multimedia resource；
2, work offline pattern：It has access to and is stored in local chosen image, and load visable indicia on selected digital image,
User touches visable indicia by point, plays be stored in local multimedia resource in real time.
Further, it is aforementioned work offline pattern on the basis of, can also derive sleep operation mode etc., that is, use
Family is stored in local specific image having access to, and puts the visable indicia for touching and loading on the specific image, you can makes a little to touch and is
System voluntarily plays and is stored in local a certain type or the multimedia resource of certain several types.
As more one of preferred embodiment, described image collecting unit and point reading unit can be integrally disposed whole in one
In end.
As one of optional embodiment, the point reads unit and may include：
Display unit, at least to show the image being ingested,
Data processing unit, at least to from screening and selected be ingested more than the frame in image in the image being ingested
Image, and more than one visual marker is loaded on chosen image, and the tactile operational order of point of user is received and handles,
To realize multimedia acquisition and/or broadcasting,
And touch control operation unit, at least with allowing the user to touch more than one visual marker by selected and point
And send out a little tactile operational order.
As more one of preferred embodiment, the display unit and touch control operation unit are integrally disposed in a touch-control
In display unit.
Further, in one embodiment of the invention, which may also include：It is touched by selected and point
In more than one visual marker make to select equipment and hold to export corresponding with chosen visual marker control instruction
The selected action of row, and/or, equipment output, corresponding with chosen visual marker feedback signal is selected in receiving.
For example, for certain mechanical equipments for needing remote control, the design being related to by foregoing embodiments, then,
The image of corresponding mechanical equipment can be taken in real time by certain image camera-shooting and recording devices in local, and controllers pass through remote control
Equipment（Such as, computer system）It is especially corresponding by specific position of the remote control equipment on image after obtaining corresponding image
Visable indicia is loaded in the position of specific position or one or more buttons on the control panel of corresponding mechanical equipment, controls people
Working condition of the member according to shown mechanical equipment in image, can accordingly select and put it is tactile wherein some or it is several can sighting target
Note to send out control instruction, and adjusts the working condition of mechanical equipment in distal end.
The point-of-reading system of the present invention can be realized on each Terminal Type that those skilled in the art note, for example, can be usual
Smart mobile phone, the tablet computer used, PC, the equipment that smart television, Google glasses etc. have multimedia function, but it is unlimited
In this.
Further, it includes finger touching operation, gesture identification operation, mouse touching behaviour that the point in this method, which touches mode,
Make, pen operation or the touching operation of class object can be touched, but not limited to this.
Further, the multimedia resource is at least selected from character, document, figure, audio, video, dummy model or super
Grade link, but not limited to this.
Further, the multimedia resource may also include augmented reality view.
Technical scheme of the present invention is more specifically illustrated below in conjunction with attached drawing and exemplary embodiments.
Refering to fig. 1, in the exemplary embodiments of the present invention, the reading method being related to may include steps of：
（1）User chooses books, and shoots with video-corder the selected page in books in real time with image camera-shooting and recording device, makes the selected page
Image（It can be single-frame images, can also be that the multiple image continuously displayed forms dynamic image or video）Real-time display is in one
On display screen；
（2）Emerge more than one visual marker automatically on the image of the selected page（That is, touch point）；
（3）User touches one of those above visual marker by putting successively, realizes corresponding to each visual marker more
The broadcasting of media information, including word, figure, three-dimensional model, video, audio etc..
Further, in another embodiment of the invention, as shown in fig.2, a kind of its point-of-reading system for being related to can be with
Including：
Camera 10 is taken in the teaching material by the intelligent point-reading system camera and is appointed for obtaining image information
One or more anticipate to obtain image information, which includes arbitrary one page and/or character and/or any one illustration
And/or multiple illustrations and/or one-dimension code and/or Quick Response Code and/or one or more in kind；
Point reads unit, including：
Image processing unit 20 for handling image information, and is transferred to local storage unit and is stored,
Image processing unit 20 is specifically used for：Intake and analysis described image information go forward side by side row matrixization processing, the square
Array processing is specially the image information at standard by the correction of the image information of distortion or deformation；
Multi-media processing unit 30, for handling multimedia resource, processing it is various for learn and/or display and demonstration and/
Or interactive and/or amusement multimedia resource, multimedia resource include 3D models and resource and/or 2D models and resource and/or
Picture and/or button and/or video and/or audio and/or character；
Touch-control processing unit 40, every interactive operation for receiving and handling outer bound pair multimedia resource, interactive operation
It touches and operates including finger, gesture identification operation, mouse touching operation can touch pen operation, the touching operation of class type objects etc.
Other external operations；
Local storage unit 50, for image information, multimedia resource, interactive operation to be locally stored；
Local processing unit 60 carries out logical operation for the information to local storage unit, and logical operation includes local
Change logical operation and online logical operation, specially：
Logical operation is localized, local processing unit is combined according to image processing unit treated image information to be originally located in
Unit searches are managed to corresponding multimedia resource, and a reading logical analysis is carried out to multimedia resource, it will further according to a reading logic
Interactive operation corresponding to touch-control processing unit is associated with corresponding multimedia resource, is finally completed a read operation；
Online logical operation, local processing unit according to image processing unit treated image information request server at
Reason unit carries out the down operation of corresponding multimedia resource, and carries out storage operation by local storage unit, by local
Processing unit carries out a reading logical analysis to the multimedia resource downloaded, further according to reading logic that touch-control processing unit institute is right
The interactive operation answered is associated with corresponding multimedia resource, is finally completed a read operation.
Local processing unit 60 can be additionally used in：
Augmented reality real-time tracing overlap-add operation is carried out to multimedia resource by image processing unit, and at combination of touch control
Reason unit carries out 360 degree of touch control operations to the multimedia resource that augmented reality real-time tracing is superimposed.
Server processing unit 70, the respective services request for responding local processing unit transmission.
Server storage unit 80, for storing image information and multimedia resource.
Further, the number that the sampling of local processing unit 60 and processing local storage unit 50 are stored in present embodiment
According to, and the server processing unit 70 and server storage unit 80 are uploaded, for intelligent point-reading system to popular and/or warp
The push of allusion quotation and/or other the targetedly teaching materials and multimedia resource such as interesting and/or beneficial.
Correspondingly, a kind of reading method realized based on image recognition augmented reality provided in this embodiment can wrap
Include following steps：
S1, camera obtain image information, and image processing unit and multi-media processing unit handle image information,
It obtains multimedia resource and is stored in server storage unit, user downloads the multimedia resource of required point reading extremely as needed
Local storage unit；
There are the pages of intelligent point-reading resource in S2, local processing unit scanning multimedia resource, if including on the page
Do the touch points for interactive operation；
Touch points position on S3, the touching page, local processing unit carry out logical analysis, are touched in touch-control processing unit
Touch event is sent out, shows corresponding multimedia messages.
Further, step S1 includes：
The existing multimedia resource list of automatic refresh requests, is all listed in systems；
The specified multimedia resource of user's selection, with obtaining the download of the corresponding intelligent point-reading resource of the multimedia resource
Location, and resource is downloaded automatically；
Intelligent point-reading resource downloading finishes, automatically use the built-in camera based on image recognition augmented reality into
Row outdoor scene scans.
Further, step S2 includes：
The multimedia resource is turned to the page for possessing intelligent point-reading function by user, which is positioned under camera；
The page of the making intelligent point-reading resource of the multimedia resource is loaded, the current outdoor scene of real time parsing judges current real
Whether scape is the page for making intelligent point-reading resource；
When the page for the making intelligent point-reading resource for tracking the multimedia resource, the page is prompted in camera outdoor scene
The position of the touch points made.
Further, step S3 includes：
Detection touches touch points, obtains the identification marking information of touch points；
It is analyzed and acquired by the corresponding touch event of touch points according to the identification marking information retrieval of touch points；
According to touch event, corresponding multimedia resource is read, executes touch event.
The flow chart of reading method in one embodiment of the invention is shown refering to Fig. 3, including：
The startup of intelligent point-reading system finishes, and refreshes automatically to server and asks existing books the Resources list, in systems
All list；
The specified books of user's selection, system is with asking the download of the corresponding intelligent point-reading resource of the books to server
Location, and resource is downloaded automatically；
The intelligent point-reading resource downloading of the books finishes, built in automatic start up system based on image recognition augmented reality skill
The camera outdoor scene scanning function of art；
The books are turned to the page for possessing intelligent point-reading function by user, which is positioned over the camera shooting of intelligent point-reading system
Under head；
The page of the making intelligent point-reading resource of the intelligent point-reading system loads books, the current outdoor scene of real time parsing judge
Whether current outdoor scene is the page for making intelligent point-reading resource；
When the page for the making intelligent point-reading resource for tracking the books, software has prompted the page in camera outdoor scene
The position of the touch points of making；
Prompt of the user according to point-of-reading system about the position of touch points, using on the tools such as finger or pen touching books
Touch points, trigger touch event, show multimedia messages.
As shown in fig.4, intelligent point-reading system touch event execution flow specifically includes in present embodiment：
Intelligent point-reading system detectio touches touch points, obtains the identification marking information of touch points；
It is analyzed and acquired by the corresponding touch event of touch points according to the identification marking information retrieval of touch points；
According to touch event, corresponding multimedia resource is read, executes touch event.
Touch event includes in present embodiment：It plays audio, display picture, display word, play video, playing model
Animation etc..Whether different events has different event actions, such as play audio, audio volume can be arranged, recycle, intelligence
Can point-of-reading system parse touch event, according to the execution logic of touch event, show and specifies in the specified region of book page
Multimedia messages become textual books teaching material to need the multimedia of arbitrary displaying multimedia messages mutual by study to reach
The purpose of dynamic study course.
As can be seen from the above technical solutions, the present invention is based on the intelligent point-reading systems that image recognition augmented reality is realized
System and method can be realized by using the augmented reality based on image recognition by arbitrary word, patterned books teaching material
Become to need the arbitrary multimedia interaction study course for showing multimedia messages by study.
Compared with prior art, any existing books can be become at once using augmented reality can point by the present invention
The books of reading, do not need special books and point reads equipment（For example point is read and talking pen）, the intelligent hand that commonly uses
Machine, tablet computer, PC, smart television etc. may act as reading equipment, easy to use, be widely used.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er Qie
In the case of without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter
From the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended power
Profit requires rather than above description limits, it is intended that all by what is fallen within the meaning and scope of the equivalent requirements of the claims
Variation is included within the present invention.Any reference signs in the claims should not be construed as limiting the involved claims.
In addition, it should be understood that although this specification is described in terms of embodiments, but not each embodiment is only wrapped
Containing an independent technical solution, this description of the specification is merely for the sake of clarity, and those skilled in the art should
It considers the specification as a whole, the technical solutions in the various embodiments may also be suitably combined, forms those skilled in the art
The other embodiment being appreciated that.
Claims (12)
1. a kind of reading method based on augmented reality, which is characterized in that including：
True or dummy object is shot and/or scanned with image acquisition units；It can alternatively, receiving computer with image acquisition units
The image data of reading form, to take in image, and at least selected frame images above being ingested in image,
And the image that is ingested is screened, and the selected image for wherein including specific identification information, and add on chosen image
More than one visual marker is carried, according to the specific identification information, obtains multimedia resource corresponding with chosen image, according to
According to the difference of image, the quantity of visual marker, form and distributing position on the image can respective change, make the multimedia
Resource and load form the wherein described specific identification information of correspondence and use between the visual marker on chosen image
Any one in bar code, Quick Response Code, text information, graphical information or two or more combinations；
Touch one of those above visual marker by selected and point, may be implemented following the 1. plant or the 2., 3. plant appoint
One or the two combination feedback：1. obtaining and/or playing multimedia resource corresponding with chosen visual marker；2.
Output control instruction corresponding with chosen visual marker makes selected equipment execute selected action；3. receiving selected set
Standby output, corresponding with chosen visual marker feedback signal.
2. the reading method according to claim 1 based on augmented reality, which is characterized in that this method further includes：
Corresponding augmented reality view is loaded on chosen image.
3. the reading method according to claim 1 based on augmented reality, which is characterized in that this method further includes：
Chosen image and/or multimedia resource corresponding with chosen image are at least stored in local and/or high in the clouds and store list
In member.
4. the reading method according to any one of claim 1-3 based on augmented reality, which is characterized in that the party
It includes finger touching operation that point in method, which touches mode, and gesture identification operates, and mouse touching operation can touch pen operation or class object
Body touching operation.
5. the reading method according to any one of claim 1-3 based on augmented reality, which is characterized in that described
Multimedia resource is at least selected from character, document, figure, audio, video, dummy model or hyperlink.
6. the reading method according to claim 5 based on augmented reality, which is characterized in that the multimedia resource
It further include augmented reality view.
7. the reading method according to claim 1 based on augmented reality, which is characterized in that include the following steps：
S1. more than one printed articles and more than one multimedia resources are provided, and in selected printed article and selected multimedia resource
Between establish correspondence；
S2. a printed article is selected, and obtains multimedia resource corresponding with the printed article；
S3. the image for selecting the page in the printed article is taken in image acquisition units, and one is loaded on the image of the page
The above visual marker；
S4. it selectes and puts and touch one of those above visual marker, it is corresponding with chosen visual marker more to play
Media resource.
8. a kind of point-of-reading system based on augmented reality, which is characterized in that including：
Image acquisition units, including can captured in real-time and/or scanning is true and/or dummy object, and obtain the element of image,
Alternatively, the image data of computed readable form can be received, to obtain the element of image, at least taking in image；
Point reads unit, including display unit, at least showing the image being ingested；
Data processing unit, at least to from screened in the image being ingested and the selected frame being ingested in image more than scheme
Picture, and more than one visual marker is loaded on chosen image, and the tactile operational order of point of user is received and handles, from
And realize multimedia acquisition and/or broadcasting,
And touch control operation unit, it allows users to touch one of those above visual marker, Ke Yishi by selected and point
1. now following the plants or the feedback of any or the two combination for 2., 3. planting：1. obtain and/or play be selected it is visual
Change and marks corresponding multimedia resource；2. corresponding with the chosen visual marker control instruction of output, make to select equipment
Execute selected action；3. receive to select equipment output, corresponding with chosen visual marker feedback signal,
It is integrally disposed in a terminal that described image collecting unit and point read unit,
Alternatively, described image collecting unit and point read discrete units setting, and connected through communication module.
9. the point-of-reading system according to claim 8 based on augmented reality, which is characterized in that it further includes：
Storage unit is at least stored in store the image being ingested and/or multimedia resource corresponding with chosen image
Local and/or high in the clouds.
10. the point-of-reading system according to claim 8 based on augmented reality, which is characterized in that the display unit
It is integrally disposed in a touch-display unit with touch control operation unit.
11. the point-of-reading system according to claim 8 based on augmented reality, which is characterized in that the multimedia money
Source is at least selected from character, document, figure, audio, video, dummy model or hyperlink.
12. the point-of-reading system according to claim 8 based on augmented reality, which is characterized in that described image acquires
Unit includes image camera-shooting and recording device or scanner.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310669737.8A CN104461318B (en) | 2013-12-10 | 2013-12-10 | Reading method based on augmented reality and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310669737.8A CN104461318B (en) | 2013-12-10 | 2013-12-10 | Reading method based on augmented reality and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104461318A CN104461318A (en) | 2015-03-25 |
| CN104461318B true CN104461318B (en) | 2018-07-20 |
Family
ID=52907461
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310669737.8A Active CN104461318B (en) | 2013-12-10 | 2013-12-10 | Reading method based on augmented reality and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104461318B (en) |
Families Citing this family (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104850582B (en) * | 2015-04-13 | 2017-11-07 | 西安教育文化数码有限责任公司 | A kind of index type augmented reality system |
| CN104834680B (en) * | 2015-04-13 | 2017-11-07 | 西安教育文化数码有限责任公司 | A kind of index type augmented reality method |
| CN104992205B (en) * | 2015-06-04 | 2018-11-06 | 西安教育文化数码有限责任公司 | Index type augmented reality system and method based on AR books |
| CN105022487A (en) * | 2015-07-20 | 2015-11-04 | 北京易讯理想科技有限公司 | Reading method and apparatus based on augmented reality |
| US11504623B2 (en) * | 2015-08-17 | 2022-11-22 | Lego A/S | Method of creating a virtual game environment and interactive game system employing the method |
| CN105513444A (en) * | 2015-10-10 | 2016-04-20 | 尚学博志(上海)教育科技有限公司 | Method and system for enhancing reading content of electronic teaching material |
| CN105760106B (en) * | 2016-03-08 | 2019-01-15 | 网易（杭州）网络有限公司 | A kind of smart home device exchange method and device |
| CN107767355A (en) * | 2016-08-18 | 2018-03-06 | 深圳市劲嘉数媒科技有限公司 | The method and apparatus of image enhaucament reality |
| CN106790416A (en) * | 2016-11-30 | 2017-05-31 | 上海仙剑文化传媒股份有限公司 | The AR books downloading management method and device of mobile terminal device |
| CN106803835A (en) * | 2016-11-30 | 2017-06-06 | 上海仙剑文化传媒股份有限公司 | The AR book datas downloading management method and device of mobile terminal device |
| CN106713896B (en) * | 2016-11-30 | 2019-08-20 | 世优（北京）科技有限公司 | The multimedia presentation method of still image, device and system |
| CN111899003A (en) | 2016-12-13 | 2020-11-06 | 创新先进技术有限公司 | Virtual object distribution method and device based on augmented reality |
| CN108255822A (en) * | 2016-12-28 | 2018-07-06 | 深圳市氧橙互动娱乐有限公司 | A kind of interactive books reading method, apparatus and system |
| US20190347946A1 (en) * | 2017-01-17 | 2019-11-14 | Hewlett-Packard Development Company, L.P. | Simulated augmented content |
| TWI640952B (en) * | 2017-05-15 | 2018-11-11 | 國立臺灣師範大學 | Virtual object collection method and portable electronic device |
| CN108932088B (en) * | 2017-05-22 | 2020-07-14 | 洪荣昭 | Virtual object collection method and portable electronic device |
| CN107426508A (en) * | 2017-07-14 | 2017-12-01 | 福建铁工机智能机器人有限公司 | A kind of method that long-range security inspection is realized using AR |
| CN110309933A (en) * | 2018-03-23 | 2019-10-08 | 广州极飞科技有限公司 | Plant plants data measuring method, work route method and device for planning, system |
| CN108735014A (en) * | 2018-06-04 | 2018-11-02 | 聆课教育科技(上海)有限公司 | A kind of multimedia teaching facility, system and the method that multimedia content is presented |
| CN110716685B (en) * | 2018-07-11 | 2023-07-18 | 广东虚拟现实科技有限公司 | Image display method, image display device, image display system and entity object of image display system |
| CN110830432A (en) * | 2018-08-08 | 2020-02-21 | 维拉斯甘有限公司 | Method and system for providing augmented reality |
| CN109215416A (en) * | 2018-10-24 | 2019-01-15 | 天津工业大学 | A kind of Chinese character assistant learning system and method based on augmented reality |
| CN110688003B (en) * | 2019-09-09 | 2024-01-09 | 华南师范大学 | Electronic drawing system, display method, device and medium based on augmented reality |
| CN110865708B (en) * | 2019-11-14 | 2024-03-15 | 杭州网易云音乐科技有限公司 | Interaction method, medium, device and computing equipment of virtual content carrier |
| CN111553360B (en) * | 2019-12-12 | 2020-12-18 | 电子科技大学中山学院 | Touch sliding pattern identification product function durability test self-learning method |
| CN111127669A (en) * | 2019-12-30 | 2020-05-08 | 北京恒华伟业科技股份有限公司 | Information processing method and device |
| CN112653933A (en) * | 2020-12-09 | 2021-04-13 | 深圳市创维软件有限公司 | VR data display method, device and system based on set top box and storage medium |
| CN112905084A (en) * | 2020-12-30 | 2021-06-04 | 广州市德晟光电科技股份有限公司 | Book picture projection interaction method, equipment and storage medium |
| CN113362662A (en) * | 2021-06-30 | 2021-09-07 | 重庆五洲世纪文化传媒有限公司 | AR-based preschool education system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101154110A (en) * | 2006-09-29 | 2008-04-02 | 三星电子株式会社 | Method, apparatus, and medium for controlling mobile device based on image of real space including the mobile device |
| CN101923791A (en) * | 2010-05-31 | 2010-12-22 | 华中师范大学 | Method for learning Chinese by combining reality enhancing technique and plane reading material |
| CN103217910A (en) * | 2012-01-18 | 2013-07-24 | 苏州宝时得电动工具有限公司 | Robot and control system thereof |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100624387B1 (en) * | 2005-04-25 | 2006-09-20 | 엘지전자 주식회사 | Robot system which can designate a movement area |
| US9710554B2 (en) * | 2010-09-23 | 2017-07-18 | Nokia Technologies Oy | Methods, apparatuses and computer program products for grouping content in augmented reality |
| KR101688155B1 (en) * | 2010-10-25 | 2016-12-20 | 엘지전자 주식회사 | Information processing apparatus and method thereof |
| CN103310099A (en) * | 2013-05-30 | 2013-09-18 | 佛山电视台南海分台 | Method and system for realizing augmented reality by adopting image capture and recognition technology |
-
2013
- 2013-12-10 CN CN201310669737.8A patent/CN104461318B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101154110A (en) * | 2006-09-29 | 2008-04-02 | 三星电子株式会社 | Method, apparatus, and medium for controlling mobile device based on image of real space including the mobile device |
| CN101923791A (en) * | 2010-05-31 | 2010-12-22 | 华中师范大学 | Method for learning Chinese by combining reality enhancing technique and plane reading material |
| CN103217910A (en) * | 2012-01-18 | 2013-07-24 | 苏州宝时得电动工具有限公司 | Robot and control system thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104461318A (en) | 2015-03-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104461318B (en) | Reading method based on augmented reality and system | |
| US11810258B2 (en) | Marker-based augmented reality authoring tools | |
| US9501140B2 (en) | Method and apparatus for developing and playing natural user interface applications | |
| US20160041981A1 (en) | Enhanced cascaded object-related content provision system and method | |
| CN110716645A (en) | Augmented reality data presentation method and device, electronic equipment and storage medium | |
| CN110199245A (en) | Three-dimension interaction system | |
| CN110168478A (en) | Surface identifies camera lens | |
| CN107427723A (en) | System and method based on the user mutual dynamic creation personal story book in virtual environment | |
| CN104937641A (en) | Information processing device, terminal device, information processing method, and programme | |
| EP1926051A2 (en) | Network connected media platform | |
| WO2013181171A1 (en) | System and method for a universal resident scalable navigation and content display system compatible with any digital device using scalable transparent adaptable resident interface design and picto-overlay interface enhanced trans -snip technology | |
| JP2022505998A (en) | Augmented reality data presentation methods, devices, electronic devices and storage media | |
| JP2022500795A (en) | Avatar animation | |
| CN108292193A (en) | Animated digital ink | |
| Chen et al. | Research on augmented reality system for childhood education reading | |
| CN112333473B (en) | Interaction method, interaction device and computer storage medium | |
| KR101587985B1 (en) | Goods Augmented Reality System | |
| Letellier et al. | Providing adittional content to print media using augmented reality | |
| CN114049467A (en) | Display method, display device, display apparatus, storage medium, and program product | |
| KR20140136713A (en) | Methods and apparatuses of an learning simulation model using images | |
| Sinclair | Integrating hypermedia techniques with augmented reality environments | |
| Bergant et al. | Display of interactive 3D models in augmented reality on mobile devices | |
| Pereira et al. | An Augmented Reality Application with EasyAR for Spatial Mapping in Museums | |
| US20210390785A1 (en) | Augmented reality display device and program recording medium | |
| JP6952654B2 (en) | Virtual capsule toy game system and virtual capsule toy game method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |