CN106506464A - A kind of toy exchange method and system based on augmented reality - Google Patents
A kind of toy exchange method and system based on augmented reality Download PDFInfo
- Publication number
- CN106506464A CN106506464A CN201610907057.9A CN201610907057A CN106506464A CN 106506464 A CN106506464 A CN 106506464A CN 201610907057 A CN201610907057 A CN 201610907057A CN 106506464 A CN106506464 A CN 106506464A
- Authority
- CN
- China
- Prior art keywords
- toy
- virtual resource
- real time
- time imaging
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/131—Protocols for games, networked simulations or virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention relates to augmented reality field, more particularly to a kind of toy exchange method and system based on augmented reality.This is arranged on the virtual resource bag on local or server by inquiry, obtain virtual resource corresponding to the plane picture or stereo-picture of toy, and the real time imaging of virtual resource and toy is overlapped display, virtual resource can be manipulated using multiple control modes simultaneously, threedimensional model such as to showing is amplified, reduces and rotates, or open corresponding audio frequency, video etc., so that toy has the effect of augmented reality, the playability of toy is improve, the economic benefit of producer and businessman is also improved.
Description
Technical field
The present invention relates to augmented reality field, more particularly to a kind of toy exchange method and system based on augmented reality.
Background technology
Augmented reality (Augmented Reality, abbreviation AR), is a kind of position and angle for calculating image in real time
Degree the technology plus respective image, this technology on screen can be enclosed within real world virtual world and carry out interaction,
With the lifting of accompanied electronic product operational capability, augmented reality can use each occasion in daily life, side
Persons who happens to be on hand for an errand preferably obtain information.But it is in toy industry, as entity toy varies, each using field, material, playing method
Differ, various inconvenience are brought to the combination of augmented reality and toy.
Content of the invention
The invention provides a kind of toy exchange method and system based on augmented reality, solves existing augmented reality skill
Art is difficult to the technical problem being combined with toy.
The technical scheme that the present invention solves above-mentioned technical problem is as follows：
According to one aspect of the present invention, there is provided a kind of toy exchange method based on augmented reality, including following step
Suddenly：
Step 1, is scanned to toy, obtains and show the real time imaging of toy；
Step 2, carries out feature pretreatment to the real time imaging, generates the fisrt feature point subset of the real time imaging；
Step 3, by the fisrt feature point subset be stored in server or local virtual resource bag is mated,
Obtain the corresponding virtual resource of the real time imaging；
The virtual resource and the real time imaging are overlapped display by step 4；
Step 5, manipulates to the virtual resource for showing.
The invention has the beneficial effects as follows：Technical scheme is arranged on the void on local or server by inquiry
Intend resource bag, obtain the plane picture or virtual resource corresponding to stereo-picture of toy, and by virtual resource and the reality of toy
When image be overlapped display, while can be manipulated to virtual resource using multiple control modes, such as to show three
Dimension module is amplified, reduces and rotates, or opens corresponding audio frequency, video etc., so that toy has augmented reality
Effect, improve the playability of toy, also improve the economic benefit of producer and businessman.
Further, also include step 6, specially：Inquiry server, obtains the corresponding Word message of the real time imaging,
And the Word message and the real time imaging are overlapped display.
Using the beneficial effect of this further technical scheme it is：This further technical scheme is except the void of acquisition real time imaging
Intend resource information, toy information and user's message information can also be obtained by server, the Chinese and English name of such as toy is situated between
Continue etc., by showing that toy information increased the playability and intelligence of toy, and pass through to show user's message information not only
The use feeling of user can intuitively be known so as to be improved to display effect, control mode etc., and can be produced similar
The effect of barrage, facilitates user for the toy exchange use feeling, further increases what user was interacted using toy
Interest and enjoyment.
Further, the virtual resource includes in animation information, model information, video information and audio-frequency information at least one
Individual；The Word message includes toy information and/or user's message.
Further, the virtual resource bag includes at least one toy picture, the corresponding virtual resource of the toy picture
And the corresponding second feature point subset of toy picture；The second feature point subset is formed using surf algorithms, is specifically included
Following steps：
The target surf characteristic point that the toy picture is obtained using the OpenCV visions storehouse accelerated through GPU functions；
Obtained in the target surf characteristic point by non-maxima suppression algorithm, eigenvalue reaches the feature of predetermined threshold value
Point, and form second feature point subset.
Further, the fisrt feature point subset is formed using surf algorithms in the step 2, specially：
S201, the target surf characteristic point for obtaining the real time imaging using the OpenCV visions storehouse accelerated through GPU functions；
S202, is obtained in the target surf characteristic point by non-maxima suppression algorithm, and eigenvalue reaches predetermined threshold value
Characteristic point, and form fisrt feature point subset.
Further, the step 3 is specially：
The fisrt feature point subset and all of second feature point subset are carried out respectively by S301 using Flann algorithms
Coupling, obtains the target characteristic point subset for meeting default feature similar conditions；
S302, obtains the virtual resource of the corresponding toy picture of the target characteristic idea collection.
Further, the step 4 is specially：
S401, obtains the direction value of the target surf characteristic point of the real time imaging；
S402, according to the direction value, determines position of the toy on the real time imaging, and generates Virtual Space
Coordinate system；
S403, the virtual resource is positioned in the Virtual Space coordinate system and is shown.
Using the beneficial effect of this further technical scheme it is：This further technical scheme is employed in OpenCV visions storehouse
Surf algorithms carry out extraction and the coupling of characteristic point, other algorithms in the OpenCV visions that compare storehouse, Surf algorithms are used
Amount of calculation compare with sift algorithms little 3 times, while surf algorithms easily can be carried out simultaneously using the multithreading of GPU or CPU
Row calculates feature, carries out the speed of extracting and matching feature points and in hgher efficiency.
Further, the step 5 is specially：
S501, obtains application logic script corresponding with control mode；
S502, generates pending action according to the application logic script and virtual resource；
The pending action is encapsulated as event by S503；
S504, executes the event, calls corresponding virtual resource, and adjusts the display location of virtual resource, realizes
The corresponding display effect of the application logic script and/or manipulation effect.
Further, the control method include zooming in and out, moving by gesture, Spin Control；Or carry out model certainly
Dynamic pathfinding control；Or carry out video full frame or scaling play control；Or carry out speech control control；Or carry out multi-model
Interactive control.
Using the beneficial effect of this further technical scheme it is：This further technical scheme is by a kind of based on Unity's
Universal display report control platform storehouse, is encapsulated to the virtual resource of toy, and takes out general display, operation logic, is led to
Incident management, model carry resource is crossed, so as to construct the system that a large amount of virtual toy resources can be shown and be manipulated,
Not only can compatible miscellaneous toy, and various displays and operating effect can be assumed, improve toy of the present invention and hand over
The suitability of mutual method and interactive function.
According to another aspect of the present invention, a kind of toy interactive system based on augmented reality is additionally provided, including client
End, the client include scan module, pretreatment module, matching module, display module and operational module,
The scan module is used for being scanned toy, obtains the real time imaging of toy；
The pretreatment module is used for carrying out the real time imaging feature pretreatment, generates the first of the real time imaging
Characteristic point subset；
The matching module be used for by the fisrt feature point subset be stored in server or local virtual resource
Bag is mated, and obtains the corresponding virtual resource of the real time imaging；
The display module is used for for the virtual resource and the real time imaging being overlapped display；
The operational module is used for manipulating the virtual resource for showing.
The invention has the beneficial effects as follows：Virtual resource bag is stored in local client by technical scheme, therefore
Directly can be mated using virtual resource bag, without considering the communication issue of client and server, it is also possible to save clothes
The expense of business device.
According to another aspect of the present invention, a kind of toy interactive system based on augmented reality is additionally provided, including client
And server, the client includes that scan module, pretreatment module, display module and operational module, the server include
Matching module,
The scan module is used for being scanned toy, obtains the real time imaging of toy；
The pretreatment module is used for carrying out the real time imaging feature pretreatment, generates the first of the real time imaging
Characteristic point subset, and the fisrt feature point subset is sent to server；
The virtual resource and the real time imaging that the display module is used for returning server is overlapped display；
The operational module is used for manipulating the virtual resource for showing；
The matching module is used for the fisrt feature point subset for receiving client transmission, and inquires about the virtual money for prestoring
Source is wrapped, and is sent to client after obtaining the corresponding virtual resource of the real time imaging.
The invention has the beneficial effects as follows：The toy interactive system of the present invention includes server and client side, by client
End is scanned to toy, and the real time imaging to scanning carries out feature pretreatment, is then obtained and spy by inquiring about server
The corresponding virtual resource of pre-processed results is levied, and virtual resource and real time imaging are overlapped display, this mode will be mated
Module has been put into server, by the powerful operational capability of server, improves matching speed and efficiency, so as to reduce display
The time of Overlay, improve the use feeling of user.Meanwhile, when server faces flood tide user's request, it is distributed
Formula processing mode, i.e. server increase CDN distribution network structures.And virtual resource is sent for convenience when constructing server, will survey
Examination server and Operation Server are parallel, and the virtual resource that close beta passes through was pushed by the server sync mechanism very first time
To Operation Server, client is sent to by Operation Server, so as to ensure that the real-time release of virtual resource.
Further, the pretreatment module is described specifically for utilizing the OpenCV visions storehouse accelerated through GPU functions to obtain
The target surf characteristic point of real time imaging, and obtained in the target surf characteristic point by non-maxima suppression algorithm, feature
Value reaches the characteristic point of predetermined threshold value, and forms fisrt feature point subset.
Further, the matching module specifically for using Flann algorithms by the fisrt feature point subset and all of
Second feature point subset is mated respectively, obtains the target characteristic point subset for meeting default feature similar conditions, and obtains institute
State the virtual resource of the corresponding toy picture of target characteristic idea collection.
Further, direction value of the display module specifically for the target surf characteristic point of the acquisition real time imaging,
According to the direction value, determine position of the toy on the real time imaging, and generate Virtual Space coordinate system, will be described
Virtual resource is positioned in the Virtual Space coordinate system and is shown.
Further, the client also includes that the first enquiry module, first enquiry module are used for sending to server
Query statement, obtains the Word message that server is returned, and drives display module by the Word message and the real time imaging
It is overlapped display；
The server also includes that the second enquiry module, second enquiry module are used for according to the query statement, obtain
The corresponding Word message of the real time imaging is taken, and the Word message is sent to client；
The server is adopted increases verify choosings in virtual resource and/or the corresponding HTTP data fields of Word message
Item and the mode of token options, are communicated with client.
Using the beneficial effect of this further technical scheme it is：In this further technical scheme, client and server end needs
When information exchange is carried out by the Internet, use HTTP as protocol bearer, it is contemplated that efficiency and safety take into account, will communication
Middle HTTP data fields increase verify options and token options, and non-usage HTTPS to be carrying out protocol communication, while communication
Used in json forms carry out packaging information content.
Further, the operational module includes interface unit, rm-cell, core processing unit, event elements, control
Unit processed, action processing unit and coordinate transformation unit,
The interface unit is used for receiving application logic script corresponding with control mode, and the application logic foot that will be received
Originally core processing unit is sent to；
The core processing unit is used for according to the application logic script and the virtual resource of rm-cell management
Pending action is generated, and is sent to event elements；
The event elements are used for the pending action to be packaged into after event to be sent to control unit；
Described control unit is used for according to the event, drive actions processing unit, coordinate transformation unit and resource management
Unit, realizes the corresponding display effect of the application logic script and/or manipulation effect；
The action processing unit is used for completing the corresponding manipulation of the application logic script according to the driving of control unit
Action；
The coordinate transformation unit is used for the display location for adjusting virtual resource；
The rm-cell is used for being managed virtual resource.
Description of the drawings
Fig. 1 is schematic flow sheet of the embodiment 1 based on the toy exchange method for strengthening display；
Fig. 2 is schematic flow sheet of the embodiment 2 based on the toy exchange method for strengthening display；
Fig. 3 is structural representation of the embodiment 3 based on the toy interactive system for strengthening display；
Fig. 4 is structural representation of the embodiment 4 based on the toy interactive system for strengthening display.
Specific embodiment
The principle and feature of the present invention are described below in conjunction with accompanying drawing, example is served only for explaining the present invention, and
Non- for limiting the scope of the present invention.
Fig. 1 is schematic flow sheet of the present invention based on the toy exchange method for strengthening display, comprises the following steps：
Step 1, is scanned to toy, obtains and show the real time imaging of toy.In this step, by client
Camera head, such as photographic head are scanned to toy.Selectable client species is a lot, sets including mobile device and wearing
Standby etc., such as mobile phone, panel computer, possess can shoot function glasses etc.；
Step 2, carries out feature pretreatment to the real time imaging, generates the fisrt feature point subset of the real time imaging；
Step 3, by the fisrt feature point subset be stored in server or local virtual resource bag is mated,
The corresponding virtual resource of the real time imaging is obtained, the virtual resource includes animation information, model information, video information and sound
At least one of frequency information；
The virtual resource and the real time imaging are overlapped display by step 4；
Step 5, manipulates to the virtual resource for showing.
Below by way of specific embodiment 1, above-mentioned steps are illustrated.
In the step of embodiment 12, the fisrt feature point subset is formed using surf algorithms, specially：
S201, the target surf characteristic point for obtaining the real time imaging using the OpenCV visions storehouse accelerated through GPU functions,
The target surf characteristic point be anti-rotation, nonshrink put or local invariant characteristic point；
S202, is obtained in the target surf characteristic point by non-maxima suppression algorithm, and eigenvalue reaches predetermined threshold value
Characteristic point, and form fisrt feature point subset.
Then by the fisrt feature point subset be stored in server or local virtual resource bag is mated, obtain
Take the corresponding virtual resource of the real time imaging.In embodiment 1, virtual resource bag is stored on local client, therefore directly
The fisrt feature point subset is mated with virtual resource bag, is obtained corresponding virtual resource.In other embodiments, when
When virtual resource bag is arranged on the server, fisrt feature point subset is sent to server, coupling is carried out by server and is obtained
Take the corresponding virtual resource of real time imaging.In embodiment 1, the virtual resource bag includes at least a set of toy picture, plays per
All there is tool picture corresponding virtual resource and second feature point subset, the virtual resource and second feature point subset all to write
And be stored in virtual resource bag.1 same employing surf algorithms of embodiment form second feature point subset, specifically include following step
Suddenly：
The target surf characteristic point that the toy picture is obtained using the OpenCV visions storehouse accelerated through GPU functions, described
Target surf characteristic point be anti-rotation, nonshrink put or local invariant characteristic point；
Obtained in the target surf characteristic point by non-maxima suppression algorithm, eigenvalue reaches the feature of predetermined threshold value
Point, and form second feature point subset.Then the coupling of fisrt feature point subset and second feature point subset is carried out, specially：
The fisrt feature point subset and all of second feature point subset are carried out respectively by S301 using Flann algorithms
Coupling, obtains the target characteristic point subset for meeting default feature similar conditions；
S302, obtains the virtual resource of the corresponding toy picture of the target characteristic idea collection.
In the step of the present embodiment 14, using Overlapping display method in detail below：
S401, obtains the direction value of the target surf characteristic point of the real time imaging；
S402, according to the direction value, determines position of the toy on the real time imaging, and generates Virtual Space
Coordinate system；
S403, the virtual resource is positioned in the Virtual Space coordinate system and is shown.
On the real time imaging that accurately virtual resource superposition can be shown on the client by said method, work as client
When mobile, real time imaging also can be moved on the display interface of client, but virtual resource can be always maintained at and real time imaging
Synchronizing moving, reaches the effect of augmented reality.
The step of the present embodiment 5, can adopt multiple displays and control mode, when such as scanning fruit and vegerable card, it may appear that star
Light specially good effect, clicks on screen, can carry out Chinese and English name introduction, again tap on screen, have excellent melody；Or scanning is ancient
During biological card, it may appear that pass through modern specially good effect, screen is clicked on, Chinese and English name introduction can be carried out, screen, meeting is again tapped on
There is the cry of extinct plants and animal；Or scanning vehicles card, it may appear that science and technology rotation light specially good effect, screen is clicked on, in can carrying out
English name is introduced, and is again tapped on screen, is had the operation sound of the vehicles；Or scanning animal card, it may appear that ring light
Specially good effect, clicks on screen, can carry out Chinese and English name introduction, again tap on screen, have cry of animal etc..Specifically,
In the present embodiment, the step 5 is specially：
S501, obtains application logic script corresponding with control mode；The control method includes being contracted by gesture
Put, move, Spin Control；Or carry out the automatic pathfinding control of model；Or carry out video full frame or scaling play control；Or
Carry out speech control control；Or carry out the interactive control of multi-model.
S502, generates pending action according to the application logic script and virtual resource.
The pending action is encapsulated as event by S503.
S504, executes the event, calls corresponding virtual resource, and adjusts the display location of virtual resource, realizes
The corresponding display effect of the application logic script and/or manipulation effect.
The present embodiment is packaged to the virtual resource of toy by the universal display report control platform storehouse based on Unity, and
General display, operation logic is taken out, by incident management, model carry resource, can be to a large amount of virtual so as to construct
The system that toy resource is shown and manipulated, not only can compatible miscellaneous toy, and various displays can be assumed
And operating effect, improve the suitability and the interactive function of toy exchange method of the present invention.
Fig. 2 is schematic flow sheet of 2 another kind of embodiment based on the toy exchange method for strengthening display, except above step
1～5, also include step 6, specially：Inquiry server, obtains the corresponding Word message of the real time imaging, and by the text
Word information and the real time imaging are overlapped display, and the Word message includes toy information and/or user's message.Embodiment
2 except the virtual resource information of acquisition real time imaging, can also obtain toy information and user's message information by server, than
Chinese and English name introduction such as toy etc., by showing that toy information increased the playability and intelligence of toy, and passes through
Show that user's message information not only can intuitively know the use feeling of user so as to changing to display effect, control mode etc.
Enter, and the effect of similar barrage can be produced, facilitate user for the toy exchange use feeling, further increase user
The interest interacted using toy and enjoyment.
As shown in figure 3, for a kind of structural representation of the toy interactive system based on augmented reality of embodiment 3, including visitor
Family end, the client include scan module, pretreatment module, matching module, display module and operational module,
The scan module is used for being scanned toy, obtains the real time imaging of toy；
The pretreatment module is used for carrying out the real time imaging feature pretreatment, generates the first of the real time imaging
Characteristic point subset；
The matching module be used for by the fisrt feature point subset be stored in server or local virtual resource
Bag is mated, and obtains the corresponding virtual resource of the real time imaging；
The display module is used for for the virtual resource and the real time imaging being overlapped display；
The operational module is used for manipulating the virtual resource for showing.
Virtual resource bag is stored in local client by the present embodiment, therefore directly can be carried out using virtual resource bag
Match somebody with somebody, without considering the communication issue of client and server, it is also possible to save the expense of server.
As shown in figure 4, the structural representation for 4 another kind of embodiment based on the toy interactive system of augmented reality, including
Client and server, the client include scan module, pretreatment module, the first enquiry module, display module and manipulation
Module, the server include the second enquiry module and matching module,
The scan module of client-side is used for being scanned toy, obtains the real time imaging of toy；
The pretreatment module is used for carrying out the real time imaging feature pretreatment, generates the first of the real time imaging
Characteristic point subset, and the fisrt feature point subset is sent to server；
First enquiry module is used for sending query statement to server, obtains the Word message that server is returned, and
Drive display module that the Word message and the real time imaging are overlapped display；
The virtual resource and the real time imaging that the display module is used for returning server is overlapped display；
The operational module is used for manipulating the virtual resource for showing.
The matching module of server side is used for the fisrt feature point subset for receiving client transmission, and inquires about and deposit in advance
The virtual resource bag of storage, is sent to client after obtaining the corresponding virtual resource of the real time imaging；Second enquiry module,
Second enquiry module is used for according to the query statement, obtains the corresponding Word message of the real time imaging, and will be described
Word message is sent to client.
The present embodiment includes server and client side, toy is scanned by client, and the real-time figure to scanning
As carrying out feature pretreatment, then virtual resource corresponding with feature pre-processed results is obtained by inquiring about server, and by void
Intend resource and real time imaging is overlapped display, matching module has been put into server by this mode, by the powerful of server
Operational capability, improves matching speed and efficiency, so as to reduce the time for showing Overlay, improves the use feeling of user
Receive.Meanwhile, when server faces flood tide user's request, carrying out distributed processing mode, i.e. server increases CDN distribution networks
Structure.And virtual resource is sent for convenience when constructing server, and will be parallel to testing service device and Operation Server, close beta is led to
The virtual resource that crosses is pushed to Operation Server by the server sync mechanism very first time, is sent to visitor by Operation Server
Family end, so that ensure that the real-time release of virtual resource.
In embodiment 3 and embodiment 4, the pretreatment module is regarded specifically for utilizing the OpenCV accelerated through GPU functions
Feel that storehouse obtains the target surf characteristic point of the real time imaging, and it is special target surf to be obtained by non-maxima suppression algorithm
In levying a little, eigenvalue reaches the characteristic point of predetermined threshold value, and forms fisrt feature point subset.
The matching module is specifically for adopting Flann algorithms by the fisrt feature point subset and all of second feature
Point subset is mated respectively, obtains the target characteristic point subset for meeting default feature similar conditions, and it is special to obtain the target
Levy the virtual resource of the corresponding toy picture of idea collection.
Direction value of the display module specifically for the target surf characteristic point of the acquisition real time imaging, according to described
Direction value, determines position of the toy on the real time imaging, and generates Virtual Space coordinate system, by the virtual resource
Positioned in the Virtual Space coordinate system and shown.
In embodiment 3 and embodiment 4, the operational module includes interface unit, rm-cell, core processing list
Unit, event elements, control unit, action processing unit and coordinate transformation unit, the interface unit are used for receiving and manipulation side
The corresponding application logic script of formula, and the application logic script of reception is sent to core processing unit；The core processing list
Unit is for generating pending action according to the virtual resource of the application logic script and rm-cell management, and is sent to
Event elements；The event elements are used for the pending action to be packaged into after event to be sent to control unit；The control
Unit is used for according to the event, drive actions processing unit, coordinate transformation unit and rm-cell, realizes the application
The corresponding display effect of logic script and/or manipulation effect；The action processing unit is used for complete according to the driving of control unit
Into the corresponding control action of the application logic script；The coordinate transformation unit is used for the display location for adjusting virtual resource；
The rm-cell is used for being managed virtual resource.By the universal display report control platform storehouse based on Unity, to playing
The virtual resource of tool is packaged, and takes out general display, operation logic, by incident management, model carry resource, from
And the system that a large amount of virtual toy resources can be shown and be manipulated is constructed, not only can compatible miscellaneous object for appreciation
Tool, and various displays and operating effect can be assumed, improve the suitability and the interactive function of toy exchange method of the present invention.
In embodiment 4, when client and server end needs information exchange to be carried out by the Internet, use HTTP as association
View carrier, it is contemplated that efficiency and safety take into account, in communicating, HTTP data fields increase verify options and token options,
And non-usage HTTPS to be carrying out protocol communication, while json forms carry out packaging information content used in communication.
In above example 3 and embodiment 4, client can also include subscriber information management module, so as to adopting
The user of the toy exchange method and system carries out information management and/or rights management, can also arrange on same server
To accessing the subscriber information management module that user is managed.
Although embodiments of the invention have been shown and described above, it is to be understood that above-described embodiment is example
Property, it is impossible to limitation of the present invention is interpreted as, one of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changes, replacing and modification.
Claims (10)
1. a kind of toy exchange method based on augmented reality, it is characterised in that comprise the following steps：
Step 1, is scanned to toy, obtains and show the real time imaging of toy；
Step 2, carries out feature pretreatment to the real time imaging, generates the fisrt feature point subset of the real time imaging；
Step 3, by the fisrt feature point subset be stored in server or local virtual resource bag is mated, obtain
The corresponding virtual resource of the real time imaging；
The virtual resource and the real time imaging are overlapped display by step 4；
Step 5, manipulates to the virtual resource for showing.
2. the toy exchange method based on augmented reality according to claim 1, it is characterised in that also include step 6, has
Body is：Inquiry server, obtains the corresponding Word message of the real time imaging, and by the Word message and the real time imaging
It is overlapped display.
3. the toy exchange method based on augmented reality according to claim 2, it is characterised in that the virtual resource bag
Include at least one of animation information, model information, video information and audio-frequency information；The Word message includes toy information
And/or user's message.
4. according to the arbitrary described toy exchange method based on augmented reality of claims 1 to 3, it is characterised in that the void
Intending resource bag includes at least one toy picture, the corresponding virtual resource of the toy picture and toy picture corresponding second
Characteristic point subset；The second feature point subset is formed using surf algorithms, following steps are specifically included：
The target surf characteristic point that the toy picture is obtained using the OpenCV visions storehouse accelerated through GPU functions；
Obtained in the target surf characteristic point by non-maxima suppression algorithm, eigenvalue reaches the characteristic point of predetermined threshold value,
And form second feature point subset.
5. the toy exchange method based on augmented reality according to claim 4, it is characterised in that adopt in the step 2
The fisrt feature point subset is formed with surf algorithms, specially：
S201, the target surf characteristic point for obtaining the real time imaging using the OpenCV visions storehouse accelerated through GPU functions；
S202, is obtained in the target surf characteristic point by non-maxima suppression algorithm, and eigenvalue reaches the spy of predetermined threshold value
Levy a little, and form fisrt feature point subset；
The step 3 is specially：
The fisrt feature point subset and all of second feature point subset are mated respectively by S301 using Flann algorithms,
Obtain the target characteristic point subset for meeting default feature similar conditions；
S302, obtains the virtual resource of the corresponding toy picture of the target characteristic idea collection.
6. the toy exchange method based on augmented reality according to claim 5, it is characterised in that the step 4 is concrete
For：
S401, obtains the direction value of the target surf characteristic point of the real time imaging；
S402, according to the direction value, determines position of the toy on the real time imaging, and generates Virtual Space coordinate
System；
S403, the virtual resource is positioned in the Virtual Space coordinate system and is shown；
The step 5 is specially：
S501, obtains application logic script corresponding with control mode；
S502, generates pending action according to the application logic script and virtual resource；
The pending action is encapsulated as event by S503；
S504, executes the event, calls corresponding virtual resource, and adjusts the display location of virtual resource, realizes described
The corresponding display effect of application logic script and/or manipulation effect.
7. a kind of toy interactive system based on augmented reality, it is characterised in that including client, the client includes scanning
Module, pretreatment module, matching module, display module and operational module,
The scan module is used for being scanned toy, obtains the real time imaging of toy；
The pretreatment module is used for carrying out the real time imaging feature pretreatment, generates the fisrt feature of the real time imaging
Point subset；
The matching module be used for by the fisrt feature point subset be stored in server or local virtual resource bag enters
Row coupling, obtains the corresponding virtual resource of the real time imaging；
The display module is used for for the virtual resource and the real time imaging being overlapped display；
The operational module is used for manipulating the virtual resource for showing.
8. a kind of toy interactive system based on augmented reality, it is characterised in that including client and server, the client
Including scan module, pretreatment module, display module and operational module, the server includes matching module,
The scan module is used for being scanned toy, obtains the real time imaging of toy；
The pretreatment module is used for carrying out the real time imaging feature pretreatment, generates the fisrt feature of the real time imaging
Point subset, and the fisrt feature point subset is sent to server；
The virtual resource and the real time imaging that the display module is used for returning server is overlapped display；
The operational module is used for manipulating the virtual resource for showing；
The matching module is used for the fisrt feature point subset for receiving client transmission, and inquires about the virtual resource for prestoring
Bag, is sent to client after obtaining the corresponding virtual resource of the real time imaging.
9. the toy interactive system based on augmented reality according to claim 8, it is characterised in that the client is also wrapped
The first enquiry module is included, and first enquiry module is used for query statement being sent to server, obtains the word that server is returned
Information, and drive display module that the Word message and the real time imaging are overlapped display；
The server also includes that the second enquiry module, second enquiry module are used for, according to the query statement, obtaining institute
The corresponding Word message of real time imaging is stated, and the Word message is sent to client；
The server adopt increase in virtual resource and/or the corresponding HTTP data fields of Word message verify options and
The mode of token options is communicated with client.
10. the toy interactive system based on augmented reality according to claim 7 or 8, it is characterised in that the manipulation mould
Block includes interface unit, rm-cell, core processing unit, event elements, control unit, action processing unit and coordinate
Converter unit,
The interface unit is used for receiving application logic script corresponding with control mode, and the application logic script for receiving is sent out
It is sent to core processing unit；
The core processing unit is used for being generated according to the virtual resource of the application logic script and rm-cell management
Pending action, and it is sent to event elements；
The event elements are used for the pending action to be packaged into after event to be sent to control unit；
Described control unit is used for according to the event, drive actions processing unit, coordinate transformation unit and rm-cell,
Realize the corresponding display effect of the application logic script and/or manipulation effect；
The action processing unit is used for completing the corresponding control action of the application logic script according to the driving of control unit；
The coordinate transformation unit is used for the display location for adjusting virtual resource；
The rm-cell is used for being managed virtual resource.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610907057.9A CN106506464B (en) | 2016-10-17 | 2016-10-17 | A kind of toy exchange method and system based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610907057.9A CN106506464B (en) | 2016-10-17 | 2016-10-17 | A kind of toy exchange method and system based on augmented reality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106506464A true CN106506464A (en) | 2017-03-15 |
| CN106506464B CN106506464B (en) | 2019-11-12 |
Family
ID=58294611
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610907057.9A Active CN106506464B (en) | 2016-10-17 | 2016-10-17 | A kind of toy exchange method and system based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106506464B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107320951A (en) * | 2017-06-27 | 2017-11-07 | 成都艺游互娱网络科技有限公司 | Method, toy base, the interactive system combined for playing with intelligent toy |
| CN107358658A (en) * | 2017-07-20 | 2017-11-17 | 深圳市大象文化科技产业有限公司 | A kind of Mammaplasty AR Forecasting Methodologies, device and system |
| WO2018188088A1 (en) * | 2017-04-14 | 2018-10-18 | 广州千藤玩具有限公司 | Clay toy system based on augmented reality and digital image processing and method therefor |
| CN109298781A (en) * | 2018-08-28 | 2019-02-01 | 百度在线网络技术（北京）有限公司 | Message processing method, device, equipment and computer storage medium based on AR |
| CN109656357A (en) * | 2018-11-16 | 2019-04-19 | 保定福日纺织品制造有限公司 | A kind of information processing method and device |
| CN109995838A (en) * | 2018-01-02 | 2019-07-09 | 中国移动通信有限公司研究院 | Virtual content dispatching method, device, equipment and computer readable storage medium |
| CN110097792A (en) * | 2019-05-09 | 2019-08-06 | 株洲华云智仿信息科技有限公司 | The intelligent movable interactive learning system and its learning method of rail traffic knowledge |
| CN111833460A (en) * | 2020-07-10 | 2020-10-27 | 北京字节跳动网络技术有限公司 | Augmented reality image processing method and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102735100A (en) * | 2012-06-08 | 2012-10-17 | 重庆邮电大学 | Individual light weapon shooting training method and system by using augmented reality technology |
| CN103218733A (en) * | 2012-04-26 | 2013-07-24 | 株式会社万代 | Portable terminal device, toll, reality expansion system and method |
| CN103996181A (en) * | 2014-05-12 | 2014-08-20 | 上海大学 | Large-vision-field image splicing system and method based on two bionic eyes |
| CN103998107A (en) * | 2011-05-23 | 2014-08-20 | 乐高公司 | A toy construction system for augmented reality |
| CN105303615A (en) * | 2015-11-06 | 2016-02-03 | 中国民航大学 | Combination method of two-dimensional stitching and three-dimensional surface reconstruction of image |
-
2016
- 2016-10-17 CN CN201610907057.9A patent/CN106506464B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103998107A (en) * | 2011-05-23 | 2014-08-20 | 乐高公司 | A toy construction system for augmented reality |
| CN103218733A (en) * | 2012-04-26 | 2013-07-24 | 株式会社万代 | Portable terminal device, toll, reality expansion system and method |
| CN102735100A (en) * | 2012-06-08 | 2012-10-17 | 重庆邮电大学 | Individual light weapon shooting training method and system by using augmented reality technology |
| CN103996181A (en) * | 2014-05-12 | 2014-08-20 | 上海大学 | Large-vision-field image splicing system and method based on two bionic eyes |
| CN105303615A (en) * | 2015-11-06 | 2016-02-03 | 中国民航大学 | Combination method of two-dimensional stitching and three-dimensional surface reconstruction of image |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018188088A1 (en) * | 2017-04-14 | 2018-10-18 | 广州千藤玩具有限公司 | Clay toy system based on augmented reality and digital image processing and method therefor |
| CN110741327B (en) * | 2017-04-14 | 2023-06-23 | 广州千藤文化传播有限公司 | Mud toy system and method based on augmented reality and digital image processing |
| CN110741327A (en) * | 2017-04-14 | 2020-01-31 | 广州千藤玩具有限公司 | Clay toy system based on augmented reality and digital image processing and method thereof |
| CN107320951A (en) * | 2017-06-27 | 2017-11-07 | 成都艺游互娱网络科技有限公司 | Method, toy base, the interactive system combined for playing with intelligent toy |
| CN107358658A (en) * | 2017-07-20 | 2017-11-17 | 深圳市大象文化科技产业有限公司 | A kind of Mammaplasty AR Forecasting Methodologies, device and system |
| CN107358658B (en) * | 2017-07-20 | 2021-08-20 | 深圳市大象文化科技产业有限公司 | Breast shaping AR prediction method, device and system |
| CN109995838B (en) * | 2018-01-02 | 2021-08-06 | 中国移动通信有限公司研究院 | Virtual content scheduling method, device, equipment and computer readable storage medium |
| CN109995838A (en) * | 2018-01-02 | 2019-07-09 | 中国移动通信有限公司研究院 | Virtual content dispatching method, device, equipment and computer readable storage medium |
| CN109298781A (en) * | 2018-08-28 | 2019-02-01 | 百度在线网络技术（北京）有限公司 | Message processing method, device, equipment and computer storage medium based on AR |
| CN109656357A (en) * | 2018-11-16 | 2019-04-19 | 保定福日纺织品制造有限公司 | A kind of information processing method and device |
| CN110097792A (en) * | 2019-05-09 | 2019-08-06 | 株洲华云智仿信息科技有限公司 | The intelligent movable interactive learning system and its learning method of rail traffic knowledge |
| CN111833460A (en) * | 2020-07-10 | 2020-10-27 | 北京字节跳动网络技术有限公司 | Augmented reality image processing method and device, electronic equipment and storage medium |
| WO2022007565A1 (en) * | 2020-07-10 | 2022-01-13 | 北京字节跳动网络技术有限公司 | Image processing method and apparatus for augmented reality, electronic device and storage medium |
| US11756276B2 (en) | 2020-07-10 | 2023-09-12 | Beijing Bytedance Network Technology Co., Ltd. | Image processing method and apparatus for augmented reality, electronic device, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106506464B (en) | 2019-11-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106506464A (en) | A kind of toy exchange method and system based on augmented reality | |
| CN110348524B (en) | Human body key point detection method and device, electronic equipment and storage medium | |
| US11050977B2 (en) | Immersive interactive remote participation in live entertainment | |
| US11405678B2 (en) | Live streaming interactive method, apparatus, electronic device, server and storage medium | |
| US8441475B2 (en) | Arrangements for enhancing multimedia features in a virtual universe | |
| CN108876877A (en) | Emoticon image | |
| CN110400251A (en) | Method for processing video frequency, device, terminal device and storage medium | |
| CN106576158A (en) | Immersive video | |
| KR20130022434A (en) | Apparatus and method for servicing emotional contents on telecommunication devices, apparatus and method for recognizing emotion thereof, apparatus and method for generating and matching the emotional contents using the same | |
| CN107257403A (en) | Use the communication of interaction incarnation | |
| JP2022551660A (en) | SCENE INTERACTION METHOD AND DEVICE, ELECTRONIC DEVICE AND COMPUTER PROGRAM | |
| CN109257589A (en) | Long-range 3-D scanning holographic cartoon special efficacy generates vertical aobvious system and method | |
| CN110178158A (en) | Information processing unit, information processing method and program | |
| Han | Mobile immersive computing: Research challenges and the road ahead | |
| CN110505406A (en) | Background-blurring method, device, storage medium and terminal | |
| US20230011822A1 (en) | System and method for social immersive content rendering | |
| CN110536095A (en) | Call method, device, terminal and storage medium | |
| CN114463470A (en) | Virtual space browsing method and device, electronic equipment and readable storage medium | |
| CN109413152A (en) | Image processing method, device, storage medium and electronic equipment | |
| Lyu et al. | WebTransceiVR: Asymmetrical communication between multiple VR and non-VR users online | |
| CN114327055A (en) | 3D real-time scene interaction system based on meta-universe VR/AR and AI technologies | |
| CN113014960B (en) | Method, device and storage medium for online video production | |
| CN113332720A (en) | Game map display method and device, computer equipment and storage medium | |
| Sun et al. | Video Conference System in Mixed Reality Using a Hololens | |
| CN107070784A (en) | A kind of 3D instant communicating systems based on WebGL and VR technologies |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |