CN106776732A - The implementation method and device of virtual electronic specification - Google Patents
The implementation method and device of virtual electronic specification Download PDFInfo
- Publication number
- CN106776732A CN106776732A CN201611026190.XA CN201611026190A CN106776732A CN 106776732 A CN106776732 A CN 106776732A CN 201611026190 A CN201611026190 A CN 201611026190A CN 106776732 A CN106776732 A CN 106776732A
- Authority
- CN
- China
- Prior art keywords
- product
- video
- image
- descriptor
- mark
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/74—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/73—Querying
- G06F16/735—Filtering based on additional data, e.g. user or group profiles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
Abstract
The embodiment of the present invention provides the implementation method and device of a kind of virtual electronic specification.Methods described includes：The mark of product is obtained, and the video of the product is obtained according to the mark；Obtain the image of the part comprising the product；The part of the product in described image is identified, and obtains the feature descriptor of the part；The feature descriptor of the part and the goal descriptor corresponding with the part for prestoring are matched, the incidence relation between the feature descriptor and the goal descriptor is obtained；The video cartoon of the part is added in the video according to the incidence relation, to generate the virtual electronic specification of the product.The implementation method and device of virtual electronic specification of the invention, realize easy to use, low cost, have a wide range of application, interactivity is strong, can provide the virtual electronic specification of the intuitional and experiential thinking and abundant expression forms, meets explanation demand and the user's request of complex industrial product.
Description
Technical field
The present invention relates to computer vision technique, more particularly to a kind of virtual electronic specification implementation method and device.
Background technology
Existing product is all accompanied with specification mostly.Traditional specification is generally using the character property explanation document of papery
Form be presented to user.
However, traditional specification has following weak point：First, message form and function are excessively single, with user
Without interactivity；Secondly, the product description more than some complex structures, parts easily makes one to lose reading quickly
Desire, also, user use extremely inconvenience, therefore, it is impossible to meet explanation demand and the user of complex industrial product
Demand；Again, the specification of papery needs to process, print and pack, and virtually increased the production cost of product.
The content of the invention
It is an object of the present invention to provide the implementation method and device of a kind of virtual electronic specification, to realize user
Just, low cost, have a wide range of application, interactivity is strong, can provide the virtual electronic specification of the intuitional and experiential thinking and abundant expression forms,
Meet explanation demand and the user's request of complex industrial product.
According to an aspect of the present invention, there is provided a kind of implementation method of virtual electronic specification, methods described includes：Obtain
The mark of product, and the video of the product is obtained according to the mark；Obtain the image of the part comprising the product；To institute
The part for stating the product in image is identified, and obtains the feature descriptor of the part；The feature of the part is retouched
The goal descriptor corresponding with the part stated symbol and prestore is matched, and is obtained the feature descriptor and is retouched with the target
State the incidence relation between symbol；The video cartoon of the part is added in the video according to the incidence relation, with life
Into the virtual electronic specification of the product.
Preferably, the mark for obtaining product includes：2 D code information on the product is read by mobile terminal,
And the mark of the product is obtained according to the 2 D code information.
Preferably, the image for obtaining the part comprising the product includes：By setting on the mobile terminal
Picture pick-up device obtain comprising the product part image.
Preferably, it is described to described image in the part of the product be identified, the feature for obtaining the part is retouched
Stating symbol includes：Feature point detection, the generation of feature point description and Feature Points Matching treatment are carried out to described image, obtains described
The feature descriptor of part.
Preferably, methods described also includes：Make the video cartoon of the part；
The video cartoon for making the part includes：
The rgb image data and depth image data of the part of the product are obtained by Kinect sensor；
It is modeled using the rgb image data and depth image data, obtains the first kind three-dimensional mould of the product
Type data；
The first kind three-dimensional modeling data is carried out to render the treatment of analysis, label character and leader, second is obtained
Class three-dimensional modeling data；
The video cartoon of the part is made according to the Equations of The Second Kind three-dimensional modeling data.
According to another aspect of the present invention, there is provided a kind of virtual electronic specification realizes device.Described device includes：Mark
Know and video acquiring module, the mark for obtaining product, and the video of the product is obtained according to the mark；Image is obtained
Module, the image for obtaining the part comprising the product；Picture recognition module, for the product in described image
Part be identified, obtain the feature descriptor of the part；Descriptor relating module, for the feature of the part to be retouched
The goal descriptor corresponding with the part stated symbol and prestore is matched, and is obtained the feature descriptor and is retouched with the target
State the incidence relation between symbol；Specification generation module, for being added the video cartoon of the part according to the incidence relation
In adding to the video of the product, to generate virtual electronic specification.
Preferably, the Quick Response Code that the mark and video acquiring module are used to be read by mobile terminal on the product is believed
Breath, and the mark of the product is obtained according to the 2 D code information.
Preferably, described image acquisition module is used to be obtained by the picture pick-up device for setting on the mobile terminal and included
The image of the part of the product.
Preferably, described image identification module is used to carry out described image feature point detection, feature point description son generation
And Feature Points Matching treatment, obtain the feature descriptor of the part.
Preferably, described device also includes：Video cartoon makes module, the video cartoon for making the part；
The video cartoon makes module to be included：
Data capture unit, rgb image data and depth for obtaining the part of the product by Kinect sensor
Degree view data；
First model data acquiring unit, for being modeled using the rgb image data and depth image data, is obtained
Obtain the first kind three-dimensional modeling data of the product；
Second model data acquiring unit, for carrying out rendering analysis, word mark to the first kind three-dimensional modeling data
Note and leader treatment, obtain Equations of The Second Kind three-dimensional modeling data；
Video cartoon production unit, the video for making the part according to the Equations of The Second Kind three-dimensional modeling data is moved
Draw.
The implementation method and device of the virtual electronic specification for providing according to embodiments of the present invention, by the mark for obtaining product
Know, and the video of product is obtained according to mark, further obtain the image of the part comprising product, and to the product in image
Part is identified, and the feature descriptor of part is obtained, by the feature descriptor of part and the target corresponding with part for prestoring
Descriptor is matched, and obtains the incidence relation between feature descriptor and goal descriptor, according to incidence relation by part
Video cartoon is added in video, to generate the virtual electronic specification of product.Realize easy to use, low cost, using model
The virtual electronic specification that wide, interactivity is strong, can provide the intuitional and experiential thinking and abundant expression forms is enclosed, complex industrial product is met
Explanation demand and user's request.
Brief description of the drawings
Fig. 1 is the flow chart of the implementation method of the virtual electronic specification for showing according to embodiments of the present invention；
Fig. 2 is the flow chart of the implementation method of the virtual electronic specification for showing according to embodiments of the present invention two；
Fig. 3 is the logic diagram for realizing device of the virtual electronic specification for showing according to embodiments of the present invention three；
Fig. 4 is the logic diagram for realizing device of the virtual electronic specification for showing according to embodiments of the present invention four.
Specific embodiment
(identical label represents identical element in some accompanying drawings) and embodiment below in conjunction with the accompanying drawings, to tool of the invention
Body implementation method is described in further detail.Following examples are used to illustrate the present invention, but are not limited to the scope of the present invention.
It will be understood by those skilled in the art that the term such as " first ", " second " in the present invention to be only used for difference asynchronous
Suddenly, equipment or module etc., neither represent any particular technology implication, also do not indicate that the inevitable logical order between them.
Embodiment one
Fig. 1 is the flow chart of the implementation method of the virtual electronic specification for showing according to embodiments of the present invention.Can be such as
Device shown in Fig. 3 performs methods described.
Reference picture 1, in step S110, obtains the mark of product, and the video of product is obtained according to mark.
In actual applications, user can download the APP software installations of the related introduction of product to be understood to mobile terminal such as
Smart mobile phone, the 2 D code information of product is scanned using smart mobile phone, obtains the mark (such as Commercial goods labelses) of product.Obtain product
After mark, the video of corresponding product, the video can be called to be used to introduce the overview of understanding product needed for user according to mark.Regarding
During frequency is demonstrated, user can arbitrarily switch visual angle, and the parts and structure of product are observed from different angles.
In step S120, the image of the part comprising product is obtained.
Certain part is interested in user is to product, and when needing to be understood in detail, user passes through mobile terminal pair
Certain part is taken pictures, so as to obtain the image of the part.Can specifically be realized by the camera of mobile terminal, e.g., user
A photographing instruction is triggered, indicates mobile terminal to be taken pictures to target component by camera, obtain the part comprising product
Image.
In step S130, the part to the product in image is identified, and obtains the feature descriptor of part.
Specifically, the part to product in the image that gets carries out feature point detection, the generation of feature point description, feature
A series for the treatment of of Point matching, the feature descriptor of obtaining widget.Wherein, feature point detection treatment can using FAST, Harris,
The feature point detecting methods such as SIFT, SURF, MSER.
In step S140, the feature descriptor of part and the goal descriptor corresponding with part for prestoring are matched,
Obtain the incidence relation between feature descriptor and goal descriptor.
In step S150, the video cartoon of part is added in video according to incidence relation, to generate the virtual of product
Electronic description.
It can be seen that, the original contents processed namely to video of this step are expanded.In concrete implementation mode, root
According to the position of the video cartoon (i.e. virtual information) of the position regulating member of part in above-mentioned video, video cartoon is rendered into regarding
Frequency flows, so as to generate the virtual electronic specification of product.In the follow-up playing process of virtual electronic specification, user can be right
The part of product carries out 360 ° of rotations, and comprehensive observation is carried out from multiple angles.Wherein, aforementioned virtual information can be three-dimensional mould
Type animation, audio frequency and video material and illustrative words etc..
In actual applications, the treatment of amplification content and the making of the above-mentioned video cartoon for referring to can be using offline side
Formula.The manufacturing process of video cartoon is as follows：(1) data acquisition：The RGB for obtaining product (or part) with Kinect sensor schemes
Picture and depth image data, complete the input of three-dimensional data, for Modeling in Product provides data source；(2) three-dimensional modeling：Using acquisition
Product (or part) depth data be modeled, obtain product (or part) three-dimensional modeling data；(3) analysis is rendered：Use
3DMAX softwares to product (or part) add texture, increase model third dimension and the sense of reality, obtain with texture information,
The stronger threedimensional model of the sense of reality；(4) word and leader：The corresponding number of its inner components is added to product (or part)
Word sequence number mark, the lead of parts to digital number, parts assembling guide wire etc.；(5) cartoon making：Using cartoon making
Software (such as flash softwares) produces translucent three-dimensional animation to the threedimensional model of product (or part), can be clearly apparent product
The internal structure and composition of product.With interaction, directly perceived, lively mode products Presentation function and composition, auxiliary user is clearer
Ground understands the operation logic of product (or part), grasps its application method, overcomes traditionally on paper specification and is only capable of by word
With picture expressing information, the artificial deficiency for the aspect such as browsing.
Below in conjunction with specific processing example, come further that more intuitively illustratively the embodiment of the present invention specifically should
With.
By taking automobile virtual electronic specification as an example, the APP softwares that user downloads product related introduction in advance (are wherein contained
The introductory video of multiple product) smart mobile phone is installed to, as user it should be understood that during the automobile of certain brand, user uses intelligence
Mobile phone is scanned it should be understood that the 2 D code information of automobile, the label of acquisition product, the introductory video of automobile is transferred by the label.
The introductory video generally introduces the performance of this brand automobile.User can arbitrarily switch visual angle in video display process, from
The parts and structure of different angle observation automobiles, make user more fully obtain information and expand knowledge, so as to reach
Deeper into the effect for understanding.
If user want understand automobile certain specific part, such as engine, then user using smart mobile phone scene it is right
Engine is taken pictures, and obtains the photo of engine, and the engine photo to obtaining carries out feature point detection, feature point description
Generation, a series for the treatment of of Feature Points Matching, set up engine features descriptor, with the engine picture mark that prestores in APP
The feature descriptor of label (has stored the video specification of automobile all parts, the corresponding portion of each video in APP softwares
Part picture is used as its label) matched, it is interrelated to realize both；Engine video cartoon is adjusted according to engine location
Position, so as to video cartoon is rendered into video flowing, if the amplification contents such as the semi-transparent Ming Dynasty style three-dimensional animation of engine, operation video
It is added in the original contents of video.In order to be played out on the screen of smart mobile phone, user is showed.It is above-mentioned to start
The three-dimensional animation of machine includes brand, total structure, basic parameter (discharge capacity, cylinder number), characteristic of such engine etc..Wait to start
Machine video playback is finished, and continues to be transferred to automobile video introduction, after user understands and finishes, directly exits APP.
The implementation method of virtual electronic specification provided in an embodiment of the present invention, by obtaining the mark of product, and according to
Mark obtains the video of product, further obtains the image of the part comprising product, and part to the product in image is carried out
Identification, obtains the feature descriptor of part, and the feature descriptor of part and the goal descriptor corresponding with part for prestoring are entered
Row matching, obtains the incidence relation between feature descriptor and goal descriptor, according to incidence relation by the video cartoon of part
Added in video, to generate the virtual electronic specification of product.Easy to use, low cost is realized, had a wide range of application, interacted
Property virtual electronic specification strong, that the intuitional and experiential thinking and abundant expression forms can be provided, meet the explanation need of complex industrial product
Summation user's request.
Embodiment two
Fig. 2 is the flow chart of the implementation method of the virtual electronic specification for showing according to embodiments of the present invention two.Can be such as
Device shown in Fig. 4 performs methods described.
Reference picture 2, in step S210, reads the 2 D code information on product, and believe according to Quick Response Code by mobile terminal
Breath obtains the mark of product, and the video of product is obtained according to mark.
The embodiment of the present invention can be using mobile terminal as executive agent, such as smart mobile phone, panel computer, and movement is eventually
End need to have camera function.
Certain part is interested in user is to product, and when needing to be understood in detail, user passes through mobile terminal pair
Certain part is taken pictures, so as to obtain the image of the part.Can specifically be realized by the camera of mobile terminal, e.g., user
A photographing instruction is triggered, indicates mobile terminal to be taken pictures to target component by camera, obtain the part comprising product
Image.
Especially when user does not know or forget the title of parts, can direct access correlation by above-mentioned treatment of taking pictures
The video display of part.
In step S220, the image of the part comprising product is obtained by the picture pick-up device for setting on mobile terminals.
In step S230, feature point detection, the generation of feature point description and Feature Points Matching treatment are carried out to image, obtained
Obtain the feature descriptor of part.
Wherein, feature point detection treatment can be using feature point detecting methods such as FAST, Harris, SIFT, SURF, MSER.
In step S240, the feature descriptor of part and the goal descriptor corresponding with part for prestoring are matched,
Obtain the incidence relation between feature descriptor and goal descriptor.
In step S250, the video cartoon of part is made.
In concrete implementation mode, can by Kinect sensor obtain product part rgb image data and
Depth image data；It is modeled using rgb image data and depth image data, obtains the first kind threedimensional model number of product
According to；First kind three-dimensional modeling data is carried out to render the treatment of analysis, label character and leader, Equations of The Second Kind threedimensional model is obtained
Data；The video cartoon of part is made according to Equations of The Second Kind three-dimensional modeling data.
In step S260, the video cartoon of part is added in video according to incidence relation, to generate the virtual of product
Electronic description.
Wherein, content is identical the step of step S150 with above-described embodiment one for the step of above-mentioned steps S260 contents,
This is repeated no more.
The implementation method of virtual electronic specification provided in an embodiment of the present invention, with following technique effect：
On the one hand, virtual reality technology is introduced into product description, there is provided a kind of virtual electronic specification, by tradition
Paper mold specification in content user is showed with interaction, lively multimedia form, contribute to user to go deep into product
Understand, with stronger interactivity, practicality and convenience, Consumer's Experience is greatly improved, while also a saving product saying
The cost of manufacture of bright book；
On the other hand, using possessing Kinect data acquisition equipments that are cheap, catching the advantage such as moderate accuracy, can be with
The depth image data and RGB data of product are obtained simultaneously, for modeling provides precision data source high, have saved modeling cost
With modeling the time, further for the making of video cartoon provides data basis；
Another further aspect, by scanning Quick Response Code function and camera function on mobile terminal, obtains part interested
Introductory video and image of component, it is to avoid obtain the cumbersome mistake of product introduction in papery specification using directory index mode
Journey, further improves convenience and interactivity.
Embodiment three
Based on identical technology design, Fig. 3 is the realization of the virtual electronic specification for showing according to embodiments of the present invention three
The logic diagram of device.May be used to perform the implementation method flow of the virtual electronic specification as described in embodiment one.
Reference picture 3, virtual electronic specification realize device include mark and video acquiring module 310, image obtain mould
Block 320, picture recognition module 330, descriptor relating module 340 and specification generation module 350.
Mark and video acquiring module 310 are used to obtain the mark of product, and the video of product is obtained according to mark.
Image collection module 320 is used to obtain the image of the part comprising product.
Picture recognition module 330 is used to be identified the part of the product in image, obtains the feature descriptor of part.
Descriptor relating module 340 is used for the feature descriptor of part and the goal descriptor corresponding with part for prestoring
Matched, obtained the incidence relation between feature descriptor and goal descriptor.
Specification generation module 350 is used to that the video cartoon of part is added in the video of product according to incidence relation,
To generate virtual electronic specification.
The implementation method of virtual electronic specification provided in an embodiment of the present invention, by obtaining the mark of product, and according to
Mark obtains the video of product, further obtains the image of the part comprising product, and part to the product in image is carried out
Identification, obtains the feature descriptor of part, and the feature descriptor of part and the goal descriptor corresponding with part for prestoring are entered
Row matching, obtains the incidence relation between feature descriptor and goal descriptor, according to incidence relation by the video cartoon of part
Added in video, to generate the virtual electronic specification of product.Easy to use, low cost is realized, had a wide range of application, interacted
Property virtual electronic specification strong, that the intuitional and experiential thinking and abundant expression forms can be provided, meet the explanation need of complex industrial product
Summation user's request.
Example IV
Based on identical technology design, Fig. 4 is the realization of the virtual electronic specification for showing according to embodiments of the present invention three
The logic diagram of device.May be used to perform the implementation method flow of the virtual electronic specification as described in embodiment two.
Reference picture 4, mark and video acquiring module 310 are believed specifically for the Quick Response Code read by mobile terminal on product
Breath, and the mark of product is obtained according to 2 D code information.
Further, image collection module 320 can be used to be obtained by the picture pick-up device for setting on mobile terminals and include
The image of the part of product.
Preferably, picture recognition module 330 can be used to carrying out image feature point detection, the generation of feature point description and
Feature Points Matching treatment, obtains the feature descriptor of part.
Alternatively, the virtual electronic specification realizes that device also includes：Video cartoon makes module 360 is used for preparing department
The video cartoon of part.
Specifically, video cartoon makes module 360 and may include：
Data capture unit (not shown) is used for the RGB image number of the part that product is obtained by Kinect sensor
According to and depth image data.
First model data acquiring unit (not shown) is used to be carried out using rgb image data and depth image data
Modeling, obtains the first kind three-dimensional modeling data of product.
Second model data acquiring unit (not shown) be used to first kind three-dimensional modeling data render analysis,
Label character and leader are processed, and obtain Equations of The Second Kind three-dimensional modeling data.
Video cartoon production unit (not shown) is used to be made according to Equations of The Second Kind three-dimensional modeling data the video of part
Animation.
The implementation method of virtual electronic specification provided in an embodiment of the present invention, with following technique effect：First, by void
Intend reality technology to be introduced into product description, there is provided a kind of virtual electronic specification, in traditional paper mold specification
Appearance shows user with interaction, lively multimedia form, contributes to user to understand product in depth, with stronger interaction
Property, practicality and convenience, greatly improve Consumer's Experience, while also a saving the cost of manufacture of product description；Second,
Using possessing Kinect data acquisition equipments that are cheap, catching the advantages such as moderate accuracy, the depth of product can be simultaneously obtained
Degree view data and RGB data, for modeling provides precision data source high, have saved modeling cost and modeling time, enter one
Walk as the making of video cartoon provides data basis；3rd, by scanning Quick Response Code function and camera function on mobile terminal,
Obtain the introductory video and image of component of part interested, it is to avoid obtained using directory index mode in papery specification
The complicated processes of product introduction, further improve convenience and interactivity.
It may be noted that the need for according to implementation, each step/part described in this application can be split as into more multistep
Suddenly/part, also can be combined into new step/part by the part operation of two or more step/parts or step/part,
To realize the purpose of the present invention.
Above-mentioned the method according to the invention can be realized in hardware, firmware, or be implemented as being storable in recording medium
Software or computer code in (such as CD ROM, RAM, floppy disk, hard disk or magneto-optic disk), or it is implemented through network download
Original storage in long-range recording medium or nonvolatile machine readable media and by the meter in being stored in local recording medium
Calculation machine code, so that method described here can be stored in uses all-purpose computer, application specific processor or programmable or special
With the such software processing in the recording medium of hardware (such as ASIC or FPGA).It is appreciated that computer, processor, micro-
Processor controller or programmable hardware include storing receive software or the storage assembly of computer code (for example, RAM,
ROM, flash memory etc.), when the software or computer code are by computer, processor or hardware access and execution, realize herein
The processing method of description.Additionally, when all-purpose computer accesses the code for the treatment for realizing being shown in which, the execution of code
All-purpose computer is converted into the special-purpose computer for performing the treatment being shown in which.
The above, specific embodiment only of the invention, but protection scope of the present invention is not limited thereto, and it is any
Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all contain
Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.
Claims (10)
1. a kind of implementation method of virtual electronic specification, it is characterised in that methods described includes：
The mark of product is obtained, and the video of the product is obtained according to the mark；
Obtain the image of the part comprising the product；
The part of the product in described image is identified, and obtains the feature descriptor of the part；
The feature descriptor of the part and the goal descriptor corresponding with the part for prestoring are matched, is obtained described
Incidence relation between feature descriptor and the goal descriptor；
The video cartoon of the part is added in the video according to the incidence relation, to generate the virtual of the product
Electronic description.
2. method according to claim 1, it is characterised in that the mark of the acquisition product includes：
2 D code information on the product is read by mobile terminal, and the product is obtained according to the 2 D code information
Mark.
3. method according to claim 2, it is characterised in that the image bag of part of the acquisition comprising the product
Include：
The image of the part comprising the product is obtained by the picture pick-up device for setting on the mobile terminal.
4. method according to claim 1, it is characterised in that it is described to described image in the part of the product carry out
Identification, the feature descriptor for obtaining the part includes：
Feature point detection, the generation of feature point description and Feature Points Matching treatment are carried out to described image, the part is obtained
Feature descriptor.
5. method according to claim 4, it is characterised in that methods described also includes：The video for making the part is moved
Draw；
The video cartoon for making the part includes：
The rgb image data and depth image data of the part of the product are obtained by Kinect sensor；
It is modeled using the rgb image data and depth image data, obtains the first kind threedimensional model number of the product
According to；
The first kind three-dimensional modeling data is carried out to render the treatment of analysis, label character and leader, Equations of The Second Kind three is obtained
Dimension module data；
The video cartoon of the part is made according to the Equations of The Second Kind three-dimensional modeling data.
6. a kind of virtual electronic specification realizes device, it is characterised in that described device includes：
Mark and video acquiring module, the mark for obtaining product, and the video of the product is obtained according to the mark；
Image collection module, the image for obtaining the part comprising the product；
Picture recognition module, the part for the product in described image is identified, and obtains the feature of the part
Descriptor；
Descriptor relating module, for by the feature descriptor of the part and the goal description corresponding with the part for prestoring
Symbol is matched, and obtains the incidence relation between the feature descriptor and the goal descriptor；
Specification generation module, for the video cartoon of the part to be added into regarding for the product according to the incidence relation
In frequency, to generate virtual electronic specification.
7. device according to claim 6, it is characterised in that the mark and video acquiring module be used for by it is mobile eventually
The 2 D code information on the product is read at end, and the mark of the product is obtained according to the 2 D code information.
8. device according to claim 7, it is characterised in that described image acquisition module is used for by being arranged on the shifting
Picture pick-up device in dynamic terminal obtains the image of the part comprising the product.
9. device according to claim 6, it is characterised in that described image identification module is used to carry out spy to described image
A detection, the generation of feature point description and Feature Points Matching treatment are levied, the feature descriptor of the part is obtained.
10. device according to claim 9, it is characterised in that described device also includes：
Video cartoon makes module, the video cartoon for making the part；
The video cartoon makes module to be included：
Data capture unit, rgb image data and depth map for obtaining the part of the product by Kinect sensor
As data；
First model data acquiring unit, for being modeled using the rgb image data and depth image data, obtains institute
State the first kind three-dimensional modeling data of product；
Second model data acquiring unit, for the first kind three-dimensional modeling data render analysis, label character and
Leader treatment, obtains Equations of The Second Kind three-dimensional modeling data；
Video cartoon production unit, the video cartoon for making the part according to the Equations of The Second Kind three-dimensional modeling data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611026190.XA CN106776732B (en) | 2016-11-21 | 2016-11-21 | The implementation method and device of virtual electronic specification |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611026190.XA CN106776732B (en) | 2016-11-21 | 2016-11-21 | The implementation method and device of virtual electronic specification |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106776732A true CN106776732A (en) | 2017-05-31 |
| CN106776732B CN106776732B (en) | 2019-09-06 |
Family
ID=58971498
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611026190.XA Active CN106776732B (en) | 2016-11-21 | 2016-11-21 | The implementation method and device of virtual electronic specification |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106776732B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107578473A (en) * | 2017-08-15 | 2018-01-12 | 绵阳云聚科技有限公司 | The expression and system of a kind of product advertising |
| CN107870673A (en) * | 2017-11-28 | 2018-04-03 | 深圳市蓝游网络科技有限公司 | Specification implementation method based on AR technologies |
| CN107948327A (en) * | 2018-01-02 | 2018-04-20 | 中国银行股份有限公司 | A kind of data processing method based on professional training, apparatus and system |
| CN107993286A (en) * | 2017-11-28 | 2018-05-04 | 深圳市蓝游网络科技有限公司 | Action teaching implementation method based on AR technologies |
| CN108010131A (en) * | 2017-12-14 | 2018-05-08 | 北京长城华冠汽车技术开发有限公司 | A kind of vehicle operating based on image holographic process illustrates imaging method and system |
| CN108021991A (en) * | 2017-11-14 | 2018-05-11 | 歌尔科技有限公司 | Obtain the method and device of device information |
| CN111582418A (en) * | 2020-05-20 | 2020-08-25 | 郝杰 | Sliding display method of AR virtual specification |
| CN111598978A (en) * | 2020-05-08 | 2020-08-28 | 上海实迅网络科技有限公司 | Article specification display system and method based on AR technology |
| CN112633806A (en) * | 2020-12-26 | 2021-04-09 | 苏州浪潮智能科技有限公司 | Electronic part bill of material management method and related equipment |
| CN113489963A (en) * | 2021-07-08 | 2021-10-08 | 宁波宝贝第一母婴用品有限公司 | Method and device for guiding installation of cart |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102110379A (en) * | 2011-02-22 | 2011-06-29 | 黄振强 | Multimedia reading matter giving readers enhanced feeling of reality |
| CN105282520A (en) * | 2015-11-16 | 2016-01-27 | 徐杰 | Chip for augmented reality explanation device, and augmented reality information transmission and interaction method |
| CN105956196A (en) * | 2016-06-15 | 2016-09-21 | 天津市汇源印刷有限公司 | Method for making instruction book by adopting virtual reality augmentation technology |
| CN106023692A (en) * | 2016-05-13 | 2016-10-12 | 广东博士早教科技有限公司 | AR interest learning system and method based on entertainment interaction |
-
2016
- 2016-11-21 CN CN201611026190.XA patent/CN106776732B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102110379A (en) * | 2011-02-22 | 2011-06-29 | 黄振强 | Multimedia reading matter giving readers enhanced feeling of reality |
| CN105282520A (en) * | 2015-11-16 | 2016-01-27 | 徐杰 | Chip for augmented reality explanation device, and augmented reality information transmission and interaction method |
| CN106023692A (en) * | 2016-05-13 | 2016-10-12 | 广东博士早教科技有限公司 | AR interest learning system and method based on entertainment interaction |
| CN105956196A (en) * | 2016-06-15 | 2016-09-21 | 天津市汇源印刷有限公司 | Method for making instruction book by adopting virtual reality augmentation technology |
Non-Patent Citations (1)
| Title |
|---|
| 程彤等: ""增强现实技术在非正式学习空间中的应用探讨"", 《中国教育信息化》 * |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107578473A (en) * | 2017-08-15 | 2018-01-12 | 绵阳云聚科技有限公司 | The expression and system of a kind of product advertising |
| CN108021991B (en) * | 2017-11-14 | 2021-05-18 | 歌尔科技有限公司 | Method and device for acquiring instrument information |
| CN108021991A (en) * | 2017-11-14 | 2018-05-11 | 歌尔科技有限公司 | Obtain the method and device of device information |
| CN107993286A (en) * | 2017-11-28 | 2018-05-04 | 深圳市蓝游网络科技有限公司 | Action teaching implementation method based on AR technologies |
| CN107870673A (en) * | 2017-11-28 | 2018-04-03 | 深圳市蓝游网络科技有限公司 | Specification implementation method based on AR technologies |
| CN108010131A (en) * | 2017-12-14 | 2018-05-08 | 北京长城华冠汽车技术开发有限公司 | A kind of vehicle operating based on image holographic process illustrates imaging method and system |
| CN107948327A (en) * | 2018-01-02 | 2018-04-20 | 中国银行股份有限公司 | A kind of data processing method based on professional training, apparatus and system |
| CN111598978A (en) * | 2020-05-08 | 2020-08-28 | 上海实迅网络科技有限公司 | Article specification display system and method based on AR technology |
| CN111598978B (en) * | 2020-05-08 | 2023-09-26 | 上海实迅网络科技有限公司 | Article instruction book display system and display method based on AR technology |
| CN111582418A (en) * | 2020-05-20 | 2020-08-25 | 郝杰 | Sliding display method of AR virtual specification |
| CN111582418B (en) * | 2020-05-20 | 2022-03-08 | 郝杰 | Sliding display method of AR virtual specification |
| CN112633806A (en) * | 2020-12-26 | 2021-04-09 | 苏州浪潮智能科技有限公司 | Electronic part bill of material management method and related equipment |
| CN112633806B (en) * | 2020-12-26 | 2022-06-03 | 苏州浪潮智能科技有限公司 | Electronic part bill of material management method and related equipment |
| CN113489963A (en) * | 2021-07-08 | 2021-10-08 | 宁波宝贝第一母婴用品有限公司 | Method and device for guiding installation of cart |
| CN113489963B (en) * | 2021-07-08 | 2024-02-23 | 宁波宝贝第一母婴用品有限公司 | Cart installation guiding method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106776732B (en) | 2019-09-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106776732A (en) | The implementation method and device of virtual electronic specification | |
| US9445016B2 (en) | Features such as titles, transitions, and/or effects which vary according to positions | |
| CN108369633B (en) | Visual representation of photo album | |
| US11237702B2 (en) | Carousel interface for post-capture processing in a messaging system | |
| CN102157006B (en) | The method and apparatus of the dynamic effect of the role that generation can interact with image | |
| US20230409852A1 (en) | Product verification in a messaging system | |
| CN112933597B (en) | Image processing method, image processing device, computer equipment and storage medium | |
| US11756249B2 (en) | Layering of post-capture processing in a messaging system | |
| US11750546B2 (en) | Providing post-capture media overlays for post-capture processing in a messaging system | |
| US20220207804A1 (en) | Automated content curation for generating composite augmented reality content | |
| CN104133956A (en) | Method and device for processing pictures | |
| US20210203627A1 (en) | Post-capture processing in a messaging system | |
| CN111240736B (en) | Model configuration method, device, equipment and storage medium | |
| CN105825521A (en) | Information processing apparatus and control method thereof | |
| US11875600B2 (en) | Facial synthesis in augmented reality content for online communities | |
| WO2021138630A1 (en) | Post-capture processing in a messaging system | |
| CN114880062B (en) | Chat expression display method, device, electronic device and storage medium | |
| CN117099134A (en) | Face composition in augmented reality content for advertising | |
| CN110599601A (en) | Method and device for generating painting image, terminal and storage medium | |
| CN117099133A (en) | Face synthesis in overlaid augmented reality content | |
| KR20090046137A (en) | Apparatus and method for searching media data | |
| CN114531553A (en) | Method and device for generating special effect video, electronic equipment and storage medium | |
| CN111049735B (en) | Group head portrait display method, device, equipment and storage medium | |
| CN114936000A (en) | Vehicle-mounted machine interaction method, system, medium and equipment based on picture framework | |
| CN109472873B (en) | Three-dimensional model generation method, device and hardware device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20221031 Address after: Room 1016, Block C, Haiyong International Building 2, No. 489, Lusong Road, High tech Zone, Changsha City, Hunan Province, 410221 Patentee after: Hunan Fenghua Intelligent Technology Co.,Ltd. Address before: 410205 A645, room 39, Changsha central software park headquarters, No. 39, Jian Shan Road, hi tech Development Zone, Hunan. Patentee before: HUNAN VISUALTOURING INFORMATION TECHNOLOGY Co.,Ltd. |