CN106713896B - The multimedia presentation method of still image, device and system - Google Patents
The multimedia presentation method of still image, device and system Download PDFInfo
- Publication number
- CN106713896B CN106713896B CN201611089873.XA CN201611089873A CN106713896B CN 106713896 B CN106713896 B CN 106713896B CN 201611089873 A CN201611089873 A CN 201611089873A CN 106713896 B CN106713896 B CN 106713896B
- Authority
- CN
- China
- Prior art keywords
- electronic image
- image
- still image
- article
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000009877 rendering Methods 0.000 claims abstract description 50
- 230000003068 static effect Effects 0.000 claims abstract description 24
- 230000033001 locomotion Effects 0.000 claims description 34
- 238000012937 correction Methods 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 10
- 239000003086 colorant Substances 0.000 claims description 6
- 230000008859 change Effects 0.000 claims description 3
- 241000406668 Loxodonta cyclotis Species 0.000 claims description 2
- 239000000463 material Substances 0.000 abstract description 12
- 238000010586 diagram Methods 0.000 description 21
- 230000036410 touch Effects 0.000 description 11
- 230000002452 interceptive effect Effects 0.000 description 10
- 230000000694 effects Effects 0.000 description 9
- 238000004458 analytical method Methods 0.000 description 6
- 230000003993 interaction Effects 0.000 description 6
- 230000009471 action Effects 0.000 description 5
- 230000005611 electricity Effects 0.000 description 4
- 230000002708 enhancing effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 241001269238 Data Species 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000001154 acute effect Effects 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013139 quantization Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241000252254 Catostomidae Species 0.000 description 1
- 208000020564 Eye injury Diseases 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 239000011248 coating agent Substances 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000003702 image correction Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000013011 mating Effects 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000003973 paint Substances 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000007306 turnover Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
- 239000002023 wood Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of multimedia presentation methods of still image, device and system.Wherein, this method comprises: obtaining electronic image, wherein electronic image is shot by the still image on article；Obtain the information in electronic image；The corresponding multi-medium data of still image is determined according to information, wherein multi-medium data includes at least one of: audio, video, 3D rendering；Multi-medium data is presented.The present invention, which solves the prior art, cannot achieve the technical issues of any static non-electronics major material object is carried out animation presentation.
Description
Technical field
The present invention relates to field of image processings, multimedia presentation method, device in particular to a kind of still image
And system.
Background technique
With the raising of quality of life and level of education, present parent increasingly payes attention to the formative education of child, initiation
Education refer to allow child do sth. in advance recognize around the world, parent often buy it is some about infant elementary education education draw this, product
Wood, picture album etc. allow child to contact the article of various colors, shape extensively, allow child to learn to read with the aid of pictures, recognize various toys etc.,
Child is allowed visually to go to recognize the things in this world.
In order to reinforce the understanding to text or image of child, occur the stationery that many points read class, such as point in the market
Reading machine or talking pen are sold together with corresponding picture album, books, and child is allowed to click text or while image, can be from listening
Feel and knows from experience up.However, existing point reading stationery on the market can only be realized and be made a sound with the use of mating books, cannot achieve
Visual picture is presented, and interactivity is poor；And any static non-electronics major material object cannot be converted to corresponding multimedia number
According to poor compatibility.Due to, existing talking pen or point reader be all it is matching used with books, when learning other books
Need to repurchase with the matching used talking pen of the book or point reader, cause very big learning cost.
On the other hand, the smart machines such as mobile phone, tablet computer are widely available into people's lives, set using electronics
The standby trend to learn to have become future education still cannot substitute all tradition using electronic equipment and learn, for example, child
Son drawing, picture mosaic etc., also, long-time close contact electronic equipment, it is larger to the eye injury of child.Thus, compel to be essential
Want a kind of Learning Scheme that can be combined tradition study with electronic equipment.
Aiming at the problem that the above-mentioned prior art cannot achieve any static non-electronics major material object progress animation presentation, at present
Not yet put forward effective solutions.
Summary of the invention
The embodiment of the invention provides a kind of multimedia presentation methods of still image, device and system, at least to solve
The prior art cannot achieve the technical issues of any static non-electronics major material object is carried out animation presentation.
According to an aspect of an embodiment of the present invention, a kind of multimedia presentation method of still image is provided, comprising: obtain
Take electronic image, wherein electronic image is shot by the still image on article；Obtain the information in electronic image；
The corresponding multi-medium data of still image is determined according to information, wherein multi-medium data includes at least one of: audio, view
Frequently, 3D rendering；Multi-medium data is presented.
According to another aspect of an embodiment of the present invention, a kind of multimedia presentation system of still image is additionally provided, comprising:
Camera, for obtaining electronic image, wherein electronic image is shot by the still image on article；Processor is used
Information in acquisition electronic image；The corresponding multi-medium data of still image is determined according to information, and multi-medium data is presented；
Wherein, multi-medium data includes at least one of: audio, video, 3D rendering.
According to another aspect of an embodiment of the present invention, a kind of multimedia presentation devices of still image are additionally provided, comprising:
First obtains module, for obtaining electronic image, wherein electronic image is shot by the still image on article；The
Two obtain module, for obtaining the information in electronic image；Determining module, for determining that still image is corresponding more according to information
Media data, wherein multi-medium data includes at least one of: audio, video, 3D rendering；Output module is more for rendering
Media data.
In embodiments of the present invention, by obtaining electronic image, wherein electronic image is clapped by the still image on article
It takes the photograph；Obtain the information in electronic image；The corresponding multi-medium data of still image is determined according to information, wherein more matchmakers
Volume data includes at least one of: audio, video, 3D rendering；Multi-medium data is presented, has reached any papery plan view
As the purpose of interactive display in the multimedia form, thus the technical effect for realizing thrift education cost, enhancing user experience, into
And it solves the prior art and cannot achieve the technical issues of any static non-electronics major material object is subjected to animation presentation.
Detailed description of the invention
The drawings described herein are used to provide a further understanding of the present invention, constitutes part of this application, this hair
Bright illustrative embodiments and their description are used to explain the present invention, and are not constituted improper limitations of the present invention.In the accompanying drawings:
Fig. 1 is a kind of multimedia presentation method flow chart of still image according to an embodiment of the present invention；
Fig. 2 is a kind of multimedia presentation method flow chart of optional still image according to an embodiment of the present invention；
Fig. 3 is a kind of multimedia presentation method flow chart of optional still image according to an embodiment of the present invention；
Fig. 4 is a kind of multimedia presentation method flow chart of optional still image according to an embodiment of the present invention；
Fig. 5 is a kind of multimedia presentation method flow chart of optional still image according to an embodiment of the present invention；
Fig. 6 is a kind of multimedia presentation method flow chart of optional still image according to an embodiment of the present invention；
Fig. 7 is a kind of multimedia presentation method flow chart of preferred drawing still image according to an embodiment of the present invention；
Fig. 8 is a kind of method flow diagram for preferably static pattern being allowed to move up according to an embodiment of the present invention；
Fig. 9 is a kind of support schematic diagram according to an embodiment of the present invention；
Figure 10 (a) is a kind of optional support schematic diagram according to an embodiment of the present invention；
Figure 10 (b) is a kind of optional support schematic diagram according to an embodiment of the present invention；
Figure 11 is another optional support schematic diagram according to an embodiment of the present invention；
Figure 12 is another optional support schematic diagram according to an embodiment of the present invention；
Figure 13 is another optional support schematic diagram according to an embodiment of the present invention；
Figure 14 (a) is a kind of optional support schematic diagram according to an embodiment of the present invention；
Figure 14 (b) is a kind of optional support schematic diagram according to an embodiment of the present invention；
Figure 15 (a) is a kind of optional reflecting mirror schematic diagram according to an embodiment of the present invention；
Figure 15 (b) is a kind of optional reflecting mirror schematic diagram according to an embodiment of the present invention；
Figure 16 is a kind of optional support schematic diagram according to an embodiment of the present invention；
Figure 17 is according to an embodiment of the present invention a kind of optionally in the fingerstall schematic diagram of tracking gesture operation；
Figure 18 is a kind of multimedia presentation system schematic diagram of still image according to an embodiment of the present invention；
Figure 19 is a kind of multimedia presentation devices schematic diagram of still image according to an embodiment of the present invention；And
Figure 20 is a kind of multimedia resource sharing system schematic diagram based on cloud storage according to an embodiment of the present invention.
Specific embodiment
In order to enable those skilled in the art to better understand the solution of the present invention, below in conjunction in the embodiment of the present invention
Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is only
The embodiment of a part of the invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill people
The model that the present invention protects all should belong in member's every other embodiment obtained without making creative work
It encloses.
It should be noted that description and claims of this specification and term " first " in above-mentioned attached drawing, "
Two " etc. be to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should be understood that using in this way
Data be interchangeable under appropriate circumstances, so as to the embodiment of the present invention described herein can in addition to illustrating herein or
Sequence other than those of description is implemented.In addition, term " includes " and " having " and their any deformation, it is intended that cover
Cover it is non-exclusive include, for example, the process, method, system, product or equipment for containing a series of steps or units are not necessarily limited to
Step or unit those of is clearly listed, but may include be not clearly listed or for these process, methods, product
Or other step or units that equipment is intrinsic.
Embodiment 1
According to embodiments of the present invention, a kind of multimedia presentation method embodiment of still image is provided, needs to illustrate
It is that step shown in the flowchart of the accompanying drawings can execute in a computer system such as a set of computer executable instructions,
Also, although logical order is shown in flow charts, and it in some cases, can be to be different from sequence execution herein
Shown or described step.
Fig. 1 is a kind of multimedia presentation method flow chart of still image according to an embodiment of the present invention, as shown in Figure 1,
This method comprises the following steps:
Step S102 obtains electronic image, wherein electronic image is shot by the still image on article；
Step S104 obtains the information in electronic image；
Step S106 determines the corresponding multi-medium data of still image according to information, wherein multi-medium data includes following
At least one: audio, video, 3D rendering；
Multi-medium data is presented in step S108.
As a kind of optional embodiment, above-mentioned article can for for child's formative education textbook, draw this or other
Books can also be the toys such as seven-piece puzzle, picture mosaic, building blocks；Above-mentioned still image can be placed in default sky for above-mentioned article
Between after the picture that shows, for example, it may be above-mentioned textbook or draw this cover, or in which a certain page, be also possible to
The shape etc. of picture mosaic；Above-mentioned electronic image can be the still image in the pre-set space obtained by photographic device on article
Electronic image；Above-mentioned multi-medium data can be audio corresponding with above-mentioned still image, video or 3D rendering；It is filled by camera shooting
It sets, the still image on the article in pre-set space is converted into corresponding electronic image, extracted from electronic image corresponding
Information to obtain multi-medium data corresponding with the information, and is presented to display screen.
In a kind of optional embodiment, above-mentioned photographic device can be the camera of mobile phone or tablet computer, above-mentioned
Display screen can be the display screen of mobile phone or tablet computer, a certain when open textbook or books by taking textbook or books as an example
When being text on the page (still image), the page is shot using mobile phone or tablet computer camera, it can be by textbook or books
Word recitation on the page comes out；When having image on a certain page of open textbook or books, mobile phone or plate electricity are utilized
The camera of brain shoots the page, can be in the flat image on mobile phone or the display screen display of the tablet computer page with 3D
The form of image shows, and the additional corresponding audio or video of display, to increase the readability of textbook or books.
Optionally, above-mentioned photographic device may be external camera, and above-mentioned display screen can be the aobvious of desktop computer
Show device.
In another optional embodiment, photographic device and display screen can be fixed using bracket, when user exists
During reading textbook or books, as page turning of user etc. operates, audio, video or the 3D rendering in display screen are cut automatically
Lower one page is shifted to, by clicking or touching a certain target object in local text or image on textbook or books, on display screen
Multi-medium data can play in the page that the target object makes corresponding movement in the audio of corresponding portion, video or image.
In a kind of optional embodiment, above-mentioned article can be textbook, pass through the behaviour such as click, touchs of user on textbook
Make, it can be with the picture of real-time display textbook on display screen, it is preferable that can be 3D model；It is a certain in picture when the user clicks
When a target object, corresponding target object adjoint can issue corresponding sound or make some movements on display screen.
In a kind of optional embodiment, above-mentioned article can be to draw this, can on a display screen real-time display user in paper
Matter draws the color or shape of full-filling on this, after user completes full-filling operation, can show that full-filling is completed flat on a display screen
The 3D model of face image can be with for example, when the picture that a width a group duckling swims in the water has been got well in full-filling to child in drawing this
Corresponding stereoscopic picture plane is shown in display screen, it is preferable that the sense of accomplishment of child can be increased with corresponding sound etc.,
Cultivate the learning interest of child.
In a kind of optional embodiment, above-mentioned article can be picture mosaic, can show a width picture mosaic, user on a display screen
Picture mosaic can be carried out in pre-set space (for example, it may be region that camera can cover on flat panel desktop), when the spelling of user
When figure result is correct, can issue it is some about congratulate the correct sound of picture mosaic, and can by the picture mosaic spelled progress 3D display；
When the picture mosaic result mistake of user, some sound about encouragement can be issued, it is preferable that some picture mosaics can also be provided and mentioned
Show.
In a kind of optional embodiment, above-mentioned article can show on a display screen a material object with English alphabet card, use
Family can throw the alphabetical card of English word corresponding with material object in pre-set space, as long as the alphabetical card and the English thrown
Literary word is corresponding (without guaranteeing sequence consensus), then exports and throw correct result information.
Through the foregoing embodiment, the learning interest of child can be cultivated, and promotes the study and growth of child.
From the foregoing, it will be observed that in the above embodiments of the present application, article is shot by photographic device, by article (for example, textbook,
Draw this or other books) on still image be converted to corresponding electronic image, according to the information obtained from the electronic image,
Still image is showed in the form of audio, video or 3D rendering etc. are multimedia, has been reached any papery flat image
The purpose of interactive display in the multimedia form, thus the technical effect for realizing thrift education cost, enhancing user experience, in turn
Solving the prior art cannot achieve the technical issues of any static non-electronics major material object is carried out animation presentation.
Optionally, above-mentioned article may include: textbook, draw sheet, card, picture album, Freehandhand-drawing sheet, seven-piece puzzle, building blocks, toy.
It in an alternative embodiment, can as shown in Fig. 2, obtaining the information in electronic image in above-mentioned steps S104
To include: step S204, the characteristic information of electronic image is obtained；
The corresponding multi-medium data of still image is determined according to information in above-mentioned steps S106, may include: step S206,
It is searched and the matched 3D rendering of electronic image according to characteristic information.
As a kind of optional embodiment, above-mentioned electronic image can be object in the pre-set space obtained by photographic device
The electronic image of still image on product；Features described above information can be text, picture, color or other marks in electronic image
Remember information；Above-mentioned multi-medium data can be audio corresponding with above-mentioned still image, video or 3D rendering；Based on above-mentioned steps
S204 and S206, after the still image on the article in pre-set space is converted to electronic image, the available electronic chart
Characteristic information as in is searched and the matched 3D rendering of the electronic image according to the characteristic information got.
It, can setting flag information can be with for example, two dimensional code etc. on the page of article in a kind of preferred embodiment
It rapidly identifies the page, and finds out 3D rendering corresponding with the page.
Through the foregoing embodiment, the effect that the flat image in the article page is carried out to 3D displaying is realized.
In an alternative embodiment, as shown in figure 3, obtaining the characteristic information of electronic image in above-mentioned steps S204,
It may include: step S304, obtain the outline of the target object in electronic image；
It may include: step according to characteristic information lookup and the matched 3D rendering of electronic image in above-mentioned steps S206
S306 is searched and the matched 3D model of target object according to outline.
As a kind of optional embodiment, above-mentioned electronic image can be object in the pre-set space obtained by photographic device
The electronic image of still image on product；Features described above information can be text, picture, color or other marks in electronic image
Remember information；Above-mentioned target object can be each figure on the article page；Above-mentioned outline can be each on the article page
The shape contour of a image；Above-mentioned 3D model can be the corresponding 3D model of these images, for example, there is one on the article page
Duckling can be shown as 3D model when display by duckling image；Based on above-mentioned steps S304 and S306, will preset
After the still image on article in space is converted to electronic image, each target object in the available electronic image
Shape, i.e. outline are searched and the matched 3D model of the target object according to the outline.
Through the foregoing embodiment, the mesh that each target object in the page by paper article carries out 3D displaying respectively has been reached
's.
In an alternative embodiment, as shown in figure 4,3D rendering, which is presented, may include steps of:
Step S402 obtains the spatial cue of at least one portion of target object according to outline；
Step S404 is rendered according to spatial cue pair and the matched 3D model of target object；
Step S406, the 3D model after rendering is presented.
As a kind of optional embodiment, above-mentioned target object can be each figure on the article page；Above-mentioned lines
Profile can be the shape contour of each image on the article page；Above-mentioned 3D model can be the corresponding 3D model of these images；
Above-mentioned spatial cue can be the variation of each color of image on the article page；Based on above-mentioned steps S402 to S406, according to line
Profile is searched with after the matched 3D model of target object, obtains one of the acquisition target object according to the outline of figure
Or the spatial cue (for example, variation of graphic color) of multiple portions, and will be matched with the target object according to the spatial cue
3D model rendered, and on a display screen present rendering after 3D model.
Through the foregoing embodiment, the effect for moving up static pattern is realized.
In an alternative embodiment, as shown in figure 5, the information of electronic image is obtained in above-mentioned steps S104, it can
To include: step S504, location information corresponding with the position operated on article in electronic image is obtained, wherein operation packet
It includes: page turning, click, touch；
The corresponding multi-medium data of still image is determined according to information in above-mentioned steps S106, may include: step S506,
It is searched and the matched audio or video of location information according to location information.
As a kind of optional embodiment, above-mentioned electronic image can be object in the pre-set space obtained by photographic device
The electronic image of still image on product；Aforesaid operations position can be to carry out a little to the still image of the article in pre-set space
It hits, touch or the position of the operations such as page turning；Above-mentioned multi-medium data can for audio corresponding with above-mentioned still image, video or
3D rendering；Based on above-mentioned steps S504 and S506, the still image on the article in pre-set space is being converted into electronic image,
Obtain in the electronic image with clicked in still image, touch or the corresponding electronic image in the position of the operations such as page turning in position
Confidence breath searches the audio or video with the location matches according to the location information.
Herein it should be noted that aforesaid operations position can be the page number position in the papery page, or
Position in the papery page where target object, if operation is page number position, that is, progress is page turn over operation, can
With the audio or video of one page under automatic acquisition；If the position where the target object of operation, that is, click or touch the target
Object, then obtain the corresponding audio or video of the target object automatically, in a kind of optional embodiment, is also possible to the target pair
The 3D model of elephant.
Optionally, above-mentioned acquisition can wrap location information corresponding with operating position in electronic image in electronic image
It includes: the position that article is operated is obtained by motion tracking device；Corresponding location information in electronic image is determined according to the position.
Through the foregoing embodiment, it realizes by clicking or touching in the article page some position and obtains corresponding position
The purpose of audio or video.
It, can be by acquiring the exercise data of user in real time, and according to data of doing exercises in a kind of optional embodiment
Corresponding driving data is generated, rendering virtual objects (for example, sound) is triggered according to driving data, to generate animation shadow in real time
As data, wherein exercise data may include at least one: books page turning action data, Fingers loop data, touch screen
Click (movement) data.
In a kind of optional embodiment, in real time acquire user exercise data may include at least one: analysis
What is inputted includes the image of books in acquisition target, and the characteristic information of books in positioning acquisition object is believed according to the feature of books
Which page determined in which kind of data books ceased, wherein the characteristic information position of books includes at least one of: book pages
The position at place, the tilt angle of book pages, rotation angle etc..
In a kind of optional embodiment, before processing exercise data generates the first movement driving data, above-mentioned side
Method further includes at least one of: analyze input comprising finger finger ring position in acquisition target, in positioning acquisition object
The characteristic information of image, according to characteristic information determine whether there is finger, the location information of finger in the picture, wherein figure
The characteristic information position of picture includes at least one of: colouring information and shape information.
In a kind of optional embodiment, before processing exercise data generates the first movement driving data, above-mentioned side
Method can also include at least one of: from which page identified in books in image, the position of book pages in the picture
It sets, while from finger ring, there are various inclinations and rotation, is needed to books page when due to acquisition data in identification in image
Correction is just had an X-rayed in face, while correction is also also carried out to finger ring makes its data in the same data space, then according in advance
The trigger condition set obtains finger ring driving data；Acquire touch screen corresponding with acquisition target and peripheral hardware mouse-keyboard etc.
Sensing data calculates the action data of acquisition target according to sensing data, wherein action data includes working as acquisition target
The position of the world coordinates of preceding movement and rotation angle.
In a kind of optional embodiment, after the first animated image data and sound rendering, the above method is also wrapped
It includes:
Step 1 acquires interactive information, and sends interactive information in the virtual scene of the first animated image and sound,
Wherein, interactive information include positioned at interactive objects at least one of information: voice messaging, image information, action message,
Text information, interaction instruction；
Step 2, the second exercise data that real-time capture acquisition target is generated according to interactive information；
Step 3 generates the second movement driving data according to the second exercise data, and is driven according to the second movement driving data
It moves and renders virtual objects and generate the second animated image data and sound in real time.
In a kind of optional embodiment, action message and interaction instruction source are to touch screen and finger ring in actual books
Finger ring operation of the touch operation on book pages above the page, wherein processing module is contained, real-time book pages
Detection, aerial prospective correction, the identification of real-time finger ring cooperates book pages perspective correction, triggers special-effect information.
In a kind of optional embodiment, 2D still image generation 3D dynamic image may include into following operation:
Then identification to the static images, segmentation, the correction of spatial position allow the picture of existence to be given birth to corresponding to used model
At 3D dynamic image.
Based on the above embodiment, as shown in figure 5, it may include: step that multi-medium data is presented in above-mentioned steps S108
S508 plays audio or video.
In an alternative embodiment, electronic image is obtained, may include: quiet on the article obtained in pre-set space
State image；Still image is identified, is corrected, electronic image is obtained.
Herein it should be noted that being obtained since the image of photographic device shooting is there may be rotating, tilting
After still image on the article page, still image can be identified, aerial prospective correction etc., to obtain the page
Electronic image.
In an alternative embodiment, as shown in fig. 6, the above method can also wrap after multi-medium data is presented
Include following steps:
Step S602 obtains preset gesture motion, wherein gesture motion is customized by the user setting；
Step S604 determines the operation to multi-medium data according to gesture motion, wherein operation includes at least: pause,
Switch or exit the multi-medium data currently presented.
As a kind of optional embodiment, above-mentioned gesture motion can be a series of dynamic of user's customized setting in advance
Make；In a kind of optional embodiment, can be set and draw triangle on the article of pre-set space be to suspend the more matchmakers currently presented
Volume data；It is arranged in and is drawn a circle in pre-set space to exit the multi-medium data currently presented (for example, video or audio etc.)；Setting
It is to automatically switch to next multi-medium data in pre-set space inside-paint horizontal line.
Through the foregoing embodiment, the purpose for being switched fast, suspending or exiting current multimedia data is realized, use is enhanced
Family experience effect.
Embodiment as one preferred, Fig. 7 show a kind of multimedia presentation method flow chart of drawing still image.
As shown in fig. 7, comprises following steps:
The first still image on this is drawn in step S702, acquisition.
In above-mentioned steps, the first still image drawn on this is obtained by photographic device, the first still image is carried out
Aerial prospective correction eliminates user and shoots the rotation generated when image, tilt problem, then to characteristic point edge analysis, and
Save these characteristic point outline datas and picture.
Step S704 calculates its topological structure according to the outline data of the first still image, searches in the database corresponding
Isomorphism topological data.
In above-mentioned steps, to the topology diagram for calculating the still image according to characteristic point outline data, according to topology
The isomorphic relations of structure chart searches corresponding isomorphism topological data in topological database.
Step S706 establishes 3D model and movement according to the isomorphism topological data got for first still image.
In above-mentioned steps, after corresponding isomorphism topological data is searched in topological database, for first still image
Establish 3D model and movement.
Step S708 obtains the second still image after drawing.
In above-mentioned steps, aerial prospective correction is carried out to the second still image, one is obtained and the first still image is big
Small consistent image (only difference is that the pattern has filled out various colors by user).
Step S710, the corresponding 3D model of the second still image of output.
In above-mentioned steps, topological data is calculated according to the outline data of the second still image, with the second static map
The topological data of picture replaces the original texture of 3D model, and then 3D model is shown, presents to make to draw.
In the above embodiments of the present application, a kind of multimedia presentation method of drawing still image is provided, i.e., some
Above static pattern, user can like according to oneself, and static images are depicted as oneself desired color, then pass through camera shooting
Head shooting deducts the matching in original image according to characteristic point obtains specifically which static image by procedure identification,
The image of identification is carried out aerial prospective correction, obtains a picture as original static pattern (only difference is that should
Pattern has filled out various colors by user), it then will correct the 3D model wash with watercolours of later image data and well in advance
Dye, obtains the image of final result, in this way, being achieved that the content that user draws, face is moved up on computers.
As a preferred embodiment, Fig. 8 show a kind of square flow chart for allowing static pattern to get up, such as Fig. 8 institute
Show, comprising:
Step S1 receives external image by camera.
In above-mentioned steps, external static article can be obtained by the camera of the smart machines such as mobile phone or tablet computer
Image, the stationary article can be draw this books, pure craft draws this, adds color draws this or entity toy.
Step S2, is analyzed and processed image.
In above-mentioned steps, after the image for getting external static article by camera, since photographic device is shot
Image there may be rotation, inclination the problems such as, obtain the article page on still image after, need to carry out aerial prospective mistake
True correction is to obtain electronic image corresponding with still image, to the carry out characteristic point edge analysis of electronic image and biometric profile
Correlative model identification, saves characteristic point outline data and picture.
Step S3 obtains topological structure skeletal graph.
In above-mentioned steps, after the profile to electronic image is analyzed to obtain outline data, outline data is carried out
Filling, which sharpens, sews and mend attended operation, then carries out ReebGraph analysis to image data, obtains the topological structure bone of image
Figure.
Step S4 obtains biometric image data.
In above-mentioned steps, the outline data that edge analysis obtains is carried out according to electronic image, in electronic image
Target object scratches figure.
Step S5, datagraphic 3Dization vector quantization.
In above-mentioned steps, in getting electronic image after the figure of target object, to face profile data triangle
Change veining, matching primitives is carried out to skeleton data and outline data, so that datagraphic 3Dization vector quantization.
Step S6, gesture motion capture and (according to motion capture, determine triggering required movement).
In above-mentioned steps, the gesture motion of user is obtained by the motion captures equipment such as tracker, is triggered corresponding dynamic
It instructs.
Step S7 is acted according to prefabricated 3D, driving rendering
In above-mentioned steps, is acted according to the 3D for presetting preservation, image data and 3D model are rendered, obtained
Final result image.
Herein it should be noted that the movement of above-mentioned 3D cartoon can be customized by the user, i.e., oneself makes gesture motion pair
The content answered.
Embodiment 2
According to embodiments of the present invention, a kind of stent embodiment is additionally provided, which can be to be used to support mobile device
(for example, mobile phone, tablet computer) is combined as a kind of intelligent reading partner tool with an article (for example, textbook, draw etc.).
Fig. 9 is a kind of support schematic diagram according to an embodiment of the present invention, as shown in figure 9, the bracket includes: fixing clamp 901
With support rod 903.
Wherein, fixing clamp 901, for placing and fixing mobile device；
Support rod 903, it is hinged with fixing clamp, it is used to support fixing clamp and is fixed to preset height.
As a kind of optional embodiment, above-mentioned mobile device can be the Intelligent mobile equipments such as mobile phone, tablet computer；On
Fixing clamp 901 is stated, can be used for the mobile phone of different size dimension, tablet computer clamping or fixed on the market at present, it is above-mentioned
Support rod is used to support and above-mentioned fixation is folded in certain height, and since fixing clamp is hinged with support rod, fixing clamp can be with
Any angle is rotated, to meet the optimal visual angle of user.
In a kind of optional embodiment, above-mentioned bracket draws this and Intelligent mobile equipment combines, and can be used as a kind of intelligence
Reading partner tool is interacted, by the optical image identification of Intelligent mobile equipment, pattern analysis processing and cloud transmission and database
Contour science and technology apply in children's early education culture in 3-6 years old, can control various types, the Chinese and English of content draws this.
By reading aloud in cartoon character built in Intelligent mobile equipment, voice guide, intelligent interaction function allow child reading to draw this, play and draw
This while, acoustically knows from experience from tactile, vision and comprehensively the enjoyment learnt.
From the foregoing, it will be observed that a kind of bracket of Intelligent mobile equipment is provided, in conjunction with intelligent sliding in the above embodiments of the present application
Dynamic equipment can be used as a kind of intelligent reading partner tool, can be by article (for example, spelling using the camera of Intelligent mobile equipment
Figure, block toy, textbook, draws this or other books at seven-piece puzzle) on still image be converted to corresponding electronic image, according to
The information obtained from the electronic image shows still image in the form of audio, video or 3D rendering etc. are multimedia,
Achieved the purpose that the flat image of any article interactive display in the multimedia form, thus realize thrift education cost,
Enhance the technical effect of user experience, and then solves the prior art and cannot achieve and move any static non-electronics major material object
Draw the technical issues of presenting.
In an alternative embodiment, as shown in Figure 10 (a), above-mentioned fixing clamp may include: inclined plate 101, pass through pin
Axis and support rod are rotatablely connected；First baffle 103 is connected as an overall structure with the bottom end of inclined plate, wherein first baffle with
Inclined plate setting at an acute angle.
Based on the above embodiment, in a kind of optional embodiment, as shown in Figure 10 (b), above-mentioned bracket further include: the
One bolt 105, passes perpendicularly through support rod and connect with inclined plate, for controlling and fixing the tilt angle of inclined plate.
In an alternative embodiment, as shown in figure 11, above-mentioned fixing clamp includes: platform 111, is connected with support rod
It connects；At least two second baffles 113 are connected as an overall structure with the both ends of platform, wherein at least two second plate washers with
Platform setting at an acute angle.
In a kind of optional embodiment, the above-mentioned platform using such as Figure 11, user can place picture mosaic, product below platform
The wooden toy draws sheet, books etc., and the smart machine being placed on platform can obtain the still image of article by rear camera, and
In the corresponding 3D rendering of display screen display or cartoon of smart machine.
Based on the above embodiment, in a kind of optional embodiment, as shown in figure 12, above-mentioned bracket further include: second
Bolt 115, for fixing the height of support rod, wherein support rod is telescopic rod.
Optionally, above-mentioned support rod may be stereotypes hoses, and height and angle can arbitrarily be arranged by user, improves and uses
Family experience effect.
By the embodiment above, using retractable support lever, user can according to their own needs be carried out support rod
Lifting selection.
In an alternative embodiment, as shown in figure 13, above-mentioned support rod can be to pass through pin shaft by multiple connecting rods
Be rotatablely connected constitute connecting component 131, for platform to be carried out to the rotation of multiple angles, wherein uppermost connecting rod with
Platform connection.
In an alternative embodiment, as shown in Figure 14 (a), above-mentioned bracket further include: reflecting mirror 141, setting is solid
In clamp or mobile device, for the still image of the article in pre-set space to be reflexed in the camera of mobile device,
In, reflecting mirror and fixing clamp or mobile device are at predetermined angle, as shown in Figure 14 (b).
As a kind of optional embodiment, above-mentioned reflecting mirror be can be set on the mobile apparatus, reflect user in desktop
The article page-images of placement make the still image of the available article page of the camera of the mobile device of any placement, this
User is greatly facilitated, is read for book pages point, the sound animation of material picture, indispensable condition is provided；Preferably,
Above-mentioned reflecting mirror is clipped in behind camera, it, can be by various behaviour of the user on book pages as shown in Figure 14 (a)
Make (instruction) to identify, to trigger corresponding operating.
Optionally, above-mentioned predetermined angle can be 45 degree, and above-mentioned reflecting mirror can be plane mirror or convex lens.
In a kind of optional embodiment, the reflecting mirror as shown in Figure 15 (a) (mirror surface in reflecting mirror is arranged in 45 degree angles)
It can be used for the rear camera of Intelligent mobile equipment；Such as the reflecting mirror of Figure 15 (b) (mirror surface in reflecting mirror is in 45 degree of angle settings)
It can be used for the front camera of Intelligent mobile equipment.
In an alternative embodiment, as shown in figure 16, above-mentioned bracket further include: horizontal base 905, with support rod
Bottom connection, for placing article.
In a kind of preferred embodiment, four suckers can be completely set in the lower of horizontal base, for preferably fixed
Bracket is stated, balance is kept.
According to embodiments of the present invention, additionally provide a kind of motion capture tracker embodiment, the motion capture tracker with
Support equipped uses, for obtaining the operation instruction information on article.
In a kind of optional embodiment, above-mentioned motion capture tracker can be finger ring or fingerstall as shown in figure 17.
In the above-described embodiments, use finger ring or fingerstall as distinguishing mark, user is allowed to put on finger ring, in book pages
Above, the various operations of clicking trigger are carried out.
Herein it should be noted that above-mentioned motion capture tracker be it is following any one: small paster, coating are (for example, refer to
Nail polish), stick-like indicant (for example, talking pen).
As a preferred mode, by based on the above embodiments of the present application bracket (including: reflecting mirror) and interaction refer to
Ring or fingerstall combination, outfit corresponding operation specification and standard configuration draw this, can be used as the reading partner tool of child's formative education.
Specifically, in the above-described embodiment, it after user buys the reading partner tool, can be installed according to product description
Combined handset/Flat computer support frame and reflecting mirror；Firstly, mobile device (by taking tablet computer as an example) is placed on bracket, then
Drawing for will reading originally is placed on the identifiable region of reflecting mirror, opens corresponding product APP on tablet computer, initially enters study
Process；After everything is ready, tablet computer, which first identifies, draws which this book the judgement of this cover is, reads scene subsequently into normal page turning
In；To draw originally to translate into and draw this any page, the APP program of tablet computer called after being identified by figure corresponding audio, 3D image,
The learning Contents such as flash demo.
Herein it should be noted that in above-mentioned learning process, user can wear fingerstall at any time with hand, draw this identification region
A reading is carried out, screen content can change therewith, lively to demonstrate；" changing book " when the user clicks, button can switch screen content,
It reads other and draws this.
Embodiment as one preferred, the present apparatus support interaction content to make function by oneself, and parent can be having had in family
Any one draw this, press operating procedure typing APP, and the sound of corresponding typing oneself and finger point reading act, and complete
Later, child can draw this by normal reading under this product, and what is heard is that oneself father, mother explain the content for drawing this.
Preferably, the present apparatus is also supported to draw this content explanation sharing function: oneself explanation can be drawn this content by parent
It is uploaded to cloud, while can also hear that the content of sheet is drawn in other parents explanation, child's study is allowed to draw sheet, different-style to difference
Draw this content.
Embodiment 3
According to embodiments of the present invention, a kind of multimedia presentation system embodiment of still image is additionally provided.The present invention is real
The multimedia presentation method for applying the still image in example 1 can execute in the system of the embodiment of the present invention 3.
Figure 18 is a kind of multimedia presentation system schematic diagram of still image according to an embodiment of the present invention, such as Figure 18 institute
Show, which includes: camera 181 and processor 183.
Camera 181, for obtaining electronic image, wherein electronic image is to shoot to obtain by the still image on article
's；
Processor 183, for obtaining the information in electronic image；The corresponding multimedia number of still image is determined according to information
According to, and multi-medium data is presented；Wherein, multi-medium data includes at least one of: audio, video, 3D rendering are for obtaining
Information in electronic image；The corresponding multi-medium data of still image is determined according to information, wherein multi-medium data includes following
At least one: audio, video, 3D rendering；Multi-medium data is presented.
From the foregoing, it will be observed that in the above embodiments of the present application, article is shot by photographic device, by article (for example, textbook,
Draw this or other books) on still image be converted to corresponding electronic image, according to the information obtained from the electronic image,
Still image is showed in the form of audio, video or 3D rendering etc. are multimedia, has been reached any papery flat image
The purpose of interactive display in the multimedia form, thus the technical effect for realizing thrift education cost, enhancing user experience, in turn
Solving the prior art cannot achieve the technical issues of any static non-electronics major material object is carried out animation presentation.
In an alternative embodiment, above-mentioned processor 183 is also used to obtain the characteristic information of electronic image；According to spy
Levy information searching and the matched 3D rendering of electronic image.
In an alternative embodiment, above-mentioned processor 183 is also used to obtain the line of the target object in electronic image
Profile；It is searched and the matched 3D rendering of electronic image according to characteristic information: being searched according to outline and matched with target object
3D model.
In an alternative embodiment, above-mentioned processor 183 is also used to obtain target object extremely according to outline
The spatial cue of a few part；It is rendered according to spatial cue pair and the matched 3D model of target object；After rendering is presented
3D model.
In an alternative embodiment, above-mentioned processor 183 is also used to obtain in electronic image is operated on article
The corresponding location information in position, and according to location information search with the matched audio or video of location information；Wherein, operation packet
It includes: page turning, click, touch；It is searched and the matched audio or video of location information according to location information.
In an alternative embodiment, above-mentioned processor 183 is also used to obtain article by motion tracking device and be operated
Position；Corresponding location information in electronic image is determined according to position.
In an alternative embodiment, above-mentioned processor 183 is also used to play audio or video.
In an alternative embodiment, above-mentioned camera 181 is also used to obtain the static state on the article in pre-set space
Image；Above-mentioned processor 183 is also used to identify still image, aerial prospective is corrected, and obtains electronic image.
In an alternative embodiment, above-mentioned camera 181 is also used to obtain preset gesture motion, wherein gesture
Movement is customized by the user setting；Above-mentioned processor 183 is also used to according to gesture motion, the determining operation to multi-medium data,
Wherein, operation includes at least: suspending, switches or exit the multi-medium data currently presented.
Embodiment 4
According to embodiments of the present invention, a kind of multimedia presentation devices embodiment of still image is additionally provided.The present invention is real
The multimedia presentation method for applying the still image in example 1 can execute in the device of the embodiment of the present invention 4.
Figure 19 is a kind of multimedia presentation devices schematic diagram of still image according to an embodiment of the present invention, such as Figure 19 institute
Show, which includes: that the first acquisition module 191, second obtains module 193, determining module 195 and output module 197.
Wherein, first module 191 is obtained, for obtaining electronic image, wherein electronic image is by the static map on article
As shooting obtains；Second obtains module 193, for obtaining the information in electronic image；Determining module 195, for according to letter
It ceases and determines the corresponding multi-medium data of still image, wherein multi-medium data includes at least one of: audio, video, 3D figure
Picture；Output module 197, for rendering multi-medium data.
From the foregoing, it will be observed that in the above embodiments of the present application, article is shot by photographic device, by article (for example, textbook,
Draw this or other books) on still image be converted to corresponding electronic image, according to the information obtained from the electronic image,
Still image is showed in the form of audio, video or 3D rendering etc. are multimedia, has been reached any papery flat image
The purpose of interactive display in the multimedia form, thus the technical effect for realizing thrift education cost, enhancing user experience, in turn
Solving the prior art cannot achieve the technical issues of any static non-electronics major material object is carried out animation presentation.
In an alternative embodiment, above-mentioned second module is obtained further include: the first acquisition submodule, for obtaining electricity
The characteristic information of subgraph；Above-mentioned determining module further include: the first searching module, for according to characteristic information lookup and electronic chart
As matched 3D rendering.
In an alternative embodiment, above-mentioned second module is obtained further include: the second acquisition submodule, for obtaining electricity
The outline of target object in subgraph；Above-mentioned determining module further include: the second searching module, for according to outline
It searches and the matched 3D model of target object.
In an alternative embodiment, above-mentioned output module further include: third acquisition submodule, for according to lines wheel
Exterior feature obtains the spatial cue of at least one portion of target object；First processing module, for according to spatial cue pair and target
The 3D model of object matching is rendered；First output sub-module, the 3D model after rendering for rendering.
In an alternative embodiment, above-mentioned second module is obtained further include: the 4th acquisition submodule, for obtaining electricity
Location information corresponding with the position operated on article in subgraph, wherein operation includes: page turning, click, touch；It is above-mentioned
Determining module further include: third searching module, for being searched and the matched audio or video of location information according to location information.
In an alternative embodiment, above-mentioned second module is obtained further include: the 5th acquisition submodule, for by dynamic
Make tracker and obtains the position that article is operated；Corresponding location information in electronic image is determined according to position.
In an alternative embodiment, above-mentioned output module further include: the second output sub-module, for play audio or
Video.
In an alternative embodiment, above-mentioned first module is obtained further include: the 6th acquisition submodule, it is pre- for obtaining
If the still image on article in space；Second processing module obtains electronics for being identified, being corrected to still image
Image.
Embodiment 5
According to embodiments of the present invention, a kind of multimedia resource sharing system embodiment based on cloud platform is additionally provided.This
The multimedia resource that the multimedia presentation method of still image in inventive embodiments 1 can be used for the embodiment of the present invention 5 is shared
It is executed in system.
Figure 20 is a kind of multimedia resource sharing system schematic diagram based on cloud storage according to an embodiment of the present invention, is such as schemed
Shown in 20, which includes: server 201 and at least one mobile terminal 203.
As a kind of optional embodiment, above-mentioned mobile terminal can be the intelligence such as computer, smart phone, tablet computer
Equipment, above-mentioned server provide the multimedia resource shared platform based on cloud storage, and user can by accessing the platform
With downloading or upload multimedia data, wherein multi-medium data includes: the multimedia presentation method system based on above-mentioned still image
The finished products files and various e-books, Freehandhand-drawing sheet, picture etc. such as various audios, video, cartoon, the 3D model made, one
In kind optional embodiment, user can download the multi-medium data that other users upload by the APP installed on mobile phone, can also
It is uploaded to platform with multi-medium datas such as the audio, the videos that make oneself, is downloaded for other users；Another optional implementation
In example, user can upload or download multimedia data file by the multimedia resource shared platform of access webpage version.
In a kind of optional embodiment, some template datas can also be provided by multimedia resource shared platform, such as
Some cartoon patterns, 3D model etc., user can be non-for uninteresting textbook to be fabricated to by downloading these interesting elements
The multimedia data file of normal vivid and interesting, increases the interest of child's study.
In a kind of optional embodiment, by above-mentioned multimedia resource shared platform, parent can also be given to provide a friendship
The platform of stream inquires into the educational mode for being most suitable for culture child by the exchange and interaction between parent.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
In the above embodiment of the invention, it all emphasizes particularly on different fields to the description of each embodiment, does not have in some embodiment
The part of detailed description, reference can be made to the related descriptions of other embodiments.
In several embodiments provided herein, it should be understood that disclosed technology contents can pass through others
Mode is realized.Wherein, the apparatus embodiments described above are merely exemplary, such as the division of unit, can be one kind
Logical function partition, there may be another division manner in actual implementation, such as multiple units or components can combine or can
To be integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual
Coupling, direct-coupling or communication connection can be through some interfaces, the indirect coupling or communication connection of unit or module,
It can be electrical or other forms.
Unit may or may not be physically separated as illustrated by the separation member, shown as a unit
Component may or may not be physical unit, it can and it is in one place, or may be distributed over multiple units
On.It can some or all of the units may be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
It, can if integrated unit is realized in the form of SFU software functional unit and when sold or used as an independent product
To be stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention substantially or
Say that all or part of the part that contributes to existing technology or the technical solution can embody in the form of software products
Out, which is stored in a storage medium, including some instructions are used so that a computer equipment
(can be personal computer, server or network equipment etc.) executes all or part of step of each embodiment method of the present invention
Suddenly.And storage medium above-mentioned includes: USB flash disk, read-only memory (ROM, Read-Only Memory), random access memory
The various media that can store program code such as (RAM, Random Access Memory), mobile hard disk, magnetic or disk.
The above is only the preferred embodiment of the present invention, it is noted that those skilled in the art are come
It says, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications also should be regarded as
Protection scope of the present invention.
Claims (7)
1. a kind of multimedia presentation method of still image characterized by comprising
Obtain electronic image, wherein the electronic image is shot by the still image on article；
Obtain the information in the electronic image；
The corresponding multi-medium data of the still image is determined according to the information, wherein the multi-medium data includes following
At least one: audio, video, 3D rendering；
The multi-medium data is presented；
Wherein, the information for obtaining the electronic image include: obtain in the electronic image with the portion that is operated on the article
The corresponding location information in position, wherein the operation includes: page turning, click, touch；
According to the information determine the corresponding multi-medium data of the still image include: according to the positional information search and position
Confidence ceases matched audio or video；
Wherein, electronic image is obtained, comprising:
Acquire the still image on the article in pre-set space；
The image of the acquisition is identified, aerial prospective correction, obtains the electronic image；
Wherein, the information in the electronic image is obtained further include: obtain the characteristic information of the electronic image；
Determine the corresponding multi-medium data of the still image according to the information further include: according to the characteristic information search with
The matched 3D rendering of electronic image；
Wherein, the characteristic information for obtaining the electronic image includes: the lines wheel for obtaining the target object in the electronic image
It is wide；
According to the characteristic information search with the matched 3D rendering of the electronic image include: according to the outline search with
The matched 3D model of target object；
Wherein, it includes: that the 3D rendering is presented that the multi-medium data, which is presented, is specifically included:
The spatial cue of at least one portion of the target object is obtained according to the outline, wherein the rendering letter
Breath includes graphic color, and the graphic color is determined according to the second still image of the article, wherein second static map
As in the same size with the electronic image, unique difference of second still image and the electronic image is described second
Still image is by various colors in user's filling；
It is rendered according to the spatial cue pair and the matched 3D model of the target object；
3D model after rendering is presented.
2. multimedia presentation method according to claim 1, which is characterized in that the article includes: textbook, draws this, blocks
Piece, picture album, Freehandhand-drawing sheet, seven-piece puzzle, building blocks, toy.
3. multimedia presentation method according to claim 1, which is characterized in that obtain in the electronic image with the object
The corresponding location information in operated unit position on product, comprising:
The position that the article is operated is obtained by motion tracking device；
Corresponding location information in the electronic image is determined according to the position.
4. multimedia presentation method according to claim 3, which is characterized in that it includes: to broadcast that the multi-medium data, which is presented,
Put the audio or video.
5. multimedia presentation method as claimed in any of claims 1 to 4, which is characterized in that described more presenting
After media data, the method also includes:
Obtain preset gesture motion, wherein the gesture motion is customized by the user setting；
According to the gesture motion, the operation to the multi-medium data is determined, wherein the operation includes at least: suspending, cuts
Change or exit the multi-medium data currently presented.
6. a kind of multimedia presentation system of still image characterized by comprising
Camera, for obtaining electronic image, wherein the electronic image is shot by the still image on article；
Processor, for obtaining the information in the electronic image；Determine that the still image is corresponding more according to the information
Media data, and multi-medium data is presented；Wherein, the multi-medium data includes at least one of: audio, video, 3D figure
Picture；
Wherein, the processor is also used to obtain position letter corresponding with the position operated on article in the electronic image
Breath, and according to the positional information search with the matched audio or video of location information, wherein operation include: page turning, click,
It touches；
Wherein, the camera is used to acquire the still image on the article in pre-set space；
The processor is also used to identify the image of the acquisition, aerial prospective is corrected, and obtains the electronic image；
Wherein, the processor is also used to:
Obtain the characteristic information of the electronic image；
It is searched and the matched 3D rendering of the electronic image according to the characteristic information；
Wherein, the processor is also used to:
Obtain the outline of the target object in the electronic image；
It is searched and the matched 3D model of the target object according to the outline；
Wherein, the processor is also used to:
The spatial cue of at least one portion of the target object is obtained according to the outline, wherein the rendering letter
Breath includes graphic color, and the graphic color is determined according to the second still image of the article, wherein second static map
As in the same size with the electronic image, unique difference of second still image and the electronic image is described second
Still image is by various colors in user's filling；
It is rendered according to the spatial cue pair and the matched 3D model of the target object；
3D model after rendering is presented.
7. a kind of multimedia presentation devices of still image characterized by comprising
First obtains module, for obtaining electronic image, wherein the electronic image is shot by the still image on article
It arrives；
Second obtains module, for obtaining the information in the electronic image；
Determining module, for determining the corresponding multi-medium data of the still image according to the information, wherein the multimedia
Data include at least one of: audio, video, 3D rendering；
Output module, for rendering multi-medium data；
Wherein, it is described second obtain module further include: the 4th acquisition submodule, for obtain in the electronic image with article
The corresponding location information in the position operated, wherein the operation includes: page turning, click, touch；The determining module is also wrapped
It includes: third searching module, for searching and the matched audio or video of location information according to the positional information；
Wherein, described first module is obtained further include:
6th acquisition submodule, for acquiring the still image on the article in pre-set space；
Second processing module obtains the electronic image for being identified, being corrected to the image of the acquisition；
Wherein, described second module is obtained further include: the first acquisition submodule, the feature for obtaining the electronic image are believed
Breath；
The determining module further include: the first searching module, for being searched and the electronic image according to the characteristic information
The 3D rendering matched；
Wherein, described second module is obtained further include: the second acquisition submodule, for obtaining the target pair in the electronic image
The outline of elephant；
The determining module further include: the second searching module, for being searched and the target object according to the outline
The 3D model matched；
Wherein, the output module further include:
Third acquisition submodule, the rendering letter of at least one portion for obtaining the target object according to the outline
Breath, wherein the spatial cue includes graphic color, and the graphic color is determined according to the second still image of the article,
Wherein, in the same size, second still image and the electronic image of second still image and the electronic image
Unique difference be second still image by various colors in user's filling；
First processing module, for being rendered according to the spatial cue pair and the matched 3D model of the target object；
First output sub-module, the 3D model after rendering for rendering.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611089873.XA CN106713896B (en) | 2016-11-30 | 2016-11-30 | The multimedia presentation method of still image, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611089873.XA CN106713896B (en) | 2016-11-30 | 2016-11-30 | The multimedia presentation method of still image, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106713896A CN106713896A (en) | 2017-05-24 |
| CN106713896B true CN106713896B (en) | 2019-08-20 |
Family
ID=58934372
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611089873.XA Active CN106713896B (en) | 2016-11-30 | 2016-11-30 | The multimedia presentation method of still image, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106713896B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107274731A (en) * | 2017-06-05 | 2017-10-20 | 深圳市科迈爱康科技有限公司 | Towards children's study method, facility for study and storage medium |
| CN107343192A (en) * | 2017-07-20 | 2017-11-10 | 武汉市陆刻科技有限公司 | A kind of 3D solids interpolation model and VR mobile terminal interaction methods and system |
| FR3072240B1 (en) | 2017-10-11 | 2019-10-18 | Societe Bic | MEDIA SHELF BRACKET OR EQUIVALENT |
| CN108460124A (en) * | 2018-02-26 | 2018-08-28 | 北京物灵智能科技有限公司 | Exchange method and electronic equipment based on figure identification |
| WO2019227429A1 (en) * | 2018-05-31 | 2019-12-05 | 优视科技新加坡有限公司 | Method, device, apparatus, terminal, server for generating multimedia content |
| CN109063038A (en) * | 2018-07-17 | 2018-12-21 | 中国联合网络通信集团有限公司 | The augmented reality reading system and method for books |
| CN110053390A (en) * | 2019-04-19 | 2019-07-26 | 温州市今艺印业有限公司 | A kind of Multifunction interdynamic notebook |
| CN111079493B (en) * | 2019-06-09 | 2024-03-22 | 广东小天才科技有限公司 | Man-machine interaction method based on electronic equipment and electronic equipment |
| CN111078096B (en) * | 2019-06-09 | 2021-07-23 | 广东小天才科技有限公司 | Man-machine interaction method and electronic equipment |
| CN110481198A (en) * | 2019-08-26 | 2019-11-22 | 温州市今艺印业有限公司 | A kind of multifunctional note |
| CN113287087A (en) * | 2019-12-19 | 2021-08-20 | 京东方科技集团股份有限公司 | Computer-implemented method of implementing dynamic effects in images, apparatus and computer program product for implementing dynamic effects in images |
| CN114115615B (en) * | 2020-08-10 | 2024-06-18 | 深圳市万普拉斯科技有限公司 | Interface display method, device, electronic equipment and storage medium |
| CN112007359B (en) * | 2020-08-24 | 2023-12-15 | 杭州睿琪软件有限公司 | Image display method, readable storage medium and computer equipment |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103050025A (en) * | 2012-12-20 | 2013-04-17 | 广东欧珀移动通信有限公司 | Mobile terminal learning method and learning system thereof |
| CN103177373A (en) * | 2011-12-22 | 2013-06-26 | 上海易络客网络技术有限公司 | Interactive commercial experiencing method and system |
| EP2662838A2 (en) * | 2012-05-11 | 2013-11-13 | Sony Computer Entertainment Europe Limited | Apparatus and method for augmented reality |
| CN103455978A (en) * | 2012-05-31 | 2013-12-18 | 索尼电脑娱乐欧洲有限公司 | Apparatus and method for augmenting a video image |
| CN103489158A (en) * | 2012-06-01 | 2014-01-01 | 索尼电脑娱乐欧洲有限公司 | Apparatus and method of augmenting video |
| CN104166851A (en) * | 2014-08-25 | 2014-11-26 | 盛静浩 | Multimedia interactive learning system and method for paper textbooks |
| CN104245067A (en) * | 2012-02-06 | 2014-12-24 | 索尼电脑娱乐欧洲有限公司 | Book object for augmented reality |
| CN104461318A (en) * | 2013-12-10 | 2015-03-25 | 苏州梦想人软件科技有限公司 | Touch read method and system based on augmented reality technology |
| CN105320282A (en) * | 2015-12-02 | 2016-02-10 | 广州经信纬通信息科技有限公司 | Image recognition solution based on augmented reality |
| CN105405168A (en) * | 2015-11-19 | 2016-03-16 | 青岛黑晶信息技术有限公司 | Method and apparatus for implementing three-dimensional augmented reality |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9558590B2 (en) * | 2012-03-28 | 2017-01-31 | Microsoft Technology Licensing, Llc | Augmented reality light guide display |
| EP2926224B1 (en) * | 2012-11-29 | 2021-09-01 | Haddish, Imran | Virtual and augmented reality instruction system |
| KR102165444B1 (en) * | 2013-08-28 | 2020-10-14 | 엘지전자 주식회사 | Apparatus and Method for Portable Device displaying Augmented Reality image |
-
2016
- 2016-11-30 CN CN201611089873.XA patent/CN106713896B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103177373A (en) * | 2011-12-22 | 2013-06-26 | 上海易络客网络技术有限公司 | Interactive commercial experiencing method and system |
| CN104245067A (en) * | 2012-02-06 | 2014-12-24 | 索尼电脑娱乐欧洲有限公司 | Book object for augmented reality |
| EP2662838A2 (en) * | 2012-05-11 | 2013-11-13 | Sony Computer Entertainment Europe Limited | Apparatus and method for augmented reality |
| CN103455978A (en) * | 2012-05-31 | 2013-12-18 | 索尼电脑娱乐欧洲有限公司 | Apparatus and method for augmenting a video image |
| CN103489158A (en) * | 2012-06-01 | 2014-01-01 | 索尼电脑娱乐欧洲有限公司 | Apparatus and method of augmenting video |
| CN103050025A (en) * | 2012-12-20 | 2013-04-17 | 广东欧珀移动通信有限公司 | Mobile terminal learning method and learning system thereof |
| CN104461318A (en) * | 2013-12-10 | 2015-03-25 | 苏州梦想人软件科技有限公司 | Touch read method and system based on augmented reality technology |
| CN104166851A (en) * | 2014-08-25 | 2014-11-26 | 盛静浩 | Multimedia interactive learning system and method for paper textbooks |
| CN105405168A (en) * | 2015-11-19 | 2016-03-16 | 青岛黑晶信息技术有限公司 | Method and apparatus for implementing three-dimensional augmented reality |
| CN105320282A (en) * | 2015-12-02 | 2016-02-10 | 广州经信纬通信息科技有限公司 | Image recognition solution based on augmented reality |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106713896A (en) | 2017-05-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106713896B (en) | The multimedia presentation method of still image, device and system | |
| CN206741428U (en) | Support with reflective mirror | |
| Linowes et al. | Augmented reality for developers: Build practical augmented reality applications with unity, ARCore, ARKit, and Vuforia | |
| US9996979B2 (en) | Augmented reality technology-based handheld viewing device and method thereof | |
| CN104461318B (en) | Reading method based on augmented reality and system | |
| TWI654539B (en) | Virtual reality interaction method, device and system | |
| KR101692335B1 (en) | System for augmented reality image display and method for augmented reality image display | |
| US10186084B2 (en) | Image processing to enhance variety of displayable augmented reality objects | |
| US20180197345A1 (en) | Augmented reality technology-based handheld viewing device and method thereof | |
| US20200326831A1 (en) | Augmented reality experience creation via tapping virtual surfaces in augmented reality | |
| CN113069759B (en) | Scene processing method and device in game and electronic equipment | |
| CN105405168A (en) | Method and apparatus for implementing three-dimensional augmented reality | |
| KR101248736B1 (en) | Augmented reality book station based augmented reality system and method, augmented reality processing apparatus for realizing the same | |
| CN111986076A (en) | Image processing method and device, interactive display device and electronic equipment | |
| KR20140082610A (en) | Method and apaaratus for augmented exhibition contents in portable terminal | |
| CN111638784B (en) | Facial expression interaction method, interaction device and computer storage medium | |
| CN204028887U (en) | A kind of reading of the hand-held based on augmented reality equipment | |
| CN106776449A (en) | A kind of plant KePu Electronics book reads methods of exhibiting and device | |
| CN108416832A (en) | Display methods, device and the storage medium of media information | |
| CN106600669A (en) | Device based on variable-color fluorescent drawing board and augmented reality, and operation method | |
| CN111625100A (en) | Method and device for presenting picture content, computer equipment and storage medium | |
| CN111652986A (en) | Stage effect presentation method and device, electronic equipment and storage medium | |
| CN110036356A (en) | Image procossing in VR system | |
| KR20160013451A (en) | Goods view system grafting augmented reality application | |
| CN111640190A (en) | AR effect presentation method and apparatus, electronic device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: Building 60, 1st Floor, No.7 Jiuxianqiao North Road, Chaoyang District, Beijing 021 Patentee after: Shiyou (Beijing) Technology Co.,Ltd. Country or region after: China Address before: 4017, 4th Floor, Building 2, No.17 Ritan North Road, Chaoyang District, Beijing Patentee before: 4U (BEIJING) TECHNOLOGY CO.,LTD. Country or region before: China |