CN106713896A - Static image multimedia presentation method, device and system - Google Patents
Static image multimedia presentation method, device and system Download PDFInfo
- Publication number
- CN106713896A CN106713896A CN201611089873.XA CN201611089873A CN106713896A CN 106713896 A CN106713896 A CN 106713896A CN 201611089873 A CN201611089873 A CN 201611089873A CN 106713896 A CN106713896 A CN 106713896A
- Authority
- CN
- China
- Prior art keywords
- electronic image
- image
- still image
- information
- medium data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000003068 static effect Effects 0.000 title abstract description 26
- 238000009877 rendering Methods 0.000 claims description 32
- 239000003973 paint Substances 0.000 claims description 27
- 230000033001 locomotion Effects 0.000 claims description 24
- 230000008859 change Effects 0.000 claims description 5
- 230000000875 corresponding effect Effects 0.000 description 55
- 238000010586 diagram Methods 0.000 description 21
- 230000009471 action Effects 0.000 description 12
- 230000002452 interceptive effect Effects 0.000 description 11
- 230000036410 touch Effects 0.000 description 11
- 239000000463 material Substances 0.000 description 10
- 238000012937 correction Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 9
- 238000004458 analytical method Methods 0.000 description 7
- 238000003860 storage Methods 0.000 description 7
- 230000003993 interaction Effects 0.000 description 6
- 238000010422 painting Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 5
- 230000005611 electricity Effects 0.000 description 4
- 230000002708 enhancing effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 241001269238 Data Species 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000001154 acute effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013139 quantization Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241000252254 Catostomidae Species 0.000 description 1
- 241000196324 Embryophyta Species 0.000 description 1
- 208000020564 Eye injury Diseases 0.000 description 1
- 241000406668 Loxodonta cyclotis Species 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 239000011248 coating agent Substances 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000004513 sizing Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000005728 strengthening Methods 0.000 description 1
- 230000007306 turnover Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
- 239000002023 wood Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a static image multimedia presentation method, device and system. The method comprises steps that an electronic image is acquired, and the electronic image is acquired through shooting a static image of an object; the information of the electronic image is acquired; multimedia data corresponding to the static image is determined according to the information, and the multimedia data comprises at least one of audios, videos and 3D images; the multimedia data is presented. The method is advantaged in that a technical problem that any static non-electronic object can not be presented in an animation mode in the prior art is solved.
Description
Technical field
The present invention relates to image processing field, in particular to a kind of multimedia presentation method of still image, device
And system.
Background technology
With the raising of quality of life and level of education, present parent increasingly payes attention to the formative education of child, initiation
Education refers to allow child to do sth. in advance the understanding world around, and parent often buys some painting this, accumulating on infant elementary education education
Wood, picture album etc., allow child to contact the article of shades of colour, shape extensively, allow child to learn to read with the aid of pictures, recognize various toys etc.,
Child is allowed visually to go to recognize the things in this world.
In order to strengthen the understanding to word or image of child, in the market occurs in that many points read the stationery of class, such as point
Reading machine or talking pen, sell together with corresponding picture album, books, allow child while word or image is clicked on, can be from listening
Feel and know from experience up.However, existing point on the market reads stationery can only to realize sending sound with the use of supporting books, it is impossible to realize
Visual picture is presented, and interactivity is poor；And any static non-electronics major material object can not be converted to corresponding multimedia number
According to poor compatibility.Because existing talking pen or point reader are all matching used with books, when other books are learnt
Needs repurchase with the matching used talking pen of the book or point reader, cause very big learning cost.
On the other hand, in the widely available life to people of the smart machine such as mobile phone, panel computer, set using electronics
The standby trend to learn to have turned into future education, but, can not substitute all of tradition using electronic equipment and learn, for example, child
Son drawing, picture mosaic etc., also, long-time close contact electronic equipment, the eye injury to child are larger.Thus, compel to be essential
Want a kind of Learning Scheme that tradition study can be combined with electronic equipment.
The problem of animation presentation cannot be realized carrying out on any static non-electronics major material object for above-mentioned prior art, at present
Not yet propose effective solution.
The content of the invention
A kind of multimedia presentation method of still image, device and system are the embodiment of the invention provides, at least to solve
Prior art cannot realize carrying out on any static non-electronics major material object the technical problem of animation presentation.
A kind of one side according to embodiments of the present invention, there is provided multimedia presentation method of still image, including：Obtain
Power taking subgraph, wherein, electronic image is to be shot to obtain by the still image on article；Obtain the information in electronic image；
The corresponding multi-medium data of still image is determined according to information, wherein, multi-medium data includes at least one of：Audio, regard
Frequently, 3D rendering；Multi-medium data is presented.
Another aspect according to embodiments of the present invention, additionally provides a kind of multimedia presentation system of still image, including：
Camera, for obtaining electronic image, wherein, electronic image is to be shot to obtain by the still image on article；Processor, uses
Information in electronic image is obtained；The corresponding multi-medium data of still image is determined according to information, and multi-medium data is presented；
Wherein, multi-medium data includes at least one of：Audio, video, 3D rendering.
Another aspect according to embodiments of the present invention, additionally provides a kind of multimedia presentation devices of still image, including：
First acquisition module, for obtaining electronic image, wherein, electronic image is to be shot to obtain by the still image on article；The
Two acquisition modules, for obtaining the information in electronic image；Determining module, for determining that still image is corresponding more according to information
Media data, wherein, multi-medium data includes at least one of：Audio, video, 3D rendering；Output module is more for presenting
Media data.
In embodiments of the present invention, by obtaining electronic image, wherein, electronic image is clapped by the still image on article
Take the photograph what is obtained；Obtain the information in electronic image；The corresponding multi-medium data of still image is determined according to information, wherein, many matchmakers
Volume data includes at least one of：Audio, video, 3D rendering；Multi-medium data is presented, has reached any papery plan
As the purpose of interactive display in the multimedia form, it is achieved thereby that thrift education cost, the technique effect of enhancing Consumer's Experience, enter
And solving prior art cannot realize carrying out on any static non-electronics major material object the technical problem of animation presentation.
Brief description of the drawings
Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the part of the application, this hair
Bright schematic description and description does not constitute inappropriate limitation of the present invention for explaining the present invention.In the accompanying drawings：
Fig. 1 is a kind of multimedia presentation method flow chart of still image according to embodiments of the present invention；
Fig. 2 is the multimedia presentation method flow chart of a kind of optional still image according to embodiments of the present invention；
Fig. 3 is the multimedia presentation method flow chart of a kind of optional still image according to embodiments of the present invention；
Fig. 4 is the multimedia presentation method flow chart of a kind of optional still image according to embodiments of the present invention；
Fig. 5 is the multimedia presentation method flow chart of a kind of optional still image according to embodiments of the present invention；
Fig. 6 is the multimedia presentation method flow chart of a kind of optional still image according to embodiments of the present invention；
Fig. 7 is the multimedia presentation method flow chart of a kind of preferred drawing still image according to embodiments of the present invention；
Fig. 8 is a kind of preferred method flow diagram for allowing static pattern to move up according to embodiments of the present invention；
Fig. 9 is a kind of support schematic diagram according to embodiments of the present invention；
Figure 10 (a) is a kind of optional support schematic diagram according to embodiments of the present invention；
Figure 10 (b) is a kind of optional support schematic diagram according to embodiments of the present invention；
Figure 11 is the optional support schematic diagram of another according to embodiments of the present invention；
Figure 12 is the optional support schematic diagram of another according to embodiments of the present invention；
Figure 13 is the optional support schematic diagram of another according to embodiments of the present invention；
Figure 14 (a) is a kind of optional support schematic diagram according to embodiments of the present invention；
Figure 14 (b) is a kind of optional support schematic diagram according to embodiments of the present invention；
Figure 15 (a) is a kind of optional speculum schematic diagram according to embodiments of the present invention；
Figure 15 (b) is a kind of optional speculum schematic diagram according to embodiments of the present invention；
Figure 16 is a kind of optional support schematic diagram according to embodiments of the present invention；
Figure 17 is according to embodiments of the present invention a kind of optionally with the fingerstall schematic diagram of tracking gesture operation；
Figure 18 is a kind of multimedia presentation system schematic diagram of still image according to embodiments of the present invention；
Figure 19 is a kind of multimedia presentation devices schematic diagram of still image according to embodiments of the present invention；And
Figure 20 is a kind of multimedia resource sharing system schematic diagram based on cloud storage according to embodiments of the present invention.
Specific embodiment
In order that those skilled in the art more fully understand the present invention program, below in conjunction with the embodiment of the present invention
Accompanying drawing, is clearly and completely described to the technical scheme in the embodiment of the present invention, it is clear that described embodiment is only
The embodiment of a part of the invention, rather than whole embodiments.Based on the embodiment in the present invention, ordinary skill people
The every other embodiment that member is obtained under the premise of creative work is not made, should all belong to the model of present invention protection
Enclose.
It should be noted that term " first ", " in description and claims of this specification and above-mentioned accompanying drawing
Two " it is etc. for distinguishing similar object, without for describing specific order or precedence.It should be appreciated that so using
Data can exchange in the appropriate case, so as to embodiments of the invention described herein can with except illustrating herein or
Order beyond those of description is implemented.Additionally, term " comprising " and " having " and their any deformation, it is intended that cover
Lid is non-exclusive to be included, for example, the process, method, system, product or the equipment that contain series of steps or unit are not necessarily limited to
Those steps or unit clearly listed, but may include not list clearly or for these processes, method, product
Or other intrinsic steps of equipment or unit.
Embodiment 1
According to embodiments of the present invention, there is provided a kind of multimedia presentation method embodiment of still image is, it is necessary to explanation
It is that can be performed in the such as one group computer system of computer executable instructions the step of the flow of accompanying drawing is illustrated,
And, although logical order is shown in flow charts, but in some cases, can be performed with different from order herein
Shown or described step.
Fig. 1 is a kind of multimedia presentation method flow chart of still image according to embodiments of the present invention, as shown in figure 1,
The method comprises the following steps：
Step S102, obtains electronic image, wherein, electronic image is to be shot to obtain by the still image on article；
Step S104, obtains the information in electronic image；
Step S106, the corresponding multi-medium data of still image is determined according to information, wherein, multi-medium data includes following
At least one：Audio, video, 3D rendering；
Step S108, is presented multi-medium data.
As a kind of optional embodiment, above-mentioned article can be for child's formative education textbook, paint this or other
Books, can also be the toys such as seven-piece puzzle, picture mosaic, building blocks；Above-mentioned still image can be that being positioned over for above-mentioned article is default empty
Between after the picture that shows, for example, it may be above-mentioned textbook or paint this front cover, or a certain page therein, or
Shape of picture mosaic etc.；Above-mentioned electronic image can be the still image on article in the pre-set space obtained by camera head
Electronic image；Above-mentioned multi-medium data can be audio corresponding with above-mentioned still image, video or 3D rendering；Filled by imaging
Put, the still image on the article in pre-set space is converted into corresponding electronic image, extract corresponding from electronic image
Information, so as to obtain multi-medium data corresponding with the information, and is presented to display screen.
In a kind of optional embodiment, above-mentioned camera head can be the camera of mobile phone or panel computer, above-mentioned
Display screen can be the display screen of mobile phone or panel computer, a certain when the textbook or books opened by taking textbook or books as an example
When being word on the page (still image), the page is shot using mobile phone or panel computer camera, can be by textbook or books
Word recitation on the page is out；When having image on the textbook or a certain page of books opened, using mobile phone or flat board electricity
The camera of brain shoots the page, can be in the plane picture on mobile phone or the display screen display of the panel computer page with 3D
The form of image is showed, and the additional corresponding audio or video of display, so as to increase the readability of textbook or books.
Alternatively, above-mentioned camera head can also be external camera, and above-mentioned display screen can be the aobvious of desktop computer
Show device.
In another optional embodiment, camera head and display screen can be fixed using support, when user exists
During reading textbook or books, with the operation such as page turning of user, audio, video or 3D rendering in display screen are cut automatically
Lower one page is shifted to, by a certain destination object in the local word or image in click or touch textbook or books, on display screen
Multi-medium data can play audio, video or the image of appropriate section in the page in the destination object make corresponding action.
In a kind of optional embodiment, above-mentioned article can be textbook, and click, touchs by user on textbook etc. are grasped
Make, the picture of textbook can be in real time shown on display screen, it is preferable that can be 3D models；It is a certain in user clicks on picture
During individual destination object, corresponding destination object can be acted with sending corresponding sound or making some on display screen.
In a kind of optional embodiment, above-mentioned article can be to paint this, can in real time show user in paper on a display screen
Matter paints the color or shape of full-filling on this, after user completes full-filling operation, can on a display screen show that full-filling is completed flat
The 3D models of face image, for example, when child has got well the picture that a width a group duckling swims in the water in full-filling in painting this, can be with
Corresponding stereoscopic picture plane is shown in display screen, it is preferable that the sense of accomplishment of child can be increased with corresponding sound etc.,
Cultivate the learning interest of child.
In a kind of optional embodiment, above-mentioned article can be picture mosaic, can on a display screen show a width picture mosaic, user
Picture mosaic can be carried out in pre-set space (for example, it may be region that camera can be covered on flat panel desktop), when the spelling of user
When figure result is correct, some can be sent on congratulating the correct sound of picture mosaic, it is possible to which the picture mosaic that will have been spelled carries out 3D and shows；
When the picture mosaic result mistake of user, some sound on encouragement can be sent, it is preferable that some picture mosaics can also be provided and carried
Show.
In a kind of optional embodiment, above-mentioned article can on a display screen show a material object with English alphabet card, use
Family can throw the alphabetical card with corresponding English word in kind in pre-set space, as long as the alphabetical card thrown and the English
(without ensureing sequence consensus), then correct object information is thrown in output to literary word correspondence.
By above-described embodiment, the learning interest of child can be cultivated, and promote the study and growth of child.
From the foregoing, it will be observed that in the above embodiments of the present application, article is shot by camera head, by article (for example, textbook,
Paint this or other books) on still image be converted to corresponding electronic image, according to the information obtained from the electronic image,
Still image is showed in the multimedia form such as audio, video or 3D rendering, has been reached any papery plane picture
The purpose of interactive display in the multimedia form, it is achieved thereby that thrift education cost, the technique effect of enhancing Consumer's Experience, and then
Solving prior art cannot realize carrying out on any static non-electronics major material object the technical problem of animation presentation.
Alternatively, above-mentioned article can include：Textbook, paint sheet, card, picture album, Freehandhand-drawing sheet, seven-piece puzzle, building blocks, toy.
In a kind of optional embodiment, as shown in Fig. 2 the information in electronic image is obtained in above-mentioned steps S104, can
To include：Step S204, obtains the characteristic information of electronic image；
The corresponding multi-medium data of still image is determined according to information in above-mentioned steps S106, can be included：Step S206,
The 3D rendering matched with electronic image is searched according to characteristic information.
Used as a kind of optional embodiment, above-mentioned electronic image can be thing in the pre-set space obtained by camera head
The electronic image of the still image on product；Features described above information can be the word in electronic image, picture, color or other marks
Note information；Above-mentioned multi-medium data can be audio corresponding with above-mentioned still image, video or 3D rendering；Based on above-mentioned steps
S204 and S206, after the still image on article in by pre-set space is converted to electronic image, can obtain the electronic chart
Characteristic information as in, the 3D rendering matched with the electronic image is searched according to the characteristic information for getting.
In a kind of preferred embodiment, label information can be set on the page of article, for example, Quick Response Code etc., can be with
The page is rapidly identified, and finds out 3D rendering corresponding with the page.
By above-described embodiment, the effect that the plane picture in the article page is carried out 3D displayings is realized.
In a kind of optional embodiment, as shown in figure 3, the characteristic information of electronic image is obtained in above-mentioned steps S204,
Can include：Step S304, obtains the outline of the destination object in electronic image；
The 3D rendering matched with electronic image according to characteristic information lookup in above-mentioned steps S206, can include：Step
S306, the 3D models matched with destination object are searched according to outline.
Used as a kind of optional embodiment, above-mentioned electronic image can be thing in the pre-set space obtained by camera head
The electronic image of the still image on product；Features described above information can be the word in electronic image, picture, color or other marks
Note information；Above-mentioned destination object can be each figure on the article page；Above-mentioned outline can be each on the article page
The shape contour of individual image；Above-mentioned 3D models can be the corresponding 3D models of these images, for example, there is one on the article page
Duckling image, can be shown as 3D models when display by duckling；Based on above-mentioned steps S304 and S306, will preset
After the still image on article in space is converted to electronic image, each destination object in the electronic image can be obtained
Shape, i.e. outline, the 3D models matched with the destination object are searched according to the outline.
By above-described embodiment, reached each destination object in the page by paper article carries out the mesh of 3D displayings respectively
's.
In a kind of optional embodiment, as shown in figure 4,3D rendering is presented may include steps of：
Step S402, the spatial cue of at least one portion of destination object is obtained according to outline；
Step S404, the 3D models matched with destination object according to spatial cue pair are rendered；
Step S406, is presented the 3D models after rendering.
Used as a kind of optional embodiment, above-mentioned destination object can be each figure on the article page；Above-mentioned lines
Profile can be the shape contour of each image on the article page；Above-mentioned 3D models can be the corresponding 3D models of these images；
Above-mentioned spatial cue can be the change of each color of image on the article page；Based on above-mentioned steps S402 to S406, according to line
After bar profile searches the 3D models matched with destination object, the outline according to figure obtains of the acquisition destination object
Or the spatial cue (for example, change of graphic color) of some, and will be matched with the destination object according to the spatial cue
3D models rendered, and on a display screen present render after 3D models.
By above-described embodiment, the effect for moving up static pattern is realized.
In an alternative embodiment, as shown in figure 5, the information of electronic image is obtained in above-mentioned steps S104, can
To include：Step S504, obtains positional information corresponding with the position operated on article in electronic image, wherein, operation bag
Include：Page turning, click, touch；
The corresponding multi-medium data of still image is determined according to information in above-mentioned steps S106, can be included：Step S506,
The audio or video matched with positional information is searched according to positional information.
Used as a kind of optional embodiment, above-mentioned electronic image can be thing in the pre-set space obtained by camera head
The electronic image of the still image on product；Aforesaid operations position can be that the still image of the article in pre-set space is carried out a little
Hit, touch or the operation such as page turning position；Above-mentioned multi-medium data can be audio corresponding with above-mentioned still image, video or
3D rendering；Based on above-mentioned steps S504 and S506, the still image on article in by pre-set space is converted to electronic image,
Obtain in the electronic image with clicked in still image, touch or the operation such as page turning the corresponding electronic image middle position in position
Confidence is ceased, and the audio or video with the location matches is searched according to the positional information.
Herein it should be noted that aforesaid operations position can be the page number position in the papery page, or
Position in the papery page where destination object, if operation is page number position, i.e. what is carried out is page turn over operation, can
With the audio or video of one page under automatic acquisition；If the position where the destination object of operation, that is, click on or touch the target
Object, then obtain the corresponding audio or video of the destination object automatically, in a kind of optional embodiment, or the target pair
The 3D models of elephant.
Alternatively, above-mentioned acquisition can be wrapped to positional information corresponding with operating position in electronic image in electronic image
Include：The position of object being operated is obtained by motion tracking device；Corresponding positional information in electronic image is determined according to the position.
By above-described embodiment, realize by certain position in click or the touch article page to obtain relevant position
The purpose of audio or video.
In a kind of optional embodiment, can be by the exercise data of Real-time Collection user, and according to data of doing exercises
Corresponding driving data is generated, virtual objects (for example, sound) are rendered according to driving data triggering, so as to generate animation shadow in real time
As data, wherein, exercise data can include at least one：Books page turning action data, Fingers loop data, touch-screen
Click on (movement) data.
In a kind of optional embodiment, the exercise data of Real-time Collection user can include with least one：Analysis
The image comprising books in acquisition target of input, the characteristic information of books in positioning acquisition object, the feature letter according to books
Breath determines which page in which kind of data books, wherein, the characteristic information position of books includes at least one of：Book pages
The position at place, the angle of inclination of book pages, anglec of rotation etc..
In a kind of optional embodiment, before driving data is moved in treatment exercise data generation first, above-mentioned side
Method also includes at least one of：Analysis input comprising finger finger ring position in acquisition target, in positioning acquisition object
The characteristic information of image, according to characteristic information determine whether there is finger, finger positional information in the picture, wherein, figure
The characteristic information position of picture includes at least one of：Colouring information and shape information.
In a kind of optional embodiment, before driving data is moved in treatment exercise data generation first, above-mentioned side
Method can also include at least one of：Which page in books, book pages position in the picture are identified from image
Put, while finger ring in being recognized from image, when due to gathered data, has various inclinations and rotation, it is necessary to books page
Correction is just had an X-rayed in face, while correction is also also carried out to finger ring makes its data in same data space, then according in advance
The trigger condition for setting, obtains finger ring driving data；Collection touch-screen corresponding with acquisition target and peripheral hardware mouse-keyboard etc.
Sensing data, the action data of acquisition target is calculated according to sensing data, wherein, action data includes working as acquisition target
The position of the world coordinates of preceding action and the anglec of rotation.
In a kind of optional embodiment, after the first animated image data and sound are rendered, the above method is also wrapped
Include：
Step one, gathers interactive information, and interactive information is sent in the virtual scene of the first animated image and sound,
Wherein, interactive information includes the information of at least one of positioned at interactive objects：Voice messaging, image information, action message,
Text information, interaction instruction；
Step 2, the second exercise data that real-time capture acquisition target is generated according to interactive information；
Step 3, moves driving data, and drive according to the second motion driving data according to the second exercise data generation second
Move and render virtual objects generation the second animated image data and sound in real time.
In a kind of optional embodiment, action message and interaction instruction source are the books of Touch screen and finger ring in reality
The finger ring operation of touch operation above the page on book pages, wherein processing module is contained, real-time book pages
Detection, aerial prospective correction, real-time finger ring identification coordinates book pages perspective correction, triggers special-effect information.
In a kind of optional embodiment, 2D still images generation 3D dynamic images can be contained into following operation：
Then identification to the static images, segmentation, the correction of locus allows the picture of existence, raw corresponding to the model for being used
Into 3D dynamic images.
Based on above-described embodiment, as shown in figure 5, multi-medium data is presented in above-mentioned steps S108 can include：Step
S508, plays audio or video.
In a kind of optional embodiment, electronic image is obtained, can included：Obtain quiet on the article in pre-set space
State image；Still image is identified, is corrected, obtain electronic image.
Herein it should be noted that due to the problems such as the image of camera head shooting there may be rotation, incline, obtaining
After still image on the article page, still image can be identified, aerial prospective correction etc., so as to obtain the page
Electronic image.
In a kind of optional embodiment, as shown in fig. 6, after multi-medium data is presented, the above method can also be wrapped
Include following steps：
Step S602, obtains default gesture motion, wherein, gesture motion is set by User Defined；
Step S604, according to gesture motion, it is determined that the operation to multi-medium data, wherein, operation at least includes：Pause,
Switch or exit the multi-medium data of current presentation.
Used as a kind of optional embodiment, above-mentioned gesture motion can be a series of dynamic of user's self-defined setting in advance
Make；In a kind of optional embodiment, it is the current many matchmakers for presenting of pause that can be arranged on the article of pre-set space and draw triangle
Volume data；It is arranged in pre-set space and draws a circle to exit the multi-medium data (for example, video or audio etc.) of current presentation；Set
It is to automatically switch to next multi-medium data in pre-set space inside-paint horizontal line.
By above-described embodiment, the purpose for being switched fast, suspending or exiting current multimedia data is realized, enhance use
Family experience effect.
Used as a kind of preferred embodiment, Fig. 7 show a kind of multimedia presentation method flow chart of drawing still image.
As shown in fig. 7, comprises following steps：
The first still image on this is painted in step S702, collection.
In above-mentioned steps, the first still image painted on this is obtained by camera head, the first still image is carried out
Aerial prospective is corrected, and eliminates rotation, the tilt problem produced during user's shooting image, then to characteristic point edge analysis, and
Preserve these characteristic point outline datas and picture.
Step S704, the outline data according to the first still image calculates its topological structure, is searched in database corresponding
Isomorphism topological data.
In above-mentioned steps, the topology diagram to calculating the still image according to characteristic point outline data, according to topology
The isomorphic relations of structure chart, searches corresponding isomorphism topological data in topological database.
Step S706, according to the isomorphism topological data for getting, for first still image sets up 3D models and action.
It is first still image after corresponding isomorphism topological data is searched in topological database in above-mentioned steps
Set up 3D models and action.
Step S708, obtains the second still image after drawing.
In above-mentioned steps, aerial prospective correction is carried out to the second still image, obtain one and the first still image is big
Small consistent image (only difference is that, the pattern has filled out shades of colour by user).
Step S710, the corresponding 3D models of the second still image of output.
In above-mentioned steps, the outline data according to the second still image is calculated topological data, uses the second static map
The topological data of picture replaces the original texture of 3D models, and then 3D models are shown, so that draw presenting.
In the above embodiments of the present application, there is provided a kind of multimedia presentation method of drawing still image, i.e., at some
Above static pattern, static images can be depicted as oneself desired color, then by shooting by user according to oneself hobby
Head shoots, and by procedure identification, deducts the image for drawing specifically which static state in original image according to the matching of characteristic point,
Identification image carry out aerial prospective correction, obtain one with original static pattern as picture (only difference is that, this
Pattern has filled out shades of colour by user), then will correct the 3D model wash with watercolours of later image data and well in advance
Dye, obtains the image of final result, so, is achieved that the content that user draws, and face moves up on computers.
As one kind preferred embodiment, Fig. 8 show a kind of square flow chart for allowing static pattern to get up, such as Fig. 8 institutes
Show, including：
Step S1, external image is received by camera.
In above-mentioned steps, external static article can be obtained by the camera of the smart machines such as mobile phone or panel computer
Image, the stationary article can be to paint this books, pure craft to paint this, add color and paint this or entity toy.
Step S2, treatment is analyzed to image.
In above-mentioned steps, after the image for getting external static article by camera, because camera head shoots
Image there may be rotation, incline the problems such as, obtain the article page on still image after, it is necessary to carry out aerial prospective mistake
It is true to correct to obtain electronic image corresponding with still image, characteristic point edge analysis and biometric profile are carried out to electronic image
Correlative model identification, preserves characteristic point outline data and picture.
Step S3, obtains topological structure skeletal graph.
In above-mentioned steps, after the profile to electronic image is analyzed and obtains outline data, outline data is carried out
Filling is sharpened sews and mend attended operation, then carries out ReebGraph analyses to view data, obtains the topological structure bone of image
Figure.
Step S4, obtains biometric image data.
In above-mentioned steps, the outline data that edge analysis is obtained is carried out according to electronic image, in electronic image
Destination object scratches figure.
Step S5, datagraphic 3Dization vector quantization.
In above-mentioned steps, after the figure of destination object in getting electronic image, to face profile data triangle
Change veining, matching primitives are carried out to skeleton data and outline data so that datagraphic 3Dization vector quantization.
Step S6, gesture motion catches (according to motion capture, it is determined that triggering required movement).
In above-mentioned steps, the gesture motion of user is obtained by the motion capture such as tracker equipment, triggering is corresponding dynamic
Instruct.
Step S7, is acted according to prefabricated 3D, and driving is rendered
In above-mentioned steps, acted according to the 3D for pre-setting preservation, image data and 3D models are rendered, obtained
Final result image.
Herein it should be noted that the action of above-mentioned 3D cartoons oneself can make gesture motion pair by User Defined
The content answered.
Embodiment 2
According to embodiments of the present invention, a kind of stent embodiment is additionally provided, the support can be for supporting mobile device
(for example, mobile phone, panel computer), a kind of intelligent reading partner instrument is combined as with an article (for example, textbook, paint etc.).
Fig. 9 is a kind of support schematic diagram according to embodiments of the present invention, as shown in figure 9, the support includes：Geometrical clamp 901
With support bar 903.
Wherein, geometrical clamp 901, for placing and fixed mobile device；
Support bar 903, is hinged with geometrical clamp, for supporting geometrical clamp and being fixed to preset height.
Used as a kind of optional embodiment, above-mentioned mobile device can be the Intelligent mobile equipments such as mobile phone, panel computer；On
Geometrical clamp 901 is stated, be can be used for the mobile phone of size dimensions different on the market at present, panel computer clamping or fixed, it is above-mentioned
Support bar is used to support and above-mentioned fixation is folded in into certain height, and because geometrical clamp is hinged with support bar, geometrical clamp can be with
Rotate arbitrarily angled, optimal to meet user visual angle.
In a kind of optional embodiment, above-mentioned support, paint this and Intelligent mobile equipment and be combined, can be as a kind of intelligence
Interactive reading partner instrument, by the optical image identification of Intelligent mobile equipment, pattern analysis treatment and high in the clouds transmission and database
Contour science and technology, apply in 3-6 Sui children's early education culture, can control various types, the Chinese and English of content and paint this.
Read aloud by the built-in cartoon character of Intelligent mobile equipment, voice guide, intelligent interaction function, allow child reading to paint this, play and paint
This while, acoustically know from experience from tactile, vision and comprehensively the enjoyment of study.
From the foregoing, it will be observed that in the above embodiments of the present application, there is provided a kind of support of Intelligent mobile equipment, combined with intelligent is moved
Dynamic equipment, can be as a kind of intelligent reading partner instrument, using the camera of Intelligent mobile equipment, can be by article (for example, spelling
Figure, seven-piece puzzle, block toy, textbook, paint this or other books) on still image be converted to corresponding electronic image, according to
The information obtained from the electronic image, still image is showed in the multimedia form such as audio, video or 3D rendering,
Reach the purpose of the plane picture of any article interactive display in the multimedia form, it is achieved thereby that thrift education cost,
Strengthening the technique effect of Consumer's Experience, and then solve prior art cannot realize for any static non-electronics major material object entering action
Draw the technical problem for presenting.
In a kind of optional embodiment, such as shown in Figure 10 (a), above-mentioned geometrical clamp can include：Swash plate 101, by pin
Axle is rotated with support bar and is connected；First baffle 103, an overall structure is connected as with the bottom of swash plate, wherein, first baffle with
Swash plate setting at an acute angle.
Based on above-described embodiment, in a kind of optional embodiment, such as shown in Figure 10 (b), above-mentioned support also includes：The
One bolt 105, passes perpendicularly through support bar and is connected with swash plate, for control and fixed swash plate angle of inclination.
In an alternative embodiment, as shown in figure 11, above-mentioned geometrical clamp includes：Platform 111, connects with support bar
Connect；At least two second baffles 113, an overall structure is connected as with the two ends of platform, wherein, at least two second plate washers with
Platform setting at an acute angle.
In a kind of optional embodiment, the above-mentioned platform using such as Figure 11, user can place picture mosaic, product below platform
Wooden toy, sheet, books etc. are painted, the smart machine being placed on platform by rear camera, can obtain the still image of article, and
In the corresponding 3D rendering of display screen display or cartoon of smart machine.
Based on above-described embodiment, in a kind of optional embodiment, as shown in figure 12, above-mentioned support also includes：Second
Bolt 115, the height for fixing support bar, wherein, support bar is telescopic rod.
Alternatively, above-mentioned support bar can also be sizing flexible pipe, and height and angle can be arbitrarily set by user, improve and use
Family experience effect.
By the embodiment above, using retractable support lever, user can be carried out support bar according to the demand of oneself
Lifting selection.
In a kind of optional embodiment, as shown in figure 13, above-mentioned support bar can be to pass through bearing pin by multiple connecting rods
The connection member 131 that connects and composes of rotation, the rotation for platform to be carried out multiple angles, wherein, uppermost connecting rod with
Platform is connected.
In a kind of optional embodiment, such as shown in Figure 14 (a), above-mentioned support also includes：Speculum 141, is arranged on solid
In clamp or mobile device, in the camera that the still image of the article in pre-set space is reflexed to mobile device, its
In, speculum is with geometrical clamp or mobile device into predetermined angle, and such as Figure 14 (b) is shown.
Used as a kind of optional embodiment, above-mentioned speculum can be set on the mobile apparatus, and user is in desktop for reflection
The article page-images of placement, allow the camera of the mobile device of any placement to obtain the still image of the article page, this
User is greatly facilitated, is that book pages point is read, the sound animation of material picture, there is provided indispensable condition；Preferably,
Above-mentioned speculum is clipped in behind camera, such as shown in Figure 14 (a), various behaviour that can be by user on book pages
Make (instruction) to identify, so as to trigger corresponding operating.
Alternatively, above-mentioned predetermined angle can be 45 degree, and above-mentioned speculum can be level crossing or convex lens.
In a kind of optional embodiment, the speculum as shown in Figure 15 (a) (minute surface in speculum is set in 45 degree of angles)
Can be used for the rear camera of Intelligent mobile equipment；Such as the speculum (minute surface in speculum is set in 45 degree of angles) of Figure 15 (b)
Can be used for the front camera of Intelligent mobile equipment.
In a kind of optional embodiment, as shown in figure 16, above-mentioned support also includes：Horizontal base 905, with support bar
Bottom connects, for placing articles.
In a kind of preferred embodiment, four suckers can be completely set in the lower of horizontal base, for preferably fixing
Support is stated, balance is kept.
According to embodiments of the present invention, additionally provide a kind of motion capture tracker embodiment, the motion capture tracker with
Support equipped is used, for obtaining the operation instruction information on article.
In a kind of optional embodiment, above-mentioned motion capture tracker can be finger ring or fingerstall as shown in figure 17.
In the above-described embodiments, using finger ring or fingerstall as distinguishing mark, user is allowed to put on finger ring, in book pages
Above, the various operations of clicking trigger are carried out.
Herein it should be noted that above-mentioned motion capture tracker for it is following any one：Small paster, coating are (for example, refer to
Nail polish), stick-like indicant (for example, talking pen).
As a preferred mode, will be based on the above embodiments of the present application support (including：Speculum) and interaction refer to
Painting originally for ring or fingerstall combination, the corresponding operational manual of outfit and standard configuration, can be as the reading partner instrument of child's formative education.
Specifically, in the above-described embodiment, after user buys the reading partner instrument, can be installed according to product description
Combined handset/Flat computer support frame and speculum；First, mobile device (by taking panel computer as an example) is placed on support, then
Painting for will reading originally is placed on the recognizable region of speculum, opens corresponding product APP on panel computer, initially enters study
Process；After everything is ready, panel computer first recognizes that painting this front cover judges it is which this book, and scene is read subsequently into normal page turning
In；To paint originally to translate into and paint this any page, the APP programs of panel computer called after figure is recognized corresponding audio, 3D images,
Flash demo etc. learns content.
Herein it should be noted that in above-mentioned learning process, user can wear fingerstall with hand at any time, this identification region is being painted
A reading is carried out, screen content can change therewith, lively demonstration；Can switch screen content when user clicks on " changing book " button,
Read other and paint this.
Used as a kind of preferred embodiment, the present apparatus supports interaction content self-control function, and father and mother can be having had in family
Any one paint this, by operating procedure typing APP, and correspondence typing oneself sound, and finger point reading action completes
Afterwards, child just can paint this by normal reading under this product, and what is heard is that oneself father, mother explain the content for painting this.
Preferably, the present apparatus is also supported to paint this content explanation sharing function：Oneself explanation can be painted this content by father and mother
High in the clouds is uploaded to, while can also hear that the content of sheet is painted in other father and mother explanation, allows child to learn to difference to paint sheet, different-style
Paint this content.
Embodiment 3
According to embodiments of the present invention, a kind of multimedia presentation system embodiment of still image is additionally provided.It is of the invention real
The multimedia presentation method for applying the still image in example 1 can be performed in the system of the embodiment of the present invention 3.
Figure 18 is a kind of multimedia presentation system schematic diagram of still image according to embodiments of the present invention, such as Figure 18 institutes
Show, the system includes：Camera 181 and processor 183.
Camera 181, for obtaining electronic image, wherein, electronic image is to be shot to obtain by the still image on article
's；
Processor 183, for obtaining the information in electronic image；The corresponding multimedia number of still image is determined according to information
According to, and multi-medium data is presented；Wherein, multi-medium data includes at least one of：Audio, video, 3D rendering are used to obtain
Information in electronic image；The corresponding multi-medium data of still image is determined according to information, wherein, multi-medium data includes following
At least one：Audio, video, 3D rendering；Multi-medium data is presented.
From the foregoing, it will be observed that in the above embodiments of the present application, article is shot by camera head, by article (for example, textbook,
Paint this or other books) on still image be converted to corresponding electronic image, according to the information obtained from the electronic image,
Still image is showed in the multimedia form such as audio, video or 3D rendering, has been reached any papery plane picture
The purpose of interactive display in the multimedia form, it is achieved thereby that thrift education cost, the technique effect of enhancing Consumer's Experience, and then
Solving prior art cannot realize carrying out on any static non-electronics major material object the technical problem of animation presentation.
In a kind of optional embodiment, above-mentioned processor 183 is additionally operable to obtain the characteristic information of electronic image；According to spy
Levy the 3D rendering that information searching is matched with electronic image.
In a kind of optional embodiment, above-mentioned processor 183 is additionally operable to obtain the line of the destination object in electronic image
Bar profile；The 3D rendering matched with electronic image is searched according to characteristic information：Searched according to outline and matched with destination object
3D models.
In a kind of optional embodiment, above-mentioned processor 183 is additionally operable to obtain destination object extremely according to outline
A few spatial cue for part；The 3D models matched with destination object according to spatial cue pair are rendered；After presentation is rendered
3D models.
In a kind of optional embodiment, above-mentioned processor 183 be additionally operable to obtain electronic image in article on operated
The corresponding positional information in position, and the audio or video that is matched with positional information is searched according to positional information；Wherein, operation bag
Include：Page turning, click, touch；The audio or video matched with positional information is searched according to positional information.
In a kind of optional embodiment, above-mentioned processor 183 is additionally operable to obtain object being operated by motion tracking device
Position；Corresponding positional information in electronic image is determined according to position.
In a kind of optional embodiment, above-mentioned processor 183 is additionally operable to play audio or video.
In a kind of optional embodiment, above-mentioned camera 181 is additionally operable to obtain the static state on the article in pre-set space
Image；Above-mentioned processor 183 is additionally operable to be identified still image, aerial prospective correction, obtains electronic image.
In a kind of optional embodiment, above-mentioned camera 181 is additionally operable to obtain default gesture motion, wherein, gesture
Action is set by User Defined；Above-mentioned processor 183 is additionally operable to according to gesture motion, it is determined that the operation to multi-medium data,
Wherein, operation at least includes：Suspend, switch or exit the multi-medium data of current presentation.
Embodiment 4
According to embodiments of the present invention, a kind of multimedia presentation devices embodiment of still image is additionally provided.It is of the invention real
The multimedia presentation method for applying the still image in example 1 can be performed in the device of the embodiment of the present invention 4.
Figure 19 is a kind of multimedia presentation devices schematic diagram of still image according to embodiments of the present invention, such as Figure 19 institutes
Show, the device includes：First acquisition module 191, the second acquisition module 193, determining module 195 and output module 197.
Wherein, the first acquisition module 191, for obtaining electronic image, wherein, electronic image is by the static map on article
Obtained as shooting；Second acquisition module 193, for obtaining the information in electronic image；Determining module 195, for according to letter
Breath determines the corresponding multi-medium data of still image, wherein, multi-medium data includes at least one of：Audio, video, 3D figures
Picture；Output module 197, for multi-medium data to be presented.
From the foregoing, it will be observed that in the above embodiments of the present application, article is shot by camera head, by article (for example, textbook,
Paint this or other books) on still image be converted to corresponding electronic image, according to the information obtained from the electronic image,
Still image is showed in the multimedia form such as audio, video or 3D rendering, has been reached any papery plane picture
The purpose of interactive display in the multimedia form, it is achieved thereby that thrift education cost, the technique effect of enhancing Consumer's Experience, and then
Solving prior art cannot realize carrying out on any static non-electronics major material object the technical problem of animation presentation.
In a kind of optional embodiment, above-mentioned second acquisition module also includes：First acquisition submodule, for obtaining electricity
The characteristic information of subgraph；Above-mentioned determining module also includes：First searching modul, for being searched and electronic chart according to characteristic information
As the 3D rendering of matching.
In a kind of optional embodiment, above-mentioned second acquisition module also includes：Second acquisition submodule, for obtaining electricity
The outline of the destination object in subgraph；Above-mentioned determining module also includes：Second searching modul, for according to outline
The 3D models that lookup is matched with destination object.
In a kind of optional embodiment, above-mentioned output module also includes：3rd acquisition submodule, for according to lines wheel
Exterior feature obtains the spatial cue of at least one portion of destination object；First processing module, for according to spatial cue pair and target
The 3D models of object matching are rendered；First output sub-module, for the 3D models after rendering to be presented.
In a kind of optional embodiment, above-mentioned second acquisition module also includes：4th acquisition submodule, for obtaining electricity
Positional information corresponding with the position operated on article in subgraph, wherein, operation includes：Page turning, click, touch；It is above-mentioned
Determining module also includes：3rd searching modul, for searching the audio or video matched with positional information according to positional information.
In a kind of optional embodiment, above-mentioned second acquisition module also includes：5th acquisition submodule, for by dynamic
Make the position that tracker obtains object being operated；Corresponding positional information in electronic image is determined according to position.
In a kind of optional embodiment, above-mentioned output module also includes：Second output sub-module, for play audio or
Video.
In a kind of optional embodiment, above-mentioned first acquisition module also includes：6th acquisition submodule, it is pre- for obtaining
If the still image on article in space；Second processing module, for being identified to still image, being corrected, obtains electronics
Image.
Embodiment 5
According to embodiments of the present invention, a kind of multimedia resource sharing system embodiment based on cloud platform is additionally provided.This
The multimedia resource that the multimedia presentation method of the still image in inventive embodiments 1 can be used for the embodiment of the present invention 5 is shared
Performed in system.
Figure 20 is a kind of multimedia resource sharing system schematic diagram based on cloud storage according to embodiments of the present invention, is such as schemed
Shown in 20, the system includes：The mobile terminal 203 of server 201 and at least one.
Used as a kind of optional embodiment, above-mentioned mobile terminal can be the intelligence such as computer, smart mobile phone, panel computer
Equipment, above-mentioned server provides a multimedia resource shared platform based on cloud storage, and user can by accessing the platform
With download or upload multimedia data, wherein, multi-medium data includes：Multimedia presentation method system based on above-mentioned still image
The finished product files such as various audios, video, cartoon, the 3D models made, and various e-books, Freehandhand-drawing sheet, picture etc., one
Plant in optional embodiment, user can download the multi-medium data that other users are uploaded by the APP installed on mobile phone, also may be used
Platform is uploaded to by multi-medium datas such as the audio for oneself making, videos, is downloaded for other users；Another optional implementation
Example in, user can by access webpage version multimedia resource shared platform, upload or download multimedia data file.
In a kind of optional embodiment, some template datas can also be provided by multimedia resource shared platform, for example
Some cartoon patterns, 3D models etc., user can be non-for uninteresting textbook is fabricated to by downloading these interesting elements
The multimedia data file of normal vivid and interesting, increases the interest of child's study.
In a kind of optional embodiment, by above-mentioned multimedia resource shared platform, a friendship can also be provided to parent
The platform of stream, by exchange and interaction between parent, discussion is best suitable for cultivating the educational mode of child.
The embodiments of the present invention are for illustration only, and the quality of embodiment is not represented.
In the above embodiment of the present invention, the description to each embodiment all emphasizes particularly on different fields, and does not have in certain embodiment
The part of detailed description, may refer to the associated description of other embodiment.
In several embodiments provided herein, it should be understood that disclosed technology contents, can be by other
Mode is realized.Wherein, device embodiment described above is only schematical, the division of such as unit, can be one kind
Division of logic function, can there is other dividing mode when actually realizing, such as multiple units or component can combine or can
To be integrated into another system, or some features can be ignored, or not perform.It is another, it is shown or discussed each other
Coupling or direct-coupling or communication connection can be the INDIRECT COUPLING or communication connection of unit or module by some interfaces,
Can be electrical or other forms.
The unit illustrated as separating component can be or may not be physically separate, be shown as unit
Part can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple units
On.Some or all of unit therein can be according to the actual needs selected to realize the purpose of this embodiment scheme.
In addition, during each functional unit in each embodiment of the invention can be integrated in a processing unit, it is also possible to
It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.Above-mentioned integrated list
Unit can both be realized in the form of hardware, it would however also be possible to employ the form of SFU software functional unit is realized.
If integrated unit, can to realize in the form of SFU software functional unit and as independent production marketing or when using
To store in a computer read/write memory medium.Based on such understanding, technical scheme substantially or
Saying all or part of the part or technical scheme contributed to prior art can be embodied in the form of software product
Out, computer software product storage is in a storage medium, including some instructions are used to so that a computer equipment
(can be personal computer, server or network equipment etc.) performs all or part of step of each embodiment method of the invention
Suddenly.And foregoing storage medium includes：USB flash disk, read-only storage (ROM, Read-Only Memory), random access memory
(RAM, Random Access Memory), mobile hard disk, magnetic disc or CD etc. are various can be with the medium of store program codes.
The above is only the preferred embodiment of the present invention, it is noted that come for those skilled in the art
Say, under the premise without departing from the principles of the invention, can also make some improvements and modifications, these improvements and modifications also should be regarded as
Protection scope of the present invention.
Claims (12)
1. a kind of multimedia presentation method of still image, it is characterised in that including：
Electronic image is obtained, wherein, the electronic image is to be shot to obtain by the still image on article；
Obtain the information in the electronic image；
The corresponding multi-medium data of the still image is determined according to described information, wherein, the multi-medium data includes following
At least one：Audio, video, 3D rendering；
The multi-medium data is presented.
2. multimedia presentation method according to claim 1, it is characterised in that the article includes：Textbook, paint this, card
Piece, picture album, Freehandhand-drawing sheet, seven-piece puzzle, building blocks, toy.
3. multimedia presentation method according to claim 2, it is characterised in that
The information obtained in the electronic image includes：Obtain the characteristic information of the electronic image；
Determine that the corresponding multi-medium data of the still image includes according to described information：Searched according to the characteristic information and institute
State the 3D rendering of electronic image matching.
4. multimedia presentation method according to claim 3, it is characterised in that
The characteristic information for obtaining the electronic image includes：Obtain the outline of the destination object in the electronic image；
The 3D rendering matched with the electronic image is searched according to the characteristic information to be included：According to the outline search with
The 3D models of the destination object matching.
5. multimedia presentation method according to claim 4, it is characterised in that the 3D rendering is presented to be included：
The spatial cue of at least one portion of the destination object is obtained according to the outline；
The 3D models matched with the destination object according to the spatial cue pair are rendered；
The 3D models after rendering are presented.
6. multimedia presentation method according to claim 1, it is characterised in that
The information for obtaining the electronic image includes：Obtain corresponding with the position operated on the article in the electronic image
Positional information, wherein, the operation includes：Page turning, click, touch；
Determine that the corresponding multi-medium data of the still image includes according to described information：Searched according to the positional information and institute
State the audio or video of positional information matching.
7. multimedia presentation method according to claim 6, it is characterised in that obtain in the electronic image with the thing
The corresponding positional information in operated unit position on product, including：
The position of the object being operated is obtained by motion tracking device；
Corresponding positional information in the electronic image is determined according to the position.
8. multimedia presentation method according to claim 7, it is characterised in that the multi-medium data is presented to be included：Broadcast
Put the audio or video.
9. multimedia presentation method as claimed in any of claims 1 to 8, it is characterised in that obtain electronic image,
Including：
Obtain the still image on the article in pre-set space；
The still image is identified, aerial prospective is corrected, and obtains the electronic image.
10. multimedia presentation method as claimed in any of claims 1 to 8, it is characterised in that described many presenting
After media data, methods described also includes：
Default gesture motion is obtained, wherein, the gesture motion is set by User Defined；
According to the gesture motion, it is determined that the operation to the multi-medium data, wherein, the operation at least includes：Suspend, cut
Change or exit the multi-medium data of current presentation.
A kind of 11. multimedia presentation systems of still image, it is characterised in that including：
Camera, for obtaining electronic image, wherein, the electronic image is to be shot to obtain by the still image on article；
Processor, for obtaining the information in the electronic image；Determine that the still image is corresponding more according to described information
Media data, and multi-medium data is presented；Wherein, the multi-medium data includes at least one of：Audio, video, 3D figures
Picture.
A kind of 12. multimedia presentation devices of still image, it is characterised in that including：
First acquisition module, for obtaining electronic image, wherein, the electronic image is shot by the still image on article
The general for arriving；
Second acquisition module, for obtaining the information in the electronic image；
Determining module, for determining the corresponding multi-medium data of the still image according to described information, wherein, the multimedia
Data include at least one of：Audio, video, 3D rendering；
Output module, for the multi-medium data to be presented.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611089873.XA CN106713896B (en) | 2016-11-30 | 2016-11-30 | The multimedia presentation method of still image, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611089873.XA CN106713896B (en) | 2016-11-30 | 2016-11-30 | The multimedia presentation method of still image, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106713896A true CN106713896A (en) | 2017-05-24 |
| CN106713896B CN106713896B (en) | 2019-08-20 |
Family
ID=58934372
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611089873.XA Active CN106713896B (en) | 2016-11-30 | 2016-11-30 | The multimedia presentation method of still image, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106713896B (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107274731A (en) * | 2017-06-05 | 2017-10-20 | 深圳市科迈爱康科技有限公司 | Towards children's study method, facility for study and storage medium |
| CN107343192A (en) * | 2017-07-20 | 2017-11-10 | 武汉市陆刻科技有限公司 | A kind of 3D solids interpolation model and VR mobile terminal interaction methods and system |
| CN108460124A (en) * | 2018-02-26 | 2018-08-28 | 北京物灵智能科技有限公司 | Exchange method and electronic equipment based on figure identification |
| CN109063038A (en) * | 2018-07-17 | 2018-12-21 | 中国联合网络通信集团有限公司 | The augmented reality reading system and method for books |
| CN109496295A (en) * | 2018-05-31 | 2019-03-19 | 优视科技新加坡有限公司 | Multimedia content generation method, device and equipment/terminal/server |
| CN110053390A (en) * | 2019-04-19 | 2019-07-26 | 温州市今艺印业有限公司 | A kind of Multifunction interdynamic notebook |
| CN110481198A (en) * | 2019-08-26 | 2019-11-22 | 温州市今艺印业有限公司 | A kind of multifunctional note |
| CN111079493A (en) * | 2019-06-09 | 2020-04-28 | 广东小天才科技有限公司 | Electronic equipment-based man-machine interaction method and electronic equipment |
| CN111078096A (en) * | 2019-06-09 | 2020-04-28 | 广东小天才科技有限公司 | Man-machine interaction method and electronic equipment |
| CN111164954A (en) * | 2017-10-11 | 2020-05-15 | 法国比克公司 | Support for a multimedia tablet computer or equivalent |
| CN112007359A (en) * | 2020-08-24 | 2020-12-01 | 杭州睿琪软件有限公司 | Image display method, readable storage medium and computer equipment |
| WO2021120111A1 (en) * | 2019-12-19 | 2021-06-24 | Boe Technology Group Co., Ltd. | Computer-implemented method of realizing dynamic effect in image, apparatus for realizing dynamic effect in image, and computer-program product |
| CN114115615A (en) * | 2020-08-10 | 2022-03-01 | 深圳市万普拉斯科技有限公司 | Interface display method and device, electronic equipment and storage medium |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103050025A (en) * | 2012-12-20 | 2013-04-17 | 广东欧珀移动通信有限公司 | Mobile terminal learning method and learning system thereof |
| CN103177373A (en) * | 2011-12-22 | 2013-06-26 | 上海易络客网络技术有限公司 | Interactive commercial experiencing method and system |
| US20130257848A1 (en) * | 2012-03-28 | 2013-10-03 | Microsoft Corporation | Augmented Reality Light Guide Display |
| EP2662838A2 (en) * | 2012-05-11 | 2013-11-13 | Sony Computer Entertainment Europe Limited | Apparatus and method for augmented reality |
| CN103455978A (en) * | 2012-05-31 | 2013-12-18 | 索尼电脑娱乐欧洲有限公司 | Apparatus and method for augmenting a video image |
| CN103489158A (en) * | 2012-06-01 | 2014-01-01 | 索尼电脑娱乐欧洲有限公司 | Apparatus and method of augmenting video |
| WO2014085768A1 (en) * | 2012-11-29 | 2014-06-05 | Haddish Imran | Virtual and augmented reality instruction system |
| CN104166851A (en) * | 2014-08-25 | 2014-11-26 | 盛静浩 | Multimedia interactive learning system and method for paper textbooks |
| CN104245067A (en) * | 2012-02-06 | 2014-12-24 | 索尼电脑娱乐欧洲有限公司 | Book object for augmented reality |
| WO2015030303A1 (en) * | 2013-08-28 | 2015-03-05 | Lg Electronics Inc. | Portable device displaying augmented reality image and method of controlling therefor |
| CN104461318A (en) * | 2013-12-10 | 2015-03-25 | 苏州梦想人软件科技有限公司 | Touch read method and system based on augmented reality technology |
| CN105320282A (en) * | 2015-12-02 | 2016-02-10 | 广州经信纬通信息科技有限公司 | Image recognition solution based on augmented reality |
| CN105405168A (en) * | 2015-11-19 | 2016-03-16 | 青岛黑晶信息技术有限公司 | Method and apparatus for implementing three-dimensional augmented reality |
-
2016
- 2016-11-30 CN CN201611089873.XA patent/CN106713896B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103177373A (en) * | 2011-12-22 | 2013-06-26 | 上海易络客网络技术有限公司 | Interactive commercial experiencing method and system |
| CN104245067A (en) * | 2012-02-06 | 2014-12-24 | 索尼电脑娱乐欧洲有限公司 | Book object for augmented reality |
| US20130257848A1 (en) * | 2012-03-28 | 2013-10-03 | Microsoft Corporation | Augmented Reality Light Guide Display |
| EP2662838A2 (en) * | 2012-05-11 | 2013-11-13 | Sony Computer Entertainment Europe Limited | Apparatus and method for augmented reality |
| CN103455978A (en) * | 2012-05-31 | 2013-12-18 | 索尼电脑娱乐欧洲有限公司 | Apparatus and method for augmenting a video image |
| CN103489158A (en) * | 2012-06-01 | 2014-01-01 | 索尼电脑娱乐欧洲有限公司 | Apparatus and method of augmenting video |
| WO2014085768A1 (en) * | 2012-11-29 | 2014-06-05 | Haddish Imran | Virtual and augmented reality instruction system |
| CN103050025A (en) * | 2012-12-20 | 2013-04-17 | 广东欧珀移动通信有限公司 | Mobile terminal learning method and learning system thereof |
| WO2015030303A1 (en) * | 2013-08-28 | 2015-03-05 | Lg Electronics Inc. | Portable device displaying augmented reality image and method of controlling therefor |
| CN104461318A (en) * | 2013-12-10 | 2015-03-25 | 苏州梦想人软件科技有限公司 | Touch read method and system based on augmented reality technology |
| CN104166851A (en) * | 2014-08-25 | 2014-11-26 | 盛静浩 | Multimedia interactive learning system and method for paper textbooks |
| CN105405168A (en) * | 2015-11-19 | 2016-03-16 | 青岛黑晶信息技术有限公司 | Method and apparatus for implementing three-dimensional augmented reality |
| CN105320282A (en) * | 2015-12-02 | 2016-02-10 | 广州经信纬通信息科技有限公司 | Image recognition solution based on augmented reality |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018223520A1 (en) * | 2017-06-05 | 2018-12-13 | 深圳市科迈爱康科技有限公司 | Child-oriented learning method and learning device, and storage medium |
| CN107274731A (en) * | 2017-06-05 | 2017-10-20 | 深圳市科迈爱康科技有限公司 | Towards children's study method, facility for study and storage medium |
| CN107343192A (en) * | 2017-07-20 | 2017-11-10 | 武汉市陆刻科技有限公司 | A kind of 3D solids interpolation model and VR mobile terminal interaction methods and system |
| CN111164954A (en) * | 2017-10-11 | 2020-05-15 | 法国比克公司 | Support for a multimedia tablet computer or equivalent |
| US11137107B2 (en) | 2017-10-11 | 2021-10-05 | Societe Bic | Support for multimedia tablet or equivalent |
| CN108460124A (en) * | 2018-02-26 | 2018-08-28 | 北京物灵智能科技有限公司 | Exchange method and electronic equipment based on figure identification |
| WO2019161685A1 (en) * | 2018-02-26 | 2019-08-29 | Beijing Ling Technology Co., Ltd. | Interactive method and electronic device |
| US12033532B2 (en) | 2018-02-26 | 2024-07-09 | Beijing Ling Technology Co., Ltd. | Interactive method and electronic device |
| CN109496295A (en) * | 2018-05-31 | 2019-03-19 | 优视科技新加坡有限公司 | Multimedia content generation method, device and equipment/terminal/server |
| WO2019227429A1 (en) * | 2018-05-31 | 2019-12-05 | 优视科技新加坡有限公司 | Method, device, apparatus, terminal, server for generating multimedia content |
| CN109063038A (en) * | 2018-07-17 | 2018-12-21 | 中国联合网络通信集团有限公司 | The augmented reality reading system and method for books |
| CN110053390A (en) * | 2019-04-19 | 2019-07-26 | 温州市今艺印业有限公司 | A kind of Multifunction interdynamic notebook |
| CN111079493A (en) * | 2019-06-09 | 2020-04-28 | 广东小天才科技有限公司 | Electronic equipment-based man-machine interaction method and electronic equipment |
| CN111078096B (en) * | 2019-06-09 | 2021-07-23 | 广东小天才科技有限公司 | Man-machine interaction method and electronic equipment |
| CN111078096A (en) * | 2019-06-09 | 2020-04-28 | 广东小天才科技有限公司 | Man-machine interaction method and electronic equipment |
| CN111079493B (en) * | 2019-06-09 | 2024-03-22 | 广东小天才科技有限公司 | Man-machine interaction method based on electronic equipment and electronic equipment |
| CN110481198A (en) * | 2019-08-26 | 2019-11-22 | 温州市今艺印业有限公司 | A kind of multifunctional note |
| WO2021120111A1 (en) * | 2019-12-19 | 2021-06-24 | Boe Technology Group Co., Ltd. | Computer-implemented method of realizing dynamic effect in image, apparatus for realizing dynamic effect in image, and computer-program product |
| CN113287087A (en) * | 2019-12-19 | 2021-08-20 | 京东方科技集团股份有限公司 | Computer-implemented method of implementing dynamic effects in images, apparatus and computer program product for implementing dynamic effects in images |
| US11922551B2 (en) | 2019-12-19 | 2024-03-05 | Boe Technology Group Co., Ltd. | Computer-implemented method of realizing dynamic effect in image, an apparatus for realizing dynamic effect in image, and computer-program product |
| CN114115615A (en) * | 2020-08-10 | 2022-03-01 | 深圳市万普拉斯科技有限公司 | Interface display method and device, electronic equipment and storage medium |
| CN112007359A (en) * | 2020-08-24 | 2020-12-01 | 杭州睿琪软件有限公司 | Image display method, readable storage medium and computer equipment |
| CN112007359B (en) * | 2020-08-24 | 2023-12-15 | 杭州睿琪软件有限公司 | Image display method, readable storage medium and computer equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106713896B (en) | 2019-08-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106713896B (en) | The multimedia presentation method of still image, device and system | |
| CN206741428U (en) | Support with reflective mirror | |
| US11790589B1 (en) | System and method for creating avatars or animated sequences using human body features extracted from a still image | |
| Linowes et al. | Augmented reality for developers: Build practical augmented reality applications with unity, ARCore, ARKit, and Vuforia | |
| CN104461318B (en) | Reading method based on augmented reality and system | |
| US9996979B2 (en) | Augmented reality technology-based handheld viewing device and method thereof | |
| KR101692335B1 (en) | System for augmented reality image display and method for augmented reality image display | |
| CN108062796B (en) | Handmade product and virtual reality experience system and method based on mobile terminal | |
| US20180197345A1 (en) | Augmented reality technology-based handheld viewing device and method thereof | |
| CN105405168A (en) | Method and apparatus for implementing three-dimensional augmented reality | |
| CN106200960A (en) | The content display method of electronic interactive product and device | |
| CN106601043A (en) | Multimedia interaction education device and multimedia interaction education method based on augmented reality | |
| CN108389249A (en) | A kind of spaces the VR/AR classroom of multiple compatibility and its construction method | |
| CN204028887U (en) | A kind of reading of the hand-held based on augmented reality equipment | |
| CN108416832A (en) | Display methods, device and the storage medium of media information | |
| CN106776449A (en) | A kind of plant KePu Electronics book reads methods of exhibiting and device | |
| CN106791032A (en) | The method and apparatus that still image is converted to dynamic image | |
| CN106600669A (en) | Device based on variable-color fluorescent drawing board and augmented reality, and operation method | |
| Sing et al. | Design and development of multimedia and multi-marker detection techniques in interactive augmented reality colouring book | |
| CN113506377A (en) | Teaching training method based on virtual roaming technology | |
| CN111840999A (en) | Game education method based on three-dimensional object graph recognition | |
| Kasinathan et al. | First Discovery: Augmented Reality for learning solar systems | |
| Ma et al. | A 3D virtual learning system for STEM education | |
| Maguire | An exploration of low-fidelity prototyping methods for augmented and virtual reality | |
| Roccetti et al. | Day and night at the museum: intangible computer interfaces for public exhibitions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: Building 60, 1st Floor, No.7 Jiuxianqiao North Road, Chaoyang District, Beijing 021 Patentee after: Shiyou (Beijing) Technology Co.,Ltd. Country or region after: China Address before: 4017, 4th Floor, Building 2, No.17 Ritan North Road, Chaoyang District, Beijing Patentee before: 4U (BEIJING) TECHNOLOGY CO.,LTD. Country or region before: China |
|
| CP03 | Change of name, title or address |