CN101887207B - Real object projector with image auxiliary data searching and display functions and method thereof - Google Patents
Real object projector with image auxiliary data searching and display functions and method thereof Download PDFInfo
- Publication number
- CN101887207B CN101887207B CN2010101293834A CN201010129383A CN101887207B CN 101887207 B CN101887207 B CN 101887207B CN 2010101293834 A CN2010101293834 A CN 2010101293834A CN 201010129383 A CN201010129383 A CN 201010129383A CN 101887207 B CN101887207 B CN 101887207B
- Authority
- CN
- China
- Prior art keywords
- image
- processor
- characteristic information
- target
- auxiliary data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 64
- 230000006870 function Effects 0.000 title claims abstract description 31
- 238000000605 extraction Methods 0.000 claims abstract description 9
- 230000000153 supplemental effect Effects 0.000 claims description 21
- 239000000284 extract Substances 0.000 claims description 16
- 238000012856 packing Methods 0.000 claims description 15
- 239000000463 material Substances 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 11
- 238000012546 transfer Methods 0.000 claims description 9
- 238000003709 image segmentation Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 abstract description 24
- 238000010586 diagram Methods 0.000 description 19
- 238000013461 design Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 238000004064 recycling Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000006386 memory function Effects 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000003973 paint Substances 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Abstract
The invention relates to a real object projector with image auxiliary data searching and display functions and application method thereof. The method includes the following steps: a user interface is utilized to carry out image extraction on the image of object to be displayed, so as to generate a target image; a processor processes the target image, so as to generate target characteristic information, searching is carried out in database according to the target characteristic information, so as to generate a first searching result, corresponding auxiliary data of the first searching result and the image of object to be displayed are displayed, or the processor uploads the target image to the Internet, searching is carried out according to the target image by utilizing network searching engine in the Internet, so as to generate a second searching result, the processor downloads the corresponding auxiliary data of the second searching result, and the auxiliary data and the image of object to be displayed are displayed. The invention not only can effectively reduce brief report operation burden of speaker but also can cause the brief report process under instant condition to show more substantial and special display quality.
Description
Technical field
The present invention relates to a kind of the have projector of image auxiliary data searching and Presentation Function and the method that is applied thereon; Relate in particular to and a kind ofly can utilize an image recognition techniques, and can search and demonstrate simultaneously the object image that shows with the institute orthogonal projection on interior perhaps theme, the be mutually related a kind of projector and the application process thereof of auxiliary data automatically.
Background technology
In the time of in the occasion of general company's row number, office of school or symposial, will carrying out bulletin, meeting or speech; regular meeting uses a kind of teaching material prompting machine (Document Camera); title commonly used comprises bulletin video camera, digital pick-up camera for bulletin, object camera or projector etc.; being used for auxiliary speaker or announcer uses some written documents in kind or picture list data when explaining at needs, can use this class device to carry out instant material picture photography and explain orally with convenient with projection.Use projector can exempt the user and want earlier lecture notes, file or graphicly become the time-consuming of file and inconvenience with scanner scans one by one, the mode that also need not data to be utilized transparent transparency xerox with colour or black and white is earlier carried out bulletin; Not only can alleviate the burden of bulletin process, can also increase the diversity in its bulletin process.
General projector has the function of image photography, scanning and the image output of video camera or scanner, this part adopts and waits this type of to install employed camera module such as digital camera shadow machine, digital camera, monitoring camera, computer camera machine (PC camera), mostly this type of camera module is that it is main adopting CMOS (Complementary Metal Oxide Semiconductor) (CMOS) or the made image sensering device of charge-coupled device (CCD) at present, produces to carry out image sensing and signal.On using, projector energy and general single rifle or multiple gun projector interconnect, and play on the projection screen and demonstration and the image of being photographed can be rendered to via projector.In addition, projector also can output to image on the display of general televisor, computer system and show, and the instant playback (live video) that can reach image with watch.Simultaneously, except the file that can be the plane, also can be three-dimensional object as the material object of image projection.
Seeing also Fig. 1, is the operation synoptic diagram that 10 pairs one objects 1 to be shown of a portable projector carry out image projection.As shown in the figure, this portable projector 10 has a camera module 11 (its structure can comprise CCD or cmos image sensing apparatus), as long as will desiring the object to be shown 1 of projection, the user is positioned over before the camera module 11, just can export picture signal to a single rifle projector 12 via photography or scanning gained, and and then will show on image projection to a projection screen 14 with play, and can immediately watch the image of its object 1 to be shown.Fig. 2 then is the operation synoptic diagram that 20 pairs one objects 2 to be shown of a platform-type projector carry out image projection.The platform-type projector 20 of this figure more comprises a glove platform 201, can be used to put this object 2 to be shown.Also have a lighting module 211 in addition, the image that can provide suitable light source to replenish this object 2 to be shown so that its camera module 21 can clearer be photographed out, and will show on image projection to a projection screen 24 and play by a single rifle projector 22.
Along with the generally lifting of people for the projector usage degree, no matter on hardware or software, various application functions develop towards providing the user to have more convenient or improving on direction of its operation usefulness invariably at projector.For instance, to become the straighforward operation of wireless type to the operational design of projector and increase its operation maneuverability, or on device body, set up a small display screen curtain or monitor demonstrates the image content of the projection of wanting simultaneously, thereby can increase the degree of convenience that the speaker inspects its project content and bulletin process at the same time.In addition, projector also can design relevant expansion port or connecting interface, except that connecting with computer system and coming interaction to demonstrate the data of institute's access, also can be connected with associated storage apparatus, touch control screen or handwriting pad etc. to make function and expand.Furthermore, this type of projector can also be stored to the image of taking the photograph in the relevant external or built-in memory cell except projection in time.
Yet, just have and to store and to write down the image of institute's projection, the projector of functions such as picture or coherent reference data, though the speaker can by in its device in the external or built-in memory cell access go out associated picture, picture or data are assisted bulletin, but for numerous and jumbled from what stored, in a large amount of various docuterms or hunt out required object in the preset database, in the bulletin process of instantaneity, sizable inconvenience is arranged, and for the designed little figure of memory image file or scheme preview mode arranged side by side more and also have degree of difficulty in the retrieval.
Summary of the invention
The object of the present invention is to provide a kind of the have projector of image auxiliary data searching and Presentation Function and the method that is applied thereon; Make the speaker in the bulletin process, utilize this projector and application process thereof can search and demonstrate simultaneously the object image that shows with the institute orthogonal projection auxiliary data that on interior perhaps theme, is mutually related automatically, to increase the quality on the bulletin.
The present invention is a kind of image auxiliary data searching and display packing, be applied on the procedure for displaying of a projector to an object to be shown, this projector comprises a processor and user's interface, this processor also can carry out access in a database, and this method comprises the following step: utilize this user's interface that the image of this shown object to be shown is carried out image extraction operation and produces a target image; This target image is handled and produced a corresponding target characteristic information by this processor; And in this database, search according to this target characteristic information by this processor and to produce a search result, and the image of the pairing at least one auxiliary data of this search result and this object to be shown is exported demonstration so that comparison to be provided.
Another aspect of the present invention is a kind of image auxiliary data searching and display packing, be applied on the procedure for displaying of a projector to an object to be shown, this projector comprises a processor and user's interface, this processor also can link to an internet, and this method comprises the following step: utilize this user's interface that the image of this shown object to be shown is carried out image extraction operation and produces a target image; By this processor with this target image uploading to this internet; And utilize a Web search engine in this internet to search to produce a search result according to this target image, and by this processor with the pairing at least one assistance data download of this search result and and the image of this object to be shown export demonstration so that comparison to be provided.
Another aspect of the present invention is a kind of projector with image auxiliary data searching and Presentation Function, this projector includes: a camera module, in order to an object to be shown is photographed and produces an instant picture signal; One processor, signal is connected in this camera module, image that will this object to be shown in order to receive this instant picture signal is exported demonstration, and this processor is also finished signal with a memory cell and is connected, and can carry out access to a database of being set up in this memory cell; And user's interface, signal is connected in this processor, and image that will this object to be shown in order to carry out an image to extract operation produces into a target image; Wherein, this processor produces a corresponding target characteristic information in order to this target image is handled, and search in this database according to this target characteristic information and to produce a search result, and then the image of the pairing at least one auxiliary data of this search result and this object to be shown is exported demonstration so that comparison to be provided.
Another aspect of the present invention is a kind of projector with image auxiliary data searching and Presentation Function, this projector includes: a camera module, in order to an object to be shown is photographed and produces an instant picture signal; One processor, signal are connected in this camera module, and image that will this object to be shown in order to receive this instant picture signal is exported demonstration, and this processor also can link to an internet; And user's interface, signal is connected in this processor, and image that will this object to be shown in order to carry out an image to extract operation produces into a target image; Wherein, this processor in order to this target image uploading to this internet, and utilize a Web search engine in this internet to search to produce a search result according to this target image, and then with the pairing at least one assistance data download of this search result and and the image of this object to be shown export demonstration so that comparison to be provided.
In sum, application characteristic by known image recognition techniques, not only can effectively reduce speaker's bulletin homework burden with projector with image auxiliary data searching and Presentation Function proposed by the invention and the method that is applied thereon, also make this in the instant nature bulletin process to present and enrich more and special display quality.Therefore, the problem that the present invention can solve in the prior art to be proposed effectively, and successfully reached the fundamental purpose of the present invention's development.
Description of drawings
Fig. 1 carries out the operation synoptic diagram of image projection for 10 pairs of objects 1 to be shown of portable projector.
Fig. 2 carries out the operation synoptic diagram of image projection for 20 pairs of objects 2 to be shown of platform-type projector.
Fig. 3 (a), the application synoptic diagram of the projector 30 that is proposed in first embodiment for notion according to the present invention.
Fig. 3 (b) is the function block diagram of projector 30.
Fig. 4 is for the user's interface 32 with hand-written sensing module carries out the synoptic diagram that image extracts operation.
Fig. 5 is the demonstration synoptic diagram of search result B1 and target image A 1.
Fig. 6 is the process flow diagram of first embodiment.
Fig. 7, the synoptic diagram that carries out character calligraph and image extraction operation for user's interface 32 with hand-written sensing module.
Fig. 8 (a), the application synoptic diagram of the projector 300 that is proposed in second embodiment for notion according to the present invention.
Fig. 8 (b) is the function block diagram of projector 300.
Description of reference numerals in the above-mentioned accompanying drawing is as follows:
The single rifle of camera module 11,21,35 projector 12,22
Glove platform 201,301 lighting modules 211
Projector 30,300 processors 31
User's interface 32 handwriting pads 321
Pressure-sensitive pen 322 assembling interfaces 33
Target image A 1, A2 search result B1
Embodiment
Embodiment proposed by the invention, to can move a kind of image auxiliary data searching and the Presentation Function that can hunt out the data relevant automatically by an image recognition techniques, and have the projector of this function and the method that is applied thereon with its bulletin process.In addition, wherein main image recognition techniques or its principle, the pattern transfer of adopting with after can carrying out distinguishing of its element or its theme or even comply with aforesaid distinguishing for the content that image was had is at present become literal, and the corresponding informance that obtains its characteristics of image is to use as the comparison of further associate content, the identification technique of search; Make the projection display applications of projector can search speed and conveniencely these data do auxiliary with relatively, and the process that can enrich bulletin.
See also Fig. 3 (a), the application synoptic diagram of a projector 30 that is proposed in one first embodiment for notion according to the present invention.As shown in the figure, this projector 30 includes a glove platform 301 that can be used to put an object 3 to be shown, and also includes the camera module 35 that can photograph to this object 3 to be shown.Identical with application described in the prior art, camera module 35 can be exported demonstration with the instant image of taking the photograph, and can carry out the Projection Display of image equally by the combination (not being shown in this figure) of a single rifle or a multiple gun projector and a projection screen.And as shown in this figure, to carry out the Projection Display explanation of instant image with a display 40 that its projector 30 is connected as signal; The speaker can adjust the storing state of object 3 to be shown to carry out bulletin by the display result that supervises on this display 40.
In addition, this projector 30 also includes user's interface 32.In this embodiment, a memory cell 34 is finished assembling with the external mode and the body of this projector 30 and is connected with signal.User's interface 32 wherein then is the main operating unit of this projector 30, can be a mouse, a keyboard, a hand-written sensing module or a telepilot; And with regard to present technology, the display image of institute's projection output, except the instant image of its object 3 to be shown, also can include the function of being finished with the program design mode of figure and choose graphic interface, can provide the speaker to utilize to wait and choose moving out of corresponding function, and its result is shown such as above-mentioned mouse, keyboard, hand-written sensing module or telepilot.And with regard to other embodiment, described user's interface also can be the function button group on the body that is set directly at projector with hardware mode, or small screen, the touch control screen set up for projector, and described user's interface can be finished in touch controllable function.
The memory cell 34 of this embodiment then can be devices such as the portable hard drive, storage card, flash disk of general plug and play, can be installed on the projector 30 and the function that can finish the usefulness that is used for data storage, record, retrieval expands.Seeing also Fig. 3 (b), is the function block diagram of the projector 30 of first embodiment; As shown in the figure, these projector 30 inside also include a processor 31, and camera module 35, user's interface 32 etc. then signal are connected on this processor 31; In addition, after making an assembling interface 33 that 34 energy of this memory cell that memory function expands are connected in processor 31 via signal and does thereon to install in external mode, and can finish and processor 31 between the signal connection.With regard to actual motion, the instant picture signal that camera module 35 is taken the photograph needs to become digital format could supply its processor 31 to do to receive, handle via analog-converted, and processor 31 also need be made the format conversion that digital revolving die is intended after handling, and is just exportablely carried out image and is shown by its display 40 or described single rifle, multiple gun projector.In addition, projector 30 also comprises an image buffer memory (frame buffer) 36, in order in the image output of finishing processing, the image that export demonstration is carried out the data of picture and inserts.
And present embodiment is when bringing into operation its image auxiliary data searching and Presentation Function, carries out an image at the instant image of its object 3 to be shown earlier and extracts operation; Certainly also can be directly the instant image of object 3 to be shown be directly carried out image auxiliary data searching and Presentation Function, just do not carry out this image and extract operation, and directly the instant image taken the photograph of utilization carries out data search.But, just may more not have significantly thematic and can increase comparison degree of difficulty in the search as the content of the instant image of data search if instant image extracts operation through its image; Yet, if more uncomplicated or when not existing in the content of its instant image, can not carry out the step that this image extraction operates processings in and do the data search such as background or corresponding on every side object.Wherein do not carry out and have carrying out its image and extracting operation described data search mode down, can be identical, detailed mode as after explanation.
And described image extracts to operate in and implements and can carry out by the technology of method for displaying image; This technology part is disclosed by " method for displaying image of projector " of national patent publication No. 200840354; Can adopt as in its prospectus in the corresponding embodiment of Figure 1A to Fig. 1 of its accompanying drawing D, and go up generation one bounding box in operation, and the instant image of superimposed bounding box and object to be shown 3, with the instant image segmentation with object 3 to be shown is to emphasize a zone and a non-zone of emphasizing, and covers the non-zone of emphasizing and emphasize that to demonstrate the zone is the required scope that image extracts operation.Or utilize this user's interface 32 (can be mouse, keyboard, hand-written sensing module or telepilot) image of shown object to be shown 3 to be carried out the frame choosing of part indication range.
With hand-written sensing module is example, can include a pressure-sensitive pen 322 and a handwriting pad 321 (seeing also Fig. 4), pressure-sensitive pen 322 can be painted on handwriting pad 321 and writes to press mode, and and then the paint track of writing done image output, thereby can finish the frame choosing that its image extracts the required scope of operation; Display result as shown in Figure 4.The photography signal of object 3 to be shown in Fig. 3 (a) can demonstrate image in a big way on display 40, but wherein may include such as part background or other and the irrelevant object on every side of theme; Therefore, a target image A 1 can be extracted just extract the mode of operating in former image in a big way, shown in the dotted line scope among Fig. 4 by image.
And practice in other user's interfaces 32 with unit such as mouse, keyboard or telepilots, then also can finish similar frame choosing action; For example click towing, or finish with the correlation function key of keyboard, telepilot and the combination mode of pushing of directionkeys with mouse.And after extracting this target image A 1, its processor 31 just can further receive its target image A 1 to deal with.In this embodiment, in this memory cell 34, set up a database 341, stored pre-prepd file in this database 341 by the speaker, and the preview that can in the bulletin process, show to the file of being stored, for example in little figure described in the prior art or scheme preview mode arranged side by side, and utilize this user's interface 32 to choose again and Projection Display in addition more.And in the operation of the image auxiliary data searching and the Presentation Function of present embodiment, be that this target image A 1 with object 3 to be shown serves as according to the file of being stored in this database 341 is searched.
From the above, the described processing that this target image A 1 is carried out, the image identification of color, shape or the ratio that distributes for the content that this target image A 1 is had, and then produce a target characteristic information of corresponding its target image A 1.Specifically, by analyzing the color-values that it constitutes each pixel of level in picture and vertical dimensions, thereby can learn the versicolor distribution scenario on the diverse location in entire scope, shape of just analyzing its content and being presented and shared ratio; These information are via this target characteristic information that is produced behind the image identification.Furthermore, when this identification being handled when designing in its processor 31 with program mode (PM), can recognize effectively its target image A 1 associated to or the theme of representative why.For instance, target image A 1 shown in Fig. 4 is being represented the theme of an apple, and its target characteristic information is a red colour system for the color-values of pixel in its indication range just, and it is adjacent one another are and can constitute a spherical or oval-shaped pattern on global shape to meet all pixels of this condition.
Therefore, the search of being carried out in present embodiment except that analyzing as the above-mentioned target image A 1 to this object 3 to be shown, also needs carry out identical identification to the All Files that is stored in the database 341.The i.e. image identification of color, shape or the ratio that then picture material that these files had is distributed by processor 31, and and then different files can be produced each corresponding supplemental characteristic information; In other words, the supplemental characteristic information of each file just representing its file content associated to or the theme of representative.Secondly, again will previous target characteristic information by processor 31 and each corresponding supplemental characteristic information compare one by one, to compare its associated each other arriving or the matching degree of representative theme.Designed in this embodiment meet definition, can be its target characteristic information and supplemental characteristic information and on a certain preset threshold value, be rendered as when close, can judge that just both meet for comparison or have a relevance its in the shared scope of a certain colour system, ratio or the shape that presented.In addition, also can adopt other such as the comparison of fingerprint comparison, the types of facial makeup in Beijing operas or retina than the more accurate image identification application technology of equity, the identification that comes at length to carry out its matching degree according to the lines distribution scenario of picture material.
From the above, processor 31 just can be rendered as the document retrieval that meets with its comparison with regard to its situation of searching one by one and comparing and go out, and produce a search result B1, with the comparison that provides the speaker to show in the image of this object 3 to be shown that wherein selects required auxiliary data and be associated.See also Fig. 5, or simultaneously and the image of this object 3 to be shown or the synoptic diagram that target image A 1 wherein shows from the auxiliary data of wherein selected taking-up for this search result B1; As shown in the drawing, in this embodiment, when the speaker in the search of carrying out auxiliary data when further showing, can design a part with the picture scope of display 40, left side for example is as the usefulness of the demonstration of this search result B1.Perhaps in other display mode, also can utilize the operation of its user's interface 32 and only all present earlier this search result B1.
Because hunting out the file that is associated from database 341 may be a lot, therefore the mode of available arrangement is shown the mode of each file among this search result B1 with contract drawing in design, maybe can design by a page spool to present more file with the side that scrolling shows.Furthermore, the speaker also can utilize this user's interface 32 to select required arbitrary file again in this search result B1 to show, makes the auxiliary data of in the bulletin process resulting correspondence to come and the image of this object 3 to be shown is made comparisons with bigger indication range.And by insert the variation of mode for the data of described image buffer memory 36, the mode of its demonstration also can be done corresponding adjustment, promptly except the demonstration arranged side by side of as shown in Figure 5 auxiliary data and target image A 1, can also be with the display mode of PIP with the indication range of identical or different size, overlap or nonoverlapping display position, make Projection Display with one simultaneously to the image of a plurality of files and the image of this object 3 to be shown.
By the explanation of above-mentioned first embodiment as can be known, the image that the speaker carried out extracts operation can provide preferable identification condition for its image recognition techniques, and, make projector 30 interior processors 31 also can finish the processing of this image recognition techniques by the program design on software or the firmware aspect.Simultaneously, by automatic search under the image recognition techniques and comparison effect, allow the speaker in the bulletin process of instantaneity, also will seek required auxiliary data time-consuming and inexpediently; When projector 30 moves out of this image auxiliary data searching and Presentation Function, resulting search result B1 just can with the object to be shown 3 of instant photography significantly related in producing on its content or on the theme, the auxiliary data that makes the speaker to obtain being fit to compares simultaneously.
Seeing also Fig. 6, is the process flow diagram of first embodiment.At first, by objects 3 photographies to be shown of 35 pairs of camera modules and and then show the image (step S1) of object 3 to be shown; Secondly, utilize the image of 32 pairs of objects 3 to be shown of user's interface to carry out image extraction operation and produce a target image A 1 (step S2); Then, the image identification of color, shape or ratio that the content that is had by 31 pairs of target image A 1 of processor distributes, and then the corresponding target characteristic information of generation, and the image identification of processor 31 and the color, shape or the ratio that also the picture material that file had in the database 341 are distributed, and then produce corresponding supplemental characteristic information (step S3); Then, by processor 31 (step S4) searched, compared to target characteristic information and each corresponding supplemental characteristic information; When the comparison in step S5 is rendered as when meeting, corresponding file is produced into a search result B1, and provide wherein that choosing with the image with object 3 to be shown of at least one auxiliary data shows side by side with make comparisons (step S6); And when comparing when meeting file for nothing, the image that then continues original object to be shown 3 shows (step S7).
On the other hand, above-mentioned first embodiment also can do suitable variation and can use under other condition.For instance, described memory cell 34 also can be the built-in unit that directly is arranged in its projector 30 except can be the expansion storage unit that is external in its projector 30; By its built-in storage space that memory cell had, just can be by the speaker in wherein setting up the file that the auxiliary bulletin of required database and storage is used.Perhaps, the projector 30 that the present invention carried can have line function, for example via the line of a Local Area Network can and long-range memory cell, the devices such as network disk, server or other computer systems that promptly are arranged on this Local Area Network carry out line, and required database just builds in the memory cell of this class; And the signal that the processor in the applied projector just can be finished on the data access with its memory cell via line is connected.
Perhaps, the object of desiring to compare among first embodiment 3 described to be shown also can need not to be the storing material object of instant image photography that its camera module 35 carries out, and can be arbitrary file of speaker's selected taking-up in its database 341.And the bulletin process of being carried out in this way, can earlier carry out preview (for example contract drawing preview) and desired the main profile object that shows to select by the speaker, and utilize this user's interface 32 to be chosen and become the object to be shown that will carry out projection being stored in each file in the database 341.In other words, the speaker can choose, show and carry out described image and extract operation the file in the database 341, come again and database 341 in alternative document make same image identification and handle, search and compare, and produce required auxiliary data.
Again on the other hand, it is whether patterns with image has search and the comparison that is consistent in database 341 that the image identification that carried out among first embodiment is handled; Yet present image recognition techniques also can be according to the pattern content that is analyzed, and for example image or character image further convert the Word message that can supply digital processing, editor to, and just pattern transfer is the image recognition techniques of literal.Same, also can carry out the processing of this mode by the target image of 31 pairs of gained of processor of the present invention.See also Fig. 7, carry out the synoptic diagram of character calligraph and its image extraction operation for user's interface 32 with hand-written sensing module.As shown in the figure, extract under the operation at image, the target image A of selecting as institute's frame in the dotted line 2 is a kind of image of word content, and processor 31 can carry out the image identification of pattern transfer literal according to the content that this situation is had this target image A 2, and then produces this corresponding target characteristic information; For instance, these target image A 2 direct identifications shown in Fig. 7 are become literal " apple ".
The image identification of the described pattern transfer literal of brought forward.Because the file that is stored in this database 341 has relevant written record, for example different file names, file content explanation or summary etc., thereby can be designed to supplemental characteristic information accordingly.Therefore, processor 31 can will be compared with each supplemental characteristic information of mode word record in the file in the target characteristic information of literal and its database 341, and and then comparison is rendered as the file that meets produces into described search result.And wherein, the situation of comparing to meeting can be, and has the written record of its " apple " in the supplemental characteristic information of correspondence.And on display mode, also its search result can be provided the speaker to do choosing of required auxiliary data, and the demonstration arranged side by side on making comparisons with the image of object 3 to be shown again.
See also Fig. 8 (a), the application synoptic diagram of a projector 300 that is proposed in one second embodiment for notion according to the present invention; Fig. 8 (b) then is the function block diagram of the projector 300 of its second embodiment.Projector 300 in this second embodiment and the projector 30 among first embodiment have similar hardware construction, and this example is characterised in that projector 300 also can link to an internet 50; Specifically, be connected as signal with this internet 50 by wherein processor 31 and can finish each other line, make the browse operation that the speaker can utilize its user's interface 32 to carry out this internet 50.And the flow process of this second embodiment is also similar with first embodiment, and demonstration is also exported in the photography that promptly at first utilizes 35 pairs of objects 3 to be shown of its camera module to carry out instant image; And in the bulletin process, image extracts operation can to utilize the image of 32 pairs of shown objects to be shown 3 of its user's interface to carry out as described in the first embodiment by the speaker, and can do the frame choosing and become a target image A 1 (identical with Fig. 4 of first embodiment) the part indication range.
From the above, in this embodiment, by processor 31 this target image A 1 is uploaded on the internet 50 and searches according to this target image A 1 by the Web search engine in the internet 50.Specifically, present relevant entry network site all possesses the function that retrieve data is arranged, and the website that has is except retrieving and the lteral data or pattern data that can obtain being associated, also having designed has in the mode of uploading the appointed pattern file and can carry out the retrieval of related pattern by interior perhaps its theme of pattern with the literal input mode of keying in special key words.Its operation logic is to utilize image recognition techniques and can earlier the pattern of uploading be analyzed, thereby in the network data base (NetworkData Base) that can be set up in its website the file of being stored is searched, compared.
From the above, in this embodiment, be this target image A 1 to be carried out the described image recognition techniques as first embodiment by the Web search engine of internet 50 is first.The image identification of the color, shape or the ratio that distribute of the content that its target image A 1 is had by the Web search engine just, and produce a corresponding target characteristic information; And Web search engine and the file to being stored in the associated network data base in this internet 50 simultaneously also, the image identification of the color that the picture material that it had distributes, shape or ratio, and produce corresponding supplemental characteristic information.Then, the Web search engine is just searched its target characteristic information and each corresponding supplemental characteristic information, compare, and then comparison is rendered as the processor 31 that search result line to provide is provided into the file that meets again and downloads to carry out preview.Speaker thereby energy be chosen auxiliary data required in this search result again, be downloaded to make the Projection Display of bulletin, compare with the image with object 3 to be shown.Wherein about then can be as shown in Figure 5 to the demonstration of search result and therefrom selected taking-up auxiliary data, and can do with first embodiment in relevant identical variation.
This second embodiment utilizes the Web search engine to search, make the process of searching or comparing need not to be undertaken by this processor 31, processor 31 can only design in order to finishing uploading of its target image A 1, and in order to the search result that receives and the download network Search engine is finished.Therefore, this second embodiment also can do suitably to change and can use under other conditions; And this part can be with reference to above-mentioned variation explanation for first embodiment.For example, the Web search engine can make to supply the image identification of digital processing, editor's pattern transfer literal according to the pattern content of its target image A 2 of analyze, and that the target image A 2 of its word content can be as first embodiment is shown in Figure 7.
Therefore, the Web search engine can be produced corresponding target characteristic information with this identification, directly with key word to being stored in the file in the internet 50 supplemental characteristic information with the correspondence of mode word record, file, Website page that for example has same keyword etc. compared, and makes the data search of literal association.Thereby with regard to the file of its comparison for meeting, this processor 31 just can be downloaded the demonstration as its auxiliary data.In other words, search result just can comprise the network data of doing storage with mode word, and the recycling user's interface 32 of speaker carries out the hyperlink unlatching and browses.On the other hand, for each file in the search result of being downloaded, the speaker also can therefrom select one to a plurality of files with auxiliary data as the bulletin process, and the mode that can show with demonstration arranged side by side or PIP and the image of object to be shown 3 compare.
Perhaps, first embodiment can do combination with second embodiment.Just when processor in the built-in or external memory cell of projector or the remote memory cells that can be wired to via its Local Area Network again, the file that its database is stored do to search all do not have after the comparison meet as a result the time, the also recycling mode that links to the internet of its processor is carried out the search of the same terms by its Web search engine again.So, make that the search result that can produce and required auxiliary data just can be detailed more and enrich.Again further, also can design when projector of the present invention in aforesaid each embodiment or when changing the search result of all failing down to produce or obtain suitably meeting, again further with the image of the object to be shown of correspondence or target image wherein, the storage of in the database of relevant memory cell, filing, and can on the file of being set up, add relevant Word messages such as title, explanation or summary, so that being provided, the search on the following bulletin uses.
In sum, application characteristic by known image recognition techniques, with projector with image auxiliary data searching and Presentation Function proposed by the invention and the method that is applied thereon, just can provide the speaker in the bulletin process when carrying out the Projection Display of a certain theme or specific image content, can from the data designated storehouse, hunt out automatically speed and conveniencely associated auxiliary data comparing, and need not time-consumingly in numerous and jumbled, a large amount of various files stored or database, to do from line search; Or search browsed in the input key word of also will surfing the Net separately.The speaker only needs to extract operation in the simple image of desire to carry out to carry out on the related image of searching, and just can obtain helping the auxiliary data of comparison immediately according to setting the operation of program.So, not only can effectively reduce speaker's bulletin homework burden, also make this in the instant nature bulletin process to present and enrich more and special display quality.Therefore, the problem that the present invention can solve in the prior art to be proposed effectively, and successfully reached the fundamental purpose of the present invention's development.
Any those of ordinary skills can be under utilization and the prerequisite of the identical purpose of the present invention, the basis of using disclosed notion and embodiment variation to be used as designing and improving some other method.These change, substitute and improve and can not deviate from protection scope of the present invention that claim defines.Therefore, the present invention must be appointed by those of ordinary skills and executes that the craftsman thinks and be to modify as all, does not take off the scope as the desire protection of attached claim institute.
Claims (18)
1. image auxiliary data searching and display packing, be applied on the procedure for displaying of a projector to an object to be shown, this projector comprises a processor and user's interface, and this processor also can carry out access in a database, and this method comprises the following step:
Utilize this user's interface that the image of this shown object to be shown is carried out image extraction operation and produces a target image;
This target image is handled and produced a corresponding target characteristic information by this processor; And
In this database, search according to this target characteristic information by this processor and to produce a search result, and the image of the pairing at least one auxiliary data of this search result and this object to be shown is exported demonstration so that comparison to be provided.
2. image auxiliary data searching as claimed in claim 1 and display packing, wherein this projector comprises a camera module, and this method comprises the following step: by this camera module this object to be shown is photographed, and then image that will this object to be shown shows that the image of this wherein shown object to be shown is instant image.
3. image auxiliary data searching as claimed in claim 1 and display packing, wherein this object to be shown is the file that is stored in this database, and this method comprises the following step: the file that will be stored in this database carries out preview, and utilize this user's interface to select this object to be shown, and then image that will this object to be shown shows.
4. image auxiliary data searching as claimed in claim 1 and display packing, wherein this processor processing that this target image is carried out, the image identification of color, shape or the ratio that distributes for the content that this target image is had, and then produce this corresponding target characteristic information; And this method comprises the following step:
The image identification of color, shape or the ratio that the picture material that file had that is stored in this database is distributed by this processor, and then produce corresponding supplemental characteristic information; And
By this processor this target characteristic information and corresponding supplemental characteristic information are compared, and comparison is rendered as the file that meets produces into this search result.
5. image auxiliary data searching as claimed in claim 1 and display packing, wherein this processor processing that this target image is carried out, for the content that this target image is had is carried out the image identification of pattern transfer literal, and then produce this corresponding target characteristic information; And this method comprises the following step:, and comparison is rendered as the file that meets produces into this search result with this target characteristic information be stored in the file in this database with the supplemental characteristic information of the correspondence of mode word record and compare by this processor.
6. image auxiliary data searching as claimed in claim 1 and display packing, wherein this method comprises the following step: utilize this user's interface to choose at least one file in this search result and become corresponding auxiliary data, and then the auxiliary data of correspondence and the image of this object to be shown are shown.
7. image auxiliary data searching as claimed in claim 1 and display packing, wherein this image extracts and is operating as the frame choosing of this user's interface of imagery exploitation of this shown object to be shown being carried out the part indication range, and becomes this target image.
8. image auxiliary data searching as claimed in claim 1 and display packing, wherein this image extracts to operate and comprises the following step:
Produce a bounding box; And
The image of superimposed this bounding box and this object to be shown is to emphasize a zone and a non-zone of emphasizing with image segmentation that will this object to be shown, and covers this non-emphasizing and regionally emphasize the zone to demonstrate this.
9. image auxiliary data searching and display packing, be applied on the procedure for displaying of a projector to an object to be shown, this projector comprises a processor and user's interface, and this processor also can link to an internet, and this method comprises the following step:
Utilize this user's interface that the image of this shown object to be shown is carried out image extraction operation and produces a target image;
By this processor with this target image uploading to this internet; And
Utilize a Web search engine in this internet to search and produce a search result according to this target image, and by this processor with the pairing at least one assistance data download of this search result and and the image of this object to be shown export demonstration so that comparison to be provided.
10. image auxiliary data searching as claimed in claim 9 and display packing, wherein this method comprises the following step:
The image identification of color, shape or ratio that the content that this target image is had by this Web search engine distributes, and then produce a corresponding target characteristic information;
The image identification of color, shape or the ratio that the picture material that file had that is stored in this internet is distributed by this Web search engine, and then produce corresponding supplemental characteristic information; And
By this Web search engine this target characteristic information and corresponding supplemental characteristic information are compared, and comparison is rendered as the file that meets produces into this search result.
11. image auxiliary data searching as claimed in claim 9 and display packing, wherein this method comprises the following step:
Carry out the image identification of pattern transfer literal by the content that this Web search engine is had this target image, and then produce a corresponding target characteristic information; And
, and comparison is rendered as the file that meets produces into this search result with this target characteristic information be stored in the file in this internet with the supplemental characteristic information of the correspondence of mode word record and compare by this Web search engine.
12. image auxiliary data searching as claimed in claim 9 and display packing, wherein this image extracts to operate and comprises the following step:
Produce a bounding box; And
The image of superimposed this bounding box and this object to be shown is to emphasize a zone and a non-zone of emphasizing with image segmentation that will this object to be shown, and covers this non-emphasizing and regionally emphasize the zone to demonstrate this.
13. the projector with image auxiliary data searching and Presentation Function, this projector includes:
One camera module is in order to photograph to an object to be shown and to produce an instant picture signal;
One processor, signal is connected in this camera module, image that will this object to be shown in order to receive this instant picture signal is exported demonstration, and this processor is also finished signal with a memory cell and is connected, and can carry out access to a database of being set up in this memory cell; And
One user's interface, signal is connected in this processor, and image that will this object to be shown in order to carry out an image to extract operation produces into a target image;
Wherein, this processor produces a corresponding target characteristic information in order to this target image is handled, and search in this database according to this target characteristic information and to produce a search result, and then the image of the pairing at least one auxiliary data of this search result and this object to be shown is exported demonstration so that comparison to be provided.
14. projector as claimed in claim 13, wherein this processor processing that this target image is carried out, the image identification of color, shape or the ratio that distributes for the content that this target image is had, and then produce this corresponding target characteristic information; And the search of this processor in this database, image identification for color, shape or ratio that the picture material that file had that is stored in this database is distributed, and then the corresponding supplemental characteristic information of generation, and this target characteristic information and corresponding supplemental characteristic information compared, and comparison is rendered as the file that meets produces into this search result.
15. projector as claimed in claim 13, wherein this processor processing that this target image is carried out for the content that this target image is had is carried out the image identification of pattern transfer literal, and then produces this corresponding target characteristic information; And the search of this processor in this database for this target characteristic information be stored in the file in this database with the supplemental characteristic information of the correspondence of mode word record and compare, and is rendered as the file that meets with comparison and produces into this search result.
16. projector as claimed in claim 13, wherein this user's interface is a mouse, a keyboard, a hand-written sensing module or a telepilot, and this image extracts the frame choosing that this mouse of imagery exploitation, this keyboard, this hand-written sensing module or this telepilot that are operating as this shown object to be shown carry out the part indication range, and becomes this target image.
17. the projector with image auxiliary data searching and Presentation Function, this projector includes:
One camera module is in order to photograph to an object to be shown and to produce an instant picture signal;
One processor, signal are connected in this camera module, and image that will this object to be shown in order to receive this instant picture signal is exported demonstration, and this processor also can link to an internet; And
One user's interface, signal is connected in this processor, and image that will this object to be shown in order to carry out an image to extract operation produces into a target image;
Wherein, this processor in order to this target image uploading to this internet, and utilize a Web search engine in this internet to search to produce a search result according to this target image, and then with the pairing at least one assistance data download of this search result and and the image of this object to be shown export demonstration so that comparison to be provided.
18. projector as claimed in claim 17, the wherein search carried out of this Web search engine, for to this target image be stored in the image identification and the comparison of color, shape or ratio that the picture material that file had in this internet distributes, and comparison is rendered as the file that meets produces into this search result; Or carry out the image identification of pattern transfer literal for the content that this target image is had, with and then and the written record that file was had that is stored in this internet compare, and comparison be rendered as the file that meets produce into this search result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101293834A CN101887207B (en) | 2010-03-08 | 2010-03-08 | Real object projector with image auxiliary data searching and display functions and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101293834A CN101887207B (en) | 2010-03-08 | 2010-03-08 | Real object projector with image auxiliary data searching and display functions and method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101887207A CN101887207A (en) | 2010-11-17 |
| CN101887207B true CN101887207B (en) | 2011-12-28 |
Family
ID=43073178
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010101293834A Expired - Fee Related CN101887207B (en) | 2010-03-08 | 2010-03-08 | Real object projector with image auxiliary data searching and display functions and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101887207B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104320602A (en) * | 2014-11-14 | 2015-01-28 | 深圳市遥蓝儿童科技有限公司 | Projector and method for playing audio and video file by identifying picture |
| CN104469446A (en) * | 2014-12-12 | 2015-03-25 | 深圳市遥蓝儿童科技有限公司 | Multi-media equipment and method for playing video and audio files through recognizing colors |
| TWI653563B (en) | 2016-05-24 | 2019-03-11 | 仁寶電腦工業股份有限公司 | Projection touch image selection method |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004118488A (en) * | 2002-09-26 | 2004-04-15 | Minolta Co Ltd | Network device |
| CN100460989C (en) * | 2005-03-21 | 2009-02-11 | 捷扬光电股份有限公司 | Object boundary fitting method and system for digital data prompter |
| CN101169579B (en) * | 2007-10-30 | 2010-08-25 | 圆展科技股份有限公司 | Projector and method for making its partial image profile clear |
-
2010
- 2010-03-08 CN CN2010101293834A patent/CN101887207B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN101887207A (en) | 2010-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8892990B2 (en) | Automatic creation of a table and query tools | |
| JP5170961B2 (en) | Image processing system, image processing apparatus and method, program, and recording medium | |
| US20110099493A1 (en) | Image auxiliary data searching and displaying method and document camera using such method | |
| CN106560809A (en) | Modifying At Least One Attribute Of Image With At Least One Attribute Extracted From Another Image | |
| Obeso et al. | Architectural style classification of Mexican historical buildings using deep convolutional neural networks and sparse features | |
| JP2017187850A (en) | Image processing system, information processing device, and program | |
| CN106560810A (en) | Searching By Using Specific Attributes Found In Images | |
| CN101751404A (en) | Classification method of multimedia files | |
| CN113766296B (en) | Live broadcast picture display method and device | |
| Ding et al. | Prior knowledge-based deep learning method for indoor object recognition and application | |
| Truong et al. | Marine video kit: a new marine video dataset for content-based analysis and retrieval | |
| CN111046197A (en) | Searching method and device | |
| CN101887207B (en) | Real object projector with image auxiliary data searching and display functions and method thereof | |
| US20220217283A1 (en) | Imaging apparatus | |
| Wu et al. | Independent metric learning with aligned multi-part features for video-based person re-identification | |
| CN108268634A (en) | It takes pictures and searching method, smart pen, search terminal and storage medium | |
| WO2010071617A1 (en) | Method and apparatus for performing image processing | |
| Arnold et al. | Distant Viewing: Computational Exploration of Digital Images | |
| Chen et al. | Image based information access for mobile phones | |
| CN109697242B (en) | Photographing question searching method and device, storage medium and computing equipment | |
| JP6109118B2 (en) | Image processing apparatus and method, information processing apparatus and method, and program | |
| Blat et al. | Big data analysis for media production | |
| KR20150096552A (en) | System and method for providing online photo gallery service by using photo album or photo frame | |
| CN110362703B (en) | Picture arranging method and system | |
| CN104917953A (en) | Photo group generation and operation method and device using same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20111228 Termination date: 20160308 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |