CN102308276A

CN102308276A - Displaying objects with certain visual effects

Info

Publication number: CN102308276A
Application number: CN2009801560756A
Authority: CN
Inventors: 宣江
Original assignee: Individual
Current assignee: Individual
Priority date: 2008-12-03
Filing date: 2009-12-03
Publication date: 2012-01-04
Anticipated expiration: 2029-12-03
Also published as: US20100134594A1; WO2010064148A1; CN102308276B; US9094632B2; WO2010064148A9

Abstract

Embodiments of the Invention provide methods, systems, and articles for displaying objects in images, videos, or a series of images with WYSIWYG (what you see is what you get) effects, for calibrating and storing dimensional information of the display elements in a display system, and for constructing 3-dimensional features and size measurement information using one camera. Displaying merchandises with WYSIWYG effects allows online retailers to post vivid pictures of their sales items on the internet to attract online customers. The processes of calibrating a display system and the processes of constructing 3 -dimensional features and size measurement information using one camera are applications of the invention designed to achieve desired WYSIWYG effects.

Description

Utilize some visual effect to come display object

The right of priority protection

This application requires to protect that on Dec 3rd, 2008 submitted to and has application number 61; 119,714 title is the U.S. Provisional Application No. of " Method to Measure and Demonstrate Real Size of Objects on Computer Displays and Cell Phone Screens (actual size of measuring object also shows the method for the actual size of object on graphoscope and mobile phone screen) ".

Background technology

A lot of retailers come to advertise to their commodity through issue photo and video on internet website.The consumer can be from their computing machine browse displays at the items for merchandising of these websites, and can utilize button click come through internet purchases any they want.Although more more convenient, has defective really through internet purchases than shopping in the shop.Because the consumer can not be from physically checking items for merchandising, so she is unlikely through watching photo and video to experience the unique products design of items for merchandising or feeling its size.Careful consumer possibly need those more persuasions that can provide according to sheet and video.When the consumer who falls through recognize commodity through internet purchases be not the size of expectation or in actual life it seem with the website on that kind that illustrates very not simultaneously, he can return that part commodity.Used diverse ways to allow the Internet user to feel the characteristic of actual size or other of items for merchandising.Fig. 1 a shows an example in these methods.

In Fig. 1 a, photo 102 shows the image of putting a digital camera 108 on a people's the hand 104.Through showing in the palm of hand 104 that digital camera 108 can be placed on the people suitably, how little photo 102 has transmitted digital camera 108 to the beholder is.Often also use other and compare the general sensation that (for example using the people who stands) transmitted real object.It is much or how little truly that the beholder can aware article, but but can not estimate it exactly, because the size of people's hand or people's height changes also very greatly.Sometimes the reference object (for example ruler) and the article of a standard are taken together.Though the beholder can be through reading the measurement result accurately of this object with reference to ruler, this method with do not have what difference with the digital ground mark objects of its how much dimensions.

The items for merchandising that the advantage of in the shop, doing shopping is to allow the consumer to contact and feels showing.But it also has its oneself defective.For consumers, be difficult to find the product purchase of in the shop, showing be suitable for later in the family effect how.For example, before the consumer want to buy a piece of furniture to her family, she can want to confirm that this part furniture is suitable for her home environment.Fig. 1 b illustrates this problem that she possibly face.In Fig. 1 b, home environment 152 comprises sofa 154 and chair 160.This consumer wants to buy a coffee table 158, and this coffee table 158 not only will be suitable for the space between sofa 154 and the chair 160, but also will be complementary with present interior decoration.Usually, before going shopping, the consumer can measure and write the size of this corner space.After the shop, she can compare the measurement of coffee table 158 and the content that she has write at her.For other requirement, she can only rely on her memory to confirm the color and style coupling of the color and style and the sofa 154 and the chair 160 of coffee table 158.

Just enjoy the viewing experience in the shop when need allow the consumer before being sitting in computing machine with the method for novelty, can make when perhaps in the shop, doing shopping she with on her home environment.

Summary of the invention

In general, disclose and utilize What You See Is What You Get (WYSIWYG) effect of expectation that object is presented at the method in image, video or a series of images.One of them of WYSIWYG effect is to make the size of object in this image or this video equal or be approximately equal to its actual size.Utilization comprises the display system of one or more display element or display unit, and such method can comprise the steps.The first, for each how much dimension, derive the size of the display element of this display system, and calculate this object to expect the number of the display element that size strides across.The second, for each how much dimension,, come to expect that size presents two-dimensional object through the size of readjusting this image, this video or this image series equably based on the number of display element.This method can be used for showing two-dimensional object, the perhaps two dimensional character of three dimensional object.This method also can be used for showing a plurality of objects and to expect one of them of a plurality of objects that size is fit to.These methods are particularly useful to online retailer, because online retailer wants to show an items for merchandising with specific size (for example its size) really, so that allow online shopper to experience certain characteristic of these article, for example Jin Cou design.For example, items for merchandising possibly be a digital camera, and shows that with its actual size how compact the design that this digital camera allows online shopper to experience this camera is.

In an implementation of these methods, display system is to be derived divided by the resolution on this geometry dimension by the length with this display system along the size of each display element of a particular geometric dimension.

The size of display element also can be confirmed through user's calibration process.User's calibration process of one type comprises following step.The first, require the user to import the diagonal line size of display system.Then, present known two-dimensional object through user's input with its actual size and verify this user's input based on the diagonal line of this system size.If the user imports incorrect, then appearing of this well-known object will not match with the object of reality.

User's calibration process of another kind of type comprises that the user will be through being placed on the display system profile of this well-known object of establishment on this display system for a calibration point of each geometric point of well-known object.Then to such user's calibration process and the computer applied algorithm implemented is measured the size of this profile, and the number of the display element of confirming to be filled for each how much these profile of dimension.This application program is through calculating the size of this display element divided by the number for the display element of this geometry dimension with the size of this profile.

User's calibration process of another type comprises that the user is placed on well-known object on this display system so that support and alignment near the framework of display system, and marks first geometric point of this well-known object.The computer applied algorithm of implementing to such user's calibration process generates line of reference on this display system; This line of reference connects first geometric point and second geometric point of this well-known object, and said second geometric point is relative diagonally with first geometric point of this well-known object.This application program on this display system, creates the profile of this well-known object then based on the geometric configuration of the framework of first geometric point, line of reference and this display system.For each how much dimension, this application program is measured the size of this profile, confirms the number of the display element that this profile is filled, and through calculate the size of this display element divided by the number for the display element of this geometry dimension with the size of this profile.

In some implementations, the well-known object of in above-mentioned user's calibration process, using possibly be driver's a license card.When the profile of the license card that on this display system, generates the driver, the user can be the left side of this driver's license card and the justified margin of this display system, and the use display frame supports this driver's license card.This user is placed on cursor on the geometric point through using mouse or keyboard then, and this geometric point is the top margin or the right edge of this driver's license card.This well-known object also possibly be credit card or compact disk.

In some implementations, each display element in the display system is that square and size are identical.In other implementations, each display element is that rectangle and size are identical.

In some implementations, for each how much dimension, the resolution of this display system possibly be stored in certain location place in advance with the mode of electronics.Maybe be by the length breadth ratio of the catercorner length of display system and this display system and derive the length of this display system.The length of this display system also possibly provided by the user.

In general, in order to calculate for each how much dimension object expecting the number of the display element that size strides across, with the expectation size of this object divided by size for the display element of this geometry dimension.The expectation size of this object possibly be in advance known, or through deriving with the picture of the real object of the camera with known configurations.The known configurations of this camera can comprise the distance between the lens combination of this object and this camera, the focal length of the lens combination of this camera, and the distortion that causes of this camera.In order to increase accuracy, may proofread and correct this distortion in the computing interval.

In this instructions, also disclose and a kind of object has been presented at the method on the display system with the expectation size with respect to background image.This method possibly comprise the steps.For each how much dimension, at first calculate the actual size of object.Based on the dimensional information of background and the actual size of object, derive the expectation size of this object then with respect to background.And last, the number of the display element that this image strides across when calculating image when this object and being in the expectation size with respect to background, and show the image of this object based on aforementioned calculation.Can in the process of buying a piece of furniture, find an application of this method.This background is this part furniture will be placed on home environment wherein.

This instructions has also been discussed a kind of about using a camera to make up for the three-dimensional feature of destination object and the method for big or small metrical information.This method comprises the steps: that (a) selects reference object; (b) take the picture of the image of the image comprise this reference object and this destination object; (c) use the image of this reference object to come calibrated cameras so that confirm the rotation matrix and the translation matrix of this camera; (d), come picture construction three-dimensional feature and big or small metrical information for this destination object based on the rotation matrix and the translation matrix of this camera; And (e) use constructed three-dimensional feature and metrical information to come its image of three-dimensional feature demonstration with this object.

A kind of method of the image with the 3-D effect display object is also disclosed.Such method comprises the steps.The first, confirm to be displayed on the suitable size of the two dimensional character of the object on the display system, and calculate two dimensional character when this object and be in the suitable number of its display element that strides across when big or small.The second, for each 3-D effect in this image, through with beholder and this display system watch distance between the panel divided by the distance between this three-dimensional feature and the beholder, derive size and readjust ratio.At last, readjust ratio based on this size and show this three-dimensional feature.

Second method with 3-D effect image of display object on display system comprises different step groups.The first suitable size of calculating the front (front side) that will be displayed on the object on the display system is placed on apart from equal the position of watching the distance between the panel of beholder and display system just as the front of this object.Second readjusts ratio through deriving for the size in front divided by the actual size in the front of this object with the suitable size in the front of this object.The 3rd comes to show with 3-D effect the image of this object through the entire image of readjusting ratio adjustment object based on this size.

Be used for implementing or carry out above that the system of disclosed method possibly comprise: display system, it comprises one or more display elements; With the processing unit that can implement these method steps.Computer-readable medium can be used to store and be used to implement the above instruction of disclosed method.

Description of drawings

Fig. 1 a is a width of cloth advertisement, and it shows and is placed on a digital camera in people's palm.

Fig. 1 b illustrates the problem that the consumer is faced when buying a piece of furniture.

Fig. 1 c illustrates the two-dimensional object with WYSIWYG effect on the computer display.

Fig. 1 d illustrates the three dimensional object with WYSIWYG effect on the computer display.

Fig. 1 e illustrates the railway of the disappearance with WYSIWYG effect on the computer display.

Fig. 1 f illustrates the three dimensional object in the video frame with WYSIWYG effect on the computer display.

Fig. 1 g illustrates a plurality of images of the different objects that put together with the WYSIWYG effect on the computer display.

Fig. 2 a is the display system that comprises a plurality of display elements.

Fig. 2 b illustrates to import based on the user and calibrates display system.

Fig. 2 c illustrates based on the user and imports the length breadth ratio that derives display system.

Fig. 2 d illustrates based on the user and imports the dimension information of deriving display system.

Fig. 3 is the display system that shows iPhone.

Fig. 4 a is the display system that when the size of known object, shows this object with its actual view.

Fig. 4 b is the display system that the picture of this object is shown with its actual view when the size of known object.

Fig. 4 c illustrates camera arrangement.

Fig. 5 comes with its actual view display object based on the size and the camera arrangement of picture.

Fig. 6 illustrates the image of coffee table is adapted in the picture of home environment.

Fig. 7 illustrates the three-dimensional feature of how adjusting image based on the distance between display system and the beholder.

Fig. 8 a illustrates and how to use rotation matrix and translation matrix that the object coordinate conversion is image coordinate.

Fig. 8 b illustrates and uses reference object to derive rotation matrix and translation matrix.

Fig. 8 c illustrates and uses attitude to estimate to make up three-dimensional feature and big or small metrical information.

Embodiment

For the online user who browses the items for merchandising that shows on the vendor web site before the computing machine that is sitting in her, the shopping that can adopt some technology to improve her is experienced.One of them technology is the method through so-called WYSIWYG (What You See Is What You Get).The WYSIWYG effect can strengthen the true effect in graphic presentation, and some real characteristic of the object that the online user might be experienced showing, the for example actual size of this object.

In order to allow online shopper to experience some WYSIWYG effect of two-dimensional object, the image of this object can be exaggerated or dwindle, so that with the certainty ratio (for example with actual size 50%) of giving of its actual size or its actual size this object is shown.With two-dimensional object with its actual size be illustrated on the display screen effect with just as the effect that this two-dimensional object is placed on the display screen is identical, shown in Fig. 1 c.If the enough big next size of giving certainty ratio with actual size or its actual size of display screen illustrates whole object, the part of this object then can only be shown so that be suitable for screen.Which part the online browse device can select to be illustrated on the display screen.

In order to allow online shopper to experience the WYSIWYG effect of three dimensional object, this object images can be exaggerated or dwindle, so that the selected two dimensional character of this three dimensional object is shown with the size of giving certainty ratio of actual size or its actual size.The two dimensional character of this three dimensional object is identical with the effect that is placed on the display screen just as the two dimensional character with this three dimensional object with the effect that its actual size is illustrated on the display screen.Shown in Fig. 1 d, the selected two dimensional character of iPhone is shown, the touch-screen of this iPhone with actual size on display screen.The image of iPhone is adjusted, so that the touch-screen of selected two dimensional character in this image (touch-screen of this iPhone) and real iPhone is big or small identical.The selected two dimensional character (trade mark of Logitech) of Logitech VX Revolution mouse is illustrated on the display screen with real size.The image of Logitech VX Revolution mouse is adjusted, so that selected two dimensional character (trade mark of Logitech) is illustrated on the display screen with actual size.This seems to be placed on the screen just as a real Logitech VX Revolution mouse.When this object images that zooms in or out made specific two dimensional character illustrate with the size of giving certainty ratio of actual size or its actual size, this object other two dimensional characters in identical image need not be in its real size or have the size of the same ratio of its actual size.

Experience the WYSIWYG effect of the three dimensional object in the image with some other objects in order to allow online shopper; This image will be exaggerated or dwindle, so that the selected two dimensional character of selected three dimensional object is shown with the size of giving certainty ratio of actual size or its actual size.In that with its actual size the effect of selected two dimensional character of selected three dimensional object to be shown on the display screen identical with the effect that is placed on the display screen just as the selected two dimensional character with selected three dimensional object.Shown in Fig. 1 e, a lot of railway sleepers are arranged in this image.The selected two dimensional character (flat of top) of this three dimensional object (nearest railway sleeper) is illustrated in 12.1 inches and length breadth ratio with 10.46% of actual size be on the display screen of 4:3.This user can be with 10.46% flat of seeing the top of nearest railway sleeper of actual size on 12.1 display screens of 4:3 in length breadth ratio.When image is exaggerated or dwindles so that when with the size of the given ratio of actual size or its actual size specific two dimensional character being shown, other characteristics of the same object in this identical image and other objects in this identical image need not be in the identical certainty ratio of giving of its actual size or its actual size.Shown in Fig. 1 e, other sleeper is not in 10.46% of its actual size.

In order to allow the online user to experience image or the WYSIWYG effect of the three dimensional object in the frame of video in a series of images, all frames in this series that zooms in or out in an identical manner or all images are come to illustrate with its actual size or with the size of giving certainty ratio of its actual size the selected two dimensional character of the three dimensional object in this selected frame or the selected image.Shown in Fig. 1 f, be illustrated on 12.1 display screens that length breadth ratio is 4:3 with 195% selected two dimensional character (trade mark of MOTOROLA) of actual size with the selected three dimensional object (Droid mobile phone) of (at the 11st second the frame that begins to locate of YouTube video) in the selected frame.

In order to allow the online user can experience the WYSIWYG effect of a plurality of objects, for example so that when they are compared each other, feel these objects, the image of all objects and video can be exaggerated or dwindle.To in each image or video, select the specific two dimensional character of special object.To show all images or the video that comprises selected two dimensional character with actual size or with the two dimensional character of the size of the same ratio of its actual size.Shown in Fig. 1 g, there is the image of 4 width of cloth electronic book readers.Be chosen in the specific two dimensional character (display screen of each electronic book readers) of the specific three dimensional object (electronic book readers) in each image.The two dimensional character of all selections all is illustrated on 12.1 inches the display screen that a length breadth ratio is 4:3 with 25% of actual size.

Aforesaid WYSIWYG effect has strengthened beholder's visual experience.Following description illustrates how to realize computer applied algorithm, on display system, to reach these WYSIWYG effects.As the first step, this application program need be calculated the configuration of beholder's display system.In the following discussion, the user is meant those people that in its business activity, are provided with and use the computer applied algorithm of realizing based on the present invention.User's a example is online retailer.Beholder/viewer or consumer refer to the user's of this application program consumer.

Shown in Fig. 2 a, exemplary display system 202 generally includes a plurality of display elements 222,224,226 or the like.Display system 202 possibly be computer screen, mobile phone screen, PDA, iPhone, monitor, TV or the like.Display element in most of display system on the market has uniform size at present.In application, this discussion has the hypothesis of identical size based on the display element in the display system.Yet identical technology and method also can be used to comprise the display system of the display element of different sizes.

With reference to Fig. 2 a, display system 202 is a rectangular shape.Its diagonal line 206 ( L) be 12.1 inches long.This display system 202 is made up of the display element grid, and the resolution of display system ( R ₁* R ₂) be set to 768 * 1024.Therefore, arrange 768 display elements, and arrange 1024 display elements along horizontal dimensions along vertical dimensions.Display element add up to 768 * 1024=786,432.

The shape of this display element 204 possibly be rectangle or square.

For display system, its length breadth ratio is defined as the ratio of this display system along the length of vertical dimensions and this display system along the length of horizontal dimensions.The length breadth ratio of this display system 202 does D ₁: D ₂

For display system with square display element, D ₁: D ₂= R ₁: R ₂

For having rectangle or square display element and display system that have above-mentioned configuration (12.1 inches diagonal line and 768 * 1024 resolution), we can use following formula calculate limit 214 ( l ₁) and limit 212 ( l ₂):

。

The length on limit 214 ( l ₁) and the length on limit 212 ( l ₂) can use the height of this display system and width to calculate.In this instructions, discuss concentrating on diagonal line size and the length breadth ratio of using this display system.Yet identical technology and method are applicable to width and the known situation of length when display system.

The resolution of this display system ( R ₁* R ₂) can be from Any Application or system's (for example online browse device) retrieval.

When using formula (1) to calculate each display element big or small, a kind of method possibly be diagonal line size and the length breadth ratio from online browse device software or this display system of hardware retrieval.In an implementation, this online browse device software or hardware possibly obtain this information from operating system, and display system hardware can provide this information to operating system.

Another kind method possibly be the requirement user length breadth ratio of importing this display system ( D ₁: D ₂) and the diagonal line size ( L).In an implementation, on display screen, present frame or circle, and to require the user visually to discern this frame be whether square or rectangle or this circle are oval, shown in the element among Fig. 2 b 1001 to the user.This frame or this circle have taken the display element of similar number along horizontal dimensions and vertical dimensions.Display element in most of display systems is a square.If User Recognition is a square to this frame, perhaps this circle is not oval, and the length breadth ratio of this display system can be represented as so D ₁: D ₂= R ₁: R ₂

If User Recognition is rectangle rather than square to this frame, perhaps this circle is oval, then will on display screen, demonstrate several frames or circle to him, shown in Fig. 2 c.Requiring which frame of User Recognition or circle is square or perfect circle (promptly not being oval).Each frame or each circle are corresponding to specific length breadth ratio D ₁: D ₂, 4:3 for example, 3:2,5:4,16:10,16:9 or the like.This frame or circle at the ratio of the number of the display element on the vertical dimensions and the number of display element on horizontal dimensions be ( D ₂ R ₁)/( D ₁ R ₂).If the user is identified as square with one of them frame, perhaps one of them circle is identified as perfect circle (be not oval), then this frame or circle can be used for based on expression ( D ₂ R ₁)/( D ₁ R ₂) length breadth ratio of calculation display screen.

In order to calculate this diagonal line size of this display system, in an implementation, the user is asked to input should size (shown in the element among Fig. 2 b 1005), and verifies that from vision this input is correct, shown in Fig. 2 b.In order to verify that the user imports is correct (for example, 12.1 inches display screen size is not by be input as 12 inches of mistake), on screen, is based on user input with hypothesis and the size of its actual size of calculating shows the image of known two-dimensional object.The user will be asked to bring real object and place it on the screen, so that verify the big or small identical of this image and real object.Diagonal line size (and the size of display element based on display screen has been discussed in formula (3) and formula (4) l ₁With l ₂), the next method that shows known two-dimensional object with its actual size.

The known object that uses in the above-mentioned discussion can be normal size and any object that find easily, for example driver's license card, passport, dollar banknote or the like.In some implementations, the display system may be a driver's license card size (eg

" ×

") is stored as the default value.

During the display element in confirming display system big or small, a kind of method possibly be that the requirement online user is placed on known two-dimensional object on the display screen, and marks this real object region occupied on display screen.For example, shown in Fig. 2 b, the user places the driver's of standard license card (element 1004 among Fig. 2 b), and uses mouse or keyboard to come tagged element 1004 region occupied on display screen.

In order to help the user to mark object region occupied on display screen, in one implementation, the user is asked to object is placed on the bottom of display screen and utilizes display frame to support this object, shown in Fig. 2 b.Like this, the user just need not pin this object in marked region.Suppose that this two-dimensional object is a rectangle.When this object was placed on the bottom of display screen and utilize display frame to support this object, the border of this object was parallel with the border of the framework of display system.So only use just enough this object of mark region occupied on display screen exactly of perpendicular line and horizontal line.This user does not need the bottom of this object of mark region occupied on display screen, because the bottom that the display frame mark should the zone, shown in the element among Fig. 2 b 1008.

In addition, the user is asked to a vertical edge alignment the left side of object and screen, shown in the element among Fig. 2 b 1007.The user just need not mark the left side of this object region occupied on display screen like this.

In Fig. 2 b, draw as a dotted line of element 1006.This dotted line starts from the lower left point of object, i.e. the joint of element 1007 and element 1008.For the set point on the dotted line 1,006 1011, in left side edge with put between 1011 along the number of the display element of horizontal dimensions and be D _Left, and at bottom margin (element 1008) with put between 1011 along the number of the display element of vertical dimensions and be D _BottomFor length breadth ratio be D ₁: D ₂, and resolution be R ₁* R ₂Display system, and length breadth ratio is W _Object: D _ObjectKnown two-dimensional object, we have

。

For any point on the dotted line 1006, equal the length breadth ratio of object to the distance of line 1007 with to the ratio of the distance of line 1008 W _Object: D _Object

When the user clicks any on the dotted line 1006, the user with regard to mark this object region occupied on display screen top margin and right edge the two.

When the user clicked the point 1010 in the zone 1002 among Fig. 2 b, said regional 1002 was the zones between left margin (line 1007) and the dotted line 1006, and the horizontal line of point-like draws at point 1010 places.The horizontal line of this point-like and dotted line 1006 intersect at a little 1011.Point 1011 can be used for tagged object region occupied on display screen top margin and left side the two because for putting 1011, equal the length breadth ratio of object to the distance of line 1007 with to the ratio of the distance of line 1008 W _Object: D _Object

When the user clicks the point 1009 in the zone 1003 among Fig. 2 b (this zone 1003 is the zones between bottom boundary 1008 and the perpendicular line 1006), the perpendicular line of point-like draws at point 1009 places.The perpendicular line of this point-like and dotted line 1006 intersect at a little 1012.Point 1012 can be used for tagged object region occupied on display screen top margin and left side the two, this is because for point 1011 and the same cause of elaboration.

Therefore, the user can enough once simply clicking the mouse mark object region occupied on display screen.

For a width do WThe inch and highly do HThe known two-dimensional object of inch, it strides across on display screen S ₁* S ₂The zone of individual display element, we can use following formula calculation display element (referring to a) limit 214 of Fig. 2 ( l ₁) and limit 212 ( l ₂):

。

Consumer's screen resolution possibly be stored in his the online browse device software or hardware.When next consumer wants to watch picture with the WYSIWYG effect, with current screen resolution be stored in the browser previous resolution relatively.If resolution changes, perhaps browser moves being attached to a display system but having between the screen of different resolution, and then current display resolution will be different from the value of storage.The computer applied algorithm of realizing based on the present invention needs automatically perhaps to import the size that recomputates each display element based on the user.

If the width of display screen has been exchanged with height, think that then this screen has been rotated.Therefore this application program can exchange the width and the height of each display element simply.

If width is different with the value of storage with height, and is not exchanged, then said method can be used to recomputate the size of each display element.

When online consumption person enlarged and displayed or dwindle on browser shows, correspondingly adjust the size of each display element.During convergent-divergent, the size of webpage by proportionally ( r) change, so that no matter how zoom level keeps the effect of WYSIWYG, the big young pathbreaker of each display element becomes:

。

Derived limit 212 with the limit 214 of display element length ( l ₁With l ₂), we can use them to come on display system, to present image with the WYSIWYG effect of expecting.

In order to simplify discussion, we will use two-dimensional object as an example this technology to be described, and suppose that each display element is to have length l= l ₁= l ₂Square.The image that how this technology is applied to three dimensional object is discussed later.Identical technology and method can be used to have the rectangle display element ( l ₁≠ l ₂) display system.

In Fig. 3, on display system 300, presented the image 302 in the front of iPhone.The size of this image 302 is identical with real iPhone.In other words, the length 306 of image 302 equals the length of real iPhone, and the width 304 of image 302 equals the width of real iPhone.Fig. 4 illustrates when knowing the size of true iPhone in advance, how to realize this effect.

Shown in Fig. 4 a, display system 400 has shown an iPhone image 402.Length 410 and the width 408 of a true iPhone are 4.5 " and 2.2 ".Each display element of display system 400 is square and has identical size.The length on the limit 404 of display element is lCan use the image in front that following formula derives iPhone along the number of the shared display element 414 of vertical dimensions:

。

The image in the front of iPhone along the number of the shared display element 412 of horizontal dimensions is:

。

v ₁With v ₂Be integer and can be rounded up.Stride across through being plotted on the vertical dimensions v ₁Individual display element and on horizontal dimensions, striding across v ₂The image of the iPhone of individual display element, display system 400 can demonstrate the image in the front of iPhone, and promptly image 402, and it is identical with real iPhone.

In current technology, know along level and vertical dimensions what display elements are arranged, just be enough on the monitor of lcd screen or plasma screen or projector type, show two dimensional image.In any real world applications of the present invention; Image maybe be very complicated; And technology possibly be existing or emerging any display technique, calculates the essence of drawing each point-like thing where and how to draw each point-like thing and means the distance of calculating between two distances between the point-like thing or each point-like thing and the reference point.This distance is represented with the number of display element usually.The above-described example that can easily be applied to complicacy about the example that how to derive the rectangular limit of representing with the number of display element.

In above-mentioned discussion, institute's images displayed is the image of object itself.Usually, the picture of (object and its surrounding enviroment and background) can be shown system's use for use in demonstration.For example, in Fig. 4 b, on display system 420, present the picture of the short and small rabbit drawing of two dimension.This picture has border 428.428 inside are images of a short and small rabbit on the border.The length of the image of this short and small rabbit is x'.The image 422 of this picture have length 424 ( x) and width 430 ( y).

The network operator who supposes drawing dealer or website wants that the online consumption person for him generates the WYSIWYG effect of image 422, for example, makes the size of size and true rabbit of the short and small rabbits drawing that image 422 is inner be complementary.The network operator of this drawing dealer or this website possibly know in advance or possibly not know the length that real short and small rabbit is painted.

If the user knows the length of real short and small rabbit drawing L _Rabbit, the ratio that the image of short and small rabbit need be exaggerated is

Therefore, the length of the whole picture needs to be amplified 422 to .This means, on the display system, the horizontal dimension of the image occupied by the number of display elements is

.Here lBe the length on a limit of the square display element in the display system 420, suppose the big or small identical of each display element.

Similarly, if know the height of real rabbit drawing in advance, just can derive the number of this picture along the shared display element of vertical dimensions.

Usually the user does not know the length or the width of true rabbit drawing.Yet, can derive length and the height of true rabbit from the configuration of the camera of the picture that is used to take rabbit.The mathematical method that in derivation, adopts is described below.

In Fig. 4 c, the camera model 450 of a simplification is shown.In model 450 inside, place lens 454 perpendicular to axis 452.The focal length of these lens 454 does f, and in two focuses 458 of each side marked and 460 of this lens 454.Object 456 be placed on lens 454 fronts distance 462 ( d ₁) locate.The distance 464 of lens 454 back ( d ₂) locate to form image 455.The height of this object 466 is h ₁And the height of image 455 is h ₂The size of this object 456 is relevant with the configuration of size of images and camera, concerns as follows,

wherein

。

Therefore, h ₁Can be according to known parameters f, d ₁With h ₂Be expressed as:

。

Referring now to Fig. 5, we are illustrated under the situation of the size of not knowing rabbit drawing, and the picture that how to make drawing amplifies so that the image corresponding to the drawing of true drawing is shown in size.In Fig. 5, on this display system 580, demonstrate image based on photo 586.In this photo 586, the length 588 of the image of this drawing does r ₂, and the length 584 on the border of picture does D ₂Configuration according to camera (is placed the distance of the two dimensional character of true two-dimensional object or three dimensional object dAnd the focal length of lens f), use formula

Can be from the length of image of drawing r ₂Derive the length of full scale drawing r ₂'.On this display system 580, the length of the length of rabbit image and rabbit drawing r ₂' identical.The length on the border of picture D ₂' need proportionally Amplify.

It should be noted that the configuration of true camera comprises other physical parameters, curvature of lens or the like for example is so that consider the distortion that caused by lens.

In case derived the size of display element based on formula (3) and (4), the user just can use the size of said method adjustment picture or image, to realize the WYSIWYG effect.A kind of such effect is to make image identical with real object size, and the application of this effect can be found in internet electronic commercial.As the background technology paragraph is mentioned, show that the commodity photo of WYSIWYG effect can give the sort of experience that the Internet shopper is similar to shopping that kind in the shop.On computer screen, see the WYSIWYG effect of the digital camera of demonstration, and what believe that he sees is exactly that he obtains, allows the consumer to experience compact design.The side view of seeing the natural scale kneetop computer allows the consumer to experience the thinness or the lucid and lively lines of design.Show that with the WYSIWYG effect this characteristic of items for merchandising may be implemented as an option that can be opened or close.This characteristic also can be used by search engine.When the user search product, search engine can select to show with the WYSIWYG effect image of this product.This characteristic can also be used so that on its website, show its rare collection with the WYSIWYG effect by the museum.

The above-described method of on display system, adjusting piece image or many images also can find in the shop, to buy the application in the furniture.Shown in Fig. 1 b, the software of realizing these methods can be proved to be for wanting that the consumer who buys coffee table for her sofa and the corner space between her chair in her family is easily.She takes a picture 602 that in view, has the corner of sofa and chair; And her picture-storage at her portable electric appts for example in iPhone, PDA, kneetop computer or the like; Perhaps store on the network site for service, rather than measure the size in the space that will be filled.If picture is uploaded on the website, then this picture can be downloaded so that use later on.This consumer arrives furniture shop with her portable electric appts, and seen her coffee table of liking.Whether her uncertain this coffee table is adapted between her sofa and her chair, and she has just taken the picture of a coffee table.

The application program that is installed in then on the portable electric appts is handled this two pictures, and one is that corner space and another are coffee tables, and wherein the former maybe be from retrieved web.For example, use the method for the size of above-mentioned adjustment image, this application program can all be adjusted into the size of the object in two pictures big or small identical with real object.This application program can be based on the measurement of consumer input, or be the hypothesis of taking with fixing configuration (being the same distance between the same focal length and object and the lens) based on this picture, realize such adjustment.This application program also can be adjusted the size of image according to some other mode, for example attempts to make all things all to be suitable for the screen of portable electric appts.

After adjustment two pictures amplify with the identical ratio that reflects size or dwindle; This consumer just can be added to the picture of coffee table on the picture of corner space; As shown in Figure 5; To see whether coffee table is suitable for corner space; Not only from geometrically; And from aesthetic, for example the color scheme is mated or the latest fashion of praise.

In some implementations, picture can be added to live camera and present.For example the consumer has had a cabinet for TV at home.He has taken (one or more) picture and has measured its size for his cabinet for TV.Afterwards, this consumer to the shop and found one one he want the TV that buys.This consumer is literal go up ground or with graphical representation tell the model of this TV of iPhone.For example, he can use the iPhone application program to scan TV product bar code or simple typewriting input or tell model name.This consumer opens the iPhone camera then, and his iPhone is faced toward TV, and the image of on the screen of iPhone, catching this TV.This iPhone takes out the picture (itself or stored into iPhone by this locality and go up or remotely be stored on the website) of this consumer's who takes at home cabinet for TV then, and with the image overlay of cabinet for TV on the TV image.The image of cabinet for TV is made this cabinet for TV seem in the shop by adjustment.Through the position of adjustment cabinet for TV on his iPhone screen, this consumer can be placed on it below the TV.Now the consumer can be TV under the take-home situation, with regard to see he want the televisor of buying be adapted to he family degree how.

In another example, the user uses her iPhone camera to write down an incident.When camera when rocking, this user is applied to rest image on the live record.This image possibly be exaggerated or dwindle as required, and the size of live record is also by corresponding adjustment.

A kind of novel manner that can be used to strengthen the shopping experience of online shopper and allow them in their comfortable family, just can enjoy the shopping experience in this shop is to allow the consumer to recognize the actual size of items for merchandising.The three-dimensional feature that allows the consumer to experience items for merchandising also can improve the shopping of online shopper and experience.

For example, a kind of method that can be used to appear the 3-D view of commodity (for example automobile) is through taking a picture for from different perspectives this automobile.These photos quilts mode in order flash on display system, provide the automobile of rotation.

The another kind of method that can be used for allowing the three-dimensional feature that the consumer experiences items for merchandising is through being that the three-dimensional feature of the photo of adjustment items for merchandising makes it seem truer.

In above-mentioned paragraph, when we discuss the size of adjustment image so that this two dimension in this image or three dimensional object seem that when really object was identical or approximate, we concentrated on the two dimensional image, for example the front of iPhone shown in Fig. 4 a.Yet some pictures of real object possibly comprise the three-dimensional feature of the environment that three-dimensional feature or object were positioned at of this object, for example the thickness of iPhone or wall on every side.When the image of adjustment object on display system made that this object manifests with the WYSIWYG effect, the three-dimensional feature that exists in this image also need be adjusted, so that entire image looks like really.When this image of adjustment is its actual size or when being similar to its actual size with the size that reflects object, can be employed each three-dimensional feature that comprises in this image to rebuild based on the detailed method of formula (7) and (8).

Fig. 1 e has explained how formula (7) and (8) derive out.In Fig. 1 e, the railway 170 of disappearance by the rail 172 of two convergences and 182 and size on the sleeper (for example 174,176 and 178) that reduces gradually constitute.

In Fig. 1 e, sleeper 174,176 and 178 length are represented as S ₁, S ₂With S ₃Article two, the distance between the adjacent rail sleepers is d, suppose that sleeper is evenly spaced.Distance between position of watching and the sleeper 174 is D(not shown).According to the mathematical operation of perspective geometry, the relation between the length of each sleeper can be by approximate representation:

，

And

。

With reference to Fig. 1 e, when the length of having set sleeper 174 S ₁The time, other part of picture (for example sleeper 176 with sleeper 178) can according to formula (7) and (8) according to the proper proportion drafting of sleeper 174.If desired, the length of sleeper 174 S ₁Can be set at the true length of this sleeper.But also can they be set for different based on needs of different applications.

As shown in Figure 7, computer user 750 is occupied in online shopping.On display screen is the photo of items for merchandising (for example jewel box 754).Image has been processed so that this jewel box 756 front in this image has the size identical with real object.The remainder of image (three-dimensional feature that comprises jewel box 754, the for example decoration 760 of complicacy on the inside 758 of Fen Geing, the side) should be by corresponding adjustment, so that computer user's 750 entire image are looked like really.

Distance 752 based between computer user 750 and this display system 751 (being computer screen) is DHypothesis, zooming in or out of the characteristic in the remainder of image can come or characteristic ground or ground enforcement one by one one by one according to formula (7) or (8).In formula (7), dDistance between the characteristic that representative will be processed or the point and the front of jewel box.

In some implementations, possibly confirm the distance D between this computer user 750 and this display system 751 in real time.Camera or range sensor can be used for confirming how far the computer user has from display system.When this computer user near or when moving away from this display system, distance DVariation kept watch on, and be fed to the display system that will be used to be used for readjusting of image.In other implementation, can use to be similar to and reduce computing time and raise the efficiency.For example, suppose distance DBe constant, and adopt value to computing machine reflection common computer user's use habit.Perhaps in order to simplify distance DCan be assumed to be 0.

As stated, on display system with the image of WYSIWYG effect display object, adopt possibly make this object in the image size and the big or small identical of real object or with the big or small approximately uniform method of real object.When this image being adjusted to when making that this image and real object size is identical, the three-dimensional feature that is included in the perspective in this image should correspondingly be adjusted based on having how far to come from the beholder position.The three-dimensional feature of perspective can strengthen the true effect of any picture.When picture lacks any or during some three-dimensional features, can use the attitude estimation technique is that this picture generates three-dimensional feature, so that create real effect.For example only lack 3-D effect usually with the picture of the object of a camera.Can use the attitude estimation technique to rebuild the three-dimensional model and the big or small metrical information of this object, so that generate another pictures of this object with true three-dimension effect.

Fig. 8 a-8b has explained how to use attitude to estimate to generate three-dimensional feature.When attitude is estimated, use a reference object to come calibrated cameras.This reference object and target are placed in the pictures together.

In Fig. 8 a, translation matrix T816 and rotation matrix R818 is two external parameters, and it is described camera and how object is converted to image from real object.Only for illustrative purposes, use a reference point O _wExplain this process. O _wBe a reference point in the real world, and it is converted into a point that is imaged at then on the plane of delineation 806 by camera lens system O _iFrom O _wArrive O _i, conversion can be expressed as:

Wherein Be O _iThree-dimensional coordinate, and

Be O _wThree-dimensional coordinate.Translation matrix T816 can be expressed as:

, wherein ( T _x, T _y, T _z) representative from O _wArrive O _iD translation.

And rotation matrix R818 can be expressed as:

, wherein ( R _x, R _y, R _z) representative from O _wArrive O _iThe Eulerian angle of rotation.

In Fig. 8 a, point O _iBeing projected on the plane of delineation 806 becomes a little P _u( x _u, y _u), wherein x _uWith y _uBe a little P _uCoordinate on the plane of delineation 806.If consider the distortion that causes by camera, O _iPicture point possibly be formed on P _dThe place, wherein P _dFrom P _uDisplacement slightly.We do not have distortion in the following discussion at hypothesis.

( x _u, y _u) with ( x _i, y _i, z _i) relevant, relation is as follows

Wherein fIt is the focal length of the lens combination of camera.If ( d _x, d _y) distance between the adjacent sensor element of expression, so according to sensor element ( x _f, y _f) come the presentation graphs picture point O _iCoordinate be:

Wherein hypothesis does not exist lens aberration and hardware deficiency.

Based on above-described mathematical relation, can use calibration process to make up rotation matrix RAnd translation matrix TFig. 8 (b) illustrates the example of a such correcting process.

In Fig. 8 (b), chessboard 840 is used as reference object.This chessboard 840 is placed on the camera front.On chessboard, select two points for calibration process.Point 846 coordinate be ( a _w, b _w, c _w), and put 848 coordinate for ( a _w', b _w', c _w').Because being placed with, chessboard 840 is parallel to plane of delineation (not shown), so we obtain c _w= c _w'= z The image 844 of chessboard 840 is formed on the inside of camera 842, and it is amplified for the illustration purpose on the left side.The point 846 be imaged at coordinate for ( a _u, b _u) point 850 in, and put 848 be imaged at coordinate for ( a _u', b _u') point 852 in.

Use formula (10) and (11), we obtain

, and

, wherein fThe focal length of expression camera lens, and

From formula (9), we obtain

, and

。

Because ( a _u, b _u), ( a _u', b _u'), ( a _w, b _w, c _w), ( a _w', b _w', c _w'), fWith zBe known parameter, just produce the rotation matrix that is used for camera so find the solution two top formula RAnd transformation matrix TUtilize RWith T, shown in Fig. 8 c, just can easily implement attitude and estimate.

In Fig. 8 c, real object 882 has front 884 and side or latter feature such as DE.Through only using a camera, capture the front of object 882, and be presented in the picture 883 as positive 886.The attitude estimation will allow not to be captured to some three-dimensional feature of the object 882 in the picture 883 and by reconstruct and by application program it filled.For example the line D'E' in the picture 886 is corresponding at the line DE shown in the picture 882, wherein

。

Can be structured in other three-dimensional features in the picture 882 similarly and it is presented in the picture 883.Above-described process is only used a camera to make up the image of three dimensional object and is generated the metrical information (the for example length of characteristic DE) of three dimensional object, rather than as classic method need use multi-section camera.

Technology described herein can be implemented in the Fundamental Digital Circuit, perhaps is implemented in computer hardware, firmware, software or their combination.This technology can be implemented as computer program, promptly visibly is embodied in the computer program in the storage medium.Computer program can be write by programming language in any form, and it can dispose in any form, comprises as program independently, perhaps as module, parts, subroutine, or other unit of being suitable in computing environment, using.Computer program can be deployed be in a site or cross over that a plurality of sites distribute and by a computing machine of interconnection of telecommunication network or a plurality of computing machine on carry out.

Technology described herein can realize in distributed computing system; This system comprises back-end component (for example as data server); And/or middleware component (for example apps server), and/or front end component (client computer and/or the user who for example has a graphic user interface through its can with the mutual web browser of implementation of the present invention), or any combination of such rear end, middleware or front end component.Each parts of this system can be through digital data communication (for example communication network) interconnection of any form or any medium.The example of communication network comprises LAN (Local Area Network) (" LAN ") and wide area network (" WAN "), the Internet for example, and include spider lines and wireless network the two.Computer system can comprise client and server.Client and server usually away from each other, and usually through communication network mutual.The relation of client and server is by means of operation on computing machine separately and have the computer program of client-server relation each other and produce.

The method step of technology described herein can be carried out so that carry out function of the present invention through output is operated and generated to the input data through one or more programmable processor of computer program.Also can come the manner of execution step, and device of the present invention may be implemented as dedicated logic circuit through dedicated logic circuit.Module refers to realize the computer program of this function and/or the part of processor/particular electrical circuit.

For instance, the processor that is applicable to computer program comprise general purpose microprocessor and special microprocessor the two, and one or more any processor of the digital machine of any kind.Usually, processor will be from ROM (read-only memory) or random access memory or this two reception instruction and data.The primary element of computing machine is the processor that is used to execute instruction and be used for one or more memory devices of storage instruction and data.Usually; Computing machine also will comprise one or more mass memory unit that is used to store data; Perhaps computing machine operationally is coupled to receive data or data are sent to said one or more mass memory unit from said one or more mass memory unit; Perhaps carry out this two, wherein said one or more mass memory unit for example is disk, magneto-optic disk or CD.Be applicable to that the information carrier of specializing computer program instructions and data comprises the nonvolatile memory of form of ownership, for instance, comprises semiconductor memory devices (for example EPROM, EEPROM and flash memory device); Disk (for example internal hard drive or removable dish); Magneto-optic disk; And CD-ROM and DVD-ROM dish.This processor can be added in the dedicated logic circuit with this storer or is integrated in the dedicated logic circuit.

Other embodiment within the scope of the following claims.Be the example that only is used to illustrate and limit never in any form alternative above.Technology described herein can be carried out with different order, and still realizes the result of expectation.

Claims

1. one kind shows the method be included in the object in image, video or a series of images with the WYSIWYG effect; Said WYSIWYG effect comprises one or more scenes; One of them of said one or more scenes is that object is in the expectation size; Said display system comprises one or more display elements, and said method comprises:

Derive the size of the display element of this display system for each how much dimension, and calculate for this object of this dimension to expect the number of the display element that size strides across; And

Based on for each how much these object of dimension to expect the number of the display element that size strides across, come basically to expect that size shows the two dimensional image of this object through the size of readjusting the said image, video or the image series that comprise two-dimensional object equably.

2. the method for claim 1, wherein for each how much dimension, derive the size of display element divided by the resolution on this geometry dimension by length with this display system.

The method of claim 1, wherein should to as if be used to show commodity on the internet, and to expect that size shows that these part commodity allow user to experience the characteristic in the outward appearance of these commodity.

4. method as claimed in claim 3, wherein, these part commodity are digital cameras, and show that with the size of expectation this digital camera allows the user to experience the compact design of this digital camera.

5. the method for claim 1, wherein calibrate the size that derives display element based on the user, said user's calibration comprises:

The request user imports the diagonal line size of this display system; And

Based on the diagonal line size of this display system, generate the image of known two-dimensional object with WYSIWYG effect;

The request user will this known two-dimensional object true article be placed on this known two-dimensional object image above, be correct to confirm that this user imports.

6. the method for claim 1, wherein calibrate the size that derives display element based on the user, said user's calibration comprises:

To be placed on the display system for the calibration point of each geometric point of well-known object through the user, cause user creates the profile of this well-known object on this display system; And

To each how much dimension, measure the size of this profile, the number of the display element of confirming to fill, and size through coming the calculation display element divided by number for the display element of this geometry dimension with the size of this profile by this profile.

7. the method for claim 1, wherein calibrate the size that derives display element based on the user, said user's calibration comprises:

The user is placed on the framework of well-known object near display system on this display system, so that support and alignment;

First geometric point of this well-known object of mark;

On this display system, generate line of reference, said line of reference connects first geometric point and second geometric point of this well-known object, and said second geometric point is relative diagonally with first geometric point of this well-known object; And

Based on the geometric configuration of the framework of this first geometric point, this line of reference and this display system, on this display system, create the profile of this well-known object; And

For each how much dimension, measure the size of this profile, the number of the display element of confirming to fill, and size through coming the calculation display element divided by number for the display element of this geometry dimension with the size of this profile by this profile.

8. like claim 5 or 6 or 7 described methods, wherein, this well-known object is driver's a license card.

9. method as claimed in claim 7; Wherein, Snap to through left side on the framework of display system well-known object; Use display frame to support driver's license card; Utilization is clicked the mouse cursor is placed on the geometric point on the line of reference, accomplishes on this display system and creates profile.

10. method as claimed in claim 7; Wherein, Snap to through left side on the framework of display system well-known object; Use display frame to support driver's license card; Be utilized in once pushing on the keyboard cursor is placed on the geometric point on the line of reference, accomplish on this display system and create profile.

11. like claim 5 or 6 or 7 described methods, wherein, this well-known object is a credit card.

12. like claim 5 or 6 or 7 described methods, wherein, this well-known object is a compact disk.

13. each in the method for claim 1, wherein said one or more display elements all is that square and size are identical.

14. each in the method for claim 1, wherein said one or more display elements all is that rectangle and size are identical.

15. method as claimed in claim 2; Wherein, For each how much dimension, resolution is stored in certain location place in advance with the electronics mode, and the length of this display system is to derive from the cornerwise length of this display system and the length breadth ratio of this display system.

16. method as claimed in claim 2 wherein, for each how much dimension, is provided the length of this display system by the user.

Comprise with the expectation size of this object divided by size with the number of expecting the display element that size strides across 17. the method for claim 1, wherein calculate for the display element of this geometry dimension for each how much dimension object.

18. method as claimed in claim 17, wherein, the expectation size of this object is known.

19. method as claimed in claim 17 wherein, is derived the expectation size of this object by the picture of the real object of the camera with known configurations.

20. method as claimed in claim 19, wherein, the known configurations of camera comprises the focal length of the lens combination of distance and camera between the lens combination of this object and camera.

21. method as claimed in claim 19 wherein, before the expectation size that derives this object, is eliminated the distortion in the picture that is caused by camera.

22. one kind is presented at the method on the display system with object with first size with respect to background image, comprising:

For each how much dimension; Acquisition equals or is approximately equal to second size of this object of the actual size of this object; Second size based on the dimensional information of background and this object is confirmed first size of this object with respect to background, and the image of working as this object is in the number that the display element that this image strides across is calculated in respect to background first hour; And

Be presented on the display system with the image of this object of first young pathbreaker in background.

23. method as claimed in claim 22, wherein, this to as if a piece of furniture, and this background is this part furniture will be placed on home environment wherein.

24. one kind is used a camera to make up the also method of the 3-D view of display object, comprising:

Select reference object;

The picture of the image that shooting comprises this reference object and the image of this object;

Use the image of this reference object to come calibrated cameras so that find out the rotation matrix and the translation matrix of this camera;

Make up the three-dimensional feature and the metrical information of the image of this object based on the rotation matrix of this camera and translation matrix;

Be presented on the display system based on constructed three-dimensional feature and metrical information image this object.

25. an image that is used for having the object of three-dimensional feature is presented on the method on the display system, said display system comprises one or more display elements, and said method comprises:

Definite suitable size that will be displayed on the two dimensional character of this object on this display system;

Calculate the number of the display element that said two dimensional character strides across when the two dimensional character of this object is in this suitable size;

The distance between the panel of watching through with beholder and this display system derives the ratio that the size that is used for each three-dimensional feature is readjusted divided by the distance between three-dimensional feature and this beholder; And

The ratio of readjusting based on this size shows this three-dimensional feature.

26. one kind is used for 3-D effect the image of object being presented on the method on the display system, said display system comprises one or more display elements, and said method comprises:

Calculating will be displayed on the suitable size in the front of the object on this display system, is placed on apart from equal the position of watching the distance between the panel of beholder and this display system just as the front of this object;

Through deriving the ratio that the size that is used for this front is readjusted divided by the actual size in the front of this object with the suitable size in the front of this object;

Adjust the entire image of this object through the ratio of readjusting based on this size and come image with this object of 3-D effect demonstration.

27. method that in image, video or a series of images, shows a plurality of objects with the WYSIWYG effect together; The ratio that the size of the two dimensional character that said WYSIWYG effect is appointment and the ratio of its actual size are substantially equal to expect; The two dimensional character of said appointment is one of them a characteristic of a plurality of objects; Said display system comprises one or more display elements, and said method comprises:

Confirm that one of them expectation size for a plurality of objects is so that realize said WYSIWYG effect;

Derive the size of the display element of these display systems for each how much dimension, and calculate for one of them of the said a plurality of objects of this dimension to expect the number of the display element that size strides across; And

The number of display element based on for each how much dimension being one of them calculating of said a plurality of objects to show together a plurality of objects through the size of readjusting said image, video or this image series equably.

28. method with the three dimensional object in WYSIWYG effect display image, video or a series of images; The two dimensional character that said WYSIWYG effect is this three dimensional object is in the expectation size that equals or be approximately equal to its actual size on display system; Said WYSIWYG effect comprises one or more scenes; Said display system comprises one or more display elements, and said method comprises:

Confirm the suitable size of this three dimensional object so that realize said WYSIWYG effect;

Derivation is for the size of the display element of each how much these display system of dimension, and calculates the number of the display element that strides across with suitable size for this this object of geometry dimension; And

The suitable size of number based on the display element that strides across with to(for) each how much these object of dimension comes to show this three dimensional object with suitable size through the size of readjusting said image, video or image series equably.

29. one kind shows with the expectation size that equals or be substantially equal to the actual size of object and to comprise the system of this object:

Display system, it comprises one or more display elements, and

Processing unit; It derives the size of the display element of this display system for each how much dimension; And calculate this object expecting the number of the display element that size strides across, and come to expect that size shows this object based on number then for the display element of each how much dimension.

30. computer-readable medium with instruction; Said instruction makes display system to show this object with the expectation size that equals or be approximately equal to the actual size of object; Said display system comprises one or more display elements, and this object is comprised to expect that size is presented on the said display system:

Derive the size of the display element of this display system for each how much dimension, and calculate for this this object of geometry dimension to expect the number of the display element that size strides across; And

Number based on display element comes to expect that size shows this object.