CN104424869B - Control the method, apparatus and system of display multimedia messages - Google Patents

Control the method, apparatus and system of display multimedia messages Download PDF

Info

Publication number
CN104424869B
CN104424869B CN201310388528.6A CN201310388528A CN104424869B CN 104424869 B CN104424869 B CN 104424869B CN 201310388528 A CN201310388528 A CN 201310388528A CN 104424869 B CN104424869 B CN 104424869B
Authority
CN
China
Prior art keywords
information
viewing area
target object
area
multimedia messages
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310388528.6A
Other languages
Chinese (zh)
Other versions
CN104424869A (en
Inventor
宋星光
廉士国
胡昌启
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201310388528.6A priority Critical patent/CN104424869B/en
Publication of CN104424869A publication Critical patent/CN104424869A/en
Application granted granted Critical
Publication of CN104424869B publication Critical patent/CN104424869B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00—Advertising or display means not otherwise provided for
    • G09F19/12—Advertising or display means not otherwise provided for using special optical effects
    • G09F19/18—Advertising or display means not otherwise provided for using special optical effects involving the use of optical projection means, e.g. projection of images on clouds
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00—Advertising or display means not otherwise provided for
    • G09F19/12—Advertising or display means not otherwise provided for using special optical effects

Landscapes

  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Marketing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The embodiment of the present invention provides the method, apparatus and system controlling display multimedia messages, and the method includes: obtain the image of first area in scene；According to the image of first area, determining primary importance information, primary importance information is for indicating the position of luminous ray that in scene, visible ray indicator sends drop point in the first region；According to primary importance information, determine the target object that drop point is corresponding in the first region, and determine the multimedia messages that target object is corresponding；Control display device display multimedia messages.In the embodiment of the present invention, by according to the image of first area in scene, determine that luminous ray that visible ray indicator sends is in the position of the drop point of first area, position according to drop point determines the target object that drop point is corresponding, and control the multimedia messages that display device display target object is corresponding, the accuracy mutual with user can be ensured such that it is able to promote Consumer's Experience.

Description

Control the method, apparatus and system of display multimedia messages
Technical field
The present invention relates to areas of information technology, and in particular it relates to control the side of display multimedia messages Method, equipment and system.
Background technology
Along with the development of technology, use various " suspensions " displays such as transparent screen, holographic mould or holographic display During the product of technology is gradually applied to business and lives.The interaction scenarios of " deficiency and excess combination " is needed at some In, such as meeting, put on display or in the scene such as displaying, use " suspension " Display Technique, show position and side Formula is ever-changing, it will bring qualitative leap to Consumer's Experience.
On the other hand, from the angle of user, no matter which kind of degree is Display Technique develop into, and lacks and hands over Mutual or that interactive means is single experience is all unluckily.And going out along with new Display Technique Existing, traditional interaction technique has also welcome new development opportunity.
In existing " deficiency and excess combination " interaction scenarios, interactive mode is based on gesture interaction.But, Gesture interaction computation complexity is high, and mutual real-time and accuracy are difficult to ensure, thus cause Consumer's Experience Difference.
Summary of the invention
The embodiment of the present invention provides the method, apparatus and system controlling display multimedia messages, it is possible to promote Consumer's Experience.
First aspect, it is provided that a kind of method controlling to show multimedia messages, including: obtain in scene The image of first area；According to the image of described first area, determine primary importance information, described first Positional information is for indicating luminous ray that in described scene, visible ray indicator sends in described firstth district The position of the drop point in territory；According to described primary importance information, determine to fall described in described first area The target object that point is corresponding, and determine the multimedia messages that described target object is corresponding；Control display device Show described multimedia messages.
In conjunction with first aspect, in the implementation that the first is possible, show at described control display device Before described multimedia messages, also include: obtain the image of described scene；Image according to described scene With the image of described first area, determine that second position information, described second position information are used for indicating institute State the position of the light source point of visible ray indicator；True according to described primary importance information and second position information It is scheduled on described display device for showing the viewing area of described multimedia messages；
Described control display device shows described multimedia messages, including: control described display device in institute State and on viewing area, show described multimedia messages.
In conjunction with the first possible implementation of first aspect, in the implementation that the second is possible, Existed by the longitudinal axis of the central point of described viewing area projection line in the horizontal plane and described luminous ray Projection line on horizontal plane is parallel.
In conjunction with the implementation that the second of first aspect is possible, in the implementation that the third is possible, Also include: according to image and the image of described first area of described scene, determine the 3rd positional information, Described 3rd positional information is for indicating the intersection point of described luminous ray and described display device；
Described determine for showing described multimedia according to described primary importance information and second position information The viewing area of information, including: according to described primary importance information, described second position information and described 3rd positional information, determines described viewing area；Wherein, hang down with described luminous ray in described viewing area Straight or described viewing area is positioned at horizontal plane；Described viewing area and the projected area of described target object Territory is not blocked, described intersection point subpoint in the horizontal plane and the throwing in the horizontal plane of described viewing area Vertical dimension between territory, shadow zone is less than the threshold value preset, and described intersection point is positioned at the projection of described target object In region.
In conjunction with the implementation that the second of first aspect is possible, in the 4th kind of possible implementation, Described viewing area is positioned at the surface of described drop point；
Described according to described primary importance information and second position information determine on described display device use In the viewing area of the described multimedia messages of display, including: according to described primary importance information and second Confidence breath determines described viewing area；Wherein, described viewing area is vertical with described luminous ray；Described Vertical distance between the top of viewing area and described target object is in default distance range.
In conjunction with the implementation that the second of first aspect is possible, in the 5th kind of possible implementation, Described viewing area is positioned at the surface of described drop point, and described viewing area is positioned at perpendicular；
Described according to described primary importance information and second position information determine on described display device use In the viewing area of the described multimedia messages of display, including: according to described second position information, determine institute State the vertical distance between the bottom of visible light source and described target object；According to described visible light source and institute State vertically distance and the height of described target object between the bottom of target object, determine described display Vertical distance between the bottom of region and described target object.
In conjunction with the first possible implementation of first aspect or first aspect to the 5th kind of possible reality Either type in existing mode, in the 6th kind of possible implementation, described believes according to described primary importance Breath, determines the target object that drop point is corresponding described in described first area, and determines described target object Corresponding multimedia messages, including: in space object information database, described primary importance information is entered Row coupling, the target object corresponding to determine described drop point, and from described space object information database Obtaining the attribute information of described target object, wherein said space object information database is used for storing described The positional information of the object in first area and attribute information；Attribute letter according to described target object Breath, obtains the multimedia messages that described target object is corresponding, described many matchmakers in multimedia information data storehouse Body information database is for storing many matchmakers of the attribute information correspondence respectively of the object in described first area Body information.
Second aspect, it is provided that a kind of equipment controlling to show multimedia messages, including: acquiring unit, For obtaining the image of first area in scene；First determines unit, for obtaining according to described acquiring unit The image of the first area taken, determines that primary importance information, described primary importance information are used for indicating described The position of the luminous ray that in scene, visible ray indicator sends drop point in described first area；Second Determine unit, for determining, according to described first, the primary importance information that unit determines, determine described the The target object that described in one region, drop point is corresponding, and determine the multimedia letter that described target object is corresponding Breath；For controlling display device, control unit, shows that described second determines the multimedia messages that unit determines.
In conjunction with second aspect, in the implementation that the first is possible, also include that the 3rd determines unit；
Described acquiring unit, is additionally operable to before described control display device shows described multimedia messages, Obtain the image of described scene；Described first determines unit, is additionally operable to the image according to described scene and institute State the image of first area, determine second position information, described second position information be used for indicating described can See the position of the light source point of optical indicator；Described 3rd determines unit, for believing according to described primary importance Breath and second position information determine on described display device for showing the display of described multimedia messages Region；Described control unit, shows institute specifically for controlling described display device on described viewing area State multimedia messages.
In conjunction with the first possible implementation of second aspect, in the implementation that the second is possible, Existed by the longitudinal axis of the central point of described viewing area projection line in the horizontal plane and described luminous ray Projection line on horizontal plane is parallel.
In conjunction with the implementation that the second of second aspect is possible, in the implementation that the third is possible, Described first determines unit, is additionally operable to the image according to described scene and the image of described first area, really Fixed 3rd positional information, described 3rd positional information is used for indicating described luminous ray and described display device Intersection point；Described 3rd determines unit, specifically for: according to described primary importance information, described second Positional information and described 3rd positional information, determine described viewing area；Wherein, described viewing area with Described luminous ray is vertical or described viewing area is positioned at horizontal plane；Described viewing area and described mesh The view field of mark object does not blocks, described intersection point subpoint in the horizontal plane and described viewing area The vertical dimension between view field in the horizontal plane is less than the threshold value preset, and described intersection point is positioned at described In the view field of target object.
In conjunction with the implementation that the second of second aspect is possible, in the 4th kind of possible implementation, Described viewing area is positioned at the surface of described drop point；
Described 3rd determines unit, specifically for: according to described primary importance information and second position information Determine described viewing area；Wherein, described viewing area is vertical with described luminous ray；Described viewing area Vertical distance between the top of territory and described target object is in default distance range.
In conjunction with the implementation that the second of second aspect is possible, in the 5th kind of possible implementation, Described viewing area is positioned at the surface of described drop point, and described viewing area is positioned at perpendicular；
Described 3rd determines unit, specifically for: according to described second position information, determine described visible Vertical distance between the bottom of light source and described target object；According to described visible light source and described target Vertically distance and the height of described target object between the bottom of object, determine described viewing area with Vertical distance between the bottom of described target object.
In conjunction with the first possible implementation of second aspect or second aspect to the 5th kind of possible reality Either type in existing mode, in the 6th kind of possible implementation, described second determines unit, specifically For: in space object information database, described primary importance information is mated, described to determine The target object that drop point is corresponding, and obtain described target object from described space object information database Attribute information, wherein said space object information database is for storing object in described first area Positional information and attribute information；According to the attribute information of described target object, at multimedia information data Obtaining the multimedia messages that described target object is corresponding in storehouse, described multimedia information data storehouse is used for storing The multimedia messages that the attribute information of the object in described first area is the most corresponding.
The third aspect, it is provided that a kind of display system, including: the display multimedia that controls as above is believed The equipment of breath, image capture device, display device and visible ray indicator；Wherein, described image is adopted Collection equipment, is used for: gathers the image of first area in scene, and controls display multimedia messages to described Equipment send described first area image；The described equipment controlling display multimedia messages, is used for: The image of first area scene is obtained from described image capture device；Figure according to described first area Picture, determines that primary importance information, described primary importance information are used for indicating visible ray described in described scene The position of the luminous ray that indicator sends drop point in described first area；According to described primary importance Information, determines the target object that drop point is corresponding described in described first area, and determines described object The multimedia messages that body is corresponding；Control display device and show described multimedia messages；Described display device, For showing described multimedia messages under the control of the described equipment controlling display multimedia messages.
In the embodiment of the present invention, by according to the image of first area in scene, determining visible ray indicator According to the position of drop point, the luminous ray sent, in the position of the drop point of first area, determines that drop point is corresponding Target object, and control the multimedia messages that display device display target object is corresponding, it is possible to ensure and use The accuracy that family is mutual such that it is able to promote Consumer's Experience.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below will be in the embodiment of the present invention The required accompanying drawing used is briefly described, it should be apparent that, drawings described below is only this Some embodiments of invention, for those of ordinary skill in the art, are not paying creative work Under premise, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the schematic flow of the method controlling display multimedia messages according to embodiments of the present invention Figure.
Fig. 2 is the schematic diagram of the scene that can apply the embodiment of the present invention.
Fig. 3 is showing of the process of the method controlling display multimedia messages according to an embodiment of the invention It is intended to.
Fig. 4 is the rough schematic view of the scene of Fig. 2.
Fig. 5 is the three-dimensional view of transparent screen in scene shown in Fig. 2.
Fig. 6 is the top view for Fig. 5.
Fig. 7 is the plan view of scene shown in Fig. 2.
Fig. 8 is the top view for Fig. 7.
Fig. 9 is the schematic diagram of another scene according to embodiments of the present invention.
Figure 10 is the process of the method controlling display multimedia messages according to another embodiment of the present invention Schematic diagram.
Figure 11 is the rough schematic view of the scene of Fig. 9.
Figure 12 is the three-dimensional view showing table region in scene shown in Fig. 9.
Figure 13 is the plan view of scene shown in Fig. 9.
Figure 14 is the top view for Figure 13.
Figure 15 is the plan view of scene shown in Fig. 9.
Figure 16 is the top view for Figure 15.
Figure 17 is the schematic block of the equipment controlling display multimedia messages according to an embodiment of the invention Figure.
Figure 18 is the schematic block of the equipment controlling display multimedia messages according to another embodiment of the present invention Figure.
Figure 19 is the schematic block diagram of display system according to embodiments of the present invention.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out Clearly and completely describe, it is clear that described embodiment is a part of embodiment of the present invention, and not It is whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art are not making wound The every other embodiment obtained on the premise of the property made work, all should belong to the scope of protection of the invention.
The embodiment of the present invention can apply to deficiency and excess combine display scene in, such as, meeting, exhibition or In the display scene that the deficiency and excesss such as displaying combine.In these scenes, have actual object, it is possible to based on Family presents the information that actual object is relevant to the selection of actual object, thus reaches the display effect that deficiency and excess combines Really.In the display scene that deficiency and excess combines, frequently with " suspension " Display Technique, for example with transparent screen, Various " suspension " Display Techniques such as holographic mould or holographic display, realize the display effect that deficiency and excess combines.
Fig. 1 is the schematic flow of the method controlling display multimedia messages according to embodiments of the present invention Figure.The method of Fig. 1 is performed by the equipment controlling to show multimedia messages, such as, has operational capability Computer or other electronic equipment.
110, obtain the image of first area in scene.
Such as, first area can be some region in scene.Such as, in the scene shown, Show that the region on table is properly termed as first area.
120, according to the image of first area, determine that primary importance information, primary importance information are used for referring to Show the position of luminous ray that in scene, visible ray indicator sends drop point in the first region.
130, according to primary importance information, determine the target object that drop point is corresponding in the first region, and Determine the multimedia messages that target object is corresponding.
In the embodiment of the present invention, target object is the object of necessary being.Such as, the information of target object The attribute information etc. of target object can be included.Such as, the information of target object can include target object The information such as position, mark or size.
Multimedia messages can include the information such as pattern, picture, word or the video relevant to target object.
140, control display device display multimedia messages.
In the embodiment of the present invention, display device can be that " suspension " shows product, such as transparent screen, complete Breath mould, line holographic projections or other Transparence Display medium etc..
In the embodiment of the present invention, it is seen that optical indicator can send luminous ray, points to a certain in space Object.Such as, it is seen that optical indicator can include laser pen, mobile phone pocket lamp, iPhone Smart Dot Laser or light emitting diode (Light Emitting Diode) light-beam pointer etc..
In above-mentioned scene, the image of first area can be that image capture device gathers, such as digital camera Machine etc..When the target object that the user in scene utilizes visible ray indicator to point to first area, image Collecting device can gather the image of first area.The equipment controlling display multimedia messages can be from image Collecting device obtains the image of first area, determines the luminous ray drop point in first area according to image, May thereby determine that the target object pointed by luminous ray.Then can be true according to the information of target object The multimedia messages that the object that sets the goal is corresponding, and control display device display multimedia messages.
At present, in the display scene that this deficiency and excess combines, it is all based on the gesture of user to position user Pointed target object, shows the multimedia messages that target object is corresponding the most on the display device.By The highest in the computation complexity of gesture interaction, mutual accuracy is difficult to ensure, such as, in some distance relatively Far, object more and arrange complex in the case of, be difficult to be accurately positioned the object that user is interested, Consumer's Experience can be caused excessively poor.And in the embodiment of the present invention, owing to visible ray indicator sends visible Light has clear and definite directivity, therefore by according to the image of first area in scene, determines visible ray Line, at the drop point of first area, can position, according to the position of drop point, the object that drop point is corresponding accurately Body, then controls the multimedia messages that display device display target object is corresponding, it is possible to ensure with user's Mutual accuracy such that it is able to promote Consumer's Experience.
In the embodiment of the present invention, by according to the image of first area in scene, determining visible ray indicator According to the position of drop point, the luminous ray sent, in the position of the drop point of first area, determines that drop point is corresponding Target object, and control the multimedia messages that display device display target object is corresponding, it is possible to ensure and use The accuracy that family is mutual such that it is able to promote Consumer's Experience.
Alternatively, as another embodiment, in step 130, can be at space object information database In primary importance information is mated, the target object corresponding to determine drop point, and from space object believe Obtaining the attribute information of target object in breath data base, wherein space object information database is for storage the The positional information of the object in one region and attribute information.Can according to the attribute information of target object, The multimedia messages that target object is corresponding, multimedia information data storehouse is obtained in multimedia information data storehouse For storing the multimedia messages that the attribute information of the object in first area is the most corresponding.
Such as, space object information database may be used for storing the position of each object in first area And other attribute information.Such as, attribute information can include that the mark of object or the size of object etc. are believed Breath.It is possible to according to the position of drop point, space object information database determines the position with drop point Put the target object matched, thus obtain the attribute information of target object.
Such as, multimedia information data storehouse may be used for storing the attribute information of each object of first area Corresponding multimedia messages.Such as, in multimedia information data storehouse, can store the mark of object with Corresponding relation between multimedia messages.Can be according to the mark of target object, from multimedia information data Storehouse obtains the multimedia messages that target object is corresponding.
Alternatively, as an embodiment, before step 140, the image of scene, root can be obtained According to image and the image of first area of scene, determine that second position information, second position information are used for referring to Show the position of visible light source in scene.Can determine aobvious according to primary importance information and second position information Show on equipment for showing the viewing area of multimedia messages.In step 140, display can be controlled to set For showing multimedia messages on above-mentioned viewing area.
For example, it is possible to according to the image of scene and the pixel distribution of both images of first area, brightness and The information such as color, are identified the feature of drop point and visible light source, so that it is determined that primary importance information and Second position information.This process is referred to existing process, repeats no more.
Such as, primary importance information and second position information all can represent with coordinate.Such as, permissible Rectangular coordinate system in space is set, then can be with drop point in rectangular coordinate system in space based on display device Coordinate represents primary importance information, can carry out table with visible light source coordinate in rectangular coordinate system in space Show second position information.
According to primary importance information and second position information, and some information of target object self, can To determine the viewing area of multimedia messages, viewing area it suffices that the requirement of angular field of view of human eye, And user oriented so that be at relaxing during the multimedia messages that user shows on viewing display area The viewed status of clothes such that it is able to promote Consumer's Experience.
Such as, above-mentioned viewing area can refer to the region on real stereo display screen, it is also possible to refers to nothing Region in shape display medium.
Alternatively, as another embodiment, by the longitudinal axis of the central point of viewing area in the horizontal plane Projection line is parallel with luminous ray projection line in the horizontal plane.As a rule, visible ray is indicated by user Device operates, it is believed that the direction of the luminous ray of the direction of the sight line of user and visible ray indicator It is identical.Therefore, the deflection angle of the viewing area projection in the horizontal plane longitudinal axis with respect to the horizontal plane Degree is identical with the deflection angle of the luminous ray projection in the horizontal plane longitudinal axis with respect to the horizontal plane, It is to say, existed with luminous ray by the longitudinal axis of the central point of viewing area projection line in the horizontal plane Projection line on horizontal plane is parallel, so allows users to the multimedia letter faced shown by viewing area Breath.
Alternatively, as another embodiment, can be according to the image of scene and the image of first area, really Fixed 3rd positional information, the 3rd positional information is for indicating the intersection point of luminous ray and display device.In step Before rapid 140, can determine according to primary importance information, second position information and the 3rd positional information Viewing area；Wherein, viewing area can or viewing area vertical with luminous ray can be at horizontal plane In；The view field of viewing area and target object does not blocks, it is seen that the intersection point of light and display device Being positioned at view field, intersection point subpoint in the horizontal plane and viewing area are in the upper projection of horizontal plane Vertical dimension between region is less than the threshold value preset.
For example, it is possible to according to the image of scene and the pixel distribution of both images of first area, brightness and The information such as color, extract the feature of luminous ray and the intersection point of display device, so that it is determined that primary importance letter Breath and second position information.
According to primary importance information and second position information, it may be determined that viewing area is in three dimensions Angle.Viewing area can be vertical with luminous ray, due to the sight line of direction and the user of luminous ray Direction is identical, and like this viewing area is also perpendicular to the sight line of user, therefore viewing area It is user oriented.Or, viewing area may be located in horizontal plane, and such user can also be intuitively See viewing area.
Additionally, in the case of display device is tangible display medium, it is also possible to exist along luminous ray Target object is projected by luminous ray with the point of intersection of display device, obtains the projected area of target object Territory.Can utilize the dimension information of target object that target object is projected, the chi of target object herein Very little information can be to be stored in advance in the memorizer of device interior, such as can be from above-mentioned spatial information thing Volume data storehouse obtains.
Viewing area can not block with the view field of target object, and intersection point is in the horizontal plane Subpoint can and viewing area view field in the horizontal plane between vertical dimension can be less than pre- If threshold value, so for the viewing angle of user, viewing area is near target object, the most not Meeting shelter target object, it is possible to promote the comfort level of user's viewing such that it is able to promote Consumer's Experience.
Alternatively, as another embodiment, viewing area may be located at the surface of drop point.In step 140 Before, viewing area can be determined according to primary importance information and second position information；Wherein, viewing area Territory is vertical with luminous ray；Vertically distance between viewing area and the top of target object is more than default Second Threshold.
When being such as, invisible display medium for display device, it is seen that between light and display device There is no intersection point.So can utilize light source point and drop point, determine viewing area.Viewing area can position In the surface of drop point, vertical with luminous ray, so from the perspective of user, viewing area be The vicinity of target object, and be user oriented, it is possible to promote Consumer's Experience.But, viewing area Not answering shelter target object, therefore, the vertical distance between viewing area and target object top can be In the range of a certain distance, this distance range can be set in advance.
Alternatively, as another embodiment, viewing area may be located at the surface of drop point, and is positioned at In perpendicular.Before step 140, visible light source and mesh can be determined according to second position information Vertical distance between the bottom of mark object.Can be according between visible light source and the bottom of target object Vertically distance and the height of target object, determine between viewing area and the bottom of target object is vertical Distance.
In the present embodiment, viewing area may be located in perpendicular, i.e. viewing area is perpendicular to level Face.Viewing area may be located at directly over drop point, and In the view of user, viewing area is in object Near body.Vertical distance between viewing area and target object can be relative to mesh according to light source point Height and the height of target object self bottom mark object carry out accommodation.The height of target object self Degree can be to be stored in advance in the memorizer of device interior, for example, it is possible to from space object information data Storehouse obtains.
The embodiment of the present invention is described in detail below in conjunction with object lesson.It should be noted that these examples the most more Those skilled in the art are helped well to be more fully understood that the embodiment of the present invention, and the unrestricted embodiment of the present invention Scope.
Fig. 2 is the schematic diagram of the scene that can apply the embodiment of the present invention.
In fig. 2, to use transparent screen to illustrate as a example by realizing " suspension " display effect.Such as Fig. 2 Shown in, show that on table, display has the object of displaying, show that table is provided above transparent screen 210.Transparent At 4 angles of screen 210,4 video camera 250a to 250d, video camera 250a to 250d can be set The whole region shown on table can be carried out image acquisition.Above transparent screen 210, namely should The top of scene, can arrange 2 video camera 240a and 240b, and video camera 240a and 240b is permissible Whole scene is carried out image acquisition.
Laser pen 230 can send luminous ray, points to jobbie in space.As in figure 2 it is shown, When user utilizes laser pen 230 to point to the target object 220 being positioned on displaying table, with target object 220 Corresponding multimedia messages may be displayed on a viewing area of transparent screen 210.Multimedia messages The information such as target object 220 relevant pattern, picture, word or video can be included.
Scene below in conjunction with Fig. 2 describes the process controlling to show multimedia messages in detail.Following During, for the ease of describing, the region shown on table is referred to as first area.Fig. 3 is according to this The schematic diagram of the process of the method controlling display multimedia messages of a bright embodiment.The method of Fig. 3 by The equipment controlling display multimedia messages performs.
301, image and the image of first area of scene is obtained from video camera.
As in figure 2 it is shown, when user utilizes laser pen 230 to point to target object 220, video camera 240 With the image that 240b can gather whole scene, video camera 250a to 250d can gather first area Image.Then the figure that video camera 240a and 240b and video camera 250a to 250d can will gather As being sent to control the equipment of display multimedia messages.
302, according to image and the image of first area of scene, determine primary importance information, second Confidence breath and the 3rd positional information.
The luminous ray that primary importance information sends for indicating laser pen 230 drop point in first area The position of D, second position information can serve to indicate that the position of the light source point S of laser pen 230, the 3rd Positional information can serve to indicate that the intersection I of luminous ray that laser pen 230 sends and transparent flat 210 Position.Primary importance information, second position information and the 3rd positional information all can be with three-dimensional Coordinate representation.
Fig. 4 is the rough schematic view of the scene of Fig. 2.In the diagram, so that view is relatively sharp, Suitably eliminate some elements in Fig. 2.As shown in Figure 4, can be from the image of scene and first area Image in detect drop point D, light source point S and intersection I.Fig. 5 is transparent screen in scene shown in Fig. 2 Three-dimensional view.As it is shown in figure 5, so that three-dimensional view is relatively sharp, suitably eliminate in Fig. 2 Some elements.In fig. 5, it is assumed that set rectangular coordinate system in space based on transparent flat 210, then Can calculate in the coordinate system according to stereoscopic localized algorithm that drop point D, light source point S and intersection I be each Coordinate.
For intersection I, if cannot detect in the image of scene, then can be according to light source point S's Coordinate and the coordinate of drop point D, calculated by space multistory geometry method.
Here, it is assumed that the coordinate of light source point S, intersection I and drop point D is as follows: light source point S (Xs, Ys, Zs), intersection I (Xi, Yi, Zi), drop point D(Xd, Yd, Zd).
303, according to drop point D, determine target object 220 corresponding for drop point D, obtain target object 220 Attribute information.
Space object information database may be used for storage and show that on table, each object is sat at space right-angle Coordinate range in mark system and other attribute information.Such as, attribute information can include the mark of object Or the information such as the size of object.It is possible to according to the coordinate of drop point D, in space object information data Storehouse determines the target object 220 that the coordinate with drop point D matches, and target object 220 is relevant Information.
304, according to the attribute information of target object 220, determine the multimedia of target object 220 correspondence Information.
Multimedia information data storehouse may be used for storage and shows the attribute information correspondence of each object on table Multimedia messages.Such as, in multimedia information data storehouse, the mark of object and many matchmakers can be set up Corresponding relation between body information.Can be according to the mark of target object 220, from multimedia information data Storehouse obtains the multimedia messages of target object 220 correspondence.
305, according to light source point S, intersection I, drop point D and target object 220, determine transparent flat 210 The viewing area of the interior multimedia messages for showing target object 220 correspondence.
Owing to transparent screen is three-dimensional, it is thus determined that viewing area it can be appreciated that determine display position and Angles of display.
As it is shown in figure 5, the visible ray that laser pen 230 sends can be determined according to solid geometry method Line L projection L ' in XZ plane, determines the angle α of L ' and L, and determines the angle of L ' and X-axis β。
Furthermore it is possible to be projected at intersection I by target object 220 according to the ratio of 1:1, obtain target The view field of object 220.Fig. 6 is the top view for Fig. 5.As shown in Figure 6, intersection I is positioned at In the view field of target object 220.
According to α and β, it may be determined that viewing area angle in rectangular coordinate system in space.Fig. 7 is figure The plan view of scene shown in 2.Fig. 8 is the top view for Fig. 7.As it is shown in fig. 7, in order to adapt to people The visual angle of eye, viewing area can be vertical with luminous ray L.Therefore, it can, according to α, determine display Region and the angle γ, i.e. γ=f (α) of XZ plane.Or, limited at the display performance of display device In the case of, γ can be 0.In order to adapt to the comfort level of human eye viewing so that user faces viewing area, As shown in Figure 8, viewing area can be equal to luminous ray L and X/Y plane with the angle of X/Y plane Angle, i.e. β.
Additionally, as shown in Figure 8, viewing area may be located near intersection I, and with target object 220 View field do not block.Specifically, so that intersection I subpoint in XZ plane with Between the view field in XZ plane of the viewing area, vertical dimension is less than the threshold value preset, and makes Apparently, viewing area is near target object for user.Additionally, the particular location of viewing area also may be used To be adjusted according to practical situation.
306, control to show the multimedia messages of target object 220 correspondence in above-mentioned viewing area.
Should be understood that the size of the sequence number of above-mentioned each process is not meant to the priority of execution sequence, each process Execution sequence should determine with its function and internal logic, and should be to the implementation process of the embodiment of the present invention Constitute any restriction.Such as, step 304 and 305 can be performed in parallel.
In the embodiment of the present invention, by according to the image of first area in scene, determining visible ray indicator According to the position of drop point, the luminous ray sent, in the position of the drop point of first area, determines that drop point is corresponding Target object, and control the multimedia messages that display device display target object is corresponding, it is possible to ensure and use The accuracy that family is mutual such that it is able to promote Consumer's Experience.
Fig. 9 is the schematic diagram of another scene according to embodiments of the present invention.
" suspend " in Display Technique in a class, it is possible to use laser, Special display or projector equipment are at sky Imaging in gas or various special gas.In fig .9, to utilize the display device of air imaging display techniques Illustrate as a example by realizing " suspension " display effect.
As it is shown in figure 9, display has the object of displaying on displaying table, show that the display that is provided above of table sets Standby 910.At 4 angles showing above table, 4 video camera 950a to 950d can be set.Take the photograph Camera 950a to 950d can carry out image acquisition to the whole region shown on table.Upper in this scene Side, can arrange 2 video camera 940a and 940b, and video camera 940a and 940b can be to whole field Scape carries out image acquisition.
Laser pen 930 can send luminous ray, points to jobbie in space.As it is shown in figure 9, When user utilizes laser pen 930 to point to the target object 920 being positioned on displaying table, with target object 920 Corresponding multimedia messages may be displayed on a viewing area of display device 910.Multimedia is believed Breath can include the information such as target object 920 relevant pattern, picture, word or video.
Scene below in conjunction with Fig. 9 describes the process controlling to show multimedia messages in detail.Following During, for the ease of describing, the region shown on table is referred to as first area.Figure 10 is according to this Invent the schematic diagram of the process of the method controlling display multimedia messages of another embodiment.The side of Figure 10 Method is performed by the equipment controlling to show multimedia messages.
1001, image and the image of first area of scene is obtained from video camera.
As it is shown in figure 9, when user utilizes laser pen 930 to point to target object 920, video camera 940 With the image that 940b can gather whole scene, video camera 950a to 950d can gather first area Image.Then the figure that video camera 940a and 940b and video camera 950a to 950d can will gather As being sent to control the equipment of display multimedia messages.
1002, according to image and the image of first area of scene, determine primary importance information and second Confidence ceases.
The luminous ray that primary importance information sends for indicating laser pen 930 drop point in first area The position of D, second position information can serve to indicate that the position of the light source point S of laser pen 930.
Figure 11 is the rough schematic view of the scene of Fig. 9.In fig. 11, so that view is relatively sharp, Suitably eliminate some elements in Fig. 9.As shown in figure 11, can be from the image of scene and the firstth district The image in territory detects drop point D and light source point S.Figure 12 is displaying table region in scene shown in Fig. 9 Three-dimensional view.As shown in figure 12, so that three-dimensional view is relatively sharp, suitably eliminate in Fig. 9 Some elements.In fig. 12, it is assumed that based on showing that table area above sets rectangular coordinate system in space, So can calculate drop point D and the respective seat of light source point S in the coordinate system according to stereoscopic localized algorithm Mark.
Here, it is assumed that the coordinate of light source point S and drop point D is as follows: light source point S(Xs, Ys, Zs), Drop point D(Xd, Yd, Zd).
1003, according to drop point D, determine target object 920 corresponding for drop point D, and obtain target object The attribute information of 920.
Space object information database may be used for storage and show that on table, each object is sat at space right-angle Coordinate range in mark system and attribute information.Such as, attribute information can include mark or the thing of object The information such as the size of body.It is possible to according to the coordinate of drop point D, in space object information database Determine the target object 920 that the coordinate with drop point D matches, and obtain the attribute letter of target object 920 Breath.
1004, according to the attribute information of target object 920, determine the multimedia of target object 920 correspondence Information.
Multimedia information data storehouse may be used for storage and shows the attribute information correspondence of each object on table Multimedia messages.Such as, in multimedia information data storehouse, the mark of object and many matchmakers can be set up Corresponding relation between body information.Can be according to the mark of target object 920, from multimedia information data Storehouse obtains the multimedia messages of target object 920 correspondence.
1005, according to light source point S, drop point D and target object 920, determine and use on display device 910 Viewing area in the multimedia messages of display target object 920 correspondence.
Owing to using " suspension " Display Technique, it is thus determined that viewing area is it can be appreciated that determine display Position and angles of display.
As shown in figure 12, can determine that laser pen 930 sends visible according to solid geometry method Light L projection L ' in XZ plane, determines the angle α of L ' and L, and determines the folder of L ' and X-axis Angle beta.
The angles and positions of viewing area can be determined by following two mode:
Mode one:
According to α and β, it may be determined that viewing area angle in rectangular coordinate system in space.
Figure 13 is the plan view of scene shown in Fig. 9.In fig. 13, some in Fig. 9 are suitably eliminated Element.Figure 14 is the top view for Figure 13.As shown in figure 13, in order to adapt to the visual angle of human eye, Making viewing area user oriented, viewing area can be vertical with luminous ray L.Therefore, it can basis α, determines the angle γ of viewing area and XZ plane, i.e. γ=f (α).
Additionally, as it has been described above, viewing area is positioned at the surface of drop point D, the most in a top view, fall In the projection of some D should be in the view field of viewing area or the two has certain overlap, but In Figure 14, in order to more clearly visible represent the viewing area deflection angle relative to X/Y plane, therefore The view field of the viewing area illustrated is in the right side of drop point projection.Should be understood that Figure 14 is only In order to help those skilled in the art to be more fully understood that the embodiment of the present invention, and the non-display embodiment of the present invention Scope.In order to adapt to the comfort level of human eye viewing so that user faces viewing area, such as Figure 14 institute Showing, the angle of viewing area and X/Y plane can be equal to the angle of luminous ray L with X/Y plane, i.e. β。
Viewing area may be located at the surface of drop point D, and viewing area and target object 920 top it Between vertical distance can more than preset threshold value.As shown in figure 13, it is assumed that the height of target object 920 Degree for c, bottom viewing area and target object between vertical distance be dh, then between dh and c Difference can more than preset threshold value.
Mode two: Figure 15 is the plan view of scene shown in Fig. 9.In fig .15, Fig. 9 is suitably eliminated In some elements.Figure 16 is the top view for Figure 15.
As shown in figure 15, viewing area still may be located at the surface of drop point D, and may be located at perpendicular In straight plane.Erecting between being different from bottom aforesaid way one, viewing area and target object 920 Straight distance can be self-adaptative adjustment.Specifically, light source point S can be determined according to second position information And vertical distance h between bottom target object 920, bottom light source point S and target object 920 Between vertical distance h and the height c of target object, determine viewing area and target object 920 end Vertical distance dh between portion, as shown in figure 15.I.e. dh is the function of h and c, can be expressed as dh=f(h,c)。
It addition, as it has been described above, viewing area is positioned at the surface of drop point D, the most in a top view, fall In the projection of some D should be in the view field of viewing area or the two has certain overlap, but In Figure 16, in order to more clearly visible represent the viewing area deflection angle relative to X/Y plane, therefore The view field of the viewing area illustrated is in the right side of drop point projection.Should be understood that Figure 16 is only In order to help those skilled in the art to be more fully understood that the embodiment of the present invention, and the non-display embodiment of the present invention Scope.As shown in figure 16, in order to adapt to the comfort level of human eye viewing, viewing area and X/Y plane Angle can be equal to the angle of luminous ray L and X/Y plane, i.e. β.
1006, control to show the multimedia messages of target object 920 correspondence in above-mentioned viewing area.
Should be understood that the size of the sequence number of above-mentioned each process is not meant to the priority of execution sequence, each process Execution sequence should determine with its function and internal logic, and should be to the implementation process of the embodiment of the present invention Constitute any restriction.Such as, step 1004 and 1005 can be performed in parallel.
In the embodiment of the present invention, by according to the image of first area in scene, determining visible ray indicator According to the position of drop point, the luminous ray sent, in the position of the drop point of first area, determines that drop point is corresponding Target object, and control the multimedia messages that display device display target object is corresponding, it is possible to ensure and use The accuracy that family is mutual such that it is able to promote Consumer's Experience.
Figure 17 is the schematic block of the equipment controlling display multimedia messages according to an embodiment of the invention Figure.The equipment 1700 of Figure 17 includes acquiring unit 1710, first determines unit 1720, second determines Unit 1730 and control unit 1740.
Acquiring unit 1710 obtains the image of first area in scene.First determines that unit 1720 is according to The image in one region, determines that primary importance information, primary importance information are used for indicating visible ray in scene to refer to Show the position of luminous ray that device sends drop point in the first region.Second determines unit 1730 basis Primary importance information, determines the target object that drop point is corresponding in the first region, and determines target object pair The multimedia messages answered.Control unit 1740 controls display device display multimedia messages.
In the embodiment of the present invention, by according to the image of first area in scene, determining visible ray indicator According to the position of drop point, the luminous ray sent, in the position of the drop point of first area, determines that drop point is corresponding Target object, and control the multimedia messages that display device display target object is corresponding, it is possible to ensure and use The accuracy that family is mutual such that it is able to promote Consumer's Experience.
Alternatively, as an embodiment, equipment 1700 can also include that the 3rd determines unit 1750.
Acquiring unit 1710 can also obtain scene before controlling display device display multimedia messages Image.First determines that unit 1720 can also be according to the image of scene and the image of first area, really Determining second position information, second position information is for indicating the position of the light source point of visible ray indicator.
3rd determines that unit 1750 can determine in display according to primary importance information and second position information For showing the viewing area of multimedia messages on equipment.
Control unit 1740 can control display device and show multimedia messages on the display region.
Alternatively, as another embodiment, by the longitudinal axis of the central point of viewing area in the horizontal plane Projection line is parallel with luminous ray projection line in the horizontal plane.
Alternatively, as another embodiment, first determines that unit 1720 can also be according to the image of scene With the image of first area, determine the 3rd positional information, the 3rd positional information be used for indicating luminous ray with The intersection point of display device.
3rd determines that unit 1750 can be according to primary importance information, second position information and the 3rd position Information, determines viewing area.Wherein, viewing area is vertical with luminous ray or viewing area is positioned at water In plane；The view field of viewing area and target object does not blocks, intersection point projection in the horizontal plane Vertical dimension between point and viewing area view field in the horizontal plane is less than the threshold value preset, intersection point It is positioned at the view field of target object.
Alternatively, as another embodiment, viewing area may be located at the surface of drop point.
3rd determines that unit 1750 can determine viewing area according to primary importance information and second position information Territory；Wherein, viewing area is vertical with luminous ray；Erecting between viewing area and the top of target object Straight distance is in default distance range.
Alternatively, as another embodiment, viewing area may be located at the surface of drop point, and viewing area Territory may be located in perpendicular.
3rd determines that unit 1750 can determine visible light source and target object according to second position information Bottom between vertical distance；According to the vertical distance between visible light source and the bottom of target object with And the height of target object, determine the vertical distance between viewing area and the bottom of target object.
Alternatively, as another embodiment, second determines that unit 1730 can be at space object Information Number According in storehouse, primary importance information is mated, the target object corresponding to determine drop point, and from space thing Obtaining the attribute information of target object in body information database, wherein space object information database is used for depositing The positional information of the object in storage first area and attribute information.Second determines that unit 1730 is all right According to the attribute information of target object, multimedia information data storehouse obtains many matchmakers that target object is corresponding Body information, multimedia information data storehouse is for storing the attribute information correspondence respectively of the object in first area Multimedia messages.
Other function of equipment 1700 and operation are referred to the embodiment of the method for above figure 1 to Figure 16 Process, in order to avoid repeating, here is omitted.
Figure 18 is the schematic block of the equipment controlling display multimedia messages according to another embodiment of the present invention Figure.The equipment 1800 of Figure 18 includes memorizer 1810 and processor 1820.
Memorizer 1810 can include random access memory, flash memory, read only memory, able to programme read-only deposit Reservoir, nonvolatile memory or depositor etc..Processor 1820 can be central processing unit (Central Processing Unit, CPU).
Memorizer 1810 is used for storing executable instruction.Processor 1820 can perform memorizer 1810 The executable instruction of middle storage, is used for: obtain the image of first area in scene；According to first area Image, determines that primary importance information, primary importance information are used for indicating visible ray indicator in scene to send The position of luminous ray drop point in the first region；According to primary importance information, determine in the firstth district The target object that in territory, drop point is corresponding, and determine the multimedia messages that target object is corresponding；Control display to set Standby display multimedia messages.
In the embodiment of the present invention, by according to the image of first area in scene, determining visible ray indicator According to the position of drop point, the luminous ray sent, in the position of the drop point of first area, determines that drop point is corresponding Target object, and control the multimedia messages that display device display target object is corresponding, it is possible to ensure and use The accuracy that family is mutual such that it is able to promote Consumer's Experience.
Alternatively, as an embodiment, processor 1820 can also show many controlling display device Before media information, obtain the image of scene.Processor 1820 can also be according to the image of scene and The image in one region, determines second position information, and second position information is for indicating visible ray indicator The position of light source point.
Processor 1820 can determine on the display device according to primary importance information and second position information For showing the viewing area of multimedia messages.
Processor 1820 can control display device and show multimedia messages on the display region.
Alternatively, as another embodiment, by the longitudinal axis of the central point of viewing area in the horizontal plane Projection line is parallel with luminous ray projection line in the horizontal plane.
Alternatively, as another embodiment, processor 1820 can also be according to the image of scene and first The image in region, determines that the 3rd positional information, the 3rd positional information are used for indicating luminous ray to set with display Standby intersection point.
Processor 1820 can according to primary importance information, second position information and the 3rd positional information, Determine viewing area.Wherein, viewing area is vertical with luminous ray or viewing area is positioned at horizontal plane； The view field of viewing area and target object does not blocks, intersection point subpoint in the horizontal plane and display Vertical dimension between the view field in the horizontal plane of region is less than the threshold value preset, and intersection point is positioned at target In the view field of object.
Alternatively, as another embodiment, viewing area may be located at the surface of drop point.
Processor 1820 can determine viewing area according to primary importance information and second position information；Its In, viewing area is vertical with luminous ray；Vertical distance between viewing area and the top of target object In default distance range.
Alternatively, as another embodiment, viewing area may be located at the surface of drop point, and viewing area Territory may be located in perpendicular.
Processor 1820 can determine the bottom of visible light source and target object according to second position information Between vertical distance；According to vertically distance and target between visible light source and the bottom of target object The height of object, determines the vertical distance between viewing area and the bottom of target object.
Alternatively, as another embodiment, processor 1820 can be in space object information database Primary importance information is mated, the target object corresponding to determine drop point, and from space object information Obtaining the attribute information of target object in data base, wherein space object information database is used for storage first The positional information of the object in region and attribute information.Processor 1820 can also be according to target object Attribute information, multimedia information data storehouse obtains multimedia messages corresponding to target object, many matchmakers Body information database is believed for the multimedia that the attribute information storing the object in first area is the most corresponding Breath.
Other function of equipment 1800 and operation are referred to the embodiment of the method for above figure 1 to Figure 16 Process, in order to avoid repeating, here is omitted.
Figure 19 is the schematic block diagram of display system according to embodiments of the present invention.The system 1900 of Figure 19 Including controlling the display equipment 1910 of multimedia messages, image capture device 1920, display device 1930 With visible ray indicator 1940.
Image capture device 1920 gathers the image of first area in scene, and to controlling display multimedia The equipment of information sends the image of first area.Control the equipment 1910 of display multimedia messages from image Collecting device 1920 obtains the image of first area in scene, according to the image of first area, determines One positional information, primary importance information is visible for indicate visible ray indicator 1940 in scene to send The position of light drop point in the first region, according to primary importance information, determines to fall in the first region The target object that point is corresponding, and determine the multimedia messages that target object is corresponding, then control display device Display multimedia messages.Display device 1930 is aobvious under controlling the control of equipment of display multimedia messages Show multimedia messages.
In the embodiment of the present invention, by controlling the equipment of display multimedia messages according to first area in scene Image, determine luminous ray that visible ray indicator sends in the position of the drop point of first area, according to The position of drop point determines the target object that drop point is corresponding, and it is corresponding to control display device display target object Multimedia messages, it is possible to ensure the accuracy mutual with user such that it is able to promote Consumer's Experience.
Alternatively, as an embodiment, image capture device 1920 can gather the image of scene, And the image of scene is sent to equipment 1910.
Before equipment 1910 can also show multimedia messages controlling display device 1930, adopt from image Collection equipment 1920 obtains the image of scene.Equipment 1910 can also be according to the image of scene and first area Image, determine second position information, second position information is for indicating visible ray indicator 1940 The position of light source point.
Equipment 1910 can determine at display device 1930 according to primary importance information and second position information The upper viewing area for showing multimedia messages.
Equipment 1910 can control display device 1930 and show multimedia messages on the display region.Display Equipment 1930 can show multimedia messages under the control of equipment 1910 on the display region.
Alternatively, as another embodiment, by the longitudinal axis of the central point of viewing area in the horizontal plane Projection line is parallel with luminous ray projection line in the horizontal plane.
Alternatively, as another embodiment, equipment 1910 can also be according to the image of scene and the firstth district The image in territory, determines that the 3rd positional information, the 3rd positional information are used for indicating luminous ray and display device The intersection point of 1930.
Equipment 1910 can be according to primary importance information, second position information and the 3rd positional information, really Determine viewing area.Wherein, viewing area is vertical with luminous ray or viewing area is positioned at horizontal plane； The view field of viewing area and target object does not blocks, intersection point subpoint in the horizontal plane and display Vertical dimension between the view field in the horizontal plane of region is less than the threshold value preset, and intersection point is positioned at target In the view field of object.
Alternatively, as another embodiment, viewing area may be located at the surface of drop point.
Equipment 1910 can determine viewing area according to primary importance information and second position information；Wherein, Viewing area is vertical with luminous ray；Vertical distance between viewing area and the top of target object is in advance If distance range in.
Alternatively, as another embodiment, viewing area may be located at the surface of drop point, and viewing area Territory may be located in perpendicular.
Equipment 1910 according to second position information, can determine visible light source and target object bottom it Between vertical distance；According to vertically distance and object between visible light source and the bottom of target object The height of body, determines the vertical distance between viewing area and the bottom of target object.
Alternatively, as another embodiment, equipment 1910 can be right in space object information database Primary importance information is mated, the target object corresponding to determine drop point, and from space object Information Number According to obtaining the attribute information of target object in storehouse, wherein space object information database is for storage the firstth district The positional information of the object in territory and attribute information.Equipment 1910 can also be according to the genus of target object Property information, multimedia information data storehouse obtains multimedia messages corresponding to target object, multimedia is believed Breath data base is for storing the multimedia messages of the attribute information correspondence respectively of the object in first area.
Other function of equipment 1910 and operation are referred to the embodiment of the method for above figure 1 to Figure 16 Process, in order to avoid repeating, here is omitted.
Those of ordinary skill in the art are it is to be appreciated that combine each of the embodiments described herein description The unit of example and algorithm steps, it is possible to electronic hardware or computer software and the knot of electronic hardware Incompatible realization.These functions perform with hardware or software mode actually, depend on the spy of technical scheme Fixed application and design constraint.Professional and technical personnel can use not Tongfang to each specifically should being used for Method realizes described function, but this realization is it is not considered that beyond the scope of this invention.
Those skilled in the art is it can be understood that arrive, and for convenience and simplicity of description, above-mentioned retouches The specific works process of system, device and the unit stated, is referred to the correspondence in preceding method embodiment Process, does not repeats them here.
In several embodiments provided herein, it should be understood that disclosed system, device and Method, can realize by another way.Such as, device embodiment described above is only shown Meaning property, such as, the division of described unit, be only a kind of logic function and divide, actual can when realizing There to be other dividing mode, the most multiple unit or assembly can in conjunction with or be desirably integrated into another System, or some features can ignore, or do not perform.Another point, shown or discussed each other Coupling direct-coupling or communication connection can be the INDIRECT COUPLING by some interfaces, device or unit Or communication connection, can be electrical, machinery or other form.
The described unit illustrated as separating component can be or may not be physically separate, makees The parts shown for unit can be or may not be physical location, i.e. may be located at a place, Or can also be distributed on multiple NE.Can select according to the actual needs part therein or The whole unit of person realizes the purpose of the present embodiment scheme.
It addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit In, it is also possible to it is that unit is individually physically present, it is also possible to two or more unit are integrated in one In individual unit.
If described function realizes using the form of SFU software functional unit and as independent production marketing or make Used time, can be stored in a computer read/write memory medium.Based on such understanding, the present invention The part that the most in other words prior art contributed of technical scheme or the portion of this technical scheme Dividing and can embody with the form of software product, this computer software product is stored in a storage medium In, including some instructions with so that computer equipment (can be personal computer, server, Or the network equipment etc.) perform all or part of step of method described in each embodiment of the present invention.And it is front The storage medium stated includes: USB flash disk, portable hard drive, read only memory (ROM, Read-Only Memory), Random access memory (RAM, Random Access Memory), magnetic disc or CD etc. are various can To store the medium of program code.
The above, the only detailed description of the invention of the present invention, but protection scope of the present invention is not limited to In this, any those familiar with the art, can be easily in the technical scope that the invention discloses Expect change or replace, all should contain within protection scope of the present invention.Therefore, the protection of the present invention Scope should be as the criterion with described scope of the claims.

Claims (15)

1. the method controlling to show multimedia messages, it is characterised in that including:
Obtain the image of first area in scene；
According to the image of described first area, determine that primary importance information, described primary importance information are used for Indicate luminous ray that in described scene, visible ray indicator the sends drop point in described first area Position；
According to described primary importance information, determine the object that drop point is corresponding described in described first area Body, and determine the multimedia messages that described target object is corresponding；
Control display device and show described multimedia messages.
Method the most according to claim 1, it is characterised in that show at described control display device Before showing described multimedia messages, also include:
Obtain the image of described scene；
Image according to described scene and the image of described first area, determine second position information, described Second position information is for indicating the position of the light source point of described visible ray indicator；
Determine on described display device for showing according to described primary importance information and second position information Show the viewing area of described multimedia messages；
Described control display device shows described multimedia messages, including:
Control described display device on described viewing area, show described multimedia messages.
Method the most according to claim 2, it is characterised in that by described viewing area The longitudinal axis of heart point projection line in the horizontal plane is parallel with described luminous ray projection line in the horizontal plane.
Method the most according to claim 3, it is characterised in that also include:
Image according to described scene and the image of described first area, determine the 3rd positional information, described 3rd positional information is for indicating the intersection point of described luminous ray and described display device；
Described determine for showing described multimedia according to described primary importance information and second position information The viewing area of information, including:
According to described primary importance information, described second position information and described 3rd positional information, determine Described viewing area；
Wherein, described viewing area is vertical with described luminous ray or described viewing area is positioned at horizontal plane In；The view field of described viewing area and described target object does not blocks, and described intersection point is at horizontal plane On subpoint and described viewing area view field in the horizontal plane between vertical dimension less than pre- If threshold value, described intersection point is positioned at the view field of described target object.
Method the most according to claim 3, it is characterised in that described viewing area is positioned at described The surface of drop point；
Described according to described primary importance information and second position information determine on described display device use In the viewing area of the described multimedia messages of display, including:
Described viewing area is determined according to described primary importance information and second position information；Wherein, described Viewing area is vertical with described luminous ray；Between the top of described viewing area and described target object Vertically distance is in default distance range.
Method the most according to claim 3, it is characterised in that described viewing area is positioned at described The surface of drop point, and described viewing area is positioned at perpendicular；
Described according to described primary importance information and second position information determine on described display device use In the viewing area of the described multimedia messages of display, including:
According to described second position information, determine between the bottom of described visible light source and described target object Vertical distance；
Vertically distance and described mesh between bottom according to described visible light source and described target object The height of mark object, determines the vertical distance between the bottom of described viewing area and described target object.
Method the most according to any one of claim 1 to 6, it is characterised in that described basis Described primary importance information, determines the target object that drop point is corresponding described in described first area, and really The multimedia messages that fixed described target object is corresponding, including:
Described primary importance information is mated by space object information database, falls described in determining The target object that point is corresponding, and from described space object information database, obtain the genus of described target object Property information, wherein said space object information database is for storing the position of object in described first area Confidence breath and attribute information；
According to the attribute information of described target object, multimedia information data storehouse obtains described object The multimedia messages that body is corresponding, described multimedia information data storehouse is for storing the thing in described first area The multimedia messages that the attribute information of body is the most corresponding.
8. the equipment controlling to show multimedia messages, it is characterised in that including:
Acquiring unit, for obtaining the image of first area in scene；
First determines unit, for the image of first area obtained according to described acquiring unit, determines the One positional information, described primary importance information can for indicate that visible ray indicator in described scene sends See the position of light drop point in described first area；
Second determines unit, for determining, according to described first, the primary importance information that unit determines, determines The target object that drop point is corresponding described in described first area, and determine that described target object is corresponding many Media information；
For controlling display device, control unit, shows that described second determines the multimedia letter that unit determines Breath.
Equipment the most according to claim 8, it is characterised in that also include that the 3rd determines unit；
Described acquiring unit, is additionally operable to before described control display device shows described multimedia messages, Obtain the image of described scene；
Described first determines unit, is additionally operable to the image according to described scene and the figure of described first area Picture, determines second position information, and described second position information is for indicating the light of described visible ray indicator The position of source point；
Described 3rd determines unit, for determining according to described primary importance information and second position information For showing the viewing area of described multimedia messages on described display device；
Described control unit, shows described specifically for controlling described display device on described viewing area Multimedia messages.
Equipment the most according to claim 9, it is characterised in that by described viewing area The longitudinal axis of heart point projection line in the horizontal plane is parallel with described luminous ray projection line in the horizontal plane.
11. equipment according to claim 10, it is characterised in that
Described first determines unit, is additionally operable to the image according to described scene and the figure of described first area Picture, determines that the 3rd positional information, described 3rd positional information are used for indicating described luminous ray aobvious with described Show the intersection point of equipment；
Described 3rd determines unit, specifically for: according to described primary importance information, the described second position Information and described 3rd positional information, determine described viewing area；Wherein, described viewing area is with described Luminous ray is vertical or described viewing area is positioned at horizontal plane；Described viewing area and described object The view field of body does not blocks, and described intersection point subpoint in the horizontal plane and described viewing area are at water The vertical dimension between view field in plane is less than the threshold value preset, and described intersection point is positioned at described target In the view field of object.
12. equipment according to claim 10, it is characterised in that described viewing area is positioned at institute State the surface of drop point；
Described 3rd determines unit, specifically for: according to described primary importance information and second position information Determine described viewing area；Wherein, described viewing area is vertical with described luminous ray；Described viewing area Vertical distance between the top of territory and described target object is in default distance range.
13. equipment according to claim 10, it is characterised in that described viewing area is positioned at institute State the surface of drop point, and described viewing area is positioned at perpendicular；
Described 3rd determines unit, specifically for: according to described second position information, determine described visible Vertical distance between the bottom of light source and described target object；According to described visible light source and described target Vertically distance and the height of described target object between the bottom of object, determine described viewing area with Vertical distance between the bottom of described target object.
14. according to Claim 8 to the equipment according to any one of 13, it is characterised in that described Two determine unit, specifically for:
Described primary importance information is mated by space object information database, falls described in determining The target object that point is corresponding, and from described space object information database, obtain the genus of described target object Property information, wherein said space object information database is for storing the position of object in described first area Confidence breath and attribute information；
According to the attribute information of described target object, multimedia information data storehouse obtains described object The multimedia messages that body is corresponding, described multimedia information data storehouse is for storing the thing in described first area The multimedia messages that the attribute information of body is the most corresponding.
15. 1 kinds of display systems, it is characterised in that including:
The equipment controlling display multimedia messages as according to any one of claim 8 to 14, image Collecting device, display device and visible ray indicator；Wherein,
Described image capture device, is used for: gather the image of first area in scene, and to described control The equipment of display multimedia messages sends the image of described first area；
Described visible ray indicator, is used for: send luminous ray；
Described display device, for showing institute under the control of the described equipment controlling display multimedia messages State multimedia messages.
CN201310388528.6A 2013-08-30 2013-08-30 Control the method, apparatus and system of display multimedia messages Active CN104424869B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310388528.6A CN104424869B (en) 2013-08-30 2013-08-30 Control the method, apparatus and system of display multimedia messages

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310388528.6A CN104424869B (en) 2013-08-30 2013-08-30 Control the method, apparatus and system of display multimedia messages

Publications (2)

Publication Number Publication Date
CN104424869A CN104424869A (en) 2015-03-18
CN104424869B true CN104424869B (en) 2016-11-09

Family

ID=52973703

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310388528.6A Active CN104424869B (en) 2013-08-30 2013-08-30 Control the method, apparatus and system of display multimedia messages

Country Status (1)

Country Link
CN (1) CN104424869B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2334075Y (en) * 1998-08-04 1999-08-18 刘吉星 Laser designator with dynamic display
JP2007231585A (en) * 2006-02-28 2007-09-13 Nagashima Imono Kk Light-emitting indicator for underground structure
CN101044547A (en) * 2004-10-20 2007-09-26 富士通天株式会社 Display device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2334075Y (en) * 1998-08-04 1999-08-18 刘吉星 Laser designator with dynamic display
CN101044547A (en) * 2004-10-20 2007-09-26 富士通天株式会社 Display device
JP2007231585A (en) * 2006-02-28 2007-09-13 Nagashima Imono Kk Light-emitting indicator for underground structure

Also Published As

Publication number Publication date
CN104424869A (en) 2015-03-18

Similar Documents

Publication Publication Date Title
US8988343B2 (en) Method of automatically forming one three-dimensional space with multiple screens
US9886102B2 (en) Three dimensional display system and use
US7796134B2 (en) Multi-plane horizontal perspective display
US8717360B2 (en) Presenting a view within a three dimensional scene
US9298070B2 (en) Participant collaboration on a displayed version of an object
CN109791442A (en) Surface model building system and method
US20180292971A1 (en) Zero Parallax Drawing within a Three Dimensional Display
US9703400B2 (en) Virtual plane in a stylus based stereoscopic display system
US9467685B2 (en) Enhancing the coupled zone of a stereoscopic display
US20180113593A1 (en) Multi-view display viewing zone layout and content assignment
US10565767B2 (en) Systems and methods for utilizing a device as a marker for augmented reality content
CN103327217B (en) A kind of method for processing video frequency and device
JP2024054137A (en) Image Display System
CN107168534B (en) Rendering optimization method and projection method based on CAVE system
US11508141B2 (en) Simple environment solver using planar extraction
US11620792B2 (en) Fast hand meshing for dynamic occlusion
CN106980378B (en) Virtual display method and system
CN105282535B (en) 3D stereo projection systems and its projecting method under three-dimensional space environment
CN208506731U (en) Image display systems
US20110085018A1 (en) Multi-User Video Conference Using Head Position Information
US20220075477A1 (en) Systems and/or methods for parallax correction in large area transparent touch interfaces
CN104345885A (en) Three-dimensional tracking state indicating method and display device
CN104424869B (en) Control the method, apparatus and system of display multimedia messages
CN110060349A (en) A method of extension augmented reality head-mounted display apparatus field angle
JP6709426B2 (en) Image display control device and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant