CN104424869A

CN104424869A - Multimedia information display control method, equipment and system

Info

Publication number: CN104424869A
Application number: CN201310388528.6A
Authority: CN
Inventors: 宋星光; 廉士国; 胡昌启
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2013-08-30
Filing date: 2013-08-30
Publication date: 2015-03-18
Anticipated expiration: 2033-08-30
Also published as: CN104424869B

Abstract

The invention discloses a multimedia information display control method, equipment and system. The multimedia information display control method includes that acquiring an image of a first region in a scene; confirming first position information according to the image of the first region, wherein the first position information is used for indicating the drop point position of the visible light emitted from a visible light indicator in the scene in the first region; confirming a target object corresponding to the drop point in the first region according to the first position information, and confirming the multimedia information corresponding to the target object; controlling display equipment to display the multimedia information. According to the embodiment, through confirming the drop point position of the visible light emitted from the visible light indicator in the first region according to the image of the first region in the scene, confirming the target object corresponding to the drop point according to the drop point position, and controlling the display equipment to display the multimedia information corresponding to the target object, the interaction precision between the multimedia information and user can be guaranteed, and accordingly the user experience can be improved.

Description

Control the method, apparatus and system of display multimedia messages

Technical field

The present invention relates to areas of information technology, and particularly, relate to the method, apparatus and system controlling display multimedia messages.

Background technology

Along with the development of technology, the product of various " suspension " display techniques such as transparent screen, holographic mould or holographic display is adopted to be applied to business gradually with life.Some need " actual situation combinations " interaction scenarios in, as in the scenes such as meeting, exhibition or displaying, employing " suspension " display technique, display position and mode ever-changing, qualitative leap will be brought to Consumer's Experience.

On the other hand, from the angle of user, no matter which kind of degree is display technique develop into, and it is all unluckily for lacking mutual or that interactive means is single experience.And along with the appearance of new display technique, traditional interaction technique has also welcome new development opportunity.

In existing " actual situation combination " interaction scenarios, interactive mode is based on gesture interaction.But gesture interaction computation complexity is high, mutual real-time and accuracy are difficult to ensure, thus cause poor user experience.

Summary of the invention

The embodiment of the present invention provides the method, apparatus and system controlling display multimedia messages, can promote Consumer's Experience.

First aspect, provides a kind of method controlling to show multimedia messages, comprising: the image obtaining first area in scene; According to the image of described first area, determine primary importance information, described primary importance information is used to indicate the position of the drop point of luminous ray in described first area that in described scene, visible ray indicator sends; According to described primary importance information, determine the target object that drop point is corresponding described in described first area, and determine the multimedia messages that described target object is corresponding; Control display device and show described multimedia messages.

In conjunction with first aspect, in the implementation that the first is possible, before described control display device shows described multimedia messages, also comprise: the image obtaining described scene; According to the image of described scene and the image of described first area, determine second place information, described second place information is used to indicate the position of the light source point of described visible ray indicator; Determine on described display device for showing the viewing area of described multimedia messages according to described primary importance information and second place information;

Described control display device shows described multimedia messages, comprising: control described display device and show described multimedia messages on described viewing area.

In conjunction with the first possible implementation of first aspect, in the implementation that the second is possible, parallel with described luminous ray projection line in the horizontal plane by the longitudinal axis projection line in the horizontal plane of the central point of described viewing area.

In conjunction with the implementation that the second of first aspect is possible, in the implementation that the third is possible, also comprise: according to the image of described scene and the image of described first area, determine the 3rd positional information, described 3rd positional information is used to indicate the intersection point of described luminous ray and described display device;

Describedly determine according to described primary importance information and the second place information viewing area showing described multimedia messages, comprising: according to described primary importance information, described second place information and described 3rd positional information, determine described viewing area; Wherein, or described viewing area vertical with described luminous ray, described viewing area is positioned at surface level; The view field of described viewing area and described target object does not block mutually, vertical range between described intersection point subpoint in the horizontal plane and described viewing area view field is in the horizontal plane less than default threshold value, and described intersection point is positioned at the view field of described target object.

In conjunction with the implementation that the second of first aspect is possible, in the 4th kind of possible implementation, described viewing area is positioned at directly over described drop point;

Describedly to determine on described display device, for showing the viewing area of described multimedia messages, to comprise: determine described viewing area according to described primary importance information and second place information according to described primary importance information and second place information; Wherein, described viewing area is vertical with described luminous ray; Vertical distance between the top of described viewing area and described target object is in the distance range preset.

In conjunction with the implementation that the second of first aspect is possible, in the 5th kind of possible implementation, described viewing area is positioned at directly over described drop point, and described viewing area is positioned at perpendicular;

Describedly to determine on described display device for showing the viewing area of described multimedia messages according to described primary importance information and second place information, comprise: according to described second place information, the vertical distance between the bottom determining described visible light source and described target object; According to the height of the vertical distance between described visible light source and the bottom of described target object and described target object, the vertical distance between the bottom determining described viewing area and described target object.

In conjunction with the first possible implementation of first aspect or first aspect to either type in the 5th kind of possible implementation, in the 6th kind of possible implementation, described according to described primary importance information, determine the target object that drop point is corresponding described in described first area, and determine the multimedia messages that described target object is corresponding, comprise: in space object information database, described primary importance information is mated, to determine the target object that described drop point is corresponding, and from described space object information database, obtain the attribute information of described target object, wherein said space object information database is for storing positional information and the attribute information of the object in described first area, according to the attribute information of described target object, in multimedia information data storehouse, obtain multimedia messages corresponding to described target object, described multimedia information data storehouse is for storing the multimedia messages of the attribute information difference correspondence of the object in described first area.

Second aspect, providing a kind of equipment controlling to show multimedia messages, comprising: acquiring unit, for obtaining the image of first area in scene; First determining unit, for the image of first area obtained according to described acquiring unit, determine primary importance information, described primary importance information is used to indicate the position of the drop point of luminous ray in described first area that in described scene, visible ray indicator sends; Second determining unit, for the primary importance information determined according to described first determining unit, determines the target object that drop point is corresponding described in described first area, and determines the multimedia messages that described target object is corresponding; Control module, for controlling the multimedia messages that described second determining unit of display device display is determined.

In conjunction with second aspect, in the implementation that the first is possible, also comprise the 3rd determining unit;

Described acquiring unit, also for before showing described multimedia messages at described control display device, obtains the image of described scene; Described first determining unit, also for according to the image of described scene and the image of described first area, determine second place information, described second place information is used to indicate the position of the light source point of described visible ray indicator; Described 3rd determining unit, for determining on described display device for showing the viewing area of described multimedia messages according to described primary importance information and second place information; Described control module, shows described multimedia messages specifically for controlling described display device on described viewing area.

In conjunction with the first possible implementation of second aspect, in the implementation that the second is possible, parallel with described luminous ray projection line in the horizontal plane by the longitudinal axis projection line in the horizontal plane of the central point of described viewing area.

In conjunction with the implementation that the second of second aspect is possible, in the implementation that the third is possible, described first determining unit, also for according to the image of described scene and the image of described first area, determine the 3rd positional information, described 3rd positional information is used to indicate the intersection point of described luminous ray and described display device; Described 3rd determining unit, specifically for: according to described primary importance information, described second place information and described 3rd positional information, determine described viewing area; Wherein, or described viewing area vertical with described luminous ray, described viewing area is positioned at surface level; The view field of described viewing area and described target object does not block mutually, vertical range between described intersection point subpoint in the horizontal plane and described viewing area view field is in the horizontal plane less than default threshold value, and described intersection point is positioned at the view field of described target object.

In conjunction with the implementation that the second of second aspect is possible, in the 4th kind of possible implementation, described viewing area is positioned at directly over described drop point;

Described 3rd determining unit, specifically for: determine described viewing area according to described primary importance information and second place information; Wherein, described viewing area is vertical with described luminous ray; Vertical distance between the top of described viewing area and described target object is in the distance range preset.

In conjunction with the implementation that the second of second aspect is possible, in the 5th kind of possible implementation, described viewing area is positioned at directly over described drop point, and described viewing area is positioned at perpendicular;

Described 3rd determining unit, specifically for: according to described second place information, the vertical distance between the bottom determining described visible light source and described target object; According to the height of the vertical distance between described visible light source and the bottom of described target object and described target object, the vertical distance between the bottom determining described viewing area and described target object.

In conjunction with the first possible implementation of second aspect or second aspect to either type in the 5th kind of possible implementation, in the 6th kind of possible implementation, described second determining unit, specifically for: in space object information database, described primary importance information is mated, to determine the target object that described drop point is corresponding, and from described space object information database, obtaining the attribute information of described target object, wherein said space object information database is for storing positional information and the attribute information of the object in described first area; According to the attribute information of described target object, in multimedia information data storehouse, obtain multimedia messages corresponding to described target object, described multimedia information data storehouse is for storing the multimedia messages of the attribute information difference correspondence of the object in described first area.

The third aspect, provides a kind of display system, comprising: the equipment controlling display multimedia messages as above, image capture device, display device and visible ray indicator; Wherein, described image capture device, for: the image gathering first area in scene, and the image sending described first area to the described equipment controlling display multimedia messages; The described equipment controlling display multimedia messages, for: the image obtaining first area scene from described image capture device; According to the image of described first area, determine primary importance information, described primary importance information is used to indicate the position of the drop point of luminous ray in described first area that described in described scene, visible ray indicator sends; According to described primary importance information, determine the target object that drop point is corresponding described in described first area, and determine the multimedia messages that described target object is corresponding; Control display device and show described multimedia messages; Described display device, for showing described multimedia messages under the control of the equipment of described control display multimedia messages.

In the embodiment of the present invention, by the image according to first area in scene, determine that luminous ray that visible ray indicator sends is in the position of the drop point of first area, the target object that drop point is corresponding is determined according to the position of drop point, and control multimedia messages corresponding to display device display-object object, the accuracy with user interactions can be ensured, thus can Consumer's Experience be promoted.

Accompanying drawing explanation

In order to be illustrated more clearly in the technical scheme of the embodiment of the present invention, be briefly described to the accompanying drawing used required in the embodiment of the present invention below, apparently, accompanying drawing described is below only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.

Fig. 1 is the indicative flowchart showing the method for multimedia messages according to the control of the embodiment of the present invention.

Fig. 2 is the schematic diagram of the scene can applying the embodiment of the present invention.

Fig. 3 is the schematic diagram of the process controlling the method showing multimedia messages according to an embodiment of the invention.

Fig. 4 is the rough schematic view of the scene of Fig. 2.

Fig. 5 is the three-dimensional view of transparent screen in scene shown in Fig. 2.

Fig. 6 is the vertical view for Fig. 5.

Fig. 7 is the plan view of scene shown in Fig. 2.

Fig. 8 is the vertical view for Fig. 7.

Fig. 9 is the schematic diagram of another scene according to the embodiment of the present invention.

Figure 10 is the schematic diagram of the process controlling the method showing multimedia messages according to another embodiment of the present invention.

Figure 11 is the rough schematic view of the scene of Fig. 9.

Figure 12 is the three-dimensional view showing table region in scene shown in Fig. 9.

Figure 13 is the plan view of scene shown in Fig. 9.

Figure 14 is the vertical view for Figure 13.

Figure 15 is the plan view of scene shown in Fig. 9.

Figure 16 is the vertical view for Figure 15.

Figure 17 is the schematic block diagram controlling the equipment showing multimedia messages according to an embodiment of the invention.

Figure 18 is the schematic block diagram controlling the equipment showing multimedia messages according to another embodiment of the present invention.

Figure 19 is the schematic block diagram of the display system according to the embodiment of the present invention.

Embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is a part of embodiment of the present invention, instead of whole embodiment.Based on the embodiment in the present invention, the every other embodiment that those of ordinary skill in the art obtain under the prerequisite not making creative work, all should belong to the scope of protection of the invention.

The embodiment of the present invention can be applied in the displayed scene of actual situation combination, such as, in the displayed scene that the actual situations such as meeting, exhibition or displaying combine.In these scenes, there is actual object, and the relevant information of actual object can be presented based on the selection of user to actual object, thus reach the display effect of actual situation combination.In the displayed scene that actual situation combines, normal employing " suspension " display technique, such as, adopt various " suspension " display techniques such as transparent screen, holographic mould or holographic display, realize the display effect that actual situation combines.

Fig. 1 is the indicative flowchart showing the method for multimedia messages according to the control of the embodiment of the present invention.The method of Fig. 1 is performed by the equipment controlling to show multimedia messages, such as, has computing machine or other electronic equipment of arithmetic capability.

110, obtain the image of first area in scene.

Such as, first area can be the some regions in scene.Such as, in the scene of showing, show that the region on table can be called first area.

120, according to the image of first area, determine primary importance information, primary importance information is used to indicate the position of the luminous ray drop point in the first region that in scene, visible ray indicator sends.

130, according to primary importance information, determine the target object that drop point is corresponding in the first region, and determine the multimedia messages that target object is corresponding.

In the embodiment of the present invention, target object is the object of necessary being.Such as, the information of target object can comprise the attribute information etc. of target object.Such as, the information of target object can comprise position, the information such as mark or size of target object.

Multimedia messages can comprise the information such as the pattern relevant to target object, picture, word or video.

140, control display device display multimedia messages.

In the embodiment of the present invention, display device can be " suspension " display product, such as transparent screen, holographic mould, line holographic projections or other Transparence Display medium etc.

In the embodiment of the present invention, visible ray indicator can send luminous ray, points to jobbie in space.Such as, visible ray indicator can comprise laser pen, mobile phone electric torch, iPhone Smart Dot laser or light emitting diode (Light Emitting Diode) light-beam pointer etc.

In above-mentioned scene, the image of first area can be image capture device collection, such as digital camera etc.When the user in scene utilizes visible ray indicator to point to the target object of first area, image capture device can gather the image of first area.The equipment controlling display multimedia messages can obtain the image of first area from image capture device, according to the drop point of image determination luminous ray in first area, thus can determine the target object pointed by luminous ray.Then multimedia messages that can be corresponding according to the information determination target object of target object, and control display device display multimedia messages.

At present, in the displayed scene that this actual situation combines, be all the target object coming pointed by consumer positioning based on the gesture of user, the multimedia messages that then display-object object is corresponding on the display device.Because the computation complexity of gesture interaction is very high, mutual accuracy is difficult to ensure, such as, distant at some, object is more and arrange comparatively under complicated situation, is difficult to the interested object of accurate consumer positioning, can causes the non-constant of Consumer's Experience.And in the embodiment of the present invention, the luminous ray sent due to visible ray indicator has clear and definite directive property, therefore by the image according to first area in scene, determine the drop point of luminous ray in first area, position according to drop point can locate target object corresponding to drop point accurately, then control the multimedia messages that display device display-object object is corresponding, the mutual accuracy with user can be ensured, thus can Consumer's Experience be promoted.

Alternatively, as another embodiment, in step 130, can mate primary importance information in space object information database, to determine the target object that drop point is corresponding, and from space object information database, obtain the attribute information of target object, wherein space object information database is for storing positional information and the attribute information of the object in first area.According to the attribute information of target object, can obtain the multimedia messages that target object is corresponding in multimedia information data storehouse, multimedia information data storehouse is for storing the multimedia messages of the attribute information difference correspondence of the object in first area.

Such as, may be used for the position and other attribute information that store each object in first area in space object information database.Such as, attribute information can comprise the information such as the mark of object or the size of object.So, according to the position of drop point, can determine in space object information database and the target object that the position of drop point matches, thus obtain the attribute information of target object.

Such as, multimedia information data storehouse may be used for storing multimedia messages corresponding to the attribute information of each object of first area.Such as, in multimedia information data storehouse, the corresponding relation between the mark of object and multimedia messages can be stored.According to the mark of target object, the multimedia messages that target object is corresponding can be obtained from multimedia information data storehouse.

Alternatively, as an embodiment, before step 140, can obtain the image of scene, according to the image of scene and the image of first area, determine second place information, second place information is used to indicate the position of visible light source in scene.Can determine on the display device for showing the viewing area of multimedia messages according to primary importance information and second place information.In step 140, display device can be controlled and show multimedia messages on above-mentioned viewing area.

Such as, according to pixel distribution, the information such as brightness and color of both images of the image of scene and first area, the feature of drop point and visible light source can be identified, thus determines primary importance information and second place information.This process with reference to existing process, can repeat no more.

Such as, primary importance information and second place information all can represent with coordinate.Such as, based on display device setting space rectangular coordinate system, so can represent primary importance information with the coordinate of drop point in rectangular coordinate system in space, second place information can be represented with the coordinate of visible light source in rectangular coordinate system in space.

According to primary importance information and second place information, and some information of target object self, the viewing area of multimedia messages can be determined, viewing area should meet the requirement of the angular field of view of human eye, and user oriented, comfortable viewed status can be in during the multimedia messages that user is shown on viewing display area, thus can Consumer's Experience be promoted.

Such as, above-mentioned viewing area can refer to the region on real stereo display screen, also can refer to the region in invisible display medium.

Alternatively, as another embodiment, parallel with luminous ray projection line in the horizontal plane by the longitudinal axis projection line in the horizontal plane of the central point of viewing area.As a rule, user operates visible ray indicator, can think that the direction of sight line of user is identical with the direction of the luminous ray of visible ray indicator.Therefore, the deflection angle of the viewing area projection in the horizontal plane longitudinal axis is with respect to the horizontal plane identical with the deflection angle of the luminous ray projection longitudinal axis with respect to the horizontal plane in the horizontal plane, that is, parallel with luminous ray projection line in the horizontal plane by the longitudinal axis projection line in the horizontal plane of the central point of viewing area, make user can face multimedia messages shown by viewing area like this.

Alternatively, as another embodiment, can according to the image of the image of scene and first area, determine the 3rd positional information, the 3rd positional information is used to indicate the intersection point of luminous ray and display device.Before step 140, according to primary importance information, second place information and the 3rd positional information, viewing area can be determined; Wherein, viewing area can or viewing area vertical with luminous ray can in surface level; The view field of viewing area and target object does not block mutually, the intersection point of luminous ray and display device is positioned at view field, and intersection point subpoint and the viewing area vertical range between the upper view field of surface level is in the horizontal plane less than default threshold value.

Such as, according to information such as the pixel distribution of both images of the image of scene and first area, brightness and colors, the feature of the intersection point of luminous ray and display device can be extracted, thus determines primary importance information and second place information.

According to primary importance information and second place information, viewing area angle in three dimensions can be determined.Viewing area can be vertical with luminous ray, and because the direction of luminous ray is identical with the direction of the sight line of user, like this viewing area is also perpendicular to the sight line of user, and therefore viewing area is user oriented.Or viewing area can be positioned at surface level, such user also intuitively can arrive viewing area.

In addition, when being tangible display medium for display device, can also projecting to target object along the point of intersection of luminous ray at luminous ray and display device, obtain the view field of target object.The dimension information of target object can be utilized herein to project to target object, and the dimension information of target object can be stored in advance in the storer of device interior, such as, can obtain from above-mentioned spatial information object database.

Viewing area can not blocked mutually with the view field of target object, and intersection point subpoint in the horizontal plane can and viewing area view field in the horizontal plane between vertical range can be less than default threshold value, like this from the viewing angle of user, viewing area is near target object, again can not shelter target object, the comfort level of user's viewing can be promoted, thus can Consumer's Experience be promoted.

Alternatively, as another embodiment, viewing area can be positioned at directly over drop point.Before step 140, viewing area can be determined according to primary importance information and second place information; Wherein, viewing area is vertical with luminous ray; Vertical distance between viewing area and the top of target object is greater than default Second Threshold.

Such as, be the situation of invisible display medium for display device, between luminous ray and display device, there is no intersection point.So can utilize light source point and drop point, determine viewing area.Viewing area can be positioned at directly over drop point, vertical with luminous ray, and like this from the angle of user, viewing area near target object, and is user oriented, can promote Consumer's Experience.But shelter target object is not answered in viewing area, therefore, the vertical distance between viewing area and target object top can in certain distance range, and this distance range can preset.

Alternatively, as another embodiment, viewing area can be positioned at directly over drop point, and is positioned at perpendicular.Before step 140, according to second place information, the vertical distance between visible light source and the bottom of target object can be determined.According to the height of the vertical distance between visible light source and the bottom of target object and target object, the vertical distance between viewing area and the bottom of target object can be determined.

In the present embodiment, viewing area can be positioned at perpendicular, and namely viewing area is perpendicular to surface level.Viewing area can be positioned at directly over drop point, and In the view of user, viewing area is near target object.Vertical distance between viewing area and target object can be carry out accommodation according to light source point relative to the height of the height bottom target object and target object self.The height of target object self can be stored in advance in the storer of device interior, such as, can obtain from space object information database.

The embodiment of the present invention is described in detail below in conjunction with object lesson.It should be noted that these examples just help those skilled in the art to understand the embodiment of the present invention better better, and the scope of the unrestricted embodiment of the present invention.

In fig. 2, be described to adopt transparent screen to realize " suspension " display effect.As shown in Figure 2, show that on table, display has the object of displaying, show and be provided with transparent screen 210 above table.At 4 angles place of transparent screen 210, can arrange 4 video camera 250a to 250d, video camera 250a to 250d can carry out image acquisition to the whole region shown on table.Above transparent screen 210, the namely top of this scene, can arrange 2 video camera 240a and 240b, and video camera 240a and 240b can carry out image acquisition to whole scene.

Laser pen 230 can send luminous ray, points to jobbie in space.As shown in Figure 2, when user utilizes laser pen 230 to point to the target object 220 being positioned at and showing on table, the multimedia messages corresponding with target object 220 may be displayed on a viewing area of transparent screen 210.Multimedia messages can comprise the information such as target object 220 relevant pattern, picture, word or video.

Scene below in conjunction with Fig. 2 describes the process controlling display multimedia messages in detail.In process below, for convenience of description, the region shown on table is called first area.Fig. 3 is the schematic diagram of the process controlling the method showing multimedia messages according to an embodiment of the invention.The method of Fig. 3 is performed by the equipment controlling to show multimedia messages.

301, obtain the image of scene and the image of first area from video camera.

As shown in Figure 2, when user utilizes laser pen 230 to point to target object 220, video camera 240 and 240b can gather the image of whole scene, and video camera 250a to 250d can gather the image of first area.Then the image of collection can be sent to the equipment controlling display multimedia messages by video camera 240a and 240b and video camera 250a to 250d.

302, according to the image of scene and the image of first area, determine primary importance information, second place information and the 3rd positional information.

Primary importance information is used to indicate the position of the drop point D of luminous ray in first area that laser pen 230 sends, second place information may be used for the position of the light source point S indicating laser pen 230, and the 3rd positional information may be used for the position of the intersection I of luminous ray and the transparent flat 210 indicating laser pen 230 to send.Primary importance information, second place information and the 3rd positional information all can represent with three-dimensional coordinate.

Fig. 4 is the rough schematic view of the scene of Fig. 2.In the diagram, in order to make view more clear, some elements in Fig. 2 are suitably eliminated.As shown in Figure 4, drop point D, light source point S and intersection I can be detected from the image of the image of scene and first area.Fig. 5 is the three-dimensional view of transparent screen in scene shown in Fig. 2.As shown in Figure 5, in order to make three-dimensional view more clear, some elements in Fig. 2 are suitably eliminated.In Figure 5, suppose based on transparent flat 210 setting space rectangular coordinate system, so can calculate drop point D, light source point S and intersection I coordinate separately in the coordinate system according to stereoscopic localized algorithm.

For intersection I, if cannot detect in the image of scene, then according to the coordinate of the coordinate of light source point S and drop point D, can be calculated by space multistory geometry method.

, suppose that the coordinate of light source point S, intersection I and drop point D is as follows respectively: light source point S(Xs, Ys, Zs herein), intersection I (Xi, Yi, Zi), drop point D(Xd, Yd, Zd).

303, according to drop point D, determine the target object 220 that drop point D is corresponding, obtain the attribute information of target object 220.

May be used in space object information database storing and show coordinate range in rectangular coordinate system in space of each object on table and other attribute information.Such as, attribute information can comprise the information such as the mark of object or the size of object.So, according to the coordinate of drop point D, the target object 220 matched with the coordinate of drop point D can be determined in space object information database, and the relevant information of target object 220.

304, according to the attribute information of target object 220, determine the multimedia messages of target object 220 correspondence.

Multimedia information data storehouse may be used for storage and shows the multimedia messages that the attribute information of each object on table is corresponding.Such as, in multimedia information data storehouse, the corresponding relation between the mark of object and multimedia messages can be set up.According to the mark of target object 220, the multimedia messages of target object 220 correspondence can be obtained from multimedia information data storehouse.

305, according to light source point S, intersection I, drop point D and target object 220, determine the viewing area for the multimedia messages of display-object object 220 correspondence in transparent flat 210.

Because transparent screen is three-dimensional, therefore determine that viewing area also can be understood as and determine display position and angles of display.

As shown in Figure 5, according to solid geometry method, the projection L ' of luminous ray L in XZ plane that laser pen 230 sends can be determined, determine the angle α of L ' and L, and determine the angle β of L ' and X-axis.

In addition, target object 220 can be projected in intersection I place according to the ratio of 1:1, obtain the view field of target object 220.Fig. 6 is the vertical view for Fig. 5.As shown in Figure 6, intersection I is positioned at the view field of target object 220.

According to α and β, the angle of viewing area in rectangular coordinate system in space can be determined.Fig. 7 is the plan view of scene shown in Fig. 2.Fig. 8 is the vertical view for Fig. 7.As shown in Figure 7, in order to adapt to the visual angle of human eye, viewing area can be vertical with luminous ray L.Therefore, according to α, the angle γ of viewing area and XZ plane can be determined, i.e. γ=f (α).Or when the display performance of display device is limited, γ can be 0.In order to adapt to the comfort level of human eye viewing, make user face viewing area, as shown in Figure 8, the angle of viewing area and XY plane can equal the angle of luminous ray L and XY plane, i.e. β.

In addition, as shown in Figure 8, viewing area can be positioned near intersection I, and does not block mutually with the view field of target object 220.Specifically, vertical range between subpoint and the viewing area view field in XZ plane of intersection I in XZ plane can be made to be less than default threshold value, and make In the view of user, viewing area is near target object.In addition, the particular location of viewing area also can adjust according to actual conditions.

306, control the multimedia messages of display-object object 220 correspondence in above-mentioned viewing area.

Should be understood that the size of the sequence number of above-mentioned each process and do not mean that the priority of execution sequence, the execution sequence of each process should be determined with its function and internal logic, and should not form any restriction to the implementation process of the embodiment of the present invention.Such as, step 304 and 305 can perform concurrently.

In a class " suspension " display technique, the imaging in air or various special gas of laser, Special display or projector equipment can be utilized.In fig .9, be described to utilize the display device of air imaging display techniques to realize " suspension " display effect.

As shown in Figure 9, show that on table, display has the object of displaying, show that the top of table is provided with display device 910.Showing 4 angles place above table, 4 video camera 950a to 950d can be set.Video camera 950a to 950d can carry out image acquisition to the whole region shown on table.Above this scene, can arrange 2 video camera 940a and 940b, video camera 940a and 940b can carry out image acquisition to whole scene.

Laser pen 930 can send luminous ray, points to jobbie in space.As shown in Figure 9, when user utilizes laser pen 930 to point to the target object 920 being positioned at and showing on table, the multimedia messages corresponding with target object 920 may be displayed on a viewing area of display device 910.Multimedia messages can comprise the information such as target object 920 relevant pattern, picture, word or video.

Scene below in conjunction with Fig. 9 describes the process controlling display multimedia messages in detail.In process below, for convenience of description, the region shown on table is called first area.Figure 10 is the schematic diagram of the process controlling the method showing multimedia messages according to another embodiment of the present invention.The method of Figure 10 is performed by the equipment controlling to show multimedia messages.

1001, obtain the image of scene and the image of first area from video camera.

As shown in Figure 9, when user utilizes laser pen 930 to point to target object 920, video camera 940 and 940b can gather the image of whole scene, and video camera 950a to 950d can gather the image of first area.Then the image of collection can be sent to the equipment controlling display multimedia messages by video camera 940a and 940b and video camera 950a to 950d.

1002, according to the image of scene and the image of first area, determine primary importance information and second place information.

Primary importance information is used to indicate the position of the drop point D of luminous ray in first area that laser pen 930 sends, and second place information may be used for the position of the light source point S indicating laser pen 930.

Figure 11 is the rough schematic view of the scene of Fig. 9.In fig. 11, in order to make view more clear, some elements in Fig. 9 are suitably eliminated.As shown in figure 11, drop point D and light source point S can be detected from the image of the image of scene and first area.Figure 12 is the three-dimensional view showing table region in scene shown in Fig. 9.As shown in figure 12, in order to make three-dimensional view more clear, some elements in Fig. 9 are suitably eliminated.In fig. 12, suppose, based on the region setting space rectangular coordinate system of showing above table, so to calculate drop point D and light source point S coordinate separately in the coordinate system according to stereoscopic localized algorithm.

, suppose that the coordinate of light source point S and drop point D is as follows respectively: light source point S(Xs, Ys, Zs herein), drop point D(Xd, Yd, Zd).

1003, according to drop point D, determine the target object 920 that drop point D is corresponding, and obtain the attribute information of target object 920.

May be used in space object information database storing and show coordinate range in rectangular coordinate system in space of each object on table and attribute information.Such as, attribute information can comprise the information such as the mark of object or the size of object.So, according to the coordinate of drop point D, the target object 920 matched with the coordinate of drop point D can be determined in space object information database, and obtains the attribute information of target object 920.

1004, according to the attribute information of target object 920, determine the multimedia messages of target object 920 correspondence.

Multimedia information data storehouse may be used for storage and shows the multimedia messages that the attribute information of each object on table is corresponding.Such as, in multimedia information data storehouse, the corresponding relation between the mark of object and multimedia messages can be set up.According to the mark of target object 920, the multimedia messages of target object 920 correspondence can be obtained from multimedia information data storehouse.

1005, according to light source point S, drop point D and target object 920, determine the viewing area for the multimedia messages of display-object object 920 correspondence on display device 910.

Owing to adopting " suspension " display technique, therefore determine that viewing area also can be understood as and determine display position and angles of display.

As shown in figure 12, according to solid geometry method, the projection L ' of luminous ray L in XZ plane that laser pen 930 sends can be determined, determine the angle α of L ' and L, and determine the angle β of L ' and X-axis.

Angle and the position of viewing area can be determined by two kinds of modes below:

Mode one:

According to α and β, the angle of viewing area in rectangular coordinate system in space can be determined.

Figure 13 is the plan view of scene shown in Fig. 9.In fig. 13, some elements in Fig. 9 are suitably eliminated.Figure 14 is the vertical view for Figure 13.As shown in figure 13, in order to adapt to the visual angle of human eye, make viewing area user oriented, viewing area can be vertical with luminous ray L.Therefore, according to α, the angle γ of viewing area and XZ plane can be determined, i.e. γ=f (α).

In addition, as mentioned above, viewing area is positioned at directly over drop point D, therefore in a top view, the projection of drop point D should be positioned at the view field of viewing area or the two has certain overlap, but in fig. 14, in order to more clearly represent the deflection angle of viewing area relative to XY plane, the view field of the viewing area therefore illustrated is the right side being positioned at drop point projection.Should be understood that Figure 14 is only used to help those skilled in the art to understand the embodiment of the present invention better, and the scope of the non-display embodiment of the present invention.In order to adapt to the comfort level of human eye viewing, make user face viewing area, as shown in figure 14, the angle of viewing area and XY plane can equal the angle of luminous ray L and XY plane, i.e. β.

Viewing area can be positioned at directly over drop point D, and the vertical distance between viewing area and target object 920 top can be greater than default threshold value.As shown in figure 13, the height of hypothetical target object 920 is c, and the vertical distance between bottom viewing area and target object is dh, and the difference so between dh and c can be greater than default threshold value.

Mode two: Figure 15 is the plan view of scene shown in Fig. 9.In fig .15, some elements in Fig. 9 are suitably eliminated.Figure 16 is the vertical view for Figure 15.

As shown in figure 15, viewing area still can be positioned at directly over drop point D, and can be positioned at perpendicular.Be different from aforesaid way one, the vertical distance between bottom viewing area and target object 920 can be self-adaptative adjustment.Particularly, can according to the vertical distance h between bottom second place information determination light source point S and target object 920, according to the height c of the vertical distance h between bottom light source point S and target object 920 and target object, vertical distance dh between determining bottom viewing area and target object 920, as shown in figure 15.Namely dh is the function of h and c, can be expressed as dh=f (h, c).

In addition, as mentioned above, viewing area is positioned at directly over drop point D, therefore in a top view, the projection of drop point D should be positioned at the view field of viewing area or the two has certain overlap, but in figure 16, in order to more clearly represent the deflection angle of viewing area relative to XY plane, the view field of the viewing area therefore illustrated is the right side being positioned at drop point projection.Should be understood that Figure 16 is only used to help those skilled in the art to understand the embodiment of the present invention better, and the scope of the non-display embodiment of the present invention.As shown in figure 16, in order to adapt to the comfort level of human eye viewing, the angle of viewing area and XY plane can equal the angle of luminous ray L and XY plane, i.e. β.

1006, control the multimedia messages of display-object object 920 correspondence in above-mentioned viewing area.

Should be understood that the size of the sequence number of above-mentioned each process and do not mean that the priority of execution sequence, the execution sequence of each process should be determined with its function and internal logic, and should not form any restriction to the implementation process of the embodiment of the present invention.Such as, step 1004 and 1005 can perform concurrently.

Figure 17 is the schematic block diagram controlling the equipment showing multimedia messages according to an embodiment of the invention.The equipment 1700 of Figure 17 comprises acquiring unit 1710, first determining unit 1720, second determining unit 1730 and control module 1740.

Acquiring unit 1710 obtains the image of first area in scene.First determining unit 1720, according to the image of first area, determines primary importance information, and primary importance information is used to indicate the position of the luminous ray drop point in the first region that in scene, visible ray indicator sends.Second determining unit 1730, according to primary importance information, determines the target object that drop point is corresponding in the first region, and determines the multimedia messages that target object is corresponding.Control module 1740 controls display device display multimedia messages.

Alternatively, as an embodiment, equipment 1700 can also comprise the 3rd determining unit 1750.

Acquiring unit 1710 before control display device display multimedia messages, can also obtain the image of scene.First determining unit 1720 can also according to the image of the image of scene and first area, and determine second place information, second place information is used to indicate the position of the light source point of visible ray indicator.

3rd determining unit 1750 can be determined on the display device for showing the viewing area of multimedia messages according to primary importance information and second place information.

Control module 1740 can control display device and show multimedia messages on the display region.

Alternatively, as another embodiment, parallel with luminous ray projection line in the horizontal plane by the longitudinal axis projection line in the horizontal plane of the central point of viewing area.

Alternatively, as another embodiment, the first determining unit 1720 can also according to the image of the image of scene and first area, and determine the 3rd positional information, the 3rd positional information is used to indicate the intersection point of luminous ray and display device.

3rd determining unit 1750 according to primary importance information, second place information and the 3rd positional information, can determine viewing area.Wherein, or viewing area vertical with luminous ray, viewing area is positioned at surface level; The view field of viewing area and target object does not block mutually, and the vertical range between intersection point subpoint in the horizontal plane and viewing area view field is in the horizontal plane less than default threshold value, and intersection point is positioned at the view field of target object.

Alternatively, as another embodiment, viewing area can be positioned at directly over drop point.

3rd determining unit 1750 can determine viewing area according to primary importance information and second place information; Wherein, viewing area is vertical with luminous ray; Vertical distance between viewing area and the top of target object is in the distance range preset.

Alternatively, as another embodiment, viewing area can be positioned at directly over drop point, and viewing area can be positioned at perpendicular.

3rd determining unit 1750 according to second place information, can determine the vertical distance between visible light source and the bottom of target object; According to the height of the vertical distance between visible light source and the bottom of target object and target object, determine the vertical distance between viewing area and the bottom of target object.

Alternatively, as another embodiment, second determining unit 1730 can be mated primary importance information in space object information database, to determine the target object that drop point is corresponding, and from space object information database, obtain the attribute information of target object, wherein space object information database is for storing positional information and the attribute information of the object in first area.Second determining unit 1730 can also according to the attribute information of target object, in multimedia information data storehouse, obtain the multimedia messages that target object is corresponding, multimedia information data storehouse is for storing the multimedia messages of the attribute information difference correspondence of the object in first area.

Other function of equipment 1700 and operation with reference to the process of the embodiment of the method for Fig. 1 to Figure 16 above, in order to avoid repeating, can repeat no more herein.

Figure 18 is the schematic block diagram controlling the equipment showing multimedia messages according to another embodiment of the present invention.The equipment 1800 of Figure 18 comprises storer 1810 and processor 1820.

Storer 1810 can comprise random access memory, flash memory, ROM (read-only memory), programmable read only memory, nonvolatile memory or register etc.Processor 1820 can be central processing unit (CentralProcessing Unit, CPU).

Storer 1810 is for stores executable instructions.The executable instruction that processor 1820 can store in execute store 1810, for: the image obtaining first area in scene; According to the image of first area, determine primary importance information, primary importance information is used to indicate the position of the luminous ray drop point in the first region that in scene, visible ray indicator sends; According to primary importance information, determine the target object that drop point is corresponding in the first region, and determine the multimedia messages that target object is corresponding; Control display device display multimedia messages.

Alternatively, as an embodiment, processor 1820 before control display device display multimedia messages, can also obtain the image of scene.Processor 1820 can also according to the image of the image of scene and first area, and determine second place information, second place information is used to indicate the position of the light source point of visible ray indicator.

Processor 1820 can be determined on the display device for showing the viewing area of multimedia messages according to primary importance information and second place information.

Processor 1820 can control display device and show multimedia messages on the display region.

Alternatively, as another embodiment, processor 1820 can also according to the image of the image of scene and first area, and determine the 3rd positional information, the 3rd positional information is used to indicate the intersection point of luminous ray and display device.

Processor 1820 according to primary importance information, second place information and the 3rd positional information, can determine viewing area.Wherein, or viewing area vertical with luminous ray, viewing area is positioned at surface level; The view field of viewing area and target object does not block mutually, and the vertical range between intersection point subpoint in the horizontal plane and viewing area view field is in the horizontal plane less than default threshold value, and intersection point is positioned at the view field of target object.

Processor 1820 can determine viewing area according to primary importance information and second place information; Wherein, viewing area is vertical with luminous ray; Vertical distance between viewing area and the top of target object is in the distance range preset.

Processor 1820 according to second place information, can determine the vertical distance between visible light source and the bottom of target object; According to the height of the vertical distance between visible light source and the bottom of target object and target object, determine the vertical distance between viewing area and the bottom of target object.

Alternatively, as another embodiment, processor 1820 can mate primary importance information in space object information database, to determine the target object that drop point is corresponding, and from space object information database, obtain the attribute information of target object, wherein space object information database is for storing positional information and the attribute information of the object in first area.Processor 1820 can also according to the attribute information of target object, in multimedia information data storehouse, obtain the multimedia messages that target object is corresponding, multimedia information data storehouse is for storing the multimedia messages of the attribute information difference correspondence of the object in first area.

Other function of equipment 1800 and operation with reference to the process of the embodiment of the method for Fig. 1 to Figure 16 above, in order to avoid repeating, can repeat no more herein.

Figure 19 is the schematic block diagram of the display system according to the embodiment of the present invention.The system 1900 of Figure 19 comprises the equipment 1910, image capture device 1920, display device 1930 and the visible ray indicator 1940 that control display multimedia messages.

Image capture device 1920 gathers the image of first area in scene, and sends the image of first area to the equipment controlling display multimedia messages.The equipment 1910 controlling display multimedia messages obtains the image of first area scene from image capture device 1920, according to the image of first area, determine primary importance information, primary importance information is used to indicate the position of the luminous ray drop point in the first region that in scene, visible ray indicator 1940 sends, according to primary importance information, determine the target object that drop point is corresponding in the first region, and determine the multimedia messages that target object is corresponding, then control display device display multimedia messages.Display device 1930 shows multimedia messages under the control of equipment controlling display multimedia messages.

In the embodiment of the present invention, by controlling the equipment of display multimedia messages according to the image of first area in scene, determine that luminous ray that visible ray indicator sends is in the position of the drop point of first area, the target object that drop point is corresponding is determined according to the position of drop point, and control multimedia messages corresponding to display device display-object object, the accuracy with user interactions can be ensured, thus can Consumer's Experience be promoted.

Alternatively, as an embodiment, image capture device 1920 can gather the image of scene, and sends the image of scene to equipment 1910.

Equipment 1910 before control display device 1930 shows multimedia messages, can also obtain the image of scene from image capture device 1920.Equipment 1910 can also according to the image of the image of scene and first area, and determine second place information, second place information is used to indicate the position of the light source point of visible ray indicator 1940.

Equipment 1910 can be determined on display device 1930 for showing the viewing area of multimedia messages according to primary importance information and second place information.

Equipment 1910 can control display device 1930 and show multimedia messages on the display region.Display device 1930 can show multimedia messages on the display region under the control of equipment 1910.

Alternatively, as another embodiment, equipment 1910 can also according to the image of the image of scene and first area, and determine the 3rd positional information, the 3rd positional information is used to indicate the intersection point of luminous ray and display device 1930.

Equipment 1910 according to primary importance information, second place information and the 3rd positional information, can determine viewing area.Wherein, or viewing area vertical with luminous ray, viewing area is positioned at surface level; The view field of viewing area and target object does not block mutually, and the vertical range between intersection point subpoint in the horizontal plane and viewing area view field is in the horizontal plane less than default threshold value, and intersection point is positioned at the view field of target object.

Equipment 1910 can determine viewing area according to primary importance information and second place information; Wherein, viewing area is vertical with luminous ray; Vertical distance between viewing area and the top of target object is in the distance range preset.

Equipment 1910 according to second place information, can determine the vertical distance between visible light source and the bottom of target object; According to the height of the vertical distance between visible light source and the bottom of target object and target object, determine the vertical distance between viewing area and the bottom of target object.

Alternatively, as another embodiment, equipment 1910 can mate primary importance information in space object information database, to determine the target object that drop point is corresponding, and from space object information database, obtain the attribute information of target object, wherein space object information database is for storing positional information and the attribute information of the object in first area.Equipment 1910 according to the attribute information of target object, can also obtain the multimedia messages that target object is corresponding in multimedia information data storehouse, and multimedia information data storehouse is for storing the multimedia messages of the attribute information difference correspondence of the object in first area.

Other function of equipment 1910 and operation with reference to the process of the embodiment of the method for Fig. 1 to Figure 16 above, in order to avoid repeating, can repeat no more herein.

Those of ordinary skill in the art can recognize, in conjunction with unit and the algorithm steps of each example of embodiment disclosed herein description, can realize with the combination of electronic hardware or computer software and electronic hardware.These functions perform with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can use distinct methods to realize described function to each specifically should being used for, but this realization should not thought and exceeds scope of the present invention.

Those skilled in the art can be well understood to, and for convenience and simplicity of description, the specific works process of the system of foregoing description, device and unit, with reference to the corresponding process in preceding method embodiment, can not repeat them here.

In several embodiments that the application provides, should be understood that disclosed system, apparatus and method can realize by another way.Such as, device embodiment described above is only schematic, such as, the division of described unit, be only a kind of logic function to divide, actual can have other dividing mode when realizing, such as multiple unit or assembly can in conjunction with or another system can be integrated into, or some features can be ignored, or do not perform.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, and the indirect coupling of device or unit or communication connection can be electrical, machinery or other form.

The described unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, or also can be distributed in multiple network element.Some or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.

In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, also can be that the independent physics of unit exists, also can two or more unit in a unit integrated.

If described function using the form of SFU software functional unit realize and as independently production marketing or use time, can be stored in a computer read/write memory medium.Based on such understanding, the part of the part that technical scheme of the present invention contributes to prior art in essence in other words or this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprising some instructions in order to make a computer equipment (can be personal computer, server, or the network equipment etc.) perform all or part of step of method described in each embodiment of the present invention.And aforesaid storage medium comprises: USB flash disk, portable hard drive, ROM (read-only memory) (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. various can be program code stored medium.

The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; change can be expected easily or replace, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection domain of described claim.

Claims

1. control the method showing multimedia messages, it is characterized in that, comprising:

Obtain the image of first area in scene;

According to the image of described first area, determine primary importance information, described primary importance information is used to indicate the position of the drop point of luminous ray in described first area that in described scene, visible ray indicator sends;

According to described primary importance information, determine the target object that drop point is corresponding described in described first area, and determine the multimedia messages that described target object is corresponding;

Control display device and show described multimedia messages.

2. method according to claim 1, is characterized in that, before described control display device shows described multimedia messages, also comprises:

Obtain the image of described scene;

According to the image of described scene and the image of described first area, determine second place information, described second place information is used to indicate the position of the light source point of described visible ray indicator;

Determine on described display device for showing the viewing area of described multimedia messages according to described primary importance information and second place information;

Described control display device shows described multimedia messages, comprising:

Control described display device and show described multimedia messages on described viewing area.

3. method according to claim 2, is characterized in that, parallel with described luminous ray projection line in the horizontal plane by the longitudinal axis projection line in the horizontal plane of the central point of described viewing area.

4. method according to claim 3, is characterized in that, also comprises:

According to the image of described scene and the image of described first area, determine the 3rd positional information, described 3rd positional information is used to indicate the intersection point of described luminous ray and described display device;

Describedly determine according to described primary importance information and the second place information viewing area showing described multimedia messages, comprising:

According to described primary importance information, described second place information and described 3rd positional information, determine described viewing area;

Wherein, or described viewing area vertical with described luminous ray, described viewing area is positioned at surface level; The view field of described viewing area and described target object does not block mutually, vertical range between described intersection point subpoint in the horizontal plane and described viewing area view field is in the horizontal plane less than default threshold value, and described intersection point is positioned at the view field of described target object.

5. method according to claim 3, is characterized in that, described viewing area is positioned at directly over described drop point;

Describedly to determine on described display device, for showing the viewing area of described multimedia messages, to comprise according to described primary importance information and second place information:

Described viewing area is determined according to described primary importance information and second place information; Wherein, described viewing area is vertical with described luminous ray; Vertical distance between the top of described viewing area and described target object is in the distance range preset.

6. method according to claim 3, is characterized in that, described viewing area is positioned at directly over described drop point, and described viewing area is positioned at perpendicular;

According to described second place information, the vertical distance between the bottom determining described visible light source and described target object;

According to the height of the vertical distance between described visible light source and the bottom of described target object and described target object, the vertical distance between the bottom determining described viewing area and described target object.

7. method according to any one of claim 1 to 6, is characterized in that, described according to described primary importance information, determines the target object that drop point is corresponding described in described first area, and determines the multimedia messages that described target object is corresponding, comprising:

In space object information database, described primary importance information is mated, to determine the target object that described drop point is corresponding, and from described space object information database, obtaining the attribute information of described target object, wherein said space object information database is for storing positional information and the attribute information of the object in described first area;

According to the attribute information of described target object, in multimedia information data storehouse, obtain multimedia messages corresponding to described target object, described multimedia information data storehouse is for storing the multimedia messages of the attribute information difference correspondence of the object in described first area.

8. control the equipment showing multimedia messages, it is characterized in that, comprising:

Acquiring unit, for obtaining the image of first area in scene;

First determining unit, for the image of first area obtained according to described acquiring unit, determine primary importance information, described primary importance information is used to indicate the position of the drop point of luminous ray in described first area that in described scene, visible ray indicator sends;

Second determining unit, for the primary importance information determined according to described first determining unit, determines the target object that drop point is corresponding described in described first area, and determines the multimedia messages that described target object is corresponding;

Control module, for controlling the multimedia messages that described second determining unit of display device display is determined.

9. equipment according to claim 8, is characterized in that, also comprises the 3rd determining unit;

Described acquiring unit, also for before showing described multimedia messages at described control display device, obtains the image of described scene;

Described first determining unit, also for according to the image of described scene and the image of described first area, determine second place information, described second place information is used to indicate the position of the light source point of described visible ray indicator;

Described 3rd determining unit, for determining on described display device for showing the viewing area of described multimedia messages according to described primary importance information and second place information;

Described control module, shows described multimedia messages specifically for controlling described display device on described viewing area.

10. equipment according to claim 9, is characterized in that, parallel with described luminous ray projection line in the horizontal plane by the longitudinal axis projection line in the horizontal plane of the central point of described viewing area.

11. equipment according to claim 10, is characterized in that,

Described first determining unit, also for according to the image of described scene and the image of described first area, determine the 3rd positional information, described 3rd positional information is used to indicate the intersection point of described luminous ray and described display device;

Described 3rd determining unit, specifically for: according to described primary importance information, described second place information and described 3rd positional information, determine described viewing area; Wherein, or described viewing area vertical with described luminous ray, described viewing area is positioned at surface level; The view field of described viewing area and described target object does not block mutually, vertical range between described intersection point subpoint in the horizontal plane and described viewing area view field is in the horizontal plane less than default threshold value, and described intersection point is positioned at the view field of described target object.

12. equipment according to claim 10, is characterized in that, described viewing area is positioned at directly over described drop point;

13. equipment according to claim 10, it is characterized in that, described viewing area is positioned at directly over described drop point, and described viewing area are positioned at perpendicular;

Equipment according to any one of 14. according to Claim 8 to 13, is characterized in that, described second determining unit, specifically for:

15. 1 kinds of display systems, is characterized in that, comprising:

The equipment of the control display multimedia messages according to any one of claim 8 to 14, image capture device, display device and visible ray indicator; Wherein,

Described image capture device, for: the image gathering first area in scene, and the image sending described first area to the described equipment controlling display multimedia messages;

The described equipment controlling display multimedia messages, for: the image obtaining first area scene from described image capture device; According to the image of described first area, determine primary importance information, described primary importance information is used to indicate the position of the drop point of luminous ray in described first area that described in described scene, visible ray indicator sends; According to described primary importance information, determine the target object that drop point is corresponding described in described first area, and determine the multimedia messages that described target object is corresponding; Control display device and show described multimedia messages;

Described display device, for showing described multimedia messages under the control of the equipment of described control display multimedia messages.