TW201028888A - Method of presenting head-pose feedback to a user of an interactive display system - Google Patents

Abstract

The invention describes a method of presenting head-pose feedback to a user (1) of an interactive display system (2) comprising a three-dimensional display area (D), which method comprises the steps of determining a head-pose for the user (1), visibly rendering a user head model (Hv, Hphy) in the display area (D), and driving the user head model (Hv, Hphy) according to the determined head-pose of the user (1). The invention further describes a head-pose feedback system, an interactive display system (2), and a method of performing a gaze-based interaction between a user (1) and an interactive display system (2).

Description

201028888 VI. Description of the Invention: [Technical Field of the Invention] The present invention describes a method for presenting a head gesture feedback to a user of an interactive display system and an execution between a user and an interactive display system. The method of line of sight interaction. The present invention also describes a head posture feedback system and an interactive display system. [Prior Art] In recent years, the field of interactive window display has been developed, the interactive cabinet

The window display can present product related information, for example, using advanced projection techniques, the purpose of which is to make browsing or shopping more interesting and attractive to potential customers. Presenting products and products in this way can help you make a more interesting shopping experience. The advantage for the store owner is that the 5H display area is not limited to a number of physical items that must be replaced or configured on a regular basis. Instead, the currently available projection and display technology can be used to display "virtual" items. This interactive display window can present information about the product or products that specifically interest a potential customer. This, the customer is more likely to enter the store and purchase the item of interest. These display systems have also become more interesting in exhibitions or museums. Because of the in-display box, Burby may use printed labels or cards for each item. The display system has more information to be presented - the interactive window system can measure the time when the guest is standing in front of the window, and the camera is typically used to tracking the movements of the guest's eyes. The line-of-sight tracking technology is applied to the location where the guest is looking, and (4) "142435.doc 201028888" to make the unique information available to the guest. An appropriate response from the interactive window system can present the guest with more detailed information about the object, such as price, any technical details, other optional colors or types, special privileges, and the like. In a museum exhibition, an appropriate response can present detailed information about the artwork that the user is looking at. The prior art solution for the interactive window assumes that the user knows in advance that the window is interactive and that he will stop to "select" the product by looking at the product for product related education. However, since the interactive display area is still quite rare, currently limited to some touch-based interactive systems, we can assume that a user will usually not expect to be able to interact, and in particular he will not expect to be based on visual interaction. In the future, as interactive display areas will become more prevalent, users will still need to be able to recognize which display areas are interactive and which are not interactive, and which can be controlled by line of sight. Since gaze tracking is very unfamiliar to the general public as one of the ways of interaction, there is a clear and concise way of presenting to the guest the challenge of being able to rely on one of the systems being controlled by the line of sight. This is especially relevant for interactive systems used in public spaces (eg shopping areas, museums, art galleries, amusement parks, etc.) where the interactive system must be intuitive and simple for the user to interact with anyone. The system interacts without having to first flip through a manual or experience training. Another aspect to consider is that the line of sight tracking can be performed in different ways. Eye-based gaze tracking and head tracking require users to behave differently. For eye-based gaze tracking, the user does not need to do anything deliberately, as long as he looks inside the display area to control the system. 142435.doc -6 - 201028888 However, for head tracking, the user must consciously move his head, and some users tend to move the head slightly or not at all if they are looking at the object. Then they must even exaggerate their head activities. There are also some indications that users find that head tracking is more comfortable than eye-based line-of-sight tracking and is therefore used for assistive technology applications. For example, based on line of sight interaction, it is more likely to apply head tracking. However, if a user does not realize that an interactive display system uses a head-based tracking method, he may not be able to move his head accordingly, causing the interaction to fail, resulting in dissatisfaction with the system. Accordingly, it is an object of the present invention to provide an easy and intuitive way of communicating the head tracking performance of an interactive display system to a user. [Summary of the Invention]

The object of the present invention is a method for presenting a head posture feedback by a technical solution, such as performing one of the line-of-sight interaction methods of the seventh aspect, an ankle posture feedback system of the X technical solution 11, and a technical solution. 15 one interactive display system implementation.

Presenting a method of returning a head posture to a user of an interactive display system including one of the preferred three-dimensional display areas, the method comprising the steps of: centralizing the head posture; visually displaying the image of the user's head The display (five) domain towel and the head model of the user user. The son-in-law driving the court in the morning, the phrase "Yu Shao posture" is interpreted as the posture adopted by the head of 嗲# (4) is being viewed by the user user; 5^ * is used to estimate the dish The direction. In the above method of the present invention, the use of 142435.doc 201028888 can be seen at a glance that the interactive display system reacts to his head posture 'making the method particularly advantageous for teaching or expressing the interaction to the user. The display system can interact based on line of sight. An intuitive indicator of one of the users who is unfamiliar with this system is a visual display of one of his heads that simulates his head posture. Performing a line-of-sight interaction method between a user and an interactive display system having a preferred three-dimensional display area, wherein a plurality of objects are disposed in the three-dimensional display area, and the interactive display system includes the present invention One of the viewing members, the method comprising the steps of: detecting the presence of a user in front of a display area; observing the user's head motion to determine the user's head (four) potential and presenting the head posture as described above Feedback to the user. With the line-of-sight interaction method described herein, wherein the head posture feedback system gives the use ♦, the user can quickly realize that the interactive display system can "follow" the source from his head. The sight of the posture. Once the action has been communicated to the user by the head gesture feedback, the user can participate in the __based line of sight interaction with the interactive display system, for example, using any of the known line-of-sight interactions known in the art. technology.颂 Shao An's feedback system, such as Feng Inventor, and Gusong; ^ Χ3\^ ^ ψ =,, ·. With a better three-dimensional display area - interactive display, the head posture feedback system includes — The head posture is arbitrarily divided, ^ female male * 疋 疋 ... ... 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者 使用者The group uses gray 142435.doc 201028888 to use the user's head model in the display area, and the user's head posture determined by the model is used to drive the make, so that the head model essentially simulates the user. An interactive display system according to the present invention includes a preferred three-dimensional display area, a detecting member and a viewing member, wherein a plurality of objects are disposed in the two-dimensional display area, and the (four) member is used for _in-display Before the area

The presence of the user of the face, and the viewing member is used to observe the head movement of the user to obtain the headstock funding. The moving display system includes a head posture feedback system and a display area domain controller. The head posture feedback system as described above is fed back to the user in a presentation head posture, and the display area controller controls the display area according to the determined head posture.

Visible visualization allows the drive unit to model the head posture based on the user's head. As with the head posture feedback system and interactive display system of the present invention, these systems provide a particularly simple and easy way for the potential user or customer to perform on the performance of such systems...the user sees - The head model moves in the same way as his movement' or the head model appears to gaze at the same object as he is looking at, and will immediately recognize that the system is responding to his own head posture. Since this can sufficiently make a display area more interesting or understandable to a user, the proposed solution can be applied to any type of public display that provides line-of-sight interaction, such as interactive window displays, interactive exhibitions, Museum interactive exhibitions, etc., which require an intuitive and easy to understand explanation of the performance of the system. The 6 ng % affiliated technical solution and the subsequent description disclose embodiments and features of the present invention which are particularly advantageous 142435.doc -9· 201028888. As already indicated, the systems and methods described by the present invention are suitable for use in any suitable environment, such as one of the interactive bridges in a shopping area and in an exhibition, a museum of trade shows. An interactive display box in the environment, etc. The display area can be an example of three, where the product is configured to look at one of the areas, 戍 - one exhibition benefit. However, it is conceivable that the display The area is a two-dimensional (for example) _ rear projection screen, for example, an image of such objects and products can be displayed on the basin. 为了8. For simplicity, but does not constrain the invention in any way, The display area can be assumed to be a three-dimensional window in the following. Guests can also interact with the interactive display system, which is referred to as a "user" or "customer" in the following. Even though the following description is for the sake of clarity, only the individual users of the disc-display system interaction, such as the methods and systems of the present invention, can be simultaneously applied to the interaction of several users. The content of the displayed display area can be referred to as "items", "objects" or "products" below, and does not constrain the invention in any way. For example, the detecting component of the interactive display system of the present invention can include a separate module for extracting the presence of a user in front of the display area, for example, in front of the display area. One of the ground or a pressure sensor or pressure tile, any suitable motion sensor, an infrared sensor, or a camera viewing system. Naturally, the viewing member itself can be used to detect the presence of a user in front of the display area, for example by constantly comparing the image in the range in front of the display area with the empty image. The "empty" image, that is, the image-in which the 142435.doc -10- 201028888 ^ is not seen, enables the presence of the guest in front of the display area to be displayed including the arrangement of the camera, such as many being installed in the The human head; the mobile camera of ^. An observation component tries to trace the activities of the guest, and is used for Bo, . Any necessary image analysis must be a35 force's observation component can also be called - "head ginseng =" Γ Γ 别 别 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于 于The action of the ministry can then be analyzed. The knowledge of the third is described as "the head of the technician from the end to the other end", which is oblique (vertical rotation) and rotation (tilt the road The head pose vector. It is not necessary to use all of this information to estimate the point at which the user p Is _ $ 。 。. For example, the experiment depends on the level or direction component of the head pose vector, when the note is When there is no object in the area, one of the heads, while others compete, A moves up and moves them, and moves their heads more. However, for straight or oblique components, this difference is shown. The sinus of the area is like...· obviously. So especially in Xiangu, it is placed in the display area so that == can be easily seen without the user having to tilt or turn his value above any value. Head. Describe the direction in which you are looking, or the second rb contains significant For example, only the observer's head chases mm-estimated tilt. As described above, the device can determine the user's head posture, and thus can estimate the direction in which the estimate is being viewed in the following Called the head, 42435.d〇c 201028888 posture vector or "the line of sight vector people convinced _ guest face = more expensive" and requires the customer's eyes to be clear = etc. =: to the ground in certain lighting conditions or brother eight The heart is paid, and does not in any way constrain the invention: the mirror is artificially problematic. The tracking system is being executed to determine the second (four) more direct head Θ Θ Γ Θ Θ Θ 使用者 使用者 使用者 使用者 使用者 使用者It is estimated that his visual & ° σ ground ' can also steadily measure one of the user's eyes to observe the component can (4) in order to determine the direction of the head (4) and the direction of the line of sight. In many areas of the environment, such as retail shopping Center, the potential enabler or customer usually walks through the window and may only look at the display area briefly. The user should preferably be able to know whether the display area is an interactive display area. 'In particular one of the inventions Good implementation: the step of 'driving the user's head model includes mapping the user's head - - the action corresponding to one of the user's head models causes the action of the user's head model to simulate the use In this way, a user may go through a window and may slow down and turn his head to see inside the display area. 'A head model can be immediately seen to behave in the same way and effectively Simulating his head activity. This can attract his attention, and if he is unfamiliar with this system, it can prompt him to continue to point his gaze into the cabinet to see what happens next. In this example, the head The "teaching" effect of the posture feedback system can be considered successful. It has been recognized that there is an interactive display system that can interact based on line of sight - the user can stay in front of the window to participate in a line-of-sight interaction. I42435.doc -12- 201028888 Head posture feedback should be presented in an easily recognizable way. In other words, the head posture feedback should explain to the user that his head activity is being tracked, especially His head activity about the display area. For example, the user's head model can be driven to reflect the head of the user. The 卩 action, or the user's head model, can be driven such that it effectively "sees" the same point in the display area that the user is looking at. This can depend to a large extent on the position of the user's head model in the display area. For example, Q, the position of the user's head model in the 5 Hz display area does not matter * positioning is aimed at the user. Still lower than the user's head. A head-up user head model can be driven to directly simulate the user's head motion, while a lower user head model can be driven to appear to be the same point of view by the user. The spoon is in a preferred embodiment of the invention, so that the user head model can include a mechanically movable solid head model that is positioned in the display area such that it is used for For clarity, you can refer to 1. The step of driving the user's head model can include controlling the physical head model based on the determined user's head posture to express or reflect that the user's master activity is rotated and/or tilted as one of the physical head models . A user passes through the display area and looks to the side to see that the physical head module moves in the same manner as the user has moved his head. A slash user has seen this happening, he is aware that the display area will respond to the head gesture, and can infer that the display area based on the line of sight interaction. The solid head model can include a small projector mini black and white laser projector' or a high power mini projector, the J42435.doc -13· 201028888 small projector is built into the head model for use by the use The person is in the main view or not. The object or the garden can be illuminated or highlighted as a head posture to the user.

Recent and ongoing developments in projection and display technology have allowed more sophisticated heads to be presented to the user. For example, the head of the user. The p activity can be displayed, for example, on the screen or the backdrop in the display area where the height of the head is used, so that the user can easily feedback back to the displayed head posture. In the present invention, in particular, the user's head model includes a virtual head model that is graphically displayed on the display or screen, and listens to the user's head. The step includes visualizing the virtual: part model in the display based on the determined user head pose. Note that the use of the word "display" in the sense of k means only that - the image can be graphically imaged on it - the screen or the backdrop - and should not be displayed with the words "window display" or "display" "Zone" is confused. The "window display"_"display area" refers only to the area in which the product system is configured for presentation. 4 to avoid confusion,

The term "screen" is used each time a display in which the image can be visually displayed is mentioned. In the method and system of the present invention, the virtual head model defines the head of the user's face, whether or not as a human head, in a detailed representation. In the case of the case, the user should immediately simulate his head activity for the virtual head model. For example, it has been mentioned that 'providing the virtual head model is positioned as a money viewer', the virtual head model can be driven to reflect the 142_1 to 1 way. 142435.doc • 14 - 201028888 :p activity 'otherwise the virtual head model can be driven to appear to be the same point of view of the display area'. It will be emphasized that at this point the "virtual head type" should not be (four) a simple "cursor" known from other simpler techniques of interaction.

Preferably, the virtual head model is imaged in one of the display areas, such that the graphic representation also includes an image of the content of the display area. For example, the graphical representation of the display area can be imaged in an area of the screen to display the shape of the object in the display area from the viewpoint of the user. The profile can be one of the contours corresponding to the shape of the object and can be imaged as a bold or thick line. The virtual head 4 model in this case can be an exterior structure of the guest's head displayed on the screen. The screen can be driven or controlled such that the head profile changes to simulate the action of the user's head. Thus, the virtual head model can show the user that his head activity is being tracked by the system. As mentioned above, a user's head posture can be analyzed to estimate or determine the point at which the user is most likely to be gazing. In a particularly preferred embodiment of the present invention, a virtual head pose vector is also visually visible in the display area $ such that the virtual head (four) vector appears to originate from the virtual head model. Using the above example, the virtual phasor can be displayed on the screen from a point on the "forehead" of the head profile or from the "nose" of the head profile. The virtual head pose vector reflects the determined direction of the user's line of sight, whether it is directly inspecting one of the objects in the display area or looking at a point between the objects. Therefore, in another embodiment of the present invention, visually emphasizing a tamping in the display area according to the determined line of sight direction 142435.doc •15·201028888 includes displaying a virtual head pose vector to indicate the Determine the direction of the line of sight. When you look at the display area, it is very likely that you have seen something of interest. Therefore, it is preferable to present any head posture feedback to the user in such a manner that the behavior of the display area is not harmful, in other words, the head posture feedback should not hinder the use. The person continues to look inside the display area, or should not distract his view from the object of interest. In the first type of head pose feedback described above, = is relatively easy to implement because the solid head model can be placed on the "floor" of the display area, or at another location outside the user's line of sight. . In the second type of head posture feedback, one of the virtual head models is graphically displayed on one of the screen positions, the position should be positioned so that the user can easily see it, such as in the The user is in sight. In a method, the graphical representation of the head model, the line of sight vector, and the content of the display area can be projected on a range behind the content of the display area so that the user can still view objects such as (4), but the user is also expected. The head model is being visualized by the line of sight vector. In a further preferred embodiment of the present invention, the visualization virtual head model and/or the developed virtual head pose vector is at least partially transparent and the image is displayed between the user and the display area Between the user, the virtual head model and/or the visualized virtual head pose vector can be viewed inside the display area. Having the user's line of sight not distracted or removed from the object he is watching, the virtual head model and/or the head pose vector being visualized such that the point at which the virtual head model is looking at is effectively utilized The point at which the user is looking at 142435.doc -16- 201028888 preferably, the virtual head model is imaged based on the position of the user's head relative to the position of the objects in the display area The graphical representation of the display area is such that the position of the virtual head π model in the graphical representation of the display area effectively corresponds to the position of the user's head relative to the display area. This can be achieved by using the appropriate type of essentially transparent display glory 'but the display screen can be made opaque when needed, such as a display screen with different propagation modes ranging from opaque to half Transparent to transparent. When the screen is in a transparent mode, a user can view an object behind the signing screen through the screen, and the user reads an object on the screen of the hlhai camp, and the information is simultaneously The object is visible through the translucent mode screen or when the display is in an opaque mode, the user only sees the image projected on the screen. Alternatively, the screen can include an inexpensive passive matrix electrophoretic display. - The multi-mode projection screen can be controlled based on the presence and behavior of a user in front of the display area. For example, in this example, when no customer is detected in front of the interactive window, the screen can be placed in the "alternate mode" type to display the store promotion content... once detected in front of an interactive bridge window To a potential end, ' ^ As described above, the screen can be changed to the moon, there is λ Ι, the area will be translucent. In this small area, the virtual head model and virtual head pose vector can be visualized to show the user that he can participate in a line-of-sight interaction. In order to end or exit this "teaching" mode, an appropriate symbol can be visualized in one of the screens, such as one of the virtual "Cancel" & "Continue" icons that can be displayed. Familiar with this type 142435.doc 17· 201028888 One of the line-of-sight interactions allows the user to simply look at the Cancel button to enable the line-based interaction to continue as usual. To ensure that the user does not inadvertently end the teaching mode, he can be asked to point his line of sight to the "Cancel" button for a predetermined length of time. For this type of interaction, one of the users can learn the information first. Once he has realized that he can interact with the showcase, pressing the "Cancel" button is sufficient to make the screen transparent and for the line-of-sight interaction to proceed in a normal manner. The screen

It can become completely translucent, allowing the user to look at any item in the display area. Once he has "selected" another item or object by looking at it, product related information for that object can be visualized in the display area. In a further preferred embodiment of the present invention, an object in the display area can be identified based on the determined head pose or line of sight vector, and

The display area can be controlled to visually emphasize the object. In the case of the object, the direction of the decision is located in an "interaction zone" or "interaction limit", and an object can be considered to have been "selected". The interaction zone or boundary can be 'in-the-' including the object itself and one of the perimeter ranges of the object such that the user does not have to explicitly look directly at the object 'and in another aspect' the line of sight determination method Errors can be considered. In this subsequent line-of-sight interaction, the display area can be controlled based on the item being viewed by the user. For example, when the user's line of sight is directed to one of the items in the interactive zone - the smallest is "staying time:" - object related information such as price, optional size, optional color, a designer name, etc. Can be displayed to the user. In a system using a built-in projector such as a front- or rear-projection unit-body head model 142435.doc -18- 201028888, the projector can be used to project object related information in an appropriate On the backdrop or on the screen. Or, for example, in an interactive display system having an electrophoretic screen, information can be directly visualized in the screen. In either case, the product related information is preferably presented in the user's line of sight so that he can easily view or read the information. The information fades out when the user's line of sight is removed from the object of interest. The visual emphasis of one of the ranges in the display area is not necessarily limited to only strong

The display shows the "select" object as mentioned above. With this available modern projection technology, more interesting ways to communicate with the user are possible. For example, a type of virtual "cursor" can be projected into the display area to follow the estimated direction of the user's line of sight. When the user's line of sight appears to point between objects in the display area, an appropriate symbol can be projected, such as an easily understood symbol such as a question mark, or an eye. The virtual cursor can traverse the display area to "follow" the user's line of sight. One of the advantages of this interesting approach is to attract the user's attention, and if he realizes that his line of sight is being effectively tracked by the display system, he may be more interested in participating in a line-of-sight interaction. Before the interactive window becomes commonplace, it is better to provide the user with a clearer indication of one of the possibilities based on line of sight interaction. For example, a set of instructions can be provided to a user to let him know that he can interact with a display system. When the appearance of a user in front of the display area is detected, the instructions such as Xuan can be issued: as a series of messages recorded through a speaker output, in the form of written text, as an image or Series of images, - film demonstrations, etc. Then, in a noisy environment, J42435.doc -19- 201028888

For example, a shopping area or public area can be unfeasible and unreliable. A series of instructions for use can be visually projected into the display area so that the user can easily "read" the instructions for use. Furthermore, it is possible to project text or information in this manner by the available projection system technology. This message can be statically defined on the display of the window or it can dynamically generate a position depending on the user such that it will be centered relative to the user. Thus, for good readability, the instructions for use can be optimally positioned 'regardless of where the user will stand relative to the display area. This is especially advantageous when considering the sharpness of a projected image depending on the angle at which it will be viewed. For example, if the user has understood or assumed that the user is already familiar with the interactive system of the type, the instructions for use can be cancelled by the user, such as by the user being able to press one of the cancel buttons, by saying A suitable command, by a virtual cancel "button" displayed in a display as already described above, or by any other suitable method.

Other objects and features of the present invention will be apparent from the following detailed description taken in conjunction with the appended claims. It will be understood that the drawings are designed for illustrative purposes only and are not to be construed as limiting. [Embodiment] In the same diagram, all the same numerals refer to the same object. Objects in these circles are not necessarily drawn to scale. Figure 1a shows one of the users 1 in front of a display area D, in front of the negative--potential customer window D. For the sake of clarity, this picture has not been kept very simple. In the window D, the articles 14, 15, 16 are tilted for display. An electrophoretic screen 5 is positioned between the user's coffee room 142435.doc • 20- 201028888 and a projection area 5 between the interiors of the display area D. A detector member 4, in this example one of the force sensors 4 or the force 4 is positioned in the appropriate position in front of the window d, such that one of the front stops in front of the bridge window D The presence of customer 1 can be detected. Having a configuration - one of the camera viewing members 3, or the head tracking member 3 is positioned in the display area , such that when the user 1 looks into the display area D, the user's head movement can Being chased. The head tracking member 3 is activated in response to a signal 40 transmitted from the test component 4 to a control unit 2A. Visibly, the headstock member 3 can be used in place of the _member 4 for the presence of a user 前面 in front of the display area D. In the chart, only a single camera 3 is displayed, but it is visibly capable of realizing a plurality of cameras, and is disposed in the display area D in a manner that is not easily seen. The control unit 2G may include hardware and software modules, for example, a suitable algorithm for operation on a computer such as an office or other location. In the figure, a simplified representation of the control unit 2 is shown, which includes a head posture determining unit 21 for analyzing the data % supplied by the observation member 3 to infer the use. By! The head posture, and therefore the line of sight G of the user is also inferred. The control unit 20 also includes an interactive control module, a head model imaging unit 23, and a database 27. These modules ^, ^ will be explained in the more detailed information below. The control unit 2 and the detection component will generally be seen by the user 1 and will therefore be indicated by the dotted lines. - Figure (10) shows the same scene as described above' but the head posture feedback is shown to the user 1. Here, the head posture determining unit 21 using the data transmitted by the observation member 3 142435.doc • 21 · 201028888 30 has determined the head posture of the user 1, that is, the user's head indicates that he is watching. Shoes 15. In order to supply the feedback to the user 1, to the user! It is shown that the system 2 "knows" what he is looking at, and the head posture determining unit 21 transmits an appropriate signal Μ to the head model developing unit 23, which develops the appropriate control. The signal 24 is driven to drive the multi-(4) electrophoresis screen 5, preferably between the user 1 and the display area D, such as a portion of the cabinet (four) glass-embedded. When in an "interactive" state, as in the above figure _, the electrophoretic screen 5 is essentially transparent' to the user! The surface of the display area d can be easily dropped through the screen 5. „ _ u u u surface. In this example, the control area 24 transmitted by the head model imaging unit 23 causes the display area The d-graphic representation is displayed in the range Μ of the electrophoretic screen 5 such that the portion 50 of the honour 5 becomes partially opaque as indicated by the smear in this range. The display area D and its content are displayed as Small, in this case the objects 14, ΐ5, 16 present in the display area are indicated by their profiles 54, 55, 56. The head model imaging unit 23 applies a software singularity rule to generate The image data is used to simulate the head posture and the line of sight of the user - the virtual head model Hv and the head posture vector 乂. The virtual head model Hv displayed as a human head structure is graphically imaged in the camp. The visual emphasis of the screen 5 is in the range of 5 。. In order to show the user i that the system 2 can recognize the position he is looking at, the virtual head posture vector v simulating the user's line of sight direction G is displayed from the head model. Hv extends to the use # in fact The object 15 is looking at the outer structure 55. The head posture feedback system in this example essentially includes the head posture decision sheet (3), the head model 142435.doc • 22- 201028888 the developing unit 23 and the Controlled display area 5 β

The first time user 1 of this interactive display system 2 can understand at this time that he can interact with the display area D based on his head posture and line of sight. In order to indicate to the system 2 that he has understood, in this example, the user 1 can view the appropriate symbol 57 displayed here in one of the corners of the visual emphasis range 50 to end the "teaching" mode. The symbol 57 can be a "button" that includes the words "OK", "Cancel", "Continue" or a similarly easy-to-understand text. The symbol 57 can also be simply an arrow that can be easily interpreted as meaning "go" or "continue". Watching this symbol 57 for a predetermined length of time, such as one second or two seconds, causes the system 2 to remove the visual focus and continue the line-of-sight interaction. Alternatively, the user can cancel the teaching mode by simply extending the "Cancel" button or touching the appropriate portion of the display. This behavior can be recognized by the observation component. Subsequent based on the line of sight interaction as explained above, in the display area, it can involve highlighting the gazing object and displaying product related information for the items, for example, by displaying a "popup menu" The electrophoresis screen. The de facto based on the line of sight interaction is managed in the interactive control module 25, and the interactive control module 25 also receives the head posture information 22 and the object information 28 derived from the database 27, the f library 27 records the placement of all objects in the display area D. With this information in mind, the interactive control module 25 can determine which object is being watched by the user and can also determine how long the user has been looking at an object. Accordingly, the interactive control unit 25 issues a control signal 24 to drive the visualization member 5, such as displaying product related information. 142435.doc -23- 201028888 Figure 2W2b shows an interaction in which the head pose is fed back to the user. In a similar manner to the above-described Fig. 1, the user 1 is located in front of the display area d of one of the plurality of products 14, 15, 16 having a layout for presentation. Between the sample and the observation component 4 and the observation component / knife to measure the user! It appears and detects his head movements. The header potential decision unit 21 analyzes the data 30 supplied by the observation member 3 to infer the head posture of the use of the seventh and thus infers his line of sight direction 〇. In this example, the user head model is a physical, controllable model Hphy of one of the guest's heads placed in front of the display area so that the beta model can "gaze" into the display area D. Any of the objects 14, 15, 16. The model, which has a realistic appearance with eyes, nose, etc., makes it immediately recognizable as a model of the human head. The head posture determining unit 21 transmits an appropriate signal 22 to a head model developing unit 23, which generates a suitable control signal 24 to drive the mechanically controllable model Hphy. For example, one or more stepper motors in the model Hphy are driven by a signal to cause the model Hphy to rotate and/or tilt to simulate the head posture of the user 1. Furthermore, the mechanically controllable model Ηρ4 is equipped with a compact laser projector 51 which is built into the phantom such that the light B emitted by the compact laser projector 51 appears to originate from the P model. H—the “eyes”. The control signals 24 in this example also include control signals for the compact laser projector 51 such that the compact laser projector 51 illuminates the object 丨5 that the user 1 is looking at. In the present figure, this is 142435.doc -24- 201028888 indicated by the "aura" surrounding the object 15 being watched. Thus, the user understands that the system 2 is able to track his line of sight. The projector 51 can also cause product related information to be projected onto an appropriate background screen (not shown) in the display area, thereby providing the user with an interest in the item he is watching at any time. Product information. In this example, the head posture feedback system essentially includes the head posture determining unit 21, the head model developing unit 23, the mechanically controllable model, and the compact laser projector 51. To facilitate understanding, in FIG. 3, the scene of the figure is shown as having a graphical side view of one of the display areas D for the interactive display system 2, wherein the projection unit 9 is used to project an image onto a rear projection. On the screen 5, such as a H〇l〇Screen®5. Similarly, an observation member 3 is used to observe the user's head so that the head posture of the user 1 and his line of sight G can be determined as described above. In a teaching or guiding mode, the projection unit 9 can project a virtual head model and a virtual line of sight vector on the range 50 of the HoloScreen® 5 within the user's line of sight, so that the user i can easily see His head posture is being noticed and he can use his line of sight to interact with the display system. Thereafter, in a normal line-of-sight interaction, the projection unit 9 can display product related information of any object Μ, 15 viewed by the user i on the H〇l〇Screen®5. The display range 50 is not limited to the size shown, but can cover any small or large area of the screen 5, or even include the entire screen 5. The HoloScreen® is completely transparent when in a "standby" mode, or when no interaction occurs. 142435.doc -25- 201028888 While the invention has been disclosed in its preferred embodiments and modifications of the embodiments, it will be appreciated that many additional modifications and changes can be made without departing from the invention. The scope. For example, instead of displaying the actual items that are naturally configured in the area, such items can be displayed in a virtual manner, such as by projecting the items on the display screen. With this method, the "content" of a display area can be easily changed at any time, such as a computer user interface. For the sake of clarity, the use of "a" or "catch" throughout the specification does not exclude the plural, and "comprising" does not exclude other steps or components. "unit" or "module" can include many units or Module, unless otherwise stated. [Simple description of the map]

Figure la shows a scene of a user in front of a display area, a first diagram lb showing a scene of Figure la, wherein in accordance with the first embodiment of the present invention, a head gesture is provided back to the user in a line of sight interaction; Figure 2a shows a second schematic view of the user in front of a display area; Figure 2b shows the scene of Figure 2a, wherein the second embodiment of the present invention provides a head in a line-of-sight interaction according to a second embodiment of the present invention. The pose is given to the user; Figure 3 shows a schematic cross-section of one of the display areas according to the invention. [Description of main component symbols] - One of the embodiments of the line of sight interaction user 142435.doc -26- 201028888

2 Interactive display system 3 Observation component 4 Detection component 5 Electrophoresis screen 9 Projection unit 14 Object 15 Shoe 16 Object 20 Control unit 21 Head posture determination unit 22 Head posture information 23 Head model development unit 23, Head model display Image unit 24 control signal 24' control signal 25 interactive control module 25' interactive control module 27 database 28 object position information 30 data 50 visual focus range 51 small laser projector 54 object 14 exterior structure 55 shoe exterior structure 142435.doc •27- 201028888 56 Object 16 Outline structure D Display area G Line of sight direction H User head movement Hv Virtual head model Hphy Mechanically controllable model L Light V Virtual head posture to 142435.doc -28-

Claims (1)

201028888 VII. Patent application scope: 1. A method for presenting a head posture feedback to a user (1) of an interactive display system (7), the interactive display system (7) comprising - a display area (9), the method comprising the following steps: - determining a head posture of the user (1); * visually visualizing a user head model (Hv, Hphy) in the display area (D); and a head posture of the user (1) according to the determination The user head model (Hv, Hphy) is driven. 2. The method of requesting the item, wherein the step of driving the user head model Hphy) comprises mapping one of the user heads (Η) to one of the user head models (Hv, Hphy) The action causes the user's head model (Hv, Hphy) to simulate the user's head motion. 3 long term 1 or 4 method of claim 2, wherein the user head model ~) comprises - a physical head model (Hphy), and the step of driving the user head loose (Hphy) comprises according to the decision The head pose of the user (1) controls the entity head model (Hphy). 4. The method of claimant or claim 2, wherein the user head model (Hv) comprises a virtual head model (Hv), and the step of driving the user head model (Ην) comprises determining according to the decision The head pose of the user (1) visualizes the virtual head model (Ην). 5. As shown in the "Method of Monthly Item 4", a virtual head posture vector (7) is visually displayed in the display area (D) such that the virtual head posture appears to = 142435.doc 201028888 (V) as The virtual head model (Η,) is obtained by the method of claim 4, wherein the developed virtual head model (Ην) and/or the developed virtual head pose vector (ν) is At least partially transparent, and being imaged between the user (1) and the display area (1), such that the user (1) can transmit the virtual head model (Ην) and/or the virtualized image The head posture vector (V) is viewed from the display area (D). The execution/1 is based on a method of visual line interaction between the user (1) and an interactive display system (7), and the interactive display system (7) includes a display area (9) And including - viewing member (3), a plurality of (physical) objects (14, 16) are disposed in the display area (9), the method comprising the steps of detecting the user in front of a display area (D) (1) Appears; - observes the action of the user's head (H) to determine (4) the head of the user (1) The method of presenting the head gesture to the user (1) using the method of any one of the items of claim 6 to 8. The method of claim 7, wherein the method comprises: the user at the decision (1) Determining a line of sight direction of the messenger (1) based on the head posture; and: visually emphasizing the range (50, L) of the display area (9) according to the determined line of sight direction. 9 Si: 8 method, wherein The direction of the line of sight of the decision 』2 = one of the ranges (10) of the display area (D) includes the development-the illusion of the P-position vector (V) to indicate the direction of the line of sight of the decision. 142435.doc 201028888 10·如清求Item 7 to 9, wherein the object (15) in the display area (D) is identified based on the line of sight direction of the macro, the & , > The display area (D) is controlled to visually emphasize the object (15 μ μ). A user for presenting the head posture feedback to the interactive display system (7) including one display area (D) (1) The head posture feedback system 1 system includes: 〃 a head posture shirt unit (4) for use in the The user (1) - the observed head movement (4) determines the posture of the user (1); an imaging member, which is used in a · S§ -T- / ΤΛ \ J, ^ ^ (D) visually visualizing a user's head model (Hv, Hphy), and a head model driving unit (23, 231), which is based on the determined head posture of the user (1) Driving the user head model (Hv, Hphy) 0 12 · a request for a head posture feedback system, wherein the imaging member includes a head one entity model (Hphy), the entity model (11 coffee) It is implemented to be mechanically controllable in response to a signal (24,) derived from the head model drive unit (23,). 13. The head pose feedback system of claim π, wherein the visualization member comprises: a projection area (5) interposed between the user (1) and the display area (d), and a projection Unit (9) 'implemented in response to a signal (24) originating from the head model drive unit (23) and visually displaying 142435.doc 201028888 on the projection area (5) like the display area (D) Within the Xuanzhi--, one of the Dougu, the virtual head model (Hv) and a virtual head pose vector (V). 14. The head posture feedback system of claim 13, wherein the projection area (5) comprises a rear projection screen (5). An interactive display system (2) comprising: · a display area (D)' in which a plurality of objects (14, 15, 16) are arranged; a detecting means (3, 4) for detecting a display area (d) the appearance of one of the preceding users (1); an observation member (3) for observing the action of the user's head (H) to obtain head motion information (30); and The head posture feedback system of any one of 11 to 14, wherein i is used to present a head posture feedback to the user (1). 142435.doc -4 -