TW201604587A - Wearable glasses, displaying image method and non-transitory computer-readable storage medium - Google Patents

Abstract

Provided are wearable glasses including a display and a method of operating the same. The wearable glasses include: a display configured to display an image; a sensor configured to acquire wear state information representing a state in which a user currently wears the wearable glasses, while the image is being displayed on the display; and a processor configured to determine an inclination of the wearable glasses with respect to the user based on the acquired wear state information, and to adjust, based on the determined inclination, the image that is displayed on the display.

Description

Wearable glasses and method for displaying images via the wearable glasses

Korean Patent Application No. 10-2014-0098630 filed on July 31, 2014 at the Korea Intellectual Property Office and Korean Patent Application filed at the Korea Intellectual Property Office on February 10, 2015 The priority of the Korean Patent Application, the entire disclosure of which is hereby incorporated by reference.

The apparatus and method according to one or more exemplary embodiments relate to an image display apparatus and method, and more particularly to a wearable eyeglass and a method of displaying an image on the wearable eyewear.

Wearable glasses are wearable components such as eyeglasses that are worn on the head. Specifically, the wearable eyewear is a head mounted display (HMD) that is worn on the user's head and displays an image in front of the user's eyes (eg, directly in front).

Since the wearable glasses are temporarily fixed to the user's head by a frame or the like, the position or positioning of the wearable glasses on the user's head can be changed due to the user's movement. In general, wearable glasses include a near-to-eye display system that displays images within a few centimeters of the user's eyes. Therefore, the output image may even be greatly distorted due to the fine positioning of the wearable glasses.

Aspects of one or more exemplary embodiments provide a system and method for comparing a wearable state of a user's wearable eyewear with a reference wear state to determine the wearable eyeglasses relative to The inclination of the user adjusts an output image of the wearable glasses by taking into account the inclination of the wearable glasses, and displays the adjusted image to a display of the wearable glasses.

Other aspects will be set forth in part in the description which follows.

According to an aspect of an exemplary embodiment, a wearable eyeglass includes: a display for displaying an image; and a sensor for capturing the image while displaying the image on the display Status information, the wear status information represents a state in which the user currently wears the wearable glasses; and a processor configured to determine the wearable glasses relative to the user based on the captured wear status information Inclining, and adjusting the image displayed on the display based on the determined tilt.

The sensor can be used to retrieve the wear status information including information about a body part of the user; and the processor can be used to view the worn wear status information with a predetermined reference wear status The information is compared to determine the slope of the wearable eyeglass relative to the user.

The sensor can be used to retrieve the wear status information including an image of the body part; and the processor can be used to detect an area corresponding to the body part from the image of the body part, Extracting a characteristic value from the detected area, and comparing the captured characteristic value with a reference value included in the reference wearing state information to determine the inclination.

The captured wear status information may include an eye image of the user's eyes wearing the wearable glasses; and the processor may be configured to retrieve the eyes of the user from the eye image At least one of a length of the major axis, a length of the minor axis of the eye, an angle of the major axis of the eye, an angle of the minor axis of the eye, and a position value of the iris The at least one value retrieved is compared to at least one predetermined reference value, and the slope is determined based on the result of the comparison.

The display may be configured to display a test image; the sensor may be configured to capture the wear status information, the wear status information including an eye image of an eye of the user reflecting the test image; and the processing The device may be configured to detect, from the image of the eye, an area corresponding to the eye of the user, obtain a reflection image of the test image in the detected area corresponding to the eye, and At least one of the size and shape of the obtained reflected image is compared with predetermined reference wear status information, and the tilt is determined based on the result of the comparison.

The sensor may be configured to obtain a status value representative of a movement state of the wearable glasses and to retrieve the wear status information when the obtained status value is equal to or greater than a predetermined value.

The processor can be configured to determine whether the determined slope is equal to or greater than a predetermined value; when the processor determines that the determined slope is less than the predetermined value, the processor is operative to determine based on the The tilt is used to control the display to display the obtained adjusted image; and when the processor determines that the determined tilt is equal to or greater than the predetermined value, the processor can be used to control the display of the display The image is used to notify the user to adjust the wearable glasses.

According to another aspect of the exemplary embodiment, a method for displaying an image via wearable glasses is provided, the method comprising: displaying an image on a display of the wearable glasses; extracting wear status information, the wear status information Representing a state in which the user currently wears the wearable glasses; determining a tilt of the wearable glasses with respect to the user based on the captured wear status information; and adjusting based on the determined tilt The image displayed on the display.

The step of extracting the wear status information may include: capturing the wear status information including information about a body part of the user; and the determining the tilt may include: The captured wear status information is compared with predetermined reference wear status information to determine the tilt of the wearable glasses relative to the user.

The step of extracting the wear status information may include: capturing the wear status information including an image of the body part; and the determining the tilt may include: from the body part Detecting an area corresponding to the body part, extracting a characteristic value from the detected area, and comparing the captured characteristic value with a reference value included in the reference wearing status information The slope is determined.

The wear status information may include an eye image of the user's eyes that is wearing the wearable glasses; and the determining the tilt may include: extracting the user from the eye image At least one of a length of the major axis of the eye, a length of the minor axis of the eye, an angle of the major axis of the eye, an angle of the minor axis of the eye, and a position value of the iris And comparing the captured at least one value with at least one predetermined reference value, and determining the slope based on a result of the comparing.

The step of displaying the image may include: displaying a test image; the step of capturing the wear status information may include: capturing the wear status information, where the wear status information includes a reflection of the test image The image of the eye of the user's eye; and the step of determining the tilt may include: detecting an area corresponding to the eye of the user from the image of the eye, obtaining the test image at the location Reflecting an image in the detected area corresponding to the eye, comparing at least one of a size and a shape of the reflected image with predetermined reference wear status information, and determining the tilt based on a result of the comparing degree.

The step of extracting the wear status information may include: obtaining a status value representing a movement state of the wearable glasses; and extracting the wear status information when the obtained status value is equal to or greater than a predetermined value .

The step of adjusting the image may include: determining whether the determined tilt is equal to or greater than a predetermined value; if the determined tilt is equal to or greater than the predetermined value according to the determining, displaying an image to notify The user adjusts the wearable glasses; and if the determined inclination is less than the predetermined value according to the determination, adjusting the image displayed on the display based on the determined inclination .

According to another aspect of the present invention, a non-transitory computer readable storage medium is provided, the non-transitory computer readable storage medium having at least one program included therein, the at least one program being included for execution An example of a method of displaying an image via wearable glasses, wherein the method includes: displaying an image provided by the wearable eyeglass; capturing wearable state information, wherein the wearable state information represents that the wearer currently wears the wearable eyewear a state of determining a tilt of the wearable glasses relative to the user based on the captured wear status information; and displaying the obtained adjusted image based on the determined tilt.

The step of extracting the wear status information may include: capturing the wear status information including information about a body part of the user; and the determining the tilt may include: The captured wear status information is compared with predetermined reference wear status information to determine the tilt of the wearable glasses relative to the user.

The step of extracting the wear status information may include: capturing the wear status information including an image of a body part of the user; and the determining the tilt may include: from the body And detecting, by the portion of the image, an area corresponding to the body part, extracting a characteristic value from the detected area, and extracting the extracted characteristic value from a reference value included in the reference wearing state information A comparison is made to determine the slope.

The step of displaying the image may include: displaying a test image; the step of capturing the wear status information may include: capturing the wear status information, the wear status information including reflecting use of the test image An eye image of the eye of the person; and the step of determining the tilt may include: detecting an area corresponding to the eye of the user from the eye image, obtaining the test image with the eye Corresponding the reflected image in the detected area, comparing at least one of the size and shape of the reflected image with predetermined reference wear status information, and determining the tilt based on a result of the comparing.

The displaying the adjusted image may include: determining whether the determined inclination is equal to or greater than a predetermined value; and determining, based on the determining, that the determined inclination is less than the predetermined value, based on the The determined tilt is used to adjust the image displayed on the display.

According to an aspect of still another exemplary embodiment, an element for displaying an image via wearable glasses is provided, the element comprising: a communicator for receiving wear status information from the wearable glasses, the wear status information Representing the state in which the wearable glasses are currently worn by the user, the wear status information is captured by the wearable glasses; and a controller for determining the wearable glasses relative to the wearable based on the received wear status information Determining the inclination of the user, and controlling to adjust an image to be displayed on the display of the wearable glasses based on the determined inclination, wherein the communicator is configured to transmit the adjusted image to the wearable The glasses are displayed on the display of the wearable glasses.

The received wear status information may include information regarding a body part of the user; and the controller may be configured to determine the tilt by comparing the received wear status information with predetermined reference wear status information.

In accordance with an aspect of yet another exemplary embodiment, a method is provided in which an element displays an image via wearable glasses, the method comprising: receiving wear status information from the wearable eyewear, the wear status information representing a user currently wearing a state of the wearable glasses, the wearable state information is captured by the wearable eyeglasses; determining a tilt of the wearable glasses relative to the wearer based on the received wearable state information; The determined tilt provides the obtained adjusted image to the wearable eyewear for display on the wearable eyewear.

According to an aspect of another exemplary embodiment, there is provided a non-transitory computer readable recording medium on which a program executable by a computer is recorded for performing the above method.

According to still another aspect of the exemplary embodiment, a wearable eyewear includes: a display for presenting an image to a user; and a sensor for capturing a posture of the user And a processor configured to determine an adjustment value based on the captured information and adjust an image displayed on the display based on the determined adjustment value.

According to an aspect of still another exemplary embodiment, there is provided a method of displaying an image via wearable glasses, the method comprising: extracting information about a posture of a user; determining an adjustment value based on the captured information; An image to be displayed on the display of the wearable glasses is adjusted based on the determined adjustment value.

According to another aspect of the exemplary embodiment, there is provided a non-transitory computer readable recording medium on which a program executable by a computer for executing the above method is recorded.

According to an aspect of still another exemplary embodiment, there is provided an element for displaying an image via wearable glasses, the element comprising: a communicator for receiving information about a posture of a user from the wearable glasses, Information about the posture of the user is captured by the wearable glasses; and a controller for determining an adjustment value based on the received information about the gesture, and controlling based on the determined Adjusting a value to adjust an image displayed via the wearable eyeglasses, wherein the communicator is configured to provide an adjusted image corresponding to the result of the image adjustment to the wearable eyeglass to display the wearable eyeglasses The adjusted image is described.

According to an aspect of still another exemplary embodiment, there is provided a method of displaying an image via wearable glasses, the method comprising: obtaining wear status information, the wear status information representing a state in which the user currently wears the wearable glasses; Determining the inclination of the wearable glasses with respect to the user based on the obtained wear status information; and controlling a display for adjusting the image to be displayed on the wearable glasses based on the determined inclination on.

The obtained wear status information may include information about a body part of the user; and the determining the inclination may include: by using the obtained wear status information with a predetermined reference wear status The information is compared to determine the inclination of the wearable glasses relative to the user.

The obtained wear status information may include an image of the body part; and the determining the inclination may include: detecting an area corresponding to the body part from the image of the body part, Extracting a characteristic value from the detected area, and comparing the captured characteristic value with a reference value included in the reference wearing state information to determine the inclination.

The wear status information may include an eye image of the user's eyes that is wearing the wearable glasses; and the determining the tilt may include: extracting the user from the eye image At least one of a length of the major axis of the eye, a length of the minor axis of the eye, an angle of the major axis of the eye, an angle of the minor axis of the eye, and a position value of the iris And comparing the captured at least one value with at least one predetermined reference value, and determining the inclination based on a result of the comparing.

The controlling the adjusting the image may include: determining whether the determined inclination is equal to or greater than a predetermined value; and if the determined inclination is less than the predetermined value according to the determining, the controlling is based on the The slope is determined to adjust the image.

According to another aspect of the exemplary embodiment, there is provided a non-transitory computer readable recording medium on which a program executable by a computer for executing the above method is recorded.

The exemplary embodiments are explained in detail herein with reference to the drawings, in which the invention can be readily implemented by those of ordinary skill in the art. However, the exemplary embodiments may be embodied in many different forms and should not be construed as being limited to the exemplary embodiments described herein. In the drawings, parts that are not relevant to the description are omitted for the sake of brevity of explanation, and the same reference numerals are used throughout the drawings.

Throughout the specification, the terms "comprise" and "comprising" or "include" are used to indicate the existence of the element, but do not exclude one. Or the presence or addition of multiple other components.

The term "display image" means an image provided to a user via wearable glasses. The display image may include images previously displayed via the wearable glasses, images currently being displayed via the wearable glasses, and images to be subsequently displayed via the wearable glasses. The display image can be an image produced by the wearable eyewear or an image received from an external component.

Exemplary embodiments will now be described more fully hereinafter with reference to the accompanying drawings in which the same reference Hereinafter, expressions such as "at least one of", when used before a series of elements, are used to modify the entire series of elements, rather than merely modifying the individual elements of the series.

A head mounted display (HMD) is mounted on the user's head and displays an image in front of the user's eyes (eg, directly in front). For example, like the wearable eyewear 10 shown in FIG. 1, the head mounted display can have the shape of a lens. Various exemplary embodiments of wearable glasses as a lens type head mounted display will be described in detail below. However, it should be understood that one or more other exemplary embodiments are not limited to wearable glasses. For example, one or more other exemplary embodiments are applicable to various types of head mounted displays that are partially or fully secured to a user's head and that display information within the user's perspective. The wearable eyewear 10 is temporarily fixed to the user's head by a frame or the like of the wearable eyewear 10. Therefore, when the user wears the wearable eyewear 10 for a long time, the positioning of the wearable eyewear 10 on the user's head may change as the user's motion or external environment changes.

Wearable eyewear 10 can include a near-eye display system that displays images within a few centimeters of the user's eyes. Therefore, the output image may be greatly distorted even by a slight change in the positioning of the wearable eyewear 10, so that the distorted image is provided to the user. In other words, when the wearable eyewear 10 is tilted or twisted relative to the user, the user is provided with a distorted image via a tilted or distorted display.

The distorted image may represent an image of at least one of a size change, a display position change, and a shape change compared to the reference image. For example, the reference image indicates an image provided to the user in a reference wear state in which the user properly wears the wearable eyewear 10 and can be predetermined.

Therefore, whenever the user feels uncomfortable due to image distortion, the user may have to frequently adjust the positioning of the wearable glasses.

To address this problem, aspects of one or more exemplary embodiments provide a system and method for adjusting a displayed image based on the tilt of the wearable eyeglass relative to the user and displaying the adjusted displayed image via the wearable eyewear.

2A, 2B, and 2C are diagrams for explaining an exemplary embodiment in which when the wearable eyewear 10 is determined to be tilted according to a comparison between a wear state of the wearable wearable eyewear 10 and a reference wear state, The wearable eyewear 10 displays the adjusted image by taking into account the inclination of the wearable eyewear 10. The reference wearing state indicates the state in which the user properly wears the wearable eyewear 10, and can be determined in advance. The reference wearing state can be set differently for different users wearing the wearable eyewear 10.

Various information can be provided to the user by recognizing both the display image and the surrounding environment provided via the wearable eyewear 10.

2A illustrates a situation in which the wearable eyewear 10 provides a display image to the user in a reference wear state in which the user properly wears the wearable eyewear 10. For example, as shown in FIG. 2A, the wearable eyewear 10 can support the navigation function by providing an image 12 that guides the path to the destination.

When the user wears the wearable eyewear 10 for a long time, the state in which the user wears the wearable eyewear 10 on his or her head (for example, the positioning of the wearable eyewear 10 on the user's head) may follow the user's movement or The external environment changes and changes. As shown in FIG. 2B, the wearable eyewear 10 can be tilted relative to the user as compared to the reference wear condition shown in FIG. 2A.

When the user wears the prior art wearable glasses, the user is provided with an image that has been distorted when the wearable glasses are tilted. In other words, even when the wearable eyewear 10 is tilted, the prior art wearable eyewear 10 outputs an image that the wearable eyewear 10 has output in the reference wear state. For example, as shown in FIG. 2B, when the wearable eyewear 10 supports a navigation function for guiding a path to a destination, the image 13 provided to the user can be visually tilted compared to the actual surrounding environment. of. Thus, according to the prior art, the user needs to physically adjust the positioning of the wearable eyewear 10 to receive an undistorted image.

Due to such inconvenience, it is necessary to be able to adjust the wearable eyewear 10 that displays an image in accordance with the degree of inclination of the wearable eyewear 10 with respect to the user as compared with the reference wear state.

As shown in FIG. 2C, the wearable spectacles 1000 may be tilted relative to the user as compared to the reference wear condition shown in FIG. 2A. Referring to FIG. 2C, the wearable spectacles 1000 according to an exemplary embodiment may output an adjusted image 14 obtained by compensating the degree of tilt of the wearable spectacles 1000 relative to the user.

The wearable spectacles 1000 can determine the degree of tilt of the wearable spectacles 1000 relative to a predetermined reference wear condition. For example, the reference wearing state may be a state that is predetermined to be a state in which the user properly wears the wearable spectacles 1000. The wearable spectacles 1000 can output an image that has been adjusted according to the degree of tilt of the wearable spectacles 1000 compared to a predetermined reference wear state.

The wearable spectacles 1000 can provide the user with an image 14 that is not tilted relative to the user. The wearable spectacles 1000 can adjust the display image 14 by rotating at least one of the following steps according to the degree of tilt of the wearable spectacles 1000 relative to the user compared to the reference wear state: rotating the display image 14 and displaying the display of the moving display image 14 Position, enlarge or reduce the display image 14, and change the shape of the displayed image. For example, as shown in FIG. 2C, when the wearable eyewear 1000 supports a navigation function that guides a path to a destination, the wearable eyewear 1000 according to an exemplary embodiment may output by compensating the wearable eyewear 10 The adjusted image 14 obtained by the degree of tilt. Thus, the adjusted image 14 provided to the user in accordance with an exemplary embodiment can provide path guidance information that is not tilted relative to the actual surrounding environment. That is, the adjusted image 14 can provide path guidance information at a location that matches the actual surrounding environment.

3A and 3B illustrate an appearance of the wearable eyewear 1000 according to an exemplary embodiment.

3A and 3B, the wearable eyewear 1000 can be a monocular display, but it should be understood that one or more other exemplary embodiments are not limited thereto.

Referring to FIG. 3A, the wearable spectacles 1000 can be configured to be secured to a lens on a user's head using the user's ears and nose. However, the structure of the wearable glasses 1000 is not limited to FIGS. 3A and 3B. For example, the wearable eyewear 1000 can be attached to a helmet structure, can be configured as a goggle, can have a headband structure, can have an elastic band, can be attached to another structure Or another pair of glasses, etc.

The wearable eyewear 1000 shown in FIG. 3A can include a frame 1010, a processor 1200, a camera 1050 (eg, a first camera), an audio output unit 1020 (eg, an audio output device or an audio output component), a display 1030, and a user input unit. 1040 (eg, a user input or user input element), and a power supply unit 1600 (eg, a power supply or power supply component). It should be understood that more or fewer components may be included in the wearable eyewear 1000 than shown in Figure 3A.

Some components of the wearable eyewear 1000 can be built into the wearable eyewear 1000, or other components can be mounted on the exterior of the wearable eyewear 1000. For example, the processor 1200 and the power supply unit 1600 can be built in the wearable glasses 1000. The display 1030 can be mounted on the exterior of the wearable eyewear 1000. The components built into the wearable eyewear 1000 and the components mounted on the exterior of the wearable eyewear 1000 are not limited to the above.

The components included in the wearable spectacles 1000 are not limited to those shown in FIG. 3A. For example, the wearable glasses 1000 may further include a sensing unit (eg, a sensor) and a communication unit (eg, a communication component, a transceiver, a transmitter, a communicator, etc.), the sensing unit capable of extracting The information of the wearable glasses 1000 or the surrounding environment information of the wearable glasses 1000 for communicating with external components. For example, the sensing unit and the communication unit can be built into the wearable glasses 1000.

The frame 1010 can be formed from a material such as plastic and/or metal (eg, comprising materials such as plastic and/or metal) and can include wires that connect the components of the wearable eyewear 1000 to each other.

The frame 1010 shown in FIG. 3A is integral with the wearable eyewear 1000, but the shape and configuration of the frame 1010 are not limited to those shown in FIG. 3A.

For example, the frame 1010 of the wearable eyewear 1000 can include a connecting member (eg, a connector), and thus can be configured such that at least a portion of the frame 1010 is bendable. For example, the wearable spectacles 1000 can include a bendable frame 1010 and thus can be folded and stored when the user does not use the wearable spectacles 1000, thereby minimizing the space occupied by the wearable spectacles 1000.

The wearable eyewear 1000 can further include an elastic band such that the wearable eyewear 1000 can be secured to the user's head regardless of the size of the user's head.

The frame 1010 according to an exemplary embodiment may be configured such that the lens 1005 is detachable from the frame 1010. Wearable eyewear 1000 may not include lens 1005. While the lens 1005 is integral with the nose bridge in FIG. 3A, it should be understood that one or more other exemplary embodiments are not limited thereto. For example, the nose piece of the wearable eyewear 1000 can be integral with the frame 1010.

Lens 1005 can be formed from a transparent material that enables a user to see the actual space via lens 1005. The lens 1005 may be formed of a material that can transmit light constituting an image displayed on the display 1030. Examples of materials used to form lens 1010 can include, but are not limited to, glass and plastic, such as polycarbonate.

The processor 1200 can be connected to the wearable eyewear 1000 via a wire and/or wirelessly. Although the processor 1200 is located on the left side surface of the frame 1010 in FIG. 3A, it should be understood that one or more other exemplary embodiments are not limited thereto. For example, the processor 1200 can be located on the right side surface of the frame 1010 or on the front surface of the wearable eyewear 1000 to be adjacent to the camera 1050. In general, it should be understood that the relative positions of the various components of the wearable eyewear 1000 are not limited to the exemplary embodiment illustrated in FIG. 3A, but may vary in various exemplary embodiments.

The processor 1200 can receive data from the camera 1050 or the user input unit 1040, analyze the received data, and generate information to be provided to the user of the wearable glasses 1000 via at least one of the display 1030 and the audio output unit 1020. . The information to be provided to the user may include, but is not limited to, at least one of an image, a text, a video, and an audio.

Camera 1050 can be included in display 1030 or can be separate from display 1030 and disposed on frame 1010. The camera 1050 can be a camera used in a smart phone or a compact camera such as a webcam. For example, the camera 1050 can be mounted at a predetermined location suitable for capturing images corresponding to the user's gestures. For example, as shown in FIG. 3A, when the user wears the wearable eyewear 1000, the camera 1050 can be mounted at a position adjacent to the user's eyes, thereby capturing an image similar to that recognized by the user's eyes. image.

Each of the user input units 1040 can include, but is not limited to, a touch pad that can be operated by a user's finger, an optical input element, a rotatable dial, a joystick, and can be used At least one of the push buttons that operate to operate. Although the user input units 1040 are respectively mounted on the two side surfaces of the frame 1010 in FIG. 3A, it should be understood that the user input unit 1040 can be positioned on the wearable glasses 1000 in accordance with one or more other exemplary embodiments. Other locations.

User input unit 1040 receives user input. The user input may include user input data or user input signals, and the user input data or user input signals generate an event that causes the wearable glasses 1000 to begin or end an operation.

For example, each of the user input units 1040 can include an on/off switch that can turn the wearable glasses 1000 on/off. Alternatively, user input unit 1040 can receive user input for adjusting images displayed via wearable glasses 1000.

As shown in FIG. 3A, display 1030 can be located on the upper left end of lens 1005, although it should be understood that one or more other exemplary embodiments are not limited thereto. For example, display 1030 can be located on the right end of lens 1005 or can be located on the lower end of lens 1005. As shown in FIG. 3A, display 1030 can be constructed as a translucent optical waveguide (eg, germanium). The display 1030 shown in FIG. 3A can reflect light output from a projector built into the wearable eyewear 1000 and focus the image on the foveal fovea of the user's eyes wearing the wearable eyewear 1000. However, the display 1030 included in the wearable eyewear 1000 is not limited to FIG. 3A, but the display 1030 can display images close to the user's eyes using various methods and various configurations.

The wearable eyewear 1000 according to an exemplary embodiment may further include a microphone. The microphone can receive, for example, the voice of the user and the sound of the surroundings of the wearable eyewear 1000.

The audio output unit 1020 can be configured as an earphone that can be mounted on the ear of a user of the wearable eyewear 1000. The audio output unit 1020 can be secured to the wearable eyewear 1000 as shown in FIG. 3A, although it should be understood that one or more other exemplary embodiments are not limited thereto. For example, the audio output unit 1020 can be detached from the wearable spectacles 1000 such that a user of the wearable spectacles 1000 can selectively mount the audio output unit 1020 on his or her ear. For example, each of the audio output units 1020 can be configured as a bone conduction speaker.

In FIG. 3A, a power supply unit 1600 is located on an end of the frame 1010 of the wearable eyewear 1000. However, it should be understood that one or more other exemplary embodiments are not limited thereto, and that the power supply unit 1600 may be disposed at any of various other positions on the frame 1010 of the wearable eyewear 1000. The power supply unit 1600 can power each component to operate the wearable glasses 1000. The power supply unit 1600 can include a battery that can be charged and a cable or cable that can receive power from an external source.

FIG. 3B illustrates the appearance of the wearable eyewear 1000 as viewed by the user when the user wears the wearable eyewear 1000.

Referring to FIG. 3B, the wearable eyewear 1000 can include a camera 1060 (eg, a second camera) that is adjacent to the display 1030 and that faces the user. The wearable spectacles 1000 can adjust the image displayed on the display 1030 based on the image of the user's eyes taken with the camera 1060. However, the position of the camera 1060 is not limited to the position shown in FIG. 3B, but may be any of various other positions depending on the shape of the wearable spectacles 1000 in one or more other exemplary embodiments.

The wearable eyewear 1000 can further include an eye tracking camera 1070 that faces the user. For example, the glasses tracking camera 1070 can include an infrared camera. The eye tracking camera 1070 can detect the user's eyes by tracking the user's iris. However, the position of the eye tracking camera 1070 is not limited to the position shown in FIG. 3B, but may be any of various other positions depending on the shape of the wearable spectacles 1000 in one or more other exemplary embodiments.

4A and 4B, the wearable eyewear 1000 can have a monocular display shape and can be configured to be secured to the left or right side of the user's head. The same components of the wearable eyewear 1000 shown in FIGS. 4A and 4B as those described above with reference to FIGS. 3A and 3B will not be repeatedly described herein.

Referring to Figure 4A, the wearable eyewear 1000 can be secured to the user's head using one of the user's ears and one side of the user's nose. Wearable eyewear 1000 can be attached to a helmet structure, but it should be understood that one or more other exemplary embodiments are not limited thereto.

The wearable eyewear 1000 shown in FIG. 4A can include a processor 1200, a camera 1050, an audio output unit 1020, a display 1030, a user input unit 1040, and a power supply unit 1600.

As shown in FIG. 4A, the wearable eyewear 1000 can be configured to cause the lens 1005 to perform the functions of the display 1030. In this case, the lens 1005 can be constructed as a transparent display or a translucent display. When the lens 1005 is configured as a translucent display, the lens 1005 can be used to form at least one optical waveguide (eg, germanium), an electroluminescent display, an organic light emitting diode (OLED). The material of the display or the liquid crystal display (LCD) is formed of the same material, but it should be understood that the material of the lens 1005 is not limited thereto.

FIG. 4B illustrates the appearance of the wearable eyewear 1000 as viewed by the user when the user wears the wearable eyewear 1000.

Referring to FIG. 4B, the wearable eyewear 1000 can include a camera 1060 that faces the user. The wearable spectacles 1000 can adjust the image displayed on the display 1030 based on the image of the user's eyes taken by the camera 1060. However, it should be understood that the position of the camera 1060 is not limited to the position shown in FIG. 4B, but may be any of various other positions depending on the shape of the wearable spectacles 1000 in one or more other exemplary embodiments. .

The wearable eyewear 1000 can further include an eye tracking camera 1070 (eg, a glasses tracker) that faces the user. The eye tracking camera 1070 can detect the user's eyes by tracking one or two irises of the user. However, the position of the eye tracking camera 1070 is not limited to the position shown in FIG. 4B, but may be any of various other positions depending on the shape of the wearable glasses 1000.

5A and 5B illustrate an appearance of the wearable eyewear 1000 according to an exemplary embodiment.

5A and 5B, the wearable glasses 1000 can be a binocular display. The components of the wearable eyewear 1000 shown in FIGS. 5A and 5B that are the same as or similar to those described above with reference to FIGS. 3A, 3B, 4A, and 4B will not be described herein.

The wearable eyewear 1000 shown in FIG. 5A can include a frame 1010, a processor 1200, a camera 1050, an audio output unit 1020, a display 1030, a user input unit 1040, and a power supply unit 1600.

As shown in FIG. 5A, the wearable eyewear 1000 can be configured to cause the lens 1005 to perform the functions of the display 1030. In this case, the lens 1005 can be constructed as a transparent display or a translucent display. When the lens 1005 is configured as a translucent display, the lens 1005 may be formed of the same material used to form at least one optical waveguide (eg, germanium), an electroluminescent display, an organic light emitting diode display, or a liquid crystal display, However, it should be understood that the material of the lens 1005 is not limited thereto.

FIG. 5B illustrates the appearance of the wearable eyewear 1000 as viewed by the user when the user wears the wearable eyewear 1000.

Referring to FIG. 5B, the wearable eyewear 1000 can include a camera 1060 that faces the face of the user. The wearable spectacles 1000 can adjust the image displayed on the display 1030 based on images of one or more eyes of the user captured by the camera 1060. However, it should be understood that the position and number of cameras 1060 are not limited to the position and number shown in FIG. 5B, but may be any one or more of various other positions or numbers depending on the shape of the wearable glasses 1000. For example, according to another exemplary embodiment, only one camera 1060 may be provided to capture an image of one or more eyes of a user.

The wearable eyewear 1000 can further include an eye tracking camera 1070 that faces the face of the user. The eye tracking camera 1070 can detect the user's eyes by tracking the user's iris. However, it should be understood that the position and number of the eye tracking camera 1070 are not limited to the position and number shown in FIG. 5B, but may be any one of various other positions and numbers depending on the shape of the wearable eyewear 1000. Moreover, according to an exemplary embodiment, the eye tracking camera 1070 can be omitted, and the camera 1060 can replace the eye tracking camera 1070 to detect the user's eyes.

As described above with reference to Figures 3A, 3B, 4A, 4B, 5A, and 5B, the shape and components of the wearable eyewear 1000 can be variously modified by those of ordinary skill in the art. It should be understood that one or more other exemplary embodiments are not limited to FIG. 3A, FIG. 3B, FIG. 4A, FIG. 4B, FIG. 5A and FIG. 5B, but FIG. 3A, FIG. 3B, FIG. 4A, FIG. Any of 5A and 5B. That is, more or fewer components than those shown in FIGS. 3A, 3B, 4A, 4B, 5A, and 5B may be included in the wearable eyewear 1000.

FIG. 6 is a flowchart of a method of displaying an image of the wearable spectacles 1000, according to an exemplary embodiment.

Referring to FIG. 6, in operation S100, the wearable glasses 1000 can generate and display an image.

Wearable glasses 1000 can process and provide images and display the provided images via display 1030. The image provided by the wearable glasses 1000 can be an image containing a text, a chart, a number or a color, or a moving picture to provide information to the user. However, it should be understood that one or more other exemplary embodiments are not limited thereto. For example, according to another exemplary embodiment, the image provided by the wearable glasses 1000 may be an image including a user interface (UI) or a graphical user interface (GUI) for The interaction between the user and the wearable glasses 1000.

For example, the wearable spectacles 1000 can also display a test image for capturing wearable state information, the wearable state information representing a state in which the wearer currently wears the wearable spectacles 1000. The wearable spectacles 1000 can output a test image and extract wear status information from the image of the user's eyes that reflect the test image. In operation S200, the wearable glasses 1000 may capture wear status information representing the state in which the user currently wears the wearable glasses 1000.

The wearable spectacles 1000 can determine the state in which the user currently wears the wearable spectacles 1000 based on information about the body part of the user wearing the wearable spectacles 1000. The wearable glasses 1000 can capture wear status information including information about the body part of the user. The information about the body part taken by the wearable spectacles 1000 may include information about the body part of the wearable spectacles 1000. For example, the information about the body part may include information for determining the relative position and angle of the wearable spectacles 1000 relative to at least one body part included in the head of the wearable spectacles 1000. For example, the information about the body part may include information about at least one of an eye, a nose, an ear, and a mouth included in a head of a user wearing the wearable spectacles 1000.

The wearable spectacles 1000 can capture wear status information including information about a body part of a user in contact with the wearable spectacles 1000. For example, when the wearable spectacles 1000 includes a nose piece and a temple, the wearable spectacles 1000 can capture at least one of the position and angle of the nose piece relative to the user's nose or the spectacles relative to the user. Information on at least one of the position and angle of the ear. The wearable spectacles 1000 can determine the at least one of the position and angle of the nose piece relative to the user's nose, or the position and angle of the temple relative to the user's ear, as compared to the reference wear condition Whether at least one has changed. Based on the result of the determination, the wearable spectacles 1000 can extract information about the state in which the user currently wears the wearable spectacles 1000 based on the position of the wearable spectacles 1000 in the reference wear state.

The wearable spectacles 1000 can also capture wear status information including information about a body part of a user who is not in contact with the wearable spectacles 1000. For example, the wearable glasses 1000 can take an image of the user's eyes and compare the captured eye image with the eye image taken in the reference wear state. By comparing the captured eye image with the eye image taken in the reference wear state, the wearable eyewear 1000 can draw on the user's current wearable wearable glasses based on the position of the wearable eyewear 1000 in the reference wear state. Information on the status of 1000.

The wearable spectacles 1000 can capture wear status information including whether the position and angle of at least a portion of the wearable spectacles 1000 have changed compared to the reference wear status when the user properly wears the wearable spectacles 1000 News.

The wearable spectacles 1000 can use the sensing unit included in the wearable spectacles 1000 to capture wear status information representing the state in which the wearer currently wears the wearable spectacles 1000, or draw wear status information from external components. For example, the wearable spectacles 1000 can use at least one of the following included in the wearable spectacles 1000 to capture wear status information: a magnetic sensor, an acceleration sensor, a gyro sensor, a proximity sensor, Optical sensors, depth sensors, infrared sensors, and ultrasonic sensors.

When the wearable spectacles 1000 are initialized or the wearable spectacles 1000 is turned on, the wearable spectacles 1000 can capture wearable state information representing the state in which the wearer currently wears the wearable spectacles 1000.

Alternatively, when receiving a user input for capturing wear status information representative of the state in which the user is currently wearing wearable glasses 1000, wearable glasses 1000 may retrieve wear status information.

Alternatively, when the wearable eyewear 1000 is moved substantially, the wearable eyewear 1000 can determine that the position of the wearable eyewear 1000 relative to the user is highly likely to be changed. Therefore, when at least one of the respective measured values (eg, acceleration value, speed value, and angular momentum) representing the movement of the wearable spectacles 1000 is equal to or greater than a critical value, the wearable spectacles 1000 can retrieve the representative user Wear status information of the state in which the wearable glasses 1000 is currently worn.

By comparing the reference wearing state when the user properly wears the wearable eyewear 1000, the wear status information representative of the state in which the user is currently wearing the wearable eyewear 1000 can be used to determine the degree of tilt of the wearable eyewear 1000 relative to the user.

The wearable spectacles 1000 can capture wear status information including information about the body part of the user wearing the wearable spectacles 1000 to determine the degree of tilt of the wearable spectacles 1000 relative to the user. For example, the information about the body part retrieved by the wearable eyewear 1000 can include information about at least one of the user's eyes, nose, ears, mouth, and hands. The information about the body part captured by the wearable glasses 1000 may also include images of the body part.

As another example, information about a body part of a user may include information about the user's posture. The term "posture" may refer to the shape of the body part of the user at a certain point in time, the change in the shape of the body part of the user over a certain period of time, the change in position of the body part, or the action of the body part. For example, the information about the posture of the user may be an image of the body part of the user at a certain point in time, or information about a touch input input through the user input unit 1040.

For example, when the user wears the wearable eyewear 100 using the nose bridge (just like how the user wears the lens), the wearable eyewear 1000 can capture the inclination of the wearable eyewear 1000 worn on the user's nose. As information about the user's nose.

As another example, when the user wears the wearable eyewear 1000 by fixing the frame of the wearable eyewear 1000 to the user's ear (just like how the user wears the lens), the wearable eyewear 1000 can learn about use. Information about the relative position between the ears of the person serves as information about the user's ear.

As still another example, the wearable spectacles 1000 can capture images of at least one of the user's eyes as information about the user's eyes. The wearable spectacles 1000 can capture an eye image by photographing the user's eyes using the camera 1060 included in the wearable spectacles 1000. For example, the wearable glasses 1000 can capture wear state information including images taken by photographing the eyes of the user who reflects the test image.

A method of capturing an image of a user's eyes as information about a body part of a user will be described in more detail below with reference to FIGS. 8, 9, 10A and 10B, and FIGS. 11A-11C.

In operation S300, the wearable spectacles 1000 may use the wear status information captured in operation S200 to determine the inclination of the wearable spectacles 1000 relative to the user.

The inclination of the wearable spectacles 1000 with respect to the user indicates the degree to which the wearable spectacles 1000 currently worn by the user are tilted based on the predetermined reference wear state when the user properly wears the wearable spectacles 1000. In other words, the inclination of the wearable spectacles 1000 may indicate the change in the position and angle of the wearable spectacles 1000 from the position and angle of the wearable spectacles 1000 relative to the user in the reference wear state. The wearable spectacles 1000 can determine the inclination of the wearable spectacles 1000 relative to the user by comparing the wear status information captured in operation S200 with predetermined reference wear status information.

For example, the predetermined reference wear status information represents a state in which the user wears the wearable glasses 1000 at the position where the image is most suitable for receiving the image, and thus the reference wear status information may be previously stored as a predetermined value or may be set by the user. A method of setting a reference wearing state by a user will be described in detail below with reference to FIG.

For example, information regarding the state in which the user is currently wearing the wearable eyewear 1000 may include an image of the body portion of the user. The wearable spectacles 1000 can detect an area corresponding to the body part of the image of the body part, and can extract the characteristic value of the body part from the detected area. The wearable spectacles 1000 can capture a characteristic value that is associated with the position, shape, or size of the region of the body portion that is detected by the image of the body portion. The wearable spectacles 1000 can determine the inclination of the wearable spectacles 1000 by comparing the extracted characteristic values with reference values included in the reference wear status information. The reference value included in the reference wear status information may be a characteristic value detected from the image of the body part captured in the reference wear state. The reference value may be a pre-stored value or a value set by a user.

The wearable spectacles 1000 can map a plurality of reference wear states and/or a plurality of reference values to a plurality of body parts and store the results of the mapping. Alternatively, the wearable glasses 1000 can map a plurality of reference wear states and/or multiple reference values to a plurality of users and store the results of the mapping, and thus can be compensated according to different users using different criteria. The inclination of the wearable glasses 1000.

A method of determining the inclination of the wearable spectacles 1000 by the image of the body portion will be described in detail below with reference to FIGS. 12 to 17.

FIG. 7 is a diagram for explaining the inclination of the wearable eyewear 1000 with respect to the user determined based on the reference wearing state, according to an exemplary embodiment. The inclination of the wearable spectacles 1000 relative to the user may indicate the extent to which the wearable spectacles 1000 worn by the user are inclined relative to the predetermined reference wear state.

Figure 7 illustrates a situation in which the wearable eyewear 1000 is in a reference state relative to the user. The reference wear state indicates that the wearable eyewear 1000 is positioned to be optimal for the user to receive images from the wearable glasses 1000. The reference wear status may be previously stored as a predetermined value or may be set by a user.

For example, the wearable spectacles 1000 can capture the angle at which the wearable spectacles 100 rotate along a spatially defined virtual axis as the slope value. For example, the inclination of the wearable spectacles 1000 relative to the user may include at least one (or all) of the front-rear inclination, the up-down inclination, and the left-right inclination, the front-back The inclination, the up-down inclination, and the left-right inclination are determined based on three spatially defined axes in the reference wear state of the wearable spectacles 1000. The inclination of the wearable spectacles 1000 relative to the user may represent a relative inclination relative to the reference wear state, which represents the extent to which the wearable spectacles 1000 are tilted relative to a particular body portion of the user.

As shown in FIG. 7, the self-wearing glasses 1000 may define an x-axis, a y-axis, and a z-axis based on when the state in which the user currently wears the wearable spectacles 1000 is a reference wear state. The x-axis of the wearable spectacles 1000 in the reference worn state may be parallel to an axis in which the coronal plane and the transverse plane of the user's body intersect each other. The y-axis of the wearable spectacles 1000 in the reference worn state may be parallel to an axis in which the sagittal plane of the user's body intersects the transverse plane. The z-axis of the wearable spectacles 1000 in the reference worn state may be parallel to an axis in which the sagittal plane of the user's body intersects the coronal plane. It should be understood that the reference wearing state is not limited to the above. For example, according to another exemplary embodiment, the reference wear status may be changed or may be different depending on the setting of the user.

In the present specification, the front-rear inclination of the wearable spectacles 1000 indicates that the wearable spectacles 1000 are rotated around the x-axis from the position of the wearable spectacles 1000 with respect to the user in the reference wear state (hereinafter, referred to as a reference position). Angle. For example, the x-axis can be an axis parallel to a line connecting the two eyes of the user to each other in the reference wear state.

The upper-lower inclination of the wearable spectacles 1000 represents the angle at which the wearable spectacles 1000 are rotated about the y-axis from the reference position. For example, the y-axis can be an axis that is parallel to the direction of the eye that the user is looking straight forward in the reference wear state.

The left-right inclination of the wearable spectacles 1000 represents the angle at which the wearable spectacles 1000 are rotated about the z-axis from the reference position. The z-axis can be an axis perpendicular to the x-axis and the y-axis.

For convenience of explanation, a case in which the angle of rotation of the wearable spectacles 1000 around the x-axis, the y-axis, and the z-axis shown in FIG. 7 is determined as the inclination of the wearable spectacles 1000 is explained in the present specification. However, it should be understood that one or more other exemplary embodiments are not limited to the situation illustrated in FIG. 7, but various methods and various criteria may be used to determine the degree of tilt of the wearable eyewear 1000 relative to the user.

A method of determining the inclination of the wearable eyewear 1000 relative to the user using the wearable state information of the user will be described in detail below with reference to FIGS. 12 through 17.

The wearable spectacles 1000 can determine the inclination of the wearable spectacles 1000 based on information about the posture of the user. The wearable spectacles 1000 can map information about a plurality of gestures to an inclination and store the result of the mapping, or store a relationship that can calculate the inclination of the wearable spectacles 1000 based on information about the gesture. The wearable spectacles 1000 can determine the inclination by searching for a pre-stored inclination based on the captured information about the user's posture or by calculating the inclination using the found relationship.

Referring back to FIG. 6, in operation S400, the wearable glasses 1000 adjusts the image displayed on the display 1030 based on the determined tilt. The wearable spectacles 1000 adjusts the image displayed on the display 1030 based on the inclination determined according to the reference wear state.

Even when the wearable eyewear 10 is tilted, the wearable eyewear 1000 can provide the user with an undistorted image by adjusting the image displayed on the display 1030 based on the inclination of the wearable eyewear 1000 relative to the user.

For example, the wearable spectacles 1000 can adjust at least one of a rotation angle, a size, and a shape of the display image based on the inclination of the wearable spectacles 1000 determined in operation S300.

For example, when the display 1030 of the wearable spectacles 1000 is configured as a translucent optical waveguide (eg, 稜鏡), the wearable spectacles 1000 can adjust the output of the projector from the display 1030 based on the inclination of the wearable spectacles 1000. The position of the focus of the light being focused.

The wearable eyewear 1000 can perform image adjustments (eg, horizontal translation, vertical translation, keystoneing, and/or correction of the image thereof) for compensating for the tilt of the wearable eyewear 1000 such that distortion can be provided to the user. Various types of image processing of images).

For example, when the wearable spectacles 1000 are tilted in the vertical direction with respect to the user, for example, when it is determined that the up-down inclination is a value other than 0, the wearable spectacles 1000 can compensate for the up-down tilt of the displayed image. degree. In other words, the wearable spectacles 1000 can rotate the display image by the determined up-down inclination in a direction opposite to the direction in which the wearable spectacles 1000 are tilted.

Therefore, even when the state in which the user currently wears the wearable spectacles 1000 deviates from the reference wear state, the user who uses the wearable spectacles 1000 can be provided with the tilt-compensated image without correcting the position of the wearable spectacles 1000.

A method of displaying an image adjusted based on the inclination of the wearable spectacles 1000 will be described in detail below with reference to FIGS. 19, 20, 21A and 21B, 22A to 22C, and 23 to 26.

FIG. 8 is a flow diagram of a method in which wearable eyewear 1000 captures information about a body part of a user, in accordance with an exemplary embodiment.

When the wearing state information representing the state in which the user currently wears the wearable spectacles 1000 is used to determine the degree to which the wearable spectacles 1000 are inclined with respect to the reference wearing state, the wearable spectacles 1000 can capture the wearing state of the user at regular time intervals. News. For example, the wearable spectacles 1000 can take a picture of the user's eyes at regular time intervals to capture the wearer's wear status information.

However, repeatedly capturing the wearable state information of the user may cause overload of the memory capacity and overload of the calculation amount of the processor. Therefore, according to an exemplary embodiment, as shown in FIG. 8, the wearable glasses 1000 may capture the wear status information of the user only when a certain event occurs.

Referring to FIG. 8, in operation S210, the wearable glasses 1000 may determine whether to initialize the wearable glasses 1000. For example, when the power of the wearable glasses 1000 is turned on or the initialization input for initializing the wearable glasses 1000 is received from the user, the wearable glasses 1000 can be initialized.

When the wearable glasses 1000 are initialized, the wearable glasses 1000 can capture the wearable state information of the user in operation S250. After the wearable glasses 1000 are initialized, the wearable glasses 1000 can capture the wear status information of the wearer based on the movement state value of the wearable glasses 1000 by performing operation S220.

In operation S220, the wearable spectacles 1000 may measure the movement state value of the wearable spectacles 1000. The movement state value represents a value representing the movement of the wearable spectacles 1000.

For example, the wearable spectacles 1000 can measure at least one of an acceleration value, a speed value, and an angular momentum value of the wearable spectacles 1000 as a movement state value. In operation S230, the wearable glasses 1000 may determine whether the measured movement state value is equal to or greater than a predetermined value. When the measured movement state value is equal to or greater than the predetermined value, the wearable glasses 1000 may retrieve the wear status information in operation S250. On the other hand, when the measured movement state value of the wearable spectacles 1000 is less than a predetermined value, the wearable spectacles 1000 can photograph or photograph the image or state of the user's eyes based on the user input by performing operation S240. .

In operation S240, the wearable glasses 1000 can determine whether an input for adjusting the display image has been received from the user. When a distorted image is provided to the user due to a change in position of the wearable spectacles 1000, the user can input a command to the wearable spectacles 1000 for adjusting the display based on the degree to which the wearable spectacles 1000 are tilted relative to the reference wear state. image.

The wearable spectacles 1000 may perform step S240 to determine whether a user input for adjusting the display image has been received. When the user input for adjusting the display image has been received, the wearable glasses 1000 can retrieve the wear status information in operation S250. On the other hand, when the user input for adjusting the display image is not received, the wearable spectacles 1000 may repeat the operations S210 to S240.

In operation S250, the wearable glasses 1000 can capture the wear status information of the user. The wearable spectacles 1000 can output a guide image to guide the user to look straight ahead, thereby improving the measurement accuracy of the tilt of the wearable spectacles 1000. For example, as shown in FIG. 9, the wearable glasses 1000 can display an image 901 on the display 1030 to notify the user that the user's eyes will be photographed for adjustment or to notify the user that the image correction process is about to begin. The wearable eyewear 1000 can photograph the user's eyes after outputting the guided image. However, it should be understood that one or more other exemplary embodiments are not limited thereto, and that the user's eyes may be photographed without outputting a guide image.

The wearable spectacles 1000 can capture a portion of the user's body to capture information about the state in which the user is currently wearing the wearable spectacles 1000. For example, the wearable spectacles 1000 can capture wear status information including images of the eyes of the user wearing the wearable spectacles 1000. 10A, 10B, 11A, 11B, and 11C are examples of images of a user's eyes taken through the wearable eyewear 1000, in accordance with one or more exemplary embodiments.

As shown in FIG. 10A, the wearable eyewear 1000 can photograph one eye of the user. Alternatively, as shown in FIG. 10B, the wearable eyewear 1000 can photograph both eyes of the user.

FIGS. 10A and 10B illustrate images of a user's eyes taken through the wearable spectacles 1000 when the wearable spectacles 1000 are not tilted relative to the user based on the reference wear state, in accordance with one or more exemplary embodiments.

11A, 11B, and 11C illustrate images of a user's eyes taken through the wearable spectacles 1000 when the wearable spectacles 1000 are tilted relative to the user based on the reference wear state, in accordance with one or more exemplary embodiments. .

FIG. 11A illustrates an example of an image of a user's eyes taken through the wearable spectacles 1000 when the wearable spectacles 1000 are tilted in the vertical direction with respect to the user and thus there is an up-down inclination. 11A illustrates the user when the wearable spectacles 1000 have been rotated about the y-axis of the wearable spectacles 1000 in the reference wear state (ie, the axis parallel to the direction of the eye in which the user in the reference wear state is looking straight ahead) An image of the eye. The position and angle of the two eyes shown in Fig. 11A are changed as compared with the positions of the two eyes shown in Fig. 10B.

FIG. 11B illustrates an example of an image of a user's eyes taken through the wearable spectacles 1000 when the wearable spectacles 1000 are tilted left and right relative to the user and thus there is a left-right tilt. 11B illustrates that the wearable eyewear 1000 has been wrapped around the z-axis of the wearable eyewear 1000 in a reference worn state (ie, an axis that is perpendicular to the x-axis and the y-axis, which is parallel to Referring to the straight line in which the two eyes of the user in the worn state are connected to each other) an image of the user's eyes when the rotation occurs.

When the wearable spectacles 1000 are tilted to the left and right with respect to the user and thus the distance from one side of the wearable spectacles 1000 to the eyes of the user increases, the size of the eyes displayed on the image of the eye is reduced. When the wearable spectacles 1000 are tilted left and right relative to the user and thus the distance from the other side of the wearable spectacles 1000 to the eyes of the user is reduced, the size of the eyes displayed on the image of the eye is increased. The size of the two eyes shown in Fig. 11B changes in comparison with the positions of the two eyes shown in Fig. 10B. Referring to FIG. 11B, since the right eye of the user shown on the captured eye image becomes smaller, the right eye of the user becomes farther from the right side of the wearable eyewear 1000. Since the left eye of the user shown on the photographed eye image becomes larger, the left eye of the user becomes closer to the left side of the wearable eyewear 1000. In other words, FIG. 11B illustrates the z-axis of the wearable spectacles 1000 when the wearable spectacles 1000 have become farther from the user along the right end of the wearable spectacles 1000b and their left ends become closer to the user. An example of a captured eye image when rotated.

The wearable spectacles 1000 can capture images of the user's eyes as information about the body part of the user and use the eye images to determine the inclination of the wearable spectacles 1000 relative to the user. In this case, the wearable spectacles 1000 can directly photograph the user's eyes by using a camera included in the wearable spectacles or by receiving an image of the user's eyes taken by the external component from the external component. Take an image of the user's eyes.

FIG. 11C illustrates an example of an image of a user's eyes taken through the wearable spectacles 1000 when the wearable spectacles 1000 have a front-rear tilt relative to the user. That is, FIG. 11C illustrates an image of the user's eyes when the wearable spectacles 1000 have been rotated about the x-axis of the wearable spectacles 1000 in the reference wear state. The position and angle of the two eyes shown in Fig. 11A are changed as compared with the positions of the two eyes shown in Fig. 10B.

FIG. 12 is a flowchart of a method of determining the inclination of the wearable spectacles 1000 from the image of the user's eyes, according to an exemplary embodiment of the wearable spectacles 1000.

In operation S310, the wearable spectacles 1000 may determine a first region corresponding to the eyes of the user from the eye image.

For example, the wearable spectacles 1000 can determine a first region corresponding to the user's eyes based on a change in at least one of brightness and color of the eye image.

Figure 13 illustrates an example of an image of a user's eye. The wearable spectacles 1000 can determine the area 1301 indicated by the broken line shown in FIG. 13 as the first area corresponding to the eyes of the user.

In operation S320, the wearable spectacles 1000 may determine a second region corresponding to the user's iris from the eye image.

For example, the wearable spectacles 1000 can determine a second region corresponding to the user's iris based on a change in at least one of brightness and color of the eye image. The wearable spectacles 1000 may determine the second region within the first region determined in operation S310, thereby reducing the amount of calculation compared to the case of determining the second region throughout the ocular image.

Figure 14 illustrates an example of an image of a user's eye. The wearable spectacles 1000 can determine the area 1401 indicated by the broken line shown in FIG. 14 as the second area corresponding to the user's iris.

The wearable spectacles 1000 can further determine a region 1403 (eg, a third region) corresponding to the pupil of the user or the center 1405 of the second region 1401. As shown in FIG. 14, the wearable spectacles 1000 can further determine a region 1403 corresponding to the pupil of the user or the center 1405 of the second region 1401 from the eye image.

In operation S330, the wearable spectacles 1000 may capture a characteristic value of the user's eyes based on at least one of the first area and the second area. The characteristic value of the user's eye may include the length value of the long axis of the eye in the eye image, the length value of the short axis of the eye, the angle value of the long axis rotation, the angle value of the short axis rotation, and the iris representing the user. At least one of the values of the location.

FIG. 15 is a schematic diagram for explaining characteristic values extracted from a captured eye image, according to an exemplary embodiment.

As shown in FIG. 15, the wearable spectacles 1000 can determine the line segment 1501 as a long axis, and the line segment 1501 connects the point at which the straight line passing through the two focal points of the first region 1301 corresponding to the user's eyes intersects the first region 1301. And determine the length of the line segment 1501 as the length of the long axis. When the first region 1301 approximates an elliptical shape, the two focal points of the first region 1301 may represent two focal points of the first region 1301 that approximate the elliptical shape.

The wearable spectacles 1000 can determine the line segment 1503 that bisects the line segment 1501 in the vertical direction as a short axis, and determines the length of the line segment 1503 as the length of the short axis.

The wearable spectacles 1000 can capture the position of the center 1405 of the second region 1401 corresponding to the user's iris as a value representing the position of the iris.

The wearable spectacles 1000 can capture the angle of the major axis and/or the angle of the minor axis by comparing the angle of the major axis of the eye image and/or the angle of the minor axis with the horizontal axis and/or the vertical axis. The horizontal axis and the vertical axis of the eye image may be a long axis and a short axis of an area corresponding to the eye taken from the eye image of the user photographed in the reference wear state.

The wearable spectacles 1000 can determine the angle 1505 formed by the long axis of the first region 1301 corresponding to the user's eyes and the horizontal axis 1509-3 of the eye image as the angle of the long axis. The wearable spectacles 1000 can determine the angle 1507 formed by the short axis of the first region 1301 corresponding to the user's eyes and the vertical axis 1509-1 of the eye image as the angle of the short axis.

Referring back to FIG. 12, in operation S340, the wearable spectacles 1000 may determine the inclination of the wearable spectacles 1000 with respect to the user based on the extracted characteristic values. For example, the wearable spectacles 1000 can determine the tilt of the wearable spectacles 1000 by comparing the captured characteristic values with reference values included in the reference wear status information. The reference value included in the reference wear status information may be a characteristic value of image detection of the body part taken when the state in which the user currently wears the wearable spectacles 1000 is the reference wear state. The reference value can be a predetermined value or a value set by a user.

16 and 17 are schematic diagrams for explaining a method of determining the inclination of the wearable spectacles 1000 from the eye image by the wearable spectacles 1000, in accordance with an exemplary embodiment.

Referring to Fig. 16, the wearable glasses 1000 can extract an angle 1601 as a characteristic value, and the angle 1601 is formed by a straight line connecting the centers 1405-1 and 1405-2 of the irises of the two eyes of the user and the horizontal axis 1509-3 of the eye image. . The wearable spectacles 1000 can determine the up-down inclination of the wearable spectacles 1000 by comparing the extracted characteristic values with reference values.

For example, when the reference value of the angle between the line connecting the centers 1405-1 and 1405-2 of the irises of the two eyes of the user and the horizontal axis 1509-3 is 0, the connection center 1405-1 and The angle 1601 between the straight line of 1405-2 and the horizontal axis 1509-3 is determined as the up-down inclination of the wearable eyewear 1000. The wearable spectacles 1000 can adjust at least one of a rotation angle, a size, and a shape of the display image based on the determined up-down inclination of the wearable spectacles 1000.

Referring to Fig. 17, the wearable glasses 1000 can extract the lengths of the long axes 1501-1 and 1501-2 of the two eyes of the user as characteristic values. The wearable spectacles 1000 can determine the left-right inclination of the wearable spectacles 1000 by comparing the extracted characteristic values with reference values. For example, the wearable spectacles 1000 may pre-store the length of the long axis as a reference value. The wearable spectacles 1000 can calculate the change of the distance between the wearable spectacles 1000 and the user based on the length of the long axis stored in advance and the length of the newly measured long axis, and can adjust the selected image based on the calculated distance. At least one of size and shape.

FIG. 18 is a flowchart of a method in which the wearable spectacles 1000 displays an image adjusted based on the inclination of the wearable spectacles 1000, according to an exemplary embodiment.

Referring to FIG. 18, in operation S410, the wearable spectacles 1000 can adjust the display image by rotating the display image based on the inclination of the wearable spectacles 1000. For example, the wearable spectacles 1000 can rotate the display image based on the reference wear state, according to the inclination of the wearable spectacles 1000 about an axis parallel to the direction of the eye that the user is looking straight forward (eg, the up-down slope).

The wearable spectacles 1000 can determine the inclination of the wearable spectacles 1000 relative to the reference wear state and rotate the display image by the determined inclination in a direction opposite to the direction in which the wearable spectacles 1000 are tilted.

In operation S450, the wearable spectacles 1000 displays an image adjusted based on the inclination of the wearable spectacles 1000. The wearable spectacles 1000 adjusts the image displayed on the display 1030 based on the inclination determined according to the reference wear state.

20, 21A, and 21B are schematic diagrams for explaining images displayed via the display 1030 based on the tilt of the wearable glasses 1000, in accordance with one or more exemplary embodiments. As shown in FIGS. 20, 21A, and 21B, the wearable eyewear 1000 can display an image on the display 1030 using a helium method. However, it should be understood that one or more other exemplary embodiments are not limited thereto. For example, according to one or more other exemplary embodiments, the wearable glasses 1000 may be displayed via the display 1030 according to the monocular display method illustrated in FIGS. 4A and 4B, the binocular display method illustrated in FIGS. 5A and 5B, or the like. image.

FIG. 20 illustrates a case where the user wears the wearable eyewear 1000 in the reference wear state. As shown in FIG. 20, the wearable eyewear 1000 can provide an image 2001 to the user via the display 1030.

FIG. 21A illustrates a case where the image displayed on the display 1030 is adjusted based on the inclination of the wearable eyewear 1000 when the wearable eyewear 1000 is inclined with respect to the reference wearing state.

When the wearable spectacles 1000 are inclined about an axis parallel to the direction of the eye in which the user looks straight forward compared to the reference wear state, the wearable spectacles 1000 may determine the angle θ of the rotation of the wearable spectacles 1000 as the upper side of the wearable spectacles 1000 - Lower slope. As shown in FIG. 21A, the wearable spectacles 1000 can display an image 2101 of the determined up-down inclination in a direction opposite to the direction in which the wearable spectacles 1000 are tilted.

FIG. 19 is a flowchart of a method in which the wearable spectacles 1000 displays an image adjusted based on the inclination of the wearable spectacles 1000, according to an exemplary embodiment.

Referring to FIG. 19, in operation S420, the wearable eyewear 1000 adjusts at least one of a size, a rotation angle, and a shape of the display image based on the inclination of the wearable eyewear 1000. For example, when the distance from the user to the wearable spectacles 1000 changes relative to the reference wear state, the wearable spectacles 1000 can adjust the size of the displayed image. Alternatively, the wearable spectacles 1000 may determine the inclination of the wearable spectacles 1000 to be inclined about a predetermined axis with respect to the reference wear state, and rotate the display image in a direction opposite to the direction in which the wearable spectacles 1000 are inclined. Alternatively, when at least one of the position and angle of the wearable spectacles 1000 changes relative to the reference wear state, the wearable spectacles 1000 can adjust the shape of the display image such that the user can be provided with an undistorted image.

In operation S450, the wearable spectacles 1000 displays an image adjusted based on the inclination of the wearable spectacles 1000.

FIG. 21B illustrates a situation in which the image displayed via the display 1030 is adjusted based on the positional change of the wearable eyewear 1000 when the wearable eyewear 1000 becomes farther away from the user than the reference wear state.

When the wearable spectacles 1000 becomes farther away from the user than the reference wear state, the user is provided with an image that is smaller than the image provided in the reference wear state. Accordingly, the wearable spectacles 1000 can display an image 2103 that has been enlarged based on the distance that the wearable spectacles 1000 has become further from the user.

FIG. 21B illustrates a situation in which the wearable eyewear 1000 projects an image to one of the user's eyes using 稜鏡. However, it should be understood that one or more other exemplary embodiments are not limited to the wearable eyewear 1000 illustrated in FIG. 21B. In the case where the wearable spectacles 1000 are configured as a two-eye display as shown in FIGS. 5A and 5B, when the wearable spectacles 1000 are tilted left and right with respect to the user and thus there is a left-right inclination, the self-wearing spectacles 1000 The distance from one side to the user's eyes is different from the distance from the other side of the wearable spectacles 1000 to the user's eyes.

When the wearable spectacles 1000 are tilted left and right with respect to the user, the wearable spectacles 1000 can determine the angle at which the wearable spectacles 1000 are tilted left and right relative to the user as the left-right inclination of the wearable spectacles 1000.

For example, as shown in FIG. 17, the wearable spectacles 1000 can determine the left-right inclination of the wearable spectacles 1000 based on the lengths of the long axes 1501-1 and 1501-2 of the two eyes of the user. When the wearable spectacles 1000 are tilted left and right relative to the user, the distance from one side of the wearable spectacles 1000 to the eyes of the user may vary. Therefore, as shown in FIG. 17, when the distance from one side of the wearable spectacles 1000 to the eyes of the user increases, the size of the eyes shown on the image of the eyes becomes smaller. When the distance from the other side of the wearable spectacles 1000 to the eyes of the user is reduced, the size of the eyes shown on the image of the eyes becomes larger.

The wearable spectacles 1000 can determine the left-right inclination of the wearable spectacles 1000 compared to the reference wear state, and can adjust the size of the displayed image by the determined left-right inclination. For example, the wearable spectacles 1000 can estimate the change in distance from the wearable spectacles 1000 to the eyes of the user based on the left-right tilt. The wearable glasses 1000 can adjust the size of the displayed image based on the estimated distance change.

The wearable spectacles 1000 can perform image adjustment based on the tilt of the wearable spectacles 1000 (eg, horizontal translation, vertical translation, keystone distortion, and/or various corrections in which the display image is corrected such that the user can provide undistorted images) Type of image processing).

A method in which the wearable eyewear 1000 adjusts an image displayed on the display 1030 according to one or more exemplary embodiments will now be described in detail with reference to FIGS. 22A, 22B, and 22C.

The wearable spectacles 1000 can determine the change in position of the wearable spectacles 1000 relative to the user as compared to the reference wear condition. For example, the wearable spectacles 1000 can determine the inclination of the wearable spectacles 1000 compared to the reference wear state.

The wearable spectacles 1000 can adjust the image displayed via the display 1030 based on the determined change in position. Wearable glasses 1000 can display the adjusted image by re-mapping the image displayed on display 1030 using a conversion formula.

As shown in FIG. 22A, the wearable glasses 1000 can display an image 2201 on the display 1030.

When the user wears the wearable eyewear 1000 for a long time, the position of the wearable eyewear 1000 on the user's head may change as the user moves or the external environment changes. The wearable glasses 1000 can capture wear status information that represents the state in which the wearer currently wears the wearable glasses 1000. The wearable spectacles 1000 can determine the degree of change in the position of the wearable spectacles 1000 from the captured wear status information based on the predetermined reference wear status. The wearable spectacles 1000 can be calculated or calculated based on the determined degree of positional change, according to a conversion formula for adjusting the image displayed via the display 1030.

The conversion formula calculated or used by the wearable glasses 1000 can be expressed as Equation 1:

[Equation 1]

Where src represents the original image that was not rotated, dst represents the rotated image, and (x, y) represents the coordinates of the image. In Equation 1, fx(x, y) represents a conversion formula for the x-axis value of the predetermined pixel, and fy(x, y) represents a conversion formula for the y-axis value of the predetermined pixel.

As shown in FIG. 22A, the wearable glasses 1000 remaps each pixel included in the image 2201 by applying a conversion formula to the image 2201, thereby generating and displaying the adjusted image 2203. The wearable spectacles 1000 can adjust at least one of a position, a rotation angle, a size, and a shape of an image being displayed by applying a conversion formula to the image.

FIG. 22B illustrates a method of adjusting the position of an image provided via wearable glasses 1000. As shown in FIG. 22B, the wearable eyewear 1000 can display an image 2211 on the display 1030.

When the user wears the wearable eyewear 1000 for a long time, the position of the wearable eyewear 1000 on the user's head may change as the user moves or the external environment changes. When the position of the wearable spectacles 1000 on the user's head changes, the image provided via the wearable spectacles 1000 may deviate from the perspective of the user. In particular, when the display 1030 of the wearable spectacles 1000 is configured in the form of a cymbal and the position of the wearable spectacles 1000 on the head of the user changes, the position of the focused focus of the light output by the projector of the display 1030 changes. And thus providing the user with a distorted image.

Accordingly, the wearable spectacles 1000 can determine a change in the position of the wearable spectacles 1000 relative to the user compared to the reference wear state, and adjust the image 2211 being displayed based on the determined position change. The wearable spectacles 1000 can be calculated or calculated according to a conversion formula for adjusting the image 2211 being displayed.

The conversion formula calculated or used to cause the wearable spectacles 1000 to move the image being displayed in the x-axis direction by k and in the y-axis direction can be expressed as Equation 2:

[Equation 2]

Where src represents the original image whose display position has not been changed, dst represents the resulting image after the display position has been changed, and (x, y) represents the coordinates of the image. The pixel 2215 indicates a predetermined pixel in the image 2211 being displayed. Fig. 22B illustrates a case where the image 2211 being displayed is moved k in the x-axis direction and moved by 1 in the y-axis direction. As shown in FIG. 22B, the pixels 2215 within the image 2211 being displayed can be moved k in the x-axis direction and moved 1 in the y-axis direction, and thus can be remapped to the pixels 2217 on the display 1030.

As shown in FIG. 22B, the wearable glasses 1000 remaps each pixel contained in the image 2211 by applying Equation 2 to the image 2211, thereby generating and displaying the adjusted image 2213. FIG. 22C illustrates a method of rotating an image provided via the wearable spectacles 1000 at a predetermined angle. As shown in FIG. 22C, the wearable eyewear 1000 can display an image 2221 on the display 1030.

When the user wears the wearable eyewear 1000 for a long time, the position of the wearable eyewear 1000 on the user's head may change as the user moves or the external environment changes. When the wearable spectacles 1000 are rotated about a predetermined axis on the user's head, a distorted image is provided to the user.

Therefore, the wearable spectacles 1000 can determine the inclination of the wearable spectacles 1000 with respect to the user compared to the reference wear state, and adjust the image being displayed based on the determined inclination. The wearable glasses 1000 can calculate a conversion formula for adjusting the image 2221 being displayed via the display 1030. For example, when the wearable spectacles 1000 are inclined about an axis parallel to the direction of the eye in which the user looks straight forward compared to the reference wear state, the wearable spectacles 1000 may determine the rotation angle θ of the wearable spectacles 1000 as the wearable spectacles 1000. The up-down slope. As shown in FIG. 22C, the wearable spectacles 1000 can display an image 2223 that has been rotated in the opposite direction to the direction in which the wearable spectacles 1000 are tilted.

The calculation formula used to cause the wearable spectacles 1000 to rotate the image being displayed in the opposite direction by the up-down inclination can be expressed as Equation 3 below.

The conversion matrix M for rotating the display image in a direction opposite to the direction in which the wearable glasses 1000 is tilted can be expressed as follows. In other words, M represents a transformation matrix for rotating the display image by -θ°:

[Equation 3]

In Equation 3, center represents the center point of the display image to be rotated, and scale represents a parameter for determining the size of the resulting image obtained by applying the conversion matrix to the display image.

The conversion formula calculated or used by applying a transformation matrix to the displayed image can be expressed as Equation 4:

[Equation 4]

Where src represents the original image that was not rotated, dst represents the resulting image that has been rotated, and (x, y) represents the coordinates of the image. As shown in FIG. 22C, the wearable spectacles 1000 can generate an image 2223 and display an image 2223 by rotating the image 2221 being displayed from the center point 2225 by -θ°.

The wearable glasses 1000 can apply an animation effect to update an image being displayed on the display 1030 with an image adjusted based on the inclination of the wearable glasses 1000, thereby displaying the adjusted image.

For example, as shown in FIG. 23, the wearable spectacles 1000 can apply an animation effect to the display image 2301 in which the display image 2301 is rotated in the direction of the arrow 2305 and displayed.

After the image adjustment based on the inclination of the wearable glasses 1000 is completed, the image 2401 representing the image adjustment completion can be output as shown in FIG.

According to an exemplary embodiment, when an image adjusted based on the inclination of the wearable spectacles 1000 deviates from an area in which the wearable spectacles 1000 can display an image, the adjusted image can be reduced and displayed.

FIG. 25 is a flowchart of a method in which wearable glasses 1000 reduces and displays an adjusted image, according to an exemplary embodiment.

The operations S200, S300, and S400 shown in FIG. 25 correspond to the operations S200, S300, and S400 shown in FIG. 6, respectively, and thus will not be described again herein.

As shown in FIG. 25, in operation S430, the wearable eyewear 1000 adjusts the image displayed on the display 1030 based on the determined inclination.

In operation S440, the wearable glasses 1000 determine whether the adjusted image deviates from the area in which the wearable glasses 1000 can display an image.

For example, in the wearable eyewear 1000 having the display type shown in FIGS. 4A, 4B, 5A, and 5B, the area in which the wearable glasses 1000 can display images can represent the pixels on the display 1030 that can be output and constitute an image. Corresponding beam and color area. As another example, in the wearable spectacles 1000 having the 稜鏡 type shown in FIGS. 3A and 3B, the area in which the wearable spectacles 1000 can display images can represent that the display 1030 can reflect the output of the projector of the wearable spectacles 1000. Light and thus the area of the image can be focused on the foveal fovea of the eye of the user wearing the wearable spectacles 1000.

For example, when the display image is rotated based on the inclination of the wearable spectacles 1000 and the angle of rotation is equal to or greater than a predetermined value, the wearable spectacles 1000 may determine that the adjusted image deviates from the area in which the wearable spectacles 1000 can display an image.

Alternatively, when the size of the displayed image is changed based on the inclination of the wearable spectacles 1000 and the size of the changed display image is equal to or greater than a predetermined value, the wearable spectacles 1000 may determine that the adjusted image is deviated from the wearable spectacles 1000 to be displayed. The area of the image.

When the adjusted image is displayed in the area where the wearable glasses 1000 can display an image, the wearable glasses 1000 can display the adjusted image in operation S470. On the other hand, when the adjusted image is deviated from the area in which the wearable eyewear 1000 can display an image, the wearable eyewear 1000 can reduce or reduce the adjusted image in operation S460.

FIG. 26 is a schematic diagram for explaining an image that is reduced and displayed based on the inclination of the wearable spectacles 1000, according to an exemplary embodiment.

FIG. 26 illustrates a case where the display image is adjusted based on the up-down inclination of the wearable eyewear 1000 with respect to the user when the wearable eyewear 1000 is inclined with respect to the reference wear state shown in FIG. When the adjusted image 2601 deviates from the area in which the wearable glasses 1000 indicated by the broken line shown in FIG. 26 can display an image, the wearable glasses 1000 can reduce (eg, reduce) the adjusted image 2601 and display the reduced image 2603.

When the position of the wearable spectacles 1000 relative to the user is greatly changed compared to the reference wear state, even when the wearable spectacles 1000 adjusts the display image based on the inclination of the wearable spectacles 1000, the user can be provided with a distorted image. Under such circumstances, according to an exemplary embodiment, the wearable spectacles 1000 may output an image that guides the user in correcting the position of the head mounted display 1000.

27 is a flow chart showing a method of requesting a user to adjust an image of the wearable eyewear 1000, in accordance with an exemplary embodiment.

The operations S200 and S300 shown in FIG. 27 correspond to the operations S200 and S300 shown in FIG. 6, respectively, and thus will not be described again.

As shown in FIG. 27, in operation S300, the wearable eyewear 1000 determines the inclination of the wearable eyewear 1000 with respect to the user.

In operation S350, the wearable spectacles 1000 determines whether the inclination of the wearable spectacles 1000 determined in operation S300 is equal to or greater than a predetermined value. The predetermined value may be a pre-stored value or a value set by a user.

When it is determined that the inclination of the wearable spectacles 1000 is less than a predetermined value, the wearable spectacles 1000 may adjust the image being displayed on the display 1030 based on the determined inclination in operation S430. On the other hand, when the determined inclination of the wearable spectacles 1000 is equal to or greater than a predetermined value, the wearable spectacles 1000 may display an image instructing the user to adjust the wearable spectacles 1000 in operation S480.

FIG. 28 illustrates an example of requesting a user to adjust an image of the wearable eyewear 1000, in accordance with an exemplary embodiment.

As shown in FIG. 28, when the inclination of the wearable spectacles 1000 is equal to or greater than a predetermined value, the wearable spectacles 1000 may display on the display 1030 a request for the user to adjust the image 2801 of the wearable spectacles 1000. Requesting the user to adjust the image 2801 of the wearable eyewear 1000 may include providing an image of information regarding the state in which the user properly wears the wearable eyewear 1000 (ie, reference to the wearable state).

For example, as shown in FIG. 28, the image 2801 requesting the user to adjust the wearable glasses 1000 may include a direction for guiding the wearable glasses 1000 to be adjusted so that the state in which the user currently wears the wearable glasses 1000 becomes a reference wear. Image 2803 of the state.

In response to requesting the user to adjust the image 2801 of the wearable eyewear 1000, the user can physically change the position of the wearable eyewear 1000. After the user is shown to request the user to adjust the image 2801 of the wearable eyewear 1000, the wearable eyewear 1000 may re-operate S200 to repeat the operation of adjusting the image based on the information about the wear state of the user.

The wearable spectacles 1000 can display a guide image that guides the user to adjust the wearable spectacles 1000. According to another exemplary embodiment, the wearable spectacles 1000 may simply display an image (eg, an icon, a flashing icon, etc.) for prompting the user to adjust the wearable spectacles 1000.

FIG. 29 illustrates an example of guiding a user to adjust an image of the wearable eyewear 1000, according to an exemplary embodiment.

As shown in FIG. 29, when the inclination of the wearable spectacles 1000 is equal to or greater than a predetermined value, the wearable spectacles 1000 may display on the display 1030 a request for the user to adjust the image 2901 of the wearable spectacles 1000. Requesting the user to adjust the image 2901 of the wearable eyewear 1000 can include guiding the user to adjust the guided image 2905 of the wearable eyewear 1000.

The guided image 2905 can be an image that provides information about the reference wear status. For example, as shown in FIG. 29, the guided image 2905 can guide the direction in which the wearable spectacles 1000 is to be adjusted so that the state in which the user currently wears the wearable spectacles 1000 becomes the reference wearable state.

For example, the guided image 2905 can be an image representing a situation in which the wearable spectacles 1000 are in a horizontal state (ie, the wearable spectacles 1000 is perpendicular to the direction of gravity of the earth), or is expected to be provided when the wearable spectacles 1000 are positioned at a reference position. User's image. The reference position indicates the position of the wearable eyewear 1000 on the user when the state in which the user currently wears the wearable spectacles 1000 is the reference wearable state, and thus can be stored in advance as a predetermined value or set by the user.

For example, the wearable spectacles 1000 can display an image intended to be provided to the user as the guide image 2905 when the wearable spectacles 1000 are in a horizontal state based on a sensing unit (eg, a sensor) built in the wearable spectacles 1000. .

Therefore, as shown in FIG. 29, the user can physically change the position of the wearable eyewear 1000 such that the display image 2903 corresponds to the guide image 2905.

For example, when the guide image 2905 is an image representing a situation in which the wearable glasses 1000 are in a horizontal state, the display image 2903 and the guide image 2905 are associated with each other, and the wearable glasses 1000 are positioned in a horizontal state. Therefore, the user can repeatedly change the position of the wearable spectacles 1000 until the display image 2903 and the guide image 2905 correspond to each other, thereby positioning the wearable spectacles 1000 in a horizontal state.

As another example, when the guided image 2905 is an image representing a situation in which the wearable spectacles 1000 are positioned at a reference position, causing the display image 2903 and the guided image 2905 to correspond to each other means that the wearable spectacles 1000 are positioned to be optimal for the user to receive. image. Therefore, the user can repeatedly change the position of the wearable spectacles 1000 until the display image 2903 and the guide image 2905 correspond to each other, thereby positioning the wearable spectacles 1000 at the reference position.

The wearable spectacles 1000 is not limited to the case where the user changes the position of the wearable spectacles 1000 so that the state in which the user currently wears the wearable spectacles 1000 becomes the reference wearable state. The wearable spectacles 1000 can include a drive that can change the state in which the user is currently wearing the wearable spectacles 1000. For example, when the wearable eyewear 1000 is in the form of a lens, the wearable eyewear 1000 can include a driver within the temple or nose piece, and thus correct the inclination of the wearable eyewear 1000 relative to the user.

The wearable spectacles 1000 can adjust the image displayed on the display 1030 by taking into account at least one of the inclination of the wearable spectacles 1000 and taking into account at least one of a change in position of the wearable spectacles 1000 and a change in brightness of the external environment. The wearable spectacles 1000 can adjust the brightness of the image displayed on the display 1030 based on a change in position of the wearable spectacles 1000 or a change in brightness of the external environment. For example, the wearable spectacles 1000 can use images of the user's eyes to determine changes in the brightness of the external environment.

FIG. 30 is a flowchart of a method of adjusting the displayed image by the wearable eyewear 1000, according to an exemplary embodiment.

Referring to FIG. 30, in operation S510, the wearable spectacles 1000 may determine at least one of a moving direction and a moving distance of the wearable spectacles 1000 using an image of a user's eyes.

For example, the wearable spectacles 1000 can determine the position value of the user's eyes from the user's eye image. The wearable spectacles 1000 may compare the determined position value with a reference value included in the reference wear status information, and determine at least one of a moving direction and a moving distance of the wearable spectacles 1000 based on the result of the comparison.

FIG. 31 is a schematic diagram for explaining a method of adjusting the position and size of a display image by the wearable eyewear 1000, according to an exemplary embodiment.

31 illustrates a first region 1301 corresponding to the user's eyes and a second region 1401 corresponding to the user's iris, wherein the first region 1301 and the second region 1401 are determined from the user's eye image. FIG. 31 illustrates a case in which the wearable spectacles 1000 determines the moving direction and the moving distance of the wearable spectacles 1000 based on the value of the position of the iris representing the user. For example, the wearable spectacles 1000 can determine the position of the center 1405 of the second region 1401 corresponding to the user's iris as a value representative of the position of the iris.

As shown in FIG. 31, the wearable eyewear 1000 can compare the position 1405 of the iris determined from the eye image of the user with the pre-stored reference position 3101 of the iris, and can determine the wearable glasses 1000 based on the result of the comparison. At least one of a moving direction and a moving distance. Arrow 3103 may represent movement of the wearable eyewear 1000, and arrow 3103 connects the position 1405 of the iris determined from the user's eye image to the pre-stored reference position 3101 of the iris. In this case, the direction indicated by the arrow 3103 may be the moving direction of the wearable spectacles 1000, and the length of the arrow 3103 may be the moving distance of the wearable spectacles 1000.

Referring back to FIG. 30, in operation S520, the wearable eyewear 1000 can measure the size change of the user's pupil using the user's eye image.

For example, the wearable spectacles 1000 can determine an area corresponding to the user's pupil from the user's eye image and determine a value representative of the width of the area corresponding to the user's pupil. The wearable spectacles 1000 can compare the value of the area corresponding to the user's pupil determined from the user's eye image with the reference value included in the reference wear status information. The wearable spectacles 1000 can measure a change in the size of the pupil of the user based on the result of the comparison.

FIG. 32 is a schematic diagram for explaining a method of adjusting the brightness of a display image by the wearable eyewear 1000, according to an exemplary embodiment.

32 illustrates a first region 1301 corresponding to the user's eyes, a second region 1401 corresponding to the user's iris, and a third region 1403 corresponding to the user's pupil and included in the second region 1401, wherein the first region The area 1301, the second area 1401, and the third area 1403 are determined from the user's eye image.

As shown in FIG. 32, the wearable spectacles 1000 can compare the area 1403 corresponding to the iris determined from the eye image of the user with the pre-storage area 3201 corresponding to the pupil, and can measure based on the result of the comparison. The size of the user's pupil changes. Referring to Figure 32, as indicated by arrow 3203, the size of the user's pupil increases.

Referring back to FIG. 30, in operation S530, the wearable spectacles 1000 may adjust at least one of a position and a size of the display image based on at least one of a moving direction and a moving distance of the wearable spectacles 1000 determined in operation S510. .

For example, the wearable spectacles 1000 can adjust the image displayed on the display 1030 such that the wearable spectacles 1000 moves the distance corresponding to the moving distance of the wearable spectacles 1000 in a direction opposite to the moving direction of the wearable spectacles 1000.

When the position of the wearable spectacles 1000 relative to the user changes, the distance from the user's eyes to the wearable spectacles 1000 can vary. Therefore, when the distance from the user's eyes to the wearable spectacles 1000 is changed compared to the reference wear state, the wearable spectacles 1000 can display a display image obtained by compensating for the change in distance. For example, when the distance from the user's eyes to the displayed image increases as the wearable spectacles 1000 moves, the wearable spectacles 1000 can display a display image whose size has changed by a factor corresponding to the increased distance.

In operation S540, the wearable spectacles 1000 may adjust the brightness of the displayed image based on the change in the size of the pupil of the user measured in operation S520.

For example, as the brightness around the wearable eyewear 1000 increases, the brightness of the image being displayed on the wearable eyewear 1000 will also increase to allow the user to recognize the image being displayed on the wearable eyewear 1000. As the brightness around the wearable eyewear 1000 decreases, the brightness of the image being displayed on the wearable eyewear 1000 will also decrease to prevent the user from being dazzled or to protect the user from discomfort.

Information about the brightness of the external environment of the wearable eyewear 1000 can be directly retrieved using the brightness sensor included in the wearable eyewear 1000. Alternatively (or in addition), information regarding the brightness of the external environment of the wearable eyewear 1000 can be directly retrieved based on the size change of the pupil of the wearable wearable spectacles 1000.

The wearable spectacles 1000 can display a display image whose brightness has been adjusted based on a change in the size of the user's pupil. For example, when the size of the user's pupil increases, the wearable spectacles 1000 can determine a decrease in brightness around the wearable spectacles 1000, and thus reduce the brightness of the displayed image. When the size of the user's pupil is reduced, the wearable spectacles 1000 can determine an increase in brightness around the wearable spectacles 1000, and thus increase the brightness of the displayed image.

As another example, the wearable spectacles 1000 can provide the user with a display that is sufficiently bright enough for the user to recognize the image being displayed on the wearable spectacles 1000, but still low enough that the user does not feel dazzled or uncomfortable. image.

Therefore, when the size of the user's pupil is increased, the wearable glasses 1000 can determine that the brightness of the displayed image is too low, and thus increase the brightness of the displayed image. When the size of the user's pupil is reduced, the wearable spectacles 1000 can determine that the brightness of the displayed image is too high, and thus reduce the brightness of the displayed image.

Although FIG. 30 illustrates the situation in which the wearable eyewear 1000 adjusts the displayed image by taking into account both the movement of the wearable eyewear 1000 and the pupil size of the user, it should be understood that one or more other exemplary embodiments are not limited thereto. . That is, the wearable spectacles 1000 can be constructed or configured to adjust at least one of the position, size, and brightness of the displayed image based on at least one of movement of the wearable spectacles 1000 and the size of the user's pupil.

According to an exemplary embodiment, the method of displaying an image in the wearable eyewear 1000 described above with reference to FIG. 6 may further include an operation of setting a reference wear state before wearing the wearable eyewear 1000 for a long time. The user can set the state determined to be the most suitable for the user to receive the image from the wearable glasses 1000 as the reference wear state.

According to an exemplary embodiment, the reference value may be set based on information about the body part of the user that has been drawn by the wearable spectacles 1000 located at the reference position. The wearable glasses 1000 can store the reference value as reference wear status information.

For example, when the information about the body part of the user includes an image of the user's eyes, the characteristic value of the user's eyes measured by the user's eye image taken by the wearable glasses 1000 located at the reference position. Can be set as a reference value.

FIG. 33 is a schematic diagram for explaining a method of setting the reference wearable state of the wearable spectacles 1000, according to an exemplary embodiment.

As shown in FIG. 33, when the user touches at least a portion of the wearable eyewear 1000, the wearable eyewear 1000 can determine that the user physically moves the wearable eyewear 1000 such that the wearable eyewear 1000 is at the reference location.

Therefore, the wearable spectacles 1000 can determine the wearing state information of the user who has been retrieved by the wearable spectacles 1000 at the end of the user's touch or at the time corresponding to the user's touch as the reference wear status information. The wearable glasses 1000 can update the pre-stored reference wear status information with the newly acquired wear status information. For example, the wearable glasses 1000 can photograph the body part of the user at the end of the user's touch and store the captured image as reference wear status information.

When the user inadvertently touches the wearable spectacles 1000, the wearable spectacles 1000 can prevent the reference wear status information from being updated. For example, when a user touch occurs on the wearable spectacles 1000, the wearable spectacles 1000 can output a graphical user interface (GUI) 3301 to ask the user whether to set the reference wear status information based on the current position of the wearable spectacles 1000. In this case, the wearable spectacles 1000 can update the reference wear status information only when the wearable spectacles 1000 receives a user input based on the current position of the wearable spectacles 1000 to set the reference wear status information.

According to an exemplary embodiment, when the image being displayed on the display 1030 is adjusted based on the inclination of the wearable spectacles 1000, the wearable spectacles 1000 may further consider images reflected on the user's eyeball.

A portion of the light output through the display 1030 of the wearable eyewear 1000 can be absorbed by the user's eyeball, and the user can recognize the displayed image from the absorbed light. Another portion of the light output via the display 1030 of the wearable eyewear 1000 can be reflected by the user's eyeball.

As shown in FIG. 34, according to an exemplary embodiment, the wearable spectacles 1000 adjusts a display image based on an image reflected by the user's eyeball. According to an exemplary embodiment, wearable glasses 1000 may include a camera 1060 for photographing a user's eyes. The user's eye image captured by camera 1060 can include an image 3403 that is reflected on the user's eye 3401.

According to an exemplary embodiment, the wearable spectacles 1000 may display a test image and adjust the display image based on the reflected image captured by reflecting a portion of the light constituting the test image from the eyeball of the user.

FIG. 35 is a flowchart of a method of correcting a displayed image based on a test image reflected from a user's eye, according to an exemplary embodiment.

Referring to FIG. 35, in operation S1100, the wearable spectacles 1000 displays a test image. The test image represents an image for determining the inclination of the wearable eyewear 1000. For example, the test image may be an image that is used to determine the tilt or an image that is displayed on the display 1030.

36A, 36B, and 36C illustrate an example of a test image in accordance with one or more exemplary embodiments.

As shown in FIG. 36A, the wearable eyewear 1000 can display a test image containing a plurality of spots.

As shown in FIG. 36B, the wearable glasses 1000 can display a test image composed of a plurality of line segments.

As shown in FIG. 36C, the wearable spectacles 1000 can display a test image of a polygon containing a predetermined color.

Referring back to FIG. 35, in operation S1200, the wearable eyewear 1000 captures an image taken by photographing the eyes of the user who reflects the test image. The wearable spectacles 1000 can capture the eye image of the user who reflects the test image as information about the state in which the user currently wears the wearable spectacles 1000.

For example, the wearable glasses 1000 can output the test image in a short time so that the user cannot recognize the test image, and capture the reflected image taken by photographing the eyes of the user who reflects the test image, and then based on The reflected image of the image is tested to control the operation of the wearable eyewear 1000.

37A, 37B, and 37C illustrate an example of an image taken by photographing a user's eyes that reflect a test image by using wearable glasses 1000, in accordance with one or more exemplary embodiments.

For example, when the wearable spectacles 1000 outputs the test image shown in FIG. 36A, the wearable spectacles 1000 can photograph the eyes of the user who reflects the test image shown in FIG. 36A, as shown in FIG. 37A.

As another example, when the wearable spectacles 1000 outputs the test image shown in FIG. 36B, the wearable spectacles 1000 can photograph the eyes of the user who reflects the test image shown in FIG. 36B, as shown in FIG. 37B.

As still another example, when the wearable spectacles 1000 outputs the test image shown in FIG. 36C, the wearable spectacles 1000 can photograph the eyes of the user who reflects the test image shown in FIG. 36C, as shown in FIG. 37C.

The description of operation S200 shown in FIG. 6 can be applied to operation S1200 shown in FIG. The operation S1200 shown in FIG. 35 will not be described again below.

In operation S1300, the wearable spectacles 1000 can determine the inclination of the wearable spectacles 1000 with respect to the user using the eye image of the user who reflects the test image.

The inclination of the wearable spectacles 1000 with respect to the user indicates the degree to which the wearable spectacles 1000 worn by the user are inclined with respect to the reference wear state. The wearable spectacles 1000 can determine the inclination of the wearable spectacles 1000 relative to the user by comparing the eye image of the user captured in operation S1200 with the reference wear status information. The wearable spectacles 1000 can store reference wear status information including images of the eyes of the user captured in the reference wear state. The wearable glasses 1000 can store the reflected image of the test image contained in the eye image of the user captured in the reference wear state as the reference wear status information.

The wearable glasses 1000 can extract a reflected image of the test image from the user's eye image. The wearable spectacles 1000 can determine the tilt of the wearable spectacles 1000 based on at least one of the size and shape of the reflected image.

For example, the wearable spectacles 1000 can determine the inclination of the wearable spectacles 1000 relative to the user by comparing the reflected image extracted from the user's eye image with the reference image.

For convenience of explanation, FIGS. 38, 39A, 39B, 39C, 42, 43A, 43B, 43C, 44A, and 44B illustrate a case in which a test image of a rectangle shown in FIG. 36B is displayed. . However, it should be understood that one or more other exemplary embodiments are not limited thereto, and various other test images may be used.

FIG. 38 illustrates an eye image 3801 of a user photographed by the wearable eyewear 1000 when the wearable eyewear 1000 is not tilted relative to the user, in accordance with an exemplary embodiment.

As shown in FIG. 38, the eye image 3801 taken by the wearable eyewear 1000 can include a reflected image 3803 of the test image.

For example, the wearable spectacles 1000 can determine the position of the wearable spectacles 1000 as a reference position when the eye image 3801 shown in FIG. 38 is taken. The wearable spectacles 1000 can set the eye image 3801 taken when the wearable spectacles 1000 is at the reference position as a reference image, and can store the eye image 3801. Alternatively, the wearable spectacles 1000 can set the reflected image 3803 captured when the wearable spectacles 1000 is in the reference position as a reference image, and can store the reference image 3803.

A case where the reflection image 3803 shown in Fig. 38 is set as the reference image will now be described. 39A, 39B, and 39C illustrate an example of an eye image of a user captured through the wearable eyewear 1000 when the wearable eyewear 1000 is tilted relative to the user, in accordance with one or more exemplary embodiments.

FIG. 39A illustrates a situation in which the wearable spectacles 1000 are tilted up and down with respect to the user and thus the upper-lower inclination is measured. The reflected image 3903 shown in FIG. 39A has the same shape as the reflected image 3803 shown in FIG. 38, but the eye image 3901-1 shown in FIG. 39A is inclined compared to the eye image 3801 shown in FIG. Thus, it can be seen that the position of the wearable spectacles 1000 relative to the user has changed.

FIG. 39B illustrates a situation in which the wearable eyewear 1000 is tilted back and forth with respect to the user and thus the front-rear tilt is measured. The position and shape of the eye image 3901-2 shown in FIG. 39B is the same as the eye image 3801 shown in FIG. 38, but the shape of the reflected image 3905 shown in FIG. 39B is different from the reflected image 3803 shown in FIG. Thus, it can be seen that the position of the wearable spectacles 1000 relative to the user has changed.

FIG. 39C illustrates a situation in which the wearable spectacles 1000 are tilted left and right with respect to the user and thus the left-right inclination is measured. The position and shape of the eye image 3801 shown in FIG. 38 is the same as the eye image 3901-3 shown in FIG. 39C, but the shape of the reflected image 3907 shown in FIG. 39C is different from the reflected image 3803 shown in FIG. Thus, it can be seen that the position of the wearable spectacles 1000 relative to the user has changed.

A method of determining the inclination of the wearable eyewear 1000 relative to the user using the user's eye image will be described in detail below with reference to FIGS. 40 to 42 and FIGS. 43A to 43C.

Referring back to FIG. 35, in operation S1400, the wearable glasses 1000 adjusts the image displayed on the display 1030 based on the determined inclination.

The wearable spectacles 1000 may adjust at least one selected from a rotation angle, a size, and a shape of the display image based on the inclination of the wearable spectacles 1000 determined in operation S1300. However, it should be understood that one or more other exemplary embodiments are not limited thereto, and that the wearable eyewear 1000 can adjust various parameters of the displayed image shown to the user.

For example, the wearable spectacles 1000 can further adjust at least one of the brightness of the displayed image, the position on the display 1030 on which the image is displayed, and the color of the displayed image. As another example, when the display 1030 of the wearable spectacles 1000 is configured as a translucent optical waveguide (eg, 稜鏡), the wearable spectacles 1000 can adjust the projector output from the display 1030 based on the tilt of the wearable spectacles 1000. The position of the focus of the light being focused.

Therefore, even when the wearable spectacles 1000 is tilted relative to the user, the user wearing the wearable spectacles 1000 can be provided with an undistorted image without having to correct the inclination of the wearable spectacles 1000.

The description of operation S400 shown in FIG. 6 can be applied to operation S1400 shown in FIG. The operation S1400 shown in FIG. 35 will not be described again below.

The wearable glasses 1000 can display the test image, capture the image of the user's eyes as the wear status information, extract the image from the user's eye image or obtain the reflected image of the test image, and analyze the reflected image, thereby determining the relative orientation of the wearable glasses 1000. The inclination of the user.

In this case, the wearable spectacles 1000 can directly photograph the user's eyes using the camera included in the wearable spectacles 1000 or by receiving an image of the user's eyes taken by the external component from the external component. Take the user's eye image.

FIG. 40 is a flowchart of a method of determining the inclination of the wearable eyewear 1000 from the eye image of the user, according to an exemplary embodiment.

Referring to FIG. 40, in operation S1310, the wearable eyewear 1000 can extract a reflected image of the test image from the eye image.

For example, the wearable spectacles 1000 can determine a first region 1301 corresponding to the user's eyes from the eye image (refer to FIG. 42), and determine a second region corresponding to the user's iris and included in the first region 1301. 1401 (refer to Figure 42). The wearable spectacles 1000 can extract a reflected image 4205 of the test image based on at least one of brightness and color in the second region 1301 (refer to FIG. 42).

In operation S1320, the wearable spectacles 1000 may determine the inclination of the wearable spectacles 1000 based on at least one of the size and shape of the reflected image.

The wearable spectacles 1000 can determine the inclination of the wearable spectacles 1000 relative to the user by comparing at least one of the size and shape of the extracted reflected image with at least one of the size and shape of the reference image.

FIG. 41 is a flowchart of a method in which the wearable spectacles 1000 displays an image that has been adjusted based on the inclination of the wearable spectacles 1000, according to an exemplary embodiment.

FIG. 12 illustrates a method in which the characteristic value of the eye is extracted by analyzing the eye image of the user and the inclination of the wearable eyewear 1000 is determined based on the characteristic value of the eye. The method of Figure 12 can be used to determine the top-bottom slope of the wearable eyewear 1000. In addition, by performing the method shown in FIG. 41, the wearable glasses 1000 can further consider the reflected image of the test image, thereby determining not only the upper-lower inclination of the wearable glasses 1000 but also the wearable degree with high accuracy with high accuracy. The left-right inclination and the front-rear inclination of the glasses 1000.

In operation S1305, the wearable spectacles 1000 may determine the up-down inclination of the wearable spectacles 1000.

42 is a schematic diagram for explaining characteristic values of a user's eyes measured from a photographed eye image of a user, according to an exemplary embodiment.

As shown in FIG. 42, the wearable spectacles 1000 can determine the line segment 1501 as a long axis, and the line segment 1501 connects the point at which the straight line passing through the two focal points of the first region 1301 corresponding to the user's eyes intersects the first region 1301. And determine the length of the line segment 1501 as the length of the long axis.

The wearable spectacles 1000 can determine the line segment 1503 that bisects the line segment 1501 in the vertical direction as a short axis, and determines the length of the line segment 1503 as the length of the short axis.

The wearable spectacles 1000 can extract the reflected image 4205 of the test image from the second region 1401 corresponding to the user's iris.

The wearable spectacles 1000 can capture the angle of the major axis and/or the angle of the minor axis by comparing the angle of the major axis of the eye image and/or the angle of the minor axis with the horizontal axis and/or the vertical axis. When the reflected image is a polygon, the wearable spectacles 1000 can determine the angle between at least one side of the reflected image 4205 and the horizontal axis 1509-3 or the vertical axis 1509-1 of the wearable spectacles 1000 as the inclination of the wearable spectacles 1000.

The wearable spectacles 1000 can determine the up-down inclination of the wearable spectacles 1000 according to the method shown in FIG. Therefore, the determination of the up-down slope will not be repeated below.

Referring back to FIG. 41, in operation S1310, the wearable glasses 1000 can extract a reflected image of the test image from the eye image.

In operation S1330, the wearable spectacles 1000 may determine the left-right inclination and the front-rear inclination of the wearable spectacles 1000 based on at least one of the size and shape of the reflected image extracted in operation S1310.

43A, 43B, and 43C are diagrams for determining the inclination of the wearable spectacles 1000 based on the reflected image of the test image contained in the user's eye image, according to one or more exemplary embodiments. Schematic diagram of the method.

Referring to FIG. 43A, the wearable spectacles 1000 can determine an angle 4301 between at least one side of the reflected image 4205 and the long axis 1501 of the eye as the up-down slope of the wearable spectacles 1000.

Referring to FIG. 43B, the wearable spectacles 1000 may determine the anterior-posterior tilt of the wearable spectacles 1000 based on a ratio between the lengths of the two sides (ie, the upper side 4303 and the lower side 4305) included in the reflected image 4205. For example, when the test image has a rectangular shape and the reflected image 4205 has a trapezoidal shape, the front-rear tilt of the wearable spectacles 1000 relative to the user can be determined as the ratio between the length of the upper side 4303 and the lower side 4305. Increase and increase.

Referring to FIG. 43C, the wearable spectacles 1000 may determine the left-right inclination of the wearable spectacles 1000 based on a ratio between the lengths of the two sides (ie, the upper side 4307 and the lower side 4309) included in the reflected image 4205. For example, when the test image has a rectangular shape and the reflected image 4205 has a trapezoidal shape rotated by 90°, the left-right inclination of the wearable spectacles 1000 relative to the user may be determined as the upper side 4307 and the lower side 4309 The ratio between the lengths increases and increases.

Referring back to FIG. 41, in operation S1340, the wearable spectacles 1000 may adjust the rotation of the display image based on at least one of the front-rear inclination, the left-right inclination, and the front-rear inclination of the wearable spectacles 1000. At least one of an angle, a size, and a shape. However, it should be understood that one or more other exemplary embodiments are not limited thereto, and that the wearable eyewear 1000 can adjust various parameters of the displayed image shown to the user. For example, the wearable spectacles 1000 can further adjust at least one of the brightness of the displayed image, the position on the display 1030 on which the image is displayed, and the color of the displayed image. As another example, when the display 1030 of the wearable spectacles 1000 is configured as a translucent optical waveguide (eg, 稜鏡), the wearable spectacles 1000 can adjust the projector output from the display 1030 based on the tilt of the wearable spectacles 1000. The position of the focus of the light being focused.

The wearable spectacles 1000 can perform image adjustment (eg, horizontal translation, vertical translation, keystone distortion, based on at least one of front-rear tilt, left-right tilt, and front-rear tilt of the wearable spectacles 1000) And/or wherein the display image is corrected so that the user can provide various types of image processing without distortion images.)

The wearable spectacles 1000 can analyze the reflected image of the test image and use the analyzed reflected image to control the operation of the wearable spectacles 1000.

44A and 44B are flow diagrams illustrating a method in which wearable eyewear 1000 operates based on an eye image, in accordance with one or more exemplary embodiments.

As shown in FIG. 44A, the wearable eyewear 1000 can determine a first area 1301 corresponding to the user's eyes and a second area 1401 corresponding to the user's iris from the eye image. The wearable glasses 1000 can extract a reflected image 4401 of the test image from the eye image.

As shown in FIG. 44B, when the reflected image 4401 is deviated from the second area 1401, the wearable glasses 1000 can perform a predetermined operation.

For example, when the user views the moving picture via the wearable glasses 1000, the user can observe a place other than the display 1030 of the wearable glasses 1000. When the user observes a location other than the display 1030 of the wearable eyewear 1000, the test image can be reflected at a location other than the user's iris. When the reflected image of the test image deviates from the area corresponding to the user's iris, the wearable glasses 1000 can stop playback of the moving picture.

The test image may be an image that is predetermined for controlling the operation of the wearable eyewear 1000 as shown in FIGS. 36A, 36B, and 36C, or a still image obtained at a certain point in time in a moving picture.

For example, when the moving picture is being played back, the wearable glasses 1000 can output the test image in a short time so that the user cannot recognize the test image and capture the image of the user's eyes reflecting the test image. The operation of the wearable eyewear 1000 is controlled based on the reflected image of the test image.

According to an exemplary embodiment, the wearable spectacles 1000 may adjust the display image based on the posture of the user. The term "posture" may mean at least one of a shape of a body part of a user at a certain point in time, a shape change of a body part of the user over a certain period of time, a change in position of the body part, and an action of a body part. .

FIG. 45 is a schematic diagram for explaining a method of adjusting the display image of the wearable spectacles 1000 based on the posture of the user, according to an exemplary embodiment.

As shown in FIG. 45, according to an exemplary embodiment, the wearable glasses 1000 may adjust a display image based on a posture of the user within the interest space 4501.

For example, the wearable spectacles 1000 can adjust the display image based on the posture of the user's hand 7.

To detect the user's posture, the wearable spectacles 1000 can include a sensing unit (eg, a sensor) that includes a camera or various sensors capable of capturing images. Examples of sensors that may be included in wearable eyewear 1000 may include depth sensors, infrared sensors, ultrasonic sensors, and similar sensors. For example, the wearable spectacles 1000 can detect the user's posture based on an image of the body part of the user or a signal received from a body part of the user (eg, an infrared signal or a supersonic signal). As another example, the wearable spectacles 1000 can be detected by receiving a signal associated with the user's gesture from the wearable component 20 worn on the user's wrist or by detecting movement of the wearable component 20. The posture of the person.

FIG. 46 is a flowchart of a method of adjusting a display image based on a posture of a user, according to an exemplary embodiment of the wearable eyewear 1000.

Referring to FIG. 46, in operation S2100, the wearable glasses 1000 can retrieve information about the posture of the user.

The wearable spectacles 1000 can use the sensing unit included in the wearable spectacles 1000 to extract information about the posture of the user or to extract information about the posture of the user from the external component. For example, the wearable spectacles 1000 can use at least one of the following included in the wearable spectacles 1000 to capture information about the posture of the user: a magnetic sensor, an acceleration sensor, a gyro sensor , proximity sensors, optical sensors, depth sensors, infrared sensors, ultrasonic sensors, etc. Alternatively, the wearable spectacles 1000 can capture information about a user's touch gesture received via the user input unit 1040 included in the wearable spectacles 1000.

When the wearable glasses 1000 are initialized or the power of the wearable spectacles 1000 is turned on, the wearable spectacles 1000 can retrieve information about the posture of the user for compensating for the inclination of the wearable spectacles 1000. Alternatively, when the wearable spectacles 1000 receives an input from a user who wants to receive an image whose tilt has been compensated, the wearable spectacles 1000 can retrieve information about the user's posture.

Alternatively, when the wearable eyewear 1000 is moved substantially, the wearable eyewear 1000 can determine that the position of the wearable eyewear 1000 relative to the user is highly likely to change. Accordingly, when at least one of the movement state values (eg, acceleration value, speed value, and angular momentum value) of the wearable spectacles 1000 is measured and equal to or greater than a critical (eg, predetermined) value, the wearable spectacles 1000 Information about the user's posture can be retrieved.

For example, the information about the posture of the user captured by the wearable spectacles 1000 may be the degree of change in the position of the body part in the posture, the degree of change in the shape of the body part, and the duration of the movement of the user. At least one of them.

Information about the user's gesture may be used to determine information for adjusting the adjustment value of the displayed image. For example, the information about the gesture retrieved by the wearable spectacles 1000 can include information about at least one of the user's head, hands, eyes, and mouth. The information about the posture captured by the wearable eyewear 1000 may also include an image of the body part in which the posture is placed. Alternatively, the information about the user's gesture may include information about the user's touch input received via the user input unit 1040.

For example, the wearable spectacles 1000 can retrieve information about a gesture based on an image of the user's hand. The wearable eyewear 1000 captures an image of the hand and detects changes in at least one of the palm, the knuckles, and the fingertips of the hand from the captured hand image.

As another example, wearable glasses 1000 can detect a gesture based on a predetermined signal received from a hand. The wearable spectacles 1000 can transmit a predetermined signal to the hand and retrieve information about the gesture based on the signal reflected by the hand in response to the transmitted signal. For example, the predetermined signal can be an infrared signal or an ultrasonic signal. The wearable spectacles 1000 can detect a change in at least one of a palm, a knuckle, and a fingertip of the hand based on a predetermined signal received from the target object.

As still another example, information regarding the user's gestures may include information regarding user input received via the user input unit 1040. For example, the user input can include an input to touch the touchpad, an input to rotate the wheel, or an input to press the button. The wearable spectacles 1000 can capture information about the touch input of the user received via the user input unit 1040 included in the wearable spectacles 1000 as information about the posture of the user. For example, the wearable eyewear 1000 can include a touch pad as the user input unit 120.

A method of extracting information about a user's posture will be explained in more detail later with reference to FIGS. 47 to 49.

In operation S2200, the wearable glasses 1000 may determine an adjustment value based on the captured information.

Use the adjustment value to adjust the display image. The adjustment value may be a value for adjusting at least one of a rotation angle, a size, and a shape of the display image. Alternatively, the adjustment value may be a value for adjusting the brightness of the displayed image, the position on the display 1030 on which the image is displayed, or the color of the displayed image. Alternatively, when the display 1030 of the wearable spectacles 1000 is configured as a translucent optical waveguide (eg, 稜鏡), the adjustment value may be the focus of the light output by the projector of the display 1030 of the wearable spectacles 1000. s position.

The wearable glasses 1000 can map information about a plurality of gestures with an adjustment value and store the result of the mapping, or store a relationship that can calculate an adjustment value based on information about the gesture. The wearable glasses 1000 can determine the adjustment value by searching for a pre-stored adjustment value based on the captured information or by using the found relationship to calculate an adjustment value.

In operation S2300, the wearable glasses 1000 can adjust the image displayed on the display 1030 based on the determined adjustment value.

First, the wearable spectacles 1000 can adjust at least one of a rotation angle, a size, and a shape of an image being displayed on the display 1030 based on the determined adjustment value. Alternatively, the wearable spectacles 1000 can adjust at least the brightness of the image being displayed on the display 1030, the position on the display 1030 displaying the image, and the color of the image being displayed on the display 1030 based on the determined adjustment value. One.

Alternatively, when the display 1030 of the wearable spectacles 1000 is configured as a translucent optical waveguide (eg, 稜鏡), the wearable spectacles 1000 can adjust the projector output from the display 1030 based on the tilt of the wearable spectacles 1000. The position of the focus of the light being focused.

Wearable glasses 1000 can perform image adjustments based on adjustment values (eg, horizontal translation, vertical translation, keystone distortion, and/or various types of image processing in which the display image is corrected such that the user can provide undistorted images. )

For example, when the display 1030 of the wearable spectacles 1000 is configured as a translucent optical waveguide (eg, 稜鏡), the wearable spectacles 1000 can adjust the output of the projector from the display 1030 based on the inclination of the wearable spectacles 1000. The position of the focus of the light being focused.

The wearable eyewear 1000 can then display the adjusted image. The description of operation S400 shown in FIG. 6 can be applied to operation S2300 shown in FIG. 46, and thus operation S2300 shown in FIG. 46 will not be described again.

When the user's gesture is used to adjust the image displayed via the wearable glasses 1000, the operation of extracting information about the user's posture may be continuously performed at regular time intervals. For example, to capture information about the user's posture, the wearable spectacles 1000 can photograph the body part of the posture and analyze the captured image at predetermined time intervals.

However, continuously extracting information about the user's posture can cause memory capacity overload and computational load overloading by the processor. Thus, according to an exemplary embodiment, the wearable eyewear 1000 can be configured to capture information about the user's posture only when a predetermined event occurs.

FIG. 47 is a flowchart of a method of the wearable glasses 1000 extracting information about a user's posture, according to an exemplary embodiment.

Information about the user's gesture may be used to determine information for adjusting the adjustment value of the displayed image. For example, the information about the gesture may include an image of the body part in which the gesture is placed.

In operation S2110, the wearable glasses 1000 can determine whether to initialize the wearable glasses 1000. For example, when the power of the wearable glasses 1000 is turned on or the initialization input for initializing the wearable glasses 1000 is received from the user, the wearable glasses 1000 can be initialized.

When the wearable spectacles 1000 are initialized, the wearable spectacles 1000 can retrieve information about the posture of the user in operation S2150. When the wearable spectacles 1000 are not initialized (for example, when the wearable spectacles 1000 continues to work), the wearable spectacles 1000 can extract a posture about the user based on the movement state value of the wearable spectacles 1000 by performing operation S2120. Information.

In operation S2120, the wearable spectacles 1000 may measure the movement state value of the wearable spectacles 1000. The movement state value represents a value representing the movement of the wearable spectacles 1000.

For example, the wearable spectacles 1000 can measure at least one of an acceleration value, a speed value, and an angular momentum value of the wearable spectacles 1000 as a movement state value. In operation S2130, the wearable glasses 1000 may determine whether the measured movement state value is equal to or greater than a predetermined value. When the measured movement state value is equal to or greater than the predetermined value, the wearable spectacles 1000 may retrieve information about the posture of the user in operation S2150. When the measured moving state value of the wearable spectacles 1000 is less than a predetermined value, the wearable spectacles 1000 can extract information about the posture of the user based on the user input by performing operation S2140.

However, it should be understood that one or more other exemplary embodiments are not limited to operation S2130 shown in FIG. The wearable glasses 1000 can determine not only whether the movement state value is equal to or greater than a predetermined value but also whether the movement state value is less than or equal to a predetermined value or whether the movement state value is less than a predetermined value. In other words, the wearable spectacles 1000 can compare the movement state value with a predetermined value, and based on the result of the comparison, determine whether to capture information about the posture of the user.

In operation S2140, the wearable glasses 1000 determine whether an input for adjusting the display image has been received from the user. When the distorted image is provided due to the change in the position of the wearable spectacles 1000, the user can input a command for adjusting the display image based on the posture of the user to the wearable spectacles 1000.

In operation S2140, the wearable glasses 1000 determine whether a user input for adjusting the display image has been received. When the user input for adjusting the display image has been received, the wearable glasses 1000 can retrieve information about the posture of the user in operation S2150. When the user input for adjusting the display image is not received, the wearable glasses 1000 may repeatedly operate S2110 through S2140.

In operation S2150, the wearable glasses 1000 can retrieve information about the posture of the user. For example, when the information about the posture of the user is an image of a gesture, the wearable glasses 1000 may output a guide image for inducing a posture of the user.

The wearable spectacles 1000 guides the user to pose a posture for adjusting the display image by outputting the guide image, thereby determining an adjustment value for adjusting the display image based on the posture of the user.

48 and 49 illustrate an example of a screen displaying wearable glasses 1000 that directs images for inducing a user's posture, in accordance with one or more exemplary embodiments.

As shown in FIGS. 48 and 49, the guided image 4800 displayed via the wearable glasses 1000 may include a virtual input interface 4801 for inducing a user's posture.

The virtual input interface 4801 can be of the button type or of the type representing a physical switch (eg, a toggle switch, a rotary switch, or a tumble switch), and can be variously retouched for the type of virtual input interface 4801.

The user can pose (eg, make) various gestures according to the type of virtual input interface 4801 provided via display 1030 of wearable glasses 1000.

For example, when the user is provided with the guide image 4800 shown in FIG. 48, the user can assume the posture of rotating the virtual input interface 4801 by the user's hand. When the user is provided with the guide image 4800 shown in FIG. 49, the user can assume the posture of pressing at least one arrow-shaped button included in the virtual input interface 4801 by the user's hand.

In operation S1150, the wearable eyewear 1000 photographs the posture of the user. 52-54 illustrate examples of images of a user's gesture captured via wearable glasses 1000 in accordance with one or more exemplary embodiments.

The wearable spectacles 1000 can determine an adjustment value for adjusting the display image based on information about the posture of the user. For example, the wearable spectacles 1000 can capture an image of the user's gesture and analyze the image of the gesture to thereby determine an adjustment value.

The case where the adjustment value is determined by analyzing the image of the user's gesture will now be described. However, it should be understood that one or more other exemplary embodiments are not limited thereto, and the wearable spectacles 1000 may adjust the display image using the posture of the body part of the user other than the user's hand.

FIG. 50 is a flowchart of a method in which the wearable spectacles 1000 determines an adjustment value from a gesture image of a user, according to an exemplary embodiment.

Referring to FIG. 50, in operation S2210, the wearable spectacles 1000 may determine an area corresponding to the user's hand from the gesture image.

FIG. 51 is a schematic diagram for explaining a method in which the wearable glasses 1000 detects a gesture of a user, according to an exemplary embodiment.

As shown in FIG. 51, the wearable glasses 1000 can capture an image 5100 of the user's hand and detect a gesture from the captured image 5100. The user's hand is located in a space of interest at a predetermined distance from the wearable glasses 1000. .

For example, the wearable spectacles 1000 can estimate an area 5102 corresponding to the user's hand from the image 5100.

In operation S2220, the wearable glasses 1000 can detect the number of hands and the number of fingers.

Referring to FIG. 51, the wearable spectacles 1000 may analyze an area 5102 corresponding to a user's hand to thereby further detect an area 5104 corresponding to the fingertip and an area 5106 corresponding to the back of the hand included in the area corresponding to the hand. However, it should be understood that one or more other exemplary embodiments are not limited to the back of the hand, but the wearable eyewear 1000 can detect an area corresponding to at least a portion of the hand (eg, the palm or wrist).

The wearable glasses 1000 can detect the number of hands present in the space of interest and the number of fingers present in the space of interest based on the detected area.

In operation S2230, the wearable spectacles 1000 may select parameters of the image to be adjusted based on the number of hands and the number of fingers. The wearable spectacles 1000 can determine the type of gesture of the user's hand based on the number of hands and the number of fingers.

The wearable spectacles 1000 can determine parameters of the image to be adjusted based on the determined type of gesture. The parameter of the image to be adjusted may include at least one of a size, a shape, and a rotation angle of the image to be adjusted. In other words, the wearable spectacles 1000 can determine which of the size, position, shape, and rotation angle of the display image to be adjusted based on the determined type of gesture. However, in one or more other exemplary embodiments, the parameters of the image to be adjusted are not limited thereto.

For example, the parameter of the image to be adjusted may be a parameter associated with the position on the display 1030 displaying the image to be adjusted, or the color of the image to be adjusted. Alternatively, when the display 1030 of the wearable spectacles 1000 is configured as a translucent optical waveguide (eg, 稜鏡), the parameters of the image to be adjusted may be light output from the projector of the display 1030 of the wearable spectacles 1000. The position of the focused focus.

In operation S2240, the wearable glasses 1000 can detect changes in the position and shape of the hand.

For example, the wearable spectacles 1000 can detect movement (eg, distance or angle of movement) of the region 5104 corresponding to the fingertip relative to the region 5106 corresponding to the back of the hand.

For example, the wearable spectacles 1000 can detect the operation of the user bending the finger by detecting that the area 5104 corresponding to the fingertip and the area 5106 corresponding to the back of the hand become closer to each other. Alternatively, the wearable spectacles 1000 can detect the user's operation of straightening the finger by detecting that the area 5104 corresponding to the fingertip and the area 5106 corresponding to the back of the hand become farther from each other.

In operation S2250, the wearable spectacles 1000 may determine an adjustment value for adjusting the selected parameter based on a change in the position and shape of the hand.

For example, the wearable spectacles 1000 can determine how much the selected parameter will be adjusted based on a change in the distance that at least a portion of the hand moves during a predetermined time period or a change in shape of at least a portion of the hand moving within a predetermined time period. However, it should be understood that one or more other exemplary embodiments are not limited thereto. For example, the wearable spectacles 1000 can be based on various information retrieved according to the gesture (eg, the speed of the hand movement, the position from which the hand is detected, the direction in which the hand moves, and the number of times the gesture is repeated) Determine the adjustment value.

52, 53 and 54 are schematic diagrams for explaining a method of determining the adjustment value for adjusting the display image based on the posture of the user, according to an exemplary embodiment of the wearable eyewear 1000.

Referring to FIG. 52, the wearable eyewear 1000 can output a guide image that guides the user to swing the posture of the virtual input interface 4801 by using the hand 7.

When the gesture of the user's hand 7 corresponding to the virtual input interface 4801 is detected, the wearable eyewear 1000 can be based on the angle at which the user's hand 7 moves, the distance the user's hand 7 moves, or the user's hand 7 The speed of the movement to adjust the display image.

For example, when the user poses a posture in which the virtual input interface 4801 is rotated clockwise by the hand 7, the wearable glasses 1000 can rotate the display image clockwise by the angle at which the user's hand 7 rotates.

As shown in FIG. 53, the wearable spectacles 1000 can output a guide image that guides the user to pose a gesture of pressing at least one button included in the virtual input interface 4801 by the hand 7.

When the gesture of the user's hand 7 corresponding to the virtual input interface 4801 is detected, the wearable spectacles 1000 can adjust the display image based on the position of the user's hand 7 and the distance or number of times the user's hand 7 moves.

For example, when the user poses a gesture of pressing the arrow-shaped button included in the virtual input interface 4801 by the hand 7, the wearable spectacles 1000 can move the display image in a direction corresponding to the arrow-shaped button. In this case, the wearable eyewear 1000 can move the display image by a distance corresponding to the number of times the user's hand 7 is moved.

As shown in FIG. 54, the wearable spectacles 1000 can output a guide image that guides the user to pose a gesture of moving the virtual input interface 4801 by the hand 7.

When the gesture of the user's hand 7 corresponding to the virtual input interface 4801 is detected, the wearable spectacles 1000 can adjust the display image based on the distance moved by the user's hand 7 or the angle at which the user's hand 7 rotates.

For example, when the user poses a gesture of rotating the virtual input interface 4801 by the hand 7, the wearable glasses 1000 can rotate the display image by the angle at which the user's hand 7 rotates.

A method of adjusting a display image based on a user's gesture within a space of interest in accordance with one or more exemplary embodiments has been described above with reference to FIGS. 50-54. However, it should be understood that one or more other exemplary embodiments are not limited thereto.

For example, according to one or more other exemplary embodiments, the wearable spectacles 1000 can capture information about the touch input of the user received via the user input unit 1040 included in the wearable spectacles 1000 as Information about the pose of the person. For example, the wearable eyewear 1000 can include a touch pad as the user input unit 120. The touch pad included in the wearable glasses 1000 may be a capacitive overlay type, a resistive overlay type, an infrared beam type, or a surface acoustic wave type. An integral strain gauge type, a piezo electric type, an optical input element, an optical input pad, etc., but not limited thereto.

The touch pads included in the wearable glasses 1000 can be configured to detect proximity touches as well as real touches. Throughout the specification, the term "real touch" means that the pointer actually or directly touches the screen, and the term "proximity touch" means that the pointer does not actually touch the screen, but is closer to the screen. The situation of the location.

A pointer as used herein refers to a touch instrument for a real touch or proximity touch of a portion of a displayed screen image. Examples of pointers include an electronic pen, a finger, a stylus, and the like.

To detect real or near touches, various sensors can be placed in or near the touchpad. An example of a sensor for detecting an actual touch or a proximity touch on a touch pad can include a tactile sensor. The haptic sensor represents a sensor that detects a touch of a particular object to a greater or lesser extent than a person perceives. The tactile sensor can detect various types of information such as the roughness of the touched surface, the hardness of the touched object, the temperature of the touched point, and the like.

Another example of a sensor for detecting a touch on a touchpad is a proximity sensor. The proximity sensor is a sensor that uses electromagnetic force or infrared light instead of using any mechanical contact to detect the presence of an object near a predetermined detection surface or present near a predetermined detection surface. Examples of the proximity sensor include a transmission-type photoelectric sensor, a direct reflection-type photoelectric sensor, and a mirror reflection-type photoelectric sensor. Sensor), high frequency oscillation-type proximity sensor, capacitance-type proximity sensor, magnetic proximity sensor, infrared proximity sensor, and the like.

Examples of user's touch gestures may include tap, touch and hold, double tap, drag, panning, flick, drag and drop. (drag and drop), swipe, etc.

The wearable spectacles 1000 can retrieve information about the user's posture via the user input unit 1040. For example, the wearable glasses 1000 can sense a touch input for adjusting a display image via the user input unit 1040. For example, the user can drag or tap the predetermined position on the touchpad of the user input unit 1040.

"Drag" refers to the action of the user touching the screen with a fingertip or touch tool while touching the screen and moving the fingertip or touch tool to other positioning on the screen. "Tap" means that the user touches the screen with a fingertip or a touch tool (for example, an electronic pen) without moving to lift the fingertip or touch the tool very quickly from the screen.

The wearable glasses 1000 can adjust the display image based on the user's touch input. For example, the wearable glasses 1000 can capture the touch input of the user as information about the posture of the user, determine an adjustment value based on the touch input of the user, and adjust the display image based on the determined adjustment value.

55 and 56 are schematic diagrams illustrating a method of adjusting the display image of the wearable spectacles 1000 based on the posture of the user, in accordance with one or more exemplary embodiments.

55 and 56 illustrate a situation in which the wearable eyewear 1000 includes a touchpad as the user input unit 1040, in accordance with one or more exemplary embodiments. The touch pads included in the wearable glasses 1000 may be, but are not limited to, a capacitive cover type, a resistive cover type, an infrared beam type, a surface acoustic wave type, an overall strain gauge type, a piezoelectric type, and the like.

First, as shown in FIG. 55, the wearable glasses 1000 can detect a posture in which the user drags a predetermined position on the touch pad of the user input unit 1040. The wearable spectacles 1000 can adjust the display image based on at least one of a direction of the user's drag gesture, a duration of the drag gesture, and a distance that the hand 7 moves with the drag gesture.

For example, as shown in FIG. 55, the wearable glasses 1000 can change the position of the display image 5501 based on the user's drag input.

The wearable glasses 1000 can recognize a multi-touch gesture by recognizing a number of touch points via the user input unit 1040. The wearable spectacles 1000 can be configured to react differently depending on the number of sensed touch points by recognizing the multi-touch gesture.

As shown in FIG. 56, the wearable eyewear 1000 can detect a gesture of a user who uses a plurality of fingers to touch a predetermined position on the touchpad of the user input unit 1040. The wearable spectacles 1000 can adjust the display image based on at least one of the number of touch points of the user, the direction in which the finger moves, the duration of the touch gesture, and the distance the finger moves with the touch gesture.

For example, as shown in FIG. 56, the wearable glasses 1000 can rotate the display image 5601 based on the moving direction of the touch input in response to the user input of the user input unit 1040 being dragged using at least two fingers.

However, it should be understood that one or more other exemplary embodiments are not limited to FIGS. 55 and 56. The wearable spectacles 1000 can adjust at least one of a rotation angle, a size, a position, a brightness, and a shape of the display image according to various touch inputs of the user. For example, when the display 1030 of the wearable glasses 1000 is configured as a translucent optical waveguide (eg, 稜鏡), the wearable spectacles 1000 can adjust the light output from the projector of the display 1030 based on the user's touch input. The position of the focused focus.

Wearable glasses 1000 can operate in conjunction with, for example, a mobile phone, a personal digital assistant (PDA), a laptop, a tablet, a portable multimedia player, a display component, a personal computer (personal Computer, PC), server, etc. The component can display an image via wearable glasses 1000.

FIG. 57 is a schematic diagram of a system in which an element 2000 displays an image via wearable glasses 1000, in accordance with an exemplary embodiment.

Referring to FIG. 57, the wearable glasses 1000 can provide the component 2000 with information for adjusting the displayed image.

The information provided by the wearable spectacles 1000 to the component 2000 may include, for example, information about a body part of the user wearing the wearable spectacles 1000, information about the posture of the user, and user input via the wearable spectacles 1000. At least one.

Element 2000 adjusts the displayed image based on information received from wearable glasses 1000 and provides the adjusted image to wearable glasses 1000. The display 2000 can display the adjusted image via the wearable glasses 1000.

The wearable spectacles 1000 can capture a body part of the user and transmit an image of the body part to the element 2000. For example, the wearable eyewear 1000 can take a picture of the user's eyes or hands.

The component 2000 can receive images captured by the wearable glasses 1000 from the wearable glasses 1000 and determine the display image via the wearable glasses 1000. The display 2000 can determine the location of the image to be displayed and can display the image at the determined location via the wearable glasses 1000.

Examples of component 2000 may include, but are not limited to, a smart phone, a tablet personal computer (PC), a personal computer, a television (television, TV), a mobile phone, a personal digital assistant, a laptop, a media player, a micro servo. , global positioning system (GPS) components, e-book terminals, digital broadcast terminals, navigation components, kiosks, MP3 players, digital cameras, and other mobile or non-motion computing components. Component 2000 can also include various devices capable of receiving touch input, such as an electronic blackboard and a touch pad. Component 1000 can be a wearable component that includes communication functions and data processing functions. However, it should be understood that one or more other exemplary embodiments are not limited thereto, and that component 2000 may be any kind that is capable of receiving material from wearable glasses 1000 via the network or transmitting material to wearable glasses 1000 via the network. Device.

The component 2000 and the wearable glasses 1000 can be connected to each other via a network, and the network can be a wired network (such as a local area network (LAN), a wide area network (WAN), or a value-added network. Value added network (VAN), or any kind of wireless network (eg, mobile radio communication network, satellite communication network, etc.).

FIG. 58 is a flowchart of a method of component 2000 displaying an image via wearable glasses 1000, in accordance with an exemplary embodiment.

Referring to FIG. 58, in operation S3100, the component 2000 may receive wear status information representing the state in which the user currently wears the wearable eyewear 1000 from the wearable glasses 1000. The wear status information may include information about the body part of the user. The information about the body part of the user may be information for determining the inclination of the wearable eyewear 1000 relative to the user relative to the reference wear state. For example, the information about the body part retrieved by the wearable eyewear 1000 can include information regarding at least one selected from the user's eyes, nose, ears, mouth, and hands. The information about the body part captured by the wearable glasses 1000 may also include images of the body part.

The wear status information received by the component 2000 from the wearable glasses 1000 in operation S3100 may be information captured by the wearable glasses 1000. The operation S200 shown in Fig. 58 corresponds to the operation S200 shown in Fig. 6, and therefore will not be described again below.

In operation S3200, the wearable spectacles 1000 may use the received information about the body part of the user to determine the inclination of the wearable spectacles 1000 relative to the user.

The inclination of the wearable spectacles 1000 with respect to the user indicates the degree of inclination of the wearable spectacles 1000 determined based on the position of the wearable spectacles 1000 that is optimal for displaying an image to the user.

For example, component 2000 can determine the tilt of wearable eyewear 1000 relative to the user by comparing predetermined reference wear status information to wear status information received from wearable glasses 1000. The reference wear status information is information representing the position of the wearable glasses 1000 that is most suitable for providing images to the user. The reference wearable status information can be stored in advance or can be set by the user.

For example, the wearable status information can include an image of the body part of the user. The component 2000 can detect an area corresponding to the body part from an image of the body part, and extract a characteristic value of the body part from the detected area. Element 2000 can retrieve a property value that is associated with the location, shape, or size of the region of the body portion that is detected by the image of the body portion. Element 2000 can determine the slope by comparing the captured characteristic value to a reference value included in the reference wear status information. The reference value included in the reference wear status information may be a characteristic value detected from the image of the body part captured in the reference wear state.

In operation S3300, the component 2000 may adjust an image displayed on the display 1030 of the wearable eyewear 1000 based on the inclination determined in operation S3200. For example, element 2000 can adjust at least one of a rotation angle, a size, and a shape of the display image based on the inclination determined in operation S3200.

However, it should be understood that one or more other exemplary embodiments are not limited thereto, and that component 2000 can adjust various parameters of the image provided to the user via display 1030. For example, component 2000 can further adjust at least one of brightness of an image displayed on display 1030, a location on display 1030 displaying the image, and a color of an image displayed on display 1030.

As another example, when the display 1030 of the wearable spectacles 1000 is configured as a translucent optical waveguide (eg, 稜鏡), the component 2000 can adjust the light output from the projector of the display 1030 based on the tilt of the wearable spectacles 1000. The position of the focused focus.

In operation S3400, the component 2000 may provide the adjusted image obtained in operation S3300 to the wearable glasses 1000. In operation S400, the adjusted image provided by the component 2000 to the wearable eyewear 1000 may be displayed via the wearable glasses 1000.

When the component 2000 uses information about the body part to adjust the displayed image, any of the above methods can be applied. In other words, any of the above methods in which the wearable spectacles 1000 adjusts the display image can be applied to the case where the component 2000 adjusts the image displayed on the wearable spectacles 1000 according to one or more exemplary embodiments. Therefore, the case where the component 2000 adjusts the image displayed on the wearable eyewear 1000 will not be described below.

FIG. 59 is a flowchart of a method in which an element 2000 displays an image via wearable glasses 1000, in accordance with an exemplary embodiment.

Referring to FIG. 59, in operation S4100, the component 2000 may receive information about the posture of the user from the wearable glasses 1000.

Information about the user's gesture may be used to determine information for adjusting the adjustment value of the displayed image. For example, the information about the gesture retrieved by the wearable spectacles 1000 can include information about at least one of the user's head, hands, eyes, and mouth. The information about the posture captured by the wearable eyewear 1000 may also include an image of the body part in which the posture is placed.

The information about the gesture received by the component 2000 from the wearable spectacles 1000 in operation S4100 may be information captured by the wearable spectacles 1000. The operation S2100 shown in Fig. 59 corresponds to the operation S2100 shown in Fig. 46, and therefore will not be described again below.

In operation S4200, the component 2000 may determine an adjustment value for adjusting the display image based on the received information about the posture of the user.

For example, the adjustment value may be a value for adjusting at least one of a rotation angle, a size, and a shape of the display image. Alternatively, the adjustment value may be a value for adjusting the brightness of the displayed image, the position on the display 1030 on which the image is displayed, or the color of the displayed image. Alternatively, when the display 1030 of the wearable spectacles 1000 is configured as a translucent optical waveguide (eg, 稜鏡), the adjustment value may be the focus of the light output by the projector of the display 1030 of the wearable spectacles 1000. s position.

Element 2000 may map information about the plurality of gestures to the adjusted values and store the results of the mapping, or store the relationship of the adjusted values based on the information about the gesture. Element 2000 may determine the adjustment value by searching for pre-stored adjustment values based on the captured information or by using the found relationship to calculate an adjustment value.

In operation S4300, the component 2000 may adjust the display image based on the determined adjustment value. For example, the wearable spectacles 1000 can adjust at least one of a rotation angle, a size, and a shape of the display image based on the determined adjustment value.

In operation S4400, the component 2000 may provide the adjusted image obtained in operation S4300 to the wearable glasses 1000. In operation S400, the adjusted image provided by the component 2000 to the wearable eyewear 1000 may be displayed via the wearable glasses 1000.

When the component 2000 adjusts the display image using information about the posture of the user, the method described above with reference to FIGS. 45 to 56 can be applied. In other words, the method described above with respect to FIGS. 45 to 56 in which the wearable glasses 1000 adjusts the display image can be applied to the case where the component 2000 adjusts the image displayed on the wearable eyewear 1000 according to the exemplary embodiment. Therefore, the description of the case where the component 2000 adjusts the image displayed on the wearable spectacles 1000 will not be described below.

FIG. 60 is a block diagram of wearable glasses 1000 in accordance with an exemplary embodiment.

Referring to FIG. 60, the wearable glasses 1000 can include a sensing unit 1100 (eg, a sensor), a processor 1200, and a display 1030. Other and/or additional components than those shown in FIG. 60 may be included in the wearable eyewear 1000. The components included in the wearable spectacles 1000 can be disposed on a frame for wearing the wearable spectacles 1000 on the head of the user.

Display 1030 shows the image to the user. Display 1030 displays information processed by wearable glasses 1000. The display 1030 can display an image that has been adjusted based on the inclination of the wearable spectacles 1000 or the posture of the user.

The display 1030 can display at least one of: a user interface (UI) for setting a reference value for adjusting the displayed image, a user interface for inducing a posture of the user for adjusting the displayed image, and A user interface for providing information to the user in connection with the adjustment of the displayed image.

The sensing unit 1100 can retrieve information about a body part of the user or information about a user's posture. The information about the body part of the user may include an image of the body part, and the information about the user's posture may include an image of the body part of the user who poses.

For example, the sensing unit 1100 can capture an image of the user's eyes or an image of the user's hand.

The processor 1200 can use information about the body part of the user to determine the tilt of the wearable eyewear 1000 relative to the user and adjust the displayed image based on the determined tilt. Alternatively, the processor 1200 can determine an adjustment value using an image of the user's gesture and adjust the display image based on the determined value.

As shown in FIG. 61, the wearable glasses 1000 may further include a communication unit 1300 (eg, a communicator), a memory 1400, a user input unit 1040 (eg, a user input device or a user input element), and an output unit 1500 ( For example, an output or output element), and a power supply unit 1600 (eg, a power supply component or a power supply). According to an exemplary embodiment, the sensing unit 1100 may include at least one camera (ie, cameras 1050, 1060, and 1070), and a sensor 1150. The above components can be connected to each other via a bus bar.

The above components will now be explained in detail.

Cameras 1050, 1060, and 1070 capture or capture images of objects in real space. The image of the object taken by the cameras 1050, 1060, and 1070 can be a moving picture image or a continuous still image. The wearable eyewear 1000 can be a lens-type component that includes communication operations and data processing operations. The camera 1050 in the wearable eyewear 1000 can face the user and take pictures of the objects in the actual space.

The camera 1060 can take a picture of the user's eyes. For example, camera 1060 in wearable eyewear 1000 can face the user's face and take a picture of the user's eyes.

The eye tracking camera 1070 can take a picture of the user's eyes. For example, the eye tracking camera 1070 in the wearable eyewear 1000 can track the user's eyes by tracking at least one of the user's head posture, eyelids, and iris.

The sensor 1150 can sense the condition of the wearable eyewear 1000 or the condition around the wearable eyewear 1000, and can transmit information corresponding to the sensed condition to the processor 1200. For example, the sensor 1150 can retrieve wear status information representing the state in which the user currently wears the wearable glasses 1000. For example, the sensor 1150 can include a magnetic sensor, an acceleration sensor, a gyro sensor, a proximity sensor, an optical sensor, a depth sensor, an infrared sensor, and a ultrasonic sensor. At least one of them.

The communication unit 1300 can receive information used by the wearable glasses 1000 to display images and adjust images from the component 2000, peripheral components or servers, or transmit the information to the component 2000, peripheral components or servers.

The memory 1400 stores the wearable glasses 1000 to display images and information used to adjust the images based on the inclination of the wearable glasses 1000. The memory 1400 can store information about a reference wear state that represents a state in which the user wears the wearable eyewear 1000 at a position where the user is most likely to receive the image. For example, the memory 1400 can store reference wear status information including an image of a body part of the user captured in the reference wear state, and a user's body captured from the reference wear state. The characteristic value detected by part of the image.

The user input unit 1040 receives user input for controlling the wearable glasses 1000. The user input unit 1040 can receive touch input to the wearable glasses 1000 and key input to the wearable glasses 1000. The user input unit 1040 can also receive gesture input by the user photographed by the camera 1050.

The power supply unit 1600 supplies power to each component to operate the wearable glasses 1000. The power supply unit 1600 can include a battery that can be charged and a cable or cable that can receive power from an external source.

The output unit 1500 outputs information received from the communication unit 1300, processed by the processor 1200, or stored in the memory 1400 in the form of at least one of light, sound, and vibration. For example, output unit 1500 can include a speaker 1020 that outputs audio material. The speaker 1020 can also output an audio signal (eg, a call signal reception sound, a message reception sound, a notification sound) related to the function of the wearable glasses 1000.

The processor 1200 can control the overall operation of the wearable glasses 1000. For example, the processor 1200 can control the display 1030, the sensing unit 1100, the communication unit 1300, the memory 1400, the user input unit 1040, the output unit 1100, and the power supply unit by executing a program stored in the memory 1400. 1600.

Wearable eyewear 1000 can be coupled to component 2000 and can receive information about the displayed image from component 2000, thereby displaying the image on display 1030 of wearable eyewear 1000.

62 and 63 are block diagrams of an element 2000 in accordance with one or more exemplary embodiments.

Referring to FIG. 62, component 2000 can include user input unit 6100, output unit 6200, controller 6300, and communication unit 6500. More or fewer components than those shown in Figure 62 may be included in component 2000.

For example, referring to FIG. 63, in addition to user input unit 6100 (eg, user input or user input element), output unit 6200 (eg, output or output element), controller 6300, and communication unit 6500 ( For example, in addition to the communicator, the component 2000 may further include a sensing unit 6400 (eg, a sensor), an audio/video (A/V) input unit 6600 (eg, an audio/video input device or an audio device). / Video input component), and memory 6700.

User input unit 6100 represents a unit for the user to input data to control element 2000. For example, the user input unit 6100 can be, but not limited to, a key pad, a dome switch, a touch pad (eg, a capacitive overlay, a resistive overlay, an infrared beam, an overall strain gauge). , surface acoustic wave type, piezoelectric type, etc.), jog wheel or jog switch.

The user input unit 6100 can receive a user unit for controlling the wearable glasses 1000. The user input unit 6100 can also receive a user unit for adjusting an image displayed via the wearable glasses 1000 based on information about a body part of the user or information about a posture of the user.

The output unit 6200 can output an audio signal, a video signal or a vibration signal, and can include a display 6210, an audio output unit 6220 (eg, a speaker, an audio output, an audio jack, an audio output component), and a vibration motor 6230.

Display 6210 displays information processed by component 2000. For example, the display 6210 can display a user interface for receiving user input and a user interface for receiving a set value, the user input is used to control the wearable glasses 1000, and the set value is adjusted and adjusted via The operation of the image displayed by the wearable glasses 1000 is associated.

When the display 6210 forms a layer structure with the touch pad to form a touch screen, the display 6210 can be used as an input element and an output element. The display 6210 can include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT-LCD), an organic light emitting diode (OLED), a flexible display, a three-dimensional (3D) display, and an electrophoretic display. According to one or more exemplary embodiments of component 2000, component 2000 can include at least two displays 6210. The at least two displays 6210 can be configured to face each other using a hinge.

The audio output unit 6220 can output the audio data stored in the memory 6700 or received from the communication unit 6500. The audio output unit 6220 can also output audio signals (eg, call signal reception sound, message reception sound, notification sound) related to the function of the component 2000. The audio output unit 6220 can include a speaker, a buzzer, and the like.

The vibration motor 6230 can output a vibration signal. For example, the vibration motor 6230 can output a vibration signal (eg, a call signal receiving sound or a message receiving sound) corresponding to the audio data or the video material. The vibration motor 6230 can also output a vibration signal when the touch screen is touched.

Controller 6300 can control the overall operation of component 2000. For example, the controller 6300 can control the user input unit 6700, the output unit 6200, the sensing unit 6400, the communication unit 6500, the audio/video input unit 6600, and the like by executing a program stored in the memory 6500.

In detail, the controller 6300 receives information for adjusting the display image from the wearable glasses 1000 by controlling the communication unit 6500 and adjusts the display image based on the received information.

The controller 6300 receives user input for controlling the operation of the wearable glasses 1000. The user input can be, for example, a touch input, a button input, or a voice input, but is not limited thereto. The controller 6300 can receive user input to the wearable glasses 1000 from the wearable glasses 1000.

The sensing unit 6400 can sense the condition of the component 2000 or the condition around the component 2000, and can transmit information corresponding to the sensed condition to the controller 6300.

The sensing unit 6400 can include, but is not limited to, a magnetic sensor 6410, an acceleration sensor 6420, a temperature/humidity sensor 6430, an infrared sensor 6440, a gyroscope sensor 6450, a positioning sensor (eg, global Positioning system) 6460, pressure sensor 6470, proximity sensor 6480, and RGB sensor 6490 (ie, brightness sensor).

The communication unit 6500 can include at least one component that enables the component 2000 to communicate with the wearable glasses 1000 or server. For example, the communication unit 6500 can include a short range wireless communication unit 6510 (eg, a short range wireless communicator), a mobile communication unit 6520 (eg, a mobile communicator), and a broadcast receiving unit 6530 (eg, a broadcast receiver).

The short-range wireless communication unit 1510 may include, but is not limited to, a Bluetooth communicator, a Bluetooth Low Energy (BLE) communicator, a near field communication (NFC) unit, and a wireless local area network (wireless local area network). WLAN) (eg Wi-Fi) communicator, ZigBee communicator, infrared data association (IrDA) communicator, Wi-Fi direct (WFD) communicator, ultra wideband , UWB) communicator, etc.

The mobile communication unit 6520 can exchange wireless signals with at least one selected from the group consisting of a base station, an external terminal, and a server on the mobile communication network. Examples of wireless signals may include voice call signals, video call signals, and various types of data generated during a short message service (SMS)/multimedia messaging service (MMS).

The broadcast receiving unit 6530 receives broadcast signals and/or broadcast associated information from an external source via a broadcast channel. The broadcast channel can be a satellite channel, a ground wave channel, or the like. According to one or more other exemplary embodiments, element 2000 may not include broadcast receiving unit 6530.

The audio/video input unit 6600 inputs an audio signal or a video signal, and may include a camera 6610 and a microphone 6620. The camera 6610 can capture an image frame (eg, a still image or a moving picture) in a video call mode or a photography mode via an image sensor. Images captured via the image sensor can be processed by controller 6300 or a separate image processor.

The video frame obtained by the camera 6610 can be stored in the memory 6700 or transmitted to the outside via the communicator 6500. At least two cameras 6610 may be included in accordance with one or more exemplary embodiments of the structure of the terminal.

The microphone 6620 receives an external audio signal and converts the external audio signal into electrical audio data. For example, the microphone 6620 can receive audio signals from external components or speakers. The microphone 6620 can use various noise cancellation algorithms to eliminate noise generated while receiving external audio signals.

The memory 6700 can store the program used by the controller 6300 for processing and control, and can also store the data input to the component 2000 or output from the component 2000.

The memory 6700 may include at least one of the following types of storage media: a flash memory type memory, a hard disk type memory, a multimedia card micro memory, a card type memory (for example, secure digital (SD) or Extreme digital (XD) memory, random access memory (RAM), static random access memory (SRAM), read-only memory (read-only memory, ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (ROMM), magnetic memory, disk, and optical disk.

The program stored in the memory 6700 can be divided into a plurality of modules according to its functions, such as a user interface module 6710, a touch screen module 6720, and a notification module 6730.

The user interface module 6710 can provide a user interface, a graphical user interface, and the like that are dedicated to each application and interact with the component 2000. The touch screen module 6720 can detect a touch gesture on the touch screen of the user and transmit information about the touch gesture to the controller 6300. The touch screen module 6720 according to an exemplary embodiment can recognize and analyze the touch code. The touch screen module 6720 can be constructed from a separate hardware that includes a controller.

To detect actual or proximity touch on the touchpad, the touchscreen can have various sensors inside or outside. An example of a sensor for detecting a real touch or a proximity touch on a touch screen is a tactile sensor. A haptic sensor represents a sensor that detects the touch of a particular object to a greater or lesser extent than a person perceives. The tactile sensor can detect various types of information such as the roughness of the touched surface, the hardness of the touched object, the temperature of the touched point, and the like.

Another example of a sensor for detecting a real touch or a proximity touch on a touch screen is a proximity sensor.

Proximity sensors are sensors that use electromagnetic force or infrared light instead of using any mechanical contact to detect the presence of an object near a predetermined detection surface or present near a predetermined detection surface. Examples of proximity sensors include a transmissive photodetector, a direct reflection photoinductor, a specular reflection photoinductor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, and magnetic proximity sensing. , infrared proximity sensor, etc. Examples of the user's touch gestures may include tapping, long press, double tapping, dragging, panning, sliding, dragging and dropping, sweeping, and the like.

The notification module 6730 can generate a signal for notifying that an event has been generated in the component 2000. Examples of events generated in component 2000 may include call signal reception, message reception, button signal input, schedule notification, and the like. The notification module 6730 can output the notification signal in the form of a video signal via the display 6210, in the form of an audio signal via the audio output unit 6220 or in the form of a vibration signal via the vibration motor 6230.

The exemplary embodiments can also be implemented as a storage medium containing an instruction code executable by a computer, such as a program module executed by a computer. The computer readable recording medium can be any available media that can be accessed by a computer and includes all volatile/nonvolatile media and removable/non-removable media. In addition, the computer readable recording medium can include all computer storage media and communication media. The computer storage medium includes all volatile/non-volatile media and removable/non-removable media for storing information implemented by a method or technique, such as a computer readable instruction code, Data structure, program modules or other materials. The communication medium may include a computer readable instruction code, a data structure, a program module, or other data of a modulated data signal (eg, a carrier wave), or other transmission mechanism, and includes any information transmission medium. It will be understood that one or more of the above-described elements may be implemented in or by at least one processor, circuit, microprocessor or the like.

Although the exemplary embodiments have been disclosed for illustrative purposes, it is understood by those of ordinary skill in the art that various changes and modifications can be made without departing from the spirit and scope of the inventive concept. Therefore, the above-described exemplary embodiments are not to be considered as limiting in all aspects. For example, the various elements illustrated in the overall form can be used separately and the separate elements can be used in combination.

The above-described exemplary embodiments are to be considered as illustrative only and not limiting. Descriptions of features or aspects in each exemplary embodiment should generally be considered as applicable to other similar features or aspects in other embodiments.

Although the exemplary embodiments have been particularly shown and described, it is understood by those of ordinary skill in the art that various forms and details can be made without departing from the spirit and scope of the invention as defined by the following claims. Change on.

7‧‧‧Hand
10‧‧‧ Wearable glasses
12‧‧‧ images
13‧‧‧Image
14‧‧‧Adjusted image/image/display image
20‧‧‧Wearing components
901‧‧‧ images
1000‧‧‧ wearable glasses
1005‧‧‧ lens
1010‧‧‧Frame
1020‧‧‧Optical output unit/speaker
1030‧‧‧ display
1040‧‧‧User input unit
1050‧‧‧ camera
1060‧‧‧ camera
1070‧‧‧ Eye tracking camera/camera
1100‧‧‧Sensor unit
1150‧‧‧ sensor
1200‧‧‧ processor
1300‧‧‧Communication unit
1301‧‧‧Regional/First Area
1400‧‧‧ memory
1401‧‧‧Regional/Second Area
1403‧‧‧Regional/Third Area
1405‧‧‧ Center/Location
1405-1‧‧ Center
1405-2‧‧ Center
1500‧‧‧Output unit
1501‧‧‧ segments
1501-1‧‧‧ long axis of the eye
1501-2‧‧‧ long axis of the eye
1503‧‧‧ segments
1505‧‧‧ angle
1507‧‧‧ angle
1509-1‧‧‧ vertical axis
1509-3‧‧‧ horizontal axis
1600‧‧‧Power supply unit
1601‧‧‧ angle
2000‧‧‧ components
2001‧‧‧Image
2101‧‧‧Image
2103‧‧‧Image
Image of 2201‧‧‧
2203‧‧‧Adjusted image
2211‧‧‧Image
2213‧‧‧Adjusted image
2215‧‧‧ pixels
2217‧‧‧ pixels
2221‧‧‧Image
2223‧‧ images
2225‧‧‧ center point
2301‧‧‧Image
2305‧‧‧ arrow
2401‧‧‧Image
2601‧‧‧Adjusted image
2603‧‧‧Reduced image
2801‧‧‧Image
2803‧‧‧Image
2901‧‧‧Image
2903‧‧‧Display image
2905‧‧‧Guided image
3101‧‧‧ Pre-stored reference locations
3103‧‧‧ arrow
3201‧‧‧Pre-storage area
3203‧‧‧ arrow
3301‧‧‧Graphical User Interface (GUI)
3401‧‧‧ eyeball
3403‧‧‧Image
3801‧‧‧ Eye images
3803‧‧·Reflex image
3901-1‧‧‧ Eye image
3901-2‧‧‧ Eye image
3901-3‧‧‧ Eye image
3903‧‧·Reflex image
3905‧‧·Reflex image
3907‧‧·Reflex image
4205‧‧‧Reflex image
4301‧‧‧ angle
4303‧‧‧上上
4305‧‧‧ below
4307‧‧‧上上
4309‧‧‧ below
4401‧‧‧Reflex image
4501‧‧‧Interest space
4800‧‧‧Guided image
4801‧‧‧Virtual Input Interface
5100‧‧‧ images
5102‧‧‧Area
5104‧‧‧Area
5106‧‧‧Area
5501‧‧‧Display image
5601‧‧‧Display image
6100‧‧‧ Input unit
6200‧‧‧Output unit
6210‧‧‧ display
6220‧‧‧Optical output unit
6230‧‧‧Vibration motor
6300‧‧‧ Controller
6400‧‧‧Sensor unit
6410‧‧‧Magnetic sensor
6420‧‧‧Acceleration sensor
6430‧‧‧ Temperature/Humidity Sensor
6440‧‧‧Infrared sensor
6450‧‧‧Gyro sensor
6460‧‧‧ Positioning Sensor
6470‧‧‧ Pressure sensor
6480‧‧‧ proximity sensor
6490‧‧‧RGB sensor
6500‧‧‧Communication unit
6510‧‧‧Short-range wireless communication unit
6520‧‧‧Mobile communication unit
6530‧‧‧Broadcast receiving unit
6600‧‧‧Audio/Video Input Unit
6610‧‧‧ camera
6620‧‧‧Microphone
6700‧‧‧ memory
6710‧‧‧User Interface Module
6720‧‧‧Touch Screen Module
6730‧‧‧Notification module
S100, S200, S300, S400‧‧‧ operations
S200, S210, S220, S230, S240, S250‧‧‧ operations
S300, S310, S320, S330, S340, S350‧‧‧ operations
S400, S410, S420, S430, S440, S450, S460, S470, S480‧‧‧ operations
S510, S520, S530, S540‧‧‧ operations
S1100, S1200, S1300, S1400‧‧‧ operations
S1305, S1310, 1320, S1330, S1340‧‧‧ operations
S2100, S2200, S2300‧‧‧ operations
S2110, S2120, S2130, S2140, S2150‧‧‧ operations
S2210, S2220, S2230, S2240, S2250‧‧‧ operations
S3100, S3200, S3300, S3400‧‧‧ operations
S4100, S4200, S4300, S4400‧‧‧ operation θ‧‧‧ angle

BRIEF DESCRIPTION OF THE DRAWINGS The following description of the exemplary embodiments, which will be apparent, and A schematic diagram of the inconvenience. 2A, 2B, and 2C are schematic views for explaining wearable glasses that display an adjusted image when the wearable glasses are tilted relative to the user, in accordance with one or more exemplary embodiments. 3A and 3B illustrate an appearance of wearable glasses according to an exemplary embodiment. 4A and 4B illustrate the appearance of wearable glasses in accordance with an exemplary embodiment. 5A and 5B illustrate an appearance of wearable glasses according to an exemplary embodiment. FIG. 6 is a flowchart of a method of displaying an image of a wearable eyeglass, according to an exemplary embodiment. FIG. 7 is a diagram for explaining a tilt of a wearable eyeglass relative to a user determined based on a reference wear state, according to an exemplary embodiment. 8 is a flow chart of a method of wearing glasses for capturing information about a body part of a user, in accordance with an exemplary embodiment. FIG. 9 illustrates a screen displaying a guide image for photographing a user's eyes, according to an exemplary embodiment. 10A and 10B illustrate an example of an eye image of a user captured through the wearable glasses when the wearable glasses are not tilted relative to the user, in accordance with one or more exemplary embodiments. 11A, 11B, and 11C illustrate an example of an eye image of a user captured through the wearable eyewear when the wearable eyeglass is tilted relative to the user, in accordance with one or more exemplary embodiments. 12 is a flow chart of a method of determining the inclination of a wearable eyeglass from an eye image of a user, in accordance with an exemplary embodiment. FIG. 13 is a schematic diagram for explaining a first region corresponding to an eye determined from a captured eye image of a user, according to an exemplary embodiment. FIG. 14 is a schematic diagram for explaining a second region corresponding to an iris determined from a captured eye image of a user, according to an exemplary embodiment. FIG. 15 is a diagram for explaining characteristic values extracted from a captured eye image, according to an exemplary embodiment. 16 and 17 are schematic diagrams illustrating a method of determining the inclination of a wearable eyeglass from an eye image, according to an exemplary embodiment. 18 and 19 are flowcharts of a method of displaying the obtained adjusted image based on the inclination of the wearable glasses, according to one or more exemplary embodiments. 20, 21A, and 21B are schematic diagrams for explaining adjustment of an image displayed via a display of the wearable glasses based on the inclination of the wearable glasses, in accordance with one or more exemplary embodiments. 22A, 22B, and 22C are schematic diagrams for explaining a method of adjusting an image displayed via a display of the wearable glasses based on the inclination of the wearable glasses, in accordance with one or more exemplary embodiments. 23 and 24 illustrate an example of an animation effect applied to an image displayed via wearable glasses, in accordance with one or more exemplary embodiments. 25 is a flow chart of a method of reducing and displaying an adjusted image of a wearable eyeglass, in accordance with an exemplary embodiment. FIG. 26 is a schematic diagram for explaining an image that is reduced based on the inclination of the wearable glasses and displayed, according to an exemplary embodiment. 27 is a flow chart for displaying a method of requesting a user to adjust an image of a wearable eyeglass, in accordance with an exemplary embodiment. FIG. 28 illustrates an example of requesting a user to adjust an image of a wearable eyeglass, according to an exemplary embodiment. FIG. 29 illustrates an example of guiding a user to adjust an image of the wearable eyeglasses, according to an exemplary embodiment. FIG. 30 is a flowchart of a method of adjusting a displayed image by a wearable eyeglass, according to an exemplary embodiment. 31 is a schematic diagram for explaining a method of adjusting a position and a size of a display image by a wearable eyeglass, according to an exemplary embodiment. FIG. 32 is a schematic diagram for explaining a method of adjusting the brightness of a display image by the wearable glasses, according to an exemplary embodiment. FIG. 33 is a schematic diagram for explaining a method of setting a reference value of a wearable eyeglass to adjust a display image, according to an exemplary embodiment. FIG. 34 is a schematic diagram for explaining a method of correcting a display image based on a test image reflected from a user's eyes, according to an exemplary embodiment. 35 is a flow diagram of a method of correcting a displayed image based on a test image reflected from a user's eye, in accordance with an exemplary embodiment. 36A, 36B, and 36C illustrate an example of a test image in accordance with one or more exemplary embodiments. 37A, 37B, and 37C illustrate an example of an image taken by photographing a user's eyes that reflect a test image by using wearable glasses, in accordance with one or more exemplary embodiments. FIG. 38 illustrates an example of an eye image of a user captured through the wearable glasses when the wearable glasses are not tilted relative to the user, according to an exemplary embodiment. 39A, 39B, and 39C illustrate an example of an eye image of a user captured through the wearable eyewear when the wearable eyewear is tilted relative to the user, in accordance with one or more exemplary embodiments. 40 is a flow chart of a method of determining the tilt of a wearable eyeglass from an eye image of a user, in accordance with an exemplary embodiment. FIG. 41 is a flowchart of a method of displaying the obtained adjusted image based on the inclination of the wearable glasses, according to an exemplary embodiment. 42 is a schematic diagram for explaining characteristic values of a user's eyes measured from a captured eye image of a user, in accordance with an embodiment of the present invention. 43A, 43B, and 43C are diagrams for explaining a method for determining the inclination of a wearable eyeglass based on a reflected image of a test image contained in a user's eye image, according to one or more exemplary embodiments. Schematic diagram. 44A and 44B are schematic diagrams illustrating a method of operating a wearable eyeglass based on an eye image, in accordance with one or more exemplary embodiments. FIG. 45 is a schematic diagram for explaining a method of adjusting a display image of a wearable eyeglass based on a posture of a user, according to an exemplary embodiment. FIG. 46 is a flowchart of a method of adjusting a display image based on a posture of a user, according to an exemplary embodiment. FIG. 47 is a flowchart of a method of wearing glasses to retrieve information about a user's posture, according to an exemplary embodiment. 48 and 49 illustrate an example of a screen displaying wearable glasses that guide images, the guide images being used to induce a user's gesture, in accordance with one or more exemplary embodiments. FIG. 50 is a flowchart of a method of determining an adjustment value of a wearable eyeglass from a posture image of a user, according to an exemplary embodiment. FIG. 51 is a flowchart of a method of detecting a gesture of a user by a wearable eyeglass, according to an exemplary embodiment. 52, 53 and 54 are schematic diagrams for explaining a method of determining an adjustment value for adjusting a display image based on a posture of a user, according to an exemplary embodiment. 55 and 56 are schematic diagrams illustrating a method of adjusting a display image of a wearable eyeglass based on a user's posture, in accordance with one or more exemplary embodiments. Figure 57 is a schematic illustration of a system in which an element displays an image via wearable glasses, in accordance with an exemplary embodiment. Figure 58 is a flow diagram of a method of displaying an image of an element via wearable glasses, in accordance with an exemplary embodiment. FIG. 59 is a flowchart of a method of displaying an image of an element via wearable glasses, according to an exemplary embodiment. 60 and 61 are block diagrams of wearable glasses in accordance with one or more exemplary embodiments. 62 and 63 are block diagrams of elements for displaying an image via wearable glasses, in accordance with one or more exemplary embodiments.

1000‧‧‧ wearable glasses

1030‧‧‧ display

1100‧‧‧Sensor unit

1200‧‧‧ processor

Claims (15)

A wearable eyewear, comprising: a display for displaying an image; a sensor for capturing wearable state information while displaying the image on the display, the wearable state information representing the user currently wearing the image a state of the wearable glasses; and a processor configured to determine an inclination of the wearable glasses relative to the user based on the captured wear status information, and adjust the position based on the determined inclination The image displayed on the display. The wearable eyewear of claim 1, wherein: the sensor is configured to capture the wear status information including information about a body part of the user; and the processor is configured to Comparing the captured wear status information with predetermined reference wear status information to determine the tilt of the wearable glasses relative to the user. The wearable spectacles of claim 2, wherein: the sensor is configured to capture the wearable state information including an image of the body part; and the processor is configured to be used from the body part The image detects an area corresponding to the body part, extracts a characteristic value from the detected area, and compares the captured characteristic value with a reference value included in the reference wear status information. Determine the slope. The wearable glasses of claim 1, wherein: the captured wear status information includes an eye image of the user's eyes wearing the wearable glasses; and the processor is configured to The eye image captures a length of a long axis of the eye of the user, a length of the minor axis of the eye, an angle of the major axis of the eye, and an angle of the minor axis of the eye And at least one of the position values of the iris, comparing the captured at least one value with at least one predetermined reference value, and determining the inclination based on a result of the comparing. The wearable spectacles of claim 1, wherein: the display is configured to display a test image; the sensor is configured to capture the wear status information, and the wear status information includes reflecting the test image An image of the eye of the user's eye; and the processor is configured to detect an area corresponding to the eye of the user from the eye image, and obtain the test image corresponding to the eye Reflecting a reflected image in the detected area, and comparing at least one of a size and a shape of the obtained reflected image with predetermined reference wear status information, and determining the tilt based on a result of the comparing . The wearable spectacles of claim 1, wherein the sensor is used to obtain a state value representative of a state of movement of the wearable spectacles and when the obtained state value is equal to or greater than a predetermined value 撷Take the wear status information. The wearable glasses of claim 1, wherein: the processor is configured to determine whether the determined inclination is equal to or greater than a predetermined value; and when the processor determines that the determined inclination is less than the The predetermined value is used by the processor to control the display to display the adjusted image obtained based on the determined tilt; and when the processor determines that the determined tilt is equal to or greater than the predetermined The processor is configured to control the display to display an image to notify the user to adjust the wearable glasses. A method for displaying an image via wearable glasses, the method comprising: displaying an image on a display of the wearable eyeglass; capturing wearable state information, the wearable state information representing a state in which the wearer currently wears the wearable eyewear Determining an inclination of the wearable glasses relative to the user based on the captured wear status information; and adjusting the image displayed on the display based on the determined inclination. The method of displaying an image via wearable glasses according to claim 8, wherein: the step of capturing the wearable state information comprises: extracting the information including information about a body part of the user Wearing the status information; and the determining the inclination comprises: determining the wearable glasses relative to the user by comparing the captured wear status information with predetermined reference wear status information Describe the inclination. The method for displaying an image via wearable glasses according to claim 9 , wherein: the step of capturing the wear status information comprises: capturing the wear status information including an image of the body part; And the step of determining the inclination comprises: detecting an area corresponding to the body part from the image of the body part, extracting a characteristic value from the detected area, and extracting the characteristic value The characteristic value is compared with a reference value included in the reference wear status information to determine the inclination. The method of displaying an image via wearable glasses according to claim 8, wherein: the wear status information includes an eye image of an eye of the user who is wearing the wearable eyeglass; and the determining The step of describing the inclination includes: extracting a length of a long axis of the eye of the user from the eye image, a length of a minor axis of the eye, an angle of the long axis of the eye, the At least one of an angle of the minor axis of the eye, and a position value of the iris, comparing the captured at least one value with at least one predetermined reference value, and determining the result based on the result of the comparing Tilt. The method for displaying an image via the wearable glasses according to claim 8 , wherein: the step of displaying the image comprises: displaying a test image; and the step of capturing the wear status information comprises: capturing The wear status information includes an eye image of the eye of the user reflecting the test image; and the determining the tilt includes: detecting the image from the eye a region corresponding to the eye of the user, obtaining a reflection image of the test image in the detected region corresponding to the eye, and at least one of a size and a shape of the reflected image and a predetermined reference The wear status information is compared, and the tilt is determined based on the result of the comparison. The method for displaying an image via wearable glasses according to claim 8 , wherein the step of capturing the wear status information comprises: obtaining a status value representative of a movement state of the wearable glasses; The wear status information is retrieved when the obtained status value is equal to or greater than a predetermined value. The method for displaying an image via wearable glasses according to claim 8 , wherein the step of adjusting the image comprises: determining whether the determined inclination is equal to or greater than a predetermined value; When the determined inclination is equal to or greater than the predetermined value, an image is displayed to notify the user to adjust the wearable glasses; and if the determined inclination is less than the predetermined value according to the determination, The image displayed on the display is then adjusted based on the determined tilt. A non-transitory computer readable storage medium, the non-transitory computer readable storage medium having at least one program included, the at least one program including a command for executing a method of displaying an image via the wearable glasses, The method includes: displaying an image provided by the wearable glasses; capturing wear status information, wherein the wear status information represents a state in which the user currently wears the wearable glasses; and based on the captured wear status information Determining the inclination of the wearable glasses with respect to the user; and displaying the obtained adjusted image based on the determined inclination.