WO2019205575A1 - 用于控制增强现实设备的显示的方法、系统、控制设备和增强现实设备 - Google Patents

用于控制增强现实设备的显示的方法、系统、控制设备和增强现实设备 Download PDF

Info

Publication number
WO2019205575A1
WO2019205575A1 PCT/CN2018/114680 CN2018114680W WO2019205575A1 WO 2019205575 A1 WO2019205575 A1 WO 2019205575A1 CN 2018114680 W CN2018114680 W CN 2018114680W WO 2019205575 A1 WO2019205575 A1 WO 2019205575A1
Authority
WO
WIPO (PCT)
Prior art keywords
color
user
display mode
augmented reality
information
Prior art date
Application number
PCT/CN2018/114680
Other languages
English (en)
French (fr)
Inventor
陈彦均
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US16/338,521 priority Critical patent/US11448875B2/en
Publication of WO2019205575A1 publication Critical patent/WO2019205575A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/02—Subjective types, i.e. testing apparatus requiring the active assistance of the patient
    • A61B3/06—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for testing light sensitivity, e.g. adaptation; for testing colour vision
    • A61B3/066—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for testing light sensitivity, e.g. adaptation; for testing colour vision for testing colour vision
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/197—Matching; Classification
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2012—Colour editing, changing, or manipulating; Use of colour codes

Definitions

  • the present disclosure relates to the field of display technologies, and in particular, to a method, system, control device, and augmented reality device for controlling display of an augmented reality device.
  • Augmented Reality (AR) technology can calculate the real-world image captured by the camera or the position and angle of the user in real time, and correspondingly simulate virtual images, videos or sounds, etc. Information is integrated into and interacts with the real world.
  • augmented reality technology is increasingly applied to various industries. For example, in the field of education, augmented reality technology can provide users with a special learning space to visualize and visualize abstract learning content. In the medical field, augmented reality technology can be used to assist doctors in accurately positioning the surgical procedure; Simulation training can be performed through augmented reality technology; in the field of games or entertainment, virtual reality can be achieved through augmented reality technology.
  • the present disclosure provides a method for controlling display of an augmented reality device.
  • the method includes: the control device queries, from a preset data set, color sensitivity information corresponding to the identity information of the acquired user of the augmented reality device; and the control device determines, according to the queried color sensitivity information, whether the user is color recognition. a patient with an obstacle; the control device acquires a personalized color display mode corresponding to the color sensitivity sensitivity information as a target color display mode when determining that the user is a color recognition disorder patient; and the control device provides the augmented reality device to the augmented reality device
  • the target color display mode causes the augmented reality device to perform image display using the target color display mode.
  • the method further includes: the control device acquiring identity information of the user collected by the augmented reality device; and the control device querying to determine whether the preset data set is Includes the identity information of the collected users.
  • the control device queries the collected identity information of the user
  • the control device queries the color sensitivity information corresponding to the collected identity information of the user from the preset data set.
  • the method further includes: when the control device does not query the collected identity information of the user from a preset data set, the control device initiates a color sensitivity test on the user to obtain Color sensitivity information corresponding to the user's identity information.
  • the control device determines whether the user is a color recognition disorder patient based on the color vision sensitivity information obtained by the test.
  • the control device stores the collected identity information of the user and the color vision sensitivity information obtained by the test in the data set in association with each other.
  • the method before the providing the target color display mode to the augmented reality device, the method further includes: acquiring ambient brightness information and user view environment color information detected by the augmented reality device; according to the color vision sensitivity information, The ambient brightness information and the user view environment color information generate a compensation parameter for each sub-pixel in the image; the data signal of each sub-pixel is compensated according to the compensation parameter of each sub-pixel, and the compensated a data signal; and providing the compensated data signal to the augmented reality device along with the target color display mode to cause the augmented reality device to adopt the target color display mode to perform image display based on the compensated data signal .
  • the generating the compensation parameter of each sub-pixel comprises: the control device generating, for each pixel in the image, according to the color vision sensitivity information, the ambient brightness information, and the user view environment color information. Data signal target value.
  • Each pixel includes a plurality of sub-pixels.
  • the control device generates a compensation parameter for each sub-pixel based on the data signal target value of each pixel.
  • the acquiring the personalized color display mode corresponding to the color sensitivity information includes: the control device instructing the augmented reality device to output multiple options of the personalized color display mode corresponding to the color sensitivity information So that the user can determine whether the personalized color display mode desired by the user is included in the plurality of options. If yes, obtaining a personalized color display mode determined by the user; if not, the control device instructs the augmented reality device to output another plurality of options of the personalized color display mode corresponding to the color sensitivity information, So that the user can continue to perform the determining step.
  • the method further includes: when determining that the user is not a color recognition obstacle patient, the control device acquires a standardized color display mode corresponding to the color vision sensitivity information as a target color display mode.
  • the present disclosure provides a control device.
  • the control device includes a query module, configured to query color vision sensitivity information corresponding to the identity information of the acquired user of the augmented reality device from the preset data set, and the determining module is configured to determine, according to the queried color sensitivity information Whether the user is a color recognition disorder patient; and a color mode acquisition module, configured to acquire a personalized color display mode corresponding to the color vision sensitivity information when the determining module determines that the user is a color recognition disorder patient.
  • the target color display mode is provided, and the target color display mode is provided to the augmented reality device to cause the augmented reality device to perform image display using the target color display mode.
  • the querying module is further configured to obtain the identity information of the user collected by the augmented reality device, query and determine whether the pre-set data set includes the identity information of the collected user, and query When the identity information of the user is collected, the color sensitivity information corresponding to the collected identity information of the user is queried from a preset data set.
  • the query module starts a color sensitivity test on the user when the collected identity information of the user is not queried to obtain color sensitivity sensitivity information corresponding to the identity information of the user; and the determining module further The color vision sensitivity information obtained based on the test is used to determine whether the user is a color recognition disorder patient.
  • the control device further includes a storage module, configured to store the preset data set, and configured to store the collected user identity information and the tested color sensitivity information in association with the data set.
  • control device further includes a compensation module, configured to generate, for each sub-pixel in the image, according to the color vision sensitivity information and the ambient brightness information and the user view environment color information detected by the augmented reality device. a compensation parameter; compensating a data signal of each sub-pixel according to a compensation parameter of each sub-pixel to generate a compensated data signal; and providing the compensated device to the augmented reality device along with the target color display mode
  • the data signal is such that the augmented reality device adopts the target color display mode to perform image display based on the compensated data signal.
  • the color mode acquiring module is further configured to: when the determining module determines that the user is not a color recognition obstacle patient, acquire a standardized color display mode corresponding to the normal color display as the target color display mode.
  • the present disclosure provides an augmented reality device.
  • the augmented reality device includes a display module for displaying an image according to a color display mode, and a display mode setting module for setting a color display mode for the display module, the color display mode being included in a user of the augmented reality device At least one personalized color display mode in the case of a color recognition disorder patient and a standard color display mode in the case where the user is a normal color recognizer.
  • the display mode setting module is configured to receive a target color display mode from the control device and set it to a color display mode for the display module, the target color display mode corresponding to a color sensitivity of the user of the augmented reality device information.
  • the augmented reality device further includes an identity information acquiring module, configured to collect identity information of the user, and provide the collected identity information of the user to the control device, so that the control device can be based on the collected user.
  • the identity information is used to query the color sensitivity information corresponding thereto.
  • the augmented reality device further includes a detecting module, configured to detect ambient brightness information and user view environment color information, and provide the detected information to the control device to enable the control device to be based on the color sensitivity
  • the information as well as the ambient brightness information and the user view environment color information generate a compensated data signal for each sub-pixel of the image.
  • the display module is further configured to perform image display based on the compensated data signal by using the received target color display mode.
  • the detecting module includes an ambient brightness sensor for sensing ambient brightness information, and a visual field environment color sensor for sensing user view environment color information.
  • the augmented reality device comprises augmented reality glasses as a body.
  • the augmented reality glasses include a frame and a lens disposed on the frame.
  • the display module, the display mode setting module, the identity information acquiring module, and the detecting module are all disposed on the frame
  • the present disclosure provides an augmented reality processing system comprising: the above control device and the augmented reality device described above.
  • the present disclosure provides an augmented reality device.
  • the augmented reality device includes: the above control device and a display module for displaying an image in a color display mode.
  • the color mode acquisition module sets a color display mode for the display module based on the target color display mode.
  • the present disclosure provides a computer storage medium.
  • the computer storage medium contains instructions that, when executed by a processor, enable the processor to implement the methods described above.
  • FIG. 1 is a flowchart of an augmented reality processing method according to an embodiment of the present disclosure
  • FIG. 2 is a flowchart of another augmented reality processing method according to an embodiment of the present disclosure
  • FIG. 3 is a flowchart of still another augmented reality processing method according to an embodiment of the present disclosure
  • FIG. 4 is a schematic structural diagram of a control device according to an embodiment of the present disclosure.
  • FIG. 5 is a schematic structural diagram of an augmented reality device according to an embodiment of the present disclosure.
  • FIG. 6 is a schematic diagram of another augmented reality device according to an embodiment of the present disclosure.
  • FIG. 7 is a schematic structural diagram of an augmented reality processing system according to an embodiment of the present disclosure.
  • Color-recognition disorders refer to the loss or dysfunction of one or more cones in the human eye, resulting in the inability to distinguish between symptoms of some, some, or all of the colors in the natural spectrum.
  • the absence of two or more types of cones can result in full color blindness, i.e., only monochromatic perception. If the photosensitive spectrum of one or several of the cones is shifted or incomplete, it will cause color weakness. These can lead to a reduction in the patient's color resolution.
  • color recognition disorders can include color blindness or color weakness.
  • Color blindness may include full color blindness or partial color blindness, and partial color blindness may include red blindness, green blindness or yellow-blue blindness.
  • the color weakness may include weak or partially weak color, and partial color weakness may include weak red, weak green or yellowish blue. As is known, the variety of color recognition disorders can be varied.
  • the color perception sensitivity information can be used to identify the type of color recognition disorder or to identify the user as a colorlessness disorder, ie, a normal color recognizer.
  • the color recognition disorder patient and the normal color recognizer can be distinguished by acquiring the color vision sensitivity information.
  • the color vision sensitivity information can include the sensitivity of each cone to the visible spectrum.
  • the color recognition obstacle patient can also easily recognize the information displayed by the augmented reality device. This greatly improves the user experience.
  • FIG. 1 is a flowchart of a method for displaying augmented reality device according to an embodiment of the present disclosure. As shown in Figure 1, the method includes:
  • Step 101 The control device queries, from the preset data set, color sensitivity information corresponding to the acquired identity information of the user.
  • This user is a user of the augmented reality device.
  • the control device may acquire biometric data of the user from the augmented reality device, including but not limited to iris information, face information, fingerprint information, and the like.
  • the control device may also obtain the user's user identifier, such as a username, from the augmented reality device.
  • the data set may be pre-set via registration by the user to the control device or the augmented reality device.
  • the data set may be pre-set by collecting identity information and corresponding color sensitivity information input by the user when registering as a user of the augmented reality device.
  • the data set can also be updated each time a new user uses the augmented reality device.
  • the pre-set data set may be stored locally in the control device or may be stored on a remote device accessible to the control device.
  • Step 102 The control device determines, according to the color sensitivity information corresponding to the identity information of the user (ie, the queried), whether the user is a color recognition disorder patient.
  • the color sensitivity sensitivity information may include the sensitivity of each of the user's cone cells to the visible spectrum. Based on the sensitivity of each cone to the visible spectrum, it can be determined whether the user is a color recognition disorder patient and/or a color recognition disorder. For example, if the color vision sensitivity information indicates that the user is less sensitive to the red region of the spectrum, the user may be a red blind patient.
  • Step 103 If it is determined in step 102 that the user is a color recognition disorder patient, the control device acquires a personalized color display mode corresponding to the color recognition disorder indicated by the color vision sensitivity information as the target color display mode.
  • different color recognition disorder types may correspond to different personalized color display modes.
  • color correction such as differential coloring, color filtering, or associating unrecognizable colors with other visual indicators such as cross-hatching. situation.
  • a red blind user its corresponding red blind color display mode may be to correct red to a color that is recognizable by the user to be near red.
  • Step 104 The control device provides the personalized color display mode (that is, the target color display mode adapted to the color recognition disorder of the user) to the augmented reality device to enable the augmented reality device to perform image display using the personalized color display mode.
  • the control device may transmit a control command including the personalized color display mode to the augmented reality device to instruct the augmented reality device to perform image display in accordance with the personalized color display mode.
  • the AR image display can be performed by the personalized color display mode.
  • Step 105 If it is determined in step 102 that the user is not a color recognition disorder patient, the control device acquires a normalized color display mode that presents a normal color as the target color display mode.
  • the standardized color display mode is a color display mode in which color correction for color recognition obstacles is not performed.
  • Step 106 The control device provides the standardized color display mode to the augmented reality device to cause the augmented reality device to perform image display through the standardized color display mode, and the process ends.
  • the AR image display can be performed by the standardized color display mode.
  • the control device determines that the user is a color recognition disorder patient according to the color vision sensitivity information
  • the augmented reality device is controlled to adopt a color recognition obstacle corresponding to each color recognition obstacle.
  • the personalized color display mode is used for image display, which avoids the situation that the color recognition disorder patient cannot recognize the AR information, thereby improving the user experience.
  • logic flow may be implemented by using one or more hardware units and/or software units of the described embodiments, or as desired replacement units for a given set of design and performance constraints.
  • a logic flow can be implemented as logic (eg, computer program instructions) for execution by a logical device (eg, a general purpose or special purpose computer).
  • FIG. 2 is a flow chart of another method provided by an embodiment of the present disclosure. As shown in Figure 2, the method includes:
  • Step 201 The augmented reality device collects identity information of the user.
  • the identity information of the user may include iris information of the user. Since the iris information of each user is different, each user's iris information can be used to uniquely identify the user's identity.
  • the collected user's identity information may also include other types of biometric data of the user, including but not limited to fingerprints, faces, and the like.
  • Step 202 The control device acquires identity information of the user collected by the augmented reality device, and queries to determine whether the collected identity information is included in the preset data set.
  • a data set may be preset, in which different user identity information is stored. For example, each time the user uses the augmented reality device, the identity information of the user may be collected, and the collected identity information of the user is stored in the data set. Alternatively, the user may be pre-registered before the user uses the augmented reality device to store the user's identity information in the data set. Exemplarily, the user may perform multiple iris information sampling by the iris recognition technology to acquire the iris information of the user, and store the collected iris information of the user as the identity information of the user into the data set. Alternatively, the data set may include multiple types of identity information corresponding to a certain user.
  • the query can include comparing the collected identity information to the identity information stored in the data set. When the identity information matching the collected identity information exists in the data set, it is determined that the identity information of the user is included in the data set.
  • Step 203 If it is determined in step 202 that the collected identity information is included in the preset data set, the control device queries the color vision sensitivity information corresponding to the collected identity information from the preset data set.
  • the color sensitivity information of different users is also stored in the preset data set, and each color sensitivity information corresponds to the identity information of the user.
  • color vision sensitivity information of different users may be acquired or tested in advance, and color sensitivity sensitivity information of different users is stored in the data set.
  • Step 204 If it is determined in step 202 that the collected identity information is not included in the data set, the control device may initiate a color sensitivity test on the user to obtain color sensitivity information of the user.
  • the color sensitivity test can include a quantitative test of the user's image color resolution.
  • the control device can perform a color vision sensitivity test through the augmented reality device.
  • the augmented reality device can display a color vision test map to the user for color sensitivity test.
  • the picture of the color vision test chart may be an AR display picture.
  • the user can provide feedback on the color vision test picture by touch or voice. Based on the feedback, the test result about the color sensitivity can be determined.
  • the augmented reality device outputs the test result to the control device, and the control device obtains the color vision sensitivity information of the user according to the test result.
  • control device may also display the color vision test chart screen through other display devices, and determine the test result based on the feedback of the user on the color vision test chart screen.
  • the control device obtains the color sensitivity information of the user according to the test result.
  • hue test methods can also be used to test excellent sensitivity information.
  • the Munsell hue test color chess test excellent sensitivity information.
  • the control device acquires the detected color sensitivity information.
  • control device may store the collected user's identity information in association with the color sensitivity sensitivity information of the user obtained via the color vision test into the data set.
  • Step 205 The control device determines, according to the color perception sensitivity information, whether the user is a color recognition disorder patient.
  • whether the user is a color recognition disorder patient can be determined based on the sensitivity of each cone cell included in the color vision sensitivity information to the visible spectrum. Further, the type and degree of the color recognition obstacle of the user and the like can be determined based on the color perception sensitivity information.
  • Step 206 If the user is a color recognition obstacle patient, the control device acquires the personalized color display mode corresponding to the color vision sensitivity information as the target color display mode.
  • a color recognition disorder type corresponding to the color perception sensitivity information and optionally a personalized color display mode corresponding to the degree can be acquired.
  • Step 207 If the user is not a color recognition disorder patient, that is, a normal color recognizer, the control device acquires a standardized color display mode corresponding to the normal color display as the target color display mode.
  • the color display mode of the augmented reality device includes a standardized color display mode and one or more personalized color display modes.
  • image display can be performed by a standardized color display mode.
  • images can be displayed in a personalized color display mode.
  • Both the standardized color display mode and the personalized color display mode can be set in advance.
  • a corresponding personalized color display mode can be set for each type of color recognition disorder.
  • the personalized color display mode can be implemented by establishing a gamma curve for display corresponding to different types of color recognition obstacles.
  • the personalized color display mode can be obtained by learning in advance the color display effects desired by different types of color recognition disorders patients.
  • the personalized color display mode corresponding to the red blind can be acquired from the preset personalized color display mode.
  • the personalized color display mode corresponding to the red blind performs appropriate color correction on the red color and is suitable for use when displaying images for a red blind patient.
  • the personalized color display mode is also considered in view of the fact that a color-recognition disorder patient or other individual may have a higher sensitivity to a certain color, a faster response, or a personal preference for certain colors. It can be a color display mode that chooses the color of the color.
  • color matching is crucial in the fusion of virtual display content and the real world.
  • the virtual display may be caused due to the contrast reduction.
  • the content is difficult to distinguish or increase the resolution time. If the user is in the process of high speed travel at this time, it is very likely to cause an accident. Therefore, it may be desirable to perform real-time color compensation in combination with ambient brightness, ambient color, and user color recognition.
  • a method in accordance with an embodiment of the present disclosure may further include the following steps.
  • Step 208 The augmented reality device detects the ambient brightness information and the user view environment color information.
  • the ambient brightness information and the user view environment color information may all be detected in real time.
  • Step 209 The control device generates a compensation parameter for each sub-pixel in the image to be displayed according to the color vision sensitivity information, the ambient brightness information, and the user visual environment color information.
  • the control device may generate a data signal target value for each pixel in the image based on one or more of color vision sensitivity information, ambient brightness information, and user field environment color information.
  • Each pixel includes a plurality of sub-pixels.
  • each pixel may include a red (R) sub-pixel, a green (G) sub-pixel, and a blue (B) sub-pixel.
  • the control device can generate a compensation parameter for each of its sub-pixels based on the data signal target value of each pixel.
  • Step 210 The control device compensates the data signal of each sub-pixel according to the compensation parameter of each sub-pixel to generate a compensated data signal.
  • the compensation parameters for each sub-pixel can be added to the data signal of each sub-pixel to derive a compensated data signal for each sub-pixel.
  • the brightness of each of the red, green, and blue sub-pixels can be adjusted by compensating for the sub-pixel's data signal.
  • Step 211 The augmented reality device adopts a target color display mode, and uses the compensated data signal to perform image display, and the process ends. Color correction of the image can be achieved by performing image display using the compensated data signal.
  • steps 208-211 are optional.
  • the augmented reality device can directly perform image display upon receiving a target color display mode from the control device.
  • the augmented reality device performs image display using the personalized color display mode corresponding to the color sensitivity information. This avoids the situation that the color recognition disorder patient cannot recognize the AR information, and can effectively improve the sensory experience of different individuals and the accuracy of information recognition, thereby improving the user experience.
  • the color compensation correction of the display image is implemented based on the color vision sensitivity information, the ambient brightness information, and the user visual environment color information, thereby effectively avoiding the user's visual field color along with the real environment during use. Change, and at some specific moments, the background and foreground colors cannot be distinguished, thereby achieving the situation of mitigating or even avoiding the user's observation of obstacles or confusion.
  • FIG. 3 is a flowchart of still another method according to an embodiment of the present disclosure. As shown in FIG. 3, the method includes:
  • Step 301 The augmented reality device collects identity information of the user.
  • the user's identity information may include the user's iris information.
  • Step 302 The control device queries and determines whether the collected identity information is included in the preset data set.
  • Step 303 If it is determined that the collected identity information is not included in the preset data set, the augmented reality device collects the identity information of the user again.
  • the user may be subjected to multiple iris sampling by iris recognition techniques to acquire multiple samples of the user's iris.
  • the user if it is determined that the collected identity information is not included in the preset data set, the user is prompted to perform multiple iris information collection.
  • the collected iris information of the user is stored as the identity information of the user. By realizing the re-acquisition of the iris information, the iris sample can be accurately collected.
  • Step 304 The control device initiates a color sensitivity test on the user, and obtains color sensitivity information corresponding to the collected identity information.
  • the user can be subjected to a standard color blind test to test their color recognition capabilities and color sensitivity.
  • the control device can directly input the color sensitivity information from the user.
  • the control device can present a plurality of options for color recognition disorders to the user on the user interface and obtain a user selection of the relevant options to obtain color perception sensitivity information corresponding to the user.
  • the options presented may include: normal color vision, red blind/colored weak, green blind/colored weak, yellow blue blind/colored weak, and the like. Additionally, the presented options may also include: performing a color vision test and initiating the color vision test when the user selects an option to perform a color vision test.
  • Step 305 The control device may store the collected identity information of the user and the obtained color sensitivity information in association with the data set.
  • Step 306 If it is found in step 302 that the identity information of the user is included in the data set, the control device queries the color sensitivity information corresponding to the identity information of the user from the preset data set.
  • Step 307 The control device determines, according to the obtained or queried color sensitivity information, whether the user is a color recognition disorder patient.
  • the color vision sensitivity information includes the sensitivity of each cone to the visible spectrum. According to the sensitivity of each cone to the visible spectrum, it can be judged whether the user is a color recognition disorder patient.
  • Step 308 when it is determined in step 307 that the user is a color recognition disorder patient, the augmented reality device may output a plurality of options of the personalized color display mode corresponding to the color sensitivity information. Each option can correspond to a different color scheme.
  • control device outputs a control command to the augmented reality device to control the enhanced reality device to display a color mode screen corresponding to each option, the color mode screen being an AR display screen.
  • the augmented reality device may output a color mode screen including a plurality of options for the personalized color display mode corresponding to the color sensitivity information.
  • Step 309 Determine whether a personalized color display mode desired by the user is included in the plurality of options.
  • a particular color mode screen corresponding to each option may be presented to the user, feedback from the user for each color mode screen is received, and the determination is made based on the feedback.
  • the feedback may be a rating of the user's color satisfaction with each color mode screen.
  • a rating threshold eg, 8
  • the color display corresponding to the color mode screen can be determined.
  • the mode is the personalized color display mode desired by the user. When the user does not reach the rating threshold for all the color mode screens, it can be determined that the personalized color display mode desired by the user is not included in the plurality of options.
  • the feedback can also be a simple "yes” or “no.”
  • the received feedback is “Yes” it indicates that the color mode screen is desired by the user, and when the received feedback is "No", it indicates that the user cannot accept the color mode screen.
  • the user can provide the feedback through control devices or input devices of the augmented reality device, including but not limited to buttons, touch pads, microphones, and the like.
  • the user may indicate that the plurality of options include a personalized color display mode desired by the user by touching a color display mode option corresponding to the color mode screen that is satisfactory when viewing the color mode screen.
  • Step 310 If it is determined that the personalized color display mode desired by the user is not included in the plurality of options, the control device outputs another plurality of options of the personalized color display mode corresponding to the color sensitivity information through the augmented reality device for the user to select. And continue to step 309.
  • a new color mode screen may be output that includes a plurality of additional options for the personalized color display mode corresponding to the color sensitivity information.
  • Step 311 if it is determined that the personalized color display mode desired by the user is included in the plurality of options, the augmented reality device outputs the personalized color display mode desired by the user to the control device, and the control device displays the personalized color based on the user desire The mode determines a personalized color display mode as the target color display mode.
  • Step 312 when it is determined in step 307 that the user is not a color recognition disorder patient, the control device acquires the standardized color display mode as the target color display mode.
  • Step 313 The augmented reality device performs image display by using the target color display mode, and the process ends.
  • the data signal is compensated according to steps 208-211 in FIG. 2, and the compensated data signal is used for image display.
  • FIG. 4 is a schematic structural diagram of a control device according to an embodiment of the present disclosure. As shown in FIG. 4, the control device includes: a first query module 11, a judgment module 12, and a color mode acquisition module 13.
  • the first query module 11 is configured to query, from a preset data set, color sensitivity information corresponding to the acquired identity information of the user.
  • the determining module 12 is configured to determine, according to the color sensitivity information corresponding to the identity information of the user, whether the user is a color recognition disorder patient.
  • the color mode acquisition module 13 is configured to acquire a personalized color display mode corresponding to the color sensitivity information as the target color display mode, and provide the target to the augmented reality device, when the determining module 12 determines that the user is a color recognition disorder patient.
  • the color display mode causes the augmented reality device to perform image display using the target color display mode.
  • control device further includes: a second query module 14.
  • the second query module 14 is configured to obtain identity information of the user collected by the augmented reality device.
  • the second query module 14 is further configured to query to determine whether the identity information of the user acquired by the augmented reality device is included in the preset data set. If the collected identity information is included in the pre-set data set, the first query module 11 is triggered to use the queried identity information to query the color sensitivity corresponding to the collected user identity information from the preset data set. information.
  • the second query module 14 may instruct/trigger the augmented reality device to collect the user's identity information again.
  • the first query module 11 can initiate a color vision sensitivity test for the user.
  • the first query module 11 can instruct/trigger the augmented reality device to perform the color sensitivity test, including displaying the color vision test map and receiving feedback from the user on the color vision side view.
  • first and second query modules 14 can be separate query modules or can be implemented by an integrated query module.
  • the control device also includes a storage module 15.
  • the storage module 15 is configured to store the data set.
  • the storage module 15 may store the identity information of the user collected by the augmented reality device and the color perception sensitivity information corresponding to the identity information of the user that is obtained by the test, that is, in one-to-one correspondence into the data set.
  • the first query module 11 may acquire the data set from the storage module 15 to query the color sensitivity information of the user based on the identity information.
  • the determination module 12 can receive the queried or tested color sensation sensitivity information from the first query module 11 and determine based on whether the user is a color recognition disorder patient.
  • control device further includes: a compensation module 16.
  • the compensation module 16 is configured to generate a compensation parameter for each sub-pixel in the image according to the color vision sensitivity information and the ambient brightness information and the user view environment color information detected by the augmented reality device;
  • the sub-pixel data signals are compensated to generate a compensated data signal, and the compensated data signal is provided to the augmented reality device along with the target color display mode to enable the augmented reality device to adopt a personalized color display mode
  • the image is displayed based on the compensated data signal.
  • the color mode obtaining module 13 is further configured to: when the determining module 12 determines that the user is not a color recognition obstacle patient, acquire a standardized color display mode corresponding to the normal color display as the target color display mode, for the augmented reality device to adopt The standardized color display mode is used for image display.
  • control device can be a host computer.
  • the control device provided in this embodiment avoids the color recognition obstacle by selecting the personalized color display mode corresponding to the color vision sensitivity information for the enhanced display device when the user is determined to be a color recognition obstacle according to the color sensitivity information. Patients can not recognize the AR information, which improves the user experience.
  • FIG. 5 is a schematic structural diagram of an augmented reality device according to an embodiment of the present disclosure.
  • the augmented reality device can be used with a control device in accordance with an embodiment of the present disclosure, such as the control device described in connection with FIG.
  • the augmented reality device includes a display module 21 and a display mode setting module 22.
  • the display module 21 is for displaying an image in a color display mode.
  • the display mode setting module 22 is configured to set a color display mode for the display module 21, where the color display mode includes at least one personalized color display mode in a case where the user of the augmented reality device is a color recognition disorder patient and A standard color display mode in the case where the user is a normal color recognizer.
  • the display mode setting module 22 is configured to receive a target color display mode from the control device and set a color display mode for the display module 21 based thereon.
  • the target color display mode corresponds to color vision sensitivity information of a user of the augmented reality device.
  • the control device may query the color vision sensitivity information corresponding to the acquired identity information of the user from the preset data set, and determine whether the user is a color recognition disorder patient according to the color sensitivity sensitivity information corresponding to the identity information of the user. If it is determined that the user is a color recognition disorder patient, a personalized color display mode corresponding to the color perception sensitivity information is acquired.
  • the augmented reality device further includes an identity information acquiring module 23.
  • the identity information obtaining module 23 is configured to collect identity information of the user. The collected identity information can be provided to the control device for querying the color sensitivity information.
  • the identity information acquisition module 23 may collect biometric data of the user.
  • the identity information acquisition module 23 is an optical sensor or camera to capture images such as irises or faces. Additionally or alternatively, the identity information acquisition module 23 may also be a flat panel sensor for collecting fingerprints or palm prints and the like.
  • the augmented reality device further includes a detection module 24.
  • the detecting module 24 is configured to detect ambient brightness information and user view environment color information.
  • the detected ambient brightness information and user field environment color information may be provided to the control device to cause the control device to generate a compensation parameter for each sub-pixel of the image based on the color perception sensitivity information and the ambient brightness information and the user view environment color information.
  • the compensated data signal is generated by compensating the data signal of each sub-pixel according to the compensation parameter of each sub-pixel.
  • the display module 21 can adopt a personalized color display mode to perform image display based on the compensated data signal.
  • the detection module 24 includes an ambient brightness sensor 241 and a field of view environment color sensor 242.
  • the ambient brightness sensor 241 is used to sense ambient brightness information.
  • the field of view environment color sensor 242 is used to sense the user's field of view environment color information.
  • the field of view ambient color sensor 242 can be a camera or a device with a camera.
  • the display module 21 is further configured to output, under the control of the control device, a plurality of options of the personalized color display mode corresponding to the color sensitivity information, so that the user determines whether the plurality of options include the personalized color display desired by the user. mode. If yes, the user determines a personalized color display mode from the plurality of personalized color display modes corresponding to the color sensitivity information; if not, the display module 21 outputs another plurality and the control under the control of the control device.
  • the color sensitivity information corresponds to an option of the personalized color display mode for the user to continue performing the determination.
  • the display module 21 may output a plurality of color mode screens. These color mode screens correspond to the options for each individualized color display mode.
  • the user may select a personalized color display mode from a plurality of options of the personalized color display mode corresponding to the color sensitivity information by touch when viewing the color mode screen.
  • display module 21 may also display based on the compensated data signal from the control device.
  • the identity information obtaining module 23 may further provide the collected identity information of the user to the control device for performing the query of the color vision sensitivity information.
  • the ambient brightness detection module 241 and the field of view environment detection module 242 may also provide the detected brightness information and color information to the control device for compensation of the data.
  • FIG. 6 is a schematic diagram of another augmented reality device according to an embodiment of the present disclosure.
  • the augmented reality device includes a body 21 and a display assembly 22.
  • the display component 22 includes a display module 221 and a display mode setting module 222.
  • the augmented reality device is an AR glasses
  • the body 21 includes a frame 211 and a lens 212 disposed on the frame 211.
  • the display module 221, the display mode setting module 222, the identity information acquiring module 23, and the detecting module 24 are all located on the frame 211.
  • the display module 221 and the display mode setting module 222 may be located inside the frame 211.
  • the display module 221 can be located inside the temple of the frame 211.
  • the display module 221 and the display mode setting module 222 may alternatively be located outside the frame 211 or at any other suitable location of the local 21.
  • the identity information acquiring module 23 is located outside the frame 211.
  • the number of identity information acquisition modules 23 can be two.
  • Each identity information acquisition module 23 is located on a mirror ring of the frame 211.
  • the lens is placed in the mirror ring.
  • the identity information of the user includes the iris information of the user.
  • the identity information obtaining module 23 may include a camera or a device equipped with a camera, and the camera directly acquires a human eye pupil pattern to identify the user's iris information.
  • the identity information acquiring module 23 may also be disposed inside the frame 211. At this time, the identity information acquiring module 23 can acquire the iris image of the user by using the same optical path as the AR virtual display to identify the iris information of the user, which is not specifically shown in the figure. It will be appreciated that in some embodiments, the augmented reality device may also include a haptic interface or other accessory for use with the AR glasses, and the identity information acquisition module 23 may be disposed in such an interface or accessory.
  • the detection module 24 is located outside of the frame 211.
  • the detection module 24 can be located at the bridge of the frame 211.
  • the display mode setting module 25 is located outside the frame 211.
  • the image display is performed by the personalized color display mode corresponding to the color sensitivity information, thereby avoiding color recognition obstacles. Patients can not recognize the AR information, which improves the user experience.
  • FIG. 6 is a schematic structural diagram of an augmented reality processing system according to an embodiment of the present disclosure. As shown in FIG. 6, the system includes a control device 1 according to an embodiment of the present disclosure and an augmented reality device 2 according to an embodiment of the present disclosure.
  • the control device 1 can be the control device described above in connection with FIG.
  • the augmented reality device 2 may be the augmented reality device described above in connection with FIG.
  • control device 1 and augmented reality device 2 may be communicatively coupled via various types of communication media.
  • the control device 1 and the augmented reality device 2 can coordinate operations with each other. Coordination can involve one-way or two-way exchange of information.
  • a component can communicate information in the form of a signal communicated over a communication medium.
  • additional embodiments may alternatively utilize data messages. Such data messages can be sent across various connections. Exemplary connections include parallel interfaces, serial interfaces, and bus interfaces.
  • control device may also be integrated into the augmented reality device.
  • the augmented reality device may include a control device according to an embodiment of the present disclosure and a display module for displaying an image in a color display mode.
  • the color mode acquisition module sets a color display mode for the display module based on the target color display mode.
  • the image display is performed by using the personalized color display mode corresponding to the color sensitivity information when the user is determined to be a color recognition obstacle according to the color sensitivity information. People with color recognition disorders cannot recognize the AR information, which improves the user experience.
  • Modes in various embodiments may be implemented by using hardware units, software units, or a combination thereof.
  • hardware units may include devices, components, processors, microprocessors, circuits, circuit components (eg, transistors, resistors, capacitors, inductors, etc.), integrated circuits, application specific integrated circuits (ASICs), programmable logic Devices (PLDs), digital signal processors (DSPs), field programmable gate arrays (FPGAs), memory cells, logic gates, registers, semiconductor devices, chips, microchips, chipsets, and more.
  • ASICs application specific integrated circuits
  • PLDs programmable logic Devices
  • DSPs digital signal processors
  • FPGAs field programmable gate arrays
  • memory cells logic gates, registers, semiconductor devices, chips, microchips, chipsets, and more.
  • Examples of software units may include software components, programs, applications, computer programs, applications, system programs, machine programs, operating system software, middleware, firmware, software modules, routines, subroutines, functions, methods, processes, Software interface, application programming interface (API), instruction set, calculation code, computer code, code segments, computer code segments, words, values, symbols, or any combination thereof. Determining whether an embodiment is implemented by using hardware units and/or software units may vary depending on any number of factors, such as desired computation rate, power level, heat resistance, processing period budget, input data rate, output data rate , memory resources, data bus speeds, and other design or performance constraints that are desirable for a given implementation.
  • Certain embodiments may include articles of manufacture.
  • the article of manufacture can include a storage medium for storing logic.
  • Examples of storage media may include one or more types of non-transitory computer readable storage media capable of storing electronic data, including volatile or nonvolatile memory, removable or non-removable memory, erasable Or non-erasable memory, writable or rewritable memory, and so on.
  • Examples of logic may include various software elements, such as software components, programs, applications, computer programs, applications, system programs, machine programs, operating system software, middleware, firmware, software modules, routines, subroutines, functions , method, process, software interface, application programming interface (API), instruction set, calculation code, computer code, code segment, computer code segment, word, value, symbol, or any combination thereof.
  • an article of manufacture may store executable computer program instructions that, when executed by a computer, cause the computer to perform the methods and/or operations in accordance with the described embodiments.
  • the executable computer program instructions can include any suitable type of code, such as source code, compiled code, interpreted code, executable code, static code, dynamic code, and the like.
  • the executable computer program instructions can be implemented in a predefined computer language, manner, or grammar for instructing a computer to perform certain functions. Instructions can be implemented using any suitable high level, low level, object oriented, visual, compiled, and/or interpreted programming language.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Multimedia (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Medical Informatics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Surgery (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Processing Or Creating Images (AREA)

Abstract

一种用于控制增强现实设备的显示的方法、系统、控制设备和增强现实设备。该方法包括：控制设备从预先设置的数据集合中查询出与获取的增强现实设备的用户的身份信息对应的色觉灵敏度信息；控制设备根据所查询出的色觉灵敏度信息判断所述用户是否是色彩识别障碍症患者；控制设备在判断出所述用户是色彩识别障碍症患者时，获取与所述色觉灵敏度信息对应的个性化色彩显示模式来作为目标色彩显示模式；和控制设备向该增强现实设备提供该目标色彩显示模式以使该增强现实设备采用该目标色彩显示模式进行图像显示。

Description

用于控制增强现实设备的显示的方法、系统、控制设备和增强现实设备
相关申请
本申请要求于2018年4月25日递交的中国专利申请No.201810378477.1的优先权，在此全文引用上述中国专利申请公开的内容作为本申请的一部分。
技术领域
本公开涉及显示技术领域，特别涉及一种用于控制增强现实设备的显示的方法、系统、控制设备和增强现实设备。
背景技术
增强现实(Augmented Reality，AR)技术作为一种视觉增强技术，能够实时地计算出摄像机捕获的现实世界影像或用户的位置和角度，且相应地将通过计算机模拟出的虚拟图像、视频或声音等信息融合到现实世界中去，并与之进行互动。随着中央处理器(Central Processing Unit，简称CPU)、图形处理器(Graphics Processing Unit，简称GPU)以及超计算机计算能力的不断提升，增强现实技术被越来越多地应用到各个行业。例如：在教育领域通过增强现实技术可以给用户提供一个特殊的学习空间，将抽象的学习内容可视化、形象化；在医疗领域，可以利用增强现实技术协助医生进行手术过程的精确定位；在军事领域，可以通过增强现实技术进行模拟训练；在游戏或者娱乐领域，可以通过增强现实技术虚拟真实对战感等。
但是，相关技术中若色彩识别障碍症患者采用AR系统时，会出现无法识别AR信息的情况，从而降低了用户的使用体验。
发明内容
在一个方面，本公开提供了一种用于控制增强现实设备的显示的方法。该方法包括：控制设备从预先设置的数据集合中查询出与获取的增强现实设备的用户的身份信息对应的色觉灵敏度信息；控制设备根据所查询出的色觉灵敏度信息判断所述用户是否是色彩识别障碍症患者；控制设备在判断出所述用户是色彩识别障碍症患者时，获取与所述色觉灵敏度信息对应的个性化色彩显示模式来作为目标色彩显示模式；和控制设备向该增强现实设备提供该目标色彩显示模式以使该增强现实设备采用该目标色彩显示模式进行图像显示。
可选地，在进行查询之前，该方法还包括：所述控制设备获取所述增强现实设备采集的所述用户的身份信息；和所述控制设备查询以确定所述预先设置的数据集合中是否包括所采集的用户的身份信息。所述控制设备在查询出所述采集的用户的身份信息时，从预先设置的数据集合中查询出与所述采集的用户的身份信息对应的色觉灵敏度信息。
可选地，该方法还包括：在所述控制设备从预先设置的数据集合中未查询出所述采集的用户的身份信息时，所述控制设备启动对所述用户的色觉灵敏度测试，以得到与用户的身份信息对应的色觉灵敏度信息。所述控制设备基于测试得到的色觉灵敏度信息判断用户是否是色彩识别障碍症患者。所述控制设备将所采集的用户的身份信息和测试得到的色觉灵敏度信息关联地存储到所述数据集合中。
可选地，在向所述增强现实设备提供该目标色彩显示模式之前，该方法还包括：获取所述增强现实设备检测到的环境亮度信息和用户视野环境颜色信息；根据所述色觉灵敏度信息、所述环境亮度信息和所述用户视野环境颜色信息，生成对于图像中的每个亚像素的补偿参数；根据每个亚像素的补偿参数对每个亚像素的数据信号进行补偿，生成补偿后的数据信号；以及随该目标色彩显示模式一起向所述增强现实设备提供所述补偿后的数据信号，以使所述增强现实设备采用所述目标色彩显示模式，基于补偿后的数据信号进行图像显示。
可选地，所述生成每个亚像素的补偿参数包括：所述控制设备根据所述色觉灵敏度信息、所述环境亮度信息和所述用户视野环境颜色信息，生成对于图像中的每个像素的数据信号目标值。每个像素包括多个亚像素。所述控制设备根据每个像素的数据信号目标值，生成每个亚像素的补偿参数。
可选地，所述获取与所述色觉灵敏度信息对应的个性化色彩显示模式包括：所述控制设备指令所述增强现实设备输出与所述色觉灵敏度信息对应的个性化色彩显示模式的多个选项，以使得所述用户能确定该多个选项中是否包括用户期望的个性化色彩显示模式。若是，则获取所述用户确定的一个个性化色彩显示模式；若否，则所述控制设备指令所述增强现实设备输出另外多个与所述色觉灵敏度信息对应的个性化色彩显示模式的选项，以使得所述用户能继续执行所述确定步 骤。
可选地，该方法还包括：所述控制设备在判断出所述用户不是色彩识别障碍症患者时，获取与所述色觉灵敏度信息对应的标准化色彩显示模式作为目标色彩显示模式。
在另一方面，本公开提供了一种控制设备。该控制设备包括查询模块，用于从预先设置的数据集合中查询出与获取的增强现实设备的用户的身份信息对应的色觉灵敏度信息；判断模块，用于根据所查询出的色觉灵敏度信息判断所述用户是否是色彩识别障碍症患者；和色彩模式获取模块，用于在所述判断模块判断出所述用户是色彩识别障碍症患者时，获取与所述色觉灵敏度信息对应的个性化色彩显示模式来作为目标色彩显示模式，以及向该增强现实设备提供该目标色彩显示模式以使该增强现实设备采用所述目标色彩显示模式进行图像显示。
可选地，所述查询模块还用于获取所述增强现实设备采集的用户的身份信息，查询并确定所述预先设置的数据集合中是否包括所述采集的用户的身份信息，以及在查询出所述采集的用户的身份信息时，从预先设置的数据集合中查询出与所述采集的用户的身份信息对应的色觉灵敏度信息。
可选地，所述查询模块在未查询出所述采集的用户的身份信息时启动对所述用户的色觉灵敏度测试，以得到与用户的身份信息对应的色觉灵敏度信息；以及所述判断模块还用以基于测试得到的色觉灵敏度信息来判断用户是否是色彩识别障碍症患者。
所述控制设备还包括存储模块，用于存储所述预先设置的数据集合，且用于将所述采集的用户的身份信息和测试得到的色觉灵敏度信息关联地存储至该数据集合中。
可选地，所述控制设备还包括补偿模块，用于根据所述色觉灵敏度信息以及所述增强现实设备检测到的环境亮度信息和用户视野环境颜色信息，生成对于该图像中的每个亚像素的补偿参数；根据每个亚像素的补偿参数对每个亚像素的数据信号进行补偿，生成补偿后的数据信号；以及随该目标色彩显示模式一起向所述增强现实设备提供所述补偿后的数据信号，以使所述增强现实设备采用所述目标色彩显示模式，基于补偿后的数据信号进行图像显示。
可选地，所述色彩模式获取模块还用于在所述判断模块判断出所述用户不是色彩识别障碍症患者时，获取与正常色彩显示对应的标准化色彩显示模式作为目标色彩显示模式。
在又一方面，本公开提供了一种增强现实设备。该增强现实设备包括显示模块，用于按照色彩显示模式显示图像；和显示模式设定模块，用于为所述显示模块设定色彩显示模式，所述色彩显示模式包括在增强现实设备的用户为色彩识别障碍症患者的情况下的至少一个个性化色彩显示模式和在该用户为正常色彩识别者的情况下的标准色彩显示模式。该显示模式设定模块被配置为接收来自控制设备的目标色彩显示模式且将其设定为用于显示模块的色彩显示模式，所述目标色彩显示模式对应于该增强现实设备的用户的色觉灵敏度信息。
可选地，所述增强现实设备还包括身份信息获取模块，用于采集用户的身份信息，且将所采集的用户的身份信息提供给所述控制设备，以使得控制设备能基于该采集的用户的身份信息来查询与之对应的色觉灵敏度信息。
可选地，所述增强现实设备还包括检测模块，用于检测出环境亮度信息和用户视野环境颜色信息，且将所检测的信息提供给所述控制设备以使得控制设备能基于所述色觉灵敏度信息以及环境亮度信息和用户视野环境颜色信息生成针对图像的每个亚像素的补偿后的数据信号。所述显示模块还用于采用所接收的目标色彩显示模式，基于补偿后的数据信号进行图像显示。
可选地，所述检测模块包括环境亮度传感器，用于感测出环境亮度信息；和视野环境颜色传感器，用于感测出用户视野环境颜色信息。
可选地，所述增强现实设备包括作为本体的增强现实眼镜。该增强现实眼镜包括镜架和设置于镜架上的镜片。所述显示模块、显示模式设定模块、身份信息获取模块和检测模块均被安置于镜架上
在再一方面，本公开提供了一种增强现实处理系统，包括：上述控制设备和上述增强现实设备。
在再一方面，本公开提供了一种增强现实设备。该增强现实设备包括：上述控制设备和显示模块，用于按照色彩显示模式显示图像。所述色彩模式获取模块基于所述目标色彩显示模式设定用于显示模块的色彩显示模式。
在再一方面，本公开提供了一种计算机存储介质。所述计算机存储介质包含指令，当所述指令被处理器执行时使得所述处理器能够实施上述的方法。
附图说明
现在将参考示出本公开的实施例的附图来更详细地描述本公开的上述以及其它方面。
图1为本公开实施例提供的一种增强现实处理方法的流程图；
图2为本公开实施例提供的另一种增强现实处理方法的流程图；
图3为本公开实施例提供的又一种增强现实处理方法的流程图；
图4为本公开实施例提供的一种控制设备的结构示意图；
图5为本公开实施例提供的一种增强现实设备的结构示意图；
图6为本公开实施例提供的另一种增强现实设备的示意图；和
图7为本公开实施例提供的一种增强现实处理系统的结构示意图。
具体实施方式
为使本领域的技术人员更好地理解本公开的技术方案，下面结合附图对本公开提供的增强现实处理方法、系统、控制设备和增强现实设备进行详细描述。在以下的说明中，为了解释而不是限制，阐述了所公开的实施例的某些特定细节，以便清楚和彻底地理解本公开。然而本领域技术人员应当容易明白，在不严重偏离本公开的精神和范围的情况下，本公开可以按并非精确地符合本文中所述细节的其它实施例来实施。此外，在这个上下文中，为了简单明了，省略了对熟悉的设备、电路和方法的详细描述，以避免多余的细节和可能的混淆。
人眼之所以具有彩色视觉是因为视网膜(retina)上分布了三种不同的视锥细胞(Cone)，分别对可见光谱的红、绿、蓝三原色波段敏感，在视网膜细胞受到光线刺激后，三种不同细胞接收到的光信息就会转换为电信号，该电信号被传递到大脑进行融合处理，从而使人获得色彩分辨能力。现代神经生理学的研究发现，每种视锥细胞的色素在光照射下吸收某些波长而反射另一些波长的光，每种视锥细胞的色素对光谱不同部位的敏感程度不同，即具有不同的光谱吸收曲线。
色彩识别障碍症是指人眼的一种或几种视锥细胞缺失或者发生功能障碍，因而导致不能分辨自然光谱中的某种、一些或全部颜色的症状。例如，如果缺失二种和更多种视锥细胞会导致全色盲，即仅仅拥 有单色感知。如果其中一种或几种视锥细胞的感光频谱段平移或不全，则会引起色弱。这些都会导致患者的色彩分辨能力降低。
一般而言，色彩识别障碍症可包括色盲或者色弱。色盲可包括全色盲或者部分色盲，部分色盲可包括红色盲、绿色盲或者黄蓝色盲。色弱可包括全色弱或者部分色弱，部分色弱可包括红色弱、绿色弱或者黄蓝色弱。正如已知的，色彩识别障碍症的种类可以为多种。
色觉灵敏度信息可用于标识色彩识别障碍症种类或者将用户标识为无色彩识别障碍症，即正常色彩识别者。换言之，可以通过获取色觉灵敏度信息来辨别色彩识别障碍症患者和正常色彩识别者。例如，当色觉灵敏度信息标识用户患有红色盲时，判断出用户是红色盲症患者。在一个实施例中，色觉灵敏度信息可包括每种视锥细胞对可见光谱的敏感程度。
按照本公开的实施例，通过向色彩识别障碍症患者提供不同于标准色彩显示模式的个性化色彩显示模式，即进行色彩矫正，使得色彩识别障碍症患者也能够轻易识别增强现实设备显示的信息，由此极大地改善了用户体验。
图1为本公开实施例提供的一种用于增强现实设备显示的方法的流程图。如图1所示，该方法包括：
步骤101、控制设备从预先设置的数据集合中查询出与获取的用户的身份信息对应的色觉灵敏度信息。该用户为增强现实设备的用户。在实施例中，控制设备可以从增强现实设备获取用户的生物特征数据，包括但不限于虹膜信息、人脸信息、指纹信息等。替换地或者附加地，控制设备也可以从增强现实设备获取用户的用户标识符，例如用户名。
在实施例中，数据集合可以经由用户向控制设备或者增强现实设备进行注册而预先设置。举例而言，数据集合可以通过收集用户在注册为增强现实设备的用户时输入的身份信息和对应的色觉灵敏度信息而预先设置。附加地，数据集合也可以在每次新用户使用该增强现实设备时被更新。预先设置的数据集合可以被本地地存储在该控制设备中，或者也可以被存储在该控制设备可访问的远程设备上。
步骤102、控制设备根据与用户的身份信息对应(即所查询出)的色觉灵敏度信息判断所述用户是否是色彩识别障碍症患者。色觉灵敏度信息可以包括用户的每种视锥细胞对可见光谱的敏感程度。根据每 种视锥细胞对可见光谱的敏感程度可判断出用户是否是色彩识别障碍症患者和/或色彩识别障碍的程度。举例而言，假如色觉灵敏度信息指示该用户对光谱的红色区域敏感度低，则该用户可能为红色盲症患者。
步骤103，若在步骤102中判定用户是色彩识别障碍症患者，则控制设备获取与色觉灵敏度信息所指示的色彩识别障碍症对应的个性化色彩显示模式作为目标色彩显示模式。在实施例中，不同的色彩识别障碍症类型可以对应不同的个性化色彩显示模式。在这些个性化色彩显示模式中，可能通过差别着色、滤色等色彩矫正方式或者将不能识别的颜色与其他视觉指示器(比如交叉影线)关联的方式来改善色彩识别障碍症患者的色彩辨认状况。示例性地，对于红色盲症用户，其对应的红色盲色彩显示模式可以是将红色矫正为用户可识别的接近红色的颜色。
步骤104、控制设备向增强现实设备提供该个性化色彩显示模式(也即适配于该用户的色彩识别障碍症的目标色彩显示模式)以使增强现实设备使用该个性化色彩显示模式进行图像显示，流程结束。在实施例中，控制设备可以向增强现实设备发送包含个性化色彩显示模的控制指令，以指令增强现实设备按照该个性化色彩显示模式进行图像显示。本步骤中可通过个性化色彩显示模式进行AR图像显示。
步骤105、若在步骤102中判定用户不是色彩识别障碍症患者，则控制设备获取呈现正常色彩的标准化色彩显示模式作为目标色彩显示模式。标准化色彩显示模式即不进行针对色彩识别障碍的色彩矫正的色彩显示模式。
步骤106、控制设备向增强现实设备提供该标准化色彩显示模式以使增强现实设备通过标准化色彩显示模式进行图像显示，流程结束。本步骤中可通过标准化色彩显示模式进行AR图像显示。
在本公开实施例提供的用于增强现实设备显示的方法中，控制设备若根据色觉灵敏度信息判断出用户是色彩识别障碍症患者时，则控制增强现实设备去采用与各色彩识别障碍症对应的个性化色彩显示模式进行图像显示，避免了色彩识别障碍症患者无法识别AR信息的情况，从而提高了用户的使用体验。
对于上述实施例的操作可以参照一个或多个逻辑流程作进一步描述。可以意识到，除非另外指示，否则代表性逻辑流程并不一定必须 以所给出的次序或以任何特定的次序执行。而且，相对于逻辑流程描述的各种活动可以以串行或并行方式被执行。逻辑流程可以通过使用所描述的实施例的一个或多个硬件单元和/或软件单元、或者如对于给定的设计和性能约束组所想要的替换单元而被实施。例如，逻辑流程可以被实施为供逻辑设备(例如，通用或专用计算机)执行的逻辑(例如，计算机程序指令)。
图2为本公开实施例提供的另一种方法的流程图。如图2所示，该方法包括：
步骤201、增强现实设备采集用户的身份信息。在实施例中，该用户的身份信息可以包括用户的虹膜信息。由于每个用户的虹膜信息均是不同的，因此可利用每个用户的虹膜信息唯一标识用户的身份。替换地，所采集的用户的身份信息还可以包括用户的其他类型的生物特征数据，包括但不限于指纹、人脸等。
步骤202、控制设备获取增强现实设备采集的用户的身份信息，并查询以确定预先设置的数据集合中是否包括所采集的身份信息。
在实施例中，可预先设置一数据集合，该数据集合中存储有不同的用户的身份信息。例如，可在每次用户使用增强现实设备时，采集用户的身份信息，并将采集到的用户的身份信息存储入数据集合中。或者，可以在用户使用增强现实设备之前预先对用户进行注册以便将用户的身份信息存储入数据集合中。示例性地，可通过虹膜识别技术对用户进行多次虹膜信息采样以获取用户的虹膜信息，并将采集到的用户的虹膜信息作为用户的身份信息存储入数据集合中。可选地，数据集合可以包括对应某个用户的多种类型的身份信息。
查询可以包括将所采集的身份信息与数据集合中存储的身份信息进行对比。当在数据集合中存在与所采集的身份信息相匹配的身份信息时确定数据集合中包括用户的身份信息。
步骤203，如果在步骤202中确定预先设置的数据集合中已包括所采集的身份信息，则控制设备从预先设置的数据集合中查询出与所采集的身份信息对应的色觉灵敏度信息。
预先设置的数据集合中还存储有不同用户的色觉灵敏度信息，每个色觉灵敏度信息与该用户的身份信息对应。在实施例中，可预先获取或者测试得到不同用户的色觉灵敏度信息，并将不同用户的色觉灵 敏度信息存储入数据集合中。
步骤204，如果在步骤202中确定该数据集合中未包括所采集的身份信息，则控制设备可以启动对用户的色觉灵敏度测试，以得到该用户的色觉灵敏度信息。色觉灵敏度测试可以包括对用户的图像色彩分辨力的量化测试。
在一些实施例中，控制设备可通过增强现实设备进行色觉灵敏度测试。增强现实设备可以向用户显示色觉测试图画面以进行色觉灵敏度测试。该色觉测试图的画面可以为AR显示画面。用户在观看色觉测试图画面时，可通过触摸的方式或者语音的方式提供对色觉测试图画面的反馈，基于该反馈可以确定出有关色觉灵敏度的测试结果。增强现实设备将测试结果输出至控制设备，控制设备根据测试结果得出该用户的色觉灵敏度信息。
在实际应用中，可选地，控制设备还可以通过其它显示设备显示色觉测试图画面，且基于用户对色觉测试图画面的反馈来确定出测试结果。控制设备根据测试结果得出该用户的色觉灵敏度信息。
在实际应用中，可选地，还可以采用色相测试方法测试出色觉灵敏度信息。例如，通过蒙赛尔(Munsell)色相测试色棋测试出色觉灵敏度信息。控制设备获取测试出的色觉灵敏度信息。
可选地，控制设备可以将所采集的用户的身份信息和与经由色觉测试得到的该用户的色觉灵敏度信息关联地存储至数据集合中。
步骤205、控制设备根据色觉灵敏度信息判断用户是否是色彩识别障碍症患者。
在实施例中，可以根据色觉灵敏度信息所包括的每种视锥细胞对可见光谱的敏感程度判断用户是否是色彩识别障碍症患者。更进一步地，可以根据色觉灵敏度信息判断用户的色彩识别障碍种类和程度等。
步骤206，若用户是色彩识别障碍症患者，则控制设备获取与色觉灵敏度信息对应的个性化色彩显示模式作为目标色彩显示模式。
示例性地，可以获取与色觉灵敏度信息对应的色彩识别障碍症种类以及可选地还有程度对应的个性化色彩显示模式。
步骤207，若用户不是色彩识别障碍症患者，也即正常色彩识别者，则控制设备获取与正常色彩显示对应的标准化色彩显示模式作为目标色彩显示模式。
增强现实设备的色彩显示模式包括标准化色彩显示模式和一种或多种个性化色彩显示模式。针对未患有色彩识别障碍症的用户，也即正常色彩识别用户，可通过标准化色彩显示模式进行图像显示。针对患有色彩识别障碍症的用户，可通过个性化色彩显示模式进行图像显示。
标准化色彩显示模式和个性化色彩显示模式均可预先进行设置。可以为每种类型的色彩识别障碍症设置对应的一个个性化色彩显示模式。在实施例中，个性化色彩显示模式可以通过建立与不同类型的色彩识别障碍对应的用于显示的伽马(Gamma)曲线来实现。在实施例中，个性化色彩显示模式可以通过预先学习不同类型的色彩识别障碍症患者所期望的色彩显示效果而获得。这样，举例而言，若色彩识别障碍症被判定为红色盲，则可从预先设置的个性化色彩显示模式中获取与红色盲对应的个性化色彩显示模式。该与红色盲对应的个性化色彩显示模式对红色进行了适当的色彩矫正，适用于为红色盲患者显示图像时使用。
在一些实施例中，考虑到色彩识别障碍症患者或者其他个体可能存在对某些色彩的反应灵敏度更高、反应速度更快，或者对某些颜色具有个人偏好的情况，个性化色彩显示模式还可以是自主选择配色的色彩显示模式。
在一些增强现实设备的应用领域中，虚拟显示内容和现实世界融合过程中色彩搭配是关键的。举例而言，在利用增强现实技术进行实景导航的过程中，特别是在车载领域，当前景(虚拟显示内容)与背景(视野环境)的色彩高度重合或相似时，由于对比度降低将导致虚拟显示的内容难以分辨或增加分辨时间。如果此时用户正处在高速行进的过程中则极可能造成事故。因此，可能期望结合环境亮度、环境色彩和用户色彩识别力情况，进行实时色彩补偿。
在一些实施例中，按照本公开实施例的方法还可以包括以下步骤。
步骤208、增强现实设备检测出环境亮度信息和用户视野环境颜色信息。环境亮度信息和用户视野环境颜色信息可以均为实时检测出的信息。
步骤209、控制设备根据色觉灵敏度信息、环境亮度信息和用户视野环境颜色信息，生成用于待显示的图像中的每个亚像素的补偿参数。
在一个实施例中，控制设备可以根据色觉灵敏度信息、环境亮度信息和用户视野环境颜色信息中的一个或多个，生成用于图像中的每个像素的数据信号目标值。每个像素包括多个亚像素。例如，每个像素可包括红色(R)亚像素、绿色(G)亚像素和蓝色(B)亚像素。
控制设备可以根据每个像素的数据信号目标值，生成针对其每个亚像素的补偿参数。
步骤210、控制设备根据每个亚像素的补偿参数对每个亚像素的数据信号进行补偿，生成补偿后的数据信号。
示例性地，可将每个亚像素的补偿参数与每个亚像素的数据信号相加，得出每个亚像素的补偿后的数据信号。在一些实施例中，可以通过对亚像素的数据信号的补偿来对红色亚像素、绿色亚像素和蓝色亚像素中每个亚像素的亮度进行调节。
步骤211、增强现实设备采用目标色彩显示模式，使用补偿后的数据信号进行图像显示，流程结束。通过使用补偿后的数据信号进行图像显示，可以实现对图像的色彩矫正。
可以理解，步骤208-211是可选的。在一些实施例中，增强现实设备可以在接收到来自控制设备的目标色彩显示模式后直接进行图像显示。
在本公开实施例提供的方法中，若根据色觉灵敏度信息判断出用户是色彩识别障碍症患者，则增强现实设备采用与色觉灵敏度信息对应的个性化色彩显示模式进行图像显示。这样避免了色彩识别障碍症患者无法识别AR信息的情况，可以有效提升不同个体的感官体验和信息识别的准确度，从而提高了用户的使用体验。
另外，在本实施例中，基于色觉灵敏度信息、环境亮度信息和用户视野环境颜色信息，实现了对显示图像的色彩补偿矫正，从而有效避免了在使用过程中由于用户视野颜色随着现实环境的改变，而在某些特定时刻出现背景和前景颜色无法区分的情况，进而达到减轻甚至避免用户观察障碍或者混乱的情形。
图3为本公开实施例提供的又一种方法的流程图。如图3所示，该方法包括：
步骤301、增强现实设备采集用户的身份信息。该用户的身份信息可以包括用户的虹膜信息。
步骤302、控制设备查询并确定预先设置的数据集合中是否包括所采集的身份信息。
步骤303，若确定预先设置的数据集合中未包括所采集的身份信息，则增强现实设备再次采集用户的身份信息。
示例性地，可通过虹膜识别技术对用户进行多次虹膜采样以采集用户虹膜的多个样本。在实施例中，若确定预先设置的数据集合中未包括所采集的身份信息，则提示用户进行多次虹膜信息采集。所采集到的用户的虹膜信息被作为用户的身份信息来存储。通过实现对虹膜信息的重新采集，能够精确的采集到虹膜样本。
步骤304、控制设备启动对用户的色觉灵敏度测试，得到与采集的身份信息对应的色觉灵敏度信息。举例而言，可以对该用户进行标准的色盲测试，以测试其色彩识别能力和色觉灵敏程度。替换地，控制设备可以直接从用户获取色觉灵敏度信息的输入。在一个实施例中，控制设备可以在用户界面上向用户呈现有关色彩识别障碍症的多个选项，且获取用户对有关选项的选择来得到与用户对应的色觉灵敏度信息。示例性地，所呈现的选项可以包括：色觉正常、红色盲/色弱、绿色盲/色弱、黄蓝色盲/色弱等。附加地，所呈现的选项还可以包括：要进行色觉测试，且在用户选择进行色觉测试的选项时才启动该色觉测试。
步骤305、控制设备可以将所采集的用户的身份信息和所得到的色觉灵敏度信息相关联地存储至数据集合中。
步骤306，若在步骤302查询出数据集合中已包括用户的身份信息，则控制设备从预先设置的数据集合中查询出与用户的身份信息对应的色觉灵敏度信息。
步骤307、控制设备根据所得到的或者所查询出的色觉灵敏度信息判断用户是否是色彩识别障碍症患者。在一些实施例中，色觉灵敏度信息包括每种视锥细胞对可见光谱的敏感程度。根据每种视锥细胞对可见光谱的敏感程度可判断出用户是否是色彩识别障碍症患者。
步骤308，当在步骤307中判断出用户是色彩识别障碍症患者时，增强现实设备可输出与色觉灵敏度信息对应的个性化色彩显示模式的多个选项。每个选项可以对应不同的配色方案。
在实施例中，控制设备向增强现实设备输出控制指令，以控制增 强现实设备显示与各选项对应的色彩模式画面，该色彩模式画面为AR显示画面。可选地，增强现实设备可输出色彩模式画面，该色彩模式画面包括多个与色觉灵敏度信息对应的个性化色彩显示模式的选项。
步骤309、判断在该多个选项中是否包括用户期望的个性化色彩显示模式。
在实施例中，可以向用户呈现与各个选项对应的特定色彩模式画面，接收用户对各色彩模式画面的反馈，且基于所述反馈来进行该判断。在一些实施例中，反馈可以是用户对各色彩模式画面的色彩满意度的评级。示例性地，假设最高评级为10，则当所接收的反馈表明用户对一个或多个色彩模式画面的评级达到或超过评级阈值(例如8)时，可以判断出该色彩模式画面所对应的色彩显示模式为用户期望的个性化色彩显示模式。而当用户对所有色彩模式画面的评级均未达到评级阈值时，可以判断该多个选项中未包括用户期望的个性化色彩显示模式。在另一些实施例中，反馈也可以是简单的“是”或“否”。当所接收的反馈为“是”时，表示该色彩模式画面是用户所期望的，而当所接收的反馈为“否”时，则表示用户不能接受该色彩模式画面。用户可以通过控制设备或增强现实设备的输入装置(包括但不限于按键、触摸板、话筒等)来提供所述反馈。示例性地，用户可在观看色彩模式画面时，通过触摸与其所满意的色彩模式画面对应色彩显示模式选项的方式来表明该多个选项中包括用户期望的个性化色彩显示模式。
步骤310，若判断出该多个选项中未包括用户期望的个性化色彩显示模式，则控制设备通过增强现实设备输出另外多个与色觉灵敏度信息对应的个性化色彩显示模式的选项以供用户选择，并继续执行步骤309。
用户对所给出的所有个性化色彩显示模式都不满意时，需要输出新的个性化色彩显示模式，以供用户继续进行选择。
可选地，可输出新的色彩模式画面，该新的色彩模式画面包括另外多个与色觉灵敏度信息对应的个性化色彩显示模式的选项。
步骤311，若判断出该多个选项中已包括用户期望的个性化色彩显示模式，则增强现实设备将用户期望的个性化色彩显示模式输出至控制设备，控制设备基于用户期望的个性化色彩显示模式确定一个个性化色彩显示模式作为目标色彩显示模式。
步骤312，当在步骤307中判断出用户不是色彩识别障碍症患者时，控制设备获取标准化色彩显示模式作为目标色彩显示模式。
步骤313、增强现实设备采用目标色彩显示模式进行图像显示，流程结束。
可以理解，也可以在确定目标色彩显示模式后，按照图2中步骤208-211所示的对数据信号进行补偿，且使用补偿后的数据信号进行图像显示。
在本实施例中允许用户自主选择个性化色彩显示模式，从而满足了用户个体对某些色彩的反应灵敏度高、反应速度快以及某些颜色具有个人偏好的情况。图4为本公开实施例提供的一种控制设备的结构示意图。如图4所示，该控制设备包括：第一查询模块11、判断模块12和色彩模式获取模块13。
第一查询模块11用于从预先设置的数据集合中查询出与获取的用户的身份信息对应的色觉灵敏度信息。判断模块12用于根据与用户的身份信息对应的色觉灵敏度信息判断用户是否是色彩识别障碍症患者。色彩模式获取模块13用于在判断模块12判断出用户是色彩识别障碍症患者时，获取与色觉灵敏度信息对应的个性化色彩显示模式来作为目标色彩显示模式，以及向该增强现实设备提供该目标色彩显示模式以使该增强现实设备采用所述目标色彩显示模式进行图像显示。
进一步地，该控制设备还包括：第二查询模块14。第二查询模块14用于获取增强现实设备采集的用户的身份信息。第二查询模块14还被配置为查询以确定预先设置的数据集合中是否包括增强现实设备采集的用户的身份信息。若查询出预先设置的数据集合中包括所采集的身份信息时，则触发第一查询模块11使用查询出的身份信息从预先设置的数据集合中查询出与采集的用户的身份信息对应的色觉灵敏度信息。
进一步地，若第二查询模块14查询出预先设置的数据集合中未包括用户的身份信息时，其可以指令/触发增强现实设备去再次采集用户的身份信息。附加地或者替换地，在这种情况下，第一查询模块11可以启动对所述用户的色觉灵敏度测试。举例而言，第一查询模块11可以指令/触发增强现实设备去进行该色觉灵敏度测试，包括显示色觉测试图以及接收用户对色觉侧视图的反馈等。
可以理解，第一和第二查询模块14可以是单独的查询模块，也可以通过一个集成的查询模块来实现。
该控制设备还包括存储模块15。存储模块15用于存储该数据集合。存储模块15可以将增强现实设备所采集的用户的身份信息和测试得到的与用户的身份信息对应的色觉灵敏度信息关联地，即一一对应地存储至数据集合中。第一查询模块11可以从存储模块15获取该数据集合以便基于身份信息来查询用户的色觉灵敏度信息。
判断模块12可以接收来自第一查询模块11的所查询的或者经测试得到的色觉灵敏度信息，且基于其执行用户是否是色彩识别障碍症患者的判断。
进一步地，该控制设备还包括：补偿模块16。补偿模块16用于根据色觉灵敏度信息以及增强现实设备检测到的环境亮度信息和用户视野环境颜色信息，生成对于该图像中的每个亚像素的补偿参数；根据每个亚像素的补偿参数对每个亚像素的数据信号进行补偿，生成补偿后的数据信号，以及随该目标色彩显示模式一起向所述增强现实设备提供所述补偿后的数据信号，以使增强现实设备采用个性化色彩显示模式，基于补偿后的数据信号进行图像显示。
进一步地，色彩模式获取模块13还用于在判断模块12判断出用户不是色彩识别障碍症患者时，获取与正常色彩显示对应的标准化色彩显示模式作为目标色彩显示模式，以供增强现实设备采用所述标准化色彩显示模式进行图像显示。
在实施例中，控制设备可以为上位机。
本实施例提供的控制设备，通过在根据色觉灵敏度信息判断出用户是色彩识别障碍症患者时为增强显示设备选择与色觉灵敏度信息对应的个性化色彩显示模式来进行图像显示，避免了色彩识别障碍症患者无法识别AR信息的情况，从而提高了用户的使用体验。
图5为本公开实施例提供的一种增强现实设备的结构示意图。该增强现实设备可以与按照本公开实施例的控制设备，如结合图4描述的控制设备一起使用。如图5所示，该增强现实设备包括显示模块21和显示模式设定模块22。
显示模块21用于按照色彩显示模式显示图像。
显示模式设定模块22用于为所述显示模块21设定色彩显示模式， 所述色彩显示模式包括在增强现实设备的用户为色彩识别障碍症患者的情况下的至少一个个性化色彩显示模式和在该用户为正常色彩识别者的情况下的标准色彩显示模式。该显示模式设定模块22被配置为接收来自控制设备的目标色彩显示模式且基于其设定用于显示模块21的色彩显示模式。所述目标色彩显示模式对应于该增强现实设备的用户的色觉灵敏度信息。
控制设备可以从预先设置的数据集合中查询出与获取的用户的身份信息对应的色觉灵敏度信息，根据与用户的身份信息对应的色觉灵敏度信息判断用户是否是色彩识别障碍症患者。若判断出用户是色彩识别障碍症患者，则获取与色觉灵敏度信息对应的个性化色彩显示模式。
进一步地，该增强现实设备还包括身份信息获取模块23。身份信息获取模块23用于采集用户的身份信息。所采集的身份信息可以提供给控制设备，以进行有关色觉灵敏度信息的查询。在实施例中，身份信息获取模块23可以采集用户的生物特征数据。示例性地，身份信息获取模块23是光学传感器或者摄像机，以采集诸如虹膜或面部图像等。附加地或者替换地，身份信息获取模块23还可以是平板传感器，用于采集指纹或掌纹等。
进一步地，该增强现实设备还包括检测模块24。检测模块24用于检测出环境亮度信息和用户视野环境颜色信息。所检测的环境亮度信息和用户视野环境颜色信息可以被提供给控制设备，以便使控制设备根据色觉灵敏度信息以及环境亮度信息和用户视野环境颜色信息，生成针对图像的每个亚像素的补偿参数。根据每个亚像素的补偿参数对每个亚像素的数据信号进行补偿，可生成补偿后的数据信号。显示模块21可采用个性化色彩显示模式，基于补偿后的数据信号进行图像显示。
进一步地，检测模块24包括：环境亮度传感器241和视野环境颜色传感器242。环境亮度传感器241用于感测出环境亮度信息。视野环境颜色传感器242用于感测出用户视野环境颜色信息。视野环境颜色传感器242可以为摄像头或者具备摄像头的装置。
进一步地，显示模块21还用于在控制设备的控制下输出与色觉灵敏度信息对应的个性化色彩显示模式的多个选项，以供用户判断该多 个选项中是否包括用户期望的个性化色彩显示模式。若是，则用户从多个与所述色觉灵敏度信息对应的个性化色彩显示模式中确定出一个个性化色彩显示模式；若否，则显示模块21在控制设备的控制下输出另外多个与所述色觉灵敏度信息对应的个性化色彩显示模式的选项，以供所述用户继续执行所述判断。可选地，显示模块21可以输出多个色彩模式画面。这些色彩模式画面与各个个性化色彩显示模式的选项对应。在实施例中，用户可在观看色彩模式画面时，通过触摸的方式从多个与色觉灵敏度信息对应的个性化色彩显示模式的选项中选择出一个个性化色彩显示模式。
在实施例中，显示模块21还可以基于来自控制设备的补偿后的数据信号来进行显示。
在实施例中，身份信息获取模块23还可以将所采集的用户的身份信息提供给控制设备，以便进行色觉灵敏度信息的查询。
在实施例中，环境亮度检测模块241和视野环境检测模块242还可以将所检测出的亮度信息和颜色信息提供给控制设备，以便进行数据的补偿。
图6为本公开实施例提供的另一种增强现实设备的示意图。如图6所示，该增强现实设备包括本体21和显示组件22。显示组件22包括显示模块221和显示模式设定模块222。
在实施例中，该增强现实设备为AR眼镜，则本体21包括镜架211和设置于镜架211上的镜片212。显示模块221、显示模式设定模块222、身份信息获取模块23和检测模块24均位于镜架211上。
可选地，显示模块221、显示模式设定模块222可位于镜架211的内部。示例性地，显示模块221可位于镜架211的镜腿的内部。尽管未示出，但是可以理解，在实际应用中，可选地，显示模块221、显示模式设定模块222也可位于镜架211的外部或者本地21的任何其他适当的位置。
可选地，身份信息获取模块23位于镜架211的外部。身份信息获取模块23的数量可以是两个。每个身份信息获取模块23位于镜架211的一个镜圈上。镜片设置于镜圈内。在实施例中，用户的身份信息包括用户的虹膜信息。可选地，身份信息获取模块23可包括摄像头或者具备摄像头的装置，摄像头直接获取用户的人眼瞳孔图形以识别出用 户的虹膜信息。
可选地，在实际应用中，身份信息获取模块23还可以设置于镜架211的内部。此时，身份信息获取模块23可通过与AR虚拟显示采用相同的光路获取到用户的人眼瞳孔图形以识别出用户的虹膜信息，此种情况在图中未具体画出。可以理解，在一些实施例中，增强现实设备还可以包括与AR眼镜配合使用的触觉接口或者其他配件，且身份信息获取模块23可以被设置在这样的接口或者配件中。
可选地，检测模块24位于镜架211的外部。示例性地，检测模块24可以位于镜架211的鼻梁架处。
可选地，显示模式设定模块25位于镜架211的外部。本实施例提供的增强现实设备的技术方案中，若根据色觉灵敏度信息判断出用户是色彩识别障碍症患者时，通过与色觉灵敏度信息对应的个性化色彩显示模式进行图像显示，避免了色彩识别障碍症患者无法识别AR信息的情况，从而提高了用户的使用体验。
图6为本公开实施例提供的一种增强现实处理系统的结构示意图。如图6所示，该系统包括：按照本公开实施例的控制设备1和按照本公开实施例的增强现实设备2。
控制设备1可以是上文结合图4所描述的控制设备。增强现实设备2可以是上文结合图5所描述的增强现实设备。在实施例中，控制设备1和增强现实设备2可以经由各种类型的通信媒体来通信地耦合。控制设备1和增强现实设备2可以协调互相之间的操作。协调可以牵涉到信息的单向或双向交换。例如，构件可以以通信媒体上传递的信号的形式来传递信息。然而，另外的实施例可以替换地利用数据消息。这样的数据消息可以跨各种连接被发送。示范性的连接包括并行接口、串行接口和总线接口。
按照本公开的另一实施例，控制设备还可以被集成到增强现实设备中。按照这一实施例的增强现实设备可以包括按照本公开实施例的控制设备和用于按照色彩显示模式显示图像的显示模块。所述色彩模式获取模块基于所述目标色彩显示模式设定用于显示模块的色彩显示模式。
在本公开实施例提供的增强现实处理系统的技术方案中，通过在根据色觉灵敏度信息判断出用户是色彩识别障碍症患者时采用与色觉 灵敏度信息对应的个性化色彩显示模式进行图像显示，避免了色彩识别障碍症患者无法识别AR信息的情况，从而提高了用户的使用体验。
各种实施例中的“模块”、“设备”等可以通过使用硬件单元、软件单元或它们的组合而被实施。硬件单元的例子可包括设备、构件、处理器、微处理器、电路、电路元件(例如，晶体管、电阻器、电容器、电感器等等)、集成电路、专用集成电路(ASIC)、可编程逻辑器件(PLD)、数字信号处理器(DSP)、现场可编程门阵列(FPGA)、存储器单元、逻辑门、寄存器、半导体器件、芯片、微芯片、芯片组等等。软件单元的例子可包括软件构件、程序、应用、计算机程序、应用程序、系统程序、机器程序、操作系统软件、中间件、固件、软件模块、例行程序、子程序、函数、方法、过程、软件接口、应用程序接口(API)、指令集、计算代码、计算机代码、代码段、计算机代码段、单词、值、符号、或它们的任何组合。确定实施例是否通过使用硬件单元和/或软件单元被实施可以根据任意数量的因素而变化，诸如想要的计算速率、功率电平、耐热性、处理周期预算、输入数据速率、输出数据速率、存储器资源、数据总线速度、和其它对于给定的实现所想要的那样的设计或性能约束。
某些实施例可包括制造品。制造品可包括用来存储逻辑的存储介质。存储介质的例子可包括能够存储电子数据的一种或多种类型的非瞬态的计算机可读存储媒体，包括易失性存储器或非易失性存储器、可拆卸或不可拆卸存储器、可擦除或不可擦除存储器、可写或可再写存储器等等。逻辑的例子可包括各种软件单元，诸如软件构件、程序、应用、计算机程序、应用程序、系统程序、机器程序、操作系统软件、中间件、固件、软件模块、例行程序、子程序、函数、方法、过程、软件接口、应用程序接口(API)、指令集、计算代码、计算机代码、代码段、计算机代码段、单词、值、符号、或它们的任何组合。在一个实施例中，例如，制造品可以存储可执行计算机程序指令，它们在被计算机执行时使得计算机执行按照所描述的实施例的方法和/或操作。可执行计算机程序指令可包括任何适当类型的代码，诸如源代码、编译的代码、解释的代码、可执行代码、静态代码、动态代码等等。可执行计算机程序指令可以按照预定义的计算机语言、方式或语法被实施，用于指令计算机去执行一定的功能。指令可以通过使用任何适 当的高级、低级、面向对象的、视觉的、编译的和/或解释的编程语言而被实施。
一些实施例可以通过使用表达“一个实施例”或“某个实施例”连同它们的派生词而被描述。这些术语是指结合实施例描述的特定特征、结构或特性被包括在至少一个实施例中。在申请书的各个地方出现的词组“在一个实施例中”不一定必须全都指同一个实施例。
可以理解的是，以上实施方式仅仅是为了说明本公开的原理而采用的示例性实施方式，然而本公开并不局限于此。对于本领域内的普通技术人员而言，在不脱离本公开的精神和实质的情况下，可以做出各种变型和改进，这些变型和改进也视为本公开的保护范围。

Claims (22)

  1. 一种用于控制增强现实设备的显示的方法，包括：
    控制设备从预先设置的数据集合中查询出与获取的增强现实设备的用户的身份信息对应的色觉灵敏度信息；
    控制设备根据所查询出的色觉灵敏度信息判断所述用户是否是色彩识别障碍症患者；
    控制设备在判断出所述用户是色彩识别障碍症患者时，获取与所述色觉灵敏度信息对应的个性化色彩显示模式来作为目标色彩显示模式；和
    控制设备向该增强现实设备提供该目标色彩显示模式以使该增强现实设备采用该目标色彩显示模式进行图像显示。
  2. 根据权利要求1所述的方法，其中，在所述查询之前，该方法还包括：
    所述控制设备获取所述增强现实设备采集的所述用户的身份信息；和
    所述控制设备查询以确定所述预先设置的数据集合中是否包括所采集的用户的身份信息；以及
    所述控制设备在查询出所述采集的用户的身份信息时，从预先设置的数据集合中查询出与所述采集的用户的身份信息对应的色觉灵敏度信息。
  3. 根据权利要求2所述的方法，还包括：在所述控制设备从预先设置的数据集合中未查询出所述采集的用户的身份信息时，所述控制设备启动对所述用户的色觉灵敏度测试，以得到与用户的身份信息对应的色觉灵敏度信息；且
    所述控制设备基于测试得到的色觉灵敏度信息判断用户是否是色彩识别障碍症患者。
  4. 根据权利要求3所述的方法，还包括：所述控制设备将所采集的用户的身份信息和测试得到的色觉灵敏度信息关联地存储到所述数据集合中。
  5. 根据权利要求1所述的方法，其中，在向所述增强现实设备提供该目标色彩显示模式之前，该方法还包括：
    获取所述增强现实设备检测到的环境亮度信息和用户视野环境颜色信息；
    根据所述色觉灵敏度信息、所述环境亮度信息和所述用户视野环境颜色信息，生成对于图像中的每个亚像素的补偿参数；
    根据每个亚像素的补偿参数对每个亚像素的数据信号进行补偿，生成补偿后的数据信号；以及
    随该目标色彩显示模式一起向所述增强现实设备提供所述补偿后的数据信号，以使所述增强现实设备采用所述目标色彩显示模式，基于补偿后的数据信号进行图像显示。
  6. 根据权利要求5所述的方法，其中，所述生成每个亚像素的补偿参数包括：
    所述控制设备根据所述色觉灵敏度信息、所述环境亮度信息和所述用户视野环境颜色信息，生成对于图像中的每个像素的数据信号目标值，每个像素包括多个亚像素；和
    所述控制设备根据每个像素的数据信号目标值，生成每个亚像素的补偿参数。
  7. 根据权利要求1所述的方法，其中，所述获取与所述色觉灵敏度信息对应的个性化色彩显示模式包括：
    所述控制设备指令所述增强现实设备输出与所述色觉灵敏度信息对应的个性化色彩显示模式的多个选项，以使得所述用户能确定该多个选项中是否包括用户期望的个性化色彩显示模式，若是，则获取所述用户确定的一个个性化色彩显示模式；若否，则所述控制设备指令所述增强现实设备输出另外多个与所述色觉灵敏度信息对应的个性化色彩显示模式的选项，以使得所述用户能继续执行所述确定步骤。
  8. 根据权利要求1所述的方法，还包括：
    所述控制设备在判断出所述用户不是色彩识别障碍症患者时，获取与所述色觉灵敏度信息对应的标准化色彩显示模式作为目标色彩显示模式。
  9. 一种控制设备，包括：
    查询模块，用于从预先设置的数据集合中查询出与获取的增强现实设备的用户的身份信息对应的色觉灵敏度信息；
    判断模块，用于根据所查询出的色觉灵敏度信息判断所述用户是 否是色彩识别障碍症患者；和
    色彩模式获取模块，用于在所述判断模块判断出所述用户是色彩识别障碍症患者时，获取与所述色觉灵敏度信息对应的个性化色彩显示模式来作为目标色彩显示模式，以及向该增强现实设备提供该目标色彩显示模式以使该增强现实设备采用所述目标色彩显示模式进行图像显示。
  10. 根据权利要求9所述的控制设备，其中，所述查询模块还用于获取所述增强现实设备采集的用户的身份信息，查询并确定所述预先设置的数据集合中是否包括所述采集的用户的身份信息，以及在查询出所述采集的用户的身份信息时，从预先设置的数据集合中查询出与所述采集的用户的身份信息对应的色觉灵敏度信息。
  11. 根据权利要求10所述的控制设备，其中，所述查询模块在未查询出所述采集的用户的身份信息时启动对所述用户的色觉灵敏度测试，以得到与用户的身份信息对应的色觉灵敏度信息；以及所述判断模块还用以基于测试得到的色觉灵敏度信息来判断用户是否是色彩识别障碍症患者。
  12. 根据权利要求11所述的控制设备，还包括：存储模块，用于存储所述预先设置的数据集合，且用于将所述采集的用户的身份信息和测试得到的色觉灵敏度信息关联地存储至该数据集合中。
  13. 根据权利要求10所述的控制设备，还包括：
    补偿模块，用于根据所述色觉灵敏度信息以及所述增强现实设备检测到的环境亮度信息和用户视野环境颜色信息，生成对于该图像中的每个亚像素的补偿参数；根据每个亚像素的补偿参数对每个亚像素的数据信号进行补偿，生成补偿后的数据信号；以及随该目标色彩显示模式一起向所述增强现实设备提供所述补偿后的数据信号，以使所述增强现实设备采用所述目标色彩显示模式，基于补偿后的数据信号进行图像显示。
  14. 根据权利要求10所述的控制设备，其中，所述色彩模式获取模块还用于在所述判断模块判断出所述用户不是色彩识别障碍症患者时，获取与正常色彩显示对应的标准化色彩显示模式作为目标色彩显示模式。
  15. 一种增强现实设备，包括：
    显示模块，用于按照色彩显示模式显示图像；和
    显示模式设定模块，用于为所述显示模块设定色彩显示模式，所述色彩显示模式包括在增强现实设备的用户为色彩识别障碍症患者的情况下的至少一个个性化色彩显示模式和在该用户为正常色彩识别者的情况下的标准色彩显示模式；
    其中该显示模式设定模块被配置为接收来自控制设备的目标色彩显示模式且将其设定为用于显示模块的色彩显示模式，所述目标色彩显示模式对应于该增强现实设备的用户的色觉灵敏度信息。
  16. 根据权利要求15所述的增强现实设备，还包括身份信息获取模块，用于采集用户的身份信息，且将所采集的用户的身份信息提供给所述控制设备，以使得控制设备能基于该采集的用户的身份信息来查询与之对应的色觉灵敏度信息。
  17. 根据权利要求15所述的增强现实设备，还包括检测模块，用于检测出环境亮度信息和用户视野环境颜色信息，且将所检测的信息提供给所述控制设备以使得控制设备能基于所述色觉灵敏度信息以及环境亮度信息和用户视野环境颜色信息生成针对图像的每个亚像素的补偿后的数据信号；
    所述显示模块还用于采用所接收的目标色彩显示模式，基于补偿后的数据信号进行图像显示。
  18. 根据权利要求15所述的增强现实设备，其中，所述检测模块包括：
    环境亮度传感器，用于感测出环境亮度信息；和
    视野环境颜色传感器，用于感测出用户视野环境颜色信息。
  19. 根据权利要求17所述的增强现实设备，包括作为本体的增强现实眼镜，该增强现实眼镜包括镜架和设置于镜架上的镜片，
    其中，所述显示模块、显示模式设定模块、身份信息获取模块和检测模块均被安置于镜架上
  20. 一种增强现实处理系统，包括：
    按照权利要求9至14中任一项所述的控制设备；和
    按照权利要求15至19中任一项所述的增强现实设备。
  21. 一种增强现实设备，包括：
    按照权利要求9至14中任一项所述的控制设备；和
    显示模块，用于按照色彩显示模式显示图像；
    其中所述色彩模式获取模块基于所述目标色彩显示模式设定用于显示模块的色彩显示模式。
  22. 一种计算机存储介质，所述计算机存储介质包含指令，当所述指令被处理器执行时使得所述处理器能够实施权利要求1到8的任一项的方法。
PCT/CN2018/114680 2018-04-25 2018-11-09 用于控制增强现实设备的显示的方法、系统、控制设备和增强现实设备 WO2019205575A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/338,521 US11448875B2 (en) 2018-04-25 2018-11-09 Method, system and control device for controlling display of augmented reality device, and augmented reality device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810378477.1 2018-04-25
CN201810378477.1A CN108563023B (zh) 2018-04-25 2018-04-25 增强现实处理方法、系统、控制设备和增强现实设备

Publications (1)

Publication Number Publication Date
WO2019205575A1 true WO2019205575A1 (zh) 2019-10-31

Family

ID=63536467

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/114680 WO2019205575A1 (zh) 2018-04-25 2018-11-09 用于控制增强现实设备的显示的方法、系统、控制设备和增强现实设备

Country Status (3)

Country Link
US (1) US11448875B2 (zh)
CN (1) CN108563023B (zh)
WO (1) WO2019205575A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2602314A (en) * 2020-12-23 2022-06-29 Continental Automotive Gmbh Augmented reality vehicular display system and method

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108563023B (zh) * 2018-04-25 2020-11-27 京东方科技集团股份有限公司 增强现实处理方法、系统、控制设备和增强现实设备
CN109324417A (zh) * 2018-12-13 2019-02-12 宜视智能科技（苏州）有限公司 助视器及其控制方法、计算机存储介质
CN110443906A (zh) * 2019-07-25 2019-11-12 中新智擎科技有限公司 一种考勤信息呈现的方法、装置及移动终端

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070099969A (ko) * 2006-04-06 2007-10-10 삼성전자주식회사 모바일 디스플레이 장치에서의 색약자를 위한 구현 방법
CN103929605A (zh) * 2014-04-01 2014-07-16 北京智谷睿拓技术服务有限公司 图像呈现控制方法及图像呈现控制装置
CN205510304U (zh) * 2016-02-18 2016-08-24 昆山龙腾光电有限公司 一种辅助色觉障碍用户图像转换的智能装置
CN106488219A (zh) * 2015-08-25 2017-03-08 中兴通讯股份有限公司 图像显示方法及装置
CN106504713A (zh) * 2016-11-21 2017-03-15 四川长虹电器股份有限公司 电视机色觉障碍模式调节系统及方法
CN108563023A (zh) * 2018-04-25 2018-09-21 京东方科技集团股份有限公司 增强现实处理方法、系统、控制设备和增强现实设备

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050011115A (ko) * 2003-07-21 2005-01-29 노용만 색상 감지 미약자를 위한 자동차용 색상 보정 방법 및 장치
CN103870148B (zh) * 2012-12-18 2017-02-08 中兴通讯股份有限公司 一种移动终端及其界面显示方法
CN103778602A (zh) * 2013-12-17 2014-05-07 微软公司 色觉缺陷校正
KR102180528B1 (ko) * 2014-01-06 2020-11-18 삼성전자주식회사 색맹 교정을 위한 전자 장치 및 운영 방법
WO2016017966A1 (en) * 2014-07-29 2016-02-04 Samsung Electronics Co., Ltd. Method of displaying image via head mounted display device and head mounted display device therefor
US9922464B2 (en) * 2016-05-10 2018-03-20 Disney Enterprises, Inc. Occluded virtual image display
CN106782385B (zh) * 2016-12-31 2019-05-10 北京枭龙科技有限公司 一种头戴显示设备的调光方法及其装置
KR102406072B1 (ko) * 2017-06-13 2022-06-10 삼성전자주식회사 압력 입력에 따라 전자 장치의 동작을 제어하는 전자 장치 및 방법
US10536678B2 (en) * 2017-11-27 2020-01-14 International Business Machines Corporation Optimized computer display rendering for user vision conditions

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070099969A (ko) * 2006-04-06 2007-10-10 삼성전자주식회사 모바일 디스플레이 장치에서의 색약자를 위한 구현 방법
CN103929605A (zh) * 2014-04-01 2014-07-16 北京智谷睿拓技术服务有限公司 图像呈现控制方法及图像呈现控制装置
CN106488219A (zh) * 2015-08-25 2017-03-08 中兴通讯股份有限公司 图像显示方法及装置
CN205510304U (zh) * 2016-02-18 2016-08-24 昆山龙腾光电有限公司 一种辅助色觉障碍用户图像转换的智能装置
CN106504713A (zh) * 2016-11-21 2017-03-15 四川长虹电器股份有限公司 电视机色觉障碍模式调节系统及方法
CN108563023A (zh) * 2018-04-25 2018-09-21 京东方科技集团股份有限公司 增强现实处理方法、系统、控制设备和增强现实设备

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2602314A (en) * 2020-12-23 2022-06-29 Continental Automotive Gmbh Augmented reality vehicular display system and method

Also Published As

Publication number Publication date
US20210373326A1 (en) 2021-12-02
CN108563023B (zh) 2020-11-27
US11448875B2 (en) 2022-09-20
CN108563023A (zh) 2018-09-21

Similar Documents

Publication Publication Date Title
WO2019205575A1 (zh) 用于控制增强现实设备的显示的方法、系统、控制设备和增强现实设备
EP3571673B1 (en) Method for displaying virtual image, storage medium and electronic device therefor
US8790280B2 (en) Human state estimating device and method
WO2021004138A1 (zh) 一种屏幕显示方法、终端设备及存储介质
US9489574B2 (en) Apparatus and method for enhancing user recognition
WO2016054860A1 (zh) 针对视觉障碍患者的头戴式视觉辅助系统
KR102322029B1 (ko) 생체 정보 획득 방법 및 이를 위한 장치
KR101998595B1 (ko) 이미지 기반 황달 진단 방법 및 장치
CN107533362A (zh) 眼睛跟踪设备和用于操作眼睛跟踪设备的方法
JP2018505458A (ja) 目追跡システム及び利き目を検出する方法
TW201445457A (zh) 虛擬眼鏡試戴方法及其裝置
CN110568930B (zh) 注视点校准方法及相关设备
CN104382552B (zh) 一种综合视觉功能检测设备
Ananto et al. Color transformation for color blind compensation on augmented reality system
EP3891585A1 (en) Biofeedback method of modulating digital content to invoke greater pupil radius response
US10049599B2 (en) System and method for assisting a colorblind user
CN109634431B (zh) 无介质浮空投影视觉追踪互动系统
CN108828771A (zh) 可穿戴设备的参数调整方法、装置、穿戴设备及存储介质
TWI557601B (zh) 瞳孔追蹤系統及其方法、電腦程式產品、及電腦可讀取紀錄媒體
CN113993441A (zh) 用于交互式测量眼屈光不正、阅读镜加光度和度数的计算机实现方法和系统
CN109008946A (zh) 一种色觉辨认障碍患者个性化视觉参数测量设备及方法
JP2007029333A (ja) 眼部情報処理システム、眼部情報処理方法、眼部情報処理プログラムおよび撮影用アタッチメント
CN108882843A (zh) 视力检查方法、视力检查仪及存储该视力检查方法的程序的下载服务器
US20200098136A1 (en) Information processing device, information processing method, and program
KR101727615B1 (ko) 시력 정보 결정을 위한 사용자 장치, 서버 및 컴퓨터 판독가능 저장 매체에 저장된 프로그램

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18916820

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18916820

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 10/05/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 18916820

Country of ref document: EP

Kind code of ref document: A1