WO2016176950A1 - 头戴式设备及其视觉反馈的方法及装置 - Google Patents

头戴式设备及其视觉反馈的方法及装置 Download PDF

Info

Publication number
WO2016176950A1
WO2016176950A1 PCT/CN2015/090242 CN2015090242W WO2016176950A1 WO 2016176950 A1 WO2016176950 A1 WO 2016176950A1 CN 2015090242 W CN2015090242 W CN 2015090242W WO 2016176950 A1 WO2016176950 A1 WO 2016176950A1
Authority
WO
WIPO (PCT)
Prior art keywords
color
image
display
component
head mounted
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2015/090242
Other languages
English (en)
French (fr)
Inventor
赵思聪
顾嘉唯
张运龙
李磊
李广
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Baidu Online Network Technology Beijing Co Ltd
Original Assignee
Baidu Online Network Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Baidu Online Network Technology Beijing Co Ltd filed Critical Baidu Online Network Technology Beijing Co Ltd
Priority to US15/504,078 priority Critical patent/US10372287B2/en
Publication of WO2016176950A1 publication Critical patent/WO2016176950A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1686—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/18—Packaging or power distribution
    • G06F1/181—Enclosures
    • G06F1/182—Enclosures with special features, e.g. for use in industrial environments; grounding or shielding against radio frequency interference [RFI] or electromagnetical interference [EMI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
    • G06F3/005—Input arrangements through a video camera
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406—Control of illumination source
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/17—Hearing device specific tools used for storing or handling hearing devices or parts thereof, e.g. placement in the ear, replacement of cerumen barriers, repair, cleaning hearing devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/033—Headphones for stereophonic communication
    • H04R5/0335—Earpiece support, e.g. headbands or neckrests

Definitions

  • the present application relates to the field of electronic device technologies, and in particular, to the field of wearable electronic devices, and in particular, to a head mounted device and a method and apparatus for visual feedback thereof.
  • head-mounted smart wearable devices have the functions of photographing and photographing, and a visual feedback function is also required on these head-mounted smart wearable devices.
  • Visual feedback is an important channel for human-computer interaction, affecting the efficiency of information communication and the user's interactive experience.
  • the user can determine the target object (viewing orientation) captured by the current head-mounted smart wearable device through visual feedback, thereby effectively adjusting the shooting angle and direction of the head-mounted smart wearable device.
  • the traditional head-mounted device performs visual feedback by displaying the currently captured view image.
  • the defect of this technology is that the viewfinder image of the visual feedback and the user's field of view are easy to interfere with each other, and the ease of use is poor.
  • the present invention provides a head-mounted device and a visual feedback method and device thereof, which solve the technical problem that the viewfinder image of the visual feedback and the user's field of view are easy to interfere with each other and the ease of use is poor.
  • the present application provides a head mounted device, the headset comprising: a support, an image capture component, a display component, and a processor; wherein the image capture component and the display component are disposed on the bracket, and when the head mounted device is in a use state, the display component is The image capturing component is configured to acquire a framing image; the processor acquires a framing image acquired by the image capturing component, determines an indication color to be displayed based on the framing image, and controls the display The component displays the indicator color to indicate to the user the view orientation of the image capture component.
  • the processor is configured to: acquire a color value of each pixel in a predetermined range in the view image; determine the indication color according to a color value of each pixel in the predetermined range .
  • the processor determines a color value of a maximum number of corresponding pixel points in the predetermined range as a color value of the indicated color; or the processor sets the pixel within the predetermined range The mean value of the color values of the dots is determined as the color value of the indicated color.
  • the predetermined range is a central region of the view image.
  • the display component comprises a full color LED light or a full color display.
  • the full color display comprises at least one of: a full color LED display, and a full color OLED display.
  • the present application provides a head mounted device, including: a bracket, an image capturing component, a display component, and a communication unit; wherein the image capturing component and the display component are disposed in the On the bracket, and when the head mounted device is in a use state, the display component is within a visual perception range of the user; the image acquisition component is configured to acquire a view image; the communication unit is configured to The image captured by the image capture component is transmitted to the cloud processor, and the cloud processor determines the indicator color to be displayed based on the view image, and receives the determined indicator color information sent by the cloud processor; the display The component is configured to display the indication color according to the information indicating the color to indicate to the user the viewing orientation of the image acquisition component.
  • the present application provides a visual feedback method for a head mounted device, the method comprising: acquiring an acquired view image; determining an indication color to be displayed based on the view image; displaying the indication color To indicate to the user the viewing orientation.
  • the determining the indicator to be displayed based on the view image Color comprising: acquiring a color value of each pixel in a predetermined range in the framing image; determining the indication color according to a color value of each pixel in the predetermined range.
  • the determining the color according to the color value of each pixel in the predetermined range comprises: determining a color value of a maximum number of corresponding pixel points in the predetermined range as Determining a color value of the color; or determining an average value of the color values of the pixel points within the predetermined range as the color value of the indicated color.
  • the indicator color is displayed using a full color LED light or a full color display.
  • the present application provides a visual feedback device for a head mounted device, the device comprising: an acquiring unit, configured to acquire an acquired framing image; and a determining unit, configured to determine, according to the framing image The indicator color displayed; the display unit is configured to display the indicator color to indicate the viewing orientation to the user.
  • the determining unit includes: a color value acquiring subunit for acquiring a color value of each pixel in a predetermined range in the through image; and a color determining subunit for using the predetermined The color value of each pixel within the range determines the indicated color.
  • the indication color determining subunit is configured to: determine a color value of a maximum number of corresponding pixel points in the predetermined range as a color value of the indicated color; or The average of the color values of the pixels within the range is determined as the color value of the indicated color.
  • the head-mounted device and the visual feedback method and the device thereof provided by the present application realize the purpose of indicating the framing orientation to the user by displaying the indication color determined based on the collected framing image to the user, and solving the problem in the prior art.
  • the visual feedback of the head-mounted device and the user's field of view are easy to interfere with each other, which improves the efficiency of information transmission.
  • FIG. 1 is an exemplary structural diagram of a head mounted device according to an embodiment of the present application.
  • FIG. 2 is a schematic diagram of a head mounted device according to an embodiment of the present application when in use;
  • FIG. 3 is a flowchart of an embodiment of a visual feedback method for a head mounted device according to an embodiment of the present application
  • FIG. 4 is a flowchart of an embodiment of a method for determining an indication color to be displayed based on a view image according to an embodiment of the present application
  • FIG. 5 is a schematic structural diagram of an embodiment of a visual feedback apparatus for a head mounted device according to an embodiment of the present application
  • FIG. 6 is an exemplary system architecture that can be applied to an embodiment of the present application provided by an embodiment of the present application.
  • the head mounted device of the present application has a function of photographing and/or photographing.
  • a head mounted device having a camera and/or camera function may include, but are not limited to, smart glasses, head mounted digital cameras, smart helmets, and the like.
  • FIG. 1 shows an exemplary structure of the head mounted device of the present application.
  • the head mounted device 100 includes a stand 101, an image capture component 102, a display component 103, and a processor (not shown).
  • the image capturing component 102 and the display component 103 are disposed on the bracket 101, and when the head mounted device 100 is in the use state, the display component 103 is within the visual perception range of the user.
  • the image acquisition component 102 is configured to acquire a framing image.
  • the processor acquires the framing image acquired by the acquisition component 102, determines the indication color to be displayed based on the framing image, and controls the display component 103 to display the indication color to indicate the framing orientation of the image acquisition component 102 to the user.
  • the head mounted device 100 includes an image capturing group in addition to the bracket 101.
  • components and/or components such as an ophthalmic lens, a recording component, and a loudspeaker may also be included.
  • the head mounted device 100 may also include other components and/or components.
  • the various components and/or components included in the head mounted device 100 may be disposed on the bracket 101.
  • the components and/or components may be fixedly disposed on the bracket 101 or may be adjustably disposed on the bracket 101. It can be understood that the manner in which the various components and/or components included in the head mounted device are disposed on the bracket is not limited.
  • the image acquisition component 102 is configured to acquire a framing image. Specifically, when taking a picture or capturing a picture, firstly, the image capturing component 102 is required to perform real-time framing, that is, obtaining a multi-frame framing image every second (for example, obtaining twelve frames or twenty-four frames of framing images per second). In the prior art, the framing image is directly displayed as a visual feedback image on the framing screen for the user to browse. When the user is satisfied with the framing image, the photographic operation is performed, and a photo or video corresponding to the framing image is captured.
  • the photographer when photographing or photographing, the photographer usually wants to capture the focus of attention (eg, a person, an object, and the like that is desired to be photographed) within a certain range of the center of the image near the photo or video. Whether the focus of attention can be captured within a certain range of the center of the image near the photo or video depends on the orientation of the image capture component (ie, the direction and angle of the image capture component).
  • the image capturing assembly is fixed at a certain position, and the user can roughly determine an approximate range of the viewing orientation according to the fixed position thereof.
  • the things around us are generally rich in color. If you can know the color of a certain range (such as the center range) in the image, then the user can combine the fixed position of the image acquisition component mentioned in the above aspect to determine the position. The orientation of the image capture component.
  • the framing image is transmitted to the processor, and the obtained framing image is analyzed and processed by the processor to determine the indicator color for visual feedback.
  • the processor controls the display component to display the indicated color to indicate to the user the view orientation of the image capture component. For example, as shown in FIG. 2, when the head mounted device is in use, the image capture component 102 is located above the left eye of the user 104, and the user 104 can generally determine that the viewfinder orientation is in front of the left eye according to the position of the image capture component 102. Within a certain range of the party. Further, the user 104 can display the display The indicator color displayed by the display component 103 determines the viewing orientation.
  • the user cannot temporarily determine the framing orientation according to the indicated color of the visual feedback. At this time, the user can slowly adjust the framing direction of the image capturing component 102 according to the indicated color. The change is determined by the orientation.
  • the display component when the head mounted device is in use, the display component should be within the visual perception range of the user. Since the display component displays color, the user does not need to clearly recognize the image. Therefore, on the one hand, when the head mounted device is in use, the display component only needs to be within the color perception range of the user's vision. On the other hand, the size of the display component can be made much smaller than the display screen for displaying the framing image in the prior art as long as the user can recognize the color displayed by the display component.
  • the head mounted device of the present application has more The advantages of power saving.
  • the head-mounted device provided by the above embodiment of the present application achieves the purpose of indicating the view orientation of the image acquisition component to the user by displaying the indication color determined based on the acquired view image to the user, and solves the problem in the prior art.
  • the visual feedback of the head-mounted device and the user's field of view are easy to interfere with each other, which improves the efficiency of information transmission.
  • the display component can be a full color display, and the full color display is a display capable of displaying the true color of the object, such as a full color LED display, or a full color OLED. Display and more.
  • the display component can also be a full color LED light. It can control almost all people by controlling three kinds of LED lamp bead chips of red, green and blue (R, G, B) according to the principle of optical three primary colors (all colors can be mixed with a certain proportion of red, green and blue in three colors). The color visible to the eye.
  • the use of full-color LED lights can also save more power, reduce the power consumption of the head-mounted device, and extend the battery life.
  • the processor is configured to: acquire a color value for each pixel within a predetermined range in the framing image.
  • the indication color is determined according to the color value of each pixel in the predetermined range.
  • the processor determines the indication color to be displayed based on the framing image. Specifically, first, the above viewfinder is acquired.
  • the predetermined range is the central area of the above-mentioned framing image (that is, the center of the predetermined range is the center of the above-mentioned framing image).
  • the predetermined range may be a circular area including a predetermined number of pixel points centering on a center of the above-mentioned framing image.
  • the predetermined range may be centered on the center of the framing image, and includes 1600 The circular area of the pixel.
  • the predetermined range may be a rectangular area including a predetermined number of pixels centering on the center of the above-mentioned framing image.
  • the predetermined range may be centered on the center of the framing image, and includes 1600. A rectangular area of pixels. It is to be understood that the specific shape of the predetermined range and the size of the range are not limited.
  • the indication color is determined according to the color value of each pixel in the predetermined range.
  • the color value of each pixel in the predetermined range in the framing image may be analyzed, and the color value corresponding to the maximum number of the corresponding pixel points is determined as the color value indicating the color.
  • the mean value of the color values in the predetermined range in the framing image may also be calculated, and the average value is determined as the color value indicating the color.
  • a histogram of the color distribution within a predetermined range in the framing image may also be acquired, and the color value of the indicated color is determined according to the distribution of the color in the framing image. It will be appreciated that there may be other ways of determining the indicated color.
  • the head mounted device includes a stand, an image capture component, a display component, and a communication unit.
  • the image capturing component and the display component are disposed on the bracket, and when the head mounted device is in the use state, the display component is within the visual perception range of the user.
  • the image acquisition component is used to capture the framing image.
  • the communication unit is configured to transmit the framing image collected by the image acquisition component to the cloud processor, so that the cloud processor determines the indication color to be displayed based on the framing image, and receives the determined indication color information sent by the cloud processor.
  • the display component is configured to display the indication color according to the information indicating the color to indicate to the user the viewing orientation of the image capturing component.
  • the information indicating the color is information capable of identifying the indicated color, for example, a name indicating the color, identification information indicating the color, a color value indicating the color, and the like.
  • the communication unit of the head mounted device can transmit the view image collected by the acquisition component to the cloud processor, and the cloud processor determines the indicator color to be displayed based on the view image. Therefore, in the embodiment, it is determined that the indication color to be displayed is On the cloud processor, the cloud processor determines the indicator color and returns the result to the headset through the communication unit of the headset.
  • the cloud processor may be, for example, a remote server, or may be an intelligent mobile electronic device such as a mobile phone or a tablet computer that authenticates the user.
  • the head mounted device of the embodiment does not have a processor, but transmits the view image collected by the acquisition component to the cloud processor via the communication unit, and receives the cloud processor. As a result, the indication color is displayed according to the result, thereby realizing visual feedback of the head mounted device.
  • the structure of the head mounted device described in this embodiment can be referred to the respective structures in the head mounted device described in FIGS. 1-2. Therefore, the various structural components and features described above for the head mounted device are also applicable to the head mounted device described in this embodiment, and details are not described herein again.
  • FIG. 3 a flow 300 of one embodiment of a visual feedback method for a head mounted device of the present application is illustrated.
  • step 301 the captured view image is acquired.
  • step 302 an indication color to be displayed is determined based on the above-described view image.
  • step 303 the above indicated color is displayed to indicate the viewing orientation to the user.
  • the framing image is directly displayed as a visual feedback image on the framing screen for the user to browse.
  • the things around us are generally rich in color. If we can know the color of a certain range (such as the center range) in the image, then the user can combine the position of the device (such as the camera) that captures the image to determine the orientation of the view.
  • the indication color for visual feedback is determined, and the indication color is displayed to indicate the framing orientation to the user.
  • the full color LED light or the full color display screen can be used to display the indication color.
  • a flow 400 of one embodiment of a method of determining an indication color to be displayed based on a viewfinder image is illustrated.
  • step 401 color values of each pixel in a predetermined range in the framing image are acquired.
  • step 402 the indicator color is determined based on the color value of each pixel within the predetermined range.
  • the predetermined range is the central area of the above-mentioned framing image (that is, the center of the predetermined range is the center of the above-mentioned framing image).
  • the present application is not limited to the specific shape of the predetermined range and the size of the range.
  • the indication color is determined according to the color value of each pixel in the predetermined range.
  • the color value of each pixel in the predetermined range in the framing image may be analyzed, and the color value corresponding to the maximum number of the corresponding pixel points is determined as the color value indicating the color.
  • the mean value of the color values in the predetermined range in the framing image may also be calculated, and the average value is determined as the color value indicating the color.
  • a histogram of the color distribution within a predetermined range in the framing image may also be acquired, and the color value of the indicated color is determined according to the distribution of the color in the framing image. It will be appreciated that there may be other ways of determining the indicated color.
  • FIG. 5 a block diagram of one embodiment of a visual feedback device for a head mounted device in accordance with the present application is shown.
  • the apparatus 500 of this embodiment includes: an obtaining unit 501, a determining unit 502, and a display unit 503.
  • the acquiring unit 501 is configured to acquire the captured framing image.
  • the determining unit 502 is configured to determine an indication color to be displayed based on the through image.
  • the display unit 503 is configured to display the indication color to indicate the viewing orientation to the user.
  • the determining unit 502 includes a color value acquisition subunit and an indication color determination subunit (not shown).
  • the color value acquisition subunit is used to acquire the framing image The color value of each pixel within the predetermined range.
  • the indication color determining subunit is configured to confirm the above indicated color according to the color value of each pixel in the predetermined range.
  • the indication color determining subunit is configured to determine a color value that is the largest number of corresponding pixel points within a predetermined range as a color value indicating the color. Or determining the mean value of the color values of the pixel points within the predetermined range as the color value indicating the color.
  • apparatus 500 corresponds to various steps in the various structures and methods of the head mounted device described with reference to Figures 1-4.
  • the device 500 may be preset in the head mounted device, or may be loaded into the head mounted device by downloading or the like.
  • Corresponding units in device 500 can cooperate with units in the head mounted device to implement a solution for visual feedback of the head mounted device.
  • FIG. 6 illustrates an exemplary system architecture 600 in which embodiments of the present application may be applied.
  • system architecture 600 can include terminal device 601, headset 602, network 603, and server 604.
  • Network 603 is used to provide a medium for communication links between terminal device 601, headset 602, and server 604.
  • Network 603 can include a variety of connection types, such as wired, wireless communication links, fiber optic cables, and the like.
  • the user 610 can interact with the server 604 through the network 603 using the terminal device 601 and the head mounted device 602 to receive or transmit a message or the like.
  • Various communication client applications such as instant messaging tools, email clients, social platform software, etc., can be installed on the terminal device 601.
  • the terminal device 601 can be a variety of electronic devices including, but not limited to, personal computers, smart phones, smart watches, tablets, personal digital assistants, and the like.
  • the head mounted device 602 can be a variety of head mounted devices having camera and/or camera functions including, but not limited to, smart glasses, head mounted digital cameras, smart helmets, and the like.
  • Server 604 can be a server that provides various services.
  • the server can store, analyze, and the like the received data, and feed the processing result back to the head mounted device.
  • the method for visual feedback of the head mounted device may be performed by the head mounted device 602, or may be performed by the terminal device 601 or the server 604 for visual feedback of the head mounted device.
  • the device can be disposed on the head mounted device 602 It can also be set in the terminal device 601 or the server 604.
  • the step of determining the indicator color to be displayed based on the view image may be performed in the server 604 or the terminal device 601, or may be performed in the head mounted device 602.
  • the indication color to be displayed is determined based on the view image, if the network 603 is unobstructed, the information indicating the color may be returned by the server 604 or the terminal device 601, and if there is no network or the network 603 is not smooth, it may be in the head-mounted manner. A determination is made in device 602.
  • terminal devices head mounted devices, networks, and servers in FIG. 6 is merely illustrative. Depending on the implementation needs, there can be any number of terminal devices, networks, and servers.
  • the unit modules described in the embodiments of the present application may be implemented by software or by hardware.
  • the described unit modules may also be provided in the processor, for example, as a processor including an acquisition unit, a determination unit, and a display unit.
  • the name of these unit modules does not constitute a limitation on the unit module itself in some cases.
  • the acquisition unit may also be described as “a unit for acquiring the captured view image”.
  • the present application further provides a computer readable storage medium, which may be a computer readable storage medium included in the apparatus described in the foregoing embodiment, or may exist separately, not A computer readable storage medium that is assembled into a terminal.
  • the computer readable storage medium stores one or more programs that are used by one or more processors to perform the methods of visual feedback for a head mounted device as described herein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Multimedia (AREA)
  • Electromagnetism (AREA)
  • Power Engineering (AREA)
  • Studio Devices (AREA)
  • Indication In Cameras, And Counting Of Exposures (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Analysis (AREA)

Abstract

一种头戴式设备（100）及其视觉反馈的方法及装置。所述头戴式设备（100）包括：支架（101），图像采集组件（102），显示组件（103）及处理器；其中，所述图像采集组件（102）和所述显示组件（103）设置于所述支架（101）上，并且，在所述头戴式设备（100）处于使用状态时，所述显示组件（103）在用户（104）的视觉感知范围内；所述图像采集组件（102）用于采集取景图像；所述处理器获取所述图像采集组件（102）采集的取景图像，基于所述取景图像确定待显示的指示颜色，并控制所述显示组件（103）显示所述指示颜色，以向用户（104）指示所述图像采集组件（102）的取景方位。实现了向用户指示取景方位的目的，解决了现有技术中用于头戴式设备的视觉反馈的取景图像和用户的视野易相互干扰的问题，提高了信息传达的效率。

Description

头戴式设备及其视觉反馈的方法及装置
相关申请的交叉引用
本申请要求百度在线网络技术(北京)有限公司于2015年5月6日提交的、发明名称为“头戴式设备及其视觉反馈的方法及装置”的、中国专利申请号“201510226606.1”的优先权，其全部内容作为整体并入本申请中。
技术领域
本申请涉及电子设备技术领域，具体涉及穿戴式电子设备技术领域，尤其涉及头戴式设备及其视觉反馈的方法及装置。
背景技术
随着电子技术的不断发展，各种穿戴设备应运而生。目前，有些头戴式智能穿戴设备具有拍照和摄像的功能，在这些头戴式智能穿戴设备上还需要具有视觉反馈的功能。视觉反馈是人机交互的重要渠道，影响信息传达的效率和用户的交互体验。用户可以通过视觉反馈确定当前头戴式智能穿戴设备所拍摄的目标对象(取景方位)，从而有效的调整头戴式智能穿戴设备的拍摄角度和方向。
传统的头戴设备通过显示当前采集的取景图像进行视觉反馈，这种技术的缺陷在于：视觉反馈的取景图像和用户的视野易相互干扰，易用性差。
发明内容
本申请提供了一种头戴式设备及其视觉反馈的方法及装置，解决了现有技术中视觉反馈的取景图像和用户的视野易相互干扰，易用性差的技术问题。
第一方面，本申请提供了一种头戴式设备，所述头戴式设备包括： 支架，图像采集组件，显示组件及处理器；其中，所述图像采集组件和所述显示组件设置于所述支架上，并且，在所述头戴式设备处于使用状态时，所述显示组件在用户的视觉感知范围内；所述图像采集组件用于采集取景图像；所述处理器获取所述图像采集组件采集的取景图像，基于所述取景图像确定待显示的指示颜色，并控制所述显示组件显示所述指示颜色，以向用户指示所述图像采集组件的取景方位。
在某些实施方式中，所述处理器配置用于：获取所述取景图像中预定范围内每个像素点的色值；根据所述预定范围内每个像素点的色值确定所述指示颜色。
在某些实施方式中，所述处理器将所述预定范围内对应的像素点的个数最多的色值确定为所述指示颜色的色值；或者所述处理器将所述预定范围内像素点的色值的均值确定为所述指示颜色的色值。
在某些实施方式中，所述预定范围为所述取景图像的中心区域。
在某些实施方式中，所述显示组件包括全彩LED灯或者全彩显示屏。
在某些实施方式中，所述全彩显示屏包括以下至少一种：全彩LED显示屏，以及全彩OLED显示屏。
第二方面，本申请提供了一种头戴式设备，所述头戴式设备包括：支架，图像采集组件，显示组件及通信单元；其中，所述图像采集组件和所述显示组件设置于所述支架上，并且，在所述头戴式设备处于使用状态时，所述显示组件在用户的视觉感知范围内；所述图像采集组件用于采集取景图像；所述通信单元用于将所述图像采集组件采集的取景图像传输至云端处理器，以供所述云端处理器基于所述取景图像确定待显示的指示颜色，接收所述云端处理器发送的确定的指示颜色的信息；所述显示组件用于根据所述指示颜色的信息显示所述指示颜色，以向用户指示所述图像采集组件的取景方位。
第三方面，本申请提供了一种用于头戴式设备的视觉反馈方法，所述方法包括：获取采集到的取景图像；基于所述取景图像确定待显示的指示颜色；显示所述指示颜色，以向用户指示取景方位。
在某些实施方式中，所述基于所述取景图像确定待显示的指示颜 色，包括：获取所述取景图像中预定范围内每个像素点的色值；根据所述预定范围内每个像素点的色值确定所述指示颜色。
在某些实施方式中，所述根据所述预定范围内每个像素点的色值确定所述指示颜色，包括：将所述预定范围内对应的像素点的个数最多的色值确定为所述指示颜色的色值；或者将所述预定范围内像素点的色值的均值确定为所述指示颜色的色值。
在某些实施方式中，采用全彩LED灯或者全彩显示屏显示所述指示颜色。
第四方面，本申请提供了一种用于头戴式设备的视觉反馈装置，所述装置包括：获取单元，用于获取采集到的取景图像；确定单元，用于基于所述取景图像确定待显示的指示颜色；显示单元，用于显示所述指示颜色，以向用户指示取景方位。
在某些实施方式中，所述确定单元包括：色值获取子单元，用于获取所述取景图像中预定范围内每个像素点的色值；指示颜色确定子单元，用于根据所述预定范围内每个像素点的色值确定所述指示颜色。
在某些实施方式中，所述指示颜色确定子单元配置用于：将所述预定范围内对应的像素点的个数最多的色值确定为所述指示颜色的色值；或者将所述预定范围内像素点的色值的均值确定为所述指示颜色的色值。
本申请提供的头戴式设备及其视觉反馈的方法及装置，通过向用户显示基于采集的取景图像确定的指示颜色，从而实现了向用户指示取景方位的目的，解决了现有技术中用于头戴式设备的视觉反馈的取景图像和用户的视野易相互干扰的问题，提高了信息传达的效率。
附图说明
通过阅读参照以下附图所作的对非限制性实施例所作的详细描述，本申请的其它特征、目的和优点将会变得更明显：
图1是本申请实施例提供的头戴式设备的一种示例性结构图；
图2是本申请实施例提供的头戴式设备处于使用状态时的一种示意图；
图3是本申请实施例提供的用于头戴式设备的视觉反馈方法的一个实施例的流程图；
图4是本申请实施例提供的基于取景图像确定待显示的指示颜色的方法的一个实施例的流程图；
图5是本申请实施例提供的用于头戴式设备的视觉反馈装置的一个实施例的结构示意图；
图6是本申请实施例提供的可以应用本申请实施例的示例性系统架构。
具体实施方式
下面结合附图和实施例对本申请作进一步的详细说明。可以理解的是，此处所描述的具体实施例仅仅用于解释相关发明，而非对该发明的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与有关发明相关的部分。
需要说明的是，在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互组合。下面将参考附图并结合实施例来详细说明本申请。
本申请所涉及的头戴式设备具有拍照和/或摄像的功能。出于示例描述目的以及为了简洁起见，在接下来的讨论中，结合具有拍照和/或摄像功能的头戴式设备来描述本申请的示例性实施例。头戴式设备可以包括但不限于智能眼镜、头戴式数码相机以及智能头盔等等。
请参考图1，其示出了本申请头戴式设备的一种示例性结构。
如图1所示，头戴式设备100包括支架101，图像采集组件102，显示组件103以及处理器(未示出)。其中，图像采集组件102和显示组件103设置于支架101上，并且，在头戴式设备100处于使用状态时，显示组件103在用户的视觉感知范围内。图像采集组件102用于采集取景图像。处理器获取采集组件102采集的取景图像，基于取景图像确定待显示的指示颜色，并控制显示组件103显示指示颜色，以向用户指示图像采集组件102的取景方位。
在本实施例中，头戴式设备100除了包括支架101，图像采集组 件102，显示组件103以及处理器以外，还可以包括譬如眼镜片，录音组件以及扩音器等部件和/或组件。可以理解，头戴式设备100还可以包括其它部件和/或组件。头戴式设备100包括的各种部件和/或组件可以设置于支架101上，这些部件和/或组件可以固定的设置于支架101上，也可以可调整的设置于支架101上。可以理解，本申请对头戴式设备包括的各种部件和/或组件在支架上的设置方式不限定。
图像采集组件102用于采集取景图像。具体来说，在进行拍照或摄像时，首先需要通过图像采集组件102进行实时的取景，即每秒获得多帧取景图像，(如每秒获得十二帧或者二十四帧取景图像)。在现有技术中，是直接将取景图像作为视觉反馈图像，显示在取景屏幕上以供用户浏览，当用户对取景图像满意后，执行拍摄的操作，拍摄出与取景图像对应的照片或视频。
需要说明的是，在拍照或者摄像时，拍摄者通常希望将关注的焦点(如，想要拍摄的人物，物体等)拍到靠近照片或视频的图像中心的一定范围内。而关注的焦点是否能被拍到靠近照片或视频的图像中心的一定范围内，取决于图像采集组件取景的方位(即图像采集组件拍摄的方向及角度)。
对于具有拍照和/或摄像功能的头戴式设备来说，一方面，图像采集组件固定于某个位置，用户能够根据其固定的位置大体判断出其取景方位的一个大概范围。另一方面，我们周围的事物一般颜色比较丰富，如果能够获知取景图像中一定范围(如中心范围)的颜色，那么用户可以结合上一方面中提到的图像采集组件固定的位置，大体判断出图像采集组件取景的方位。
因此，在本实施例中，图像采集组件采集到取景图像后，将取景图像传递给处理器，由处理器对获取到的取景图像进行分析处理，确定用于视觉反馈的指示颜色。然后，处理器控制显示组件显示上述指示颜色，以向用户指示图像采集组件的取景方位。例如，如图2所示，在头戴式设备处于使用状态时，图像采集组件102位于用户104左眼上方的位置，用户104能够根据图像采集组件102的位置大体判断出其取景方位在左眼前方的一定范围内。进一步，用户104可以根据显 示组件103显示的指示颜色确定取景方位。如果用户104左眼前方很多区域的颜色均与指示颜色接近，则用户暂时无法根据视觉反馈的指示颜色确定取景方位，此时，用户可以慢慢调整图像采集组件102的取景方向，根据指示颜色的变化情况确定取景方位。
需要说明的是，在头戴式设备处于使用状态时，显示组件应该处于用户的视觉感知范围内，由于显示组件显示的是颜色，因此，用户不需要清楚的辨识图像。所以，一方面，在头戴式设备处于使用状态时，显示组件只需要处于用户视觉的颜色感知范围内即可。另一方面，显示组件的尺寸可以做的远小于现有技术中用于显示取景图像的显示屏幕，只要用户能辨识显示组件显示的颜色即可。因此，即使本申请的显示组件与现有技术中用于显示取景图像的显示屏幕的材料相同，但由于本申请的显示组件尺寸可以做的很小，所以，本申请的头戴式设备具有更省电的优点。
本申请的上述实施例提供的头戴式设备，通过向用户显示基于采集的取景图像确定的指示颜色，从而实现了向用户指示图像采集组件的取景方位的目的，解决了现有技术中用于头戴式设备的视觉反馈的取景图像和用户的视野易相互干扰的问题，提高了信息传达的效率。
在一些可选实施方式中，在一种实现中，显示组件可以是全彩显示屏，全彩显示屏为能够显示物体真实的颜色的显示屏，例如，全彩LED显示屏，或者全彩OLED显示屏等等。在另一种实现中，显示组件还可以是全彩LED灯。可以通过控制红、绿、蓝(R、G、B)三种LED灯珠芯片，按光学三原色原理(所有颜色均可以用三原色红、绿、蓝按照一定比例混合出来)近似调出几乎所有人眼可见的颜色。在本实现中，采用全彩LED灯也能够更加节省电能，减小了头戴式设备的耗电量，延长续航时间。
在一些可选实施方式中，处理器配置用于：获取取景图像中预定范围内每个像素点的色值。根据预定范围内每个像素点的色值确定指示颜色。
在本实施例中，处理器在获取采集组件采集的取景图像后，基于该取景图像确定待显示的指示颜色。具体地，首先，获取上述取景图 像中预定范围内每个像素点的色值。其中，预定范围为上述取景图像的中心区域(即预定范围的中心为上述取景图像的中心)。在一种实现方式中，预定范围可以是以上述取景图像的中心为中心，包含预定个数个像素点的圆形区域，例如，预定范围可以是以上述取景图像的中心为中心，包含1600个像素点的圆形区域。在一另种实现方式中，预定范围也可以是以上述取景图像的中心为中心，包含预定个数个像素点的矩形区域，例如，预定范围可以是以上述取景图像的中心为中心，包含1600个像素点的矩形区域。可以理解，本申请对预定范围的具体形状以及范围的大小不限定。
然后，根据预定范围内每个像素点的色值确定指示颜色。具体来说，在一种实现方式中，可以分析取景图像中预定范围内每个像素点的色值，将对应的像素点的个数最多的色值确定为指示颜色的色值。在另一种实现方式中，也可以计算取景图像中预定范围内色值的均值，将该均值确定为指示颜色的色值。在又一种实现方式中，还可以获取取景图像中预定范围内的颜色分布直方图，根据颜色在取景图像中的分布情况确定指示颜色的色值。可以理解，还可以有其它的确定指示颜色的方式。
在另一些可选实施方式中，头戴式设备包括：支架，图像采集组件，显示组件及通信单元。其中，图像采集组件和显示组件设置于支架上，并且，在该头戴式设备处于使用状态时，显示组件在用户的视觉感知范围内。图像采集组件用于采集取景图像。通信单元用于将图像采集组件采集的取景图像传输至云端处理器，以供该云端处理器基于上述取景图像确定待显示的指示颜色，接收云端处理器发送的确定的指示颜色的信息。显示组件用于根据指示颜色的信息显示上述指示颜色，以向用户指示上述图像采集组件的取景方位。其中，指示颜色的信息为能够标识指示颜色的信息，例如，指示颜色的名称，指示颜色的标识信息以及指示颜色的色值等等。
在本实施例中，头戴式设备的通信单元可以将采集组件采集到的取景图像传输至云端处理器，由云端处理器基于上述取景图像确定待显示的指示颜色。因此，在本实施例中，确定待显示的指示颜色是在 云端处理器上进行的，云端处理器确定指示颜色后再将结果通过头戴式设备的通信单元返回给头戴式设备。其中，云端处理器例如可以是远程的服务器，或者，也可以是认证用户的智能移动电子设备如，手机，平板电脑等。
与图1对应的实施例相比，本实施例的头戴式设备不设处理器，而是通过将采集组件采集到的取景图像经通信单元传输至云端处理器，并接收云端处理器发送的结果，根据结果显示指示颜色，从而实现头戴式设备的视觉反馈。
应当理解，本实施例中记载的头戴式设备的结构可参考图1-2描述的头戴式设备中的各个结构。由此，上文针对头戴式设备描述的各个结构部件和特征同样适用于本实施例中记载的头戴式设备，在此不再赘述。
进一步参考图3，其示出了本申请的用于头戴式设备的视觉反馈方法的一个实施例的流程300。
如图3所示，在步骤301中，获取采集到的取景图像。
接着，在步骤302中，基于上述取景图像确定待显示的指示颜色。
最后，在步骤303中，显示上述指示颜色，以向用户指示取景方位。
一般来说，在进行拍照或摄像时，首先需要进行实时的取景，即每秒获得多帧取景图像。在现有技术中，是直接将取景图像作为视觉反馈图像，显示在取景屏幕上以供用户浏览。而我们周围的事物一般颜色比较丰富，如果能够获知取景图像中一定范围(如中心范围)的颜色，那么用户可以结合采集取景图像的器件(如摄像头)的位置，大体判断出取景的方位。在本实施例中，采集到取景图像后，对获取到的取景图像进行分析处理，确定用于视觉反馈的指示颜色，显示上述指示颜色，以向用户指示取景方位。
在本实施例中，可以采用全彩LED灯或者全彩显示屏显示指示颜色。
进一步参考图4，其示出了基于取景图像确定待显示的指示颜色的方法的一个实施例的流程400。
如图4所示，在步骤401中，获取取景图像中预定范围内每个像素点的色值。
最后，在步骤402中，根据预定范围内每个像素点的色值确定指示颜色。
具体地，在本实施例中，首先，获取上述取景图像中预定范围内每个像素点的色值。其中，预定范围为上述取景图像的中心区域(即预定范围的中心为上述取景图像的中心)。本申请对预定范围的具体形状以及范围的大小不限定。
然后，根据预定范围内每个像素点的色值确定指示颜色。具体来说，在一种实现方式中，可以分析取景图像中预定范围内每个像素点的色值，将对应的像素点的个数最多的色值确定为指示颜色的色值。在另一种实现方式中，也可以计算取景图像中预定范围内色值的均值，将该均值确定为指示颜色的色值。在又一种实现方式中，还可以获取取景图像中预定范围内的颜色分布直方图，根据颜色在取景图像中的分布情况确定指示颜色的色值。可以理解，还可以有其它的确定指示颜色的方式。
应当注意，尽管在附图中以特定顺序描述了本发明方法的操作，但是，这并非要求或者暗示必须按照该特定顺序来执行这些操作，或是必须执行全部所示的操作才能实现期望的结果。相反，流程图中描绘的步骤可以改变执行顺序。附加地或备选地，可以省略某些步骤，将多个步骤合并为一个步骤执行，和/或将一个步骤分解为多个步骤执行。
进一步参考图5，其示出了根据本申请的用于头戴式设备的视觉反馈装置的一个实施例的结构示意图。
如图5所示，本实施例的装置500包括：获取单元501，确定单元502和显示单元503。其中，获取单元501用于获取采集到的取景图像。确定单元502用于基于所述取景图像确定待显示的指示颜色。显示单元503用于显示所述指示颜色，以向用户指示取景方位。
在一些可选实施方式中，确定单元502包括：色值获取子单元和指示颜色确定子单元(未示出)。色值获取子单元用于获取取景图像中 预定范围内每个像素点的色值。指示颜色确定子单元用于根据预定范围内每个像素点的色值确上述指示颜色。
在一些可选实施方式中，指示颜色确定子单元配置用于：将预定范围内对应的像素点的个数最多的色值确定为指示颜色的色值。或者将预定范围内像素点的色值的均值确定为指示颜色的色值。
应当理解，装置500中记载的诸单元或模块与参考图1-4描述的头戴式设备的各个结构以及方法中的各个步骤相对应。由此，上文针对头戴式设备的各个结构以及方法描述的操作和特征同样适用于装置500及其中包含的单元，在此不再赘述。装置500可以预先设置在头戴式设备中，也可以通过下载等方式而加载到头戴式设备中。装置500中的相应单元可以与头戴式设备中的单元相互配合以实现用于头戴式设备的视觉反馈的方案。
图6示出了可以应用本申请实施例的示例性系统架构600。
如图6所示，系统架构600可以包括终端设备601、头戴式设备602、网络603和服务器604。网络603用以在终端设备601、头戴式设备602和服务器604之间提供通信链路的介质。网络603可以包括各种连接类型，例如有线、无线通信链路或者光纤电缆等等。
用户610可以使用终端设备601、头戴式设备602通过网络603与服务器604交互，以接收或发送消息等。终端设备601上可以安装有各种通讯客户端应用，例如即时通信工具、邮箱客户端、社交平台软件等。
终端设备601可以是各种电子设备，包括但不限于个人电脑、智能手机、智能手表、平板电脑、个人数字助理等等。头戴式设备602可以是各种具有拍照和/或摄像功能的头戴式设备，包括但不限于智能眼镜、头戴式数码相机以及智能头盔等等。
服务器604可以是提供各种服务的服务器。服务器可以对接收到的数据进行存储、分析等处理，并将处理结果反馈给头戴式设备。
需要说明的是，本申请实施例所提供的用于头戴式设备视觉反馈的方法可以由头戴式设备602执行，也可以由终端设备601或服务器604执行，用于头戴式设备视觉反馈的装置可以设置于头戴式设备602 中，也可以设置于终端设备601或服务器604中。在一些实施例中，基于取景图像确定待显示的指示颜色的步骤可以在服务器604或终端设备601中执行，也可以在头戴式设备602中执行。例如，在基于取景图像确定待显示的指示颜色时，如果网络603通畅，可以由服务器604或终端设备601进行确定后返回指示颜色的信息，如果没有网络或网络603不畅通，可以在头戴式设备602中进行确定。
应该理解，图6中的终端设备、头戴式设备、网络和服务器的数目仅仅是示意性的。根据实现需要，可以具有任意数目的终端设备、网络和服务器。
描述于本申请实施例中所涉及到的单元模块可以通过软件的方式实现，也可以通过硬件的方式来实现。所描述的单元模块也可以设置在处理器中，例如，可以描述为：一种处理器包括获取单元，确定单元和显示单元。其中，这些单元模块的名称在某种情况下并不构成对该单元模块本身的限定，例如，获取单元还可以被描述为“用于获取采集到的取景图像的单元”。
作为另一方面，本申请还提供了一种计算机可读存储介质，该计算机可读存储介质可以是上述实施例中所述装置中所包含的计算机可读存储介质；也可以是单独存在，未装配入终端中的计算机可读存储介质。所述计算机可读存储介质存储有一个或者一个以上程序，所述程序被一个或者一个以上的处理器用来执行描述于本申请的用于头戴式设备的视觉反馈的方法。
以上描述仅为本申请的较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解，本申请中所涉及的发明范围，并不限于上述技术特征的特定组合而成的技术方案，同时也应涵盖在不脱离所述发明构思的情况下，由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本申请中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。

Claims (15)

  1. 一种头戴式设备，其特征在于，所述头戴式设备包括：支架，图像采集组件，显示组件及处理器；
    其中，所述图像采集组件和所述显示组件设置于所述支架上，并且，在所述头戴式设备处于使用状态时，所述显示组件在用户的视觉感知范围内；
    所述图像采集组件用于采集取景图像；
    所述处理器获取所述图像采集组件采集的取景图像，基于所述取景图像确定待显示的指示颜色，并控制所述显示组件显示所述指示颜色，以向用户指示所述图像采集组件的取景方位。
  2. 根据权利要求1所述的头戴式设备，其特征在于，所述处理器配置用于：
    获取所述取景图像中预定范围内每个像素点的色值；
    根据所述预定范围内每个像素点的色值确定所述指示颜色。
  3. 根据权利要求2所述的头戴式设备，其特征在于，
    所述处理器将所述预定范围内对应的像素点的个数最多的色值确定为所述指示颜色的色值；或者
    所述处理器将所述预定范围内像素点的色值的均值确定为所述指示颜色的色值。
  4. 根据权利要求2或3所述的头戴式设备，其特征在于，所述预定范围为所述取景图像的中心区域。
  5. 根据权利要求1-4任意一项所述的头戴式设备，其特征在于，所述显示组件包括全彩LED灯或者全彩显示屏。
  6. 根据权利要求5所述的头戴式设备，其特征在于，所述全彩显 示屏包括以下至少一种：全彩LED显示屏，以及全彩OLED显示屏。
  7. 一种头戴式设备，其特征在于，所述头戴式设备包括：支架，图像采集组件，显示组件及通信单元；
    其中，所述图像采集组件和所述显示组件设置于所述支架上，并且，在所述头戴式设备处于使用状态时，所述显示组件在用户的视觉感知范围内；
    所述图像采集组件用于采集取景图像；
    所述通信单元用于将所述图像采集组件采集的取景图像传输至云端处理器，以供所述云端处理器基于所述取景图像确定待显示的指示颜色，接收所述云端处理器发送的确定的指示颜色的信息；
    所述显示组件用于根据所述指示颜色的信息显示所述指示颜色，以向用户指示所述图像采集组件的取景方位。
  8. 一种用于头戴式设备的视觉反馈方法，其特征在于，所述方法包括：
    获取采集到的取景图像；
    基于所述取景图像确定待显示的指示颜色；
    显示所述指示颜色，以向用户指示取景方位。
  9. 根据权利要求8所述的方法，其特征在于，所述基于所述取景图像确定待显示的指示颜色，包括：
    获取所述取景图像中预定范围内每个像素点的色值；
    根据所述预定范围内每个像素点的色值确定所述指示颜色。
  10. 根据权利要求9所述的方法，其特征在于，所述根据所述预定范围内每个像素点的色值确定所述指示颜色，包括：
    将所述预定范围内对应的像素点的个数最多的色值确定为所述指示颜色的色值；或者
    将所述预定范围内像素点的色值的均值确定为所述指示颜色的色 值。
  11. 根据权利要求8-10任意一项所述的方法，其特征在于，采用全彩LED灯或者全彩显示屏显示所述指示颜色。
  12. 一种用于头戴式设备的视觉反馈装置，其特征在于，所述装置包括：
    获取单元，用于获取采集到的取景图像；
    确定单元，用于基于所述取景图像确定待显示的指示颜色；
    显示单元，用于显示所述指示颜色，以向用户指示取景方位。
  13. 根据权利要求12所述的装置，其特征在于，所述确定单元包括：
    色值获取子单元，用于获取所述取景图像中预定范围内每个像素点的色值；
    指示颜色确定子单元，用于根据所述预定范围内每个像素点的色值确定所述指示颜色。
  14. 根据权利要求13所述的装置，其特征在于，所述指示颜色确定子单元配置用于：
    将所述预定范围内对应的像素点的个数最多的色值确定为所述指示颜色的色值；或者
    将所述预定范围内像素点的色值的均值确定为所述指示颜色的色值。
  15. 一种非易失性计算机存储介质，所述计算机存储介质存储有一个或多个程序，当所述一个或者多个程序被一个设备执行时，使得所述设备：
    获取采集到的取景图像；
    基于所述取景图像确定待显示的指示颜色；
    显示所述指示颜色，以向用户指示取景方位。
PCT/CN2015/090242 2015-05-06 2015-09-22 头戴式设备及其视觉反馈的方法及装置 Ceased WO2016176950A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/504,078 US10372287B2 (en) 2015-05-06 2015-09-22 Headset device and visual feedback method and apparatus thereof

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510226606.1A CN104834356B (zh) 2015-05-06 2015-05-06 头戴式设备及其视觉反馈的方法及装置
CN201510226606.1 2015-05-06

Publications (1)

Publication Number Publication Date
WO2016176950A1 true WO2016176950A1 (zh) 2016-11-10

Family

ID=53812295

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/090242 Ceased WO2016176950A1 (zh) 2015-05-06 2015-09-22 头戴式设备及其视觉反馈的方法及装置

Country Status (3)

Country Link
US (1) US10372287B2 (zh)
CN (1) CN104834356B (zh)
WO (1) WO2016176950A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104834356B (zh) 2015-05-06 2018-04-13 百度在线网络技术（北京）有限公司 头戴式设备及其视觉反馈的方法及装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102811769A (zh) * 2009-12-07 2012-12-05 C-Rad定位公司 具有视觉反馈的对象定位
US20140258902A1 (en) * 2011-11-30 2014-09-11 Google Inc. Graphical Interface Having Adjustable Borders
CN104182051A (zh) * 2014-08-29 2014-12-03 百度在线网络技术（北京）有限公司 头戴式智能设备和具有该头戴式智能设备的交互系统
CN104345802A (zh) * 2013-08-08 2015-02-11 派布勒斯有限公司 控制近眼式显示器的方法和设备
CN104834356A (zh) * 2015-05-06 2015-08-12 百度在线网络技术（北京）有限公司 头戴式设备及其视觉反馈的方法及装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9691241B1 (en) * 2012-03-14 2017-06-27 Google Inc. Orientation of video based on the orientation of a display
JP6028357B2 (ja) * 2012-03-22 2016-11-16 ソニー株式会社 ヘッドマウントディスプレイ及び手術システム
JP5787099B2 (ja) * 2012-11-06 2015-09-30 コニカミノルタ株式会社 案内情報表示装置
TW201419883A (zh) * 2012-11-12 2014-05-16 Powertech Ind Co Ltd 頭戴式耳機裝置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102811769A (zh) * 2009-12-07 2012-12-05 C-Rad定位公司 具有视觉反馈的对象定位
US20140258902A1 (en) * 2011-11-30 2014-09-11 Google Inc. Graphical Interface Having Adjustable Borders
CN104345802A (zh) * 2013-08-08 2015-02-11 派布勒斯有限公司 控制近眼式显示器的方法和设备
CN104182051A (zh) * 2014-08-29 2014-12-03 百度在线网络技术（北京）有限公司 头戴式智能设备和具有该头戴式智能设备的交互系统
CN104834356A (zh) * 2015-05-06 2015-08-12 百度在线网络技术（北京）有限公司 头戴式设备及其视觉反馈的方法及装置

Also Published As

Publication number Publication date
CN104834356B (zh) 2018-04-13
US20180067623A1 (en) 2018-03-08
CN104834356A (zh) 2015-08-12
US10372287B2 (en) 2019-08-06

Similar Documents

Publication Publication Date Title
US9866748B2 (en) System and method for controlling a camera based on processing an image captured by other camera
US9491418B2 (en) Method of providing a digitally represented visual instruction from a specialist to a user in need of said visual instruction, and a system therefor
CN105744176B (zh) 一种屏幕补光方法、装置及移动终端
CN106937039B (zh) 一种基于双摄像头的成像方法、移动终端及存储介质
US9065967B2 (en) Method and apparatus for providing device angle image correction
EP3076660B1 (en) Method and apparatus for displaying framing information
CN105554372B (zh) 一种拍摄方法以及装置
US20120019703A1 (en) Camera system and method of displaying photos
EP3306913B1 (en) Photographing method and apparatus
CN108419008B (zh) 一种拍摄方法、终端及计算机可读存储介质
CN105554594B (zh) 一种控制处理方法及用户终端
WO2017067121A1 (zh) 一种拍摄方法、装置、系统及一种移动终端
CN107040723B (zh) 一种基于双摄像头的成像方法、移动终端及存储介质
US12439163B2 (en) Mobile device support for capture and synthesis of extreme low-light video
CN110933297B (zh) 智能摄影系统的摄影控制方法、装置、存储介质及系统
WO2016155227A1 (zh) 显示取景信息的方法及装置
US9456148B1 (en) Multi-setting preview for image capture
CN111835941A (zh) 图像生成方法及装置、电子设备、计算机可读存储介质
US10372287B2 (en) Headset device and visual feedback method and apparatus thereof
US20210176402A1 (en) Image Capture Eyepiece
US20150264336A1 (en) System And Method For Composite Three Dimensional Photography And Videography
US12363448B2 (en) Ambient light detection and hyperlapse video generation
CN103973961A (zh) 便携终端内置相机的拍摄方法、系统和装置
JP3228959U (ja) オンライン撮影システム
CN111835977A (zh) 图像传感器、图像生成方法及装置、电子设备、存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15891201

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 15504078

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15891201

Country of ref document: EP

Kind code of ref document: A1