WO2023005338A1 - 拍摄方法、装置、电子设备、存储介质和计算机程序产品 - Google Patents

拍摄方法、装置、电子设备、存储介质和计算机程序产品 Download PDF

Info

Publication number
WO2023005338A1
WO2023005338A1 PCT/CN2022/092076 CN2022092076W WO2023005338A1 WO 2023005338 A1 WO2023005338 A1 WO 2023005338A1 CN 2022092076 W CN2022092076 W CN 2022092076W WO 2023005338 A1 WO2023005338 A1 WO 2023005338A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
graphic
indication
gaze point
human eye
Prior art date
Application number
PCT/CN2022/092076
Other languages
English (en)
French (fr)
Inventor
李晨
李由
Original Assignee
北京有竹居网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京有竹居网络技术有限公司 filed Critical 北京有竹居网络技术有限公司
Publication of WO2023005338A1 publication Critical patent/WO2023005338A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking

Definitions

  • the present disclosure relates to the technical field of image acquisition, and in particular to a photographing method, device, electronic equipment, storage medium and computer program product.
  • Augmented Reality (AR) technology is a technology that superimposes virtual information on the real world
  • Virtual Reality (VR) technology is a technology that gives people a sense of environmental immersion based on computer simulation of a virtual environment.
  • the realization of AR/VR technology needs to rely on smart glasses. After wearing smart glasses, users can see the real world or virtual environment superimposed with virtual information through smart glasses.
  • a camera may be installed on the smart glasses or other head-mounted display devices similar to the smart glasses, and may shoot objects or environments in front of the smart glasses user.
  • the picture captured by the camera may be quite different from the picture actually seen by the user.
  • the present disclosure provides a photographing method, device, electronic equipment, storage medium and computer program product.
  • the present disclosure provides a shooting method, which is applied to a head-mounted display device, and the head-mounted display device is provided with a camera, and the method includes:
  • an indication graphic is determined and displayed, and the indication graphic is used to indicate the adjustment of the direction of the camera.
  • the method also includes:
  • image capturing is performed.
  • the shooting parameter information includes: focus position information;
  • the determining and displaying the instruction graphic according to the position information of the gaze point of the human eye and the shooting parameter information of the camera includes:
  • first indication graphic When the first distance is less than or equal to a first preset threshold, determine and display a first indication graphic, where the first indication graphic is used to indicate that there is no need to adjust the direction of the camera;
  • a second indication graphic is determined and displayed, and the second indication graphic is used to indicate that the direction of the camera needs to be adjusted.
  • the determining and displaying a second indication graphic when the first distance is greater than a first preset threshold includes:
  • the position information of the human eye gaze point and the position information of the focus of the camera determine the direction in which the human gaze point deviates from the focus of the camera;
  • determining and displaying a second indication graphic according to the direction in which the gaze point of the human eye deviates from the focus of the camera includes:
  • the second indication graphic includes: indication direction and indication magnitude;
  • the determining and displaying a second instruction graphic according to the first distance and the direction in which the gaze point of the human eye deviates from the focus of the camera includes:
  • the indication graphic is determined and displayed according to the indication magnitude and the indication direction.
  • the shooting parameter information includes: shooting range;
  • the determining and displaying the instruction graphic according to the position information of the gaze point of the human eye and the shooting parameter information of the camera includes:
  • the position information of the gaze point of the human eye and the shooting range of the camera determine a second distance between the gaze point of the human eye and the center point of the shooting range of the camera;
  • a second indication graphic is determined and displayed, and the second indication graphic is used to indicate that the direction of the camera needs to be adjusted.
  • the instruction graphic when the instruction graphic indicates that the direction of the camera needs to be adjusted, the instruction graphic also displays an adjustment direction mark, and the adjustment direction mark is used to instruct the user to adjust the direction of the camera according to the adjustment direction mark .
  • the indicating graphic indicates that the direction of the camera does not need to be adjusted
  • the indicating graphic is displayed in a preset color.
  • the method before the execution of capturing images when the instruction graphic indicates that the direction of the camera does not need to be adjusted, the method further includes:
  • the automatic shooting function set by the user is received and executed, and the automatic shooting function is used to directly trigger the execution of shooting images when the instruction graphic indicates that the direction of the camera does not need to be adjusted.
  • performing image capturing includes:
  • a trigger instruction input by the user is received, and image capturing is performed.
  • the present disclosure provides a photographing device, which is applied to a head-mounted display device, the head-mounted display device is provided with a camera, and the device includes:
  • An acquisition module configured to acquire the position information of the gaze point of the human eye and the shooting parameter information of the camera
  • a processing module configured to determine an indication graphic according to the position information of the gaze point of the human eye and the shooting parameter information of the camera, and the indication graphic is used to indicate the adjustment of the direction of the camera;
  • a display module configured to display indicating graphics
  • the photographing module is configured to execute photographing an image when the instruction graphic indicates that the direction of the camera does not need to be adjusted.
  • the present disclosure provides an electronic device, comprising: a display screen; one or more processors; a memory; and one or more computer programs; wherein the one or more computer programs are stored in the memory ; When the one or more processors execute the one or more computer programs, the electronic device implements the method as described in the first aspect.
  • the present disclosure provides a computer storage medium, which is characterized by comprising computer instructions, and when the computer instructions are run on an electronic device, the electronic device is made to execute the method as described in the first aspect.
  • the present disclosure provides a computer program product, which is characterized in that, when the computer program product is run on a computer, the computer is made to execute the method as described in the first aspect.
  • the head-mounted display device determines and displays a prompt for the direction of the camera according to the gaze point of the human eye and the shooting parameter information of the camera.
  • the adjusted instruction graphic so that the user can adjust the direction of the camera according to the instruction graphic.
  • the instruction graphic indicates that there is no need to adjust the direction of the camera, the picture seen by the user's eyes is consistent with the picture taken by the camera. The pictures seen are consistent, which improves shooting efficiency and user experience.
  • the method of this embodiment avoids the superimposition effect of the image captured by the camera and the real image seen by human eyes when the image captured by the camera is displayed on the display screen in real time, thereby avoiding dizziness for the user.
  • the real-time display of the images captured by the camera will increase the power consumption and even cause the head-mounted display device to heat up.
  • the disclosed method reduces the power consumption of the head-mounted display device by displaying the instruction image, and does not cause heat generation and other problems. The phenomenon that users bring bad experience improves the user experience.
  • FIG. 1 is a schematic diagram of a field of view of a user wearing AR glasses provided by the present disclosure
  • FIG. 2 is a schematic flowchart of a shooting method provided by the present disclosure
  • FIG. 3 is a schematic flowchart of a shooting method provided by the present disclosure
  • FIG. 4 is a schematic flowchart of another shooting method provided by the present disclosure.
  • FIG. 5A is a schematic diagram of the positional relationship between a gaze point of a human eye and a focal point of a camera provided by the present disclosure
  • Figure 5B is a schematic plan view of Figure 5A;
  • FIG. 5C is a schematic diagram of a second indicating graphic provided by the present disclosure.
  • FIG. 5D is a schematic diagram of a second indicating graphic provided by the present disclosure.
  • FIG. 5E is a schematic diagram of a second indicating graphic provided by the present disclosure.
  • FIG. 5F is a schematic diagram of a second indicating graphic provided by the present disclosure.
  • FIG. 6 is a schematic flowchart of another shooting method provided by the present disclosure.
  • FIG. 7 is a schematic structural diagram of a photographing device provided in the present disclosure.
  • the head-mounted display device of the present disclosure may be smart glasses or other smart devices with a camera, wherein the smart glasses may be AR glasses or VR glasses, and the user refers to the wearer of the head-mounted display device.
  • the head-mounted display device is worn above the shoulder, for example, may be worn in front of the eyes.
  • the head-mounted display device of the present disclosure may include a display screen.
  • the display screen is facing the eyes of the target user.
  • the user can see the real world superimposed with virtual information through the head-mounted display device, or through the head-mounted display device. device, seeing a virtual world simulated by a computer.
  • the head-mounted display device of the present disclosure is provided with a camera, and images can be captured through the camera.
  • the head-mounted display device is taken as AR glasses as an example for description.
  • FIG. 1 is a schematic diagram of a field of view of a user wearing AR glasses provided by the present disclosure.
  • a camera is installed on the AR glasses. Assume that the shooting range of the camera is directly in front of the AR glasses. Due to the limitation of the field of view of the camera, the camera can capture the picture of the user wearing the AR glasses looking straight ahead, that is, the shooting range of the camera 101 . The user can see objects in a larger range than the imaging range 101 , that is, the user's field of view 102 , without adjusting his head and turning his eyes.
  • the position 103 within the shooting range can be the focus of the camera, and the position actually seen by the eyes of the user wearing AR glasses, that is, the gaze point of the human eye, can coincide with the focus of the camera, which is the position 103;
  • Other positions outside the position 103 that deviate from the position 103 for example, the position 104 ; may also be any position within the field of view 102 outside the shooting range 101 , for example, the position 105 .
  • the present disclosure provides a shooting method.
  • the head-mounted display device can display the images captured by the camera in real time through the display screen, so that The user can see the picture currently captured by the camera.
  • the present disclosure provides a shooting method.
  • the head-mounted display device determines the And display the instruction graphic that prompts the adjustment for the direction of the camera, so that the user can adjust the direction of the camera according to the instruction graphic.
  • the images are consistent.
  • the head-mounted display device can capture images, so that the images captured by the head-mounted display device are consistent with the images seen by the user, which improves shooting efficiency and user experience.
  • the method of the present disclosure avoids the superimposition effect of the image captured by the camera and the real image seen by human eyes when the image captured by the camera is displayed in real time through the display screen, thereby avoiding dizziness for the user.
  • the real-time display of the images captured by the camera will increase the power consumption and even cause the head-mounted display device to heat up.
  • the disclosed method reduces the power consumption of the head-mounted display device by displaying the instruction image, and does not cause heat generation and other problems.
  • the phenomenon that users bring bad experience improves the user experience.
  • FIG. 2 is a schematic flow diagram of a shooting method provided by the present disclosure. As shown in FIG. 2, the method of this embodiment is executed by the above-mentioned head-mounted display device, and the method of this embodiment is as follows:
  • the head-mounted display device After wearing the head-mounted display device, when the user wants to take pictures of the picture he sees, the head-mounted display device obtains the position information of the gaze point of the human eye and the shooting parameter information of the camera.
  • the gaze point of the human eyes is the spatial position actually viewed by the user's eyes.
  • the fixation point of the human eye may be determined by performing eye movement tracking on both eyes of the user, or may be determined in other ways, which is not limited in the present disclosure. It should be noted that when observing an object, the eyes do not necessarily look at a precise point in space, but may also be in a smaller range. Therefore, the point of human gaze is not necessarily a precise point in space. , and possibly a preset region range.
  • the shooting parameter information includes: focus position information or shooting range.
  • the focal point of the camera may be the position 103 shown in FIG. 1 .
  • the shooting range may be the shooting range 101 shown in FIG. 1 .
  • S202 Determine and display an instruction graphic according to the location information of the gaze point of the human eye and the shooting parameter information of the camera.
  • the head-mounted display device can obtain the position information of the gaze point of the human eye and the shooting parameter information of the camera in real time after the shooting is determined, and determine the indicating graphic according to the obtained position information of the gaze point of the human eye and the shooting parameter information of the camera. And display the instruction graphics through the display screen.
  • the indicating graphic is used to indicate the adjustment of the direction of the camera.
  • the body pose may include but not limited to the head pose, that is, the user's head position, face orientation and other information.
  • the indication graphic may be in two shapes, one of which indicates that the user does not need to adjust the direction of the camera, and the other shape indicates that the user needs to adjust the direction of the camera.
  • the instruction graphic indicates that the direction of the camera needs to be adjusted
  • the user adjusts his/her body posture, so that when the user adjusts the body posture so that the direction of the camera does not need to be adjusted, the instruction image changes into another shape accordingly.
  • the indication graphics can also change correspondingly with changes in the position information of the gaze point of the human eye and the shooting parameter information of the camera, that is, under the conditions of different position information of the gaze point of the human eye and the shooting parameter information of the camera, the indication graphics are not the same shape.
  • the head-mounted display device When the user sees the instruction graphic, he can adjust his body posture. During the process of the user adjusting his body posture, the head-mounted display device also obtains the position information of the gaze point of the human eye and the shooting parameter information of the camera in real time, thereby Make the indicating graphics change with the adjustment of the user's body posture.
  • the indication figure may be a quadrangle, such as a distorted trapezoid, square, or rectangle, or a circle or an ellipse, or other figures, and the disclosure does not limit the specific shape of the indication figure. Since the picture actually captured by the camera is generally a rectangle, for example, a rectangle with an aspect ratio of 16:9, it is easier for the user to understand the meaning of the indication graphic by using a distorted trapezoid.
  • the location for displaying the indicating graphic may display the indicating graphic at the center of the display screen. It is also possible to display the indicating graphics at the position of the gaze point of the human eye relative to the position of the display screen.
  • the indication graphics may also be displayed on other positions of the display screen, which is not limited in the present disclosure.
  • the head-mounted display device determines and displays prompts for The instruction graphic for adjusting the direction of the camera enables the user to adjust the direction of the camera according to the instruction graphic, thereby indicating a clear adjustment direction for the user, avoiding blind adjustment by the user, and improving adjustment efficiency.
  • S203 may further be included after S202, as shown in FIG. 3:
  • the instruction graphic indicates that there is no need to adjust the direction of the camera, it means that the object currently viewed by the user's eyes is exactly the object currently captured by the camera, so that the head-mounted display device controls the camera to capture images.
  • the instruction graphic indicates that there is no need to adjust the direction of the camera
  • the picture seen by the user's eyes is consistent with the picture taken by the camera.
  • the image is consistent with what the user sees, which improves shooting efficiency and user experience.
  • the method of this embodiment avoids the superimposition effect of the image captured by the camera and the real image seen by human eyes when the image captured by the camera is displayed on the display screen in real time, thereby avoiding dizziness for the user.
  • the real-time display of the images captured by the camera will increase the power consumption and even cause the head-mounted display device to heat up.
  • the disclosed method reduces the power consumption of the head-mounted display device by displaying the instruction image, and does not cause heat generation and other problems. The phenomenon that users bring bad experience improves the user experience.
  • a specific application scenario of the disclosed method will be described below by taking a user wearing AR glasses to visit an exhibition hall as an example.
  • the AR glasses can see the items in the exhibition hall through the AR glasses, and at the same time, the AR glasses can also display relevant item introduction text or videos on its display screen.
  • the AR glasses will determine the gaze point of the human eye and the parameter information of the camera, and display an instruction graphic on the display screen of the AR glasses to remind the user of the current gaze position and the actual shooting of the camera. Whether the picture is consistent, so that the user can adjust his body posture according to the instruction graphic.
  • the instruction graphic indicates that there is no need to adjust the direction of the camera, the picture seen by the user's eyes is consistent with the picture taken by the camera.
  • the head-mounted display The device can capture images.
  • the shooting parameter information may include: focus position information, and in step S202, the determined first distance between the gaze point of the human eye and the focus of the camera , displaying different indication graphics according to the numerical magnitude relationship between the first distance and the first preset threshold.
  • Figure 4 is a schematic flowchart of another shooting method provided by the present disclosure
  • Figure 4 is based on the embodiment shown in Figure 2 or Figure 3, further, S202 can be implemented through the following steps S2022-S2024 :
  • first distance is less than or equal to the first preset threshold, continue to execute S2023, and if the first distance is greater than the first preset threshold, continue to execute S2024.
  • the magnitude relationship between the first distance and the first preset threshold it can be determined whether there is a deviation between the object currently watched by the user and the image currently captured by the camera. If the first distance is less than or equal to the first preset threshold, it means that the object the user is currently looking at will appear in the image currently captured by the camera, and the first indication graphic may be displayed.
  • the first preset threshold is any preset value greater than or equal to 0.
  • the first preset threshold is 0, it means that when the gaze point of the human eyes completely coincides with the focal point of the camera, the first indication graphic is displayed.
  • the first preset threshold can be set to any value greater than 0 within the allowable error range.
  • the first indication graphic is used to indicate that the direction of the camera does not need to be adjusted.
  • the second indication graphic is used to indicate that the direction of the camera needs to be adjusted.
  • the displayed instruction graphics are also different, so that the user can know whether to adjust the direction of the camera according to whether the displayed first instruction image or the second instruction image is displayed.
  • the second indicating graphic is a graphic different from the first indicating graphic.
  • the first indication figure is a rectangle
  • the second indication figure is a quadrilateral
  • one corner of the quadrilateral is an acute angle
  • the shape of the second indication graphic is also used to instruct the user to adjust the magnitude of the direction of the camera.
  • the shape of the second indication graphic is a quadrilateral, one of which is an acute angle
  • the angle of the acute angle may be used to instruct the user to adjust the direction of the camera.
  • the head-mounted display device determines the first distance between the gaze point of the human eye and the focus of the camera according to the position information of the gaze point of the human eye and the focus of the camera, and determines whether the first distance is less than or equal to
  • the first preset threshold determines the degree of deviation between the gaze point of the human eye and the focus of the camera, thereby displaying different indication graphics to prompt the user whether to adjust their body posture, more accurately determine and display the indication graphics, and thus be more accurate The user is prompted through instruction graphics.
  • the second indicating graphic may be a preset fixed graphic.
  • the second indication graphic may be determined according to the direction in which the gaze point of the human eye deviates from the focus of the camera. The following is a detailed description with specific embodiments.
  • step S2024 the displacement of the gaze point of the human eye away from the focus of the camera is determined, so as to determine the second indication graphic.
  • S2024 can be realized through the following steps 1 and 2:
  • Step 1 Determine the direction in which the human gaze deviates from the focal point of the camera according to the position information of the gaze point of the human eye and the focus position information of the camera.
  • Step 2 Determine and display a second indication graphic according to the direction in which the gaze point of the human eye deviates from the focus of the camera.
  • the second instruction graphic is determined according to the direction in which the gaze point of the human eye deviates from the focus of the camera, so that the displayed second instruction graphic can prompt the user to deviate from the direction, and the user can determine the direction in which the body posture needs to be adjusted based on the second instruction graphic, Therefore, the user can adjust the body posture according to this direction, and the second instruction graphic is more instructive, and the adjustment is more targeted, which improves the efficiency of the user in adjusting the body posture, and improves the shooting efficiency and user experience at the same time.
  • the second indication graphic may be determined according to the first distance and the direction in which the gaze point of the human eye deviates from the focal point of the camera.
  • Step 2 can be achieved as follows:
  • the second indication graphic is determined and displayed.
  • the distance between the position of the gaze point of the human eye and the focal point of the camera is relatively large.
  • the direction in which the point of gaze shifts relative to the focal point of the camera thereby obtaining a second indication graphic according to the first distance and the first direction, so that the second indication graphic can indicate whether the direction of the camera needs to be adjusted, and can also indicate that the camera needs to be adjusted.
  • the direction of the direction makes the second instruction graphic more accurate and intuitive, which in turn makes the user's adjustment more targeted, improves the efficiency of the user's body posture adjustment, and also improves the shooting efficiency and user experience.
  • the second indication graphic includes: indication direction and indication range.
  • the indication magnitude of the second indication graphic may be determined according to the first distance.
  • the indication direction of the second indication graphic is determined according to the direction in which the gaze point of the human eye deviates from the focus of the camera. According to the indication magnitude and indication direction, determine and display the indication graphics.
  • the second indication graphic is determined according to the first distance and the direction in which the human gaze deviates from the focus of the camera, so that the displayed second indication graphic can prompt the direction and degree of deviation of the human gaze from the focus of the camera, and the user
  • the direction and range of body posture to be adjusted can be determined based on the second instruction graphic, so that the user can adjust the body posture according to the direction and the range.
  • the second instruction graphic is more instructive and more targeted when the user adjusts, improving This improves the efficiency of the user in adjusting the body posture, and at the same time improves the shooting efficiency and user experience.
  • FIG. 5A is a schematic diagram of the positional relationship between the gaze point of human eyes and the focal point of the camera according to the present disclosure
  • FIG. 5B is a schematic plan view of FIG. 5A .
  • the camera can be used as the origin, the focus direction from the origin to the camera is the positive direction of the Y-axis, and the straight line where the eyes are located is the X-axis to establish a spatial X-Y-Z rectangular coordinate system.
  • the calculation of the first distance between the human gaze point 501 and the focal point 502 of the camera can be converted to the X-Z plane as shown in Figure 5B, the first distance is the distance between the human eye gaze point 501 and the focal point 502 of the camera in the X-Z plane,
  • the direction in which the gaze point 501 of the human eye deviates from the focal point 502 of the camera is the direction in which the focal point 502 of the camera points to the focal point 501 of the human eye in the X-Z plane in FIG. 5B .
  • the second indication graphic may be determined according to the first distance between the gaze point 501 of the human eye and the focal point 502 of the camera in the X-Z plane, and the direction in which the gaze point 501 of the human eye deviates from the focal point 502 of the camera.
  • the second indication figure is a quadrilateral with one acute angle
  • the first indication figure is a rectangle as an example for illustration.
  • FIG. 5C , FIG. 5D , FIG. 5E and FIG. 5F are respectively schematic diagrams of a second indication graphic provided by the present disclosure.
  • the human gaze point 501 coincides with the focal point 502 of the camera, and the determined first indication figure at this time is a rectangle .
  • the focal point 501 of the human eye does not coincide with the focal point 502 of the camera.
  • the first distance from the focal point 502 of the camera and the direction in which the gaze point 501 of the human eye deviates from the focal point 502 of the camera determine the second indication graphic 503 .
  • the shape of the second indication graphic 503 is obtained by distorting on the basis of a rectangle, and the two sides of the rectangle may be distorted along the direction according to the direction in which the gaze point 501 of the human eye deviates from the focus 502 of the camera.
  • the distance from the center point of the dotted rectangle in the second indication graphic 503 shown in FIG. 5C , FIG. 5D , FIG. 5E and FIG. 5F to the acute-angle vertex may be preset in proportion to the first distance.
  • the first distance in Figure 5D is greater than the first distance in Figure 5C, then correspondingly, the acute angle ratio diagram of the second indicating graphic 503 corresponding to Figure 5D
  • the second indicating graphic 503 corresponding to 5C is smaller, and similarly, the rectangular distortion magnitude of the second indicating graphic 503 corresponding to FIG. 5D is larger than that of the second indicating graphic 503 corresponding to FIG. 5C .
  • the shooting parameter information includes: when shooting the range, in step S502, the second distance between the human gaze point that can be determined and the center point of the shooting range of the camera, through the second distance
  • Different indication graphics are displayed for the relationship between the numerical value and the second preset threshold.
  • FIG. 6 is a schematic flowchart of another shooting method provided by the present disclosure.
  • FIG. 6 is based on the embodiment shown in FIG. 2.
  • S202 can be implemented through the following steps S202a-S202d:
  • S202a Determine a second distance between the gaze point of the human eye and a central point of the shooting range of the camera according to the position information of the gaze point of the human eye and the shooting range of the camera.
  • the second distance By judging the magnitude relationship between the second distance and the second preset threshold, it can be determined whether there is a deviation between the object currently watched by the user and the current shooting range of the camera. If the second distance is less than or equal to the second preset threshold, it means that the object the user is currently looking at will appear in the image currently captured by the camera, and the first indication graphic may be displayed.
  • the second preset threshold is any preset value greater than or equal to 0.
  • the second preset threshold is 0, it means that when the gaze point of the human eye completely coincides with the center point of the shooting range of the camera, the first indication graphic is displayed.
  • the first preset threshold can be set to any value greater than 0 within the allowable error range.
  • the first indication graphic is used to indicate that the direction of the camera does not need to be adjusted.
  • the first indicating graphic in this embodiment is the same as the first indicating graphic in the embodiment shown in FIG. 3 , and will not be repeated here.
  • the second indication graphic is used to indicate that the direction of the camera needs to be adjusted.
  • the second indicating graphic in this embodiment is the same as the second indicating graphic in the embodiment shown in FIG. 4 , and will not be repeated here.
  • the head-mounted display device determines the second distance between the gaze point of the human eye and the center point of the photographing range of the camera according to the position information of the gaze point of the human eye and the position information of the center point of the photographing range of the camera, By judging whether the second distance is less than or equal to the second preset threshold, determine the degree of deviation between the human gaze point and the center point of the camera's shooting range, thereby displaying different instruction graphics to prompt the user whether to adjust his body posture, Determine and display the instruction graphics more accurately, so that the user can be prompted more accurately through the instruction graphics, and the user's adjustment is more targeted, which improves the efficiency of the user's body posture adjustment, and at the same time improves the shooting efficiency and user experience.
  • the second indicating graphic may be a preset fixed graphic.
  • the second indication graphic may be determined according to the direction in which the gaze point of the human eye deviates from the center point of the shooting range of the camera. The following is a detailed description with specific embodiments.
  • step S202d the displacement of the gaze point of the human eye from the center point of the shooting range of the camera is determined, so as to determine the second indication graphic.
  • S202d can be realized through the following steps a and b:
  • Step a according to the position information of the human eye gaze point and the position information of the center point of the camera's shooting range, determine the direction in which the human eye gaze point deviates from the center point of the camera's shooting range.
  • Step b According to the direction in which the gaze point of human eyes deviates from the center point of the shooting range of the camera, determine and display the second indicating graphic.
  • the second instruction graphic is determined according to the direction in which the gaze point of the human eye deviates from the center point of the camera's shooting range, so that the displayed second instruction graphic can prompt the user to deviate from the direction, and the user can determine that the body needs to be adjusted based on the second instruction graphic.
  • the direction of the posture so that the user can adjust the body posture according to this direction.
  • the second instruction graphic is more instructive, and the user's adjustment is more targeted, which improves the efficiency of the user's adjustment of the body posture, and also improves the shooting efficiency. and user experience.
  • the second indication graphic may be determined according to the first distance and the direction in which the gaze point of the human eye deviates from the center point of the shooting range of the camera.
  • Step b can be achieved as follows:
  • the second indication graphic is determined and displayed.
  • the distance between the position of the gaze point of the human eye and the center point of the shooting range of the camera is relatively large.
  • the user needs to adjust his body posture according to the second instruction graphic , determine the direction in which the gaze point of the human eye shifts relative to the center point of the shooting range of the camera, so as to obtain a second indication graphic according to the first distance and the first direction, so that the second indication graphic can indicate whether the direction of the camera needs to be adjusted , and can indicate the direction to adjust the direction of the camera, so that the second instruction graphic is more accurate and intuitive, and then the user can adjust his body posture more quickly and accurately to complete the shooting.
  • the second indication graphic includes: indication direction and indication range.
  • the indication magnitude of the second indication graphic may be determined according to the first distance. According to the direction in which the gaze point of the human eye deviates from the center point of the shooting range of the camera, the indication direction of the second indication graphic is determined. According to the indication magnitude and indication direction, determine and display the indication graphics.
  • the second instruction graphic is determined according to the first distance and the direction in which the gaze point of the human eye deviates from the center point of the shooting range of the camera, so that the displayed second instruction graph can prompt that the gaze point of the human eye deviates from the center of the shooting range of the camera
  • the direction of the point and the degree of deviation the user can determine the direction and magnitude of the need to adjust the body posture based on the second instruction graphic, so that the user can adjust the body posture according to the direction and the range, the second instruction graphic is more instructive, so that the user It is more efficient to adjust the body posture.
  • a voice prompt can be output, the voice prompt is used to indicate the adjustment of the camera direction, for example, it can output "please adjust the head direction” or " Please keep the current head posture and start shooting", etc. In this way, the user is more aware of whether the direction of the camera needs to be adjusted currently.
  • the instruction graphic when the instruction graphic indicates that the direction of the camera needs to be adjusted, the instruction graphic also displays an adjustment direction mark, which is used to instruct the user to adjust the direction according to the Adjust the direction mark to adjust the direction of the camera.
  • the adjustment direction logo By displaying the adjustment direction logo, it is easier for the user to understand how to adjust their body posture, and the adjustment is more targeted, which improves the efficiency of the user in adjusting the body posture, and also improves the shooting efficiency and user experience.
  • the indicating graphic indicates that the direction of the camera does not need to be adjusted
  • the indicating graphic is displayed in a preset color.
  • the indication graphics may be displayed in green or yellow, which is not limited in the present disclosure.
  • the preset color is displayed, so as to better prompt the user whether to adjust the direction of the camera at present.
  • the head-mounted display device may directly Execute capturing an image.
  • the indication graphic is the first indication graphic
  • the head-mounted display device directly executes capturing an image. The following describes in detail with the embodiment shown in FIG. 7 .
  • the head-mounted display device directly performs image capture when the instruction graphic indicates that the direction of the camera does not need to be adjusted, so that the head-mounted display device automatically performs image capture when the captured image matches the image seen by the human eye, improving improve the efficiency of capturing images.
  • the instruction graphic indicates that the direction of the camera does not need to be adjusted, before performing image capturing, it also includes:
  • the automatic shooting function that receives the user's setting is turned on and executed.
  • the automatic shooting function is used to directly trigger the execution of shooting images when the instruction graphic indicates that the direction of the camera does not need to be adjusted.
  • the head-mounted display device can directly trigger the execution of the shooting image, and the process of automatically shooting the image It is user-permitted, complies with system security, and fully considers the needs of users.
  • step S203 after the user does not need to adjust the direction of the camera according to the indication graphic, the user The display device inputs a trigger instruction for instructing shooting, so that the head-mounted display device executes shooting images.
  • a trigger instruction for instructing shooting so that the head-mounted display device executes shooting images.
  • a trigger instruction input by the user is received, and image capturing is performed.
  • the user can determine whether the direction of the camera needs to be adjusted according to the shape of the current instruction graphic.
  • the instruction graphic indicates that the camera direction does not need to be adjusted, the user can input a trigger command to the head-mounted display device, thereby triggering the head-mounted display device to execute Take an image.
  • the head-mounted display device performs image capture after receiving a trigger instruction input by the user, fully considers the needs of the user, and performs image capture only when the user triggers the image capture, thereby ensuring that each image captured is what the user needs.
  • step S201 the following steps may be included before step S201:
  • the shooting start instruction is used to instruct the head-mounted display device to perform shooting.
  • the shooting start command may be a voice command input by the user, a gesture command or a touch button command.
  • the voice command can be "take a picture” or “start shooting” and so on.
  • Gesture action instructions can be clenching a fist, clicking a finger in the air, and the like.
  • the touch button instruction may be for the user to press a shooting button set on the head-mounted display device.
  • the head-mounted display device may display a rectangular frame representing the shooting range on the display screen, for example, a 16:9 rectangular frame, thereby prompting the user to start the shooting mode.
  • taking an image in step S203 may include the following steps:
  • the camera is controlled to focus on the object located according to the position information of the gaze point of the human eye, and an image is captured through the camera.
  • the head-mounted display device controls the camera to focus on the object where the position information of the human eye gaze point is located, and then executes shooting images, so that the captured image is the picture seen by the human eyes, and the human eyes mainly focus on The object is clear in the shooting screen.
  • Fig. 7 is a schematic structural diagram of a shooting device provided by the present disclosure. As shown in Fig. 7, the device of this embodiment is applied to a head-mounted display device, and a camera is provided on the head-mounted display device, and the device includes:
  • Obtaining module 701 used to obtain the position information of the gaze point of the human eye and the shooting parameter information of the camera;
  • the processing module 702 is configured to determine an indication graphic according to the position information of the gaze point of the human eye and the shooting parameter information of the camera, where the indication graphic is used to indicate the adjustment of the direction of the camera;
  • a photographing module 704 configured to perform photographing of an image when the instruction graphic indicates that the direction of the camera does not need to be adjusted.
  • the shooting parameter information includes: focus position information;
  • the processing module 702 is specifically configured to: determine the first distance between the human gaze point and the camera focus according to the position information of the gaze point of the human eye and the focal point of the camera; when the first distance is less than or equal to the first preset threshold , determine the first indicating graphic, the first indicating graphic is used to indicate that the direction of the camera does not need to be adjusted; when the first distance is greater than the first preset threshold, determine the second indicating graphic, and the second indicating graphic is used to indicate that the adjustment the direction of the camera.
  • the processing module 702 is specifically configured to: when the first distance is greater than a first preset threshold, determine the direction in which the human gaze deviates from the focus of the camera according to the position information of the gaze point of the human eye and the focus position information of the camera ; Determine the second indicating graphic according to the direction in which the gaze point of the human eye deviates from the focal point of the camera.
  • the processing module 702 is specifically configured to: determine and display the second indication graphic according to the first distance and the direction in which the human gaze deviates from the focus of the camera.
  • the second indication graphic includes: indication direction and indication magnitude;
  • the processing module 702 is specifically used to: determine the indication range of the second indication graphic according to the first distance; determine the indication direction of the second indication graphic according to the direction in which the gaze point of the human eye deviates from the focus of the camera; determine the indication direction of the second indication graphic according to the indication range and indication direction And display the instruction graphics.
  • the shooting parameter information includes: shooting range;
  • the processing module 702 is specifically configured to: determine the second distance between the human gaze point and the center point of the camera's shooting range according to the position information of the human gaze point and the shooting range of the camera; When the threshold is set, determine the first indicating graphic, the first indicating graphic is used to indicate that there is no need to adjust the direction of the camera; when the second distance is greater than the second preset threshold, determine the second indicating graphic, and the second indicating graphic is used to indicate the need to adjust the direction of the camera; Adjust the camera direction.
  • the display module 703 is further configured to: when the instruction graphic indicates that the camera direction needs to be adjusted, the instruction graphic also displays an adjustment direction mark, and the adjustment direction mark is used to instruct the user to adjust the camera direction according to the adjustment direction mark.
  • the display module 703 is further configured to: when the indicating graphic indicates that the direction of the camera does not need to be adjusted, the indicating graphic is displayed in a preset color.
  • the shooting module 704 is specifically used for:
  • the device also includes:
  • the receiving module is used to receive the start and execution of the automatic shooting function set by the user.
  • the automatic shooting function is used to directly trigger the execution of shooting images when the instruction graphic indicates that there is no need to adjust the direction of the camera.
  • the receiving module is further configured to: receive a trigger instruction input by the user and execute image capturing after the instruction graphic indicates that the direction of the camera does not need to be adjusted.
  • the shape of the second indication graphic is also used to instruct the user to adjust the magnitude of the direction of the camera.
  • the first indication figure is a rectangle
  • the second indication figure is a quadrilateral
  • one corner of the quadrilateral is an acute angle
  • An embodiment of the present disclosure provides an electronic device, including: a display screen; one or more processors; memory; and one or more computer programs; wherein one or more computer programs are stored in the memory; When the device executes one or more computer programs, the electronic device implements the methods in the above-mentioned embodiments.
  • An embodiment of the present disclosure provides a computer storage medium, including computer instructions, and when the computer instructions are run on an electronic device, the electronic device is made to execute the method in the foregoing embodiments.
  • An embodiment of the present disclosure provides a computer program product, which enables the computer to execute the method in the foregoing embodiments when the computer program product is run on a computer.

Abstract

本公开提供一种拍摄方法、装置、电子设备、存储介质和计算机程序产品。该方法应用于头戴式显示设备,头戴式显示设备上设置有摄像头,该方法包括:获取人眼注视点的位置信息和摄像头的拍摄参数信息(S201),其中,拍摄参数信息包括:焦点的位置信息或者拍摄范围,根据人眼注视点的位置信息和摄像头的拍摄参数信息,确定并显示指示图形(S202),指示图形用于指示针对摄像头方向的调整,从而为用户指示了明确的调整方向,避免用户盲目的调整,提高了调整效率。

Description

拍摄方法、装置、电子设备、存储介质和计算机程序产品
相关申请的交叉引用
本申请基于申请号为202110846022.X、申请日为2021年07月26日,名称为“拍摄方法、装置、电子设备、存储介质和计算机程序产品”的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本公开涉及图像采集技术领域,尤其涉及一种拍摄方法、装置、电子设备、存储介质和计算机程序产品。
背景技术
增强现实(Augmented Reality,AR)技术是一种将虚拟信息叠加到真实世界的技术,虚拟现实(Virtual Reality,VR)技术是一种基于计算机模拟虚拟环境而给人以环境沉浸感的技术。AR/VR技术的实现需要依赖智能眼镜,使用者佩戴智能眼镜后,通过智能眼镜可以看见叠加了虚拟信息的真实世界,或者虚拟环境。
在智能眼镜或者与智能眼镜类似的其他头戴式显示设备上可以安装有摄像头,可以对智能眼镜使用者的前方物体或环境进行拍摄。
由于使用者的视野范围相比摄像头的视场角要大,使用者想要拍摄图像时,使用摄像头拍摄得到的画面可能与使用者实际看到的画面有较大的差别。
发明内容
为了解决上述技术问题,本公开提供了一种拍摄方法、装置、电子设备、存储介质和计算机程序产品。
第一方面,本公开提供一种拍摄方法,应用于头戴式显示设备,所述头戴式显示设备上设置有摄像头,所述方法包括:
获取人眼注视点的位置信息和所述摄像头的拍摄参数信息;
根据人眼注视点的位置信息和所述摄像头的拍摄参数信息,确定并显示指示图形,所述指示图形用于指示针对所述摄像头方向的调整。
可选的,所述方法还包括:
在所述指示图形指示无需调整所述摄像头方向的情况下,执行拍摄图像。
可选的,所述拍摄参数信息包括:焦点的位置信息;
所述根据人眼注视点的位置信息和所述摄像头的拍摄参数信息,确定并显示指示图形,包括:
根据人眼注视点的位置信息和所述摄像头的焦点的位置信息,确定所述人眼注视点与所述摄像头的焦点之间的第一距离;
在所述第一距离小于等于第一预设阈值时,确定并显示第一指示图形,所述第一指示图形用于指示无需调整所述摄像头方向;
在所述第一距离大于第一预设阈值时,确定并显示第二指示图形,所述第二指示图形用于指示需要调整所述摄像头方向。
可选的,所述在所述第一距离大于第一预设阈值时,确定并显示第二指示图形,包括:
在所述第一距离大于第一预设阈值时,根据人眼注视点的位置信息和所述摄像头的焦点的位置信息,确定所述人眼注视点偏离所述摄像头的焦点的方向;
根据所述人眼注视点偏离所述摄像头的焦点的方向,确定并显示第二指示图形。
可选的,所述根据所述人眼注视点偏离所述摄像头的焦点的方向,确定并显示第二指示图形,包括:
根据所述第一距离和所述人眼注视点偏离所述摄像头的焦点的方向,确定并显示第二指示图形。
可选的,所述第二指示图形包括:指示方向和指示幅度;
所述根据所述第一距离和所述人眼注视点偏离所述摄像头的焦点的方向,确定并显示第二指示图形,包括:
根据所述第一距离,确定所述第二指示图形的指示幅度;
根据所述人眼注视点偏离所述摄像头的焦点的方向,确定所述第二指示图形的指示方向;
根据所述指示幅度和所述指示方向,确定并显示所述指示图形。
可选的,所述拍摄参数信息包括:拍摄范围;
所述根据人眼注视点的位置信息和所述摄像头的拍摄参数信息,确定并显示指示图形,包括:
根据人眼注视点的位置信息和所述摄像头的拍摄范围,确定所述人眼注视点与所述摄像头的拍摄范围的中心点之间的第二距离;
在所述第二距离小于等于第二预设阈值时,确定并显示第一指示图形,所述第一指示图形用于指示无需调整所述摄像头方向;
在所述第二距离大于第二预设阈值时,确定并显示第二指示图形,所述第二指示图形用于指示需要调整所述摄像头方向。
可选的,在所述指示图形指示需要调整所述摄像头方向时,所述指示图形中还显示有调整方向标识,所述调整方向标识用于指示用户根据所述调整方向标识调整所述摄像头方向。
可选的,所述在所述指示图形指示无需调整所述摄像头方向时,所述指示图形以预设颜色显示。
可选的,所述在所述指示图形指示无需调整所述摄像头方向情况下,执行拍摄图像之前,还包括:
接收用户设置的自动拍摄功能开启执行,所述自动拍摄功能用于在所述指示图形指示无需调整所述摄像头方向时,直接触发执行拍摄图像。
可选的,所述在所述指示图形指示无需调整所述摄像头方向情况下,执行拍摄图像,包括:
在所述指示图形指示无需调整所述摄像头方向后,接收用户输入的触发指令,执行拍摄图像。
第二方面,本公开提供一种拍摄装置,应用于头戴式显示设备,所述头戴式显示设备上设置有摄像头,所述装置包括:
获取模块,用于获取人眼注视点的位置信息和所述摄像头的拍摄参数信息;
处理模块,用于根据人眼注视点的位置信息和所述摄像头的拍摄参数信息,确定指示图形,所述指示图形用于指示针对所述摄像头方向的调整;
显示模块,用于显示指示图形;
拍摄模块,用于在所述指示图形指示无需调整所述摄像头方向的情况下,执行拍摄图像。
第三方面,本公开提供一种电子设备,包括:显示屏;一个或多个处理器;存储器;以及一个或多个计算机程序;其中所述一个或多个计算机程序被存储在所述存储器中;所述一个或多个处理器在执行所述一个或多个计算机程序时,使得所述电子设备实现如第一方面所述的方法。
第四方面,本公开提供一种计算机存储介质,其特征在于,包括计算机指令,当所述计算机指令在电子设备上运行时,使得所述电子设备执行如第一方面所述的方法。
第五方面,本公开提供一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如第一方面所述的方法。
本公开实施例提供的技术方案与现有技术相比具有如下优点:
在用户佩戴头戴式显示设备,需要通过头戴式显示设备上的摄像头进行拍摄图像时,头戴式显示设备根据人眼注视点和摄像头的拍摄 参数信息,确定并显示提示针对所述摄像头方向的调整的指示图形,以使用户根据指示图形调整所述摄像头方向。从而为用户指示了明确的调整方向,避免用户盲目的调整,提高了调整效率。当指示图形指示无需调整所述摄像头方向时,则用户的眼睛看到的画面与摄像头拍摄的画面一致,此时头戴式显示设备可以进行拍摄图像,使得头戴式显示设备拍摄的图像与用户看到的画面一致,提高了拍摄效率和用户体验。另外,本实施例的方法避免了通过显示屏实时显示摄像头捕捉的画面时,人眼看到的是摄像头捕捉的画面与人眼看到的现实的画面相叠加的效果,从而避免用户出现眩晕的情况。摄像头实时显示摄像头捕捉的画面会使得功耗增大,甚至造成头戴式显示设备发热,本公开的方法通过显示指示图像,降低了头戴式显示设备的功耗,并不会出现发热等给用户带来不良体验的现象,提高了用户体验。
附图说明
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。
为了更清楚地说明本公开实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1为本公开提供的一种佩戴AR眼镜的用户的视野示意图;
图2为本公开提供的一种拍摄方法的流程示意图;
图3为本公开提供的一种拍摄方法的流程示意图;
图4为本公开提供的另一种拍摄方法的流程示意图;
图5A为本公开提供的一种人眼注视点和摄像头的焦点的位置关系示意图;
图5B为图5A的平面示意图;
图5C为本公开提供的一种第二指示图形的示意图;
图5D为本公开提供的一种第二指示图形的示意图;
图5E为本公开提供的一种第二指示图形的示意图;
图5F为本公开提供的一种第二指示图形的示意图;
图6为本公开提供的另一种拍摄方法的流程示意图;
图7为本公开提供的一种拍摄装置的结构示意图。
具体实施方式
为了能够更清楚地理解本公开的上述目的、特征和优点,下面将对本公开的方案进行进一步描述。需要说明的是,在不冲突的情况下,本公开的实施例及实施例中的特征可以相互组合。
在下面的描述中阐述了很多具体细节以便于充分理解本公开,但本公开还可以采用其他不同于在此描述的方式来实施;显然,说明书中的实施例只是本公开的一部分实施例,而不是全部的实施例。
本公开的头戴式显示设备可以是智能眼镜或者其他具有摄像头的智能设备,其中,智能眼镜例如可以是AR眼镜,也可以是VR眼镜,用户是指头戴式显示设备的佩戴者,用户将头戴式显示设备佩戴于肩部以上,例如可以是佩戴于眼睛前方。
本公开的头戴式显示设备可以包括显示屏,用户使用时显示屏正对目标用户的眼睛,用户可以通过头戴式显示设备,看见叠加了虚拟信息的真实世界,也可以通过头戴式显示设备,看见通过计算机模拟的虚拟世界。
本公开的头戴式显示设备上设置有摄像头,可以通过摄像头进行拍摄图像。下面以头戴式显示设备为AR眼镜为例进行说明。
请参见图1,图1为本公开提供的一种佩戴AR眼镜的用户的视野示意图。AR眼镜上安装有摄像头,假设摄像头的拍摄范围为AR眼镜的正前方,由于摄像头的视场角限制,摄像头可以拍摄到佩戴AR眼镜的用户眼球正视前方的画面,即摄像头的拍摄范围101。用户可以在无需调整自己的头部,而转动眼睛的情况下,看见相比于摄像范围101 更大的范围内的物体,即用户的视野范围102。
对于拍摄范围内位置103可以为摄像头的焦点,而佩戴AR眼镜的用户的眼睛实际看的位置,即人眼注视点,可以与摄像头的焦点重合,即为位置103;也可以为拍摄范围内除位置103外其他偏离位置103的位置,例如,位置104;还可以为视野范围102内出拍摄范围101以外的任一位置,例如,位置105。
本公开提供一种拍摄方法,在用户佩戴头戴式显示设备,需要通过头戴式显示设备上的摄像头进行拍摄图像时,头戴式显示设备可以通过显示屏实时显示摄像头捕捉的画面,从而使得用户可以看到摄像头当前获取到的画面。
本公开提供一种拍摄方法,在用户佩戴头戴式显示设备,需要通过头戴式显示设备上的摄像头进行拍摄图像时,头戴式显示设备根据人眼注视点和摄像头的拍摄参数信息,确定并显示提示针对所述摄像头方向的调整的指示图形,以使用户根据指示图形调整所述摄像头方向,当指示图形指示无需调整所述摄像头方向时,则用户的眼睛看到的画面与摄像头拍摄的画面一致,此时头戴式显示设备可以进行拍摄图像,使得头戴式显示设备拍摄的图像与用户看到的画面一致,提高了拍摄效率和用户体验。另外,本公开的方法避免了通过显示屏实时显示摄像头捕捉的画面时,人眼看到的是摄像头捕捉的画面与人眼看到的现实的画面相叠加的效果,从而避免用户出现眩晕的情况。摄像头实时显示摄像头捕捉的画面会使得功耗增大,甚至造成头戴式显示设备发热,本公开的方法通过显示指示图像,降低了头戴式显示设备的功耗,并不会出现发热等给用户带来不良体验的现象,提高了用户体验。
下面以几个具体的实施例以智能眼镜为例对本公开的技术方案进行描述,与智能眼镜类似的其他可穿戴设备的实现方式与本公开描述的技术方案相似,本公开不做赘述。
图2为本公开提供的一种拍摄方法的流程示意图,如图2所示, 本实施例的方法由上述头戴式显示设备执行,本实施例的方法如下:
S201、获取人眼注视点的位置信息和摄像头的拍摄参数信息。
用户佩戴头戴式显示设备后,当想要对所看到的画面进行拍摄时,头戴式显示设备获取人眼注视点的位置信息和摄像头的拍摄参数信息。
其中,人眼注视点为用户双眼实际看的空间位置。可以通过对用户双眼进行眼动追踪确定人眼注视点,也可以通过其他方式确定人眼注视点,本公开对此不做限定。需要说明的是,由于双眼在观察物体时,并不一定看的是空间中精确的一个点,也可能是一个较小的范围,因此,人眼注视点并不一定是空间中精确的一个点,也可能是一个预设的区域范围。
其中,拍摄参数信息包括:焦点的位置信息或者拍摄范围。
其中,摄像头的焦点可以为图1中所示的位置103。
其中,拍摄范围可以为图1中所示的拍摄范围101。
S202、根据人眼注视点的位置信息和摄像头的拍摄参数信息,确定并显示指示图形。
头戴式显示设备可以在确定进行拍摄以后,实时获取人眼注视点的位置信息和摄像头的拍摄参数信息,根据获取到的人眼注视点的位置信息和摄像头的拍摄参数信息,确定指示图形,并通过显示屏显示指示图形。
其中,指示图形用于指示针对所述摄像头方向的调整。身体姿态可以包括但不限于头部姿态,即用户的头部位置,面部朝向等信息。
其中,指示图形可以为两个形状,其中一个形状表示用户不需要调整所述摄像头方向,另一个形状表示用户需要调整所述摄像头方向。在用户看到指示图形指示需要调整所述摄像头方向时,进行调整自身的身体姿态,从而当用户将身体姿态调整到不需要再调整所述摄像头方向时,指示图像相应变成另一个形状。
指示图形也可以随着人眼注视点的位置信息和摄像头的拍摄参数 信息的变化进行相应的变化,也就是,在不同人眼注视点的位置信息和摄像头的拍摄参数信息的条件下,指示图形的形状不相同。在用户看到指示图形时,可以进行调整自身的身体姿态,在用户调整自身的身体姿态的过程中,头戴式显示设备也实时获取人眼注视点的位置信息和摄像头的拍摄参数信息,从而使得指示图形随用户身体姿态的调整而变化。
可选的,指示图形可以为四边形,该四边形为畸变的梯形、正方形或者矩形等,也可以为圆形或者椭圆形等,也可以为其他图形,对于指示图形的具体形状本公开不做限定。由于摄像头实际拍摄的画面一般为矩形,例如,可以为长宽比为16:9的矩形,因此,指示图形采用畸变的梯形更容易让用户理解指示图形的含义。
其中,显示指示图形的位置可以将指示图形显示在显示屏的中心位置。也可以在人眼注视点的位置相对于显示屏的位置,显示指示图形。还可以将指示图形显示在显示屏的其他位置,本公开对此不做限定。
本实施例,在用户佩戴头戴式显示设备,需要通过头戴式显示设备上的摄像头进行拍摄图像时,头戴式显示设备根据人眼注视点和摄像头的拍摄参数信息,确定并显示提示针对所述摄像头方向的调整的指示图形,以使用户根据指示图形调整所述摄像头方向,从而为用户指示了明确的调整方向,避免用户盲目的调整,提高了调整效率。
可选的,在图2所示实施例的基础上,进一步地,在S202之后还可以包括S203,如图3所示:
S203、在指示图形指示无需调整所述摄像头方向的情况下,执行拍摄图像。
当指示图形指示无需调整所述摄像头方向的情况下,说明当前用户双眼所看的物体正是摄像头现在拍摄的物体,从而头戴式显示设备控制摄像头拍摄图像。
本实施例,当指示图形指示无需调整所述摄像头方向时,则用户 的眼睛看到的画面与摄像头拍摄的画面一致,此时头戴式显示设备可以进行拍摄图像,使得头戴式显示设备拍摄的图像与用户看到的画面一致,提高了拍摄效率和用户体验。另外,本实施例的方法避免了通过显示屏实时显示摄像头捕捉的画面时,人眼看到的是摄像头捕捉的画面与人眼看到的现实的画面相叠加的效果,从而避免用户出现眩晕的情况。摄像头实时显示摄像头捕捉的画面会使得功耗增大,甚至造成头戴式显示设备发热,本公开的方法通过显示指示图像,降低了头戴式显示设备的功耗,并不会出现发热等给用户带来不良体验的现象,提高了用户体验。
下面以在展馆中用户佩戴AR眼镜参观为例说明本公开的方法的一种具体的应用场景。用户佩戴AR眼镜进行参观时,用户可透过AR眼镜看到展馆中的物品,同时,AR眼镜也可以在其显示屏上显示相关的物品介绍文字或者视频。用户需要对某个感兴趣的物品进行拍摄时,AR眼镜对确定人眼注视点和摄像头的参数信息,通过AR眼镜的显示屏上显示指示图形,用以提示用户当前注视的位置与摄像头实际拍摄的画面是否相符,从而使得用户可以根据指示图形调整自身身体姿态,当指示图形指示无需调整所述摄像头方向时,则用户的眼睛看到的画面与摄像头拍摄的画面一致,此时头戴式显示设备可以进行拍摄图像。
在图2或图3所示实施例的基础上,进一步地,拍摄参数信息可以包括:焦点的位置信息,在步骤S202中,可以确定的人眼注视点与摄像头的焦点之间的第一距离,通过第一距离与第一预设阈值的数值大小关系,显示不同的指示图形。下面以图4所示实施例进行详细说明。
请参见图4,图4为本公开提供的另一种拍摄方法的流程示意图,图4是在图2或图3所示实施例的基础上,进一步地,S202可以通过如下步骤S2022-S2024实现:
S2021、根据人眼注视点的位置信息和摄像头的焦点的位置信息,确定人眼注视点与摄像头的焦点之间的第一距离。
S2022、判断第一距离是否小于等于第一预设阈值。
若第一距离小于等于第一预设阈值,则继续执行S2023,若第一距离大于第一预设阈值,则继续执行S2024。
通过判断第一距离和第一预设阈值的大小关系,可以确定用户当前注视的物体是摄像头当前拍摄图像之间是否有偏差。若第一距离小于等于第一预设阈值,则说明用户当前注视的物体是摄像头当前拍摄图像中会呈现的,则可以显示第一指示图形。
其中,第一预设阈值为预先设置的大于等于0的任一值。例如,当第一预设阈值为0时,则表示当人眼注视点与摄像头的焦点完全重合时,显示第一指示图形。而对于使得人眼注视点和摄像头的焦点完全重合并不容易做到,因此可以在允许的误差范围内设置第一预设阈值为大于0的任一值。
S2023、确定并显示第一指示图形。
其中,第一指示图形用于指示无需调整所述摄像头方向。
继续执行S203。
S2024、在第一距离大于第一预设阈值时,确定并显示第二指示图形。
其中,第二指示图形用于指示需要调整所述摄像头方向。
返回执行S2021。
在第一距离和第一预设阈值的大小关系不同时,显示的指示图形也不相同,从而用户可以根据显示的为第一指示图像还是第二指示图像知晓是否需要调整所述摄像头方向。
其中,第二指示图形为一种与第一指示图形不同的图形。
可选的,第一指示图形为矩形,第二指示图形为四边形,四边形其中一个角为锐角。
可选的,第二指示图形的形状还用于指示用户调整所述摄像头方向的幅度。例如,第二指示图形的形状为其中一个角为锐角的四边形时,则该锐角的角度可以用于指示用户调整所述摄像头方向的幅度。
本实施例,头戴式显示设备通过根据人眼注视点的位置信息和摄像头的焦点的位置信息,确定人眼注视点与摄像头的焦点之间的第一距离,通过判断第一距离是否小于等于第一预设阈值,确定人眼注视点与摄像头的焦点之间的偏离程度,从而显示不同的指示图形,以提示用户是否需要调整其身体姿态,更准确的确定并显示指示图形,从而更准确的通过指示图形给用户提示。
在图4所示实施例的基础上,进一步地,第二指示图形的确定的一种可能的实现方式中,第二指示图形可以为一种预设的固定图形。
则通过第一指示图形和第二指示图形这两种形状指示是否需要调整所述摄像头方向。
另一种可能的实现方式中,第二指示图形可以根据人眼注视点偏离摄像头的焦点的方向确定。下面以具体的实施例进行详细说明。
在图4所示实施例的基础上,在步骤S2024中确定人眼注视点偏离摄像头焦点的位移,从而确定第二指示图形。S2024可以通过如下步骤1和步骤2实现:
步骤1、根据人眼注视点的位置信息和摄像头的焦点的位置信息,确定人眼注视点偏离摄像头的焦点的方向。
步骤2、根据人眼注视点偏离摄像头的焦点的方向,确定并显示第二指示图形。
本实施例,第二指示图形根据人眼注视点偏离摄像头的焦点的方向确定,从而使得显示的第二指示图形能够提示用户偏离方向,用户可以基于第二指示图形确定需要调整身体姿势的方向,从而使得用户可以按照该方向调整身体姿势,第二指示图形的指导性更强,用户调整的时候更有针对性,提高了用户调整身体姿势的效率,同时也就提高了拍摄效率和用户体验。
再一种可能的实现方式中,第二指示图形可以根据第一距离和人眼注视点偏离摄像头的焦点的方向确定。下面以具体的实施例进行详细说明。
步骤2可以通过如下方式实现:
根据第一距离和人眼注视点偏离摄像头的焦点的方向,确定并显示第二指示图形。
本实施例,当第一距离大于第一预设阈值时,人眼注视点的位置与摄像头的焦点之间的距离较大,此时需要用户根据第二指示图形调整其身体姿态,确定人眼注视点相对摄像头的焦点偏移的方向,从而根据第一距离和第一方向,得到第二指示图形,使得第二指示图形既能指示是否需要调整所述摄像头方向,又能指示调整所述摄像头方向的方向,从而使得第二指示图形更准确、直观,进而使得用户调整的时候更有针对性,提高了用户调整身体姿势的效率,同时也就提高了拍摄效率和用户体验。。
进一步地,第二指示图形包括:指示方向和指示幅度。在步骤2中,可以根据第一距离,确定第二指示图形的指示幅度。根据人眼注视点偏离摄像头的焦点的方向,确定第二指示图形的指示方向。根据指示幅度和指示方向,确定并显示指示图形。
本实施例,第二指示图形根据第一距离以及人眼注视点偏离摄像头的焦点的方向确定,从而使得显示的第二指示图形能够提示人眼注视点偏离摄像头的焦点的方向以及偏离程度,用户可以基于第二指示图形确定需要调整身体姿势的方向和幅度,从而使得用户可以按照该方向以及该幅度调整身体姿势,第二指示图形的指导性更强,用户调整的时候更有针对性,提高了用户调整身体姿势的效率,同时也就提高了拍摄效率和用户体验。
下面以用户佩戴AR眼镜为例进行说明。AR眼镜上设置摄像头。请参见图5A和图5B,图5A为本公开提供的一种人眼注视点和摄像头的焦点的位置关系示意图,图5B为图5A的平面示意图。如图5A所示,可以以摄像头为原点,以原点到摄像头的焦点方向为Y轴正方向,双眼所在直线为X轴,建立空间X-Y-Z直角坐标系。人眼注视点501与摄像头的焦点502的第一距离的计算可以转换到如图5B的X-Z平面 中,第一距离为在X-Z平面中人眼注视点501与摄像头的焦点502之间的距离,人眼注视点501偏离摄像头的焦点502的方向即为图5B中X-Z平面中摄像头的焦点502指向人眼注视点501的方向。
相应的,可以根据X-Z平面中人眼注视点501与摄像头的焦点502的第一距离,以及人眼注视点501偏离摄像头的焦点502的方向,确定第二指示图形。
本实施例以第二指示图形是有一个角为锐角的四边形,第一指示图形是矩形为例进行说明。请参见图5C、图5D、图5E和图5F,图5C、图5D、图5E和图5F分别为本公开提供的一种第二指示图形的示意图。
当人眼注视点501与摄像头的焦点502之间的第一距离小于等于第一预设阈值时,可以认为人眼注视点501与摄像头的焦点502重合,此时确定的第一指示图形为矩形。
当人眼注视点501与摄像头的焦点502之间的第一距离大于第一预设阈值时,可以认为人眼注视点501与摄像头的焦点502不重合,从而根据X-Z平面中人眼注视点501与摄像头的焦点502的第一距离,以及人眼注视点501偏离摄像头的焦点502的方向,确定第二指示图形503。
具体的,第二指示图形503的形状为在矩形的基础上畸变得到的,可以根据人眼注视点501偏离摄像头的焦点502的方向,使得矩形的两条边沿着该方向畸变。人眼注视点501与摄像头的焦点502之间的第一距离越大,第二指示图形503的锐角越小,也就是矩形的两条的畸变幅度越大。
可选的,图5C、图5D、图5E和图5F中所示的第二指示图形503中的虚线矩形的中心点到锐角顶点的距离可以与第一距离成预设比例。如图5C和图5D中的第二指示图形503所示的,图5D中的第一距离大于图5C中的第一距离,则相应的,图5D对应的第二指示图形503的锐角比图5C对应的第二指示图形503小,同样,图5D对应的 第二指示图形503的矩形畸变幅度比图5C对应的第二指示图形503的矩形畸变幅度大。
在图2所示实施例的基础上,拍摄参数信息包括:拍摄范围时,步骤S502中,可以确定的人眼注视点与摄像头的拍摄范围的中心点之间的第二距离,通过第二距离与第二预设阈值的数值大小关系,显示不同的指示图形。下面以图6所示实施例进行详细说明。
请参见图6,图6为本公开提供的另一种拍摄方法的流程示意图,图6是在图2所示实施例的基础上,进一步地,S202可以通过如下步骤S202a-S202d实现:
S202a、根据人眼注视点的位置信息和摄像头的拍摄范围,确定人眼注视点与摄像头的拍摄范围的中心点之间的第二距离。
S202b、判断第二距离是否小于等于第二预设阈值。
若第二距离小于等于第二预设阈值,则继续执行S202c。若第二距离大于第二预设阈值,则继续执行S202d。
通过判断第二距离和第二预设阈值的大小关系,可以确定用户当前注视的物体是摄像头当前拍摄范围之间是否有偏差。若第二距离小于等于第二预设阈值,则说明用户当前注视的物体是摄像头当前拍摄图像中会呈现的,则可以显示第一指示图形。
其中,第二预设阈值为预先设置的大于等于0的任一值。例如,当第二预设阈值为0时,则表示当人眼注视点与摄像头的拍摄范围的中心点完全重合时,显示第一指示图形。而对于使得人眼注视点和摄像头的拍摄范围的中心点完全重合并不容易做到,因此可以在允许的误差范围内设置第一预设阈值为大于0的任一值。
S202c、确定并显示第一指示图形。
其中,第一指示图形用于指示无需调整所述摄像头方向。本实施例中的第一指示图形与图3所示实施例中的第一指示图形相同,在此不再赘述。
继续执行S203。
S202d、确定并显示第二指示图形。
其中,第二指示图形用于指示需要调整所述摄像头方向。本实施例中的第二指示图形与图4所示实施例中的第二指示图形相同,在此不再赘述。
返回执行S202a。
本实施例,头戴式显示设备通过根据人眼注视点的位置信息和摄像头的拍摄范围的中心点的位置信息,确定人眼注视点与摄像头的拍摄范围的中心点之间的第二距离,通过判断第二距离是否小于等于第二预设阈值,确定人眼注视点与摄像头的拍摄范围的中心点之间的偏离程度,从而显示不同的指示图形,以提示用户是否需要调整其身体姿态,更准确的确定并显示指示图形,从而更准确的通过指示图形给用户提示,用户调整的时候更有针对性,提高了用户调整身体姿势的效率,同时也就提高了拍摄效率和用户体验。
在图6所示实施例的基础上,进一步地,第二指示图形的确定的一种可能的实现方式中,第二指示图形可以为一种预设的固定图形。
则通过第一指示图形和第二指示图形这两种形状指示是否需要调整所述摄像头方向。
另一种可能的实现方式中,第二指示图形可以根据人眼注视点偏离摄像头的拍摄范围的中心点的方向确定。下面以具体的实施例进行详细说明。
在图4所示实施例的基础上,在步骤S202d中确定人眼注视点偏离摄像头拍摄范围的中心点的位移,从而确定第二指示图形。S202d可以通过如下步骤a和步骤b实现:
步骤a、根据人眼注视点的位置信息和摄像头的拍摄范围的中心点的位置信息,确定人眼注视点偏离摄像头的拍摄范围的中心点的方向。
步骤b、根据人眼注视点偏离摄像头的拍摄范围的中心点的方向,确定并显示第二指示图形。
本实施例,第二指示图形根据人眼注视点偏离摄像头的拍摄范围 的中心点的方向确定,从而使得显示的第二指示图形能够提示用户偏离方向,用户可以基于第二指示图形确定需要调整身体姿势的方向,从而使得用户可以按照该方向调整身体姿势,第二指示图形的指导性更强,用户调整的时候更有针对性,提高了用户调整身体姿势的效率,同时也就提高了拍摄效率和用户体验。
再一种可能的实现方式中,第二指示图形可以根据第一距离和人眼注视点偏离摄像头的拍摄范围的中心点的方向确定。下面以具体的实施例进行详细说明。
步骤b可以通过如下方式实现:
根据第一距离和人眼注视点偏离摄像头的拍摄范围的中心点的方向,确定并显示第二指示图形。
本实施例,当第一距离大于第一预设阈值时,人眼注视点的位置与摄像头的拍摄范围的中心点之间的距离较大,此时需要用户根据第二指示图形调整其身体姿态,确定人眼注视点相对摄像头的拍摄范围的中心点偏移的方向,从而根据第一距离和第一方向,得到第二指示图形,使得第二指示图形既能指示是否需要调整所述摄像头方向,又能指示调整所述摄像头方向的方向,从而使得第二指示图形更准确、直观,进而使得用户能够更快速准确的调整自身的身体姿态,完成拍摄。
进一步地,第二指示图形包括:指示方向和指示幅度。在步骤b中,可以根据第一距离,确定第二指示图形的指示幅度。根据人眼注视点偏离摄像头的拍摄范围的中心点的方向,确定第二指示图形的指示方向。根据指示幅度和指示方向,确定并显示指示图形。
本实施例,第二指示图形根据第一距离以及人眼注视点偏离摄像头的拍摄范围的中心点的方向确定,从而使得显示的第二指示图形能够提示人眼注视点偏离摄像头的拍摄范围的中心点的方向以及偏离程度,用户可以基于第二指示图形确定需要调整身体姿势的方向和幅度,从而使得用户可以按照该方向以及该幅度调整身体姿势,第二指示图 形的指导性更强,使得用户调整身体姿势的效率更高。
在上述图2-图6任一所示实施例的基础上,进一步地,在一些场景中,有些用户并不清楚指示图形实际的含义,用户只是根据指示图形进行调身体姿态,可能需要花费大量的时间,因此,本实施例可以在步骤S102中显示指示图形的同时,输出语音提示,该语音提示用于指示针对所述摄像头方向的调整,例如,可以输出“请调整头部方向”或者“请保持当前头部姿态,进行拍摄”等。从而使得用户更明确当前是否需要调整所述摄像头方向。
在上述图2-图5任一所示实施例的基础上,进一步地,在指示图形指示需要调整所述摄像头方向时,指示图形中还显示有调整方向标识,调整方向标识用于指示用户根据调整方向标识调整所述摄像头方向。
通过显示调整方向标识,使得用户更容易理解需要如何调整自身的身体姿态,用户调整的时候更有针对性,提高了用户调整身体姿势的效率,同时也就提高了拍摄效率和用户体验。
在上述图2-图5任一所示实施例的基础上,进一步地,在指示图形指示无需调整所述摄像头方向时,指示图形以预设颜色显示。例如,可以为绿色或者黄色显示指示图形,本公开对此不做限定。
由于当人眼注视点与摄像头实际拍摄的范围之间的偏差越小,用户越不容易分辨出当前的指示图像为第一指示图形还是第二指示图形,因此,可以通过将第二指示图形以预设颜色显示,从而起到更好的提示用户当前是否需要调整所述摄像头方向的作用。
在上述图3-图6任一所示实施例的基础上,进一步地,步骤S203的一种可能的实现方式中,头戴式显示设备可以在指示图形指示无需调整所述摄像头方向时,直接执行拍摄图像。示例性的,在图4或图6所示的实施例中,头戴式显示设备在指示图形为第一指示图形时,直接执行拍摄图像。下面以图7所示实施例进行详细说明。
在指示图形指示无需调整所述摄像头方向时,执行拍摄图像。
本实施例,头戴式显示设备通过在指示图形指示无需调整所述摄像头方向时,直接执行拍摄图像,使得头戴式显示设备在拍摄画面与人眼看到画面相符时,自动执行拍摄图像,提高了拍摄图像的效率。
进一步地,在指示图形指示无需调整所述摄像头方向时,执行拍摄图像之前,还包括:
接收用户设置的自动拍摄功能开启执行。
其中,自动拍摄功能用于在指示图形指示无需调整所述摄像头方向时,直接触发执行拍摄图像。
本实施例,通过在拍摄图像前先接受用户设置的自动拍摄功能开启执行,则在指示图形指示无需调整所述摄像头方向时,头戴式显示设备可以直接触发执行拍摄图像,自动拍摄图像的过程是用户许可的,符合系统安全性,并充分考虑用户的需求。
在上述图3-图6任一所示实施例的基础上,进一步地,步骤S203的另一种可能的实现方式中,可以根据指示图形指示无需调整所述摄像头方向以后,用户向头戴式显示设备输入用于指示拍摄的触发指令,从而头戴式显示设备执行拍摄图像。下面以具体的实施例进行详细说明。步骤S203可以通过如下步骤实现:
在指示图形指示无需调整所述摄像头方向后,接收用户输入的触发指令,执行拍摄图像。
用户根据当前指示图形的形状,可以确定是否需要调整所述摄像头方向,当指示图形指示无需调整所述摄像头方向后,用户可以向头戴式显示设备输入触发指令,从而触发头戴式显示设备执行拍摄图像。
本实施例,头戴式显示设备通过接收用户输入的触发指令以后,再执行拍摄图像,充分考虑用户需求,在用户触发拍摄时才执行拍摄,从而保证每次拍摄的图像都是用户需要的。
在上述实施例的基础上,进一步地,在步骤S201之前还可以包括如下步骤:
接收拍摄启动指令。
其中,拍摄启动指令用于指示头戴式显示设备执行拍摄。拍摄启动指令可以为用户输入的语音指令、手势动作指令或者触摸按钮指令。其中,语音指令可以为“拍照”或“开始拍摄”等。手势动作指令可以为握拳,手指在空中点击操作等。触摸按钮指令可以为用户按下头戴式显示设备上设置的拍摄按钮。
进一步地,在接收拍摄启动指令以后,头戴式显示设备可以在显示屏中显示表示拍摄范围的矩形框,例如,可以为16:9的矩形框,从而提示用户拍摄模式开启。
在上述实施例的基础上,进一步地,在步骤S203中执行拍摄图像可以包括如下步骤:
控制摄像头根据人眼注视点的位置信息所在的物体进行对焦,通过摄像头拍摄图像。
本实施例,头戴式显示设备控制摄像头在对人眼注视点的位置信息所在的物体进行对焦以后,再执行拍摄图像,从而使得拍摄得到的图像即为人眼看到的画面,并且人眼主要注视的物体在拍摄画面中是清晰的。
图7为本公开提供的一种拍摄装置的结构示意图,如图7所示,本实施例的装置应用于头戴式显示设备,头戴式显示设备上设置有摄像头,装置包括:
获取模块701,用于获取人眼注视点的位置信息和摄像头的拍摄参数信息;
处理模块702,用于根据人眼注视点的位置信息和摄像头的拍摄参数信息,确定指示图形,指示图形用于指示针对所述摄像头方向的调整;
显示模块703,用于显示指示图形;
可选的,还包括:拍摄模块704,用于在指示图形指示无需调整所述摄像头方向的情况下,执行拍摄图像。
可选的,拍摄参数信息包括:焦点的位置信息;
处理模块702具体用于:根据人眼注视点的位置信息和摄像头的焦点的位置信息,确定人眼注视点与摄像头的焦点之间的第一距离;在第一距离小于等于第一预设阈值时,确定第一指示图形,第一指示图形用于指示无需调整所述摄像头方向;在第一距离大于第一预设阈值时,确定第二指示图形,第二指示图形用于指示需要调整所述摄像头方向。
可选的,处理模块702具体用于:在第一距离大于第一预设阈值时,根据人眼注视点的位置信息和摄像头的焦点的位置信息,确定人眼注视点偏离摄像头的焦点的方向;根据人眼注视点偏离摄像头的焦点的方向,确定第二指示图形。
可选的,处理模块702具体用于:根据第一距离和人眼注视点偏离摄像头的焦点的方向,确定并显示第二指示图形。
可选的,第二指示图形包括:指示方向和指示幅度;
处理模块702具体用于:根据第一距离,确定第二指示图形的指示幅度;根据人眼注视点偏离摄像头的焦点的方向,确定第二指示图形的指示方向;根据指示幅度和指示方向,确定并显示指示图形。
可选的,拍摄参数信息包括:拍摄范围;
处理模块702具体用于:根据人眼注视点的位置信息和摄像头的拍摄范围,确定人眼注视点与摄像头的拍摄范围的中心点之间的第二距离;在第二距离小于等于第二预设阈值时,确定第一指示图形,第一指示图形用于指示无需调整所述摄像头方向;在第二距离大于第二预设阈值时,确定第二指示图形,第二指示图形用于指示需要调整所述摄像头方向。
可选的,显示模块703还用于:在指示图形指示需要调整所述摄像头方向时,指示图形中还显示有调整方向标识,调整方向标识用于指示用户根据调整方向标识调整所述摄像头方向。
可选的,显示模块703还用于:在指示图形指示无需调整所述摄像头方向时,指示图形以预设颜色显示。
可选的,拍摄模块704具体用于:
在指示图形指示无需调整所述摄像头方向时,执行拍摄图像。
可选的,装置还包括:
接收模块,用于接收用户设置的自动拍摄功能开启执行,自动拍摄功能用于在指示图形指示无需调整所述摄像头方向时,直接触发执行拍摄图像。
可选的,接收模块还用于:在指示图形指示无需调整所述摄像头方向后,接收用户输入的触发指令,执行拍摄图像。
可选的,第二指示图形的形状还用于指示用户调整所述摄像头方向的幅度。
可选的,第一指示图形为矩形,第二指示图形为四边形,四边形其中一个角为锐角。
上述实施例的装置,可以用于执行上述方法实施例的技术方案,其实现原理和技术效果类似,此处不再赘述。
本公开实施例提供一种电子设备,包括:显示屏;一个或多个处理器;存储器;以及一个或多个计算机程序;其中一个或多个计算机程序被存储在存储器中;一个或多个处理器在执行一个或多个计算机程序时,使得电子设备实现如上述实施例的方法。
本公开实施例提供一种计算机存储介质,包括计算机指令,当计算机指令在电子设备上运行时,使得电子设备执行如上述实施例的方法。
本公开实施例提供一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行如上述实施例的方法。
需要说明的是,在本文中,诸如“第一”和“第二”等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或 者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括要素的过程、方法、物品或者设备中还存在另外的相同要素。
以上仅是本公开的具体实施方式,使本领域技术人员能够理解或实现本公开。对这些实施例的多种修改对本领域的技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本公开的精神或范围的情况下,在其它实施例中实现。因此,本公开将不会被限制于本文的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。

Claims (14)

  1. 一种拍摄方法,其特征在于,应用于头戴式显示设备,所述头戴式显示设备上设置有摄像头,所述方法包括:
    获取人眼注视点的位置信息和所述摄像头的拍摄参数信息;
    根据人眼注视点的位置信息和所述摄像头的拍摄参数信息,确定并显示指示图形,所述指示图形用于指示针对所述摄像头方向的调整。
  2. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    在所述指示图形指示无需调整所述摄像头方向的情况下,执行拍摄图像。
  3. 根据权利要求1所述的方法,其特征在于,所述拍摄参数信息包括:焦点的位置信息;
    所述根据人眼注视点的位置信息和所述摄像头的拍摄参数信息,确定并显示指示图形,包括:
    根据人眼注视点的位置信息和所述摄像头的焦点的位置信息,确定所述人眼注视点与所述摄像头的焦点之间的第一距离;
    在所述第一距离小于等于第一预设阈值时,确定并显示第一指示图形,所述第一指示图形用于指示无需调整所述摄像头方向;
    在所述第一距离大于第一预设阈值时,确定并显示第二指示图形,所述第二指示图形用于指示需要调整所述摄像头方向。
  4. 根据权利要求3所述的方法,其特征在于,所述在所述第一距离大于第一预设阈值时,确定并显示第二指示图形,包括:
    在所述第一距离大于第一预设阈值时,根据人眼注视点的位置信息和所述摄像头的焦点的位置信息,确定所述人眼注视点偏离所述摄像头的焦点的方向;
    根据所述人眼注视点偏离所述摄像头的焦点的方向,确定并显示第二指示图形。
  5. 根据权利要求4所述的方法,其特征在于,所述根据所述人眼 注视点偏离所述摄像头的焦点的方向,确定并显示第二指示图形,包括:
    根据所述第一距离和所述人眼注视点偏离所述摄像头的焦点的方向,确定并显示第二指示图形。
  6. 根据权利要求5所述的方法,其特征在于,所述第二指示图形包括:指示方向和指示幅度;
    所述根据所述第一距离和所述人眼注视点偏离所述摄像头的焦点的方向,确定并显示第二指示图形,包括:
    根据所述第一距离,确定所述第二指示图形的指示幅度;
    根据所述人眼注视点偏离所述摄像头的焦点的方向,确定所述第二指示图形的指示方向;
    根据所述指示幅度和所述指示方向,确定并显示所述指示图形。
  7. 根据权利要求1所述的方法,其特征在于,在所述指示图形指示需要调整所述摄像头方向时,所述指示图形中还显示有调整方向标识,所述调整方向标识用于指示用户根据所述调整方向标识调整所述摄像头方向。
  8. 根据权利要求1或7所述的方法,其特征在于,在所述指示图形指示无需调整所述摄像头方向时,所述指示图形以预设颜色显示。
  9. 根据权利要求2-7任一项所述的方法,其特征在于,所述在所述指示图形指示无需调整所述摄像头方向情况下,执行拍摄图像之前,还包括:
    接收用户设置的自动拍摄功能开启执行,所述自动拍摄功能用于在所述指示图形指示无需调整所述摄像头方向时,直接触发执行拍摄图像。
  10. 根据权利要求2-7任一项所述的方法,其特征在于,所述在所述指示图形指示无需调整所述摄像头方向情况下,执行拍摄图像,包括:
    在所述指示图形指示无需调整所述摄像头方向后,接收用户输入 的触发指令,执行拍摄图像。
  11. 一种拍摄装置,其特征在于,应用于头戴式显示设备,所述头戴式显示设备上设置有摄像头,所述装置包括:
    获取模块,用于获取人眼注视点的位置信息和所述摄像头的拍摄参数信息;
    处理模块,用于根据人眼注视点的位置信息和所述摄像头的拍摄参数信息,确定指示图形,所述指示图形用于指示针对所述摄像头方向的调整;
    显示模块,用于显示指示图形;
    拍摄模块,用于在所述指示图形指示无需调整所述摄像头方向的情况下,执行拍摄图像。
  12. 一种电子设备,包括:显示屏;一个或多个处理器;存储器;以及一个或多个计算机程序;其中所述一个或多个计算机程序被存储在所述存储器中;其特征在于,所述一个或多个处理器在执行所述一个或多个计算机程序时,使得所述电子设备实现如权利要求1-10任一项所述的方法。
  13. 一种计算机存储介质,其特征在于,包括计算机指令,当所述计算机指令在电子设备上运行时,使得所述电子设备执行如权利要求1-10任一项所述的方法。
  14. 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求1-10任一项所述的方法。
PCT/CN2022/092076 2021-07-26 2022-05-10 拍摄方法、装置、电子设备、存储介质和计算机程序产品 WO2023005338A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110846022.XA CN115695768A (zh) 2021-07-26 2021-07-26 拍摄方法、装置、电子设备、存储介质和计算机程序产品
CN202110846022.X 2021-07-26

Publications (1)

Publication Number Publication Date
WO2023005338A1 true WO2023005338A1 (zh) 2023-02-02

Family

ID=85044449

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/092076 WO2023005338A1 (zh) 2021-07-26 2022-05-10 拍摄方法、装置、电子设备、存储介质和计算机程序产品

Country Status (2)

Country Link
CN (1) CN115695768A (zh)
WO (1) WO2023005338A1 (zh)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015126451A (ja) * 2013-12-27 2015-07-06 レノボ・シンガポール・プライベート・リミテッド 画像の記録方法、電子機器およびコンピュータ・プログラム
US20180007255A1 (en) * 2016-06-30 2018-01-04 Thalmic Labs Inc. Image capture systems, devices, and methods that autofocus based on eye-tracking
CN108881724A (zh) * 2018-07-17 2018-11-23 北京七鑫易维信息技术有限公司 一种图像获取方法、装置、设备及存储介质
CN110225252A (zh) * 2019-06-11 2019-09-10 Oppo广东移动通信有限公司 拍照控制方法及相关产品
CN111970456A (zh) * 2020-09-14 2020-11-20 Oppo广东移动通信有限公司 拍摄控制方法、装置、设备及存储介质
CN112738388A (zh) * 2019-10-28 2021-04-30 七鑫易维(深圳)科技有限公司 拍照处理方法、系统、电子设备及存储介质
CN112995507A (zh) * 2021-02-08 2021-06-18 北京蜂巢世纪科技有限公司 提示对象位置的方法及装置
US20210208675A1 (en) * 2018-06-06 2021-07-08 Beijing 7Invensun Technology Co., Ltd. Smart Glasses, Method and Device for Tracking Eyeball Trajectory, and Storage Medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015126451A (ja) * 2013-12-27 2015-07-06 レノボ・シンガポール・プライベート・リミテッド 画像の記録方法、電子機器およびコンピュータ・プログラム
US20180007255A1 (en) * 2016-06-30 2018-01-04 Thalmic Labs Inc. Image capture systems, devices, and methods that autofocus based on eye-tracking
US20210208675A1 (en) * 2018-06-06 2021-07-08 Beijing 7Invensun Technology Co., Ltd. Smart Glasses, Method and Device for Tracking Eyeball Trajectory, and Storage Medium
CN108881724A (zh) * 2018-07-17 2018-11-23 北京七鑫易维信息技术有限公司 一种图像获取方法、装置、设备及存储介质
CN110225252A (zh) * 2019-06-11 2019-09-10 Oppo广东移动通信有限公司 拍照控制方法及相关产品
CN112738388A (zh) * 2019-10-28 2021-04-30 七鑫易维(深圳)科技有限公司 拍照处理方法、系统、电子设备及存储介质
CN111970456A (zh) * 2020-09-14 2020-11-20 Oppo广东移动通信有限公司 拍摄控制方法、装置、设备及存储介质
CN112995507A (zh) * 2021-02-08 2021-06-18 北京蜂巢世纪科技有限公司 提示对象位置的方法及装置

Also Published As

Publication number Publication date
CN115695768A (zh) 2023-02-03

Similar Documents

Publication Publication Date Title
US10691934B2 (en) Real-time visual feedback for user positioning with respect to a camera and a display
US9264702B2 (en) Automatic calibration of scene camera for optical see-through head mounted display
US9651782B2 (en) Wearable tracking device
CN103207664B (zh) 一种图像处理方法和设备
US20140254939A1 (en) Apparatus and method for outputting information on facial expression
US10296783B2 (en) Image processing device and image display device
JP7026825B2 (ja) 画像処理方法及び装置、電子機器並びに記憶媒体
WO2016131217A1 (zh) 一种图像校正的方法和装置
CN106780389B (zh) 一种基于坐标转换的鱼眼图像校正方法及装置
CN108090463B (zh) 对象控制方法、装置、存储介质和计算机设备
CN110636218B (zh) 对焦方法、装置、存储介质及电子设备
WO2014128748A1 (ja) キャリブレーション装置、キャリブレーションプログラム、およびキャリブレーション方法
US20190362559A1 (en) Augmented reality method for displaying virtual object and terminal device therefor
JP2021508109A (ja) 頭部装着型ディスプレイデバイスおよびその方法
WO2014128751A1 (ja) ヘッドマウントディスプレイ装置、ヘッドマウントディスプレイ用プログラム、およびヘッドマウントディスプレイ方法
JP6294054B2 (ja) 映像表示装置、映像提示方法及びプログラム
CN107436681A (zh) 自动调节文字的显示大小的移动终端及其方法
Nitschke et al. I see what you see: point of gaze estimation from corneal images
WO2023005338A1 (zh) 拍摄方法、装置、电子设备、存储介质和计算机程序产品
CN113596323A (zh) 智能合影方法、装置、移动终端及计算机程序产品
CN110737326A (zh) 虚拟对象的显示方法、装置、终端设备及存储介质
CN109934168B (zh) 人脸图像映射方法及装置
KR20140090538A (ko) 디스플레이 장치 및 제어 방법
JP6210447B2 (ja) 視線計測装置、注視点の表示方法、注視領域の表示方法および注視点のガウス分布の表示方法
CN115248501B (zh) 增强现实设备的显示方法、装置和增强现实设备

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE