WO2023097724A1 - 一种拍摄功能的控制方法、装置、ar设备及存储介质 - Google Patents

一种拍摄功能的控制方法、装置、ar设备及存储介质 Download PDF

Info

Publication number
WO2023097724A1
WO2023097724A1 PCT/CN2021/136624 CN2021136624W WO2023097724A1 WO 2023097724 A1 WO2023097724 A1 WO 2023097724A1 CN 2021136624 W CN2021136624 W CN 2021136624W WO 2023097724 A1 WO2023097724 A1 WO 2023097724A1
Authority
WO
WIPO (PCT)
Prior art keywords
shooting
preview
photographing
area
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2021/136624
Other languages
English (en)
French (fr)
Inventor
杨青河
邱绪东
郭晓峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Inc
Original Assignee
Goertek Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Inc filed Critical Goertek Inc
Priority to US18/552,450 priority Critical patent/US12568301B2/en
Publication of WO2023097724A1 publication Critical patent/WO2023097724A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera

Definitions

  • the present application relates to the field of augmented reality technology, and in particular to a method, device, AR device, and storage medium for controlling a shooting function.
  • AR Augmented Reality
  • AR equipment simulates computer-generated text, images, 3D models, music, videos and other virtual information and applies them to the real world.
  • the two kinds of information complement each other to enhance the real world.
  • AR devices with camera devices are gradually being widely used.
  • the user can use the camera device of the AR device to perform operations such as video conferencing and image capture.
  • the preview content (that is, the content that can be captured currently) is often rendered by optical machine.
  • the display of the preview content needs to be refreshed frequently, which seriously affects the battery life of the AR device.
  • the purpose of the present application is to provide a shooting function control method, device, AR device and storage medium, which can reduce the power consumption of the shooting function of the AR device and increase the battery life.
  • the present application provides a method for controlling the shooting function, which is applied to an AR device.
  • the method for controlling the shooting function includes:
  • setting the display state of the AR device to a non-preview state includes:
  • controlling the optical machine of the AR device to display a black image, so as to set the display state of the AR device to the non-preview state.
  • setting the display state of the AR device to a non-preview state includes:
  • a viewfinder frame of the shooting device is determined according to the boundary of the viewfinder area, and the viewfinder frame is set as the current display content of the AR device.
  • the method further includes:
  • the color of the viewfinder frame is set as the first color
  • the color of the viewfinder frame is set to the second color.
  • the viewfinder area before setting the smallest area among the shooting area of the shooting device, the optical-mechanical display area, and the human eye observation area as the viewfinder area, it also includes:
  • the human eye observation area is determined according to the viewing angle of the user's eyes.
  • the method further includes:
  • the focus state includes focusing completed and focusing not completed.
  • the present application also provides a shooting function control device, which is applied to AR equipment, and the device includes:
  • a shooting function starting module configured to start the shooting device of the AR device if a shooting function calling instruction is received
  • a display control module configured to set the display state of the AR device to a non-preview state; wherein, in the non-preview state, the current display content of the AR device does not include shooting preview content;
  • the photographing module is configured to determine whether a photographing instruction is received; if yes, control the photographing device to perform the operation corresponding to the photographing instruction.
  • the present application also provides a storage medium on which a computer program is stored, and when the computer program is executed, the steps performed by the control method for the above-mentioned shooting function are realized.
  • the present application also provides an electronic device, including a memory and a processor, the memory stores a computer program, and when the processor invokes the computer program in the memory, the steps performed by the control method for the above-mentioned photographing function are realized.
  • the present application provides a method for controlling a shooting function, which is applied to an AR device, including: if a shooting function call instruction is received, starting the shooting device of the AR device; setting the display state of the AR device to a non-preview state ; Wherein, in the non-preview state, the current display content of the AR device does not include shooting preview content; determine whether a shooting instruction is received; if so, control the shooting device to perform the operation corresponding to the shooting instruction.
  • This application activates the shooting device of the AR device after receiving the shooting function call command.
  • the AR device will display the preview content of the shooting device after starting the shooting device.
  • the shooting device is controlled to perform the operation corresponding to the shooting instruction. Because the user can see the external scene while seeing the content displayed on the screen of the AR device.
  • the display state of the AR device is set to a non-preview state, so that the current display content of the AR device does not include the shooting preview content.
  • the preview content of the shooting device is not displayed on the display screen of the AR device, thereby reducing the power consumption of the shooting function of the AR device and increasing the battery life.
  • the present application also provides a shooting function control device, an electronic device, and a storage medium, which have the above-mentioned beneficial effects, and will not be repeated here.
  • FIG. 1 is a flow chart of a method for controlling a shooting function provided by an embodiment of the present application
  • FIG. 2 is a flow chart of a method for controlling a camera of an AR device provided in an embodiment of the present application
  • FIG. 3 is a schematic diagram of a viewfinder setting method provided by an embodiment of the present application.
  • FIG. 4 is a schematic structural diagram of a control device for a shooting function provided by an embodiment of the present application.
  • FIG. 1 is a flowchart of a method for controlling a shooting function provided by an embodiment of the present application.
  • this embodiment can be applied to an AR device equipped with a shooting device.
  • the user can send a shooting function call command to the AR device through a manual trigger button, or through an intelligent terminal (such as a mobile phone, a tablet computer, etc.) connected to the AR device.
  • the shooting function calling instruction is an instruction to start the shooting device of the AR device, so as to use the shooting device to shoot images or videos.
  • the shooting device of the AR device Before receiving the shooting function calling instruction, the shooting device of the AR device may be in an off state, and after receiving the shooting function calling instruction, the shooting device may be started.
  • the AR device may include multiple photographing devices, and in this embodiment, the photographing device corresponding to the command to call the photographing function may be activated.
  • the display state after starting the shooting device of the AR device, can be set to the preview state first, and the display state can be set to the non-preview state after a preset time delay (such as 3 seconds). .
  • a preset time delay such as 3 seconds.
  • S103 Determine whether a shooting instruction is received; if so, proceed to S104;
  • S104 Control the photographing device to perform an operation corresponding to the photographing instruction.
  • the photographing device may be controlled to execute the operation corresponding to the photographing instruction to obtain a corresponding image or video.
  • the operation result can be saved locally or uploaded to the cloud.
  • it may be delayed for a certain period of time (such as 0.5s) to determine whether the shooting instruction is received again.
  • the shooting device of the AR device is activated after receiving the command to call the shooting function.
  • the AR device will display the preview content of the shooting device after starting the shooting device.
  • the shooting device is controlled to perform the operation corresponding to the shooting instruction. Because the user can see the external scene while seeing the content displayed on the screen of the AR device.
  • the display state of the AR device is set to a non-preview state, so that the current display content of the AR device does not include shooting preview content.
  • the preview content of the shooting device is not displayed on the display screen of the AR device, thereby reducing the power consumption of the shooting function of the AR device and increasing the battery life.
  • Way 1 Control the optical machine of the AR device to display a black image, so as to set the display state of the AR device to the non-preview state.
  • the optical machine displays a black image
  • the transparent content is displayed on the AR lens, and the AR device does not need to render the content with color.
  • Mode 2 closing the preview data channel of the shooting device, so as to set the display state of the AR device to the non-preview state.
  • This embodiment can also control the optical machine of the AR device to display a black image, and close the preview data channel of the shooting device, so as to set the display state of the AR device to a non-preview state.
  • FIG. 1 does not display the preview content of the camera device, in order to facilitate the user to determine the currently available shooting area, the user may be prompted with the currently available shooting content by displaying a viewfinder frame. Therefore, the present application can determine and display the viewfinder frame in the following manner: setting the smallest area among the shooting area of the photographing device, the optical-mechanical display area and the human eye observation area as the viewfinder area; and setting the viewfinder frame as the current display content of the AR device.
  • the photographing area of the photographing device may be determined according to the field of view of the photographing device; the opto-mechanical display area may also be determined according to the opto-mechanical field of view of the AR device; or the field of view of the user's eyes may be determined.
  • the angle determines the viewing area of the human eye.
  • the viewfinder frame may also be determined whether the camera is in focus; if yes, set the color of the viewfinder frame to the first color; if not , then set the color of the viewfinder frame to the second color.
  • the user may be prompted whether the focus has been completed by changing the color of the viewfinder frame.
  • the shooting result collected by the shooting device may also be saved to the storage space, and the focus state of the shooting result may be recorded; wherein, the focusing The status includes focus complete and focus incomplete.
  • This embodiment provides a camera preview solution for an AR device. Since the AR device can see external scenes, when the camera is turned on to take pictures or record videos, there is no need to swipe the preview image of the camera to the screen.
  • the viewing frame is determined by comparing the field of view fov (field of view) of the camera, the optical machine, and the human eye, and the viewing frame is displayed on the optical machine, effectively reducing the power consumption of the whole machine.
  • FIG. 2 is a flowchart of a method for controlling a camera of an AR device provided in an embodiment of the present application. This embodiment may include the following steps:
  • Step 1 Receive the command to turn on the camera, and determine the viewfinder frame according to the fov range of the optical machine and the fov range of the camera. If the fov of the optical machine is greater than the fov of the camera, take the fov of the camera as the frame. Otherwise, the fov of the light picker is used as the viewfinder frame.
  • Fig. 3 is a schematic diagram of a viewfinder setting method provided by the embodiment of the present application. In this embodiment, the optical-mechanical fov and the boundary of the smallest range in the optical-mechanical fov are selected as the viewfinder (the dotted line frame in Fig. 3) .
  • Step 2 Open the camera app and set it to no-preview mode.
  • Step 3 According to the fov range in step 1, a red viewfinder frame is displayed on the display.
  • Step 4 Receive the camera command and call the camera's camera service.
  • Step 5 When the camera is in focus, a green viewfinder frame can be displayed.
  • Step 6 After the camera captures the image, save the image to the storage space.
  • Step 7 When the command to turn off the camera is received, turn off the camera and control the optical machine to display the system interface.
  • a black image with a viewfinder frame may be displayed on the screen, or the camera preview data channel may be closed, thereby setting the AR device to a no-preview mode. Due to the characteristics of the optical machine, the black image area does not display content and no light is emitted, that is to say, only the red viewfinder frame pattern is displayed on the spectacle lens through light, and the human eye can see the outside world through these areas of the lens.
  • a camera command such as voice, button or gesture is received
  • the image display changes from a red frame to a green frame (focus is complete), and then the background camera application obtains the image and saves it in the storage space.
  • FIG. 4 is a schematic structural diagram of a control device for a shooting function provided by an embodiment of the present application.
  • the device can include:
  • a shooting function starting module 401 configured to start the shooting device of the AR device if a shooting function calling instruction is received;
  • a display control module 402 configured to set the display state of the AR device to a non-preview state; wherein, in the non-preview state, the current display content of the AR device does not include shooting preview content;
  • the photographing module 403 is configured to determine whether a photographing instruction is received; if yes, control the photographing device to perform an operation corresponding to the photographing instruction.
  • the shooting device of the AR device is activated after receiving the command to call the shooting function.
  • the AR device will display the preview content of the shooting device after starting the shooting device.
  • the shooting device is controlled to perform the operation corresponding to the shooting instruction. Because the user can see the external scene while seeing the content displayed on the screen of the AR device.
  • the display state of the AR device is set to a non-preview state, so that the current display content of the AR device does not include shooting preview content.
  • the preview content of the shooting device is not displayed on the display screen of the AR device, thereby reducing the power consumption of the shooting function of the AR device and increasing the battery life.
  • the display control module 402 includes:
  • a first control unit configured to control the optical machine of the AR device to display a black image, so as to set the display state of the AR device to the non-preview state.
  • the second control unit is configured to close the preview data channel of the shooting device, so as to set the display state of the AR device to the non-preview state.
  • the viewfinder frame setting module is used to set the smallest area among the shooting area of the photographing device, the optomechanical display area and the human eye observation area as the viewfinder area; it is also used to determine the viewfinder frame of the photographing device according to the boundary of the viewfinder area, And set the viewfinder frame as the current display content of the AR device.
  • a focusing module configured to determine whether the camera is in focus after setting the viewfinder frame as the current display content of the AR device; if yes, set the color of the viewfinder frame to the first color; if not , then set the color of the viewfinder frame to the second color.
  • the display area setting module is used to determine the shooting area of the shooting device according to the field angle of the shooting device before setting the smallest area among the shooting area of the shooting device, the optomechanical display area and the human eye observation area as the viewing area; It is also used to determine the opto-mechanical display area according to the opto-mechanical field of view of the AR device; it is also used to determine the human eye observation area according to the field of view of the user's eyes.
  • a storage module configured to save the photographing result collected by the photographing device to a storage space after controlling the photographing device to execute the operation corresponding to the photographing instruction, and record the focus state of the photographing result; wherein, the focusing The status includes focus complete and focus incomplete.
  • the present application also provides a storage medium on which a computer program is stored. When the computer program is executed, the steps provided in the above-mentioned embodiments can be realized.
  • the storage medium may include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes.
  • the present application also provides an AR device, which may include a memory and a processor, where a computer program is stored in the memory, and when the processor invokes the computer program in the memory, the steps provided in the foregoing embodiments may be implemented.
  • the AR device may also include various network interfaces, power supplies and other components.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

本申请公开了一种拍摄功能的控制方法，应用于AR设备，包括：若接收到拍摄功能调用指令，则启动所述AR设备的拍摄装置；将所述AR设备的显示状态设置为非预览状态；其中，在所述非预览状态下所述AR设备的当前显示内容不包括拍摄预览内容；判断是否接收到拍摄指令；若是，则控制所述拍摄装置执行所述拍摄指令对应的操作。本申请能够降低AR设备拍摄功能的功耗，提高续航时长。本申请还公开了一种拍摄功能的控制装置、一种存储介质及一种AR设备，具有以上有益效果。

Description

一种拍摄功能的控制方法、装置、AR设备及存储介质
本申请要求于2021年11月30日提交中国专利局、申请号为202111447242.1、发明名称为“一种拍摄功能的控制方法、装置、AR设备及存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及增强现实技术领域，特别涉及一种拍摄功能的控制方法、装置、AR设备及存储介质。
背景技术
AR(Augmented Reality，增强现实)技术是一种将虚拟信息与真实世界融合的技术，AR设备将计算机生成的文字、图像、三维模型、音乐、视频等虚拟信息模拟仿真后应用到真实世界中，两种信息互为补充从而实现对真实世界的增强。
随着AR的发展，带有摄像装置的AR设备逐渐被广泛应用。用户可以使用AR设备的摄像装置进行视频会议、图像拍摄等操作。在AR设备启动摄像功能时，往往通过光机渲染预览内容(即，当前可以拍摄到的内容)。但是，预览内容的显示需要频繁刷新，严重影响AR设备的续航时间。
因此，如何降低AR设备拍摄功能的功耗，提高续航时长是本领域技术人员目前需要解决的技术问题。
发明内容
本申请的目的是提供一种拍摄功能的控制方法、装置、AR设备及存储介质，能够降低AR设备拍摄功能的功耗，提高续航时长。
为解决上述技术问题，本申请提供一种拍摄功能的控制方法，应用于AR设备，该拍摄功能的控制方法包括：
若接收到拍摄功能调用指令，则启动所述AR设备的拍摄装置；
将所述AR设备的显示状态设置为非预览状态；其中，在所述非预览状 态下所述AR设备的当前显示内容不包括拍摄预览内容；
判断是否接收到拍摄指令；
若是，则控制所述拍摄装置执行所述拍摄指令对应的操作。
可选的，将所述AR设备的显示状态设置为非预览状态，包括：
控制所述AR设备的光机显示黑色图像，以便将所述AR设备的显示状态设置为所述非预览状态。
可选的，将所述AR设备的显示状态设置为非预览状态，包括：
关闭所述拍摄装置的预览数据通道，以便将所述AR设备的显示状态设置为所述非预览状态。
可选的，还包括：
将拍摄装置拍摄区域、光机显示区域和人眼观察区域中最小的区域设置为取景区域；
根据所述取景区域的边界确定所述拍摄装置的取景框，并将所述取景框设置为所述AR设备的当前显示内容。
可选的，在将所述取景框设置为所述AR设备的当前显示内容之后，还包括：
判断所述拍摄装置是否对焦完毕；
若是，则将所述取景框的颜色设置为第一颜色；
若否，则将所述取景框的颜色设置为第二颜色。
可选的，在将拍摄装置拍摄区域、光机显示区域和人眼观察区域中最小的区域设置为取景区域之前，还包括：
根据所述拍摄装置的视场角确定所述拍摄装置拍摄区域；
根据所述AR设备的光机视场角确定所述光机显示区域；
根据用户眼睛的视场角确定所述人眼观察区域。
可选的，在控制所述拍摄装置执行所述拍摄指令对应的操作之后，还包括：
将所述拍摄装置采集的拍摄结果保存至存储空间，并记录所述拍摄结果的对焦状态；其中，所述对焦状态包括对焦完毕和对焦未完毕。
本申请还提供了一种拍摄功能的控制装置，应用于AR设备，该装置包括：
拍摄功能启动模块，用于若接收到拍摄功能调用指令，则启动所述AR设备的拍摄装置；
显示控制模块，用于将所述AR设备的显示状态设置为非预览状态；其中，在所述非预览状态下所述AR设备的当前显示内容不包括拍摄预览内容；
拍摄模块，用于判断是否接收到拍摄指令；若是，则控制所述拍摄装置执行所述拍摄指令对应的操作。
本申请还提供了一种存储介质，其上存储有计算机程序，所述计算机程序执行时实现上述拍摄功能的控制方法执行的步骤。
本申请还提供了一种电子设备，包括存储器和处理器，所述存储器中存储有计算机程序，所述处理器调用所述存储器中的计算机程序时实现上述拍摄功能的控制方法执行的步骤。
本申请提供了一种拍摄功能的控制方法，应用于AR设备，包括：若接收到拍摄功能调用指令，则启动所述AR设备的拍摄装置；将所述AR设备的显示状态设置为非预览状态；其中，在所述非预览状态下所述AR设备的当前显示内容不包括拍摄预览内容；判断是否接收到拍摄指令；若是，则控制所述拍摄装置执行所述拍摄指令对应的操作。
本申请在接收到拍摄功能调用指令后启动AR设备的拍摄装置，在常规方案中AR设备启动拍摄装置后会将拍摄装置的预览内容进行显示。在接收到拍摄指令后，控制所述拍摄装置执行所述拍摄指令对应的操作。由于用户在看到AR设备在屏幕上显示内容的同时，也可以看到外界场景。本申请在启动拍摄装之后，将AR设备的显示状态设置为非预览状态，以使AR设备的当前显示内容不包括拍摄预览内容。本申请在启动拍摄装置后，不将拍摄装置的预览内容显示在AR设备的显示屏上，进而可以降低AR设备拍摄功能的功耗，提高续航时长。本申请同时还提供了一种拍摄功能的控制装置、一种电子设备和一种存储介质，具有上述有益效果，在此不再赘述。
附图说明
为了更清楚地说明本申请实施例，下面将对实施例中所需要使用的附图做简单的介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例， 对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本申请实施例所提供的一种拍摄功能的控制方法的流程图；
图2为本申请实施例所提供的一种AR设备的相机控制方法的流程图；
图3为本申请实施例所提供的一种取景框设置方法的示意图；
图4为本申请实施例所提供的一种拍摄功能的控制装置的结构示意图。
具体实施方式
为使本申请实施例的目的、技术方案和优点更加清楚，下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
下面请参见图1，图1为本申请实施例所提供的一种拍摄功能的控制方法的流程图。
具体步骤可以包括：
S101：若接收到拍摄功能调用指令，则启动所述AR设备的拍摄装置；
其中，本实施例可以应用于设置有拍摄装置的AR设备，用户可以通过手动触发按钮向AR设备发送拍摄功能调用指令，也可以通过与AR设备连接的智能终端(如：手机、平板电脑等)向AR设备发送拍摄功能调用指令。拍摄功能调用指令为启动AR设备的拍摄装置的指令，以便利用拍摄装置拍摄图像或视频。
在接收到拍摄功能调用指令之前，AR设备的拍摄装置可以处于关闭状态，在接收到拍摄功能调用指令后，可以启动拍摄装置。作为一种可行的实施方式，AR设备可以包括多个拍摄装置，给本实施例可以启动与拍摄功能调用指令对应的拍摄装置。
S102：将所述AR设备的显示状态设置为非预览状态；
在启动AR设备的拍摄装置之后，本实施例可以将AR设备的显示状态设置为非预览状态，在所述非预览状态下所述AR设备的当前显示内容不包括拍摄预览内容。
作为一种可行的实施方式，本实施例可以在启动AR设备的拍摄装置之后先将显示状态设置为预览状态，并在延时预设时间(如3秒)后将显示状态设置为非预览状态。通过上述方式，先将显示状态设置为预览状态能够帮助用户了解拍摄装置是否正常工作，再将显示状态设置为非预览状态，以达到降低功效的效果。
S103：判断是否接收到拍摄指令；若是，则进入S104；
S104：控制所述拍摄装置执行所述拍摄指令对应的操作。
其中，在接收到拍摄指令后。可以控制拍摄装置执行所述拍摄指令对应的操作，得到相应的图像或视频。在得到拍摄指令对应的操作结果后可以将操作结果进行本地保存或云端上传等操作。作为一种可行的实施方式，本实施例可以在S103判定未接收到拍摄指令后，延时一定时长(如0.5s)后再次判断是否接收到拍摄指令。
AR由于其特性，可以看到屏上显示内容的同时，也可以看到外界场景，当打开camera时，不需要再把camera的预览刷到屏上，改变用户的体验方式。功耗是衡量AR产品的成功关键指标，功耗直接影响了整机设计。为了控制AR功耗，配备低容量电池，本方案可以在打开camera时，不用打开camera预览，进而在很大程度上降低了功耗。
本实施例在接收到拍摄功能调用指令后启动AR设备的拍摄装置，在常规方案中AR设备启动拍摄装置后会将拍摄装置的预览内容进行显示。在接收到拍摄指令后，控制所述拍摄装置执行所述拍摄指令对应的操作。由于用户在看到AR设备在屏幕上显示内容的同时，也可以看到外界场景。本实施例在启动拍摄装之后，将AR设备的显示状态设置为非预览状态，以使AR设备的当前显示内容不包括拍摄预览内容。本实施例在启动拍摄装置后，不将拍摄装置的预览内容显示在AR设备的显示屏上，进而可以降低AR设备拍摄功能的功耗，提高续航时长。
作为对于图1对应实施例的进一步介绍，可以通过以下方式将AR设备的显示状态设置为非预览状态：
方式1：控制所述AR设备的光机显示黑色图像，以便将所述AR设备的显示状态设置为所述非预览状态。其中，由于光机的特性，当光机显示黑色 图象时，AR镜片上显示透明内容，AR设备无需渲染具有颜色的内容。
方式2：关闭所述拍摄装置的预览数据通道，以便将所述AR设备的显示状态设置为所述非预览状态。
本实施例还可以均控制所述AR设备的光机显示黑色图像，并关闭所述拍摄装置的预览数据通道，以便将AR设备的显示状态设置未非预览状态。
作为对于图1对应实施例的进一步介绍，由于图1不显示摄像装置的预览内容，为了便于用户确定当前可以拍摄的区域，可以通过显示取景框提示用户当前可以拍摄的内容。因此，本申请可以通过以下方式确定和显示取景框：将拍摄装置拍摄区域、光机显示区域和人眼观察区域中最小的区域设置为取景区域；根据所述取景区域的边界确定所述拍摄装置的取景框，并将所述取景框设置为所述AR设备的当前显示内容。本实施例可以根据所述拍摄装置的视场角确定所述拍摄装置拍摄区域；还可以根据所述AR设备的光机视场角确定所述光机显示区域；也可以根据用户眼睛的视场角确定所述人眼观察区域。
进一步的，在将所述取景框设置为所述AR设备的当前显示内容之后，还可以判断所述拍摄装置是否对焦完毕；若是，则将所述取景框的颜色设置为第一颜色；若否，则将所述取景框的颜色设置为第二颜色。本实施例可以通过改变取景框的颜色提示用户是否已经对焦完毕。
进一步的，在控制所述拍摄装置执行所述拍摄指令对应的操作之后，还可以将所述拍摄装置采集的拍摄结果保存至存储空间，并记录所述拍摄结果的对焦状态；其中，所述对焦状态包括对焦完毕和对焦未完毕。
下面通过在实际应用中的实施例说明上述实施例描述的流程。本实施例提供一种AR设备的相机预览方案，由于AR设备可以看到外界场景，当打开相机拍照或者录像时，不需要把相机的预览图像刷到屏上。本实施例还通过比较相机、光机和人眼的视场角fov(field ofview)确定取景框，并将取景框显示在光机上，有效的降低整机的功耗。
请参见图2，图2为本申请实施例所提供的一种AR设备的相机控制方法的流程图，本实施例可以包括以下步骤：
步骤1：接收打开相机指令，根据光机的fov范围和相机的fov范围，确定取景框。如果光机的fov大于相机的fov，取相机的fov作为取景框。否则，取光机的fov作为取景框。请参见图3，图3为本申请实施例所提供的一种取景框设置方法的示意图，本实施例选取光机fov和光机fov中最小范围的边界作为取景框(图3中的虚线框)。
步骤2：打开相机应用，设置为非预览(no-preview)模式。
步骤3：根据步骤1的fov范围，在显示屏上显示出红色的取景框。
步骤4：接收拍照指令，调用相机的拍照服务。
步骤5：在相机对焦完成时，可以显示绿色的取景框。
步骤6：在相机拍摄图像后，保存图片到存储空间。
步骤7：接收到关闭相机命令时，关闭相机并控制光机显示系统界面。
在上述过程中可以在屏幕上显示带有取景指示框的黑色图像，或关闭相机预览数据通道，进而将AR设备设置为非预览(no-preview)模式。由于光机的特性，黑色图像区域不显示内容，没有光线射出来，也就是说只有红色取景框图案才通过光显示在眼镜片上，人眼可以通过镜片这些区域看到外面的世界。当接收到语音和按键或者手势等拍照命令时，图像显示由红框到绿框(对焦完成)的变化，然后后台相机应用获取图像后，保存在存储空间里。
请参见图4，图4为本申请实施例所提供的一种拍摄功能的控制装置的结构示意图；
该装置可以包括：
拍摄功能启动模块401，用于若接收到拍摄功能调用指令，则启动所述AR设备的拍摄装置；
显示控制模块402，用于将所述AR设备的显示状态设置为非预览状态；其中，在所述非预览状态下所述AR设备的当前显示内容不包括拍摄预览内容；
拍摄模块403，用于判断是否接收到拍摄指令；若是，则控制所述拍摄装置执行所述拍摄指令对应的操作。
本实施例在接收到拍摄功能调用指令后启动AR设备的拍摄装置，在常规方案中AR设备启动拍摄装置后会将拍摄装置的预览内容进行显示。在接 收到拍摄指令后，控制所述拍摄装置执行所述拍摄指令对应的操作。由于用户在看到AR设备在屏幕上显示内容的同时，也可以看到外界场景。本实施例在启动拍摄装之后，将AR设备的显示状态设置为非预览状态，以使AR设备的当前显示内容不包括拍摄预览内容。本实施例在启动拍摄装置后，不将拍摄装置的预览内容显示在AR设备的显示屏上，进而可以降低AR设备拍摄功能的功耗，提高续航时长。
进一步的，显示控制模块402，包括：
第一控制单元，用于控制所述AR设备的光机显示黑色图像，以便将所述AR设备的显示状态设置为所述非预览状态。
和/或，第二控制单元，用于关闭所述拍摄装置的预览数据通道，以便将所述AR设备的显示状态设置为所述非预览状态。
进一步的，还包括：
取景框设置模块，用于将拍摄装置拍摄区域、光机显示区域和人眼观察区域中最小的区域设置为取景区域；还用于根据所述取景区域的边界确定所述拍摄装置的取景框，并将所述取景框设置为所述AR设备的当前显示内容。
进一步的，还包括：
对焦模块，用于在将所述取景框设置为所述AR设备的当前显示内容之后，判断所述拍摄装置是否对焦完毕；若是，则将所述取景框的颜色设置为第一颜色；若否，则将所述取景框的颜色设置为第二颜色。
进一步的，还包括：
显示区域设置模块，用于在将拍摄装置拍摄区域、光机显示区域和人眼观察区域中最小的区域设置为取景区域之前，根据所述拍摄装置的视场角确定所述拍摄装置拍摄区域；还用于根据所述AR设备的光机视场角确定所述光机显示区域；还用于根据用户眼睛的视场角确定所述人眼观察区域。
进一步的，还包括：
存储模块，用于在控制所述拍摄装置执行所述拍摄指令对应的操作之后，将所述拍摄装置采集的拍摄结果保存至存储空间，并记录所述拍摄结果的对焦状态；其中，所述对焦状态包括对焦完毕和对焦未完毕。
由于装置部分的实施例与方法部分的实施例相互对应，因此装置部分的实施例请参见方法部分的实施例的描述，这里暂不赘述。
本申请还提供了一种存储介质，其上存有计算机程序，该计算机程序被执行时可以实现上述实施例所提供的步骤。该存储介质可以包括：U盘、移动硬盘、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
本申请还提供了一种AR设备，可以包括存储器和处理器，所述存储器中存有计算机程序，所述处理器调用所述存储器中的计算机程序时，可以实现上述实施例所提供的步骤。当然所述AR设备还可以包括各种网络接口，电源等组件。
说明书中各个实施例采用递进的方式描述，每个实施例重点说明的都是与其他实施例的不同之处，各个实施例之间相同相似部分互相参见即可。对于实施例公开的装置而言，由于其与实施例公开的方法相对应，所以描述的比较简单，相关之处参见方法部分说明即可。应当指出，对于本技术领域的普通技术人员来说，在不脱离本申请原理的前提下，还可以对本申请进行若干改进和修饰，这些改进和修饰也落入本申请权利要求的保护范围内。
还需要说明的是，在本说明书中，诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的状况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。

Claims (10)

  1. 一种拍摄功能的控制方法，其特征在于，应用于AR设备，包括：
    若接收到拍摄功能调用指令，则启动所述AR设备的拍摄装置；
    将所述AR设备的显示状态设置为非预览状态；其中，在所述非预览状态下所述AR设备的当前显示内容不包括拍摄预览内容；
    判断是否接收到拍摄指令；
    若是，则控制所述拍摄装置执行所述拍摄指令对应的操作。
  2. 根据权利要求1所述拍摄功能的控制方法，其特征在于，将所述AR设备的显示状态设置为非预览状态，包括：
    控制所述AR设备的光机显示黑色图像，以便将所述AR设备的显示状态设置为所述非预览状态。
  3. 根据权利要求1所述拍摄功能的控制方法，其特征在于，将所述AR设备的显示状态设置为非预览状态，包括：
    关闭所述拍摄装置的预览数据通道，以便将所述AR设备的显示状态设置为所述非预览状态。
  4. 根据权利要求1所述拍摄功能的控制方法，其特征在于，还包括：
    将拍摄装置拍摄区域、光机显示区域和人眼观察区域中最小的区域设置为取景区域；
    根据所述取景区域的边界确定所述拍摄装置的取景框，并将所述取景框设置为所述AR设备的当前显示内容。
  5. 根据权利要求4所述拍摄功能的控制方法，其特征在于，在将所述取景框设置为所述AR设备的当前显示内容之后，还包括：
    判断所述拍摄装置是否对焦完毕；
    若是，则将所述取景框的颜色设置为第一颜色；
    若否，则将所述取景框的颜色设置为第二颜色。
  6. 根据权利要求4所述拍摄功能的控制方法，其特征在于，在将拍摄装置拍摄区域、光机显示区域和人眼观察区域中最小的区域设置为取景区域之前，还包括：
    根据所述拍摄装置的视场角确定所述拍摄装置拍摄区域；
    根据所述AR设备的光机视场角确定所述光机显示区域；
    根据用户眼睛的视场角确定所述人眼观察区域。
  7. 根据权利要求1至6任一项所述拍摄功能的控制方法，其特征在于，在控制所述拍摄装置执行所述拍摄指令对应的操作之后，还包括：
    将所述拍摄装置采集的拍摄结果保存至存储空间，并记录所述拍摄结果的对焦状态；其中，所述对焦状态包括对焦完毕和对焦未完毕。
  8. 一种拍摄功能的控制装置，其特征在于，应用于AR设备，包括：
    拍摄功能启动模块，用于若接收到拍摄功能调用指令，则启动所述AR设备的拍摄装置；
    显示控制模块，用于将所述AR设备的显示状态设置为非预览状态；其中，在所述非预览状态下所述AR设备的当前显示内容不包括拍摄预览内容；
    拍摄模块，用于判断是否接收到拍摄指令；若是，则控制所述拍摄装置执行所述拍摄指令对应的操作。
  9. 一种AR设备，其特征在于，包括存储器和处理器，所述存储器中存储有计算机程序，所述处理器调用所述存储器中的计算机程序时实现如权利要求1至7任一项所述拍摄功能的控制方法的步骤。
  10. 一种存储介质，其特征在于，所述存储介质中存储有计算机可执行指令，所述计算机可执行指令被处理器加载并执行时，实现如权利要求1至7任一项所述拍摄功能的控制方法的步骤。
PCT/CN2021/136624 2021-11-30 2021-12-09 一种拍摄功能的控制方法、装置、ar设备及存储介质 Ceased WO2023097724A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US18/552,450 US12568301B2 (en) 2021-11-30 2021-12-09 Photographing function control method, photographing function control device, AR apparatus and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111447242.1A CN114189628A (zh) 2021-11-30 2021-11-30 一种拍摄功能的控制方法、装置、ar设备及存储介质
CN202111447242.1 2021-11-30

Publications (1)

Publication Number Publication Date
WO2023097724A1 true WO2023097724A1 (zh) 2023-06-08

Family

ID=80541849

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/136624 Ceased WO2023097724A1 (zh) 2021-11-30 2021-12-09 一种拍摄功能的控制方法、装置、ar设备及存储介质

Country Status (3)

Country Link
US (1) US12568301B2 (zh)
CN (1) CN114189628A (zh)
WO (1) WO2023097724A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117082225A (zh) * 2023-10-12 2023-11-17 山东海量信息技术研究院 一种虚拟延时视频的生成方法、装置、设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105187725A (zh) * 2015-08-12 2015-12-23 小米科技有限责任公司 拍摄方法及装置
CN106201238A (zh) * 2015-05-06 2016-12-07 小米科技有限责任公司 展示对焦状态的方法及装置
CN106791412A (zh) * 2016-12-29 2017-05-31 深圳市金立通信设备有限公司 一种拍摄控制方法及终端
US20210142059A1 (en) * 2019-11-11 2021-05-13 Lg Electronics Inc. Xr device for providing ar mode and vr mode and method for controlling the same

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4084963B2 (ja) * 2002-06-12 2008-04-30 富士フイルム株式会社 デジタルカメラ
JP5233720B2 (ja) * 2009-02-12 2013-07-10 ソニー株式会社 撮像装置、撮像装置の制御方法およびプログラム
JP6264014B2 (ja) * 2013-12-17 2018-01-24 セイコーエプソン株式会社 頭部装着型表示装置
JP6331374B2 (ja) * 2013-12-17 2018-05-30 セイコーエプソン株式会社 頭部装着型表示装置
CN105979154A (zh) * 2016-06-28 2016-09-28 广东欧珀移动通信有限公司 一种增强现实ar的拍摄方法、装置及智能终端
KR102807668B1 (ko) * 2016-08-22 2025-05-14 삼성전자주식회사 영상 표시 장치 및 영상 표시 장치의 동작 방법
JP2018046514A (ja) * 2016-09-16 2018-03-22 オリンパス株式会社 撮像装置
CN111970456B (zh) * 2020-09-14 2022-01-11 Oppo广东移动通信有限公司 拍摄控制方法、装置、设备及存储介质
US12108146B2 (en) * 2020-12-30 2024-10-01 Snap Inc. Camera mode for capturing multiple video clips within a messaging system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106201238A (zh) * 2015-05-06 2016-12-07 小米科技有限责任公司 展示对焦状态的方法及装置
CN105187725A (zh) * 2015-08-12 2015-12-23 小米科技有限责任公司 拍摄方法及装置
CN106791412A (zh) * 2016-12-29 2017-05-31 深圳市金立通信设备有限公司 一种拍摄控制方法及终端
US20210142059A1 (en) * 2019-11-11 2021-05-13 Lg Electronics Inc. Xr device for providing ar mode and vr mode and method for controlling the same

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117082225A (zh) * 2023-10-12 2023-11-17 山东海量信息技术研究院 一种虚拟延时视频的生成方法、装置、设备及存储介质
CN117082225B (zh) * 2023-10-12 2024-02-09 山东海量信息技术研究院 一种虚拟延时视频的生成方法、装置、设备及存储介质

Also Published As

Publication number Publication date
US20240171850A1 (en) 2024-05-23
US12568301B2 (en) 2026-03-03
CN114189628A (zh) 2022-03-15

Similar Documents

Publication Publication Date Title
CN111654629B (zh) 摄像头切换方法、装置、电子设备及可读存储介质
JP7678877B2 (ja) 撮影方法、撮影装置と電子機器
US9961273B2 (en) Mobile terminal and shooting method thereof
CN111586282B (zh) 拍摄方法、装置、终端及可读存储介质
WO2022028184A1 (zh) 一种拍摄控制方法、装置、电子设备及存储介质
US9571739B2 (en) Camera timer
US10769416B2 (en) Image processing method, electronic device and storage medium
CN105827942A (zh) 一种快速拍照方法及电子设备
CN112866576A (zh) 图像预览方法、存储介质及显示设备
CN111970456A (zh) 拍摄控制方法、装置、设备及存储介质
CN110868533A (zh) 一种hdr模式确定方法、装置、存储介质及终端
CN104580874A (zh) 一种摄像设备及其实现拍照的方法
CN111277758A (zh) 拍摄方法、终端及计算机可读存储介质
TWI676113B (zh) 虹膜識別過程中的預覽方法及裝置
CN108540711A (zh) 移动终端及其拍摄方法
CN114339022B (zh) 摄像头拍摄参数确定方法、神经网络模型的训练方法
WO2023097724A1 (zh) 一种拍摄功能的控制方法、装置、ar设备及存储介质
CN111586280B (zh) 拍摄方法、装置、终端及可读存储介质
CN114422687A (zh) 预览图像切换方法及装置、电子设备及存储介质
CN113315903A (zh) 图像获取方法和装置、电子设备、存储介质
CN111835941A (zh) 图像生成方法及装置、电子设备、计算机可读存储介质
CN108495038A (zh) 图像处理方法、装置、存储介质及电子设备
CN110086990A (zh) 一种终端的拍照方法、装置、便携式终端及存储介质
CN114338984B (zh) 工作记录仪的熄屏拍摄方法、装置、记录仪及存储介质
CN114286009B (zh) 倒影图像拍摄方法、装置、电子设备及存储介质

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 18552450

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 01/10/2024)

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21966150

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 21966150

Country of ref document: EP

Kind code of ref document: A1

WWG Wipo information: grant in national office

Ref document number: 18552450

Country of ref document: US