CN111614893A

CN111614893A - Automatic photographing method and device, storage medium and intelligent glasses

Info

Publication number: CN111614893A
Application number: CN202010350759.8A
Authority: CN
Inventors: 王梦奎
Original assignee: Yulong Computer Telecommunication Scientific Shenzhen Co Ltd
Current assignee: Yulong Computer Telecommunication Scientific Shenzhen Co Ltd
Priority date: 2020-04-28
Filing date: 2020-04-28
Publication date: 2020-09-01
Anticipated expiration: 2040-04-28
Also published as: CN111614893B

Abstract

The embodiment of the application discloses an automatic photographing method, an automatic photographing device, a storage medium and intelligent glasses, wherein the method comprises the following steps: acquiring the input target eye action information; determining focusing information according to the target eye action information; and when the focusing information meets a first automatic photographing condition in a static state, automatically photographing. According to the method, the photographing parameters are not required to be optimized through a large amount of operation by intelligent glasses, and the photographing parameters can be changed only by moving eyes of a user and staying at a focus for a certain time, so that the automatic photographing condition is achieved and automatic photographing is carried out; the automatic photographing condition can be set individually, and different requirements are met.

Description

Automatic photographing method and device, storage medium and intelligent glasses

Technical Field

The application relates to the technical field of computers, in particular to an automatic photographing method, an automatic photographing device, a storage medium and intelligent glasses.

Background

The shooting and video recording functions of the intelligent terminal are convenient for users to record life drops, and various shooting modes such as live shooting, slow motion shooting and automatic shooting are more choices of the users.

The automatic photographing function of the current intelligent terminal such as intelligent glasses needs to calculate various parameters such as the brightness, the exposure and the light sensitivity of a camera through a software algorithm, and when the various parameters meet requirements, automatic photographing can be achieved; and when the parameters fail to meet the requirements, certain optimization processing is required. The automatic photographing method has the advantages that firstly, the calculation amount is large, and secondly, the user cannot set the automatic photographing requirement in a personalized mode.

Disclosure of Invention

The embodiment of the application provides an automatic photographing method, an automatic photographing device, a storage medium and intelligent glasses, and can solve the problems that the automatic photographing method is large in calculation amount and cannot be set individually. The technical scheme is as follows:

in a first aspect, an embodiment of the present application provides an automatic photographing method, where the method includes:

acquiring the input target eye action information;

determining focusing information according to the target eye action information;

and when the focusing information meets a first automatic photographing condition in a static state, automatically photographing.

In a second aspect, an embodiment of the present application provides an automatic photographing apparatus, including:

the eye action information acquisition module is used for acquiring the input target eye action information;

the focusing information determining module is used for determining focusing information according to the target eye action information;

and the automatic photographing module is used for automatically photographing when the focusing information meets a first automatic photographing condition in a static state.

In a third aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps of any one of the above methods.

In a fourth aspect, an embodiment of the present application provides smart glasses, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the steps of any one of the above methods when executing the program.

The beneficial effects brought by the technical scheme provided by some embodiments of the application at least comprise:

according to the automatic photographing method provided by the embodiment of the application, the intelligent glasses acquire target eye action information input by a user; determining focusing information according to the target eye action information; and when the focusing information meets a first automatic photographing condition in a static state, automatically photographing. According to the method, the photographing parameters are not required to be optimized through a large amount of operation by intelligent glasses, and the photographing parameters can be changed only by moving eyes of a user and staying at a focus for a certain time, so that the automatic photographing condition is achieved and automatic photographing is carried out; the automatic photographing condition can be set individually, and different requirements are met.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic flowchart of an automatic photographing method according to an embodiment of the present disclosure;

fig. 2 is a schematic flowchart of an automatic photographing method according to an embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of an automatic photographing apparatus according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of an automatic photographing apparatus according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of an automatic photographing apparatus according to an embodiment of the present application;

fig. 6 is a block diagram of a smart glasses structure provided in an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the application, as detailed in the appended claims.

In the description of the present application, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. The specific meaning of the above terms in the present application can be understood in a specific case by those of ordinary skill in the art. Further, in the description of the present application, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

The automatic photographing method provided by the embodiment of the present application will be described in detail below with reference to fig. 1 to 2.

Fig. 1 is a schematic flow chart of an automatic photographing method according to an embodiment of the present disclosure.

As shown in fig. 1, the method of the embodiment of the present application may include the steps of:

and S101, acquiring the input target eye motion information.

The automatic photographing method provided by the embodiment of the application is applied to intelligent glasses. The intelligent glasses have independent operating systems, are a general name of various wearable glasses devices, and can realize various functions such as photographing, audio and video playing, communication and the like through software installation. The smart glasses may be, for example, AR glasses.

The mirror surface of the intelligent glasses is the display interface, the user wears the intelligent glasses, the eyes of the user are linked with the focus on the photographing interface of the intelligent glasses, and the focus moves along with the movement of the eyes of the user. When the default camera is opened, the focus on the photographing interface is located at the center position, and when the eyes of the user move, the focus moves synchronously along with the eyes on the photographing interface.

The eye movement of the user includes various movements such as blinking, stuttering, and moving, and the movement is taken as the target eye movement in this embodiment. The target eye motion information includes, but is not limited to, target eye motion movement information (movement direction, movement distance, etc.), time information, and the like.

And S102, determining focusing information according to the target eye action information.

The focusing information comprises a focus position and a photographing focal length.

The focus is linked with the eyes of the user, and the final staying position of the focus can be known through the moving information of the target eyes. For example, if the user's eyes move 2 cm directly above the center of the camera interface and there is no further eye movement after that, the camera focus will stay 2 cm directly above the center of the camera interface.

If the focus is moved to the designated position by the eye movement, the user still needs to move the eyes to observe the rest positions of the photographing interface, and at this time, the focus can be fixed by an obvious eye movement which can be distinguished from the eye movement, for example, two times of continuous blinking.

Specifically, assuming that the position of the focus which needs to be finalized is at a 45 ° direction above the left of the center position of the photographing interface and is 1 cm away from the center position, when the eyes of the user move 1 cm from the center of the photographing interface to the 45 ° direction above the left, the user blinks twice continuously, the focus is finalized at the position, and the eye movement focus does not move any more thereafter, so that the user can continue to move the eyes to view the rest parts of the photographing interface after the focus is determined.

After the focal position is determined, the intelligent glasses can determine the photographing focal length corresponding to the staying time of the eyes of the user at the focal position according to the corresponding relation between the preset focal length and the staying time of the eyes.

The corresponding relationship between the focal length and the eye dwell time length may be, for example, one focal length every five seconds, when the focal length reaches the maximum value of the smart glasses, the dwell time is cleared, the dwell time length is recalculated, that is, when the focal length reaches the maximum value of the smart glasses, the focal length returns to one time of the focal length again. For example, in the corresponding relationship, the time length corresponding to the maximum focal length is 40s, and the stay time length of the eye of the user at the focal point is 50s, so that the time length corresponds to twice the focal length, and the smart glasses automatically take a picture at the focal length.

Particularly, when the focal position is determined and the eyes of the user move to the rest positions of the photographing interface immediately, the intelligent glasses keep one time of the focal length; if the photographing focal length is to be adjusted, the user can change the photographing focal length by staring at the focal point for a long time in the subsequent process.

S103, when the focusing information meets a first automatic photographing condition in a static state, automatic photographing is carried out.

When the intelligent glasses are in a static state, the noise of the picture is less, and when the focal position and the photographing focal length reach the limit values preset by a user, automatic photographing can be carried out.

Fig. 2 is a schematic flow chart of an automatic photographing method according to an embodiment of the present disclosure.

As shown in fig. 2, the method of the embodiment of the present application may include the steps of:

s201, the input target eye motion information is acquired.

S202, focusing information is determined according to the target eye action information.

The step can be referred to as step S102, and is not described herein again.

S203, calculating a first photographing progress corresponding to the focusing information according to a photographing progress calculation rule.

The photographing progress is used for determining whether the current photographing parameters reach the automatic photographing conditions. For automatic photographing in a static state, a first photographing progress needs to be calculated according to a preset photographing progress calculation rule, and the next step is executed.

The photographing progress calculation rule may be such that the closer the focusing information is to the first automatic photographing condition, the more full the photographing progress. In more detail, the photographing progress may be displayed as a percentage.

And S204, when the first photographing progress is greater than or equal to a first progress threshold, automatically photographing.

The first progress threshold is the automatic photographing condition limit in the static state, when the first photographing progress is larger than or equal to the first progress threshold, the photographing parameter is shown to meet the first automatic photographing condition, and at the moment, the intelligent glasses control performs automatic photographing.

When the first photographing progress is smaller than the first progress threshold, the photographing parameters need to be adjusted, and the user can continuously adjust the photographing parameters through eye movement and the like until the first progress threshold is met. The first progress threshold may be set to 70%, for example.

And S205, acquiring the motion parameter information of the intelligent glasses.

In other embodiments, the smart glasses may be in a motion state, and in this case, the motion parameter information needs to be acquired. The motion parameter information includes, but is not limited to, speed, angle, etc. of the smart glasses.

And S206, calculating a second photographing progress corresponding to the focusing information and the motion parameter information according to a photographing progress calculation rule.

For automatic photographing in a motion state, a second photographing progress needs to be calculated according to a preset photographing progress calculation rule, for example, the sky is photographed at an elevation angle of 45 degrees, and 0-45 degrees correspond to 0-100% of the progress; the process from head-up to head-up of the user comprises an acceleration motion process and a deceleration motion process, and the process corresponds to the progress of 0-100%; the closer the parameters such as focal length and the like in the motion state are to the preset values, the closer the progress is to 100%; and respectively configuring a weight for each progress, and obtaining a second photographing progress after weighting calculation, namely the progress of sky photographing at an elevation angle of 45 degrees.

The more full the photographing progress, the closer to the automatic photographing condition in the motion state, i.e., the second automatic photographing condition.

And S207, when the second photographing progress is greater than or equal to a second progress threshold, automatically photographing.

The second progress threshold is the limitation of the automatic photographing condition in the motion state, when the second photographing progress is larger than or equal to the second progress threshold, the photographing parameter and the motion parameter information both meet the second automatic photographing condition, and at the moment, the intelligent glasses control the automatic photographing.

When the second photographing progress is smaller than a second progress threshold, it is indicated that each parameter information needs to be adjusted, and the user can adjust each parameter information by continuously moving the eyes and changing the motion state of the smart glasses until the second progress threshold is met. The second progress threshold may be set to 85%, for example.

According to the automatic photographing method provided by the embodiment, the intelligent glasses acquire target eye action information input by a user; determining focusing information according to the target eye action information; and when the focusing information meets a first automatic photographing condition in a static state, automatically photographing. According to the method, the photographing parameters are not required to be optimized through a large amount of operation by intelligent glasses, and the photographing parameters can be changed only by moving eyes of a user and staying at a focus for a certain time, so that the automatic photographing condition is achieved and automatic photographing is carried out; the automatic photographing condition can be set individually, and different requirements are met.

The following are embodiments of the apparatus of the present application that may be used to perform embodiments of the method of the present application. For details which are not disclosed in the embodiments of the apparatus of the present application, reference is made to the embodiments of the method of the present application.

Fig. 3 is a schematic structural diagram of an automatic photographing apparatus according to an exemplary embodiment of the present application. The automatic photographing device can be realized into all or part of the intelligent glasses through software, hardware or the combination of the software and the hardware, and can also be integrated on a server as an independent module. The automatic photographing device in the embodiment of the application is applied to intelligent glasses, the device 1 includes an eye action information obtaining module 11, a focusing information determining module 12 and an automatic photographing module 13, wherein:

an eye movement information obtaining module 11, configured to obtain the input target eye movement information;

a focusing information determining module 12, configured to determine focusing information according to the target eye action information;

and the automatic photographing module 13 is configured to perform automatic photographing when the focusing information meets a first automatic photographing condition in a static state.

Fig. 4 is a schematic structural diagram of an automatic photographing apparatus according to an exemplary embodiment of the present application.

Optionally, as shown in fig. 4, the focusing information determining module 12 in the automatic photographing apparatus 1 according to the embodiment of the present application includes:

a focus position determination unit 121 configured to determine a focus position according to the target eye motion information;

a dwell time acquiring unit 122, configured to acquire a dwell time of the eye at the focal position;

the focal length determining unit 123 is configured to determine a photographing focal length according to a preset correspondence between a focal length and an eye dwell time;

the automatic photographing module 13 includes:

the photographing progress calculating unit 131 is configured to calculate a first photographing progress corresponding to the focusing information according to a photographing progress calculation rule;

the automatic photographing unit 132 is configured to perform automatic photographing when the first photographing progress is greater than or equal to a first progress threshold.

Fig. 5 is a schematic structural diagram of an automatic photographing apparatus according to an exemplary embodiment of the present application.

Optionally, as shown in fig. 5, the automatic photographing apparatus 1 provided in the embodiment of the present application further includes:

a motion parameter information obtaining module 14, configured to obtain motion parameter information of the smart glasses;

the photographing progress calculating unit 131 in the automatic photographing module 13 is specifically configured to:

calculating a second photographing progress corresponding to the focusing information and the motion parameter information according to a photographing progress calculation rule;

the automatic photographing unit 132 is specifically configured to:

and the automatic photographing device is used for automatically photographing when the second photographing progress is greater than or equal to a second progress threshold.

It should be noted that, when the automatic photographing apparatus provided in the foregoing embodiment executes the automatic photographing method, only the division of the functional modules is illustrated, and in practical applications, the function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the automatic photographing apparatus and the automatic photographing method provided by the above embodiments belong to the same concept, and details of implementation processes thereof are referred to in the method embodiments and are not described herein again.

The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

According to the automatic photographing device provided by the embodiment of the application, the intelligent glasses acquire target eye action information input by a user; determining focusing information according to the target eye action information; and when the focusing information meets a first automatic photographing condition in a static state, automatically photographing. According to the method, the photographing parameters are not required to be optimized through a large amount of operation by intelligent glasses, and the photographing parameters can be changed only by moving eyes of a user and staying at a focus for a certain time, so that the automatic photographing condition is achieved and automatic photographing is carried out; the automatic photographing condition can be set individually, and different requirements are met.

The embodiments of the present application also provide a computer-readable storage medium, on which a computer program is stored, and the computer program is executed by a processor to implement the steps of the method of any one of the foregoing embodiments. The computer-readable storage medium may include, but is not limited to, any type of disk including floppy disks, optical disks, DVD, CD-ROMs, microdrive, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory devices, magnetic or optical cards, nanosystems (including molecular memory ICs), or any type of media or device suitable for storing instructions and/or data.

The embodiment of the application further provides intelligent glasses, which comprise a memory, a processor and a computer program which is stored on the memory and can be run on the processor, and the steps of the method of any one of the embodiments are realized when the processor executes the program.

Please refer to fig. 6, which is a block diagram of a smart glasses structure according to an embodiment of the present disclosure.

As shown in fig. 6, the smart glasses 100 include: a processor 601 and a memory 602.

In this embodiment, the processor 601 is a control center of a computer system, and may be a processor of an entity machine or a processor of a virtual machine. The processor 601 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 601 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable logic Array). The processor 601 may also include a main processor and a coprocessor, where the main processor is a processor for processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state.

The memory 602 may include one or more computer-readable storage media, which may be non-transitory. The memory 602 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments of the present application, a non-transitory computer readable storage medium in the memory 602 is used to store at least one instruction for execution by the processor 601 to implement a method in embodiments of the present application.

In some embodiments, the smart glasses 100 further comprise: a peripheral interface 603 and at least one peripheral. The processor 601, memory 602, and peripheral interface 603 may be connected by buses or signal lines. Various peripheral devices may be connected to the peripheral interface 603 via a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of a display screen 604, a camera 605, and an audio circuit 606.

The peripheral interface 603 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 601 and the memory 602. In some embodiments of the present application, the processor 601, memory 602, and peripheral interface 603 are integrated on the same chip or circuit board; in some other embodiments of the present application, any one or both of the processor 601, the memory 602, and the peripheral interface 603 may be implemented on separate chips or circuit boards. The embodiment of the present application is not particularly limited to this.

The display system 604 is typically comprised of a miniature display screen and optical elements. In general terms, the display system 604 is a combination of various micro-displays and optical elements such as prisms, freeform surfaces, BirdBanh, light guides, and the like. The micro display is used to provide display content for the smart glasses 100, and may be a self-luminous active device, such as a light emitting diode panel micro-OLED or a micro-LED, or a liquid crystal display (including a transmissive LCD and a reflective LCOS) requiring an external light source for illumination, a digital micromirror array (DMD, i.e., the core of DLP) based on a Micro Electro Mechanical System (MEMS) technology, and a Laser Beam Scanner (LBS).

The camera 605 is used to capture images or video. Optionally, the camera 605 includes a front camera and a rear camera. Generally, the front camera is arranged on the front panel of the intelligent glasses, and the rear camera is arranged on the back of the intelligent glasses. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments of the present application, camera 605 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.

Audio circuitry 606 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 601 for processing. For the purpose of stereo sound collection or noise reduction, a plurality of microphones may be provided at different portions of the smart glasses 100. The microphone may also be an array microphone or an omni-directional pick-up microphone.

The power supply 607 is used to supply power to the various components in the smart eyewear 100. The power supply 607 may be ac, dc, disposable or rechargeable. When power supply 607 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery may also be used to support fast charge technology.

The block diagram of the smart glasses structure shown in the embodiments of the present application does not constitute a limitation to the smart glasses 100, and the smart glasses 100 may include more or less components than those shown, or combine some components, or adopt a different arrangement of components.

In this application, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or order; the term "plurality" means two or more unless expressly limited otherwise. The terms "mounted," "connected," "fixed," and the like are to be construed broadly, and for example, "connected" may be a fixed connection, a removable connection, or an integral connection; "coupled" may be direct or indirect through an intermediary. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.

In the description of the present application, it is to be understood that the terms "upper", "lower", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience in describing the present application and simplifying the description, but do not indicate or imply that the referred device or unit must have a specific direction, be configured and operated in a specific orientation, and thus, should not be construed as limiting the present application.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Accordingly, all equivalent changes made by the claims of this application are intended to be covered by this application.

Claims

1. An automatic photographing method is applied to intelligent glasses and comprises the following steps:

acquiring the input target eye action information;

2. The method of claim 1, wherein determining focus information from the target eye motion information comprises:

determining a focus position according to the target eye action information;

acquiring the stay time of the eye at the focal position;

and determining the photographing focal length according to the corresponding relation between the preset focal length and the eye staying time.

3. The method according to claim 1, wherein when the focusing information satisfies a first photographing condition in a static state, performing automatic photographing comprises:

calculating a first photographing progress corresponding to the focusing information according to a photographing progress calculation rule;

and when the first photographing progress is greater than or equal to a first progress threshold, automatically photographing.

4. The method of claim 1, wherein after determining focusing information according to the target eye motion information, further comprising:

acquiring motion parameter information of the intelligent glasses;

when the focusing information meets a first automatic photographing condition in a static state, carrying out automatic photographing, including:

and when the focusing information and the motion parameter information both meet a second automatic photographing condition in a motion state, automatically photographing.

5. The method according to claim 4, wherein when the focusing information and the motion parameter information both satisfy a second automatic photographing condition in a motion state, performing automatic photographing includes:

and when the second photographing progress is greater than or equal to a second progress threshold, automatically photographing.

6. An automatic photographing apparatus, comprising:

7. The apparatus of claim 6, wherein the focusing information determining module comprises:

a focus position determining unit for determining a focus position according to the target eye action information;

a dwell time acquiring unit for acquiring the dwell time of the eye at the focal position;

and the focal length determining unit is used for determining the photographing focal length according to the corresponding relation between the preset focal length and the eye staying time.

8. The apparatus of claim 6, wherein the automatic photographing module comprises:

the photographing progress calculating unit is used for calculating a first photographing progress corresponding to the focusing information according to a photographing progress calculating rule;

and the automatic photographing unit is used for automatically photographing when the first photographing progress is greater than or equal to a first progress threshold.

9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 5.

10. Smart eyewear comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any one of claims 1 to 5 are implemented when the processor executes the program.