CN110062167B

CN110062167B - Linkage shooting control method and device and computer readable storage medium

Info

Publication number: CN110062167B
Application number: CN201910351197.6A
Authority: CN
Inventors: 王秀琳
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2019-04-28
Filing date: 2019-04-28
Publication date: 2021-11-12
Anticipated expiration: 2039-04-28
Also published as: CN110062167A

Abstract

The application discloses a linkage shooting control method, equipment and a computer readable storage medium, wherein the method comprises the following steps: recognizing and analyzing the shooting state, and determining a visual state and an operation state in the shooting state; then, if the visual state is different from a preset visual threshold, analyzing the operation state, wherein the operation state comprises an operation gesture of the wearable device corresponding to the operation object; and finally, acquiring a first shooting parameter control signal sent by the wearable device, analyzing the operation gesture to obtain a second shooting parameter control signal, and adjusting the shooting parameters of the scenery to be shot by combining the first shooting parameter control signal and the second shooting parameter control signal. The humanized linkage shooting control scheme is realized, so that the user can conveniently and rapidly adjust and control the shooting parameters in the shooting process of the terminal equipment, the operation efficiency is improved, and the user experience is enhanced.

Description

Linkage shooting control method and device and computer readable storage medium

Technical Field

The present application relates to the field of mobile communications, and in particular, to a method and an apparatus for controlling linked shooting, and a computer-readable storage medium.

Background

Among the prior art, along with the rapid development of intelligent terminal equipment, wearable equipment different from conventional smart phones appears, for example, wearable equipment such as smart watches or smart bracelets. Because wearable equipment is compared in traditional smart mobile phone, particularity such as its software, hardware environment, operation methods and operation environment, if with traditional smart mobile phone's the scheme of controlling transfer to wearable equipment, then may bring inconvenience, user experience for user's operation not good.

Disclosure of Invention

In order to solve the technical defects in the prior art, the invention provides a linkage shooting control method, which comprises the following steps:

the method comprises the steps that a preview image of a scene to be shot is obtained through a first shooting component of the terminal device, and meanwhile, the shooting state of an operation object is obtained through a second shooting component of the terminal device;

recognizing and analyzing the shooting state, and determining a visual state and an operation state in the shooting state;

if the visual state is different from a preset visual threshold, analyzing the operation state, wherein the operation state comprises an operation gesture of the wearable device corresponding to the operation object;

the method comprises the steps of obtaining a first shooting parameter control signal sent by the wearable device, analyzing the operation gesture to obtain a second shooting parameter control signal, and adjusting shooting parameters of a scene to be shot by combining the first shooting parameter control signal and the second shooting parameter control signal.

Optionally, the acquiring, by a first shooting component of the terminal device, a preview image of a scene to be shot, and acquiring, by a second shooting component of the terminal device, a shooting status of the operation object includes:

determining the first shooting component on a first side of the terminal equipment;

in the terminal device, a second face opposite to the first face is determined.

Optionally, the acquiring, by the first shooting component of the terminal device, the preview image of the scene to be shot, and acquiring, by the second shooting component of the terminal device, the shooting status of the operation object further includes:

determining the second shooting component on the second surface;

the method comprises the steps of obtaining a preview image of a scene to be shot through a first shooting component of the terminal device, and obtaining image information of an operation object through a second shooting component of the terminal device.

analyzing the image information and identifying an operation object in the image information;

and determining an operation part and a visual part of the operation object, and analyzing the state information of the operation part and the visual part.

Optionally, the recognizing and analyzing the shooting status, and determining a visual status and an operation status in the shooting status include:

identifying and analyzing state information of the visual part, wherein the visual part comprises positions of two eyes and states of the two eyes;

and identifying and analyzing the state information of the operation part, wherein the operation part comprises the positions and the states of the worn wrist and the unworn wrist.

Optionally, the recognizing and analyzing the shooting status, and determining a visual status and an operation status in the shooting status further include:

acquiring positions of pupils of the two eyes compared with eyeballs of eye sockets;

determining the visual centers of the two eyes according to the positions of the eyeballs;

and determining a visual orientation according to the visual center, and determining the preset visual threshold value under the visual orientation.

Optionally, if the visual state is worse than a preset visual threshold, the operating state is analyzed, where the operating state includes an operating gesture of the wearable device corresponding to the operation object, and the analyzing includes:

if the visual state difference is larger than a preset visual threshold, determining a first time period for acquiring an operation gesture;

and analyzing the operation gesture of the wearable device corresponding to the operation object in the first time period.

Optionally, the acquisition by the first shooting parameter control signal that wearing equipment sent, and, the analysis the operation gesture obtains the second and shoots parameter control signal, combines first shooting parameter control signal and the second shoots parameter control signal, adjusts the shooting parameter of the scenery of waiting to shoot, include:

acquiring a first shooting parameter control signal sent by the wearable device, wherein the first shooting parameter control signal is generated after the wearable device receives corresponding operation of the operation object;

and analyzing the operation gesture to obtain a second shooting parameter control signal, adjusting the first shooting parameter of the scenery to be shot through the first shooting parameter control signal, and adjusting the second shooting parameter of the scenery to be shot through the second shooting parameter control signal.

The present invention also proposes a linked shooting control apparatus, including:

a memory, a processor, and a computer program stored on the memory and executable on the processor;

the computer program, when executed by the processor, implements the steps of the method of any one of the above.

The present invention also proposes a computer-readable storage medium having stored thereon a linkage shooting control program which, when executed by a processor, implements the steps of the linkage shooting control method according to any one of the above.

The method has the advantages that the preview image of the scenery to be shot is acquired through the first shooting component of the terminal equipment, and meanwhile, the shooting state of the operation object is acquired through the second shooting component of the terminal equipment; then, recognizing and analyzing the shooting state, and determining a visual state and an operation state in the shooting state; then, if the visual state is different from a preset visual threshold, analyzing the operation state, wherein the operation state comprises an operation gesture of the wearable device corresponding to the operation object; and finally, acquiring a first shooting parameter control signal sent by the wearable device, analyzing the operation gesture to obtain a second shooting parameter control signal, and adjusting the shooting parameters of the scenery to be shot by combining the first shooting parameter control signal and the second shooting parameter control signal. The humanized linkage shooting control scheme is realized, so that the user can conveniently and rapidly adjust and control the shooting parameters in the shooting process of the terminal equipment, the operation efficiency is improved, and the user experience is enhanced.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.

Fig. 1 is a schematic hardware structure diagram of an implementation manner of a wearable device according to an embodiment of the present invention;

fig. 2 is a hardware schematic diagram of an implementation of a wearable device provided in an embodiment of the present application;

fig. 3 is a hardware schematic diagram of an implementation of a wearable device provided in an embodiment of the present application;

fig. 4 is a hardware schematic diagram of an implementation of a wearable device provided in an embodiment of the present application;

fig. 5 is a hardware schematic diagram of an implementation manner of a wearable device provided in an embodiment of the present application;

fig. 6 is a flowchart of the linked shooting control method according to the first embodiment of the present invention;

fig. 7 is a flowchart of a linked shooting control method according to a second embodiment of the present invention;

fig. 8 is a flowchart of a linked shooting control method according to a third embodiment of the present invention;

fig. 9 is a flowchart of a linked shooting control method according to a fourth embodiment of the present invention;

fig. 10 is a flowchart of a linked shooting control method according to a fifth embodiment of the present invention;

fig. 11 is a flowchart of a linked shooting control method according to a sixth embodiment of the present invention;

fig. 12 is a flowchart of a linked shooting control method according to a seventh embodiment of the present invention;

fig. 13 is a flowchart of an eighth embodiment of the linked shooting control method of the present invention.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.

The wearable device provided by the embodiment of the invention comprises a mobile terminal such as an intelligent bracelet, an intelligent watch, an intelligent mobile phone and the like. With the continuous development of screen technologies, screen forms such as flexible screens and folding screens appear, and mobile terminals such as smart phones can also be used as wearable devices. The wearable device provided in the embodiment of the present invention may include: a Radio Frequency (RF) unit, a WiFi module, an audio output unit, an a/V (audio/video) input unit, a sensor, a display unit, a user input unit, an interface unit, a memory, a processor, and a power supply.

In the following description, a wearable device will be taken as an example, please refer to fig. 1, which is a schematic diagram of a hardware structure of a wearable device for implementing various embodiments of the present invention, where the wearable device 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, a/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the wearable device structure shown in fig. 1 does not constitute a limitation of the wearable device, and that the wearable device may include more or fewer components than shown, or combine certain components, or a different arrangement of components.

The following describes the various components of the wearable device in detail with reference to fig. 1:

the rf unit 101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, the rf unit 101 may transmit uplink information to a base station, in addition, the downlink information sent by the base station may be received and then sent to the processor 110 of the wearable device for processing, the downlink information sent by the base station to the radio frequency unit 101 may be generated according to the uplink information sent by the radio frequency unit 101, or may be actively pushed to the radio frequency unit 101 after detecting that the information of the wearable device is updated, for example, after detecting that the geographic location where the wearable device is located changes, the base station may send a message notification of the change in the geographic location to the radio frequency unit 101 of the wearable device, and after receiving the message notification, the message notification may be sent to the processor 110 of the wearable device for processing, and the processor 110 of the wearable device may control the message notification to be displayed on the display panel 1061 of the wearable device; typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 may also communicate with a network and other devices through wireless communication, which may specifically include: the server may push a message notification of resource update to the wearable device through wireless communication to remind a user of updating the application program if the file resource corresponding to the application program in the server is updated after the wearable device finishes downloading the application program. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000 ), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division duplex Long Term Evolution), and TDD-LTE (Time Division duplex Long Term Evolution).

In one embodiment, the wearable device 100 may access an existing communication network by inserting a SIM card.

In another embodiment, the wearable device 100 may be configured with an esim card (Embedded-SIM) to access an existing communication network, and by using the esim card, the internal space of the wearable device may be saved, and the thickness may be reduced.

It is understood that although fig. 1 shows the radio frequency unit 101, it is understood that the radio frequency unit 101 does not belong to the essential constituents of the wearable device, and can be omitted entirely as required within the scope not changing the essence of the invention. The wearable device 100 may implement a communication connection with other devices or a communication network through the wifi module 102 alone, which is not limited by the embodiments of the present invention.

WiFi belongs to short-distance wireless transmission technology, and the wearable device can help a user to send and receive e-mails, browse webpages, access streaming media and the like through the WiFi module 102, and provides wireless broadband Internet access for the user. Although fig. 1 shows the WiFi module 102, it is understood that it does not belong to the essential constitution of the wearable device, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the wearable device 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the wearable device 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The a/V input unit 104 is used to receive audio or video signals. The a/V input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, the Graphics processor 1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 may receive sounds (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

In one embodiment, the wearable device 100 includes one or more cameras, and by turning on the cameras, capturing of images can be realized, functions such as photographing and recording can be realized, and the positions of the cameras can be set as required.

The wearable device 100 also includes at least one sensor 105, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or the backlight when the wearable device 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), and the like.

In one embodiment, the wearable device 100 further comprises a proximity sensor, and the wearable device can realize non-contact operation by adopting the proximity sensor, so that more operation modes are provided.

In one embodiment, the wearable device 100 further comprises a heart rate sensor, which, when worn, enables detection of heart rate by proximity to the user.

In one embodiment, the wearable device 100 may further include a fingerprint sensor, and by reading the fingerprint, functions such as security verification can be implemented.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

In one embodiment, the display panel 1061 is a flexible display screen, and when the wearable device using the flexible display screen is worn, the screen can be bent, so that the wearable device is more conformable. Optionally, the flexible display screen may adopt an OLED screen body and a graphene screen body, in other embodiments, the flexible display screen may also be made of other display materials, and this embodiment is not limited thereto.

In one embodiment, the display panel 1061 of the wearable device may take a rectangular shape to wrap around when worn. In other embodiments, other approaches may be taken.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the wearable device. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 1071 (e.g., an operation performed by the user on or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.

In one embodiment, the side of the wearable device 100 may be provided with one or more buttons. The button can realize various modes such as short-time pressing, long-time pressing, rotation and the like, thereby realizing various operation effects. The number of the buttons can be multiple, and different buttons can be combined for use to realize multiple operation functions.

Further, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although in fig. 1, the touch panel 1071 and the display panel 1061 are two independent components to implement the input and output functions of the wearable device, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the wearable device, and is not limited herein. For example, when receiving a message notification of an application program through the rf unit 101, the processor 110 may control the message notification to be displayed in a predetermined area of the display panel 1061, where the predetermined area corresponds to a certain area of the touch panel 1071, and perform a touch operation on the certain area of the touch panel 1071 to control the message notification displayed in the corresponding area on the display panel 1061.

The interface unit 108 serves as an interface through which at least one external device is connected to the wearable apparatus 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the wearable apparatus 100 or may be used to transmit data between the wearable apparatus 100 and the external device.

In one embodiment, the interface unit 108 of the wearable device 100 is configured as a contact, and is connected to another corresponding device through the contact to implement functions such as charging and connection. The contact can also be waterproof.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the wearable device, connects various parts of the entire wearable device by various interfaces and lines, and performs various functions of the wearable device and processes data by running or executing software programs and/or modules stored in the memory 109 and calling up data stored in the memory 109, thereby performing overall monitoring of the wearable device. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The wearable device 100 may further include a power source 111 (such as a battery) for supplying power to various components, and preferably, the power source 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.

Although not shown in fig. 1, the wearable device 100 may further include a bluetooth module or the like, which is not described herein. The wearable device 100 can be connected with other terminal devices through Bluetooth, so that communication and information interaction are realized.

Please refer to fig. 2-4, which are schematic structural diagrams of a wearable device according to an embodiment of the present invention. The wearable device in the embodiment of the invention comprises a flexible screen. When the wearable device is unfolded, the flexible screen is in a strip shape; when the wearable device is in a wearing state, the flexible screen is bent to be annular. Fig. 2 and 3 show the structural schematic diagram of the wearable device screen when the wearable device screen is unfolded, and fig. 4 shows the structural schematic diagram of the wearable device screen when the wearable device screen is bent.

Based on the above embodiments, it can be seen that, if the device is a watch, a bracelet, or a wearable device, the screen of the device may not cover the watchband region of the device, and may also cover the watchband region of the device. Here, the present application proposes an optional implementation manner, in which the device may be a watch, a bracelet, or a wearable device, and the device includes a screen and a connection portion. The screen can be a flexible screen, and the connecting part can be a watchband. Optionally, the screen of the device or the display area of the screen may partially or completely cover the wristband of the device. As shown in fig. 5, fig. 5 is a hardware schematic diagram of an implementation manner of a wearable device provided in an embodiment of the present application, where a screen of the device extends to two sides, and a part of the screen is covered on a watchband of the device. In other embodiments, the screen of the device may also be entirely covered on the watchband of the device, and this is not limited in this application.

Example one

Fig. 6 is a flowchart of the linked shooting control method according to the first embodiment of the present invention. A linkage shooting control method, the method comprising:

s1, acquiring a preview image of a scene to be shot through a first shooting component of the terminal equipment, and acquiring the shooting state of an operation object through a second shooting component of the terminal equipment;

s2, recognizing and analyzing the shooting state, and determining a visual state and an operation state in the shooting state;

s3, if the visual state is worse than a preset visual threshold, analyzing the operation state, wherein the operation state comprises an operation gesture of the wearable device corresponding to the operation object;

s4, acquiring a first shooting parameter control signal sent by the wearable device, analyzing the operation gesture to obtain a second shooting parameter control signal, and adjusting the shooting parameters of the scenery to be shot by combining the first shooting parameter control signal and the second shooting parameter control signal.

In the embodiment, firstly, a preview image of a scene to be shot is acquired through a first shooting component of the terminal equipment, and meanwhile, the shooting state of an operation object is acquired through a second shooting component of the terminal equipment; then, recognizing and analyzing the shooting state, and determining a visual state and an operation state in the shooting state; then, if the visual state is different from a preset visual threshold, analyzing the operation state, wherein the operation state comprises an operation gesture of the wearable device corresponding to the operation object; and finally, acquiring a first shooting parameter control signal sent by the wearable device, analyzing the operation gesture to obtain a second shooting parameter control signal, and adjusting the shooting parameters of the scenery to be shot by combining the first shooting parameter control signal and the second shooting parameter control signal.

Optionally, in this embodiment, a preview image of a scene to be photographed is acquired through a first shooting component of the terminal device, and meanwhile, a shooting state of an operation object is acquired through a second shooting component of the terminal device, where the terminal device has at least two sets of shooting components facing different surfaces, so that the preview image of the scene to be photographed is acquired through the first shooting component, and meanwhile, the second shooting component on the other surface is used for acquiring the shooting state of the operation object;

optionally, in this embodiment, the shooting status is identified and analyzed, and a visual status and an operation status in the shooting status are determined, where the shooting status includes a current visual status and an operation status of an operation object (i.e., a user), where the visual status is a visual condition of the operation object to a preview screen of the terminal device, for example, information such as visual clarity and visual distance, and the operation status includes two types, one of which is an operation condition of the operation object to a preview screen interface of the terminal device, for example, a click operation, an adjustment operation, and the like, and the other of which is an operation condition of the operation object to a wearable device worn on a wrist of the operation object, for example, a click operation, an adjustment operation, or a gesture operation, and the like in an interaction interface of the wearable device;

optionally, in this embodiment, if the visual state is worse than a preset visual threshold, the operation state is analyzed, where the operation state includes an operation gesture of the wearable device corresponding to the operation object. Specifically, a certain preset visual threshold is set, and the preset visual threshold can be set from two aspects, namely, the visual definition of an operation object but the visual distance of the operation object, and further, the determining factors of the visual threshold further include the size of a display area of the terminal device and the layout of an interactive interface under the current shooting preview of the terminal device, for example, in the layout of the interactive interface under the shooting preview, the display layout of a part of parameters is small, so that the operation object is inconvenient to view at a far distance, while the display part of another part of parameters is large, and when the distance is far, the operation object can still view normally;

optionally, in this embodiment, a first shooting parameter control signal sent by the wearable device is obtained, the operation gesture is analyzed to obtain a second shooting parameter control signal, and the shooting parameters of the scenery to be shot are adjusted in combination with the first shooting parameter control signal and the second shooting parameter control signal. It can be understood that, in this embodiment, in order to avoid the display area of the terminal device to be far away from the operation object, thereby the operation object not convenient for carry out the corresponding regulation and control operation of shooting parameters, or, the terminal device is when shooting the preview, the angle of placing, or the position of placing of the terminal device is comparatively special, the operation object not convenient for carry out the corresponding regulation and control operation of shooting parameters, therefore, in this embodiment, another camera through the terminal device obtains two types of operation gestures, the shooting parameters of the current shooting scenery are regulated and controlled in combination, thereby the convenience of the regulation and control of shooting parameters is improved.

Example two

Fig. 7 is a flowchart of a coordinated shooting control method according to a second embodiment of the present invention, where based on the above-described embodiments, the acquiring a preview image of a scene to be shot by a first shooting component of a terminal device, and acquiring a shooting status of an operation object by a second shooting component of the terminal device, includes:

s11, determining the first shooting component on the first side of the terminal equipment;

and S12, determining a second surface opposite to the first surface in the terminal equipment.

In this embodiment, first, the first shooting component is determined on the first side of the terminal device; then, in the terminal device, a second face opposite to the first face is determined.

Optionally, a shooting requirement of the terminal device is determined, for example, the shooting requirement is that an object to be shot is shot through a rear camera of the terminal device, and the shot preview image is observed through a front screen of the terminal device, and then a second surface opposite to the first surface is determined in the terminal device;

optionally, also, first, a shooting requirement of the terminal device is determined, for example, the shooting requirement is to shoot an object to be shot through a front camera of the terminal device, and the shooting preview image is observed through a front screen of the terminal device, then in the terminal device, a second surface that is the same as the first surface is determined, that is, the first surface and the second surface are in the same orientation, or the first surface and the second surface belong to the same surface.

The method has the advantages that the first shooting component is determined on the first face of the terminal device; then, in the terminal device, a second face opposite to the first face is determined. The method and the device realize a more humanized linkage shooting control scheme, so that a user can conveniently and rapidly regulate and control the shooting parameters in the shooting process of the terminal equipment, the operation efficiency is improved, and the user experience is enhanced.

EXAMPLE III

Fig. 8 is a flowchart of a linked shooting control method according to a third embodiment of the present invention, where based on the above-mentioned embodiment, the obtaining a preview image of a scene to be shot by a first shooting component of a terminal device, and obtaining a shooting status of an operation object by a second shooting component of the terminal device further includes:

s13, determining the second shooting component on the second surface;

and S14, acquiring a preview image of the scene to be shot through a first shooting component of the terminal equipment, and acquiring image information of the operation object through a second shooting component of the terminal equipment.

In this embodiment, first, the second photographing component is determined on the second surface; then, a preview image of a scene to be shot is acquired through a first shooting component of the terminal device, and meanwhile, image information of an operation object is acquired through a second shooting component of the terminal device.

Optionally, a shooting requirement of the terminal device is determined, for example, the shooting requirement is that an object to be shot is shot through a rear camera of the terminal device, and the shooting preview image is observed through a front screen of the terminal device, then in the terminal device, a second surface opposite to the first surface is determined, and then image information of the operation object is obtained through a second shooting component of the second surface;

optionally, also, first, a shooting requirement of the terminal device is determined, for example, the shooting requirement is that an object to be shot is shot through a front camera of the terminal device, and the shot preview image is observed through a front screen of the terminal device, then in the terminal device, a second surface identical to the first surface is determined, that is, the first surface and the second surface are in the same orientation, or the first surface and the second surface belong to the same surface, then, image information is obtained in three ways, one of which is that image information of an operation object is obtained through a first shooting component of the first surface, and the other of which is that image information of the operation object is obtained through a second shooting component of the second surface in the same orientation, and the third of which is that a preview image of the object to be shot and image information of the operation object are simultaneously obtained through the first shooting component.

The embodiment has the advantages that the second shooting component is determined on the second surface; then, a preview image of a scene to be shot is acquired through a first shooting component of the terminal device, and meanwhile, image information of an operation object is acquired through a second shooting component of the terminal device. The method and the device realize a more humanized linkage shooting control scheme, so that a user can conveniently and rapidly regulate and control the shooting parameters in the shooting process of the terminal equipment, the operation efficiency is improved, and the user experience is enhanced.

Example four

Fig. 9 is a flowchart of a fourth embodiment of the coordinated shooting control method according to the present invention, where based on the above embodiments, the obtaining a preview image of a scene to be shot by a first shooting component of a terminal device, and obtaining a shooting status of an operation object by a second shooting component of the terminal device further includes:

s15, analyzing the image information and identifying the operation object in the image information;

s16, determining the operation part and the visual part of the operation object, and analyzing the state information of the operation part and the visual part.

In this embodiment, first, the image information is analyzed, and an operation object in the image information is identified; then, an operation part and a visual part of the operation object are determined, and state information of the operation part and the visual part is analyzed.

Optionally, the image information is analyzed, and an operation object in the image information is identified, where the identified features include a head feature of the operation object, an upper arm feature of the operation object, and a wearing device feature of the operation object;

optionally, an operation part and a visual part of the operation object are determined, and state information of the operation part and the visual part is analyzed, for example, the visual part of the operation object is determined according to head features of the operation object, for example, positions of eyes and positions of eyeballs in the eyes are determined according to the head features;

optionally, the operation part and the visual part of the operation object are determined, and the state information of the operation part and the visual part is analyzed, for example, the corresponding wrist worn, wrist not worn, wrist position of the wearable device compared with the wrist worn, and the like are determined according to the upper arm characteristics of the operation object.

The method has the advantages that the operation object in the image information is identified by analyzing the image information; then, an operation part and a visual part of the operation object are determined, and state information of the operation part and the visual part is analyzed. The method and the device realize a more humanized linkage shooting control scheme, so that a user can conveniently and rapidly regulate and control the shooting parameters in the shooting process of the terminal equipment, the operation efficiency is improved, and the user experience is enhanced.

EXAMPLE five

Fig. 10 is a flowchart of a fifth embodiment of the coordinated shooting control method according to the present invention, and based on the above embodiments, the identifying and analyzing the shooting status, and determining the visual status and the operation status in the shooting status includes:

s21, identifying and analyzing the state information of the visual part, wherein the visual part comprises the positions of the two eyes and the states of the two eyes;

and S22, identifying and analyzing the state information of the operation part, wherein the operation part comprises the positions and states of the worn wrist and the unworn wrist.

In this embodiment, first, status information of the visual part is identified and analyzed, wherein the visual part includes positions of both eyes and statuses of both eyes; then, state information of the operation part is identified and analyzed, wherein the operation part comprises positions and states of a worn wrist and a non-worn wrist.

Optionally, the state information of the visual part is identified and analyzed, wherein the visual part includes positions of both eyes and states of both eyes, specifically, a distance between both eyes and a display area of the terminal device is determined according to the positions of both eyes, and it is determined that the current operation object is to view a preview image or operate a wearable device worn by the terminal device according to the states of both eyes;

optionally, the state information of the operation part is identified and analyzed, wherein the operation part comprises positions and states of a worn wrist and a non-worn wrist. Specifically, when the gesture control information is acquired through the second camera shooting assembly, the positions and the states of the worn wrist and the non-worn wrist are acquired at the same time, for example, the corresponding hand is determined according to the wrist, and then the gesture information of the corresponding hand is acquired.

The embodiment has the advantages that the state information of the visual part is identified and analyzed, wherein the visual part comprises the positions of the two eyes and the states of the two eyes; then, state information of the operation part is identified and analyzed, wherein the operation part comprises positions and states of a worn wrist and a non-worn wrist. The method and the device realize a more humanized linkage shooting control scheme, so that a user can conveniently and rapidly regulate and control the shooting parameters in the shooting process of the terminal equipment, the operation efficiency is improved, and the user experience is enhanced.

EXAMPLE six

Fig. 11 is a flowchart of a sixth embodiment of the coordinated shooting control method according to the present invention, based on the above embodiments, the recognizing and analyzing the shooting status, and determining a visual status and an operation status in the shooting status, further including:

s23, acquiring the positions of the pupils of the two eyes relative to the eyeballs of the eye sockets;

s24, determining the vision centers of the two eyes according to the positions of the eyeballs;

and S25, determining a visual orientation according to the visual center, and determining the preset visual threshold value in the visual orientation.

In this embodiment, first, the positions of the pupils of the two eyes compared with the positions of the eyeballs of the eye sockets are obtained; then, determining the visual centers of the two eyes according to the positions of the eyeballs; and finally, determining a visual orientation according to the visual center, and determining the preset visual threshold value in the visual orientation.

Optionally, the positions of the pupils of the two eyes, which are compared with the positions of the eyeballs of the eye sockets, are obtained through the second camera shooting assembly, the current visual orientation is determined according to the positions of the pupils, and whether the current operation target of the operation object is the terminal device or the wearable device is determined according to the visual orientation.

The method has the advantages that the positions of the pupils of the two eyes are obtained compared with the positions of the eyeballs of the eye sockets; then, determining the visual centers of the two eyes according to the positions of the eyeballs; and finally, determining a visual orientation according to the visual center, and determining the preset visual threshold value in the visual orientation. The method and the device realize a more humanized linkage shooting control scheme, so that a user can conveniently and rapidly regulate and control the shooting parameters in the shooting process of the terminal equipment, the operation efficiency is improved, and the user experience is enhanced.

EXAMPLE seven

Fig. 12 is a flowchart of a coordinated shooting control method according to a seventh embodiment of the present invention, where based on the foregoing embodiment, if the visual state is worse than a preset visual threshold, the analyzing the operation state, where the operation state includes an operation gesture of a wearable device corresponding to the operation target, includes:

s31, if the visual state difference is larger than a preset visual threshold, determining a first time period for acquiring an operation gesture;

and S32, analyzing the operation gesture of the wearable device corresponding to the operation object in the first time period.

In this embodiment, first, if the visual state is worse than a preset visual threshold, a first time period for acquiring an operation gesture is determined; then, the operation gesture of the wearable device corresponding to the operation object is analyzed in the first time period.

Optionally, if the visual state is worse than the preset visual threshold, a first time period for obtaining the operation gesture is determined, and it may be understood that, in order to ensure the operation continuity of this embodiment, in this embodiment, the first time period is set, and in this first time period, the operation gesture of the wearable device corresponding to the operation object is obtained, so that interference caused by other operations of the operation object on the operation gesture is avoided, or other operation actions are mistakenly collected.

The method has the advantages that the first time period for acquiring the operation gesture is determined by judging whether the visual state is different from the preset visual threshold; then, the operation gesture of the wearable device corresponding to the operation object is analyzed in the first time period. The method and the device realize a more humanized linkage shooting control scheme, so that a user can conveniently and rapidly regulate and control the shooting parameters in the shooting process of the terminal equipment, the operation efficiency is improved, and the user experience is enhanced.

Example eight

Fig. 13 is a flowchart of an eighth embodiment of the coordinated shooting control method according to the present invention, based on the above embodiments, where the acquiring a first shooting parameter control signal sent by the wearable device, and analyzing the operation gesture to obtain a second shooting parameter control signal, and adjusting the shooting parameters of the scene to be shot in combination with the first shooting parameter control signal and the second shooting parameter control signal includes:

s41, acquiring a first shooting parameter control signal sent by the wearable device, wherein the first shooting parameter control signal is generated after the wearable device receives corresponding operation of the operation object;

s42, analyzing the operation gesture to obtain a second shooting parameter control signal, adjusting the first shooting parameter of the scenery to be shot through the first shooting parameter control signal, and adjusting the second shooting parameter of the scenery to be shot through the second shooting parameter control signal.

In this embodiment, first, a first shooting parameter control signal sent by the wearable device is obtained, where the first shooting parameter control signal is generated after the wearable device receives a corresponding operation of the operation object; then, the operation gesture is analyzed to obtain a second shooting parameter control signal, the first shooting parameter of the scenery to be shot is adjusted through the first shooting parameter control signal, and the second shooting parameter of the scenery to be shot is adjusted through the second shooting parameter control signal.

Optionally, in order to facilitate reasonable regulation and control of the shooting parameters, in this embodiment, the shooting parameters are classified, for example, the shooting parameters are divided into parameters for controlling the shooting process, for example, the shooting interval is set, the continuous shooting times of shooting are set, remote control shooting is set, and the like, and the shooting parameters are further divided into parameters for controlling the shooting of images, for example, the shooting aperture value is set, the shooting exposure is set, the shooting shutter time is set, and further, the operation gesture is set to correspond to the parameters for controlling the shooting process, so that the process control instruction is conveniently and rapidly sent out, and the shooting parameters acquired and sent by the wearable device are set to correspond to the parameters for shooting images, so that the setting in the wearable device is more detailed and accurate.

The method has the advantages that the first shooting parameter control signal sent by the wearable device is obtained, wherein the first shooting parameter control signal is generated after the wearable device receives corresponding operation of the operation object; then, the operation gesture is analyzed to obtain a second shooting parameter control signal, the first shooting parameter of the scenery to be shot is adjusted through the first shooting parameter control signal, and the second shooting parameter of the scenery to be shot is adjusted through the second shooting parameter control signal. The method and the device realize a more humanized linkage shooting control scheme, so that a user can conveniently and rapidly regulate and control the shooting parameters in the shooting process of the terminal equipment, the operation efficiency is improved, and the user experience is enhanced.

Example nine

Based on the above embodiment, the present invention also provides a linked shooting control apparatus, including:

Example ten

Based on the foregoing embodiments, the present invention further provides a computer-readable storage medium, on which a bitmap processing program is stored, and when the bitmap processing program is executed by a processor, the bitmap processing program implements the steps of the bitmap processing method according to any one of the above.

By implementing the bitmap processing method, the equipment and the computer readable storage medium, the preview image of the scenery to be shot is obtained through the first shooting component of the terminal equipment, and meanwhile, the shooting state of the operation object is obtained through the second shooting component of the terminal equipment; then, recognizing and analyzing the shooting state, and determining a visual state and an operation state in the shooting state; then, if the visual state is different from a preset visual threshold, analyzing the operation state, wherein the operation state comprises an operation gesture of the wearable device corresponding to the operation object; and finally, acquiring a first shooting parameter control signal sent by the wearable device, analyzing the operation gesture to obtain a second shooting parameter control signal, and adjusting the shooting parameters of the scenery to be shot by combining the first shooting parameter control signal and the second shooting parameter control signal. The humanized linkage shooting control scheme is realized, so that the user can conveniently and rapidly adjust and control the shooting parameters in the shooting process of the terminal equipment, the operation efficiency is improved, and the user experience is enhanced.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A linkage shooting control method, characterized by comprising:

recognizing and analyzing the shooting state, and determining a visual state and an operation state in the shooting state; the visual state is the visual condition of the operation object on a preview screen of the terminal equipment, and the visual condition comprises visual definition and visual distance information;

if the visual state is different from a preset visual threshold, analyzing the operation state, wherein the operation state comprises an operation gesture of the wearable device corresponding to the operation object; setting a certain preset visual threshold, wherein the preset visual threshold is set from two aspects, namely, the visual definition of the operation object and the visual distance of the operation object;

the recognizing and analyzing the shooting status, and determining a visual status and an operational status in the shooting status, including:

identifying and analyzing state information of a visual part, wherein the visual part comprises positions of two eyes and states of the two eyes; determining the distance between the two eyes and the display area of the terminal equipment according to the positions of the two eyes, and determining that the current operation object is to view the preview image or operate the wearable equipment worn by the preview image according to the states of the two eyes;

identifying and analyzing state information of an operation part, wherein the operation part comprises positions and states of a worn wrist and a non-worn wrist;

obtain by the first shooting parameter control signal that wearing equipment sent, first shooting parameter control signal by wearing equipment receives generate behind the corresponding operation of operation object, and, the analysis with wearing equipment that operation object corresponds the operation gesture obtains the second and shoots parameter control signal, combines first shooting parameter control signal and the adjustment of second shooting parameter control signal the shooting parameter of the scenery of waiting to shoot, wherein, through first shooting parameter control signal adjustment the parameter of the shooting image of the scenery of waiting to shoot, through the adjustment of second shooting parameter control signal the parameter of the shooting process of the scenery of waiting to shoot.

2. The coordinated shooting control method according to claim 1, wherein said acquiring a preview image of a subject to be shot by a first shooting component of a terminal device, and simultaneously acquiring a shooting status of an operation subject by a second shooting component of the terminal device, comprises:

in the terminal device, a second face opposite to the first face is determined.

3. The coordinated shooting control method according to claim 2, wherein the acquiring of the preview image of the subject to be shot by the first shooting component of the terminal device and the acquiring of the shooting status of the operation subject by the second shooting component of the terminal device further comprises:

determining the second shooting component on the second surface;

4. The coordinated shooting control method according to claim 3, wherein the acquiring of the preview image of the subject to be shot by the first shooting component of the terminal device and the acquiring of the shooting status of the operation subject by the second shooting component of the terminal device further comprises:

5. The coordinated shooting control method according to claim 4, wherein the recognizing and analyzing the shooting status, determining a visual status and an operational status in the shooting status, further comprises:

acquiring the positions of pupils of two eyes compared with the positions of eyeballs of eye sockets;

6. The coordinated shooting control method according to claim 5, wherein the analyzing the operation state if the visual state is worse than a preset visual threshold, wherein the operation state includes an operation gesture of a wearable device corresponding to the operation object, includes:

7. A linked shooting control apparatus, characterized in that the apparatus comprises:

the computer program, when executed by the processor, implementing the steps of the method of any one of claims 1 to 6.

8. A computer-readable storage medium, characterized in that a linked shooting control program is stored thereon, which when executed by a processor, implements the steps of the linked shooting control method according to any one of claims 1 to 6.