CN114245005A - Control method and device of electronic equipment and related equipment - Google Patents
Control method and device of electronic equipment and related equipment Download PDFInfo
- Publication number
- CN114245005A CN114245005A CN202111437279.6A CN202111437279A CN114245005A CN 114245005 A CN114245005 A CN 114245005A CN 202111437279 A CN202111437279 A CN 202111437279A CN 114245005 A CN114245005 A CN 114245005A
- Authority
- CN
- China
- Prior art keywords
- image
- gesture
- electronic device
- electronic equipment
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application provides a control method and a control device of electronic equipment and related equipment, wherein the electronic equipment comprises a first camera, and the method comprises the following steps: the electronic equipment opens the first camera and enters a first camera shooting mode, and the electronic equipment displays a first image collected by the first camera in the first camera shooting mode. Then the electronic equipment responds to the trigger operation of the user, carries out image recognition on the first image and obtains the user gesture in the first image; the electronic equipment switches the image pickup mode of the electronic equipment from the first image pickup mode to the second image pickup mode according to the user gesture. According to the method, after the user triggers operation, the first image collected by the first camera is subjected to image recognition, so that the shooting mode of the electronic equipment is switched. In some scenes that a user is inconvenient to touch a control screen of the electronic equipment, the method provided by the embodiment of the application can switch the shooting mode of the electronic equipment through the gesture of the user, so that the control method of the user is simplified.
Description
Technical Field
The present application relates to the field of image processing technologies, and in particular, to a method and an apparatus for controlling an electronic device, and a related device.
Background
With the continuous development of the camera shooting technology, the camera shooting function provided by the electronic equipment is more and more mature, and users apply the camera shooting function of the electronic equipment in more and more scenes. Currently, it is often necessary to switch the image capturing mode. The switching of the image pickup mode comprises the switching of a camera and/or the switching of an image pickup state. For example, the current shooting mode of the electronic device is a shooting mode of a front camera, and when a user wants to switch to a recording mode of a rear camera, the user generally needs to click a camera switching control to switch the camera to the rear camera and click a state switching control to switch the shooting state from the shooting state to the recording state.
In some scenes of shooting by the electronic equipment, the user experience is low due to the fact that the control method of the shooting mode of the electronic equipment is too complicated. Therefore, there is a need for a method for controlling an electronic device, which can improve the user experience of using the electronic device to perform image capturing.
Disclosure of Invention
The application provides a control method and device of electronic equipment and related equipment, which are used for improving the use experience of shooting by a user by using the electronic equipment.
In order to achieve the purpose, the technical scheme is as follows:
the application provides a control method of electronic equipment, wherein the electronic equipment comprises a first camera, and the method comprises the following steps: the electronic equipment opens the first camera and enters a first camera shooting mode, and the electronic equipment displays a first image acquired by the first camera in the first camera shooting mode; responding to the trigger operation of a user, carrying out image recognition on the first image by the electronic equipment, and obtaining a user gesture in the first image; the electronic equipment switches the image pickup mode of the electronic equipment from the first image pickup mode to the second image pickup mode according to the user gesture.
Therefore, the control method of the electronic device, provided by the embodiment of the application, can perform image recognition on the first image acquired by the first camera after the user triggers the operation, so that the user gesture is obtained to control the electronic device. In some scenes that a user is inconvenient to touch a control screen of the electronic equipment, the method provided by the embodiment of the application can control the camera shooting function of the electronic equipment through the gesture of the user, so that the control method of the user is simplified. For example, in a scene where the user uses the selfie stick, the user can directly control the camera function of the electronic device through gestures to take a picture without retracting the selfie stick. Therefore, the control method of the electronic equipment provided by the embodiment of the application can simplify the control operation of the user and improve the use experience of the user in shooting by using the electronic equipment.
As a possible implementation manner, the electronic device provided in the embodiment of the present application further includes a second camera; the electronic equipment switches the image pickup mode of the electronic equipment from a first image pickup mode to a second image pickup mode according to the user gesture, and the method comprises the following steps: and the electronic equipment opens the second camera and obtains a second image acquired by the second camera according to the user gesture, and displays the second image. The electronic equipment provided by the embodiment of the application can be switched to a second image shooting mode for displaying a second image from a first image shooting mode for displaying a first image by recognizing the gesture of a user. Therefore, the user can directly switch the first camera and the second camera through gestures when using the electronic equipment, and the use experience of the user in shooting by using the electronic equipment is improved.
As a possible implementation manner, the electronic device provided in the embodiment of the present application includes a first display area and a second display area, and when the electronic device enters the second image capturing mode, the first display area displays the first image and the second display area displays the second image. The electronic equipment provided by the embodiment of the application can be switched to a second shooting mode for simultaneously displaying the first image and the second image from a first shooting mode for displaying the first image by recognizing the gesture of a user. Therefore, the user can control the electronic equipment to switch between the single mirror and the double mirror through gestures, and the use experience of shooting by using the electronic equipment is improved.
As a possible implementation manner, the method for controlling an electronic device provided in an embodiment of the present application further includes: the electronic equipment closes the first camera according to the user gesture. When the electronic equipment provided by the embodiment of the application is switched to the second camera shooting mode for displaying the second image, the second camera is automatically opened, and the first camera is closed. Therefore, the user can control the switches of the first camera and the second camera through gestures, and the use experience of the user in shooting by using the electronic equipment is improved.
As a possible implementation manner, the method for controlling an electronic device provided in an embodiment of the present application further includes: when the user gesture in the first image is adjusted to be the switching gesture, the electronic equipment exchanges the display position of the first image and the display position of the second image. As a possible implementation manner, the method for controlling an electronic device provided in an embodiment of the present application further includes: when the user gesture in the first image is adjusted to be a fist making gesture, the electronic equipment displays the first image in a partial area of the display area where the second image is located. The electronic equipment can also control the display interface of the camera shooting function through the gesture of the user, so that the camera shooting preview interface of the electronic equipment and the recording interface of the electronic equipment meet the requirements of the user, and the use experience of the user in shooting by using the electronic equipment is improved.
As a possible implementation manner, the method for controlling an electronic device provided in an embodiment of the present application further includes: when the user gesture in the first image is adjusted to be a sliding gesture, the electronic equipment switches the image pickup mode from the second image pickup mode to the third image pickup mode, and the electronic equipment displays the first image or the second image in the first image pickup mode. Therefore, the electronic equipment provided by the embodiment of the application can continuously control the photographing function of the electronic equipment according to the gesture of the user in the acquired image, so that the user can control the photographing function of the electronic equipment at any time, and the use experience of photographing by the user using the electronic equipment is improved.
As a possible implementation manner, the method for controlling an electronic device provided in an embodiment of the present application further includes: and when the user gesture in the first image is adjusted to be a recording gesture, the electronic equipment records the picture of the electronic equipment. As a possible implementation manner, the method for controlling an electronic device provided in an embodiment of the present application further includes: and when the user gesture in the first image is adjusted to be the gesture for stopping recording, the electronic equipment stops recording the picture of the electronic equipment. Therefore, the electronic equipment provided by the embodiment of the application can remotely control the functions of starting recording and stopping recording of the electronic equipment through gestures, and improves the use experience of shooting by using the electronic equipment by a user in a scene that a selfie stick or other users are inconvenient to touch a control screen of the electronic equipment.
As a possible implementation manner, an embodiment of the present application provides a method for controlling an electronic device, including: the image pickup function and the display function of the electronic apparatus are controlled.
As a possible implementation manner, an electronic device provided in an embodiment of the present application includes: a gesture recognition node; in response to a trigger operation of a user, the electronic device performs image recognition on the first image to obtain a user gesture in the first image, and the method comprises the following steps: and responding to the trigger operation of the user, and carrying out image recognition on the first image by the gesture recognition node to obtain the user gesture in the first image.
As a possible implementation manner, an electronic device provided in an embodiment of the present application includes: the device comprises a gesture control module and a switching control module; the electronic equipment switches the image pickup mode of the electronic equipment from a first image pickup mode to a second image pickup mode according to the user gesture, and the method comprises the following steps: the gesture control module controls the switching control module to switch the image pickup mode of the electronic equipment from the first image pickup mode to the second image pickup mode according to the user gesture.
According to the control method of the electronic device, an embodiment of the present application further provides a control apparatus of an electronic device, where the electronic device includes a first camera, and the apparatus includes: the display unit is used for opening the first camera and entering a first camera shooting mode, and the electronic equipment displays a first image acquired by the first camera in the first camera shooting mode; the recognition unit is used for responding to the trigger operation of the user, carrying out image recognition on the first image and obtaining the user gesture in the first image; the switching unit is used for switching the image pickup mode of the electronic equipment from the first image pickup mode to the second image pickup mode according to the user gesture.
According to the control method of the electronic device and the control apparatus of the electronic device provided above, an embodiment of the present application further provides a computer device, where the computer device includes a processor and a memory: the memory is used for storing a computer program; the processor is used for executing the control method of the electronic equipment according to the computer program.
According to the control method of the electronic device and the control device of the electronic device provided above, an embodiment of the present application further provides a computer-readable storage medium for storing a computer program for executing the control method of the electronic device.
According to the technical scheme, the method has the following beneficial effects:
the embodiment of the application provides a control method and a control device of electronic equipment and related equipment, wherein the electronic equipment comprises a first camera, and the method comprises the following steps: the electronic equipment opens the first camera and enters a first camera shooting mode, and the electronic equipment displays a first image collected by the first camera in the first camera shooting mode. Then the electronic equipment responds to the trigger operation of the user, carries out image recognition on the first image and obtains the user gesture in the first image; the electronic equipment switches the image pickup mode of the electronic equipment from the first image pickup mode to the second image pickup mode according to the user gesture.
To sum up, according to the control method of the electronic device provided in the embodiment of the present application, after the gesture recognition function of the electronic device is triggered, the electronic device can automatically perform image recognition on the first image acquired by the first camera on the preview interface for shooting or the recording interface for shooting, so as to switch the shooting model of the electronic device. In some scenes that a user is inconvenient to touch a control screen of the electronic equipment, the method provided by the embodiment of the application can switch the shooting mode of the electronic equipment through the gesture of the user, so that the control method of the user is simplified. For example, in a scene that a user uses a selfie stick, the user does not need to retract the selfie stick, and the electronic equipment can be directly controlled by gestures to switch the image pickup mode. Therefore, the control method of the electronic equipment provided by the embodiment of the application can simplify the operation of switching the shooting mode of the user and improve the use experience of shooting by using the electronic equipment.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art according to the drawings.
Fig. 1 is a block diagram of a control method of an electronic device according to an embodiment of the present disclosure;
fig. 2 is a signaling diagram of a control method of an electronic device according to an embodiment of the present disclosure;
fig. 3a is a schematic diagram of a trigger button according to an embodiment of the present disclosure;
fig. 3b is a display interface diagram of an electronic device according to an embodiment of the present disclosure;
fig. 4 is a display interface diagram of another electronic device provided in the embodiment of the present application;
fig. 5 is a display interface diagram of an electronic device according to an embodiment of the present application;
fig. 6 is a display interface diagram of another electronic device provided in the embodiments of the present application;
fig. 7 is a schematic diagram of a gesture control method according to an embodiment of the present disclosure;
FIG. 8 is a schematic diagram of another gesture control method provided in the embodiments of the present application;
fig. 9 is a schematic diagram of a gesture control method according to an embodiment of the present application;
FIG. 10 is a schematic diagram of another gesture control method provided in the embodiments of the present application;
fig. 11 is a schematic diagram of a gesture control method according to an embodiment of the present application;
FIG. 12 is a schematic diagram of another gesture control method provided in the embodiments of the present application;
fig. 13 is a schematic diagram of a control device of an electronic device according to an embodiment of the present application.
Detailed Description
The terms "first", "second" and "third", etc. in the description and claims of this application and the description of the drawings are used for distinguishing between different objects and not for limiting a particular order.
In the embodiments of the present application, words such as "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.
The term "User Interface (UI)" in the following embodiments of the present application is a media interface for interaction and information exchange between an application program or an operating system and a user, and implements conversion between an internal form of information and a form acceptable to the user. The user interface is source code written by java, extensible markup language (XML) and other specific computer languages, and the interface source code is analyzed and rendered on the electronic equipment and finally presented as content which can be identified by a user. A commonly used presentation form of the user interface is a Graphical User Interface (GUI), which refers to a user interface related to computer operations and displayed in a graphical manner. It may be a visual interface element such as text, an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. displayed in the display of the electronic device.
In some examples, the electronic device may be a camera, a mobile phone, a tablet Computer, a desktop Computer, a laptop Computer, a notebook Computer, an Ultra-mobile Personal Computer (UMPC), a handheld Computer, a netbook, a Personal Digital Assistant (PDA), a wearable electronic device, a smart watch, and the like, and the specific form of the electronic device is not particularly limited in this application. In order to better understand the solutions provided in the embodiments of the present application, an application scenario of the solutions provided in the embodiments of the present application is described first.
Referring to fig. 1, the figure is a block diagram of a control method of an electronic device according to an embodiment of the present application.
As shown in fig. 1, an Android system of an electronic device in the embodiment of the present application includes four layers, which are, from top to bottom, an application layer (App)100, a framework layer (FWK) 200, a Hardware Abstraction Layer (HAL) 300, and a kernel layer (kernel layer).
The application layer 100 includes three layers of a UI layer 101, a multi-shot framework 102, and a camera management 103. The UI layer 101 includes applications such as a photographing module 1011, a recording module 1012, and a multi-mirror module 1013. The multi-shot frame layer 102 includes a switching control module 1021, a multi-shot encoding module 1022, a gesture control module 1023, and the like. The camera management 103 includes device management 1031, session control management 1032 (session management), surface management 1033, and the like.
The framework layer 200 provides an Application Programming Interface (API) and a programming framework for the application programs of the application layer 100. The framework layer 200 includes some predefined functions. The framework layer in the embodiment of the present application mainly includes a camera manager (camera manager)2001, an image pickup device (camera device)2002, a session control (session)2003, an output interface (output)2004, and the like.
The hardware abstraction layer 300 is located at the interface layer between the operating system and the hardware circuitry, and is intended to abstract the hardware. The hardware abstraction layer 300 in the embodiment of the present application may include a three-dimensional graphics processing library (camera 3D device)3001, a data stream (steam)3002, an image capture (capture)3003, and a gesture recognition node (capture node) 3004.
The kernel layer, which is an abstraction layer between the hardware and software stacks, is located between the hardware abstraction layer 300 and the hardware layer 400, and is not shown in the figure.
The hardware layer 400 includes a first camera 4001, a second camera 4002, a third camera 4003, and the like. It should be noted that the structure of the hardware layer in fig. 1 is only a framework example of the control method of the electronic device provided in the embodiment of the present application. The control method of the electronic device provided in the embodiment of the present application may be applied to an electronic device including only one camera, and may also be applied to an electronic device including a plurality of cameras, which is not limited herein.
In the electronic device corresponding to the frame shown in fig. 1, if the camera function needs to be controlled by clicking an electronic control screen, the control method becomes more cumbersome in some scenes, and the user experience is reduced. Therefore, the embodiment of the application provides a control method of an electronic device, which is used for simplifying the control operation of a user and improving the use experience of the user in shooting by using the electronic device. Specifically, in response to a triggering operation of a user, the electronic device loads a gesture control function and displays a first image acquired by the first camera. The hardware abstraction layer 300 of the electronic device receives the image data of the first image sent by the hardware layer 400, and performs image recognition on the first image to obtain information corresponding to the user gesture in the first image. The hardware abstraction layer 300 sends information corresponding to the user gesture to the application layer 100 through the framework layer 200, and the application layer 100 controls the electronic device according to the information corresponding to the user gesture, for example, switching a camera mode, or triggering a photographing or video recording function. Therefore, after the electronic equipment provided by the embodiment of the application is triggered, the camera shooting function of the electronic equipment can be controlled according to the gesture of the user, the control operation of the user is simplified, and the use experience of the user in shooting by using the electronic equipment is improved.
The electronic device provided by the embodiment of the application can only comprise the first camera, and also can comprise the first camera and the second camera. When the electronic device in the embodiment of the present application includes the first camera and the second camera, the electronic device provided in the embodiment of the present application has a plurality of image capturing modes, such as a single-mirror mode and a double-mirror mode. Specifically, when the electronic device is in the single-lens mode, the electronic device displays only a first image captured by the first camera or a second image captured by the second camera. When the electronic device is in the dual-mirror mode, the electronic device simultaneously displays the first image and the second image.
The single-mirror mode and the double-mirror mode in the embodiment of the present application are functions pre-stored in the electronic device, and switching between the multiple modes may be implemented by the switching control module 1021 in the application layer 100. The electronic device provided by the embodiment of the present application further has functions of starting recording and ending recording, and may be implemented by the video module 1012 of the UI layer.
The following describes a control method of an electronic device provided in an embodiment of the present application in detail with reference to the embodiment.
Referring to fig. 2, the figure is a signaling diagram of a control method of an electronic device according to an embodiment of the present application.
As shown in fig. 2, a method for controlling an electronic device provided in an embodiment of the present application includes:
s201: and responding to the trigger operation of the user, and loading the gesture control function by the electronic equipment.
As a possible implementation manner, in the embodiment of the application, a user may trigger a gesture recognition mode of the electronic device by clicking a target position in a control screen of the electronic device, so that the electronic device loads a gesture control function. The user may also trigger the gesture recognition mode of the electronic device by clicking a target key, by voice control, or in another triggering manner, which is not limited herein. As another possible implementation manner, the electronic device may also directly load the gesture control function in other modes, such as a video recording mode, through a trigger operation of the user. In fig. 3a, the electronic device is in a video recording mode, and a user can trigger a gesture recognition function of the electronic device through a target key H in a control screen of the electronic device.
As a possible implementation, after the gesture control function is loaded, the camera manager 2002 may open a first camera of the electronic device, and the electronic device displays a first image captured by the first camera, that is, the electronic device displays the single-lens mode. As one example, the first camera may be a front-facing camera of the electronic device. Referring to fig. 3b, the figure is a display interface diagram of an electronic device according to an embodiment of the present application. As shown in fig. 3b, when the first camera is a front camera of the electronic device, the electronic device displays a first image captured by the front camera.
As another possible implementation manner, after the gesture recognition mode in the embodiment of the present application is turned on, the electronic device will call the gesture control module 1023 to load a gesture control function. When the gesture control function is loaded, the electronic device opens the first camera and the second camera with the camera manager 2002 in the control frame layer 200, and the electronic device displays a first image acquired by the first camera and a second image acquired by the second camera, that is, the electronic device displays a dual-mirror mode.
The embodiment of the application does not limit the positions of the first camera and the second camera on the electronic equipment, the first camera and the second camera can be both rear cameras and front cameras, can be respectively the front cameras and the rear cameras, and can also be other cameras connected to the electronic equipment. Specifically, the display screen of the electronic device may include a first display area and a second display area, and the electronic device displays a first image in the first display area and displays a second image in the second display area. The display interface of the electronic device according to the embodiment of the present application is described below by taking the first camera as a front camera of the electronic device and the second camera as a rear camera of the electronic device as an example.
Referring to fig. 4, this figure is a display interface diagram of another electronic device provided in the embodiment of the present application.
Referring to fig. 5, this figure is a display interface diagram of an electronic device according to an embodiment of the present application.
As a possible implementation, the electronic device may display the first image and the second image in juxtaposed display areas, respectively. In the embodiment of the application, a scheme that the electronic device respectively displays the first image and the second image in the juxtaposed display areas is called as a scheme of split-screen display of the electronic device. As shown in fig. 4, the electronic device may display the first image and the second image in a split manner, i.e. the upper half of the display screen of the electronic device displays the second image and the lower half of the display screen of the electronic device displays the first image. As shown in fig. 5, the electronic device may further display the first image and the second image in left and right split screens, that is, the left half of the display screen of the electronic device displays the first image and the right half of the display screen of the electronic device displays the second image.
As described above, the electronic device can display the first image and the second image in the juxtaposed display areas, respectively. As another possible implementation, the electronic device may also display the first image and the second image in the overlapped display areas, respectively.
Referring to fig. 6, this figure is a display interface diagram of another electronic device provided in the embodiment of the present application.
The electronic device may further display the first image in a partial area of the display area where the second image is located. In the embodiment of the present application, a mode in which the electronic device displays the first image and the second image in the overlapped display regions, respectively, is referred to as a picture-in-picture mode. As shown in fig. 6, the main display of the electronic device displays the second image, and the window on the main display displays the second image. It should be noted that the position of the window in fig. 6 is only an example, and the window may be anywhere on the main display screen in an actual application.
After the electronic equipment displays the image collected by the target camera, the electronic equipment can recognize the gesture of the user and control the camera shooting function in the electronic equipment. To better understand the solution provided by the embodiments of the present application, several examples of the user gesture controlling the electronic device are introduced below.
As shown in fig. 2, it is assumed that the gesture of the user is a sliding gesture, and after the gesture recognition mode of the electronic device is turned on, the electronic device displays a first image acquired by the first camera and a second image acquired by the second camera in a split screen manner, that is, the electronic device is in a dual-mirror mode.
S202: the gesture recognition node 3004 recognizes a user gesture in the image captured by the target camera as a slide gesture.
It should be noted that the target camera in the embodiment of the present application may be a first camera, and may also be a second camera. When the first camera is a front camera and the second camera is a rear camera, the gesture recognition node 3004 may perform image recognition on only the first image collected by the first camera, or may simultaneously recognize the first image collected by the first camera and the second image collected by the second camera. The method and the device for recognizing the user gestures in the image can recognize the user gestures in the image collected by the front camera, and can also recognize the user gestures in the image collected by the rear camera. Therefore, the user can control the camera shooting function of the electronic equipment through gestures not only on the front side of the electronic equipment, but also on the back side of the electronic equipment.
After the gesture recognition node 3004 recognizes the user gesture as a slide gesture, it sends the slide gesture information to the gesture control module 1023. It should be noted that the sliding gesture in the embodiment of the present application may be a gesture of sliding a palm of a user, a gesture of making a fist of the user, or another gesture, and the embodiment of the present application is not limited herein. For convenience of understanding, the solution provided by the embodiment of the present application will be described below by taking a swipe gesture as a gesture of user palm swipe as an example.
S203: the gesture control module 1023 triggers the single-mirror mode according to the sliding gesture information sent by the gesture recognition node 3004.
Referring to fig. 7, the drawing is a schematic view of a gesture control method according to an embodiment of the present disclosure.
Referring to fig. 8, this figure is a schematic diagram of another gesture control method provided in the embodiment of the present application.
When the gesture control module 1023 receives the sliding gesture information, the switching control module 1021 is invoked to switch the image capturing mode of the electronic device to the single-mirror mode, that is, the electronic device only displays the first image or the second image. As shown in fig. 7, the electronic device displays a first image on one side of the display screen and the electronic device displays a second image on the other side of the display screen. The gesture recognition node 3004 recognizes the slide gesture in the first image, and sends the slide gesture information to the gesture control module 1023, and the gesture control module 1023 triggers the single-mirror mode, so that the electronic device only displays the first image.
It should be noted that, in the sliding gesture in the embodiment of the present application, the palm of the user may slide left and right, or may slide up and down, and the embodiment of the present application is not limited herein. As an example, the first camera is a front camera, the second camera is a rear camera, and as shown in fig. 7, when the gesture recognition node 3004 recognizes that the sliding direction of the sliding gesture in the first image is sliding upwards or sliding leftwards, the gesture control module 1023 triggers a single-mirror mode corresponding to the first image, and the electronic device only displays the first image. As shown in fig. 8, when the gesture recognition node 3004 recognizes that the sliding direction of the sliding gesture in the first image is sliding downwards or sliding to the right, the gesture control module 1023 triggers the single-mirror mode corresponding to the second image, and the electronic device only displays the second image.
As can be seen from the above, the electronic device in the embodiment of the present application can be switched from the dual-mirror mode to the single-mirror mode. As another possible implementation manner, when the electronic device is in the single-mirror mode, the electronic device in the embodiment of the present application may also be switched from the single-mirror mode to the double-mirror mode.
Referring to fig. 9, the figure is a schematic diagram of a gesture control method according to an embodiment of the present disclosure.
When the electronic device is in the single-mirror mode, the gesture recognition node 3004 recognizes the user gesture as a slide gesture, and sends the slide gesture information to the gesture control module 1023. When the gesture control module 1023 receives the sliding gesture information, the switching control module 1021 is invoked to switch the image capturing mode of the electronic device to the double-mirror mode, that is, the electronic device only displays the first image and the second image. Correspondingly, in the sliding gesture in the embodiment of the present application, the palm of the user may slide left and right, or may slide up and down, which is not limited herein.
It should be noted that when the electronic device is in the single-lens mode, the electronic device may only turn on the first camera, but not turn on the second camera. At this time, the switching control module 1021 opens the second camera according to the preset requirement of the dual-lens mode, and the electronic device displays a second image acquired by the second camera.
According to the embodiment of the application, the electronic equipment can be switched between the single-mirror mode and the double-mirror mode according to the user gesture, and the image pickup mode of the electronic equipment can be switched to the picture-in-picture mode according to the user gesture.
S204: the gesture recognition node 3004 recognizes a user gesture in the image captured by the target camera as a fist making gesture.
S205: the gesture control module 1023 triggers the picture-in-picture mode according to the fist making gesture sent by the gesture recognition node 3004.
After the gesture recognition node 3004 recognizes that the user gesture is a fist-making gesture, the fist-making gesture information is sent to the gesture control module 1023. It should be noted that the fist making gesture in the embodiment of the present application may be a palm sliding gesture of the user, a fist making gesture of the user, or another gesture, and the embodiment of the present application is not limited herein. For convenience of understanding, the solution provided by the embodiment of the present application will be described below by taking a fist making gesture as an example of a hand fist making gesture of a user.
Referring to fig. 10, this figure is a schematic diagram of another gesture control method provided in the embodiment of the present application.
As shown in fig. 10, the electronic device in the embodiment of the present application is originally in the dual-mirror mode, and when the gesture recognition node 3004 recognizes the user gesture as a fist-making gesture, the fist-making gesture information is sent to the gesture control module 1023. The gesture control module 1023 calls the switching control module 1021 to switch the dual-mirror mode of the electronic device to the picture-in-picture mode. It should be noted that, in the picture-in-picture mode provided in the embodiment of the present application, a first image may be displayed in a main display screen of an electronic device, and a second image is displayed in a window; the first image may also be displayed in a window of the electronic device and the second image is displayed in a main display of the electronic device.
When the electronic device is in the single-mirror mode, the user may switch the single-mirror mode of the electronic device to the picture-in-picture mode in the same manner. It should be noted that when the electronic device is in the single-lens mode, the electronic device may only turn on the first camera, but not turn on the second camera. At this time, the switching control module 1021 opens the second camera according to the preset requirement of the pip mode, and the electronic device displays the second image acquired by the second camera.
As a possible implementation, after the electronic device is in the picture-in-picture mode, the gesture recognition node 3004 recognizes the user gesture as a fist making gesture again. The gesture control module 1023 calls the switching control module 1021 to switch the picture-in-picture mode of the electronic device to the single-mirror mode corresponding to the first image. As another possible implementation manner, when the gesture recognition node 3004 recognizes the user gesture as a sliding gesture after the electronic device is in the picture-in-picture mode, the gesture control module 1023 calls the switching control module 1021 to switch the picture-in-picture mode of the electronic device to the dual-mirror mode.
In the embodiment of the application, the electronic device can switch different image capturing modes of the electronic device according to the user gesture, such as a single-mirror mode, a double-mirror mode and a picture-in-picture mode. In addition, the electronic equipment can call the camera function of the electronic equipment according to the user gesture.
S206: the gesture recognition node 3004 recognizes a user gesture in the image collected by the target camera as a switching gesture.
S207: the gesture control module 1023 exchanges the display position of the first image and the display position of the second image according to the switching gesture sent by the gesture recognition node 3004.
After the gesture recognition node 3004 recognizes the user gesture as a switching gesture, it sends the switching gesture information to the gesture control module 1023. It should be noted that the switching gesture in the embodiment of the present application may be a gesture of sliding a palm of a user, a gesture of making a fist of the user, or another gesture, and the embodiment of the present application is not limited herein. For convenience of understanding, the solution provided by the embodiment of the present application will be described below by taking a switching gesture as a gesture of user palm flipping as an example.
Referring to fig. 11, which is a schematic view of a gesture control method provided in the embodiment of the present application.
Referring to fig. 12, this figure is a schematic view of another gesture control method provided in the embodiment of the present application.
As shown in fig. 11, the electronic device in the embodiment of the present application is in the dual-mirror mode, and when the gesture recognition node 3004 recognizes the user gesture as the switching gesture, the switching gesture information is sent to the gesture control module 1023. After receiving the switching gesture information, the gesture control module 1023 swaps the positions of the first image and the second image in the dual-mirror mode. As another possible implementation manner, when the electronic device is in the picture-in-picture mode, the gesture control module 1023 may also swap the positions of the first image and the second image in the picture-in-picture mode after receiving the switching gesture information sent by the gesture recognition node 3004.
As shown in fig. 12, the electronic device provided in the embodiment of the application is in the single-mirror mode, and when the gesture recognition node 3004 recognizes the user gesture as the switching gesture, the switching gesture information is sent to the gesture control module 1023. After receiving the switching gesture information, the gesture control module 1023 switches the first image displayed by the electronic device to the second image, or switches the second image displayed by the electronic device to the first image. It should be noted that, when the electronic device is in the single-lens mode corresponding to the first image, the electronic device may only turn on the first camera, but not turn on the second camera. At this time, the gesture control module 1023 receives the switching gesture information and then starts the second camera, so that the electronic device displays a second image collected by the second camera.
In addition, according to the embodiment of the application, the start or the termination of the recording function of the video recording setting equipment can be triggered according to the user gesture.
S208: and the gesture recognition node recognizes the user gesture in the image acquired by the target camera as a gesture for starting recording.
S209: the gesture control module 1023 controls the electronic device to record the picture of the electronic device according to the recording starting gesture sent by the gesture recognition node 3004.
S210: and the gesture recognition node recognizes the user gesture in the image acquired by the target camera as a recording stopping gesture.
S211: the gesture control module 1023 controls the electronic device to stop recording the picture of the electronic device according to the recording stopping gesture sent by the gesture recognition node 3004.
As a possible implementation manner, the gesture of starting recording in this embodiment may be hovering of a palm of a user. For example, the user's palm is unfolded and held stationary for 2 s. The recording stopping gesture in the embodiment of the present application may be an OK gesture, that is, a gesture in which the top of the thumb of the user is in contact with the top of the index finger, and the other three palms are straightened.
It should be noted that the display interface of the electronic device in the above drawings may be a display interface of the electronic device during a video recording process, or may be a display interface of the electronic device during a video preview process, and the examples of the present application are not limited herein. In practical application, when the electronic device in the embodiment of the application previews a video, the shooting mode of the electronic device can be switched through a gesture, so that a proper shooting module is selected to start shooting. The electronic equipment in the embodiment of the application can also switch the shooting mode of the electronic equipment through gestures after the video recording is started, namely in the video recording process.
It should be noted that, when receiving the gesture information of the user, the gesture control module 1023 in the embodiment of the application analyzes the gesture information of the user, and executes an operation corresponding to the gesture information of the user. When the gesture control module 1023 parses the gesture information or performs a corresponding operation, the gesture control module 1023 is in a running state. After the gesture control module 1023 completes the operation corresponding to the gesture information, the gesture control module 1023 will resume to the initial state. When the gesture control module 1023 is in the running state, if the gesture control module 1023 further receives new gesture information, the gesture control module 1023 saves the gesture information, and analyzes the gesture information and executes corresponding operation after the gesture control module 1023 returns to the starting state.
To sum up, according to the control method of the electronic device provided in the embodiment of the present application, after the gesture recognition function of the electronic device is triggered, the electronic device can automatically perform image recognition on the first image acquired by the first camera on the preview interface for shooting or the recording interface for shooting, so as to switch the shooting model of the electronic device. In some scenes that a user is inconvenient to touch a control screen of the electronic equipment, the method provided by the embodiment of the application can switch the shooting mode of the electronic equipment through the gesture of the user, so that the control method of the user is simplified. For example, in a scene that a user uses a selfie stick, the user does not need to retract the selfie stick, and the electronic equipment can be directly controlled by gestures to switch the image pickup mode. Therefore, the control method of the electronic equipment provided by the embodiment of the application can simplify the operation of switching the shooting mode of the user and improve the use experience of shooting by using the electronic equipment.
According to the control method of the electronic device provided by the embodiment, the embodiment of the application further provides a control device of the electronic device.
Referring to fig. 13, this figure is a schematic view of a control device of an electronic device according to an embodiment of the present application.
As shown in fig. 13, an embodiment of the present application provides a control apparatus for an electronic device, where the electronic device includes a first camera, and the apparatus includes:
the display unit 1301 is configured to open the first camera and enter a first camera mode, and the electronic device displays a first image acquired by the first camera in the first camera mode.
The recognition unit 1302 is configured to perform image recognition on the first image in response to a trigger operation of a user, and obtain a user gesture in the first image.
The switching unit 1303 is configured to switch the image capturing mode of the electronic device from the first image capturing mode to the second image capturing mode according to the user gesture.
To sum up, the control device of the electronic device provided in the embodiment of the present application can automatically perform image recognition on the first image acquired by the first camera after triggering the gesture recognition function of the electronic device, so as to obtain the user gesture to control the electronic device. Under the condition that some users are inconvenient to touch the control screen of the electronic equipment, the device provided by the embodiment of the application can control the camera shooting function of the electronic equipment through gestures of the users, so that the control operation of the users is simplified. For example, in a scene that a user uses a selfie stick, the user does not need to retract the selfie stick, and the electronic device can be directly controlled by gestures to switch a shooting mode or trigger a shooting function of the electronic device. Therefore, the control method of the electronic equipment provided by the embodiment of the application can simplify the control operation of the user and improve the use experience of the user in shooting by using the electronic equipment.
According to the control apparatus of the electronic device and the control method of the electronic device provided in the above embodiments, the present application also provides a computing device, which includes a processor and a memory: the memory is used for storing a computer program; the processor is used for executing the control method of the electronic equipment according to the computer program.
According to the control apparatus of the electronic device and the control method of the electronic device provided in the above embodiments, the present application also provides a computer-readable storage medium for storing a computer program for executing the control method of the electronic device described above.
Through the above description of the embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions. For the specific working processes of the system, the apparatus and the unit described above, reference may be made to the corresponding processes in the foregoing method embodiments, and details are not described here again.
In the several embodiments provided in this embodiment, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, each functional unit in the embodiments of the present embodiment may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present embodiment essentially or partially contributes to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) or a processor to execute all or part of the steps of the method described in the embodiments. And the aforementioned storage medium includes: flash memory, removable hard drive, read only memory, random access memory, magnetic or optical disk, and the like.
The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (15)
1. A control method of an electronic device, wherein the electronic device includes a first camera, the method comprising:
the electronic equipment opens the first camera and enters a first camera shooting mode, and the electronic equipment displays a first image acquired by the first camera in the first camera shooting mode;
responding to a trigger operation of a user, the electronic equipment performs image recognition on the first image to obtain a user gesture in the first image;
and the electronic equipment switches the image pickup mode of the electronic equipment from the first image pickup mode to a second image pickup mode according to the user gesture.
2. The method of claim 1, wherein the electronic device further comprises a second camera; the electronic device switches the image capturing mode of the electronic device from the first image capturing mode to a second image capturing mode according to the user gesture, and the method comprises the following steps:
and the electronic equipment opens the second camera according to the user gesture, obtains a second image acquired by the second camera and displays the second image.
3. The method according to claim 2, wherein the electronic apparatus includes a first display area and a second display area, the first display area displaying the first image and the second display area displaying the second image when the electronic apparatus enters the second image capturing mode.
4. The method of claim 2, further comprising:
and the electronic equipment closes the first camera according to the user gesture.
5. The method of claim 3, further comprising:
when the user gesture in the first image is adjusted to be a switching gesture, the electronic equipment exchanges the display position of the first image and the display position of the second image.
6. The method of claim 3, further comprising:
when the user gesture in the first image is adjusted to be a fist making gesture, the electronic equipment displays the first image in a partial area of a display area where the second image is located.
7. The method of claim 3, further comprising:
when the user gesture in the first image is adjusted to be a sliding gesture, the electronic device switches the image capturing mode from the second image capturing mode to a third image capturing mode, and the electronic device displays the first image or the second image in the first image capturing mode.
8. The method of claim 1, further comprising:
and when the user gesture in the first image is adjusted to be a recording gesture, the electronic equipment records the picture of the electronic equipment.
9. The method of claim 8, further comprising:
and when the user gesture in the first image is adjusted to be the gesture for stopping recording, the electronic equipment stops recording the picture of the electronic equipment.
10. The method of claim 1, wherein the controlling the electronic device comprises:
and controlling the image pickup function and the display function of the electronic equipment.
11. The method of claim 1, wherein the electronic device comprises: a gesture recognition node;
the responding to the trigger operation of the user, the electronic equipment performs image recognition on the first image to obtain the user gesture in the first image, and the method comprises the following steps:
responding to a trigger operation of a user, and carrying out image recognition on the first image by the gesture recognition node to obtain a user gesture in the first image.
12. The method of claim 1, wherein the electronic device comprises: the device comprises a gesture control module and a switching control module;
the electronic device switches the image capturing mode of the electronic device from the first image capturing mode to a second image capturing mode according to the user gesture, and the method comprises the following steps:
the gesture control module controls the switching control module to switch the image pickup mode of the electronic equipment from the first image pickup mode to the second image pickup mode according to the user gesture.
13. A control device of an electronic device, wherein the electronic device comprises a first camera, and the method comprises:
the display unit is used for opening the first camera and entering a first camera shooting mode, and the electronic equipment displays a first image acquired by the first camera in the first camera shooting mode;
the recognition unit is used for responding to the trigger operation of a user, carrying out image recognition on the first image and obtaining a user gesture in the first image;
and the switching unit is used for switching the image pickup mode of the electronic equipment from the first image pickup mode to the second image pickup mode according to the user gesture.
14. A computing device, the device comprising a processor and a memory:
the memory is used for storing a computer program;
the processor is configured to perform the method of any of claims 1-12 in accordance with the computer program.
15. A computer-readable storage medium, characterized in that the computer-readable storage medium is used to store a computer program for performing the method of any of claims 1-12.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111437279.6A CN114245005A (en) | 2021-11-29 | 2021-11-29 | Control method and device of electronic equipment and related equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111437279.6A CN114245005A (en) | 2021-11-29 | 2021-11-29 | Control method and device of electronic equipment and related equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114245005A true CN114245005A (en) | 2022-03-25 |
Family
ID=80751975
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111437279.6A Pending CN114245005A (en) | 2021-11-29 | 2021-11-29 | Control method and device of electronic equipment and related equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114245005A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103167230A (en) * | 2011-12-17 | 2013-06-19 | 富泰华工业（深圳）有限公司 | Electronic equipment and method controlling shooting according to gestures thereof |
| US20140192245A1 (en) * | 2013-01-07 | 2014-07-10 | Samsung Electronics Co., Ltd | Method and mobile terminal for implementing preview control |
| CN106231175A (en) * | 2016-07-09 | 2016-12-14 | 东莞市华睿电子科技有限公司 | A kind of method that terminal gesture is taken pictures |
| WO2019071381A1 (en) * | 2017-10-09 | 2019-04-18 | 深圳传音通讯有限公司 | Video recording method, apparatus, and terminal |
| CN111787223A (en) * | 2020-06-30 | 2020-10-16 | 维沃移动通信有限公司 | Video shooting method and device and electronic equipment |
| CN112822388A (en) * | 2019-11-15 | 2021-05-18 | 北京小米移动软件有限公司 | Shooting mode triggering method, device, equipment and storage medium |
| CN113422903A (en) * | 2021-06-16 | 2021-09-21 | 荣耀终端有限公司 | Photographing mode switching method, photographing mode switching apparatus, storage medium, and program product |
-
2021
- 2021-11-29 CN CN202111437279.6A patent/CN114245005A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103167230A (en) * | 2011-12-17 | 2013-06-19 | 富泰华工业（深圳）有限公司 | Electronic equipment and method controlling shooting according to gestures thereof |
| US20140192245A1 (en) * | 2013-01-07 | 2014-07-10 | Samsung Electronics Co., Ltd | Method and mobile terminal for implementing preview control |
| CN106231175A (en) * | 2016-07-09 | 2016-12-14 | 东莞市华睿电子科技有限公司 | A kind of method that terminal gesture is taken pictures |
| WO2019071381A1 (en) * | 2017-10-09 | 2019-04-18 | 深圳传音通讯有限公司 | Video recording method, apparatus, and terminal |
| CN112822388A (en) * | 2019-11-15 | 2021-05-18 | 北京小米移动软件有限公司 | Shooting mode triggering method, device, equipment and storage medium |
| CN111787223A (en) * | 2020-06-30 | 2020-10-16 | 维沃移动通信有限公司 | Video shooting method and device and electronic equipment |
| CN113422903A (en) * | 2021-06-16 | 2021-09-21 | 荣耀终端有限公司 | Photographing mode switching method, photographing mode switching apparatus, storage medium, and program product |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11128802B2 (en) | Photographing method and mobile terminal | |
| WO2020259651A1 (en) | Method for controlling user interface and electronic device | |
| US8760557B2 (en) | User interface for a digital camera | |
| CN107562322B (en) | Page switching method and device | |
| CN112954210B (en) | Photographing method and device, electronic equipment and medium | |
| US9179090B2 (en) | Moving image recording device, control method therefor, and non-transitory computer readable storage medium | |
| JP5645626B2 (en) | Display control apparatus, display control method, program, and storage medium | |
| CN110572575A (en) | camera shooting control method and device | |
| CN112714253B (en) | Video recording method and device, electronic equipment and readable storage medium | |
| EP2887648B1 (en) | Method of performing previewing and electronic device for implementing the same | |
| US20130332884A1 (en) | Display control apparatus and control method thereof | |
| CN112068762A (en) | Interface display method, device, equipment and medium of application program | |
| CN112286362A (en) | Method, system and storage medium for displaying virtual prop in real environment picture | |
| CN109379623A (en) | Video content generation method, device, computer equipment and storage medium | |
| US20220221970A1 (en) | User interface modification | |
| CN113873151A (en) | Video recording method and device and electronic equipment | |
| CN112702517B (en) | Display control method and device and electronic equipment | |
| CN112954209B (en) | Photographing method and device, electronic equipment and medium | |
| CA2807866C (en) | User interface for a digital camera | |
| WO2022257655A1 (en) | Video photographing method and electronic device | |
| CN114245005A (en) | Control method and device of electronic equipment and related equipment | |
| CN112889020A (en) | Interaction method based on screen capture, electronic device and computer readable storage medium | |
| CN114245017A (en) | Shooting method and device and electronic equipment | |
| CN112165584A (en) | Video recording method, video recording device, electronic equipment and readable storage medium | |
| CN112181228A (en) | Display method and device for displaying |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220325 |