CN116156317A

CN116156317A - Camera control method, storage medium, co-processing chip and electronic device

Info

Publication number: CN116156317A
Application number: CN202111355955.5A
Authority: CN
Inventors: 夏清峰
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2021-11-16
Filing date: 2021-11-16
Publication date: 2023-05-23

Abstract

The embodiment of the application discloses a camera control method, a storage medium, a co-processing chip and electronic equipment, wherein the method is applied to an application processing chip, the application processing chip comprises a multimedia service module, and the multimedia service module triggers a camera control instruction according to received control parameters; generating first indication information and second indication information based on a camera control instruction; the multimedia service module carries out hardware configuration and software configuration on a pipeline of a front image signal processor of the co-processing chip according to the first indication information, and configures a camera module; the multimedia service module configures the camera software parameters in the application processing chip according to the second indication information, so that the response speed of the camera can be improved.

Description

Camera control method, storage medium, co-processing chip and electronic device

Technical Field

The application relates to the technical field of electronic equipment, in particular to a camera control method, a storage medium, a co-processing chip and electronic equipment.

Background

With the continuous development of intelligent terminal technology, electronic devices (such as smart phones, tablet computers, etc.) are becoming more and more popular. Most electronic devices are provided with camera modules. The existing camera control scene is that after a software layer of a system detects camera control operation, a message is firstly reported to an upper camera application, then camera software parameters are configured layer by layer from an upper application layer to a lower kernel layer, finally a camera module is driven and controlled by a camera of the kernel layer to shoot, the serial execution process takes longer time, and the response time of the camera is longer.

Disclosure of Invention

The embodiment of the application provides a camera control method, a storage medium, a co-processing chip and electronic equipment, which can improve the response speed of a camera.

In a first aspect, an embodiment of the present application provides a camera control method applied to an application processing chip, where the application processing chip includes a multimedia service module, the method includes:

the multimedia service module triggers a camera control instruction according to the received control parameter;

generating first indication information and second indication information based on the camera control instruction;

the multimedia service module carries out hardware configuration and software configuration on a pipeline of a front image signal processor of the co-processing chip according to the first indication information, and configures a camera module;

and the multimedia service module configures camera software parameters in the application processing chip according to the second indication information.

In a second aspect, embodiments of the present application also provide a computer-readable storage medium having stored thereon a computer program which, when run on a computer, causes the computer to perform a camera control method as provided in any of the embodiments of the present application.

In a third aspect, an embodiment of the present application further provides an application processing chip, where the application processing chip includes a multimedia service module, where the multimedia service module is configured to:

triggering a camera control instruction according to the received control parameter;

according to the first indication information, carrying out hardware configuration and software configuration on a pipeline of a front image signal processor of the co-processing chip, and configuring a camera module;

and configuring camera software parameters in the application processing chip according to the second indication information.

In a fourth aspect, an embodiment of the present application further provides an electronic device, including an application processing chip, a co-processing chip, and a camera module provided in any embodiment of the present application.

According to the technical scheme, the electronic equipment is provided with the application processing chip and the co-processing chip, the application processing chip comprises a multimedia service module, the multimedia service can trigger a camera control instruction according to the received control parameter, and first indication information and second indication information are generated based on the camera control instruction. Then, the multimedia service module carries out hardware configuration and software configuration on a pipeline of a front image signal processor of the co-processing chip according to the first indication information, and configures a camera module; because the first indication information and the second indication information are synchronously generated, the multimedia service module configures camera software parameters in the upper application processing chip according to the second indication information while configuring the lower layer, waiting is not needed, parallel processing of the upper layer software and the lower layer hardware is realized, and the response speed of the camera is improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic flow chart of a camera control method according to an embodiment of the present application.

Fig. 2 is a flow chart of the first indication information and the second indication information in the embodiment of the present application.

Fig. 3 is a second flowchart of a camera control method according to an embodiment of the present application.

Fig. 4 is a schematic diagram of a framework of an application processing chip according to an embodiment of the present application.

Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Fig. 6 is a schematic diagram of a second structure of an electronic device according to an embodiment of the present application.

Fig. 7 is a schematic diagram of a third structure of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It will be apparent that the described embodiments are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by a person skilled in the art without any inventive effort, are intended to be within the scope of the present application based on the embodiments herein.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments.

In the use of electronic equipment, the starting response speed of a camera application is critical to user experience, and the current camera control scene is that after a software layer of a system detects camera control operation, a message is firstly reported to an upper camera application, then camera software parameters are configured layer by layer from an upper application layer to a lower kernel layer, finally a camera module is driven and controlled by a camera of the kernel layer to shoot, the serial execution process takes longer time, and the response time of the camera is longer. With the development of electronic devices, in order to improve the image processing capability of the electronic devices, a co-processing chip is added between the application processing chip and the camera module, and the co-processing chip can be used for performing some preprocessing on the image, such as high-dynamic image synthesis, preview and video effect enhancement. Because of the addition of the co-processing chip, besides the above configuration process, the co-processing chip needs to be configured, which results in a longer response time from the time when the user performs the camera control operation to the time when the camera responds to the operation, and results in a certain delay between the time when the user subjectively senses the trigger of the camera control operation and the time when the camera responds, and poor scene experience such as photographing.

In order to solve this problem, the embodiment of the present application provides a camera control method, which may be applied to an application processing chip, which may be a main processing chip of an electronic device. The application processing chip comprises a multimedia service module.

Referring to fig. 1, fig. 1 is a schematic flow chart of a camera control method according to an embodiment of the present application. The specific flow of the camera control method provided in the embodiment of the present application may be as follows:

101. and triggering a camera control instruction by the multimedia service module according to the received control parameter.

It should be noted that the application processing chip includes an operating system. The operating system may be an android system. The architecture of the android operating system comprises an application layer, a framework layer, a hardware abstraction layer and a kernel layer. The native application programs of the system and the third party application program installed by the user belong to an application layer, the layer is responsible for direct interaction with the user, for example, the camera application program related to the application, the user can start the camera application program through an icon of a camera APP on a desktop, and also can start the camera application program through other preset touch operation, for example, the fingerprint matching control method provided in the foregoing. The framework layer includes application interfaces (e.g., native camera application program interfaces), application services (e.g., native camera services), and framework layer interfaces (e.g., google HAL3 interface) for various native applications. The hardware abstraction layer is an interface layer between the operating system kernel and the hardware circuitry, which aims at abstracting the hardware. Wherein the android hardware abstraction layer comprises a camera hardware abstraction layer. The camera hardware abstract layer is upwards connected with the frame layer interface and downwards connected with the bottom camera driver and hardware. The Camera subsystem mainly contains the various implementations of Camera pipeline components, while the Camera hardware abstraction layer provides the use interface for these components. The android core system service is based on a Linux kernel, wherein the memory management, process management, network protocol stack and driving model of the system all depend on the kernel layer. For example, the kernel layer includes drivers for various hardware that can drive the operation of the various hardware. Such as camera module drivers, pre-image signal processor (pre-Image Signal Processing, pre-ISP) drivers, etc.

The application processing chip of the embodiment of the application provides a lightweight multimedia service (Multi Media Service, MMS) module besides the operating system. In some embodiments, the MMS module may communicate directly with an application layer and a kernel layer of an operating system. In other embodiments, the MMS module may communicate with a framework layer and a hardware abstraction layer in addition to directly with the application layer and the kernel layer of the operating system.

In addition, the MMS module can receive control parameters sent by other hardware and directly trigger a camera control instruction based on the control parameters. Among them, camera control operations include, but are not limited to, turning on a camera and previewing, photographing, recording video, front-back camera switching, and the like.

For example, in some embodiments, the user performs the camera control operations described above through a side physical key of the electronic device. Alternatively, in other embodiments, the user may perform the camera control operation described above through a virtual control of the display interface.

Or in another embodiment, the electronic device further comprises a fingerprint identification chip, and the control parameter is fingerprint data; the multimedia service module triggers a camera control instruction according to the received control parameter, and the method comprises the following steps: the multimedia service module receives first fingerprint data detected by the fingerprint identification chip; determining a target fingerprint area corresponding to the first fingerprint data from a plurality of preset fingerprint areas; when the first fingerprint data is matched with the preset fingerprint data corresponding to the target fingerprint area, determining a camera control instruction corresponding to the target fingerprint area, and triggering the camera control instruction.

The embodiment provides a camera touch control mode based on fingerprint identification. The electronic equipment is provided with a fingerprint identification chip, the fingerprint identification chip can transmit the first fingerprint data detected and collected through the fingerprint collection panel to an MMS module of the application processing chip, and the MMS module matches the received first fingerprint data.

For example, a user first performs fingerprint acquisition and registration, and before the user uses the fingerprint to control the camera, the fingerprint is registered. For example, in the fingerprint registration mode, the multimedia service module receives second fingerprint data transmitted by the fingerprint identification module; determining a preset fingerprint area corresponding to the second fingerprint data; and storing the second fingerprint data as preset fingerprint data corresponding to the preset fingerprint area.

In this embodiment, a complete set of fingerprints is divided into a plurality of regions, and different regions correspond to different control instructions, that is, a one-to-one correspondence between a plurality of preset fingerprint regions and a plurality of camera control instructions is pre-constructed. And then collecting fingerprint data of different areas of the user's finger, and respectively binding the fingerprint data with different camera control instructions. For example, the fingerprint data of the area on the right front side of the thumb corresponds to turning on the camera preview, the fingerprint data of the area on the abdomen of the thumb corresponds to a photographing instruction, the fingerprint data of the area on the left side of the thumb corresponds to a recorded video, and the right side of the thumb corresponds to a switch between front and rear cameras. The thumb is used herein for illustrative purposes only, and the user may choose his fingers based on his habit of use. For example, in other scenarios, a user uses an index finger fingerprint for fingerprint verification. While in order to distinguish between different usage scenarios, the fingerprint of the thumb or other different finger may be used to control the camera's scenario.

Specifically, the user controls the electronic device to enter a related setting interface of the camera software, and triggers a fingerprint registration mode. In the fingerprint registration mode, a user touches the fingerprint acquisition panel on different sides of a finger, the fingerprint identification chip transmits detected second fingerprint data to the MMS module, after receiving the second fingerprint data, the MMS module analyzes the second fingerprint data to determine a preset fingerprint area corresponding to the fingerprint data, and stores the second fingerprint data as preset fingerprint data corresponding to the preset fingerprint area.

In the fingerprint matching stage, the MMS module firstly determines a target fingerprint area corresponding to the first fingerprint data from a plurality of preset fingerprint areas, acquires the preset fingerprint data of the target fingerprint area, detects whether the first fingerprint data are matched with the preset fingerprint data, if so, sends a camera control instruction corresponding to the target fingerprint area, and triggers the camera control instruction.

In another embodiment, the electronic device further comprises a motion sensor, the control parameter being motion data; the multimedia service module receives the motion data sent by the motion sensor and calculates acceleration data of the electronic equipment according to the motion data; and determining a camera control instruction corresponding to the acceleration data, and triggering the camera control instruction.

In this embodiment, a camera control method based on a motion sensor is provided. The motion sensor may be a sensor capable of detecting acceleration of the electronic device, such as an acceleration sensor or a gyroscope. And presetting one-to-one correspondence between different acceleration data and camera control instructions. For example, two consecutive acceleration changes of the camera application in the closed state for a preset period of time correspond to an open camera preview command, two consecutive acceleration changes of the camera application in the open state for a preset period of time correspond to a photographing command, and three acceleration changes of the electronic device correspond to a front-to-rear camera switching command. For example, when the camera application is in a closed state, the user double-clicks the electronic device, the motion data detected by the acceleration sensor is the acceleration change which is rapid twice within the preset duration, and then the camera control instruction corresponding to the acceleration data is determined to be the camera preview starting instruction.

102. The first instruction information and the second instruction information are generated based on the camera control instruction.

After determining the camera control instruction, the MMS module generates first indication information and second indication information based on the camera control instruction. Since the MMS module can communicate directly with the application layer and the kernel layer of the operating system. Accordingly, after the first instruction information and the second instruction information are generated, the configuration of the relevant hardware and the configuration of the relevant software can be performed downward and upward, respectively, based on the connection instruction information in synchronization.

103. And the multimedia service module carries out hardware configuration and software configuration on a pipeline of a front image signal processor of the co-processing chip according to the first indication information, and configures the camera module.

104. The multimedia service module configures camera software parameters in the application processing chip according to the second indication information.

It should be noted that, step 103 and step 104 are not sequential, and after the first indication information and the second indication information are generated, the two steps may be synchronously started to be executed.

Referring to fig. 2, fig. 2 is a flow diagram of the first indication information and the second indication information in the embodiment of the present application. And the MMS module carries out hardware configuration and software configuration on a pipeline of the front image signal processor of the co-processing chip according to the first indication information, and configures the camera module. The co-processing chip and the driving program of the camera module are both positioned in the kernel layer, the operation of the co-processing chip can be controlled through the driving program of the co-processing chip, and the camera module can be controlled through the driving program of the camera. Therefore, in this embodiment, the MMS module sends the first indication information to the kernel layer after generating the first indication information.

In an embodiment, the multimedia service module configures hardware and software for a pipeline of a front image signal processor of the co-processing chip and configures a camera module according to the first indication information, and includes: the multimedia service module sends the first indication information to the kernel layer, so that the kernel layer carries out hardware configuration and software configuration on a pipeline of a front image signal processor of the co-processing chip through a co-processing chip driver, and configures a camera module through a camera driver.

The configuration of the camera module by the kernel layer through the camera driver comprises starting the camera, configuring camera parameters and the like, and after the configuration is completed, the camera module can expose and output original image data. The co-processing chip comprises a front image signal processor, and the original image data output by the camera module is firstly sent to the front image signal processor for preprocessing to obtain a preprocessed image. And then the preprocessing image is sent to an application processing chip, and the application processing chip performs post-processing. Therefore, the configuration of the camera module is also performed, and the configuration of the two hardware can be started synchronously. The pre-image processor includes a pipeline (pipeline) implemented with support of associated software and hardware. Therefore, the driver of the co-processing chip of the kernel layer can perform hardware configuration and software configuration on the pipeline of the front image signal processor of the co-processing chip according to the received first indication information, and the front image signal processor after configuration can process the received original image data.

Meanwhile, the multimedia service module sends the second indication information to the application layer, so that the application layer configures camera parameters in the application processing chip. For a camera (camera) frame of an android system, for different operation modes, such as previewing, video recording, continuing photographing, etc., when corresponding operations are performed, the camera system performs layer-by-layer configuration from top to bottom according to a pipeline defined by a protocol defined by the frame, where a portion related to an application processing chip includes configuration of some parameters of a camera photographing and a subsequent image processing process, for example: focusing, exposure, noise reduction, contrast, sharpening, resolution, pixel format, 3A modeling, RAW to YUV processing control, and the like. Wherein, the RAW is an image format, and the RAW image is the original data of the image sensor for converting the captured light source signal into a digital signal, which is an unprocessed and uncompressed format. YUV is an image format in which chromaticity and luminance are separately represented, where Y is a luminance signal and U and V are chromaticity signals. The multimedia service module sends the second indication information to the application layer, then the application layer, the framework layer and the camera hardware abstraction layer are configured layer by layer.

It can be understood that, for different camera control instructions, the specific content of the configuration indicated by the first indication information and the second indication information is different, so that the configured hardware or software can support the response of the corresponding camera control instruction.

Wherein, in some embodiments, the method further comprises: after the configuration of the front image signal processor is completed, the first interface is controlled to be switched from the off state to the on state, so that the co-processing chip receives the original image data output by the camera module.

In this embodiment, the camera module includes a first interface, and the co-processing chip includes a second interface, where the first interface is connected to the second interface. The first interface and the second interface are of the same type, and both the first interface and the second interface can be mobile industry processor interfaces (Mobile Industry Processor Interface, MIPI). The original image data collected by the camera module is transmitted to the co-processing chip through the first interface and the second interface. However, before the configuration of the front image signal processor is completed, even if the original image data transmitted by the camera module is received, the original image data cannot be processed timely, so as to avoid delay of data processing caused by buffering excessive original image data in the co-processing chip before the configuration of the front image signal processor is completed, after the camera is started, the first interface is set to be in a closed state, and after the configuration of the front image signal processor is completed, the first interface is controlled to be switched from the closed state to an open state, so that the co-processing chip receives the original image data output by the camera module.

In particular, the present application is not limited by the order of execution of the steps described, and certain steps may be performed in other orders or concurrently without conflict.

As can be seen from the foregoing, in the camera control method provided by the embodiment of the present application, the electronic device is provided with an application processing chip and a co-processing chip, where the application processing chip includes a multimedia service module, and the multimedia service may trigger a camera control instruction according to the received control parameter, and generate first indication information and second indication information based on the camera control instruction. Then, the multimedia service module carries out hardware configuration and software configuration on a pipeline of a front image signal processor of the co-processing chip according to the first indication information, and configures a camera module; because the first indication information and the second indication information are synchronously generated, the multimedia service module configures camera software parameters in the upper application processing chip according to the second indication information while configuring the lower layer, waiting is not needed, parallel processing of the upper layer software and the lower layer hardware is realized, and the response speed of the camera is improved.

The method described in the previous examples is described in further detail below by way of example.

Referring to fig. 3, fig. 3 is a second flow chart of a camera control method according to an embodiment of the invention. The method is applied to electronic equipment, and the electronic equipment comprises an application processing chip, a camera module, a co-processing chip and a fingerprint identification chip, wherein the co-processing chip comprises a front image signal processor, and the application processing chip comprises a multimedia service module. The method comprises the following steps:

201. the fingerprint identification chip sends the detected first fingerprint data to the multimedia service module.

The embodiment provides a camera touch control mode based on fingerprint identification. The electronic equipment is provided with a fingerprint identification chip, the fingerprint identification chip can transmit the first fingerprint data detected and collected through the fingerprint collection panel to the multimedia service module of the application processing chip, and the multimedia service module matches the received first fingerprint data. Wherein the fingerprint is registered before the user uses the fingerprint to control the camera. For example, the user collects fingerprint data of different areas of the finger according to his own usage habit, and binds the plurality of fingerprint data with different camera control instructions, respectively.

202. The multimedia service module determines a target fingerprint area corresponding to the first fingerprint data from a plurality of preset fingerprint areas.

203. When the first fingerprint data is matched with the preset fingerprint data corresponding to the target fingerprint area, the multimedia service module determines a camera control instruction corresponding to the target fingerprint area and triggers the camera control instruction.

In the fingerprint matching stage, the multimedia service module firstly determines a target fingerprint area corresponding to first fingerprint data from a plurality of preset fingerprint areas, acquires preset fingerprint data of the target fingerprint area, detects whether the first fingerprint data is matched with the preset fingerprint data, if so, a camera control instruction corresponding to the target fingerprint area is triggered, and the camera control instruction is triggered.

204. The multimedia service module generates first indication information and second indication information based on the camera control instruction.

After determining the camera control instruction, the multimedia service module generates first indication information and second indication information based on the camera control instruction. Since the multimedia service module can communicate directly with the application layer and the kernel layer of the operating system. Accordingly, after the first instruction information and the second instruction information are generated, the configuration of the relevant hardware and the configuration of the relevant software can be performed downward and upward, respectively, based on the connection instruction information in synchronization.

205. The multimedia service module sends the first indication information to the kernel layer, so that the kernel layer carries out hardware configuration and software configuration on a pipeline of a front image signal processor of the co-processing chip through a co-processing chip driver, and configures a camera module through a camera driver.

206. The multimedia service module sends the second indication information to the application layer, so that the application layer configures camera parameters in the application processing chip.

It should be noted that, step 205 and step 206 are not sequential, and after the first indication information and the second indication information are generated, the two steps may be started to be performed synchronously.

The configuration of the camera module by the kernel layer through the camera driver comprises starting the camera, configuring camera parameters and the like, and after the configuration is completed, the camera module can expose and output original image data. The co-processing chip comprises a front image signal processor, and the original image data output by the camera module is firstly sent to the front image signal processor for preprocessing to obtain a preprocessed image. And then the preprocessing image is sent to an application processing chip, and the application processing chip performs post-processing. Therefore, the configuration of the camera module is also performed, and the configuration of the two hardware can be started synchronously. The pre-image processor includes a pipeline (pipeline) implemented with support of associated software and hardware. Therefore, the driver of the co-processing chip of the kernel layer can perform hardware configuration and software configuration on the pipeline of the front image signal processor of the co-processing chip according to the received first indication information, and the front image signal processor after configuration can process the received original image data. Meanwhile, the multimedia service module sends the second indication information to the application layer, so that the application layer configures camera parameters in the application processing chip.

As can be seen from the above, when fingerprint data is detected, the camera control method provided by the embodiment of the invention determines the camera control instruction through the target fingerprint area corresponding to the fingerprint data, and the control mode improves the convenience of camera control operation, especially for a large-screen mobile phone, no matter a user holds the mobile phone with both hands or one hand to take a picture, the camera control method can conveniently carry out touch control on the fingerprint area, and improves the convenience compared with the existing mode of clicking related controls on the mobile phone screen. And only the finger is required to be placed in the fingerprint identification area, pressing or clicking is not required, and the shaking condition of the mobile phone during photographing can be relieved.

In addition, after the camera control instruction is determined, a lightweight multimedia service module generates a first indication signal and a second indication signal according to the camera control instruction, synchronously sends the first indication signal to a lower kernel layer and sends the second indication signal to an upper application layer, so that parallel processing of upper software and lower hardware is realized, and compared with the serial starting and configuration mode of the existing camera, the configuration speed of the camera is improved, and the response speed of the camera is further improved.

A camera control apparatus is also provided in an embodiment. The camera control device is applied to an application processing chip of electronic equipment, and comprises an instruction triggering module, an information generating module, a first configuration module and a second configuration module, wherein the camera control device comprises the following components:

the instruction triggering module is used for triggering a camera control instruction according to the received control parameter;

the information generation module is used for generating first indication information and second indication information based on the camera control instruction;

the first configuration module is used for carrying out hardware configuration and software configuration on a pipeline of a front image signal processor of the co-processing chip according to the first indication information, and configuring a camera module;

and the second configuration module is used for configuring the camera software parameters in the application processing chip according to the second indication information.

It should be noted that, the camera control apparatus provided in the embodiment of the present application and the camera control method in the above embodiment belong to the same concept, and any method provided in the embodiment of the camera control method may be implemented by using the camera control apparatus, and detailed implementation processes of the method are shown in the embodiment of the camera control method, which is not repeated herein.

As can be seen from the above, in the camera control device provided in the embodiment of the present application, the electronic device is provided with an application processing chip and a co-processing chip, and the application processing chip includes a multimedia service module, where the multimedia service may trigger a camera control instruction according to a received control parameter, and generate first indication information and second indication information based on the camera control instruction. Then, the multimedia service module carries out hardware configuration and software configuration on a pipeline of a front image signal processor of the co-processing chip according to the first indication information, and configures a camera module; because the first indication information and the second indication information are synchronously generated, the multimedia service module configures camera software parameters in the upper application processing chip according to the second indication information while configuring the lower layer, waiting is not needed, parallel processing of the upper layer software and the lower layer hardware is realized, and the response speed of the camera is improved.

Referring to fig. 4, fig. 4 is a schematic diagram of a frame of an application processing chip 300 according to an embodiment of the present application. The application processing chip includes an operating system 310 and a multimedia service module 320, the multimedia service module 320 being configured to:

In some embodiments, the electronic device further includes a fingerprint identification chip, and the control parameter is fingerprint data; the multimedia service module 320 is configured to:

receiving first fingerprint data detected by the fingerprint identification chip;

determining a target fingerprint area corresponding to the first fingerprint data from a plurality of preset fingerprint areas;

and when the first fingerprint data is matched with the preset fingerprint data corresponding to the target fingerprint area, determining a camera control instruction corresponding to the target fingerprint area, and triggering the camera control instruction.

In some embodiments, the multimedia service module 320 is configured to:

in a fingerprint registration mode, the multimedia service module receives second fingerprint data transmitted by the fingerprint identification module;

Determining a preset fingerprint area corresponding to the second fingerprint data;

and storing the second fingerprint data as preset fingerprint data corresponding to the preset fingerprint area.

In some embodiments, the electronic device further comprises a motion sensor, the control parameter is motion data; the multimedia service module 320 is configured to:

receiving motion data sent by the motion sensor, and calculating acceleration data of the electronic equipment according to the motion data;

and determining a camera control instruction corresponding to the acceleration data, and triggering the camera control instruction.

In some embodiments, the application processing chip further comprises an operating system, the operating system comprising a kernel layer; the multimedia service module 320 is configured to:

and sending the first indication information to the kernel layer, so that the kernel layer carries out hardware configuration and software configuration on a pipeline of a front image signal processor of the co-processing chip through a co-processing chip driver, and carries out configuration on the camera module through a camera driver.

In some embodiments, the application processing chip further comprises an operating system, the operating system further comprising an application layer; the multimedia service module 320 is configured to:

And sending the second indication information to the application layer, so that the application layer configures camera parameters in the application processing chip.

In some embodiments, the camera module comprises a first interface, the co-processing chip comprises a second interface, and the first interface is connected with the second interface; the multimedia service module 320 is configured to:

after the configuration of the front image signal processor is finished, the first interface is controlled to be switched from a closed state to an open state, so that the co-processing chip receives the original image data output by the camera module.

The embodiment of the application also provides electronic equipment. The electronic device may be a smart phone, a smart watch, a tablet computer, a game device, an AR (Augmented Reality ) device, a video playing device, a notebook computer, a desktop computing device, or a wearable electronic device such as an electronic helmet or an electronic glasses.

Referring to fig. 5, fig. 5 is a schematic diagram of a first structure of an electronic device according to an embodiment of the present application. The electronic device 1000 includes an application processing chip 300, a co-processing chip 200, and a camera module 100 according to the embodiments of the present application.

The application processing chip 300 includes a processor 301 and a memory 302. The processor 301 is electrically connected to the memory 302.

The processor 301 is a control center of the application processing chip 300, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or calling computer programs stored in the memory 302 and calling data stored in the memory 302, thereby performing overall monitoring of the electronic device.

Memory 302 may be used to store computer programs and data. The memory 302 stores computer programs that include instructions that are executable in a processor. The computer program may constitute various functional modules. The processor 301 executes various functional applications and data processing by calling a computer program stored in the memory 302.

In this embodiment, the processor 301 in the application processing chip 300 loads instructions corresponding to the processes of one or more computer programs into the memory 302 according to the following steps, and the processor 301 executes the computer programs stored in the memory 302, so as to implement various functions:

In some embodiments, referring to fig. 6, fig. 6 is a schematic diagram of a second structure of an electronic device according to an embodiment of the present application. The electronic device 1000 further comprises a fingerprint recognition chip 400. The fingerprint recognition chip 400 is used for detecting first fingerprint data and transmitting the detected first fingerprint data to the multimedia service module 320 of the application processing chip 300.

The multimedia service module 320 is further configured to: receiving first fingerprint data detected by the fingerprint identification chip;

In some embodiments, referring to fig. 7, fig. 7 is a schematic diagram of a third structure of an electronic device according to an embodiment of the present application. The electronic device further comprises a radio frequency circuit 1003, a display 1004, a control circuit 1005, an input unit 1006, an audio circuit 1007, a sensor 1008, and a power supply 1009. The application processing chip 10000 and the co-processing chip 200 are electrically connected to the radio frequency circuit 1003, the display 1004, the control circuit 1005, the input unit 1006, the audio circuit 1007, the sensor 1008, and the power supply 1009, respectively.

The radio frequency circuit 1003 is configured to receive and transmit radio frequency signals for communication with a network device or other electronic device via wireless communication.

The display 1004 may be used to display information entered by or provided to a user as well as various graphical user interfaces of an electronic device, which may be composed of images, text, icons, video, and any combination thereof.

The control circuit 1005 is electrically connected to the display 1004, and is used for controlling the display 1004 to display information.

The input unit 1006 may be used to receive input numbers, character information, or user characteristic information (e.g., a fingerprint), and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control. The input unit 1006 may include a fingerprint recognition module.

The audio circuit 1007 may provide an audio interface between the user and the electronic device through a speaker, microphone. Wherein the audio circuit 1007 includes a microphone. The microphone is electrically connected to the processor 301. The microphone is used for receiving voice information input by a user.

The sensor 1008 is used to collect external environmental information. The sensor 1008 may include one or more of an ambient brightness sensor, an acceleration sensor, a gyroscope, and the like.

The power supply 1009 is used to supply power to the various components of the electronic device 1000. In some embodiments, the power supply 1009 may be logically connected to the processor 301 through a power management system, so as to perform functions of managing charging, discharging, and power consumption management through the power management system.

Although not shown in the drawings, the electronic device 1000 may further include a camera, a bluetooth module, etc., which will not be described herein.

In this embodiment, the processor 301 of the application processing chip 300 loads instructions corresponding to the processes of one or more computer programs into the memory 302 according to the following steps, and the processor 301 executes the computer programs stored in the memory 3022, thereby implementing various functions:

As can be seen from the foregoing, the embodiment of the present application provides an electronic device, which is provided with an application processing chip and a co-processing chip, where the application processing chip includes a multimedia service module, and the multimedia service may trigger a camera control instruction according to a received control parameter, and generate first indication information and second indication information based on the camera control instruction. Then, the multimedia service module carries out hardware configuration and software configuration on a pipeline of a front image signal processor of the co-processing chip according to the first indication information, and configures a camera module; because the first indication information and the second indication information are synchronously generated, the multimedia service module configures camera software parameters in the upper application processing chip according to the second indication information while configuring the lower layer, waiting is not needed, parallel processing of the upper layer software and the lower layer hardware is realized, and the response speed of the camera is improved.

The embodiment of the application further provides a computer readable storage medium, in which a computer program is stored, and when the computer program runs on a computer, the computer executes the camera control method according to any one of the embodiments.

It should be noted that, those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments may be implemented by a computer program, which may be stored in a computer readable storage medium, and the computer readable storage medium may include, but is not limited to: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like.

Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or modules is not limited to the particular steps or modules listed and certain embodiments may include additional steps or modules not listed or inherent to such process, method, article, or apparatus.

The camera control method, the storage medium, the co-processing chip and the electronic device provided by the embodiment of the application are described in detail above. The principles and embodiments of the present application are described herein with specific examples, the above examples being provided only to assist in understanding the methods of the present application and their core ideas; meanwhile, those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, and the present description should not be construed as limiting the present application in view of the above.

Claims

1. A camera control method, applied to an application processing chip, the application processing chip including a multimedia service module, the method comprising:

2. The method of claim 1, wherein the control parameter is fingerprint data; the multimedia service module triggers a camera control instruction according to the received control parameter, and the method comprises the following steps:

the multimedia service module receives first fingerprint data detected by the fingerprint identification chip;

3. The method of claim 2, wherein the method further comprises:

in a fingerprint registration mode, the multimedia service module receives second fingerprint data transmitted by the fingerprint identification chip;

4. The method of claim 1, wherein the control parameter is motion data; the multimedia service module triggers a camera control instruction according to the received control parameter, and the method comprises the following steps:

The multimedia service module receives motion data sent by a motion sensor and calculates acceleration data of the electronic equipment according to the motion data;

5. The method of claim 1, wherein the application processing chip further comprises an operating system, the operating system comprising a kernel layer; the multimedia service module configures hardware and software for a pipeline of a front image signal processor of the co-processing chip according to the first indication information, configures a camera module, and comprises:

the multimedia service module sends the first indication information to the kernel layer, so that the kernel layer carries out hardware configuration and software configuration on a pipeline of a front image signal processor of a co-processing chip through a co-processing chip driver, and configures the camera module through a camera driver.

6. The method of claim 5, wherein the application processing chip further comprises an operating system, the operating system further comprising an application layer; the multimedia service module configures camera software parameters in the application processing chip according to the second indication information, and the method comprises the following steps:

And the multimedia service module sends the second indication information to the application layer, so that the application layer configures camera parameters in the application processing chip.

7. The method of any one of claims 1 to 6, wherein the camera module comprises a first interface, the co-processing chip comprises a second interface, and the first interface is connected with the second interface; the method further comprises the steps of:

8. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when run on a computer, causes the computer to execute the camera control method according to any one of claims 1 to 7.

9. An application processing chip, wherein the application processing chip comprises a multimedia service module for:

10. An electronic device comprising the application processing chip of claim 9, and a co-processing chip and a camera module.