WO2023124007A1

WO2023124007A1 - Linux-based camera control method and apparatus, and device and storage medium

Info

Publication number: WO2023124007A1
Application number: PCT/CN2022/105146
Authority: WO
Inventors: 张兴涛
Original assignee: 北京字节跳动网络技术有限公司
Priority date: 2021-12-29
Filing date: 2022-07-12
Publication date: 2023-07-06
Also published as: CN113986368A

Abstract

Provided in the present disclosure are a Linux-based camera control method and apparatus, and a device and a storage medium. The method comprises: receiving, by means of a multimedia service, a camera control instruction, which is sent by an application program in a Linux system; and controlling, on the basis of a camera source plug-in, a camera to execute an operation corresponding to the camera control instruction, and returning an execution result of the camera to the application program by means of the camera source plug-in.

Description

Camera control method, device, equipment and storage medium based on Linux

This application claims priority to a Chinese patent application with application number 202111628449.9 filed with the China Patent Office on December 29, 2021, the entire contents of which are incorporated herein by reference.

technical field

The present disclosure relates to the field of computer technology, for example, to a Linux-based camera control method, device, device, and storage medium.

Background technique

The Linux system is a set of Unix-like operating systems that are free to use and spread freely. The system has been widely used. In addition, the Android system is currently the operating system with the highest proportion in the mobile terminal market, and has an excellent ecological environment in the field of mobile terminals.

Currently, on Linux-based operating systems, most camera devices are driven by v4l2. However, in the case that the camera device manufacturer does not provide the v4l2 driver but only provides the Android camera driver, the application program on the Linux side cannot directly use the camera device. Therefore, in the case that only the Android camera driver exists, how to use the camera device on the Linux side is an important issue that the industry needs to solve urgently.

Contents of the invention

The present disclosure provides a Linux-based camera control method, device, device, and storage medium to avoid the situation that the application program on the Linux side cannot use the camera device when there is only an Android camera driver in the related art, and to realize the Linux-side camera control method. The application is able to use the camera device.

The present disclosure provides a Linux-based camera control method applied to a Linux system, the method comprising:

Receive a camera control instruction sent by an application program in the Linux system through a multimedia service;

Based on the camera source plug-in, the camera is controlled to execute the operation corresponding to the camera control instruction, and the execution result of the camera is returned to the application program through the camera source plug-in.

The present disclosure also provides a Linux-based camera control device, including:

The receiving module is configured to receive the camera control instruction sent by the application program in the Linux system through the multimedia service;

The control module is configured to control the camera to execute the operation corresponding to the camera control instruction based on the camera source plug-in, and return the execution result of the camera to the application program through the camera source plug-in.

The present disclosure also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and operable on the processor. When the processor executes the program, it implements any one of the above-mentioned Linux-based Steps of a camera control method.

The present disclosure also provides a non-transitory computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of any one of the Linux-based camera control methods described above are implemented.

Description of drawings

FIG. 1 is one of the flow diagrams of a Linux-based camera control method provided by the present disclosure;

FIG. 2 is one of the architecture schematic diagrams of the Linux-based camera control method provided by the present disclosure;

FIG. 3 is the second schematic flow diagram of the Linux-based camera control method provided by the present disclosure;

FIG. 4 is the second schematic diagram of the architecture of the Linux-based camera control method provided by the present disclosure;

FIG. 5 is a structural diagram of a Linux-based camera control device provided by the present disclosure;

FIG. 6 is a schematic structural diagram of an electronic device provided by the present disclosure.

Detailed ways

In related technologies, on the operating system based on the Linux kernel, most camera devices are driven by v4l2. However, when the camera device manufacturer does not provide the v4l2 driver and only provides the Android camera driver, the application program on the Linux side cannot directly drive camera equipment.

This application presents the following examples. In order to facilitate understanding of the following embodiments, the application scenarios of the present disclosure are described below with examples.

For example, the Linux system is installed in the terminal device, that is, the operating system of the terminal device is an operating system based on the Linux kernel. At the same time, any application program (APP) is installed in the terminal device, and the application program needs to use a camera, which can only be controlled through the Android camera driver. Wherein, the terminal device may be a mobile phone, a tablet computer, a notebook computer, a desktop computer, a server, an embedded system, etc., which are not specifically limited here.

The present disclosure provides a Linux-based camera control method applied to a Linux system. FIG. 1 is one of the flow diagrams of the Linux-based camera control method provided by the present disclosure. As shown in FIG. 1 , the Linux-based camera control method provided by the present disclosure includes the following steps 110-120:

Step 110, through the multimedia service, receive the camera control instruction sent by the application program in the Linux system.

Wherein, the multimedia service is a multimedia framework in the Linux system, which is used for the operation of the application programs in the Linux system, that is, it is a multimedia service process of the Linux system. In addition, the multimedia service is located in the user space of the Linux system.

Here, the multimedia service is an extensible multimedia framework, which supports plugin (plug-in) extension.

In one embodiment, the multimedia service is the GStreamer multimedia framework. The GStreamer multimedia framework supports plug-in extensions, for example, a GStreamer source plugin (camera source plugin) can be implemented.

In another embodiment, the multimedia service is the QtMulimedia multimedia framework. The QtMultimedia multimedia framework supports plug-in extensions, for example, a QtMultimedia Camera Backend plug-in (camera source plug-in) can be implemented.

In one embodiment, before the above step 110, the Linux-based camera control method also includes:

After the Linux system is started, start the multimedia service.

Wherein, the camera control instructions include but not limited to: instructions for turning on the camera, instructions for turning off the camera, instructions for previewing the camera, instructions for shooting the camera, instructions for recording the camera, and instructions for setting camera parameters.

Step 120, based on the camera source plug-in, control the camera to execute the operation corresponding to the camera control instruction, and return the execution result of the camera to the application program through the camera source plug-in.

Wherein, the camera source plug-in is loaded through the multimedia service. The camera source plug-in is a plug-in obtained by extending the multimedia service. The camera source plugin resides in userspace on Linux.

It should be noted that the camera source plug-in is set to create a communication pipe so that applications in the Linux system can access the camera device through the multimedia service. The communication channel may be a pipeline.

Wherein, the execution result includes a control result and a data transmission result, and the data transmission result includes but not limited to: image data, video data and camera configuration parameters. For example, the execution results include, but are not limited to: the execution results of the camera opening instruction, the camera closing instruction execution result, the camera preview instruction execution result, the camera shooting instruction execution result, the camera video recording instruction execution result and the camera parameter setting instruction execution result Results and so on.

Here, the execution result of the command to turn on the camera includes an indication of successful opening of the camera or an indication of failure to turn on the camera. The execution result of the instruction to close the camera includes an indication of successful closing of the camera or an indication of failure of closing the camera. The execution result of the camera preview instruction includes the image data captured by the camera in real time and the camera preview success flag or the camera preview failure flag. The execution result of the camera shooting instruction includes the image data obtained by the camera shooting and the camera shooting success flag or the camera shooting failure flag. The execution result of the camera video recording command includes the video data obtained by the camera video recording and the camera video recording success flag or the camera video recording failure flag. The execution result of the camera parameter setting instruction includes an indication that the camera parameter setting is successful or an indication that the camera parameter setting is failed.

In one embodiment, if the camera control instruction is an instruction to turn on the camera, the camera is controlled to turn on, and the execution result of whether the camera is turned on successfully is returned to the application program through the camera source plug-in.

For example, if the camera control instruction is an instruction to turn on the camera, the camera is controlled to turn on, and the flag of successful opening of the camera or the flag of failure of the camera to be turned on is returned to the application through the camera source plug-in.

In another embodiment, if the camera control command is a camera close command, the camera is controlled to close, and the execution result of whether the camera closes successfully is returned to the application program through the camera source plug-in.

For example, if the camera control command is a camera close command, the camera is controlled to close, and the camera close success mark or camera close failure mark is returned to the application through the camera source plug-in.

In another embodiment, if the camera control command is a camera preview command, the camera is controlled to perform a preview operation, and the image data captured by the camera in real time and the success of the camera preview are returned to the application through the camera source plug-in, or the camera preview fails The identity is returned to the application through the camera feed plugin.

For example, if the camera control command is a camera preview command, and the camera preview command is a camera start preview command, control the camera to perform a preview operation, return the image data captured by the camera in real time to the application program through the camera source plug-in, and mark the success of the camera preview Return to the application program through the camera source plug-in, or return the camera preview failure flag (camera start preview failure flag) to the application program through the camera source plug-in; if the camera control command is a camera preview command, and the camera preview command is a camera stop preview command , control the camera to stop the preview operation, that is, stop the transmission of real-time data, and at the same time, return the camera preview success mark (camera stop preview success mark) to the application through the camera source plug-in, or mark the camera preview failure (camera stop preview failure mark) Return to the application through the camera feed plugin.

In another embodiment, if the camera control instruction is a camera shooting instruction, the camera is controlled to perform a shooting operation, and the image data captured by the camera is returned to the application program through the camera source plug-in and the camera shooting success is marked, or the camera shooting failure is marked Return to the application through the camera feed plugin.

For example, if the camera control command is a camera shooting command, control the camera to perform shooting operations, return the image data captured by the camera to the application program through the camera source plug-in, and return the camera shooting success flag to the application program through the camera source plug-in, or, Return the camera capture failure flag to the application through the camera source plug-in.

In another embodiment, if the camera control command is a camera video recording command, the camera is controlled to perform a video recording operation, and the video data obtained by the camera video recording and the successful camera video recording are returned to the application program through the camera source plug-in, or the camera video recording failure is marked Return to the application through the camera feed plugin.

For example, if the camera control command is a camera recording command, and the camera recording command is a camera start recording command, the camera is controlled to perform a recording operation, and the video data stream is returned to the application through the camera source plug-in, or the camera recording failure flag is passed through the camera source The plug-in returns to the application program; if the camera control command is a camera recording command, and the camera recording command is a camera stop recording command, control the camera to stop recording, that is, stop transmitting the recording data stream, and at the same time, return the successful identification of the camera recording to the application through the camera source plug-in The program, or, return the camera recording failure flag to the application program through the camera source plug-in.

In another embodiment, if the camera control instruction is a camera parameter setting instruction, the camera is controlled to configure the camera parameters indicated by the camera parameter setting instruction, and the execution result of whether the parameter configuration is successful is returned to the application program through the camera source plug-in.

For example, if the camera control instruction is a camera parameter setting instruction, the camera is controlled to configure the camera parameters indicated by the camera parameter setting instruction, and the camera parameter setting success flag or the camera parameter setting failure flag is returned to the application through the camera source plug-in.

In an embodiment, the returning the execution result of the camera to the application through the camera source plug-in includes:

Return the execution result of the camera to the Android camera service; return the execution result to the Camera Client library; forward the execution result from the Camera Client library to the multimedia service through the camera source plug-in; return the execution result from the multimedia service to the application.

Embodiments of the present disclosure will be described by way of example for easy understanding. When the application program uses the camera in the Linux system, the application program generates a camera control command, and then receives the camera control command sent by the application program through the multimedia service, and then forwards the camera control command from the multimedia service to the Camera Client through the camera source plug-in Library, to control the camera to execute the operation corresponding to the camera control command through the interface of the Camera Client library and the Android camera service, and then return the execution result of the camera to the camera driver and the Android camera service; through the Camera Client library to connect with the Android camera service The interface forwards the execution result from the Android camera service to the Camera Client library; through the camera source plug-in, the execution result is returned from the Camera Client library to the multimedia service, and the execution result is returned from the multimedia service to the application. In addition, create an Android container and deploy the Android camera service to the Android container. Can refer to Fig. 2, in Fig. 2 the embodiment of the present disclosure is divided into layers, application program, multimedia service, camera source plug-in, Camera Client storehouse, Android container belong to the user space layer, camera driver (Camera Driver) belongs to the kernel layer, The camera belongs to the hardware layer.

According to the Linux-based camera control method according to the embodiment of the present disclosure, the method is applied to the Linux system, and receives the camera control command sent by the application program in the Linux system through the multimedia service; based on the camera source plug-in, the camera is controlled to perform the operation corresponding to the camera control command , and return the execution result of the camera to the application through the camera source plug-in. Through the above method, the embodiment of the present disclosure receives the camera control command sent by the application program through the multimedia service, and uses the camera based on the camera source plug-in, so that the application program can use the camera, so that when only the Android camera driver exists, the application program Programs can use the camera to enable applications on the Linux side to use the camera device.

For example, based on the above embodiments, another embodiment of the Linux-based camera control method of the present disclosure is proposed. As shown in FIG. 3, in the above step 120, based on the camera source plug-in, the camera is controlled to perform the operation corresponding to the camera control instruction, including the following steps 121-122:

Step 121, forward the camera control command from the multimedia service to the Camera Client library based on the camera source plug-in.

Step 122, through the Camera Client library, control the camera to execute the operation corresponding to the camera control instruction.

Wherein, the camera source plug-in is loaded and called through the multimedia service. The camera source plug-in is a plug-in obtained by extending the multimedia service. The camera source plugin resides in userspace on Linux.

It should be noted that the camera source plugin is set up to create a communication pipe so that applications in the Linux system can access the camera device through multimedia services. The communication channel may be a pipeline.

For example, if the camera control command is a command to turn on the camera, the command to turn on the camera is forwarded from the multimedia service to the Camera Client library, so that the Camera Client library controls the camera to perform the operation corresponding to the command to turn on the camera.

For example, if the camera control command is a camera close command, the camera close command is forwarded from the multimedia service to the Camera Client library, so that the Camera Client library controls the camera to perform the operation corresponding to the camera close command.

For example, if the camera control instruction is a camera preview instruction, the camera preview instruction is forwarded from the multimedia service to the Camera Client library, so that the Camera Client library controls the camera to perform the operation corresponding to the camera preview instruction.

For example, if the camera control instruction is a camera shooting instruction, the camera shooting instruction is forwarded from the multimedia service to the Camera Client library, so that the Camera Client library controls the camera to perform the operation corresponding to the camera shooting instruction.

For example, if the camera control command is a camera recording command, the camera recording command is forwarded from the multimedia service to the Camera Client library, so that the Camera Client library controls the camera to perform the operation corresponding to the camera recording command.

For example, if the camera control instruction is a camera parameter setting instruction, the camera parameter setting instruction is forwarded from the multimedia service to the Camera Client library, so that the Camera Client library controls the camera to perform the operation corresponding to the camera parameter setting instruction.

In one embodiment, the Linux system includes a user space layer; the user space layer includes the application program, the multimedia service, the camera source plug-in, and the Camera Client library.

In one embodiment, the above step 121 includes:

Step 1211, based on the camera source plug-in, determine the communication channel corresponding to the camera control command.

Step 1213, forward the camera control instruction from the multimedia service to the Camera Client library through the communication channel, and call the interface corresponding to the camera control instruction in the Camera Client library.

Wherein, the communication channel is created by the camera source plug-in, and the communication channel is used to enable the application program of the Linux system to access the camera device through the multimedia service. The communication channel may be a pipeline. For example, use GStreamer's v4l2src camera source plugin to create a pipeline to access camera hardware devices.

Among them, the Camera Client library includes interfaces corresponding to multiple camera control commands, including various camera operation application programming interfaces (Application Programming Interface, API), for example, including preview API, shooting API, video recording API, parameter setting API, etc. .

In one embodiment, the Camera Client library communicates with the Android camera service through an inter-process communication channel.

Wherein, the inter-process communication channel can realize data transmission and information transmission between processes. For example, the inter-process communication channel realizes the transmission of control instructions and processing data between the Camera Client library and the Android camera service, that is, it is used to complete the interface (API) docking between the Camera Client library and the Android camera service. The processed data includes, but is not limited to: image data, video data, camera configuration parameters, and the like.

Inter-Process Communication (IPC) provides a variety of inter-process communication methods, such as binder, socket (socket), shared memory (shared memory), etc.

For example, the Camera Client library communicates with the Android camera service through an IPC channel.

In one embodiment, the Camera Client library communicates with the Android camera service through a binder. For example, the Camera Client library communicates with the Android camera service through libgbinder, which is a linux implementation of binder.

In another embodiment, the Camera Client library communicates with the Android camera service through sockets.

In another embodiment, the Camera Client library communicates with the Android camera service through shared memory.

For example, create an Android container and deploy the Android camera service to the Android container. Refer to FIG. 2 , which will not be repeated here.

It can be understood that the communication between the Camera Client library and the Android camera service is realized by using the inter-process communication channel, so that the interface corresponding to the camera control command in the Camera Client library can be connected with the interface corresponding to the camera control command in the Android camera service, so that Enables data communication between Linux and Android so that applications can use the camera when only the Android camera driver exists.

Based on the above-mentioned embodiment, the above-mentioned step 122 includes:

Step 1221, connect the interface corresponding to the camera control command in the Camera Client library with the interface corresponding to the camera control command in the Android camera service.

Step 1222: Control the camera to execute the operation corresponding to the camera control instruction based on the docking interface.

In one embodiment, the preview interface corresponding to the camera preview command in the Camera Client library is connected with the preview interface corresponding to the camera preview command in the Android camera service.

In one embodiment, the shooting interface corresponding to the camera shooting command in the Camera Client library is connected with the shooting interface corresponding to the camera shooting command in the Android camera service.

In one embodiment, the video recording interface corresponding to the camera video recording command in the Camera Client library is connected with the video recording interface corresponding to the camera video recording command in the Android camera service.

In one embodiment, the parameter setting interface corresponding to the camera parameter setting instruction in the Camera Client library is connected with the parameter setting interface corresponding to the camera parameter setting instruction in the Android camera service.

For ease of understanding, in one embodiment, as shown in Figure 4, the embodiment of the present disclosure is divided into layers in Figure 4, and application programs, multimedia services, camera source plug-ins, Camera Client libraries, and Android containers belong to the user space layer , the camera driver (Camera Driver) belongs to the kernel layer, and the camera belongs to the hardware layer. Here, the application can generate camera preview instructions, camera shooting instructions, camera recording instructions and camera parameter setting instructions; correspondingly, the multimedia service can receive camera preview instructions, camera shooting instructions, camera recording instructions and camera parameter setting instructions; correspondingly , the communication pipeline in the camera source plug-in includes preview pipeline, shooting pipeline, video pipeline and parameter setting API; correspondingly, the Camera Client library includes preview API, shooting API, video recording API and parameter setting API; correspondingly, the Android container in the Android Camera services include preview API, shooting API, video recording API and parameter setting API.

According to the Linux-based camera control method according to the embodiment of the present disclosure, the method is applied to the Linux system, and based on the camera source plug-in, the camera control command is forwarded from the multimedia service to the Camera Client library; through the Camera Client library, the camera is controlled to execute the corresponding camera control command. operation. In the above way, the camera control command is forwarded through the camera source plug-in to use the camera through the Camera Client library, so that the application can use the camera through the Android camera service, so that the application can use the camera only if there is an Android camera driver. Use Camera to enable applications on the Linux side to use the camera device.

For example, based on any of the above embodiments, another embodiment of the Linux-based camera control method of the present disclosure is proposed. In this embodiment, before the above step 120, the method further includes:

Step 130, load the camera source plug-in through the multimedia service.

For example, through the multimedia service, the camera source plug-in is loaded to call the Camera Client library based on the camera source plug-in.

Wherein, the camera source plug-in is a plug-in obtained by extending the multimedia service. The camera source plugin resides in userspace on Linux.

The camera source plugin is set up to create a communication pipe so that applications on the Linux system can access the camera device through multimedia services.

In one embodiment, the communication channel is a pipeline.

According to the Linux-based camera control method according to an embodiment of the present disclosure, the method is applied to a Linux system, and the camera source plug-in is loaded through the multimedia service to call the Camera Client library based on the camera source plug-in, thereby controlling the camera to perform camera control through the Camera Client library The operation corresponding to the instruction, so that the application can use the camera through the Android camera service, so that the application can use the camera when only the Android camera driver exists, so that the application on the Linux side can use the camera device.

For example, based on any of the above embodiments, another embodiment of the Linux-based camera control method of the present disclosure is proposed. In this embodiment, before the above step 110, the method further includes:

Step 140, start the Android container after the Linux system is started.

Step 150, start the Android camera service in the Android container to initialize the camera.

Here, the Android camera service is a service for initializing camera hardware.

In one embodiment, after the Linux system is started, the Android container is started by the Ixc container technology; the Android camera service is started in the Android container to initialize the camera hardware.

According to the Linux-based camera control method of the embodiment of the present disclosure, the method is applied to a Linux system, and the camera is initialized by starting an Android container and its Android camera service, thereby providing support for subsequent use of the camera.

The following describes the Linux-based camera control device provided by the present disclosure. The Linux-based camera control device described below and the Linux-based camera control method described above can be referred to each other. According to the report, the Linux-based camera control device includes:

The receiving module 510 is configured to receive the camera control instruction sent by the application program in the Linux system through the multimedia service;

The control module 510 is configured to control the camera to execute the operation corresponding to the camera control instruction based on the camera source plug-in, and return the execution result of the camera to the application program through the camera source plug-in.

According to the Linux-based camera control device according to the embodiment of the present disclosure, the camera control command sent by the application program in the Linux system is received through the multimedia service; based on the camera source plug-in, the camera is controlled to perform the operation corresponding to the camera control command, and the execution result of the camera is Return to the application through the camera feed plugin. Through the above method, the embodiment of the present disclosure receives the camera control command sent by the application program through the multimedia service, and uses the camera based on the camera source plug-in, so that the application program can use the camera, so that when only the Android camera driver exists, the application program Programs can use the camera to enable applications on the Linux side to use the camera device.

For example, the control module 510 is also configured to forward the camera control instruction from the multimedia service to the Camera Client library based on the camera source plug-in; through the Camera Client library, the camera is controlled to perform the operation corresponding to the camera control instruction .

For example, the control module 510 is further configured to determine the communication channel corresponding to the camera control instruction based on the camera source plug-in; forward the camera control instruction from the multimedia service to the Camera Client library through the communication channel, and Call the interface corresponding to the camera control command in the Camera Client library.

For example, the Camera Client library communicates with the Android camera service through an interprocess communication channel.

For example, the control module 510 is also configured to connect the interface corresponding to the camera control command in the Camera Client library with the interface corresponding to the camera control command in the Android camera service; based on the docked interface, control The camera executes the operation corresponding to the camera control instruction.

For example, the Linux-based camera control device also includes:

The plug-in loading module is configured to load the camera source plug-in through the multimedia service.

For example, the Linux-based camera control device also includes:

The container startup module is configured to start the Android container after the Linux system starts;

The service startup module is configured to start the Android camera service in the Android container, so as to initialize the camera.

FIG. 6 illustrates a schematic diagram of the physical structure of an electronic device. As shown in FIG. 6, the electronic device may include: a processor (processor) 610, a communication interface (Communications Interface) 620, a memory (memory) 630 and a communication bus 640, Wherein, the processor 610 , the communication interface 620 , and the memory 630 communicate with each other through the communication bus 640 . The processor 610 can call the logic instructions in the memory 630 to execute the camera control method based on Linux, the method includes: receiving the camera control instruction sent by the application program in the Linux system through the multimedia service; controlling the camera based on the camera source plug-in Execute the operation corresponding to the camera control instruction, and return the execution result of the camera to the application program through the camera source plug-in.

In addition, the logic instructions in the above-mentioned memory 630 may be implemented in the form of software functional units and when sold or used as an independent product, may be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present disclosure or the part that contributes to the related technology or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several The instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in multiple embodiments of the present disclosure. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disc and other media that can store program codes. .

On the other hand, the present disclosure also provides a computer program product, the computer program product includes a computer program, the computer program can be stored on a non-transitory computer-readable storage medium, and when the computer program is executed by a processor, the computer can Executing the Linux-based camera control method provided by the above multiple methods, the method includes: receiving the camera control command sent by the application program in the Linux system through multimedia services; based on the camera source plug-in, controlling the camera to execute the camera control command corresponding operation, and return the execution result of the camera to the application program through the camera source plug-in.

In yet another aspect, the present disclosure also provides a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it is implemented to perform the Linux-based camera control method provided by the above-mentioned various methods, The method includes: receiving a camera control instruction sent by an application program in the Linux system through a multimedia service; controlling the camera to perform operations corresponding to the camera control instruction based on a camera source plug-in, and passing the execution result of the camera through the The camera feed plugin returns to the application.

The device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network elements. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. It can be understood and implemented by those skilled in the art without any creative effort.

Through the above description of the implementations, those skilled in the art can clearly understand that multiple implementations can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware. Based on this understanding, the essence of the above technical solutions or the part that contributes to related technologies can be embodied in the form of software products, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, disk , CD, etc., including several instructions to make a computer device (which may be a personal computer, server, or network device, etc.) execute the methods described in multiple embodiments or some parts of the embodiments.

Claims

A method for controlling a camera based on Linux, applied to a Linux system, said method comprising:

Receive a camera control instruction sent by an application program in the Linux system through a multimedia service;

Based on the camera source plug-in, the camera is controlled to execute the operation corresponding to the camera control instruction, and the execution result of the camera is returned to the application program through the camera source plug-in.
The method according to claim 1, wherein, based on the camera source plug-in, controlling the camera to perform operations corresponding to the camera control instruction includes:

Based on the camera source plug-in, the camera control command is forwarded from the multimedia service to the camera client Camera Client library;

Through the Camera Client library, the camera is controlled to perform the operation corresponding to the camera control instruction.
The method according to claim 2, wherein the camera source plug-in-based forwarding the camera control command from the multimedia service to the Camera Client library includes:

Based on the camera source plug-in, determine the communication channel corresponding to the camera control command;

Through the communication channel, forward the camera control instruction from the multimedia service to the Camera Client library, and call the interface corresponding to the camera control instruction in the Camera Client library.
The method according to claim 2, wherein the Camera Client storehouse communicates with the Android camera service through an inter-process communication channel.
The method according to claim 4, wherein the controlling the camera to perform operations corresponding to the camera control instruction through the Camera Client library includes:

The interface corresponding to the camera control command described in the Camera Client library is docked with the interface corresponding to the camera control command described in the Android camera service;

Based on the docking interface, the camera is controlled to perform the operation corresponding to the camera control instruction.
According to the method according to any one of claims 1 to 5, based on the camera source plug-in, the camera is controlled to execute the operation corresponding to the camera control instruction, and the execution result of the camera is returned to the camera source plug-in Before the above application, also include:

Through the multimedia service, the camera source plug-in is loaded.
According to the method according to any one of claims 1 to 5, before receiving the camera control instruction sent by the application program in the Linux system through the multimedia service, it also includes:

After the Linux system starts, start the Android container;

Start the Android camera service in the Android container for initializing the camera.
A Linux-based camera control setup consisting of:

The receiving module is configured to receive the camera control instruction sent by the application program in the Linux system through the multimedia service;

The control module is configured to control the camera to execute the operation corresponding to the camera control instruction based on the camera source plug-in, and return the execution result of the camera to the application program through the camera source plug-in.
An electronic device, comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, when the processor executes the program, the computer program described in any one of claims 1 to 7 is implemented. Describe the steps of the camera control method based on Linux.
A non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the Linux-based camera control method according to any one of claims 1 to 7 are implemented.