US12207000B2 - Shooting method and device and storage medium - Google Patents

Shooting method and device and storage medium Download PDF

Info

Publication number
US12207000B2
US12207000B2 US17/733,511 US202217733511A US12207000B2 US 12207000 B2 US12207000 B2 US 12207000B2 US 202217733511 A US202217733511 A US 202217733511A US 12207000 B2 US12207000 B2 US 12207000B2
Authority
US
United States
Prior art keywords
camera
party application
functional
image data
layer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US17/733,511
Other versions
US20230209212A1 (en
Inventor
Yuqing GU
Zhihui ZHANG
Guohao Yang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Assigned to BEIJING XIAOMI MOBILE SOFTWARE CO., LTD. reassignment BEIJING XIAOMI MOBILE SOFTWARE CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GU, Yuqing, ZHANG, ZHIHUI, YANG, GUOHAO
Publication of US20230209212A1 publication Critical patent/US20230209212A1/en
Application granted granted Critical
Publication of US12207000B2 publication Critical patent/US12207000B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60—Protecting data
    • G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • G06F21/6281—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database at program execution time, where the protection is within the operating system
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
    • G06F21/52—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems during program execution, e.g. stack integrity ; Preventing unwanted data erasure; Buffer overflow
    • G06F21/54—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems during program execution, e.g. stack integrity ; Preventing unwanted data erasure; Buffer overflow by adding security routines or objects to programs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60—Protecting data
    • G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/629—Protecting access to data via a platform, e.g. using keys or access control rules to features or functions of an application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • the image processing technology of the electronic device has become very mature.
  • Most of the electronic devices are integrated with a plurality of cameras to meet the shooting requirements of different focal lengths.
  • the cameras commonly used in the electronic devices include ultra-wide-angle cameras, telephoto cameras and other cameras with setting functions.
  • the disclosure provides a shooting method and device and a storage medium.
  • a shooting method which is performed by an electronic device, the electronic device includes an operating system and is provided with a functional camera, and an application layer of the electronic device is provided with a third-party application, the method includes:
  • a shooting device which is applied to an electronic device, the electronic device includes an operating system and is provided with a functional camera, an application layer of the electronic device is provided with a third-party application, and the shooting device includes:
  • a shooting device comprising:
  • a non-transitory computer readable storage medium on which computer program instructions are stored, and when the program instructions are executed by a processor, the steps of the shooting method according to the first aspect of the disclosure are realized.
  • FIG. 1 is a flow chart of a shooting method according to an example.
  • FIG. 2 is a flow chart of a shooting method according to an example.
  • FIG. 3 is a schematic diagram of a software architecture of an operating system according to an example.
  • FIG. 4 is a flow schematic diagram of applying the shooting method disclosed by the disclosure according to an example.
  • FIG. 5 is a diagram of a shooting method according to an example.
  • FIG. 6 is a diagram of a shooting method according to an example.
  • FIG. 7 is a block diagram of a shooting device according to an example.
  • FIG. 8 is a block diagram of a device according to an example.
  • the above-mentioned camera with a setting function can only be accessed by a camera application built in the electronic device, and a third-party application cannot access or use the above-mentioned camera with the setting function.
  • FIG. 1 is a flow chart of a shooting method according to an example. As shown in FIG. 1 , the shooting method is performed by an electronic device and includes the following steps.
  • a third-party application sends a data processing request to a framework layer of an operating system in response to a shooting operation on a shooting interface of the third-party application, and the data processing request is a request for indicating to process initial image data collected by a functional camera.
  • the electronic device can include an operating system, the electronic device is provided with a functional camera with a setting function, and an application layer of the electronic device is provided with a third-party application.
  • the operating system can be an Android system, an IOS system, a Linux system and the like.
  • the third-party application can be a third-party camera application, such as Meitu Xiu, BeautyCam and Camera FV5, and can also be an application capable of calling a camera function.
  • the setting function refers to a preset function of the functional camera, such as an Ultra-Wide-Angle-Shooting Function, a Telephoto-Shooting Function, an Ultra-Telephoto-Shooting Function, a Macro-Shooting Function, a Multi-Camera Simultaneous Opening Function, and a Smooth-Zoom Function, etc.
  • an application layer of the operating system is provided with a camera software development kit (SDK)
  • SDK camera software development kit
  • a third-party application of the operating system is integrated with the SDK
  • the third-party application sends data processing request to a framework layer of the operating system through the SDK.
  • the functional camera may include at least one of an ultra-wide-angle camera, a telephoto camera, an ultra-telephoto camera, and a macro camera.
  • step S 12 the framework layer sends the data processing request to a hardware abstraction layer of the operating system.
  • step S 13 the hardware abstraction layer processes the initial image data in response to the data processing request to obtain target image data, and sends the target image data to the third-party application.
  • the processing request for processing the initial image data collected by the functional camera can be sent to the hardware abstraction layer of the operating system through the third-party application, and the hardware abstraction layer processes the initial image data in response to the data processing request to obtain the target image data and sends the target image data to the third-party application, so that the third-party application calls the functional camera for shooting, and the richness of shooting through the third-party application is improved.
  • FIG. 2 is a flow chart of a shooting method according to an example. As shown in FIG. 2 , the shooting method is performed by an electronic device and includes the following steps.
  • step S 21 in response to a first operation for the third-party application, it is determined that the third-party application has the use permission to use the functional camera.
  • the first operation may be, for example, an operation to turn on the third-party application to run the third-party application.
  • the third-party application is an application capable of calling the camera function
  • the first operation can be an operation of calling the shooting function through the third-party application, or an operation of enabling the third-party application to enter the shooting interface.
  • the use request for using the functional camera in response to the first operation for the third-party application, can be sent to the framework layer of the operating system.
  • the framework layer grants the use permission to use the functional camera to the third-party application in response to the use request, so that the third-party application also has the capability of using the functional camera, a user can shoot by calling the functional camera, and the richness of shooting through the third-party application is improved.
  • An application layer of the operating system is provided with a camera software development kit (SDK), the SDK is integrated in the third-party application, and the framework layer is provided with a camera permission module.
  • SDK camera software development kit
  • the third-party application is integrated with the SDK. After the third-party application is installed on the electronic device, the SDK is configured in the application layer of the operating system.
  • the third-party application has the use permission to use the functional camera in the following manner:
  • step S 22 a use request for using the functional camera is sent to a framework layer of the operating system.
  • step S 23 the framework layer grants the use permission for the functional camera to the third-party application in response to the use request.
  • step S 24 in response to a shooting operation on a shooting interface of the third-party application, the third-party application sends a data processing request to the framework layer of the operating system, and the data processing request is a request for indicating to process initial image data collected by the functional camera.
  • step S 25 the framework layer sends the data processing request to a hardware abstraction layer of the operating system, and the hardware abstraction layer processes the initial image data in response to the data processing request to obtain target image data and sends the target image data to the third-party application.
  • granting the use permission for the functional camera to the third-party application further includes: granting the use permission for a Multi-Camera Simultaneous Opening Function for the plurality of the functional cameras to the third-party application.
  • the Multi-Camera Simultaneous Opening Function has the function of simultaneously obtaining and displaying a shot image of each selected camera.
  • the data processing request can include a request for indicating to process a first initial image data collected by a first functional camera and a second initial image data collected by a second functional camera, the first functional camera and the second functional camera are functional cameras selected from the plurality of the functional cameras.
  • the hardware abstraction layer In response to the data processing request including a request for indicating to process the first initial image data collected by the first functional camera and the second initial image data collected by the second functional camera, the hardware abstraction layer processes the first initial image data to obtain a first target image data in response to the data processing request and processes the second initial image data to obtain a second target image data in response to the data processing request, and sends the first target image data and the second target image data to the third-party application.
  • the third-party application determines that the third-party application has the use permission to use the functional camera, and after the use request for using the functional camera is sent to the framework layer of the operating system, the framework layer can grant the Multi-Camera Simultaneous Opening Function for the functional cameras to the third-party application in response to the use request. Based on the Multi-Camera Simultaneous Opening Function, a Multi-Camera Simultaneous Opening shot picture can be realized through the third-party application, so that the richness and intelligence of the operations of third-party application are improved.
  • the present disclosure takes the operating system of the electronic device as an Android system as an example to explain the shooting method applied by the present disclosure
  • FIG. 3 is a schematic diagram of a software architecture of an operating system according to an example.
  • the native architecture of the operating system can include an application layer 31 , a framework layer 32 , a hardware abstraction layer 33 , a kernel layer 34 and a hardware layer 35 .
  • the application layer 31 is provided with a plurality of third-party applications 311 and a native application 312 of the electronic device.
  • the framework layer 32 includes various native application interfaces (such as a camera application interface 322 ), an application service (e.g., a camera application service 323 ), and a framework layer interface 324 .
  • the hardware abstraction layer 33 includes a hardware abstraction layer interface 331 (e.g., HAL3.0), and the kernel layer 34 includes various drives 341 (e.g., a screen Display drive, an Audio drive and the like).
  • the hardware layer 35 includes various hardware devices (such as cameras with various functions) included in the electronic device.
  • a camera software development kit (SDK) 313 is arranged in the application layer 31 , and the SDK 313 is integrated in the third-party application 311 .
  • a camera permission module 321 and a camera granting module 3231 are arranged in the framework layer 32 of the operating system.
  • the third-party application 311 is integrated with the SDK 313 . After the third-party application 311 is installed on the electronic device, the SDK 313 is configured in the application layer 31 of the operating system.
  • a query request for querying the use permission is sent to the camera permission module 321 by the SDK 313 , and the camera permission module 321 determines that the third-party application 311 has the use permission to use the functional camera in response to the query request and responds a permission confirmation message to the third-party application 311 .
  • the permission confirmation message can include, for example, identification data of the functional camera, so that the third-party application 311 sends the use request for using the functional camera to the framework layer 32 of the operating system according to the identification data.
  • the camera permission module 321 can also respond a confirmation message of granting a Multi-Camera Simultaneous Opening Function for the plurality of the functional cameras to the third-party application 311 .
  • the framework layer 32 of the operating system further includes a camera granting module 3231 , and the camera granting module 3231 is configured to receive the use request sent by the third-party application 311 and to grant the use permission for the functional camera to the third-party application 311 in response to the use request.
  • the third-party application 311 sends a data processing request to the framework layer 32 of the operating system through the SDK 313 in response to the shooting operation on the shooting interface of the third-party application 311 .
  • the data processing request is a request for indicating to process initial image data collected by the functional camera.
  • the third-party application 311 sends the data processing request to the camera application service 323 of the framework layer 32 through the SDK 313 via the camera application interface 322 of the framework layer 32 of the operating system.
  • the camera application service 323 may be configured with a module for processing the data processing request, such as the camera granting module 3231 .
  • the framework layer 32 sends the received data processing request to the hardware abstraction layer 33 of the operating system.
  • the framework layer 32 sends the data processing request received by the camera application service 323 to the hardware abstraction layer 33 via the framework layer interface 324 .
  • the hardware abstraction layer 33 processes the initial image data in response to the data processing request to obtain target image data and sends the target image data to the third-party application 311 .
  • the hardware abstraction layer 33 interfaces with the kernel layer 34 through the hardware abstraction layer interface 331 in response to the data processing request, and obtains the initial image data captured by the lens group 351 (i.e., the functional camera) in the hardware layer 35 through the drive 341 of the kernel layer 34 .
  • the hardware abstraction layer 33 processes the initial image data to obtain the target image data.
  • the hardware abstraction layer 33 sends the target image data to the SDK 313 of the application layer 31 through the framework layer interface 324 , the camera application service 323 and the camera application interface 322 of the framework layer 32 , after that, the target image data is sent to the third-party application 311 through the SDK 313 .
  • FIG. 4 is a flow schematic diagram of applying the shooting method disclosed by the disclosure according to an example.
  • the third-party application in response to a first operation for the third-party application, sends a use request for using the functional camera to the framework layer of the operating system.
  • the framework layer of the operating system performs permission verification on the third-party application in response to the query request, and after it is determined that the third-party application passes the verification, the framework layer sends a permission confirmation information to the third-party application. After it is determined that the third-party application has the use permission to use the functional camera, the framework layer grants the use permission for the functional camera to the third-party application in response to the use request.
  • the third-party application sends a data processing request to the framework layer of the operating system, the framework layer sends the data processing request to a hardware abstraction layer of the operating system, and the hardware abstraction layer processes the initial image data to obtain target image data in response to the data processing request and sends the target image data to the third-party application.
  • FIG. 5 and FIG. 6 are diagrams of a shooting method according to an example.
  • FIG. 5 shows that after the operating system grants the functional cameras to the third-party application, the third-party application displays buttons for the plurality of the functional cameras on its operation interface, such as a camera 1, a camera 2, a camera 3 and the like. A user can select the camera 1, the camera 2 or the camera 3 to shoot images on the operation interface of the third-party application in response to shooting requirements.
  • FIG. 6 shows that after the operating system grants a Multi-Camera Simultaneous Opening Function for the functional cameras to the third-party application, a preview interface for simultaneously previewing a scene through two functional cameras is displayed on the operation interface of the third-party application.
  • FIG. 7 is a block diagram of a shooting device 700 according to an example.
  • the shooting device is applied to an electronic device.
  • the electronic device includes an operating system and is provided with a functional camera with a setting function, an application layer of the electronic device is provided with a third-party application, and the shooting device 700 includes:
  • the shooting device 700 further includes:
  • the determining module 703 is further configured to:
  • an application layer of the operating system is provided with a camera software development kit (SDK), the SDK is integrated in the third-party application, and the framework layer is provided with a camera permission module.
  • SDK camera software development kit
  • the determining module 703 is configured to control the third-party application to determine that the functional camera can be used in the following manner:
  • the framework layer is provided with a camera granting module
  • the granting module 704 controlling the framework layer to grant the use permission for the functional camera to the third-party application further includes:
  • the hardware abstraction layer processing the initial image data in response to the data processing request to obtain the target image data and sending the target image data to the third-party application includes:
  • the functional camera includes at least one of an ultra-wide-angle camera, a telephoto camera, an ultra-telephoto camera and a macro camera.
  • the disclosure further provides a computer readable storage medium on which computer program instructions are stored, and the steps of the shooting method provided by the disclosure are realized when the program instructions are executed by a processor.
  • FIG. 8 is a block diagram of a device 800 for shooting in accordance with an example.
  • the device 800 may be a mobile phone, a computer, digital broadcast electronic device, messaging equipment, a game console, tablet equipment, medical equipment, fitness equipment, a personal digital assistant, etc.
  • the device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input/output (I/O) interface 812 , a sensor component 814 , and a communication component 816 .
  • the processing component 802 generally controls overall operations of the device 800 , such as operations associated with displaying, telephone calling, data communications, camera operations, and recording operations.
  • the processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above shooting method.
  • the processing component 802 may include one or more modules, to facilitate interaction between the processing component 802 and other components.
  • the processing component 802 may include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802 .
  • the memory 804 is configured to store various types of data to support operation at the device 800 . Examples of these data include instructions, contact data, phonebook data, messages, pictures, videos, etc. for any application or method operated on the device 800 .
  • the memory 804 may be implemented by any type of volatile or non-volatile storage equipment, or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic disk or an optical disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EPROM erasable programmable read-only memory
  • PROM programmable read-only memory
  • ROM read-only memory
  • magnetic memory a magnetic memory
  • flash memory a flash memory
  • the power component 806 provides power to various components of the device 800 .
  • the power component 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 800 .
  • the multimedia component 808 includes a screen that provides an output interface between the device 800 and a user.
  • the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes the touch panel, the screen may be implemented as a touch screen to receive an input signal from the user.
  • the touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor may not only sense boundaries of a touch or slide action, but also detect duration and pressure associated with the touch or slide action.
  • the multimedia component 808 includes a front camera and/or a rear camera. When the device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and each rear camera can be a fixed optical lens system or have a focal length and the optical zooming capability.
  • the audio component 810 is configured to output and/or input an audio signal.
  • the audio component 810 includes a microphone (MIC) configured to receive an external audio signal when the device 800 is in an operating mode, such as a calling mode, a recording mode, and a voice recognition mode.
  • the received audio signal may be further stored in a memory 804 or transmitted via a communication component 816 .
  • the audio assembly 810 also includes a speaker for outputting the audio signal.
  • the I/O interface 812 provides an interface between the processing component 802 and the peripheral interface module.
  • the peripheral interface module can be a keyboard, a click wheel, a button and the like. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.
  • the sensor assembly 814 includes one or more sensors for providing various aspects of state evaluation for the device 800 .
  • the sensor assembly 814 may detect an on/off state of the device 800 , relative positioning of the components, such as a display and keypad of the device 800 .
  • the sensor assembly 814 may also detect a change in position of the device 800 or one component of the device 800 , the presence or absence of contact of a user with the device 800 , and the orientation or acceleration/deceleration of the device 800 and the temperature variation of the device 800 .
  • the sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact.
  • the sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • the communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other equipment.
  • the device 800 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof.
  • the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication.
  • NFC near field communication
  • the NFC module may be implemented based on a radio frequency identification (RFID) technology, an infrared data association (IrDA) technology, an ultra wide band (UWB) technology, a Bluetooth (BT) technology, and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra wide band
  • BT Bluetooth
  • the device 800 may be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), controllers, microcontrollers, microprocessors, or other electronic components for performing the above shooting method.
  • ASIC application specific integrated circuits
  • DSP digital signal processors
  • DSPD digital signal processing devices
  • PLD programmable logic devices
  • FPGA field programmable gate arrays
  • controllers microcontrollers, microprocessors, or other electronic components for performing the above shooting method.
  • a non-transitory computer-readable storage medium such as a memory 804 including instructions executable by the processor 820 of the device 800 to complete the above shooting method.
  • the non-transitory computer-readable storage medium may be an ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, optical data storage equipment, or the like.
  • a computer program product including a computer program executable by a programmable device, the computer program having a code portion for performing the above-described shooting method when executed by the programmable device.
  • the hardware abstraction layer processing the initial image data in response to the data processing request to obtain the target image data and sending the target image data to the third-party application includes:
  • the technical solution according to the examples of the disclosure can include the following beneficial effects: in response to the shooting operation on the shooting interface of the third-party application, the processing request for processing initial image data collected by the functional camera can be sent to the hardware abstraction layer of the operating system through the third-party application.
  • the hardware abstraction layer processes the initial image data in response to the data processing request to obtain the target image data and sends the target image data to the third-party application, so that the third-party application calls the functional camera for shooting, and the richness of shooting through the third-party application is improved.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Bioethics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Studio Devices (AREA)

Abstract

A shooting method, performed by an electronic device, the electronic device includes an operating system and is provided with a functional camera, an application layer of the electronic device is provided with a third-party application, and the shooting method includes: in response to a shooting operation on a shooting interface of the third-party application, sending a data processing request to a framework layer of the operating system by the third-party application, the data processing request being a request for indicating to process initial image data collected by the functional camera; sending the data processing request to a hardware abstraction layer of the operating system by the framework layer; and processing the initial image data by the hardware abstraction layer in response to the data processing request to obtain target image data, and sending the target image data to the third-party application by the hardware abstraction layer.

Description

CROSS-REFERENCE TO RELATED APPLICATION
The present application is based on and claims priority to the Chinese Patent Application No. 2021116274552, filed on Dec. 28, 2021, the entire contents of which are incorporated herein by reference.
BACKGROUND
With the development of the technology of electronic device, the image processing technology of the electronic device has become very mature. Most of the electronic devices are integrated with a plurality of cameras to meet the shooting requirements of different focal lengths. For example, the cameras commonly used in the electronic devices include ultra-wide-angle cameras, telephoto cameras and other cameras with setting functions.
SUMMARY
The disclosure provides a shooting method and device and a storage medium.
According to a first aspect of the disclosure, there is provided a shooting method which is performed by an electronic device, the electronic device includes an operating system and is provided with a functional camera, and an application layer of the electronic device is provided with a third-party application, the method includes:
    • in response to a shooting operation on a shooting interface of the third-party application, sending a data processing request to a framework layer of the operating system by the third-party application, the data processing request being a request for indicating to process initial image data collected by the functional camera;
    • sending the data processing request to a hardware abstraction layer of the operating system by the framework layer; and
    • processing the initial image data by the hardware abstraction layer in response to the data processing request to obtain target image data, and sending the target image data to the third-party application by the hardware abstraction layer.
According to a second aspect of the disclosure, there is provided a shooting device which is applied to an electronic device, the electronic device includes an operating system and is provided with a functional camera, an application layer of the electronic device is provided with a third-party application, and the shooting device includes:
    • a sending module, configured to control the third-party application to send a data processing request to a framework layer of the operating system in response to a shooting operation on a shooting interface of the third-party application, the data processing request being a request for indicating to process initial image data collected by the functional camera, and the sending module is further configured to control the framework layer to send the data processing request to a hardware abstraction layer of the operating system; and
    • a processing module, configured to control the hardware abstraction layer to process the initial image data in response to the data processing request to obtain target image data, and to control the hardware abstraction layer to send the target image data to the third-party application.
According to a third aspect of the disclosure, there is provided a shooting device, comprising:
    • a processor; and
    • a memory, configured to store processor executable instructions;
    • wherein the processor is configured to implement the steps of the method according to any one of the first aspect.
According to a fourth aspect of the disclosure, there is provided a non-transitory computer readable storage medium on which computer program instructions are stored, and when the program instructions are executed by a processor, the steps of the shooting method according to the first aspect of the disclosure are realized.
It should be understood that the general description and the detailed description of the following text are examples and explanatory, and are not used to limit the disclosure.
BRIEF DESCRIPTION OF THE DRAWINGS
The drawings herein are incorporated into and constitute part of the description, illustrating examples conforming to the disclosure, and used together with the description to interpret the principles of the disclosure.
FIG. 1 is a flow chart of a shooting method according to an example.
FIG. 2 is a flow chart of a shooting method according to an example.
FIG. 3 is a schematic diagram of a software architecture of an operating system according to an example.
FIG. 4 is a flow schematic diagram of applying the shooting method disclosed by the disclosure according to an example.
FIG. 5 is a diagram of a shooting method according to an example.
FIG. 6 is a diagram of a shooting method according to an example.
FIG. 7 is a block diagram of a shooting device according to an example.
FIG. 8 is a block diagram of a device according to an example.
 DETAILED DESCRIPTION
Examples will be described in detail here, examples of which are represented in the drawings. When the following description relates to drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. Implementations described in the following examples do not represent all the implementations consistent with the disclosure. Instead, they are examples of devices and methods consistent with some aspects of the disclosure.
At present, under an existing system architecture of the electronic device, the above-mentioned camera with a setting function can only be accessed by a camera application built in the electronic device, and a third-party application cannot access or use the above-mentioned camera with the setting function.
FIG. 1 is a flow chart of a shooting method according to an example. As shown in FIG. 1 , the shooting method is performed by an electronic device and includes the following steps.
In step S11, a third-party application sends a data processing request to a framework layer of an operating system in response to a shooting operation on a shooting interface of the third-party application, and the data processing request is a request for indicating to process initial image data collected by a functional camera.
The electronic device can include an operating system, the electronic device is provided with a functional camera with a setting function, and an application layer of the electronic device is provided with a third-party application. The operating system can be an Android system, an IOS system, a Linux system and the like. The third-party application can be a third-party camera application, such as Meitu Xiu, BeautyCam and Camera FV5, and can also be an application capable of calling a camera function.
The setting function refers to a preset function of the functional camera, such as an Ultra-Wide-Angle-Shooting Function, a Telephoto-Shooting Function, an Ultra-Telephoto-Shooting Function, a Macro-Shooting Function, a Multi-Camera Simultaneous Opening Function, and a Smooth-Zoom Function, etc.
In an example of the disclosure, as shown in FIG. 3 , taking Android as the operating system as an example, an application layer of the operating system is provided with a camera software development kit (SDK), a third-party application of the operating system is integrated with the SDK, and the third-party application sends data processing request to a framework layer of the operating system through the SDK.
For example, the functional camera may include at least one of an ultra-wide-angle camera, a telephoto camera, an ultra-telephoto camera, and a macro camera.
In step S12, the framework layer sends the data processing request to a hardware abstraction layer of the operating system.
In step S13, the hardware abstraction layer processes the initial image data in response to the data processing request to obtain target image data, and sends the target image data to the third-party application.
In an example of the disclosure, in response to the shooting operation on the shooting interface of the third-party application, the processing request for processing the initial image data collected by the functional camera can be sent to the hardware abstraction layer of the operating system through the third-party application, and the hardware abstraction layer processes the initial image data in response to the data processing request to obtain the target image data and sends the target image data to the third-party application, so that the third-party application calls the functional camera for shooting, and the richness of shooting through the third-party application is improved.
FIG. 2 is a flow chart of a shooting method according to an example. As shown in FIG. 2 , the shooting method is performed by an electronic device and includes the following steps.
In step S21, in response to a first operation for the third-party application, it is determined that the third-party application has the use permission to use the functional camera.
In the case that the third-party application is a third-party camera application, the first operation may be, for example, an operation to turn on the third-party application to run the third-party application. Or, in the case that the third-party application is an application capable of calling the camera function, the first operation can be an operation of calling the shooting function through the third-party application, or an operation of enabling the third-party application to enter the shooting interface.
In one implementation, in response to the first operation for the third-party application, the use request for using the functional camera can be sent to the framework layer of the operating system. The framework layer grants the use permission to use the functional camera to the third-party application in response to the use request, so that the third-party application also has the capability of using the functional camera, a user can shoot by calling the functional camera, and the richness of shooting through the third-party application is improved.
An application layer of the operating system is provided with a camera software development kit (SDK), the SDK is integrated in the third-party application, and the framework layer is provided with a camera permission module.
The third-party application is integrated with the SDK. After the third-party application is installed on the electronic device, the SDK is configured in the application layer of the operating system.
For example, it can be determined that the third-party application has the use permission to use the functional camera in the following manner:
    • a query request for querying the use permission is sent to the camera permission module by the SDK; and
    • the camera permission module determines that the third-party application has the use permission to use the functional camera in response to the query request, and responds a permission confirmation message to the third-party application.
In step S22, a use request for using the functional camera is sent to a framework layer of the operating system.
In step S23, the framework layer grants the use permission for the functional camera to the third-party application in response to the use request.
In step S24, in response to a shooting operation on a shooting interface of the third-party application, the third-party application sends a data processing request to the framework layer of the operating system, and the data processing request is a request for indicating to process initial image data collected by the functional camera.
In step S25, the framework layer sends the data processing request to a hardware abstraction layer of the operating system, and the hardware abstraction layer processes the initial image data in response to the data processing request to obtain target image data and sends the target image data to the third-party application.
Under the condition of there being a plurality of the functional cameras, granting the use permission for the functional camera to the third-party application further includes: granting the use permission for a Multi-Camera Simultaneous Opening Function for the plurality of the functional cameras to the third-party application.
The Multi-Camera Simultaneous Opening Function has the function of simultaneously obtaining and displaying a shot image of each selected camera.
The data processing request can include a request for indicating to process a first initial image data collected by a first functional camera and a second initial image data collected by a second functional camera, the first functional camera and the second functional camera are functional cameras selected from the plurality of the functional cameras.
In response to the data processing request including a request for indicating to process the first initial image data collected by the first functional camera and the second initial image data collected by the second functional camera, the hardware abstraction layer processes the first initial image data to obtain a first target image data in response to the data processing request and processes the second initial image data to obtain a second target image data in response to the data processing request, and sends the first target image data and the second target image data to the third-party application.
In an example of the disclosure, in response to the shooting operation on the shooting interface of the third-party application, the third-party application determines that the third-party application has the use permission to use the functional camera, and after the use request for using the functional camera is sent to the framework layer of the operating system, the framework layer can grant the Multi-Camera Simultaneous Opening Function for the functional cameras to the third-party application in response to the use request. Based on the Multi-Camera Simultaneous Opening Function, a Multi-Camera Simultaneous Opening shot picture can be realized through the third-party application, so that the richness and intelligence of the operations of third-party application are improved.
The present disclosure takes the operating system of the electronic device as an Android system as an example to explain the shooting method applied by the present disclosure
FIG. 3 is a schematic diagram of a software architecture of an operating system according to an example.
In FIG. 3 , the native architecture of the operating system can include an application layer 31, a framework layer 32, a hardware abstraction layer 33, a kernel layer 34 and a hardware layer 35. The application layer 31 is provided with a plurality of third-party applications 311 and a native application 312 of the electronic device. The framework layer 32 includes various native application interfaces (such as a camera application interface 322), an application service (e.g., a camera application service 323), and a framework layer interface 324. The hardware abstraction layer 33 includes a hardware abstraction layer interface 331 (e.g., HAL3.0), and the kernel layer 34 includes various drives 341 (e.g., a screen Display drive, an Audio drive and the like). The hardware layer 35 includes various hardware devices (such as cameras with various functions) included in the electronic device.
On the basis of the native architecture, a camera software development kit (SDK) 313 is arranged in the application layer 31, and the SDK 313 is integrated in the third-party application 311. A camera permission module 321 and a camera granting module 3231 are arranged in the framework layer 32 of the operating system.
The third-party application 311 is integrated with the SDK 313. After the third-party application 311 is installed on the electronic device, the SDK 313 is configured in the application layer 31 of the operating system.
In response to a shooting operation on a shooting interface of the third-party application 311, a query request for querying the use permission is sent to the camera permission module 321 by the SDK 313, and the camera permission module 321 determines that the third-party application 311 has the use permission to use the functional camera in response to the query request and responds a permission confirmation message to the third-party application 311. The permission confirmation message can include, for example, identification data of the functional camera, so that the third-party application 311 sends the use request for using the functional camera to the framework layer 32 of the operating system according to the identification data.
Under the condition of there being a plurality of the functional cameras, the camera permission module 321 can also respond a confirmation message of granting a Multi-Camera Simultaneous Opening Function for the plurality of the functional cameras to the third-party application 311.
The framework layer 32 of the operating system further includes a camera granting module 3231, and the camera granting module 3231 is configured to receive the use request sent by the third-party application 311 and to grant the use permission for the functional camera to the third-party application 311 in response to the use request.
In an example, as shown in FIG. 3 , after the camera granting module 3231 grants the use permission for the functional camera to the third-party application 311, the third-party application 311 sends a data processing request to the framework layer 32 of the operating system through the SDK 313 in response to the shooting operation on the shooting interface of the third-party application 311. The data processing request is a request for indicating to process initial image data collected by the functional camera. In some examples, the third-party application 311 sends the data processing request to the camera application service 323 of the framework layer 32 through the SDK 313 via the camera application interface 322 of the framework layer 32 of the operating system. The camera application service 323 may be configured with a module for processing the data processing request, such as the camera granting module 3231.
The framework layer 32 sends the received data processing request to the hardware abstraction layer 33 of the operating system. In some examples, the framework layer 32 sends the data processing request received by the camera application service 323 to the hardware abstraction layer 33 via the framework layer interface 324.
The hardware abstraction layer 33 processes the initial image data in response to the data processing request to obtain target image data and sends the target image data to the third-party application 311. In some examples, the hardware abstraction layer 33 interfaces with the kernel layer 34 through the hardware abstraction layer interface 331 in response to the data processing request, and obtains the initial image data captured by the lens group 351 (i.e., the functional camera) in the hardware layer 35 through the drive 341 of the kernel layer 34. The hardware abstraction layer 33 processes the initial image data to obtain the target image data. The hardware abstraction layer 33 sends the target image data to the SDK 313 of the application layer 31 through the framework layer interface 324, the camera application service 323 and the camera application interface 322 of the framework layer 32, after that, the target image data is sent to the third-party application 311 through the SDK 313.
FIG. 4 is a flow schematic diagram of applying the shooting method disclosed by the disclosure according to an example.
With reference to FIG. 4 , in response to a first operation for the third-party application, the third-party application sends a use request for using the functional camera to the framework layer of the operating system. The framework layer of the operating system performs permission verification on the third-party application in response to the query request, and after it is determined that the third-party application passes the verification, the framework layer sends a permission confirmation information to the third-party application. After it is determined that the third-party application has the use permission to use the functional camera, the framework layer grants the use permission for the functional camera to the third-party application in response to the use request. After that, in response to a shooting operation on a shooting interface of the third-party application, the third-party application sends a data processing request to the framework layer of the operating system, the framework layer sends the data processing request to a hardware abstraction layer of the operating system, and the hardware abstraction layer processes the initial image data to obtain target image data in response to the data processing request and sends the target image data to the third-party application.
FIG. 5 and FIG. 6 are diagrams of a shooting method according to an example.
FIG. 5 shows that after the operating system grants the functional cameras to the third-party application, the third-party application displays buttons for the plurality of the functional cameras on its operation interface, such as a camera 1, a camera 2, a camera 3 and the like. A user can select the camera 1, the camera 2 or the camera 3 to shoot images on the operation interface of the third-party application in response to shooting requirements.
FIG. 6 shows that after the operating system grants a Multi-Camera Simultaneous Opening Function for the functional cameras to the third-party application, a preview interface for simultaneously previewing a scene through two functional cameras is displayed on the operation interface of the third-party application.
FIG. 7 is a block diagram of a shooting device 700 according to an example. With reference to FIG. 7 , the shooting device is applied to an electronic device. The electronic device includes an operating system and is provided with a functional camera with a setting function, an application layer of the electronic device is provided with a third-party application, and the shooting device 700 includes:
    • a sending module 701, configured to control the third-party application to send a data processing request to a framework layer of the operating system in response to a shooting operation on a shooting interface of the third-party application, the data processing request being a request for indicating to process initial image data collected by the functional camera, and the sending module 701 is further configured to control the framework layer to send the data processing request to a hardware abstraction layer of the operating system; and
    • a processing module 702, configured to control the hardware abstraction layer to process the initial image data in response to the data processing request to obtain target image data, and to control the hardware abstraction layer to send the target image data to the third-party application.
In an example, the shooting device 700 further includes:
    • a determining module 703, configured to send a use request for using the functional camera to the framework layer of the operating system in response to a first operation for the third-party application; and
    • a granting module 704, configured to control the framework layer to grant the use permission for the functional camera to the third-party application in response to the use request.
In an example, the determining module 703 is further configured to:
    • determine that the third-party application has the use permission to use the functional camera before sending the use request for using the functional camera to the framework layer of the operating system.
In an example, an application layer of the operating system is provided with a camera software development kit (SDK), the SDK is integrated in the third-party application, and the framework layer is provided with a camera permission module.
The determining module 703 is configured to control the third-party application to determine that the functional camera can be used in the following manner:
    • sending a query request for querying the use permission to the camera permission module by the SDK; and
    • determining, by the camera permission module, that the third-party application has the use permission to use the functional camera in response to the query request, and responding, by the camera permission module, a permission confirmation message to the third-party application.
In an example, the framework layer is provided with a camera granting module;
    • the determining module 703 controls the third party application to send the use request to the camera granting module; and
    • the granting module 704 is configured to control the camera granting module to grant the use permission to the third-party application in response to the use request.
In an example, under the condition of there being a plurality of the functional cameras, the granting module 704 controlling the framework layer to grant the use permission for the functional camera to the third-party application further includes:
    • granting the use permission for a Multi-Camera Simultaneous Opening Function for the plurality of the functional cameras to the third-party application, the Multi-Camera Simultaneous Opening Function having the function of simultaneously obtaining and displaying the shot image of each selected camera; and
    • the data processing request includes:
    • a request for indicating to process a first initial image data collected by a first functional camera and a second initial image data collected by a second functional camera, the first functional camera and the second functional camera being functional cameras selected from the plurality of the functional cameras.
The hardware abstraction layer processing the initial image data in response to the data processing request to obtain the target image data and sending the target image data to the third-party application includes:
    • the hardware abstraction layer processes the first initial image data in response to the data processing request to obtain a first target image data, and processes the second initial image data in response to the data processing request to obtain a second target image data, and sends the first target image data and the second target image data to the third-party application.
In an example, the functional camera includes at least one of an ultra-wide-angle camera, a telephoto camera, an ultra-telephoto camera and a macro camera.
Regarding the device in the above-mentioned examples, the specific mode by which each module performs the operations has been described in detail in the example of the method, and will not be described in detail here.
The disclosure further provides a computer readable storage medium on which computer program instructions are stored, and the steps of the shooting method provided by the disclosure are realized when the program instructions are executed by a processor.
FIG. 8 is a block diagram of a device 800 for shooting in accordance with an example. For example, the device 800 may be a mobile phone, a computer, digital broadcast electronic device, messaging equipment, a game console, tablet equipment, medical equipment, fitness equipment, a personal digital assistant, etc.
With reference to FIG. 8 , the device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, and a communication component 816.
The processing component 802 generally controls overall operations of the device 800, such as operations associated with displaying, telephone calling, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above shooting method. Further, the processing component 802 may include one or more modules, to facilitate interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operation at the device 800. Examples of these data include instructions, contact data, phonebook data, messages, pictures, videos, etc. for any application or method operated on the device 800. The memory 804 may be implemented by any type of volatile or non-volatile storage equipment, or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic disk or an optical disk.
The power component 806 provides power to various components of the device 800. The power component 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 800.
The multimedia component 808 includes a screen that provides an output interface between the device 800 and a user. In some examples, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes the touch panel, the screen may be implemented as a touch screen to receive an input signal from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor may not only sense boundaries of a touch or slide action, but also detect duration and pressure associated with the touch or slide action. In some examples, the multimedia component 808 includes a front camera and/or a rear camera. When the device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and each rear camera can be a fixed optical lens system or have a focal length and the optical zooming capability.
The audio component 810 is configured to output and/or input an audio signal. For example, the audio component 810 includes a microphone (MIC) configured to receive an external audio signal when the device 800 is in an operating mode, such as a calling mode, a recording mode, and a voice recognition mode. The received audio signal may be further stored in a memory 804 or transmitted via a communication component 816. In some examples, the audio assembly 810 also includes a speaker for outputting the audio signal.
The I/O interface 812 provides an interface between the processing component 802 and the peripheral interface module. The peripheral interface module can be a keyboard, a click wheel, a button and the like. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.
The sensor assembly 814 includes one or more sensors for providing various aspects of state evaluation for the device 800. For example, the sensor assembly 814 may detect an on/off state of the device 800, relative positioning of the components, such as a display and keypad of the device 800. The sensor assembly 814 may also detect a change in position of the device 800 or one component of the device 800, the presence or absence of contact of a user with the device 800, and the orientation or acceleration/deceleration of the device 800 and the temperature variation of the device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some examples, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other equipment. The device 800 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In one example, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one example, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on a radio frequency identification (RFID) technology, an infrared data association (IrDA) technology, an ultra wide band (UWB) technology, a Bluetooth (BT) technology, and other technologies.
In an example, the device 800 may be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), controllers, microcontrollers, microprocessors, or other electronic components for performing the above shooting method.
In an example, a non-transitory computer-readable storage medium, such as a memory 804 including instructions executable by the processor 820 of the device 800 to complete the above shooting method, is also provided. For example, the non-transitory computer-readable storage medium may be an ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, optical data storage equipment, or the like.
In another example, there is also provided a computer program product including a computer program executable by a programmable device, the computer program having a code portion for performing the above-described shooting method when executed by the programmable device.
Additional non-limiting embodiments of the disclosure include:
    • 1. A shooting method, performed by an electronic device, the electronic device includes an operating system and is provided with a functional camera, and an application layer of the electronic device is provided with a third-party application. The method includes:
    • in response to a shooting operation on a shooting interface of the third-party application, sending a data processing request to a framework layer of the operating system by the third-party application, the data processing request being a request for indicating to process initial image data collected by the functional camera;
    • sending the data processing request to a hardware abstraction layer of the operating system by the framework layer; and
    • processing the initial image data by the hardware abstraction layer in response to the data processing request to obtain target image data, and sending the target image data to the third-party application by the hardware abstraction layer.
    • 2. The shooting method according to embodiment 1, wherein, the method further includes:
    • in response to a first operation for the third-party application, sending a use request for using the functional camera to the framework layer of the operating system; and
    • granting use permission for the functional camera to the third-party application by the framework layer in response to the use request.
    • 3. The shooting method according to any one of embodiments 1-2, wherein, before sending the use request for using the functional camera to the framework layer of the operating system, the method further includes:
    • determining that the third-party application has the use permission to use the functional camera.
    • 4. The shooting method according to any one of embodiments 1-3, wherein, the application layer of the operating system is provided with a camera software development kit (SDK), the SDK is integrated in the third-party application, and the framework layer is provided with a camera permission module;
    • determining that the third-party application has the use permission to use the functional camera includes:
    • sending a query request for querying the use permission to the camera permission module by the SDK; and
    • determining, by the camera permission module, that the third-party application has the use permission to use the functional camera in response to the query request, and responding, by the camera permission module, a permission confirmation message to the third-party application.
    • 5. The shooting method according to any one of embodiments 1-4, wherein, under the condition of there being a plurality of the functional cameras, granting the use permission for the functional camera to the third-party application further includes:
    • granting the use permission for a Multi-Camera Simultaneous Opening Function for the plurality of the functional cameras to the third-party application, the Multi-Camera Simultaneous Opening Function having the function of simultaneously obtaining and displaying the shot image of each selected camera; and
    • the data processing request includes:
    • a request for indicating to process a first initial image data collected by a first functional camera and a second initial image data collected by a second functional camera, the first functional camera and the second functional camera being functional cameras selected from the plurality of the functional cameras;
    • processing, by the hardware abstraction layer, the initial image data in response to the data processing request to obtain the target image data and sending, by the hardware abstraction layer, the target image data to the third-party application, includes:
    • processing the first initial image data by the hardware abstraction layer in response to the data processing request to obtain a first target image data, and processing the second initial image data by the hardware abstraction layer in response to the data processing request to obtain a second target image data; and
    • sending the first target image data and the second target image data to the third-party application by the hardware abstraction layer.
    • 6. The shooting method according to any one of embodiments 1-5, wherein, the functional camera includes at least one of an ultra-wide-angle camera, a telephoto camera, an ultra-telephoto camera and a macro camera.
    • 7. A shooting device, applied to an electronic device, the electronic device includes an operating system and is provided with a functional camera, an application layer of the electronic device is provided with a third-party application, and the shooting device includes:
    • a sending module, configured to control the third-party application to send a data processing request to a framework layer of the operating system in response to a shooting operation on a shooting interface of the third-party application, the data processing request being a request for indicating to process initial image data collected by the functional camera, and the sending module is further configured to control the framework layer to send the data processing request to a hardware abstraction layer of the operating system; and
    • a processing module, configured to control the hardware abstraction layer to process the initial image data in response to the data processing request to obtain target image data, and to control the hardware abstraction layer to send the target image data to the third-party application.
    • 8. The shooting device according to embodiment 7, wherein, the device further includes:
    • a determining module, configured to send a use request for using the functional camera to the framework layer of the operating system in response to a first operation for the third-party application; and
    • a granting module, configured to control the framework layer to grant use permission for the functional camera to the third-party application in response to the use request.
    • 9. The shooting device according to any one of embodiments 7-8, wherein, the determining module is further configured to:
    • determine that the third-party application has the use permission to use the functional camera before sending the use request for using the functional camera to the framework layer of the operating system.
    • 10. The shooting device according to any one of embodiments 7-9, wherein, the application layer of the operating system is provided with a camera software development kit (SDK), the SDK is integrated in the third-party application, and the framework layer is provided with a camera permission module;
    • the determining module determines that the third-party application has the use permission to use the function camera in the following manner:
    • sending a query request for querying the use permission to the camera permission module by the SDK; and
    • the camera permission module determines that the third-party application has the use permission to use the functional camera in response to the query request, and responds a permission confirmation message to the third-party application.
    • 11. The shooting device according to any one of embodiments 7-10, wherein, under the condition of there being a plurality of the functional cameras, controlling the framework layer to grant the use permission for the functional camera to the third-party application by the granting module further includes:
    • granting the use permission for a Multi-Camera Simultaneous Opening Function for the plurality of the functional cameras to the third-party application, the Multi-Camera Simultaneous Opening Function having the function of simultaneously obtaining and displaying the shot image of each selected camera; and
    • the data processing request includes:
    • a request for indicating to process a first initial image data collected by a first functional camera and a second initial image data collected by a second functional camera, the first functional camera and the second functional camera being functional cameras selected from the plurality of the functional cameras.
The hardware abstraction layer processing the initial image data in response to the data processing request to obtain the target image data and sending the target image data to the third-party application, includes:
    • the hardware abstraction layer processes the first initial image data in response to the data processing request to obtain a first target image data, and processes the second initial image data in response to the data processing request to obtain a second target image data; and
    • sends the first target image data and the second target image data to the third-party application.
    • 12. The shooting device according to any one of embodiments 7-11, wherein, the functional camera includes at least one of an ultra-wide-angle camera, a telephoto camera, an ultra-telephoto camera and a macro camera.
The technical solution according to the examples of the disclosure can include the following beneficial effects: in response to the shooting operation on the shooting interface of the third-party application, the processing request for processing initial image data collected by the functional camera can be sent to the hardware abstraction layer of the operating system through the third-party application. The hardware abstraction layer processes the initial image data in response to the data processing request to obtain the target image data and sends the target image data to the third-party application, so that the third-party application calls the functional camera for shooting, and the richness of shooting through the third-party application is improved.
Other examples of the present disclosure will be readily conceived by those skilled in the art after taking into account the specification and practicing the present disclosure. The present disclosure aims to cover any variation, use or adaptive variation of the disclosure that follow the general principles of the disclosure and include the known common knowledge or habitual technical means in the art that are not disclosed by the disclosure. The description and examples are considered as examples, and the true scope and spirit of the disclosure are indicated by the following claims.
It should be understood that the disclosure is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from its scope. The scope of the present disclosure is limited by the appended claims

Claims (19)

What is claimed is:
1. A shooting method, wherein the shooting method is performed by an electronic device, the electronic device comprises an operating system and is provided with a functional camera, and an application layer of the electronic device is provided with a third-party application, the application layer is provided with a camera software development kit (SDK), the SDK is integrated in the third-party application, and the method comprises:
in response to a shooting operation on a shooting interface of the third-party application, sending, through the SDK, a data processing request to a framework layer of the operating system by the third-party application, the data processing request being a request for indicating to process initial image data collected by the functional camera;
sending the data processing request to a hardware abstraction layer of the operating system by the framework layer; and
processing the initial image data by the hardware abstraction layer in response to the data processing request to obtain target image data, and sending the target image data from the hardware abstraction layer to the third-party application through the framework layer;
wherein sending, through the SDK, the data processing request to the framework layer of the operating system by the third-party application, comprises: sending, by the third-party application, the data processing request to a camera application service of the framework layer through the SDK via a camera application interface of the framework layer;
wherein sending the data processing request to the hardware abstraction layer of the operating system by the framework layer, comprises: sending the data processing request received by the camera application service to the hardware abstraction layer via a framework layer interface of the framework layer.
2. The method according to claim 1, wherein the method further comprises:
in response to a first operation for the third-party application, sending a use request for using the functional camera to the framework layer of the operating system; and
granting an use permission for the functional camera to the third-party application by the framework layer in response to the use request.
3. The method according to claim 2, wherein before sending the use request for using the functional camera to the framework layer of the operating system, the method further comprises:
determining that the third-party application has the use permission to use the functional camera.
4. The method according to claim 3, wherein the framework layer is provided with a camera permission module;
determining that the third-party application has the use permission to use the functional camera comprises:
sending a query request for querying the use permission to the camera permission module by the SDK; and
determining that the third-party application has the use permission for the functional camera by the camera permission module in response to the query request, and responding a permission confirmation message to the third-party application by the camera permission module.
5. The method according to claim 2, wherein under the condition of there being a plurality of the functional cameras, granting the use permission for the functional camera to the third-party application further comprises:
granting use permission for a Multi-Camera Simultaneous Opening Function for the plurality of the functional cameras to the third-party application, wherein the Multi-Camera Simultaneous Opening Function has the function of simultaneously obtaining and displaying the shot image of each selected camera; and
the data processing request comprises:
a request for indicating to process a first initial image data collected by a first functional camera and a second initial image data collected by a second functional camera, wherein the first functional camera and the second functional camera are functional cameras selected from the plurality of the functional cameras;
processing the initial image data by the hardware abstraction layer in response to the data processing request to obtain the target image data and sending the target image data from the hardware abstraction layer to the third-party application through the framework layer comprises:
processing the first initial image data by the hardware abstraction layer in response to the data processing request to obtain a first target image data, and processing the second initial image data by the hardware abstraction layer in response to the data processing request to obtain a second target image data; and
sending the first target image data and the second target image data from the hardware abstraction layer to the third-party application through the framework layer.
6. The method according to claim 1, wherein the functional camera comprises at least one of an ultra-wide angle camera, a telephoto camera, an ultra-telephoto camera and a macro camera.
7. The method according to claim 4, wherein the permission confirmation message includes identification data of the functional camera;
sending the use request for using the functional camera to the framework layer of the operating system, comprises: sending, by the third-party application, the use request for using the functional camera to the framework layer of the operating system according to the identification data.
8. A shooting device, the shooting device is applied to an electronic device, the electronic device comprises an operating system and is provided with a functional camera, and an application layer of the electronic device is provided with a third-party application, the application layer is provided with a camera software development kit (SDK), the SDK is integrated in the third-party application, and the shooting device comprising:
a processor; and
a memory, configured to store processor executable instructions;
wherein the processor is configured to:
in response to a shooting operation on a shooting interface of the third-party application, control the third-party application to send, through the SDK, a data processing request to a framework layer of the operating system, the data processing request being a request for indicating to process initial image data collected by the functional camera;
control the framework layer to send the data processing request to a hardware abstraction layer of the operating system; and
control the hardware abstraction layer to process the initial image data in response to the data processing request to obtain target image data, and control the hardware abstraction layer to send the target image data to the third-party application through the framework layer;
wherein send, through the SDK, the data processing request to the framework layer of the operating system, comprises: sending the data processing request to a camera application service of the framework layer through the SDK via a camera application interface of the framework layer;
wherein send the data processing request to the hardware abstraction layer of the operating system, comprises: sending the data processing request received by the camera application service to the hardware abstraction layer via a framework layer interface of the framework layer.
9. The shooting device according to claim 8, wherein the processor is further configured to:
in response to a first operation for the third-party application, control the third-party application to send a use request for using the functional camera to the framework layer of the operating system; and
control the framework layer to grant use permission for the functional camera to the third-party application in response to the use request.
10. The shooting device according to claim 9, wherein the processor is further configured to:
before controlling the third-party application to send the use request for using the functional camera to the framework layer of the operating system, control the third-party application to determine that the third-party application has the use permission to use the functional camera.
11. The shooting device according to claim 10, wherein the framework layer is provided with a camera permission module;
the processor is further configured to:
control the third-party application to send a query request for querying the use permission to the camera permission module by the SDK; and
control the camera permission module to determine that the third-party application has the use permission for the functional camera in response to the query request, and to respond a permission confirmation message to the third-party application.
12. The shooting device according to claim 9, wherein under the condition of there being a plurality of the functional cameras, the processor is further configured to:
control the framework layer to grant use permission for a Multi-Camera Simultaneous Opening Function for the plurality of the functional cameras to the third-party application, wherein the Multi-Camera Simultaneous Opening Function has the function of simultaneously obtaining and displaying the shot image of each selected camera; and
the data processing request comprises: a request for indicating to process a first initial image data collected by a first functional camera and a second initial image data collected by a second functional camera, wherein the first functional camera and the second functional camera are functional cameras selected from the plurality of the functional cameras;
the processor is further configured to:
control the hardware abstraction layer to process the first initial image data in response to the data processing request to obtain a first target image data, and to process the second initial image data in response to the data processing request to obtain a second target image data; and
control the hardware abstraction layer to send the first target image data and the second target image data to the third-party application through the framework layer.
13. The shooting device according to claim 8, wherein the functional camera comprises at least one of an ultra-wide angle camera, a telephoto camera, an ultra-telephoto camera and a macro camera.
14. A non-transitory computer readable storage medium on which computer program instructions are stored, wherein, the storage medium is applied to an electronic device, the electronic device comprises an operating system and is provided with a functional camera, and an application layer of the electronic device is provided with a third-party application, the application layer is provided with a camera software development kit (SDK), the SDK is integrated in the third-party application, and when the program instructions are executed by a processor, the processor is configured to:
in response to a shooting operation on a shooting interface of the third-party application, control the third-party application to send, through the SDK, a data processing request to a framework layer of the operating system, the data processing request being a request for indicating to process initial image data collected by the functional camera;
control the framework layer to send the data processing request to a hardware abstraction layer of the operating system; and
control the hardware abstraction layer to process the initial image data in response to the data processing request to obtain target image data, and control the hardware abstraction layer to send the target image data to the third-party application through the framework layer;
wherein send, through the SDK, the data processing request to the framework layer of the operating system, comprises: sending the data processing request to a camera application service of the framework layer through the SDK via a camera application interface of the framework layer;
wherein send the data processing request to the hardware abstraction layer of the operating system, comprises: sending the data processing request received by the camera application service to the hardware abstraction layer via a framework layer interface of the framework layer.
15. The storage medium according to claim 14, wherein the processor is further configured to:
in response to a first operation for the third-party application, control the third-party application to send a use request for using the functional camera to the framework layer of the operating system; and
control the framework layer to grant use permission for the functional camera to the third-party application in response to the use request.
16. The storage medium according to claim 15, wherein the processor is further configured to:
before controlling the third-party application to send the use request for using the functional camera to the framework layer of the operating system, control the third-party application to determine that the third-party application has the use permission to use the functional camera.
17. The storage medium according to claim 16, wherein the framework layer is provided with a camera permission module;
the processor is further configured to:
control the third-party application to send a query request for querying the use permission to the camera permission module by the SDK; and
control the camera permission module to determine that the third-party application has the use permission for the functional camera in response to the query request, and to respond a permission confirmation message to the third-party application.
18. The storage medium according to claim 15, wherein under the condition of there being a plurality of the functional cameras, the processor is further configured to:
control the framework layer to grant use permission for a Multi-Camera Simultaneous Opening Function for the plurality of the functional cameras to the third-party application, wherein the Multi-Camera Simultaneous Opening Function has the function of simultaneously obtaining and displaying the shot image of each selected camera; and
the data processing request comprises: a request for indicating to process a first initial image data collected by a first functional camera and a second initial image data collected by a second functional camera, wherein the first functional camera and the second functional camera are functional cameras selected from the plurality of the functional cameras;
the processor is further configured to:
control the hardware abstraction layer to process the first initial image data in response to the data processing request to obtain a first target image data, and to process the second initial image data in response to the data processing request to obtain a second target image data; and
control the hardware abstraction layer to send the first target image data and the second target image data to the third-party application through the framework layer.
19. The storage medium according to claim 14, wherein the functional camera comprises at least one of an ultra-wide angle camera, a telephoto camera, an ultra-telephoto camera and a macro camera.
US17/733,511 2021-12-28 2022-04-29 Shooting method and device and storage medium Active US12207000B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111627455.2 2021-12-28
CN202111627455.2A CN116419057A (en) 2021-12-28 2021-12-28 Shooting method, shooting device and storage medium

Publications (2)

Publication Number Publication Date
US20230209212A1 US20230209212A1 (en) 2023-06-29
US12207000B2 true US12207000B2 (en) 2025-01-21

Family

ID=81841852

Family Applications (1)

Application Number Title Priority Date Filing Date
US17/733,511 Active US12207000B2 (en) 2021-12-28 2022-04-29 Shooting method and device and storage medium

Country Status (3)

Country Link
US (1) US12207000B2 (en)
EP (1) EP4206962A1 (en)
CN (1) CN116419057A (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119450186A (en) * 2023-07-31 2025-02-14 北京小米移动软件有限公司 Shooting processing method and device, electronic device and storage medium
CN119255089A (en) * 2024-01-10 2025-01-03 荣耀终端有限公司 Image processing method and related device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070070204A1 (en) * 2005-09-29 2007-03-29 Mentzer Ray A Multi-camera system and method
US20180365004A1 (en) * 2017-06-14 2018-12-20 Beijing Xiaomi Mobile Software Co., Ltd. Method and device for calling software development kit
US20190034624A1 (en) * 2017-07-27 2019-01-31 Samsung Electronics Co., Ltd. Methods and apparatus to monitor permission-controlled hidden sensitive application behavior at run-time
US20200349749A1 (en) * 2019-05-03 2020-11-05 XRSpace CO., LTD. Virtual reality equipment and method for controlling thereof
CN113727035A (en) * 2021-10-15 2021-11-30 Oppo广东移动通信有限公司 Image processing method, system, electronic device and storage medium
US20210389996A1 (en) * 2020-06-10 2021-12-16 Snap Inc. Software development kit for image processing
US20220201201A1 (en) * 2019-09-12 2022-06-23 Huawei Technologies Co., Ltd. Callback stream processing method and device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070070204A1 (en) * 2005-09-29 2007-03-29 Mentzer Ray A Multi-camera system and method
US20180365004A1 (en) * 2017-06-14 2018-12-20 Beijing Xiaomi Mobile Software Co., Ltd. Method and device for calling software development kit
US20190034624A1 (en) * 2017-07-27 2019-01-31 Samsung Electronics Co., Ltd. Methods and apparatus to monitor permission-controlled hidden sensitive application behavior at run-time
US20200349749A1 (en) * 2019-05-03 2020-11-05 XRSpace CO., LTD. Virtual reality equipment and method for controlling thereof
US20220201201A1 (en) * 2019-09-12 2022-06-23 Huawei Technologies Co., Ltd. Callback stream processing method and device
US20210389996A1 (en) * 2020-06-10 2021-12-16 Snap Inc. Software development kit for image processing
US11698822B2 (en) * 2020-06-10 2023-07-11 Snap Inc. Software development kit for image processing
CN113727035A (en) * 2021-10-15 2021-11-30 Oppo广东移动通信有限公司 Image processing method, system, electronic device and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Extended European Search Report dated Oct. 14, 2022 for European Application No. 22170805.0.

Also Published As

Publication number Publication date
US20230209212A1 (en) 2023-06-29
EP4206962A1 (en) 2023-07-05
CN116419057A (en) 2023-07-11

Similar Documents

Publication Publication Date Title
US10613498B2 (en) Method for controlling device by remote control device
US9667774B2 (en) Methods and devices for sending virtual information card
US10530836B2 (en) Methods and apparatuses for acquiring image
EP3179711B1 (en) Method and apparatus for preventing photograph from being shielded
CN105487857A (en) Method and apparatus for prompting image shooting part to be started
EP3048508A1 (en) Methods, apparatuses and devices for transmitting data
CN107562349B (en) Method and device for executing processing
US20220391446A1 (en) Method and device for data sharing
CN103986821A (en) Method, equipment and system for carrying out parameter adjustment
EP3232301A1 (en) Mobile terminal and virtual key processing method
WO2018000710A1 (en) Method and device for displaying wifi signal icon and mobile terminal
US12207000B2 (en) Shooting method and device and storage medium
CN112689047A (en) Display control method and device and electronic equipment
US10225387B2 (en) Call processing method and device
EP3104282A1 (en) Search method and search apparatus
US20170075671A1 (en) Method and apparatus for installing application and smart device using the same
US11783525B2 (en) Method, device and storage medium form playing animation of a captured image
CN107656616B (en) Input interface display method and device and electronic equipment
CN114296587A (en) Cursor control method and device, electronic equipment and storage medium
CN108650412B (en) A display method, display device and computer-readable storage medium
CN112423092A (en) Video recording method and video recording device
CN107562350B (en) Method and device for reporting key event
US11209665B2 (en) Application interface display method and apparatus, and storage medium
CN113050866A (en) Touch control method, terminal device and computer storage medium
CN110769114B (en) Call interface display method, device and mobile terminal

Legal Events

Date Code Title Description
AS Assignment

Owner name: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD., CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GU, YUQING;ZHANG, ZHIHUI;YANG, GUOHAO;SIGNING DATES FROM 20220425 TO 20220427;REEL/FRAME:059714/0621

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

ZAAB Notice of allowance mailed

Free format text: ORIGINAL CODE: MN/=.

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE

CC Certificate of correction