CN113747043B - Image processor starting method, electronic device and storage medium - Google Patents

Image processor starting method, electronic device and storage medium Download PDF

Info

Publication number
CN113747043B
CN113747043B CN202010478300.6A CN202010478300A CN113747043B CN 113747043 B CN113747043 B CN 113747043B CN 202010478300 A CN202010478300 A CN 202010478300A CN 113747043 B CN113747043 B CN 113747043B
Authority
CN
China
Prior art keywords
image processor
memory
camera
starting
parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010478300.6A
Other languages
Chinese (zh)
Other versions
CN113747043A (en
Inventor
王涛
杨平平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202010478300.6A priority Critical patent/CN113747043B/en
Publication of CN113747043A publication Critical patent/CN113747043A/en
Application granted granted Critical
Publication of CN113747043B publication Critical patent/CN113747043B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/617Upgrading or updating of programs or applications for camera control
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The embodiment of the application discloses an image processor starting method, electronic equipment and a storage medium. The method comprises the following steps: when the central processing unit receives a camera starting request, before a software driver of the image processor is called, memory parameters and preset firmware related to the image processor are acquired, parameter configuration is carried out on a memory controller of the image processor, the preset firmware corresponding to the image processor is loaded, and when the software driver of the image processor is called according to the camera starting request, the starting of the image processor is completed according to the software driver, the preset firmware and the memory controller with the parameter configuration completed. The parameter test time of the memory controller after the initialization of the image processor is finished is saved, the time of loading the preset firmware of the image processor after the initialization of the image processor is finished is saved, and the starting speed of the image processor is improved.

Description

Image processor starting method, electronic device and storage medium
Technical Field
The present disclosure relates to the field of image processing technologies, and in particular, to an image processor starting method, an electronic device, and a storage medium.
Background
In the related art, when a user opens a camera application, an image processor is started to perform optimization processing on image data captured by a camera. In the process of starting the image processor, the initialization of the image processor is usually finished, parameters of a memory controller related to the image processor are carried out to finish the parameter configuration of the memory controller, and then firmware corresponding to the image processor is loaded. In the whole process of starting the image processor, more time is consumed, and the image processor is slowly started, so that photographing experience is affected.
Disclosure of Invention
The embodiment of the application provides an image processor starting method, electronic equipment and a storage medium. The starting method of the image processor can accelerate the starting speed of the image processor and reduce time consumption.
In a first aspect, an embodiment of the present application provides an image processor starting method, where the method includes:
when the central processing unit receives a camera starting request, acquiring memory parameters and preset firmware related to the image processor;
performing parameter configuration on a memory controller of the image processor according to the memory parameter;
Calling a software driver of the image processor according to a camera starting request, and loading the preset firmware;
and starting the image processor according to the software driver, the loaded preset firmware and the memory controller with the parameter configuration completed.
In a second aspect, an embodiment of the present application provides an electronic device, including:
the central processing unit and the image processor are electrically connected;
the central processor is configured to:
when the central processing unit receives a camera starting request, judging whether the memory parameter and the preset firmware corresponding to the image processor are stored in the electronic equipment or not;
if yes, acquiring memory parameters and preset firmware related to the image processor;
performing parameter configuration on a memory controller of the image processor according to the memory parameter;
calling a software driver of the image processor according to a camera starting request, and loading the preset firmware;
starting the image processor according to the software driver, the loaded preset firmware and the memory controller with the parameter configuration completed;
if not, calling a software driver of the image processor according to a camera starting request to initialize the image processor;
And performing memory parameter setting on the initialized image processor, acquiring and loading the preset firmware, and starting the image processor.
In a third aspect, embodiments of the present application provide a storage medium storing a plurality of instructions adapted to be loaded by a processor to perform steps in an image processor startup method.
In this embodiment, when the central processing unit receives the camera start request, before the software driver of the image processor is invoked, the memory parameter and the preset firmware related to the image processor are obtained, the memory controller of the image processor is configured with the parameter, and the preset firmware corresponding to the image processor is loaded, and when the software driver of the image processor is invoked according to the camera start request, the memory controller completed according to the software driver, the preset firmware and the parameter configuration completes the start of the image processor. The parameter test time of the memory controller after the initialization of the image processor is finished is saved, the time of loading the preset firmware of the image processor after the initialization of the image processor is finished is saved, and the starting speed of the image processor is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of an image processor starting method according to an embodiment of the present application.
Fig. 2 is a second flowchart of an image processor starting method according to an embodiment of the present application.
Fig. 3 is a third flow chart of an image processor starting method according to an embodiment of the present application.
Fig. 4 is a fourth flowchart of an image processor starting method according to an embodiment of the present application.
Fig. 5 is a schematic flow chart of starting up an image processor according to an embodiment of the present application.
Fig. 6 is a first structural schematic diagram of an electronic device according to an embodiment of the present application.
Fig. 7 is a second schematic structural diagram of an electronic device according to an embodiment of the present application.
Fig. 8 is a third schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
The embodiment of the application provides an image processor starting method, and an execution subject of the image processor starting method may be the electronic device integrated with the image processor provided by the embodiment of the application. The electronic device may be a smart phone, an intelligent wearable device, a tablet computer, a palm computer (PDA, personal Digital Assistant), etc. The following will describe in detail.
Referring to fig. 1, fig. 1 is a schematic flow chart of an image processor starting method according to an embodiment of the present application. The image processor starting method can save the starting time of the image processor and accelerate the starting speed of the image processor. The image processor starting method may include the steps of:
110. the central processing unit receives the camera starting request, and the central processing unit acquires memory parameters and preset firmware related to the image processor from the electronic equipment according to the camera starting request.
When a user takes a picture by using the electronic device, the user takes the picture according to the camera application of the electronic device. For example, the user generates a camera start request by means of voice control, eyeball control, touching a screen icon, pressing a specific physical key, and the like, and sends the camera start request to the central processing unit, and the central processing unit controls the electronic device to open the camera to take a picture.
When the central processing unit receives a camera starting request, a corresponding instruction needs to be generated to control the image processor to start.
In some embodiments, the central processor, upon receiving the camera start request, obtains a memory parameter and a preset Firmware (Firmware) stored in the electronic device and related to the image processor. The preset firmware may include firmware corresponding to the image processor and firmware corresponding to the camera.
It should be noted that, the memory parameter and the preset firmware related to the image processor may be pre-stored in the internal memory of the electronic device, or may be downloaded to the electronic device locally through a network.
An application processor (AP, application process) may be included in the central processor, on which an operating system, user interface, and application programs all execute. The image processor may include an image signal processor (ISP, image Signal Processing), a Pre-image processor (Pre ISP, pre image Signal Processing), and the like.
In some embodiments, the application processor may receive a camera startup request and obtain memory parameters and preset firmware corresponding to the image processor. The application processor then generates a start command to the image processor to cause the image processor to power up.
120. And carrying out parameter configuration on a memory controller of the image processor according to the memory parameters.
In some embodiments, the cpu may perform parameter setting on the memory controller corresponding to the image processor in advance according to the acquired memory parameter, for example, may perform parameter setting on a register related to the memory parameter in the memory controller. For example, there is A, B, C in the registers related to the memory parameters, the parameters corresponding to the register a are stored in the register a, the parameters corresponding to the register B are stored in the register B, and the parameters corresponding to the register C are stored in the register C.
The parameter configuration of the memory controller of the image processor is completed before the image processor is initialized by the software driver, and no more time is needed for the parameter configuration of the memory controller after the image processor is initialized by the software driver.
130. And calling a software driver of the image processor according to the camera starting request, and loading preset firmware.
It can be understood that after the image processor is powered on, the image processor is initialized by calling a software driver (driver) of the image processor, and the initialized image processor can directly use the loaded preset firmware.
In some embodiments, the loading of the preset firmware may be performed by loading the preset firmware into the corresponding hardware device before the initialization of the image processor is completed, so that the loading of the preset firmware of the image processor is completed after the initialization of the software is completed. The time for calling the software driver to continue loading the preset firmware after the initialization of the image processor is completed is saved.
140. And starting the image processor according to the software driver, the loaded preset firmware and the memory controller with the parameter configuration completed.
It will be appreciated that a software driver is a small piece of code that is added to the operating system and contains information about the hardware device. Is software that enables high-level computer programs to interact with hardware devices. Software drivers are related to the operating system and hardware. The software driver tells the operating system how to communicate with the device, and when the computer program requests interaction with a hardware device, the software driver will handle the instruction and output transitions between the device and the computer program that invokes the software driver.
That is, after the initialization is completed according to the image processor and the software driver, the memory controller is already configured according to the memory parameter, and the preset firmware corresponding to the image processor is also loaded, so that the image processor can directly control the memory to realize the startup of the image processor.
In some embodiments, the software driver may control the image processor to process the image data input from the camera, obtain the preprocessed image data after the image data is processed, and send the preprocessed image processing data to the central processor, where the central processor processes the preprocessed image data, and finally obtain the picture displayed on the screen of the electronic device.
By shortening the starting time consumption of the image processor and improving the starting speed of the image processor, the camera can be started and image data can be processed more quickly.
In summary, in the embodiment of the present application, by storing the memory parameters of the image processor and the preset firmware of the image processor in various scenarios on the terminal, when the central processor receives the camera start request, before the software driver of the image processor is invoked, the memory parameters and the preset firmware related to the image processor are acquired, the memory controller of the image processor is configured with parameters, and the preset firmware corresponding to the image processor is loaded, and when the software driver of the image processor is invoked according to the camera start request, the image processor is started according to the software driver, the preset firmware and the memory controller whose parameter configuration is completed. The parameter test time of the memory controller after the initialization of the image processor is finished is saved, the time of loading the preset firmware of the image processor after the initialization of the image processor is finished is saved, and the starting speed of the image processor is improved.
For a more detailed description of the image processor starting method in the present application, please continue to refer to fig. 2, fig. 2 is a second flowchart of the image processor starting method according to the embodiment of the present application. The image processor starting method can save the starting time of the image processor and accelerate the starting speed of the image processor. The image processor starting method may include the steps of:
210. and acquiring historical memory parameters related to the image processor when the camera is operated at least once, and storing the historical memory parameters in a local area.
It will be appreciated that when the camera is in operation, a camera is required to capture image data, and an image processor is required to process the image, and a central processor is required to process the image data. When the image processor runs each time, the memory controller needs to be adjusted according to the temperature due to the temperature change of the electronic equipment, so that the memory has better performance to read and write data.
In the process of starting the image processor, the memory needs to be tested, for example, when a low-power-consumption double-rate synchronous dynamic random access memory (LPDDR, low Power Double Data Rate SDRAM) memory is adopted, or when a double-rate synchronous dynamic random access memory (DDR, double Data Rate SDRAM) memory is adopted, the memory needs to be tested (DDR tracking), and then the image processor loads firmware corresponding to the image processor in the memory to finish the starting of the image processor.
Because the image processor requires high speed bandwidth, the faster the speed, the more stringent the timing on the memory bus, and read and write errors can occur with slight deviations. The temperature change affects the output timing of the memory controller, so different memory parameters need to be configured for different temperatures, thereby preventing read-write errors.
After the graphics processor is started, the historical memory parameters corresponding to the historical temperature information can be stored in the local storage of the electronic device. For example, when the temperature of the electronic device is 36 ℃, the memory parameter corresponding to 36 ℃ is stored. The memory parameters include a plurality of parameters, and each temperature corresponds to a set of memory parameters.
220. When the central processing unit receives a camera starting request, current temperature information and preset firmware of the electronic equipment are obtained.
In some embodiments, the central processor may obtain temperature information of the current electronic device when the central processor receives a camera activation request. Such as temperature information from a memory location via a temperature sensor. The temperature information may be changed according to the use of the electronic device, for example, when the electronic device processes a task with a large amount of data, the chip generates a large amount of heat, so that the temperature information of the electronic device can be detected in real time, or a detection time period is set, and the temperature is detected and acquired at intervals.
When the central processing unit receives the camera starting request, preset firmware related to the image processor can be acquired. For example, the preset firmware is obtained from the main memory corresponding to the central processing unit.
Referring to fig. 3 together, fig. 3 is a third flow chart of the method for starting up the image processor according to the embodiment of the present application. In some embodiments, it may also be determined whether the image processor-related memory parameters and the preset firmware are stored in the electronic device. Thereby enabling the image processor in different ways.
301. And when the central processing unit receives a camera starting request, acquiring current temperature information of the electronic equipment.
In some embodiments, after the temperature information of the electronic device is obtained, it may be determined whether the memory parameter and the preset firmware related to the image processor are stored in the electronic device.
When the memory parameter and the preset firmware related to the image processor exist in the electronic equipment, the starting of the image processor can be completed by directly using the memory parameter and the preset firmware.
When there are no memory parameters and preset firmware associated with the image processor in the electronic device, step 302 is entered.
302. If the memory parameters and the preset firmware corresponding to the image processor are not stored in the electronic equipment, calling a software driver of the image processor according to the camera starting request.
When there is no memory parameter corresponding to the image processor in the electronic device, the software driver of the image processor needs to be called according to the camera start request at this time, and then step 303 is entered.
303. And performing parameter test and configuration on a memory controller of the image processor, and storing the memory parameters.
According to the parameter test of the memory controller, a set of proper memory parameters at the current temperature can be found to control the memory. And simultaneously, the memory parameter and the corresponding temperature information are stored.
304. Downloading preset firmware related to the image processor and loading the preset firmware to finish the starting of the image processor.
And downloading the preset firmware through a network and loading the preset firmware under the condition that the preset firmware corresponding to the image processor does not exist or the stored preset firmware is lost, which is stored on the electronic equipment, so that the starting of the image processor is completed.
In this embodiment, by detecting the memory parameter and the preset firmware on the electronic device, the image processor can be started in other ways according to the memory parameter and the change of the preset firmware stored on the electronic device, so as to prevent the image processor from being failed to start.
With continued reference to fig. 2, in step 230, a memory parameter is determined from the historical memory parameters based on the temperature information.
Since the temperature inside the electronic device will have a certain influence on the memory, the memory needs to be subjected to a memory parameter test to obtain a proper memory parameter. In the application, in order to save the time of testing the memory parameter, the memory parameter corresponding to the current temperature can be determined in the historical memory parameter according to the temperature information.
Referring to fig. 4 together, fig. 4 is a fourth flowchart of an image processor starting method according to an embodiment of the present disclosure.
401. And when the central processing unit receives a camera starting request, acquiring current temperature information of the electronic equipment.
The current temperature information of the electronic equipment can be determined according to the temperature value acquired by the temperature sensor.
402. And acquiring memory parameters and preset firmware related to the image processor.
Specifically, the historical memory parameters and the preset firmware may be obtained from a memory inside the electronic device.
403. And judging whether historical temperature information corresponding to the temperature information exists in the historical memory parameters.
If there is historical temperature information corresponding to the temperature information in the historical memory parameters, it is indicated that there is an appropriate memory parameter under the current temperature information, and step 404 is entered.
If there is no historical temperature information corresponding to the temperature information in the historical memory parameters, it indicates that there is no suitable memory parameter in the current temperature information, and step 405 is entered.
404. And determining the historical memory parameter corresponding to the historical temperature information as the memory parameter.
In some embodiments, the current temperature information and the historical temperature information may be compared, for example, if the current temperature information and the historical temperature information are the same, the memory parameter corresponding to the historical temperature information may be directly used as the memory parameter of the current temperature. For another example, after the current temperature information is obtained, a historical memory parameter corresponding to the closest historical temperature is found, and the historical memory parameter is used as a memory parameter related to the image processor under the current temperature information.
405. And if the historical temperature information corresponding to the temperature information does not exist in the historical memory parameters, acquiring the corresponding memory parameters from the network according to the current temperature information.
In some embodiments, a memory parameter corresponding to the current temperature information may be obtained on the network according to the current temperature information, and then the memory parameter is downloaded to the electronic device locally. If there are multiple sets of downloaded memory parameters, the method can be based on the prior downloaded memory parameters
In some embodiments, without a network, the memory controller may be further parameter tested after the image processor is initialized, and a set of suitable memory parameters at the current temperature may be found to control the memory.
With continued reference to fig. 2, in step 240, a register associated with a memory parameter in the memory controller is determined, and the register is configured according to the memory parameter.
In some embodiments, the cpu may perform parameter setting on the memory controller corresponding to the image processor in advance according to the acquired memory parameter, for example, may perform parameter setting on a register related to the memory parameter in the memory controller. For example, there is A, B, C in the registers related to the memory parameters, the parameters corresponding to the register a are stored in the register a, the parameters corresponding to the register B are stored in the register B, and the parameters corresponding to the register C are stored in the register C.
The parameter configuration of the memory controller of the image processor is completed before the image processor is initialized by the software driver, and no more time is needed for the parameter configuration of the memory controller after the image processor is initialized by the software driver.
250. And calling a software driver of the image processor according to the camera starting request, and loading preset firmware.
After the image processor is powered on, the initialization of the image processor is completed, and meanwhile, a software driver is called and preset firmware is loaded.
In some embodiments, the loading of the preset firmware may be performed by loading the preset firmware into the corresponding hardware device before the initialization of the image processor is completed, so that the loading of the preset firmware of the image processor is completed after the initialization of the software is completed. The time for calling the software driver to continue loading the preset firmware after the initialization of the image processor is completed is saved.
260. And starting the image processor according to the software driver, the loaded preset firmware and the memory controller with the parameter configuration completed.
After the initialization is completed according to the image processor and the software driver, the memory controller is completed according to the memory parameter configuration, and the preset firmware corresponding to the image processor is loaded, so that the image processor can directly control the memory to realize the starting of the image processor.
270. And acquiring and storing related parameter information which needs to be initialized in the running process of the image processor.
The image processor, when running, may cooperate with a plurality of modules in the electronic device, such as the image processor and the central processing unit, to process the image data, and the image processor and the camera cooperate to process the image data.
In some embodiments, when the image processor is running and the temperature of the electronic device is changed, the memory parameter is changed accordingly, and the memory parameter corresponding to the changed temperature can be obtained and stored. As another example, some debug parameters, such as parameters that interface with a camera module, need to be initialized between the graphics processor and other modules. By storing the relevant parameters that need to be initialized when the image processor is required to be started.
280. And calling the related parameter information to finish the starting of the image processor when the image processor is started next time.
By locally storing the memory parameters and preset firmware of the image processor and other relevant parameters that need to be initialized when the image processor is started up in the electronic device. When the image processor is started next time, the memory parameters, the preset firmware and other related parameters can be directly called, so that the starting time of the image processor is shortened, and the starting speed of the image processor is accelerated.
In summary, in the embodiment of the present application, by storing the memory parameters of the image processor and the preset firmware of the image processor in various scenarios on the terminal, when the central processor receives the camera start request, before the software driver of the image processor is invoked, the memory parameters and the preset firmware related to the image processor are acquired, the memory controller of the image processor is configured with parameters, and the preset firmware corresponding to the image processor is loaded, and when the software driver of the image processor is invoked according to the camera start request, the image processor is started according to the software driver, the preset firmware and the memory controller whose parameter configuration is completed. The parameter test time of the memory controller after the initialization of the image processor is finished is saved, the time of loading the preset firmware of the image processor after the initialization of the image processor is finished is saved, and the starting speed of the image processor is improved.
In order to further understand the operation of the image processor during startup, please continue to refer to fig. 5, fig. 5 is a schematic diagram of a flow chart of startup of the image processor according to an embodiment of the present application.
When a user needs to take a picture, the user takes the picture by opening a camera application of the electronic equipment when taking the picture by using the electronic equipment. For example, the user generates a camera start request by means of voice control, eyeball control, touching a screen icon, pressing a specific physical key, and the like, and sends the camera start request to the central processing unit, and the central processing unit controls the electronic device to open the camera to take a picture.
At this time, a power-on interface of the image processor is provided at a hardware abstraction layer (Pre ISP HAL) corresponding to the image processor, and the image processor is powered on by the hardware abstraction layer, and a corresponding start-up process, such as an init process, is generated. There are also generated some configuration parameters, data information, etc. In this process, the cpu has acquired the memory parameters of the memory processor, and has completed the parameter configuration of the memory controller of the image processor using the memory parameters.
The hardware abstraction layer transfers some information to the kernel (kernel), where the software driver of the image processor can be called and the firmware of the image processor loaded. Meanwhile, the hardware abstraction layer can load camera firmware and call a camera software driver for a sensor unit of the camera.
And finally, the image processor finishes starting, the camera finishes starting while the image processor finishes starting, the image data acquired by the camera is transmitted to the image processor for preprocessing, the image processor sends the preprocessed data to the central processing unit, and the central processing unit processes the preprocessed image data to obtain final image data.
In the embodiment of the application, before the image processor calls the software driver, the parameter configuration of the memory controller of the image processor is finished, and the loading of the firmware of the image processor is finished when the software driver is called. These steps do not need to be performed until the initialization of the image processor is completed, so that the starting time of the image processor is saved.
Correspondingly, the embodiment of the application also provides an electronic device, and referring specifically to fig. 6, fig. 6 is a schematic first structural diagram of the electronic device provided in the embodiment of the application.
The image processor and the central processing unit are connected through an interconnection bus, such as a PCIE (peripheral component interconnect express) bus, and the PCIE bus has the characteristics of point-to-point dual-channel high-bandwidth transmission. The image processor may also be connected to the central processor by MI PI (Mobile Industry Processor Interface ) lines.
In some embodiments, the image processor includes a memory controller and a storage, where the memory controller may be integrated on the image processor or may be separately provided outside the image processor. The memory controller can control the memory to realize data transmission.
The memory may store an operating system of the image processor, the memory may store RAW image data acquired by the image processor, such as RAW data, and the memory may also store results processed by the image processor, i.e., pre-processed image data. The memory 2 may be a dynamic memory such as a Double Data Rate synchronous dynamic random access memory (DDR).
In some embodiments, when the electronic device receives the camera start request, the central processor acquires the memory parameter and the preset firmware corresponding to the image processor according to the camera start request, powers on the image processor, invokes the software driver of the image processor, and loads the preset firmware at the same time, and after the initialization of the image processor is completed, the image processor can be started directly by using the memory and the preset firmware.
In some embodiments, if there is no stored historical memory parameter in the electronic device, the software driver of the image processor is called according to the camera start request to complete the initialization of the image processor, the memory parameter setting is performed on the initialized image processor, the preset firmware is obtained and loaded, and finally the starting of the image processor is completed.
With continued reference to fig. 7, fig. 7 is a second schematic structural diagram of the electronic device according to the embodiment of the present application.
The electronic device provided by the embodiment of the application can further comprise an image sensor, the image sensor can be understood as a camera on the electronic device, the image sensor can be connected with an image processor, and the image sensor can be connected with a central processing unit.
In some embodiments, the image sensor is connected to the central processor through an interconnection bus, such as a PCIE (peripheral component interconnect express) bus, and the PCIE bus has the characteristics of point-to-point dual-channel high-bandwidth transmission. The image sensor may also be connected to the central processor through MI PI (Mobile Industry Processor Interface ) lines.
The image sensor and the image processor are connected through an interconnection bus, such as a PCIE (peripheral component interconnect express) bus, and the PCIE bus has the characteristic of point-to-point dual-channel high-bandwidth transmission. The image sensor may also be connected to the image processor through an MI PI (Mobile Industry Processor Interface ) line.
The image sensor may include a Complementary Metal Oxide Semiconductor (CMOS) image sensor, a charge coupled device (Charge Coupled Device, CCD) image sensor, or the like.
In some embodiments, when a camera start request is received, the central processor may call the stored memory parameters of the image processor and preset firmware, and may also call the firmware corresponding to the image sensor. The central processing unit loads the firmware of the image processor by calling a software driver of the image processor. And meanwhile, a software driver of the image sensor can be called to load the firmware of the image sensor. At the same time as the image processor is started, the image sensor is started.
In some embodiments, before the image processor is started, a software driver of the camera can be acquired according to a camera starting request, and camera firmware of the camera can be loaded. And when the image processor is started, the starting of the camera is completed according to the software driver of the camera and the camera firmware. After the camera acquires the image data, the camera transmits the acquired image data to the image processor. So that the image processor processes the image data immediately after start-up.
With continued reference to fig. 8, fig. 8 is a third schematic structural diagram of the electronic device according to the embodiment of the present application. Wherein the electronic device 500 comprises: an input unit 501, a display unit 502, a central processor 503, an image processor 504, a power source 505, a sensor 506, and a memory 507. It will be appreciated by those skilled in the art that the terminal structure shown in fig. 8 is not limiting of the terminal and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
The input unit 501 may be used to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, in one particular embodiment, the input unit 501 may include a touch-sensitive surface, as well as other input devices. The input unit transmits the input data to the central processing unit 503, and can receive and execute a command transmitted from the central processing unit 503. In addition, touch sensitive surfaces may be implemented in a variety of types, such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch-sensitive surface, the input unit 501 may also comprise other input devices. In particular, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, mouse, joystick, etc.
The display unit 502 may be used to display information input by a user or information provided to the user and various graphical user interfaces of the terminal, which may be composed of graphics, text, icons, video and any combination thereof. The display unit 502 may include a display panel, which may optionally be configured in the form of a liquid crystal display (LCD, liquid Crystal Display), an Organic Light-Emitting Diode (OLED), or the like.
The memory 507 may be used to store software programs and modules, and the central processor 503 and the next processor execute various functional applications and data processing by running the software programs and modules stored in the memory 507. The memory 507 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, application programs required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the terminal, etc. In addition, memory 507 may include high speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 507 may also include a memory controller to provide access to the memory 507 by the central processor 503 and the input unit 501.
The central processor 503 is a control center of the terminal, and connects various parts of the entire mobile phone using various interfaces and lines, and performs various functions of the terminal and processes data by running or executing software programs and/or modules stored in the memory 507 and calling data stored in the memory 507, thereby performing overall monitoring of the mobile phone. The central processor 503 is connected to the image processor 504, the image data processed by the image processor 504 may be transmitted to the central processor 503 for processing, and the image processed by the central processor 503 may be displayed by the display unit 502.
The terminal further comprises a power source 505 (e.g. a battery) for powering the various components, which may preferably be logically connected to the central processor 503 and the image processor 504 via a power management system, whereby the functions of managing charging, discharging, and power consumption are achieved via the power management system. The power source 505 may also include one or more of any components, such as a direct current or alternating current power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
The terminal may also include at least one sensor 506, such as a light sensor, a motion sensor, an image sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel according to the brightness of ambient light, and a proximity sensor that may turn off the display panel and/or backlight when the terminal moves to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and the direction when the mobile phone is stationary, and can be used for applications of recognizing the gesture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that may also be configured in the terminal are not described in detail herein.
Although not shown, the terminal may further include a camera, a bluetooth module, etc., which will not be described herein. In this embodiment, the central processor 503 in the terminal loads executable files corresponding to the processes of one or more application programs into the memory 507 according to the following instructions, and the central processor 503 runs the application programs stored in the memory 507, so as to implement various functions:
when the central processing unit receives a camera starting request, judging whether the memory parameter and the preset firmware corresponding to the image processor are stored in the electronic equipment or not;
if yes, acquiring memory parameters and preset firmware related to the image processor;
performing parameter configuration on a memory controller of the image processor according to the memory parameter;
calling a software driver of the image processor according to a camera starting request, and loading the preset firmware;
starting the image processor according to the software driver, the loaded preset firmware and the memory controller with the parameter configuration completed;
if not, calling a software driver of the image processor according to a camera starting request to initialize the image processor;
And performing memory parameter setting on the initialized image processor, acquiring and loading the preset firmware, and starting the image processor.
Those of ordinary skill in the art will appreciate that all or a portion of the steps of the various methods of the above embodiments may be performed by instructions, or by instructions controlling associated hardware, which may be stored in a computer-readable storage medium and loaded and executed by a processor.
To this end, embodiments of the present application provide a storage medium having stored therein a plurality of instructions capable of being loaded by a processor to perform steps in any of the image processor startup methods provided by embodiments of the present application. For example, the instructions may perform the steps of:
when the central processing unit receives a camera starting request, acquiring memory parameters and preset firmware related to the image processor;
performing parameter configuration on a memory controller of the image processor according to the memory parameter;
calling a software driver of the image processor according to a camera starting request, and loading the preset firmware;
and starting the image processor according to the software driver, the loaded preset firmware and the memory controller with the parameter configuration completed.
The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.
Wherein the storage medium may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like.
The instructions stored in the storage medium may perform steps in any of the image processor starting methods provided in the embodiments of the present application, so that the beneficial effects that any of the image processor starting methods provided in the embodiments of the present application can be achieved are detailed in the previous embodiments, and are not repeated herein.
The image processor starting method, the electronic device and the storage medium provided in the embodiments of the present application are described in detail, and specific examples are applied to illustrate the principles and the implementation of the present application, where the description of the above embodiments is only used to help understand the method and the core idea of the present application; meanwhile, those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, and the present description should not be construed as limiting the present application in view of the above.

Claims (10)

1. An image processor starting method is applied to an electronic device, wherein the electronic device comprises a central processing unit and an image processor, and the method comprises the following steps:
when the central processing unit receives a camera starting request, acquiring current temperature information of the electronic equipment;
acquiring memory parameters and preset firmware related to the image processor according to the temperature information, wherein the preset firmware comprises firmware corresponding to the image processor and firmware corresponding to a camera;
performing parameter configuration on a memory controller of the image processor according to the memory parameter;
generating a starting instruction according to the camera starting request and sending the starting instruction to the image processor so that the image processor is electrified;
after the image processor is powered on, initializing the image processor by calling a software driver of the image processor, and loading the preset firmware, so that the initialized image processor directly uses the loaded preset firmware;
and starting the image processor according to the software driver, the loaded preset firmware and the memory controller with the parameter configuration completed.
2. The method of claim 1, wherein prior to retrieving the image processor-related memory parameters, the method further comprises:
acquiring historical memory parameters related to the image processor when the camera is operated at least once;
the acquiring the memory parameter related to the image processor includes:
and determining the memory parameter in the historical memory parameter according to the temperature information.
3. The method according to claim 2, wherein determining the memory parameter from the historical memory parameters according to the temperature information comprises:
judging whether historical temperature information corresponding to the temperature information exists in the historical memory parameters or not;
if yes, determining the historical memory parameter corresponding to the historical temperature information as the memory parameter.
4. The method of claim 1, wherein before the image processor is started up by the memory controller configured according to the software driver, the loaded preset firmware, and parameters, the method further comprises:
judging whether the camera application runs in the foreground or not in a preset time period;
If yes, starting the image processor according to the software driver, the loaded preset firmware and the memory controller with the parameter configuration completed.
5. The method of claim 1, wherein the performing parameter configuration on the memory controller according to the memory parameter comprises:
determining a register in the memory controller associated with the memory parameter;
and carrying out parameter configuration on the register according to the memory parameter.
6. The image processor startup method according to any one of claims 1 to 5, characterized in that after startup of the image processor, the method further comprises:
acquiring and storing related parameter information to be initialized in the running process of the image processor;
and calling the related parameter information to finish the starting of the image processor when the image processor is started next time.
7. An electronic device, comprising:
the central processing unit and the image processor are electrically connected;
the central processor is configured to:
when the central processing unit receives a camera starting request, acquiring current temperature information of the electronic equipment;
Judging whether the memory parameter corresponding to the image processor and preset firmware are stored in the electronic equipment according to the temperature information, wherein the preset firmware comprises the firmware corresponding to the image processor and the firmware corresponding to the camera;
if yes, acquiring memory parameters and preset firmware related to the image processor;
performing parameter configuration on a memory controller of the image processor according to the memory parameter;
generating a starting instruction according to a camera starting request and sending the starting instruction to the image processor so that the image processor is electrified;
after the image processor is powered on, initializing the image processor by calling a software driver of the image processor, and loading the preset firmware, so that the initialized image processor directly uses the loaded preset firmware;
starting the image processor according to the software driver, the loaded preset firmware and the memory controller with the parameter configuration completed;
if not, calling a software driver of the image processor according to a camera starting request to initialize the image processor;
and performing memory parameter setting on the initialized image processor, acquiring and loading the preset firmware, and starting the image processor.
8. The electronic device of claim 7, wherein the electronic device further comprises:
the camera is electrically connected with the image processor and the central processing unit;
the central processor is configured to:
before the image processor is started, acquiring a software driver of the camera according to the camera starting request, and loading camera firmware of the camera;
and when the image processor is started, starting the camera according to the software driver of the camera and the camera firmware.
9. The electronic device of claim 8, wherein the camera transmits the acquired image data to the image processor after the camera acquires the image data.
10. A storage medium storing a plurality of instructions adapted to be loaded by a processor to perform the steps of the image processor activation method of any one of claims 1 to 6.
CN202010478300.6A 2020-05-29 2020-05-29 Image processor starting method, electronic device and storage medium Active CN113747043B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010478300.6A CN113747043B (en) 2020-05-29 2020-05-29 Image processor starting method, electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010478300.6A CN113747043B (en) 2020-05-29 2020-05-29 Image processor starting method, electronic device and storage medium

Publications (2)

Publication Number Publication Date
CN113747043A CN113747043A (en) 2021-12-03
CN113747043B true CN113747043B (en) 2023-06-20

Family

ID=78724932

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010478300.6A Active CN113747043B (en) 2020-05-29 2020-05-29 Image processor starting method, electronic device and storage medium

Country Status (1)

Country Link
CN (1) CN113747043B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114035842B (en) * 2022-01-07 2022-04-08 飞腾信息技术有限公司 Firmware configuration method, computing system configuration method, computing device and equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1920878A (en) * 2005-08-24 2007-02-28 松下电器产业株式会社 Image processing apparatus
JP2009123091A (en) * 2007-11-16 2009-06-04 Ricoh Co Ltd Image processor, image processing method, and program
CN105827909A (en) * 2016-01-25 2016-08-03 维沃移动通信有限公司 Dual-camera quick start method and mobile terminal
CN108984219A (en) * 2018-08-29 2018-12-11 迈普通信技术股份有限公司 Memory parameter configuration method and electronic equipment
CN111143104A (en) * 2019-12-29 2020-05-12 苏州浪潮智能科技有限公司 Memory exception processing method and system, electronic device and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1920878A (en) * 2005-08-24 2007-02-28 松下电器产业株式会社 Image processing apparatus
JP2009123091A (en) * 2007-11-16 2009-06-04 Ricoh Co Ltd Image processor, image processing method, and program
CN105827909A (en) * 2016-01-25 2016-08-03 维沃移动通信有限公司 Dual-camera quick start method and mobile terminal
CN108984219A (en) * 2018-08-29 2018-12-11 迈普通信技术股份有限公司 Memory parameter configuration method and electronic equipment
CN111143104A (en) * 2019-12-29 2020-05-12 苏州浪潮智能科技有限公司 Memory exception processing method and system, electronic device and storage medium

Also Published As

Publication number Publication date
CN113747043A (en) 2021-12-03

Similar Documents

Publication Publication Date Title
US11069323B2 (en) Apparatus and method for driving display based on frequency operation cycle set differently according to frequency
US20190227703A1 (en) Electronic device for controlling a plurality of applications
US10402222B2 (en) Task migration method and apparatus
US11086447B2 (en) Electronic device and method for controlling touch sensor controller on basis of image synchronization signal
US10803785B2 (en) Electronic device and method for controlling output timing of signal corresponding to state in which content can be received based on display location of content displayed on display
US20230343305A1 (en) Electronic device and method for operating high speed screen of electronic device
US11514831B2 (en) Electronic device and method for controlling storage of content displayed on display panel
KR102517228B1 (en) Electronic device for controlling predefined function based on response time of external electronic device on user input and method thereof
EP3926466A1 (en) Electronic device which prefetches application and method therefor
US20220210264A1 (en) Method and apparatus for executing application
WO2019019818A1 (en) Method and apparatus for accelerating black screen gesture processing, storage medium, and mobile terminal
CN110471870B (en) Multi-system operation method and device, electronic equipment and storage medium
CN116339838A (en) Server starting method and device, electronic equipment and storage medium
CN107341094B (en) Method and device for measuring time consumed by starting item
CN113747043B (en) Image processor starting method, electronic device and storage medium
US20210240434A1 (en) Electronic device and volume adjustment method of electronic device
CN108984259B (en) Interface display method and device and terminal
US20170047057A1 (en) Electronic device and method for reproducing sound in the electronic device
US10796398B2 (en) Electronic device for displaying image and method for controlling the same
US20220004244A1 (en) Method and device for determining compensation for touch data on basis of operating mode of display
KR20210046426A (en) Application optimizing method and electronic device supporting the same
CN113867804A (en) Starting method of real-time operating system, electronic equipment and storage medium
US10666789B2 (en) Control method and device for sensors of mobile terminal, storage medium and mobile terminal
CN114071007A (en) Image processing method, multimedia processing chip and electronic equipment
CN111027406A (en) Picture identification method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant