KR102543344B1 - Image processing apparatus, method for controlling the same, and computer-readable storage medium - Google Patents

Abstract

The image processing device includes the total memory usage obtained from the memory usage of each acquired image process and the memory usage when executing the requested new image process, and the allowable memory indicating the memory usage allowed for use by the process executing the plug-in application. The capacities are compared, and as a result of the comparison, if the total memory usage does not exceed the allowable memory capacity, new image processing is executed, and if the total memory usage exceeds the allowable memory capacity, new image processing is not executed and the request source , an error indicating that new image processing cannot be executed due to insufficient memory is reported.

Description

Image processing apparatus, control method thereof, and computer readable storage medium

The present invention relates to an image processing apparatus, a control method thereof, and a computer readable storage medium.

Conventionally, when executing various jobs including image processing that are not provided by an image processing device, it is known to create a job execution application including a new image processing as a plug-in and install it in the image processing device to realize the new image processing. there is. Various jobs are device control processes including image processing executable on the image processing apparatus, such as copy, print, scan and save, and scan and transmit, for example. New image processing is processing that cannot be realized in existing jobs of image processing apparatuses, such as skew correction for input data, format conversion, or translation conversion after OCR (Optical Character Recognition).

An image processing apparatus to which a plurality of new image processes have been added can be operated in parallel with the added new image processes. However, if a plurality of image processes that use a large amount of memory are executed simultaneously, the amount of memory used may exceed the upper limit of the memory of the image processing device.

When the amount of memory used exceeds the upper limit of the memory, the OS performs a swap operation to save data in an infrequently used memory area to the hard disk, free the area, and rewrite data to the memory as necessary. At this time, there is a case where a recording process is performed on the HDD and this process deteriorates the performance of various processes in this process. For example, when a UI module exists in this process, a phenomenon in which the UI screen does not respond quickly to a user's manipulation may occur. Further, a phenomenon may occur in which the time until completion of a plurality of image processes being executed on the same process is longer than the time taken when no swap operation is performed. When the swap area is also used up, the OS forcibly terminates the process that uses a lot of memory resources. In this case, since the process of performing image processing ends, image processing cannot be restarted unless the image processing apparatus is restarted.

In order to solve this problem, Japanese Patent Application Publication No. 2013-120103 proposes a technique of measuring the memory usage of each plug-in in real time and not activating the plug-in when it exceeds a predetermined maximum amount of memory.

However, the related art has problems described below. In this related art, for example, when a plug-in is activated, the sum of the declaration amount of used memory defined in each plug-in and the amount of memory used already in the image processing device is calculated. When the total amount of memory used exceeds the predetermined maximum amount of memory, the above-described memory shortage is avoided by not activating the plug-in itself. In the above control, when the calculated memory usage exceeds the maximum amount of memory, a new plug-in cannot be started unless an already activated plug-in is stopped. In practice, even plug-ins that can be executed cannot be activated and processed unless they are executed in parallel. This lowers user convenience.

The present invention provides an implementation of a mechanism that dynamically calculates the total memory usage during processing execution (at runtime) and executes multiple image processing in parallel, without restricting the startup of the plug-in itself and preferably avoiding memory shortages. make it possible

One aspect of the present invention is an image processing apparatus capable of executing a plurality of image processing by one or more plug-in applications, comprising: a memory device storing a set of instructions; and executing the set of commands to search for a plug-in application capable of executing the new image processing, if execution of a new image process by the plug-in application is requested during execution of image processing by the plug-in application, and the searched plug-in A memory usage amount when the new image processing by the plug-in application is executed, which is held together with the application, and a memory usage amount of each of the image processing already executed by the plug-in application are acquired, and the acquired memory of each image process is acquired. The total memory usage obtained from the usage amount and the memory usage when executing the requested new image processing is compared with the allowable memory capacity indicating the memory usage allowed in the process executing the plug-in application, and as a result of the comparison, the total memory usage is calculated. If the usage amount does not exceed the allowable memory capacity, the new image processing is executed, and when the total memory usage amount exceeds the allowable memory capacity, the new image processing is not executed, and the request source is caused by memory shortage. An image processing apparatus having at least one processor notifying an error indicating that the new image processing cannot be executed is provided.

Another aspect of the present invention is capable of executing a plurality of image processing in a first execution environment for executing a program written in a first programming language and a second execution environment for executing a program written in a second programming language. An image processing apparatus comprising: a memory device for storing a set of instructions; and executing the set of instructions, so that, during execution of image processing in the first execution environment, execution of new image processing by a first application written in the first programming language is requested, the new image processing is executed. Memory usage when the executable first application is searched and the new image processing by the first application, which is maintained together with the searched first application, is executed, and an image already executed in the first execution environment The memory usage amount of each process is acquired, the total memory usage amount obtained from the acquired memory usage amount of each image process and the memory usage amount when the requested new image process is executed, and the memory allowed to be used in the first execution environment. Comparing allowable memory capacities representing usage amounts, and as a result of the comparison, if the total memory usage does not exceed the allowable memory capacity, the new image processing is executed; and if the total memory usage exceeds the allowable memory capacity, the An image processing apparatus having at least one processor notifying an error indicating that the new image processing cannot be executed due to insufficient memory to a request source without executing the new image processing.

Another aspect of the present invention is a method for controlling an image processing apparatus capable of executing a plurality of image processes by one or more plug-in applications, wherein, while image processing is executed by a plug-in application, a new image process is executed by a plug-in application. If required, the step of searching for a plug-in application capable of executing the new image processing, the memory usage when executing the new image processing by the plug-in application, which is maintained together with the searched plug-in application, and the plug-in application Acquiring the memory usage of each image process already being executed, the total memory usage obtained from the acquired memory usage of each image process and the memory usage when executing the requested new image process, and the process of executing the plug-in application Comparing an allowable memory capacity indicating a memory usage allowed for use in the memory; and as a result of the comparison, if the total memory usage does not exceed the allowable memory capacity, the new image processing is executed, and the total memory usage is and notifying the requester of an error indicating that the new image processing cannot be executed due to memory shortage, without executing the new image processing when the allowable memory capacity is exceeded.

Another aspect of the present invention is to execute a plurality of image processing in a first execution environment for executing a program written in a first programming language and a second execution environment for executing a program written in a second programming language. As a possible control method of an image processing apparatus, when execution of new image processing by a first application written in the first programming language is requested during execution of image processing in the first execution environment, the new image processing is performed. The step of searching for the executable first application, the memory usage when executing a new image processing by the first application, which is maintained together with the searched first application, and the memory usage that is already running in the first execution environment. Acquiring the memory usage amount of each image process, the total memory usage amount obtained from the acquired memory usage amount of each image process and the memory usage usage when the requested new image process is executed, and the usage in the first execution environment comparing the allowable memory capacity indicating the allowable memory usage; and if the total memory usage does not exceed the allowable memory capacity as a result of the comparison, the new image processing is executed, and the total memory usage is the allowed memory capacity. and notifying an error indicating that the new image processing cannot be executed due to insufficient memory to the request source, without executing the new image processing.

Another aspect of the present invention is a non-temporary computer readable memory storing a computer program for causing a computer to execute each step in a control method of an image processing apparatus capable of executing a plurality of image processing by one or more plug-in applications. As a medium, the control method includes: searching for a plug-in application capable of executing the new image processing, when execution of a new image processing by a plug-in application is requested during execution of image processing by a plug-in application; Acquiring a memory usage when executing the new image processing by the plug-in application, which is maintained together with the plug-in application, and a memory usage of each image process already being executed by the plug-in application; Comparing the total memory usage obtained from the memory usage and the memory usage when executing the requested new image processing with the allowable memory capacity indicating the memory usage allowed in the process executing the plug-in application, and the result of the comparison When the total memory usage amount does not exceed the allowable memory capacity, the new image processing is executed; when the total memory usage amount exceeds the allowable memory capacity, the new image processing is not executed, and the memory memory for the request source is executed. and notifying an error indicating that the new image processing cannot be executed due to shortage.

Another aspect of the present invention is to execute a plurality of image processing in a first execution environment for executing a program written in a first programming language and a second execution environment for executing a program written in a second programming language. A non-transitory computer-readable storage medium storing a computer program for causing a computer to execute each step in a possible control method of an image processing apparatus, wherein the control method is stored in a plug-in application during execution of image processing by the plug-in application. Searching for a plug-in application capable of executing the new image processing, when execution of the new image processing is requested, and providing the acquisition unit with the new image processing by the plug-in application that is maintained together with the searched plug-in application. Acquisition of the memory usage at the time of execution and the memory usage of each of the image processes already being executed by the plug-in application, the memory usage of each of the acquired image processes and the memory usage at the time of executing the requested new image process A comparison step of comparing the total memory usage obtained from the above and the allowable memory capacity indicating the memory usage allowed for use in a process executing the plug-in application, and as a result of the comparison, if the total memory usage does not exceed the allowable memory capacity, When the new image processing is executed, and the total memory usage exceeds the allowable memory capacity, the new image processing is not executed, and an error indicating that the new image processing cannot be executed due to insufficient memory for the request source. It provides a storage medium comprising the step of notifying.

Further features of the present invention will become apparent from the following detailed description of the embodiments given with reference to the accompanying drawings.

1 is a diagram showing an example of a configuration of an image processing formation system according to an embodiment.
Fig. 2 is a block diagram showing an example of a hardware configuration of an image processing apparatus according to an embodiment.
Fig. 3 is a block diagram showing an example of a software configuration of an image processing apparatus according to an embodiment.
Fig. 4 is a flowchart showing processing procedures of an image processing apparatus according to an embodiment.
5 is a flowchart illustrating a processing procedure of a native image processing server according to an embodiment.
Fig. 6 is a block diagram showing an example of a software configuration of an image processing apparatus according to an embodiment.
Fig. 7 is a flowchart showing processing procedures of an image processing apparatus according to an embodiment.
8A and 8B are flowcharts illustrating processing procedures of a native image processing module according to an embodiment.
9 is a flowchart illustrating a processing procedure of a native image processing server according to an embodiment.
10 is a flowchart illustrating a processing procedure of a native image processing server according to an embodiment.
Fig. 11 is a flowchart illustrating a processing procedure of a native image processing module according to an embodiment.

Hereinafter, embodiments of the present invention will be described in more detail with reference to the accompanying drawings. At this time, it should be noted that the relative arrangement, formulas, and numerical values of the components described in the present embodiment do not limit the protection scope of the present invention unless specifically stated otherwise.

<First Embodiment>

<System Configuration>

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a first embodiment of the present invention will be described with reference to the accompanying drawings. First, with reference to Fig. 1, an example of the configuration of an image forming system will be described. The image forming system according to the present embodiment includes image processing devices 101 and 102 , information processing terminals 103 and 104 , and a server 105 . The image processing devices 101 and 102 , the information processing terminals 103 and 104 , and the server 105 are connected via a network 106 to enable communication with each other.

In Fig. 1, an example in which two image processing devices 101 and 102 are arranged is shown, but the number of image processing devices is arbitrary (one or more). Each of the image processing devices 101 and 102 can be realized with the same configuration. Therefore, below, the configuration of the image processing device 101 will be described on behalf of the image processing devices 101 and 102, and detailed description of the image processing device 102 will be omitted. At this time, the network 106 is a network, such as LAN (Local Area Network) and the Internet, through which devices in the image forming system can communicate with each other. There is no intention to limit the number and functions of information processing terminals and servers. The server 105 may be implemented by a plurality of devices by distributing its functions. At this time, an image processing apparatus to which the present invention is applied does not necessarily include an image forming function, and an apparatus capable of executing a plurality of image processing simultaneously (parallel) can be applied.

The image processing device 101 receives and prints image data print requests (print data) from the information processing terminals 103 and 104, reads image data with a scanner of the image processing device 101, or reads an image with a scanner. It is possible to print the data. In addition, the image processing device 101 can store print data received from the information processing terminals 103 and 104 and transmit images read by the scanner of the image processing device 101 to the information processing terminals 103 and 104. do. The image processing device 101 can perform image processing using the server 105 or print documents stored in the server 105 . Moreover, the image processing device 101 is capable of realizing the functions of known image processing devices such as MFP (Multifunction Peripheral).

<Hardware configuration of image processing device>

Next, with reference to FIG. 2, an example of the hardware configuration of the image processing apparatus 101 will be described. The image processing device 101 includes a controller 201, a printer 202, a scanner 203, and an operation unit 204. Controller 201 includes CPU 211, RAM 212, HDD 213, network I/F 214, printer I/F 215, scanner I/F 216, operation unit I/F ( 217), and an expansion I/F 218. CPU 211 includes RAM 212, HDD 213, network I/F 214, printer I/F 215, scanner I/F 216, operation panel I/F 217, and expansion It is possible to exchange data with the I/F 218.

The CPU 211 expands the command read from the HDD 213 to the RAM 212, executes the command deployed to the RAM 212, and executes various processes described later. In the HDD 213, it is possible to store commands executable by the CPU 211, setting values used in the image processing device 101, data related to processing requested by the user, and the like. The RAM 212 is an area for temporarily storing commands read by the CPU 211 from the HDD 213. In addition, the RAM 212 can also store various types of data necessary for executing instructions. For example, image processing can be performed by developing inputted data into the RAM 212 .

The network I/F 214 is an interface for network communication with devices in the image forming system. The network I/F 214 is capable of notifying the CPU 211 of data reception and transmitting data of the RAM 212 to the network 106 . The printer I/F 215 is capable of transmitting print data sent from the CPU 211 to the printer 202 and conveying printer status received from the printer 202 to the CPU 211 . The scanner I/F 216 can transmit image reading instructions received from the CPU 211 to the scanner 203 and transmit image data received from the scanner 203 to the CPU 211 . Also, the scanner I/F 216 can transmit the status received from the scanner 203 to the CPU 211.

The operation unit I/F 217 is capable of transmitting to the CPU 211 an instruction input from the user input to the operation unit 204 or transmitting screen information for the user to operate to the operation unit 204 . The expansion I/F 218 is an interface that allows external devices to be connected to the image processing device 101 . The expansion I/F 218 includes, for example, a USB (Universal Serial Bus) interface. The image processing device 101, when an external storage device such as a USB memory is connected to the expansion I/F 218, reads data stored in the external storage device and writes data to the external storage device. it is possible to do

The printer 202 can print image data received from the printer I/F 215 on a recording medium such as paper or a sheet, and can transmit the status of the printer 202 to the printer I/F 215. . The scanner 203 reads the information recorded on the paper placed on the scanner 202 according to the image reading instruction received from the scanner I/F 216, digitizes this information, and transfers it to the scanner I/F 216. It is possible to pass on The scanner 203 can transmit its own state to the scanner I/F 216. The operation unit 204 is an interface for prompting the user to perform operations for inputting various instructions to the image processing device 101 . For example, the operation unit 204 includes a liquid crystal screen with a touch panel, provides an operation screen to the user, and receives operations from the user.

<Software configuration of image processing device>

Next, with reference to Fig. 3, an example of the structure of software processed by the CPU 211 according to the present embodiment will be described. The software having the structure shown in Fig. 3 is constructed by using a program stored in the HDD 213 of the image processing apparatus 101. In Fig. 3, with some exceptions, upper layers use services provided by lower layers.

In Fig. 3, the lowest layer is a layer that includes an operating system 317 and performs program execution management, memory management, and the like. In the operating system 317, a printer control driver 318, a scanner control driver 319, and a network I/F control driver 320 are inserted. The printer control driver 318, scanner control driver 319, and network I/F control driver 320 can function in conjunction with each other. The printer control driver 318 is software for controlling the printer 202 via the printer I/F 215. The scanner control driver 319 is software for controlling the scanner 203 via the scanner I/F 216. The network I/F control driver 320 is software for controlling the network I/F 214.

The second layer from the lowest layer includes a language device control library 309 and an image processing control unit 340 serving as an example of the second execution environment. In this embodiment, for example, the device control library 309 and the image processing control unit 340 are described in a compiler language (second programming language) such as C language or C++ language. Accordingly, the device control library 309 and the image processing control unit 340 are stored in the HDD 213 in the form of object files that can be directly executed by the CPU 211 . The device control library 309 is statically or dynamically linked to a single-function plug-in application 302 or device control application 304 described later. The device control library 309 uses the operating system 317 based on instructions from each application program. In addition, each device control library 309 can request image processing to the native image processing connection library 314 .

Next, an example of the configuration of the device control library 309 will be described. The print library 310 is a library that provides an API (Application Programming Interface) for controlling a print job by using the functions of the printer control driver 318 . A print job represents a series of processes for printing print data stored in the HDD 213 of the image processing device 101 or printing print data received from an external device via the network I/F 214. External devices are the information processing terminals 103 and 104, for example. The copy library 311 is a library that provides an API for controlling a copy job by using the functions of the scanner control driver 319 and the printer control driver 318 . A copy job represents a series of processes for printing image data scanned by the scanner 203 by the printer 202 .

The scan save library 312 is a library that provides an API for controlling scan save jobs using the functions of the scanner control driver 319 . The scan save job converts the image data scanned by the scanner 203 into print data or data in a general-purpose format, and transfers it to an external storage device such as a USB memory connected to the HDD 213 or expansion I/F 218. Represents a series of processes that preserve data. At this time, the universal format is a data format such as PDF (Portable Document Format) or JPEG (Joint Photographic Experts Group).

The scan transmission library 313 is a library that provides an API for controlling a scan transmission job by using functions of the scanner control driver 319 and the network I/F control driver 320 . The scan send job converts the image data scanned by the scanner 203 into universal format data, and sends this data to a file server via the network I/F 214 or to an external device as an e-mail attachment. represents a series of processes. The file server is the server 105, for example, and the external devices are the information processing terminals 103 and 104, for example.

The image processing controller 340 includes a native image processing connection library 314, a native image processing server 315, and a native image processing module (native application) 316. The native application is an application that is preinstalled in the image processing device 101 and provides various functions such as image processing. On the other hand, a plug-in application described later is an application that can be added to the image processing device 101 after product shipment. When the native image processing connection library 314 receives an image processing execution request from the device control library 309, it transmits the request content to the image processing connection library 332. The native image processing server 315 provides a function of executing a native image processing module upon receiving a request from software written in the Java (registered trademark) language described later. The native image processing module 316 is software capable of executing various types of image processing. At this time, the native image processing server 315 and the native image processing module 316 are executed on the native image processing control process 350, which is a program execution unit having a logical memory space separate from other software shown in FIG. . As a specific method of separating the memory space, it is conceivable to use a process mechanism provided by a general OS (Operating System), but other methods also exist. By adopting a configuration in which the logical memory space is separated when image processing is performed, the influence of processing errors on the requesting side of the processing can be suppressed when performing complex calculations and subsequent memory manipulations.

The Java language execution environment 330 serving as the top layer is an example of the first execution environment and is an application layer including a plug-in application 301 and a device control application 304 . In this embodiment, the plug-in application 301 and the device control application 304 are written in the Java language (first programming language) and are stored in the HDD 213 in a Java bytecode format interpreted by the Java virtual machine. The CPU 211 executes the program of the Java virtual machine, and the Java virtual machine reads and executes the Java bytecode to perform processing. One of the reasons for using such a programming language is the simplicity of the program description. In Java, the developer does not need to manage the memory area, and it is managed automatically. The effort of writing the program is reduced, and high development efficiency is expected.

Each application is executed using each API of the device control library 309 and the image processing connection library 332 to provide various functions. The function of the device control application 304 can be extended by updating the firmware. The print application 305, copy application 306, scan save application 307, and scan transmission application 308 included in the device control application 304 include screen information 321, screen information 322, screen information 323, It has screen information 324. The CPU 211 displays screen information 321, screen information 322, screen information 323, and screen information 324 on the operation unit 204 via the operation unit I/F 217, respectively. When the user operates the operation unit 204 and the CPU 211 detects a change in the settings of the device control application 304, the CPU 211 records the contents of the change in the HDD 213.

When the CPU 211 (device control application 304) detects a job execution request via the operation unit 204, it calls the API of the device control library 309 to start the job. The device control application 304 can also request image processing to the image processing connection library 332 .

The image processing connection library 332 maintains an allowed memory definition 325 . In the allowable memory definition 325, the maximum allowable memory capacity at the time of simultaneous execution by the image processing connection library 332 is defined. For example, the allowed memory defined in the allowed memory definition 325 may be acquired from the HDD 213 by directly writing in a program. Alternatively, it is also possible to install a file in which the allowable amount is defined in advance and load it at the time of execution. At this time, the method of obtaining the allowed memory may be a method other than the above. The image processing connection library 332 further holds the memory management unit 326 during execution. The running memory management unit 326 manages the total memory capacity of image processing being executed via the image processing connection library 332 .

Next, an example of the device control application 304 will be described. The print application 305 calls the API of the print library 310 to execute a print job. The copy application 306 calls the API of the copy library 311 to execute the copy job. The scan save application 307 calls the API of the scan save library 312 to execute the scan save job. The scan transmission application 308 calls the API of the scan transmission library 313 to execute a scan transmission job.

Next, an example of the plug-in application 301 will be described. Unlike the device control application 304, which is a resident application, the plug-in application 301 is an application that can be installed and uninstalled as a plug-in. The plug-in application 301 has a single function plug-in application 302 and an image processing plug-in application 303. In the plug-in application 301, programs required for each operation are packaged. The plug-in application 301 is installed in the image processing device 101 by using a remote user interface (UI). At this time, the remote UI accesses the image processing device 101 from the web browser of the external device via the network I/F 214, confirms the status of the image processing device 101, operates print jobs, and sets various settings. It is a mechanism that can do this. External devices are the information processing terminals 103 and 104, for example. The plug-in applications 301 (the stand-alone plug-in application 302 and the image processing plug-in application 303) can be individually started and stopped.

An example of a series of operations from installation of the plug-in application 301 to start, stop, and uninstallation is shown below. When the CPU 211 detects the installation of the plug-in application 301, the information of the plug-in application 301 is stored in the HDD 213. When the CPU 211 detects an instruction to start the plug-in application 301, it issues an instruction to start the plug-in application 301. While the plug-in application 301 is running, it is possible to execute the contents of each program. When the CPU 211 detects an instruction to stop the plug-in application 301, it issues an instruction to stop the plug-in application 301. When the CPU 211 detects an uninstall instruction for the plug-in application 301, information on the plug-in application 301 is deleted from the HDD 213. At this time, these instructions may be input from, for example, a remote UI or the operation unit 204, but these instructions may be input by a method other than the above method.

Next, an example of the stand-alone plug-in application 302 will be described. The stand-alone plug-in application 302 has screen information 321 . The stand-alone plug-in application 302 can provide a user with functions and screens different from those of the resident device control application 304 by calling an API of the device control library 309 . For example, the single-function plug-in application 302 provides a plurality of functions, such as a function of copying and simultaneously scanning certain image data and sending a document to a specific destination in a destination database maintained by the single-function plug-in application 302. It is possible to provide a combination. At this time, the single-function plug-in application 302 may not have a function of performing image processing. In this case, setting of image processing is not performed. When the device control library 309 receives print data or image data converted into a general-purpose format, it instructs the appropriate operating system 317 to process control to execute the job.

Next, an example of the image processing plug-in application 303 will be described. The image processing plug-in application 303 is an application that provides specific image processing. The image processing plug-in application 303 receives image data and processing parameters to be processed from the stand-alone plug-in application 302, device control application 304, etc. via the image processing connection library 332, and performs requested image processing. run The image processing plug-in application 303 can receive an image processing request from the device control library 309 via the native image processing connection library 314 and the image processing connection library 332 . At this time, a plurality of image processing plug-in applications 303 may exist in the HDD 213 . For example, image processing plug-in applications 303 capable of performing image format conversion, skew correction, form recognition, OCR processing and the like for input images may each exist.

The image processing plug-in application 303 itself may not have an image processing function. For example, the image processing plug-in application 303 may use the native image processing client 331 and the image processing function of the native image processing module 316 . One of the reasons why the image processing plug-in application 303 uses the native image processing module 316 is to increase the processing speed when image processing is performed. When performing image processing. There are cases in which a large amount of complex numerical calculation is performed and a large amount of memory is required in the process of processing. In such a case, the processing speed can be improved by using a compiler language capable of directly generating an object file executable by the CPU instead of using a programming language processing system that performs processing through a virtual machine such as Java.

The image processing plug-in application 303 maintains an execution memory definition 327 . The execution memory definition 327 defines the maximum memory capacity used by image processing executed by each plug-in. At this time, the above memory capacity may be maintained for each plug-in or for each function of image processing.

<Processing Procedure>

Next, with reference to Fig. 4, an example of processing procedures of the image processing apparatus 101 according to the present embodiment will be described. Assume a case in which the image processing connection library 332 accepts image processing, performs memory control, and then issues a process request to the image processing plug-in application 303. This flowchart shows an example of image processing using the image processing plug-in application 303. At this time, the processing described below is realized by, for example, the CPU 211 reading the program stored in the HDD 213 into the RAM 212 and executing the program.

First, in step S401, the image processing connection library 332 receives an image processing execution request from the device control application 304, the native image processing connection library 314, or the single function plug-in application 302. At this time, it is assumed that the received execution request includes parameters necessary for specifying the image processing plug-in application 303 requesting processing.

Next, in step S402, the image processing connection library 332 searches for the image processing plug-in application 303 capable of executing the image processing corresponding to the acquired execution request. In step S403, the image processing connection library 332 determines whether or not the target image processing plug-in application exists based on the search result in step S402.

If it is determined in step S403 that the application capable of executing the image processing request received by the image processing connection library 332 does not exist, processing proceeds to step S404, whereby the image processing connection library 332 executes the received image processing. Returns an error indicating that a capable application does not exist to the requesting module. After that, processing is terminated. For example, when the native image processing connection library 314 is the requesting destination, the above-mentioned error content is propagated to the device control application 304 or single function plug-in application 302 via the device control library 309. The device control application 304 or the single function plug-in application 302 displays the received error contents on the operation screen of each application. This error can notify the user that a module required for processing does not exist. By installing the necessary image processing plug-in application 303 by the above installation method by the service man or IT manager, it is possible to continue processing.

If the image processing connection library 332 determines in step S403 that the target image processing plug-in application 303 exists, the processing proceeds to step S405, and the image processing connection library 332 determines that the target image processing plug-in application ( The execution memory capacity is acquired from the execution memory definition 327 of 303). As described above, this execution memory capacity may be defined for each plug-in unit, or may be held for each function unit of image processing in each plug-in. Next, in step S406, the image processing connection library 332 acquires the allowed memory capacity from the allowed memory definition 325 of the image processing connection library 332. In step S407, the image processing connection library 332 acquires the total memory capacity during execution from the execution memory management unit 326 of the image processing connection library 332.

In step S408, the image processing connection library 332 determines whether or not the sum of the acquired memory capacity during execution and the total memory capacity during execution managed by the image processing connection library 332 exceeds the allowable memory capacity (memory shortage occurs). whether or not) is determined. When the image processing connection library 332 determines that this sum does not exceed the allowable memory capacity, in step S409, the running memory capacity managed by the running memory management unit 326 is defined in the execution memory definition 327. Add the execution memory capacity. In step S410, the image processing connection library 332 requests the target image processing plug-in application 303 for processing. The image processing plug-in application 303 receives an image processing request together with processing parameters from the image processing connection library 332, and executes image processing according to the processing parameters. There is a method of performing image processing within the image processing plug-in application 303 and a method of executing it by the native image processing module 316, which will be described in detail later. When image processing is executed, in the image processing plug-in application 303 or native image processing module 316, the CPU 211 expands input data to the RAM 212. At this time, it is necessary to allocate a memory having a capacity corresponding to the image processing contents and the input data size. Then, in step S411, the image processing connection library 332 receives the processing result from the image processing plug-in application 303, and in step S412 subtracts the execution memory capacity from the total memory capacity during execution. In step S413, the image processing connection library 332 returns the image processing result to each module of the client, and ends the processing.

When the image processing connection library 332 judges that the sum exceeds the allowable memory capacity in step S408, the processing proceeds to step S414, and the image processing connection library 332 determines the current image processing for the module of the client. Returns an error indicating that image processing could not be executed because memory resources required for processing are not sufficient (due to insufficient memory), and processing is terminated. When the native image processing connection library 314 is the requesting destination, the above-mentioned error content is propagated to the device control application 304 or single function plug-in application 302 via the device control library 309. The device control application 304 or the single function plug-in application 302 executes exception processing based on the received error content.

An example of exception processing is retry processing. When each application receives the above error, it can be determined that a plurality of image processes are being simultaneously executed on the image processing connection library 332 . Each application once waits by retrying until the image processing currently being executed is finished, and transmits an image processing request again at the timing when the image processing being executed is finished. This makes it possible to continue processing without interruption.

Another exception processing is a control displaying an error that prompts the input of a job again after a certain period of time (after a predetermined period of time has elapsed) since a plurality of image processes are being simultaneously executed on the operation screen of each application. This error can notify the user that the job is available for execution after a certain amount of time.

As described above, according to the present embodiment, before issuing a process request to a module (plug-in application) that performs image processing, it is determined whether or not the memory capacity exceeds the allowable memory capacity by the image processing to be executed. When the memory capacity exceeds the allowable memory capacity, image processing is not requested in the first place. In this embodiment, allocation of memory exceeding the allowable memory capacity can be avoided. Memory allocation can be controlled before the operation of the system becomes unstable due to memory allocation exceeding the memory capacity allowed by the system.

<Image processing by image processing plug-in application>

Hereinafter, image processing by an image processing plug-in application will be described. When the image processing plug-in application 303 requests image processing, the image processing plug-in application 303 executes the image processing based on the requested processing content. The image processing plug-in application 303 can execute image processing by at least two types of methods. The first method is to execute image processing within the image processing plug-in application 303. In this case, the image processing plug-in application executes image processing based on the processing request and processing parameters received from the image processing connection library 332 . In this case, the image processing plug-in application needs to be written in the Java language. The second method is a method of requesting image processing to the native image processing module 316 . The image processing plug-in application 303 can execute image processing in a process dedicated to image processing different from the image processing plug-in application 303 by requesting a native image processing client for processing.

Referring to Fig. 5, a processing procedure in which each image processing plug-in application 303 executes image processing will be described. This flowchart shows a processing procedure for requesting the native image processing server 315 to execute image processing. At this time, the processing described below is realized by, for example, the CPU 211 reading the program stored in the HDD 213 into the RAM 212 and executing the program.

The image processing plug-in application 303 transmits an image processing request together with processing parameters to the native image processing client 331 . The native image processing client 331 issues a processing request to the native image processing server 315 together with the received processing parameters.

In step S501, the native image processing server 315 receives an image processing execution request, and in step S502, it searches for the target native image processing module 316 based on the received processing parameters. In step S503, the native image processing server 315 determines whether or not the target native image processing module 316 exists. If the target native image processing module 316 does not exist, processing proceeds to step S504, and the native image processing server 315 generates an error indicating that the target native image processing module 316 does not exist. It returns to the native image processing client 331, and processing ends.

If the target native image processing module 316 exists, processing proceeds to step S505, and the native image processing server 315 performs image processing based on the processing parameters received from the target native image processing module 316. run it Next, in step S506, the native image processing server 315 returns the image processing result of step S505 to the native image processing client 331, and the processing is terminated. When the native image processing client 331 receives an image processing result or error content, it returns the content to the image processing plug-in application 303 .

As described above, the image processing device according to the present embodiment is an image processing device capable of executing a plurality of image processing by one or more plug-in applications. When this image processing apparatus is requested to execute a new image process by a plug-in application during execution of image processing by a plug-in application, it searches for a plug-in application capable of executing the new image process. Also, the image processing apparatus acquires the memory usage when a new image process is executed by the plug-in application, which is maintained together with the searched plug-in application, and the memory usage of each of the image processes already executed by the plug-in application. The image processing device indicates the total memory usage amount obtained from the memory usage amount of each acquired image process and the memory usage usage when executing the requested new image process, and the memory usage usage permitted for use in the process executing the corresponding plug-in application. Compare memory capacity. The image processing apparatus executes a new image process when, as a result of the comparison, the total memory usage does not exceed the allowable memory capacity. If the total amount of memory used exceeds the allowable memory capacity, the image processing device does not execute new image processing and notifies the request source of an error indicating that new image processing cannot be executed due to lack of memory. Accordingly, memory control for a plurality of image processes can be performed at runtime by calculating the total memory of the image processes being executed at the time of execution of the image processing without restricting the startup (installation) of the image processing plug-in application 303. . According to this embodiment, it is possible to execute a plurality of image processing while preferably avoiding memory shortage. This can improve user convenience.

The present invention is not limited to the above embodiment and various modifications are possible. For example, the execution memory defined in the execution memory definition 327 of the image processing plug-in application 303 can also describe execution memory used when the native image processing module 316 executes image processing.

<Second Embodiment>

A second embodiment of the present invention will be described below. In the first embodiment, an example in which the image processing connection library 332 performs memory control for a plurality of image processing at runtime has been described. In this embodiment, an example in which the native image processing server 315 performs memory control for a plurality of image processes inside the native image processing control process 350 when a plug-in application requests image processing will be described.

<Software configuration of image processing device>

First, with reference to Fig. 6, an example of the structure of software processed by the CPU 211 according to the present embodiment will be described. At this time, since the basic configuration is the same as the content described with reference to Fig. 3 in the first embodiment, the difference will be mainly explained. The same reference numerals are attached to the same components, and descriptions are omitted.

The native image processing server 315 maintains an allowed memory definition 601 . The allowed memory definition 601 defines the maximum allowable memory capacity possible when concurrently executed on the native image processing server 315 . The allowable memory capacity defined in the allowable memory definition 601 can also be acquired from the HDD 213 by directly writing in a program. Alternatively, a file defining the allowable memory capacity in advance may be installed and loaded at the time of execution. At this time, the method of obtaining the allowed memory may be a method other than the above method. The native image processing server 315 further maintains a memory management unit 602 during execution. The running memory management unit 602 manages the total memory capacity of image processing being executed via the native image processing server 315 .

<Processing Procedure>

Next, with reference to Fig. 7, an example of processing procedures of the image processing apparatus 101 according to the present embodiment will be described. Here, a case is assumed in which the native image processing server 315 manages the memory of the image processing being executed and executes the image processing. The client for such image processing is the image processing plug-in application 303. At this time, the processing described below is realized by, for example, the CPU 211 reading the program stored in the HDD 213 into the RAM 212 and executing the program.

In step S701, the native image processing server 315 receives an image processing execution request together with processing parameters from the native image processing client 331, and searches for the native image processing module 316 in step S702. In step S703, the native image processing server 315 determines whether or not the target native image processing module 316 exists based on the search result in step S702.

If the target native image processing module 316 does not exist, processing proceeds to step S704, and the native image processing server 315 returns an error indicating that the target native image processing module 316 does not exist. and end the processing. Upon receiving an error, the native image processing client 331 propagates the content of the error to the requesting image processing plug-in application 303. In this case, the native image processing module 316 necessary for the HDD 213 of the image processing device 101 is not installed and does not occur in normal operation. Therefore, it is necessary for developers to modify the source code.

If the target native image processing module 316 exists, processing proceeds to step S705, and the native image processing server 315 is executed from the execution memory definition 603 of the target native image processing module 316. Get the memory capacity. Next, in step S706, the native image processing server 315 acquires the allowed memory capacity from the allowed memory definition 601 of the native image processing server 315. In step S707, the native image processing server 315 acquires the total running memory capacity from the running memory management unit 602 of the native image processing server 315.

In step S708, the native image processing server 315 judges whether or not the sum of the acquired memory capacity during execution and the total memory capacity during execution exceeds the allowable memory capacity. If the native image processing server 315 determines that the sum does not exceed the allowable memory capacity, the processing proceeds to step S709, and the native image processing server 315 adds the execution memory capacity to the total memory capacity during execution. In step S710, the native image processing server 315 requests the native image processing module 316 to execute image processing. The native image processing module 316 receives an image processing request with processing parameters, and executes image processing according to the processing parameters. When performing image processing, in the native image processing module 316, the CPU 211 expands input data to the RAM 212 and performs processing. At this time, it is necessary to allocate memory according to image processing content and input data size.

In step S711, the native image processing server 315 receives the image processing result from the native image processing module 316, and subtracts the execution memory capacity from the total memory capacity during execution in step S712. In step S713, the native image processing server 315 returns the image processing result to the native image processing client 331, and ends the processing.

If the native image processing server 315 determines in step S708 that the sum exceeds the allowable memory capacity, the process proceeds to step S714, and the native image processing server 315 determines that the currently required memory resources are not sufficient. An error indicating that processing cannot be executed is returned to the native image processing client 331. After that, processing is terminated.

The native image processing client 331 propagates the image processing result and error details to the image processing plug-in application 303 . The image processing plug-in application receives the image processing result and propagates it to the client's module via the image processing connection library 332. Execute exception processing when receiving an error indicating that there are not enough memory resources. An example of exception processing is retry processing. When receiving the above error, the image processing plug-in application 303 can determine that the image processing cannot be executed because there is an image processing being executed. Therefore, it is possible to execute by requesting processing to the image processing client 331 after a predetermined period of time. The retry processing performed in the image processing plug-in application has an advantage that it is not necessary to perform the retry processing by the requesting module. As another exception processing, the above error is propagated to the single function plug-in application 302 and the device control application 304 in the client. If it is possible to assume both a case where it is desirable to perform a retry depending on the application and a case where it is desirable to abort the retry, by propagating the above error to the application side, switching between retry and abort within the application is possible. it becomes possible

As described above, before processing is requested to the native image processing module 316, it is judged whether or not the memory capacity exceeds the allowable memory capacity by image processing to be executed in advance, and control is performed. When the memory capacity exceeds the allowable memory capacity, since image processing is not requested in the first place, memory is not allocated uselessly. Memory allocation can be controlled in advance before the operation of the system becomes unstable due to allocation of memory exceeding the memory capacity allowed by the system (device).

In this embodiment, in parallel with the above memory control in the native image processing control process 350, the same memory control may be performed for other image processing control processes realized by plug-ins. That is, you may define the amount of memory allowed for each process. For example, the configuration according to the second embodiment may be applied in combination with the configuration according to the first embodiment.

According to the present embodiment, it is possible to perform memory control for a plurality of image processes at runtime by calculating the total memory of image processes being executed at the time of image processing execution without restricting the startup of the image processing plug-in application 303. lose This can improve user convenience. Unlike the first embodiment, it becomes possible to perform memory management confined to a process that specializes in image processing (native image processing control process 350). The image processing plug-in application 303 need not be aware of the memory control of image processing on the native image processing control process 350. There is an advantage that the development efficiency of the image processing plug-in application 303 is improved.

<Third Embodiment>

Hereinafter, a third embodiment of the present invention will be described. In this embodiment, an example in which the native image processing module 316 mainly performs memory control will be described. In the third embodiment, when memory control is performed and parallel processing cannot be performed unlike in the first and second embodiments, processing is executed without immediately returning an error. When parallel processing for image processing of multiple pages can be performed, parallel processing is used to speed up processing.

<Processing Procedure>

First, with reference to Figs. 8A and 8B, an example of a processing procedure of the image processing apparatus 101 according to the present embodiment will be described. An example in which the native image processing module 316 registers an execution memory in the native image processing server 315 and performs memory control will be described. At this time, the processing described below is realized by, for example, the CPU 211 reading the program stored in the HDD 213 into the RAM 212 and executing the program.

First, in step S801, the native image processing module 316 receives an image processing execution request from the native image processing server 315. Next, in step S802, the native image processing module 316 acquires the memory size (memory usage) necessary for processing the received image from the execution memory definition 603. In step S803, the native image processing module 316 determines whether or not parallel processing is possible for the received image processing. The native image processing module 316 may have information indicating whether or not parallel processing is possible, and may use this information to make a decision. At this time, using information indicating whether parallel processing is possible or not, as described in the first and second embodiments, based on the amount of memory for each of the image processing already executed by the native application and the amount of memory required, , it may be determined whether or not parallel processing is possible. For example, a threshold memory capacity corresponding to the total memory usage is determined so that the total memory usage does not exceed the allowable memory capacity when parallel processing is performed in the two total memory usages, and the threshold memory capacity and the allowable memory capacity are determined. The decision may be made based on the result of the comparison of capacities. Alternatively, it may be judged by adding information indicating whether parallel processing is possible (for example, threshold memory capacity) as meta information in advance to the execution memory definition 603 and reading it.

In step S804, if the native image processing module 316 determines that parallel processing is not possible for the received image processing based on the determination result in step S803, the processing proceeds to step S805. If the native image processing module 316 determines that parallel processing is possible, processing proceeds to step S811.

Step S805 shows processing for repeating the processing of steps S806 to S810 for the number of pages of synchronously received image processing when parallel processing is not possible (each image processing is executed sequentially). In step S806, the native image processing module 316 registers the memory information acquired from the execution memory definition 603 of the native image processing module 316 in the native image processing server 315. Details of registration of memory information by the native image processing server 315 will be described later with reference to FIG. In step S807, the native image processing module 316 determines whether registration of the execution memory is successful or not in step S806. If registration fails, the processing proceeds to step S808, and the native image processing module 316 sends an error indicating that image processing cannot be executed because memory resources required for image processing are not sufficient, to the native image processing server 315. ), and processing ends. The native image processing server 315 propagates this error to the calling application through the native image processing client 331 .

If registration of the execution memory in the native image processing server 315 is successful, the processing proceeds to step S809, and the native image processing module 316 executes the target image processing. When the image processing is completed, in step S810, the native image processing module 316 requests the native image processing server 315 to release the execution memory together with the memory information to be released. After the repeated loop processing is finished, the processing ends.

When the native image processing module 316 determines that parallel processing is possible in step S804, the processing proceeds to step S811, and the processing of steps S812 to S814 in the case where parallel processing is possible is synchronously received for image processing. Repeat as many times as the number of pages. In step S812, the native image processing module 316 registers the execution memory acquired from the execution memory definition 603 of the native image processing module 316 with the native image processing server 315. At this time, the memory registration sequence by the native image processing server 315 will be described later with reference to FIG. In step S813, the native image processing module 316 determines whether registration of the execution memory is successful or not. If the registration is successful, processing proceeds to step S814, and the native image processing module 316 increments the number of parallel executions. The number of parallel executions indicates the number of threads to be executed in parallel, and is a variable managed by the RAM 212, HDD 213, and the like. If registration of the execution memory fails, the process escapes from this loop process and proceeds to step S815. When the repetitive loop process ends, the process proceeds to step S815. At the stage where the processing exits from this loop processing, a positive integer in the range of the number of pages set from 0 is input to the number of parallel executions.

In step S815, the native image processing module 316 determines whether or not the calculated number of parallel executions is greater than zero. If the number of parallel executions is greater than 0, the process proceeds to step S816, otherwise the process proceeds to step S808. In step S808, the native image processing module 316 returns an error indicating that image processing cannot be executed because memory resources required for image processing are not sufficient to the native image processing server 315, and the processing is terminated. The native image processing server 315 propagates this error to the calling application via the native image processing client 331.

If the number of parallel executions is an integer equal to or greater than 1, processing proceeds to step S816, and the native image processing module 316 activates as many threads as the number of parallel executions. In this embodiment, a thread is started, but a process may be started. Subsequently, the process proceeds to step S817, and the process of step S818 is repeated for the set number of pages. In step S818, the native image processing module 316 allocates the image processing of each page to an empty thread and executes it. After the processing exits this loop processing, image processing execution of all threads is completed, and image processing for all received pages is completed. Finally, in step S819, the native image processing module 316 issues a release request of the execution memory to the native image processing server 315 for the number of activated threads, and ends the processing.

<Register Execution Memory>

Next, with reference to Fig. 9, processing procedures when the native image processing server 315 receives an execution memory registration request from the native image processing module 316 in steps S806 and S812 will be described. At this time, the processing described below is realized by, for example, the CPU 211 reading the program stored in the HDD 213 into the RAM 212 and executing the program.

In step S901, the native image processing server 315 receives an execution memory registration request together with execution memory information from the native image processing module 316. In step S902, the native image processing server 315 judges whether or not the sum of the received memory size and the image processing memory size being executed exceeds the allowable memory size. If the total exceeds the allowable memory size, processing proceeds to step S903, and the native image processing server 315 returns a message indicating that registration has failed to the native image processing module 316. After that, processing ends. If the total does not exceed the allowable memory size, the processing proceeds to step S904, the native image processing server 315 adds the received memory size to the memory during execution, and sends a message indicating successful registration in step S905 to the native image processing server 315. Return to processing module 316. After that, processing ends.

<Release Execution Memory>

Referring to Fig. 10, a processing procedure when the native image processing server 315 receives a release request of the execution memory from the native image processing module 316 in step S810 will be described. At this time, the processing described below is realized by, for example, the CPU 211 reading the program stored in the HDD 213 into the RAM 212 and executing the program.

In step S1001, the native image processing server 315 receives an execution memory release request from the native image processing module 316. In step S1002, the native image processing server 315 subtracts the memory size received from the running memory, and ends the processing.

As described above, according to the present embodiment, the native image processing module 316 can perform memory control as a main body. Depending on the characteristics of the native image processing module 316, it is possible to appropriately perform thread control depending on whether parallel processing is possible or not. It is possible to realize high speed for multiple pages while performing memory control.

<Fourth Embodiment>

A fourth embodiment of the present invention will be described below. In the above third embodiment, in the image processing module capable of parallel execution, an example in which parallel processing is performed after determining the number of parallel executions has been described before performing image processing of a plurality of pages. In the fourth embodiment, as a modified example of the third embodiment, an example in which the number of parallel executions is dynamically increased during execution of image processing will be described.

<Processing Procedure>

First, with reference to Fig. 11, a processing procedure for dynamically increasing the number of parallel executions during image processing according to the present embodiment will be described. This flowchart is a modified example of the processing of steps S816 to S819 in the flowchart of Fig. 8B. The processing performed before step S816 is the same as the flowchart in Fig. 8B. At this time, the processing described below is realized by, for example, the CPU 211 reading the program stored in the HDD 213 into the RAM 212 and executing the program.

In step S1101, the native image processing module 316 activates as many threads as the number of parallel executions. The processing proceeds to step S1102, and the loop processing of steps S1103 to S1107 is repeatedly executed for the set number of pages. Specifically, in step S1103, the native image processing module 316 assigns the image processing of each page to an empty thread and executes it. The processing proceeds to step S1104, and the loop processing of steps S1105 to S1107 is repeatedly executed for the number of pages waiting for image processing.

In step S1105, the native image processing module 316 registers an execution memory in the native image processing server 315. In step S1106, the native image processing module 316 determines whether registration of the execution memory is successful or not. If registration of the execution memory fails, the process escapes from the loop of step S1104 and returns to the loop of step S1102. If the native image processing module 316 determines that registration of the execution memory is successful in step S1106, an execution thread is created, and the process returns to step S1104. These loops are repeatedly executed as many times as the number of pages corresponding to the set image processing (step S1102). As a result, the image processing of all the pages is completed, and the processing proceeds to step S1108.

In step S1108, the native image processing module 316 requests the native image processing server 315 to release the execution memory as many as the number of activated threads, and ends the processing. At this time, the processing sequence by the native image processing server 315 for registering the execution memory (step S1105) and releasing the execution memory (step S1108) is the same as that described with reference to FIGS. 9 and 10 .

As described above, according to the present embodiment, in image processing of multiple pages, execution threads can be dynamically increased by querying the native image processing server 315 between image processing of each page. Therefore, it is possible to execute image processing of multiple pages more efficiently than in the third embodiment.

<Other Embodiments>

Embodiments of the present invention are computer executables recorded in a storage medium (which may be more specifically referred to as a 'non-transitory computer readable storage medium') to perform one or more functions of the above-described embodiment(s) of the present invention. One or more circuits (eg, application specific integrated circuits (ASICs)) that read and execute capable instructions (eg, one or more programs) and/or perform one or more functions of the foregoing embodiment(s). By reading and executing computer-executable instructions from a computer of a system or device including a computer or, for example, a storage medium to perform one or more functions of the foregoing embodiment(s), by the computer of the system or device. A computer may include one or more central processing units (CPUs), microprocessing units (MPUs) or other circuitry, and may include a network of separate computers or separate computer processors. Computer-executable instructions may be given to a computer, for example, from a network of storage media The recording medium may include, for example, one or more hard disks, random access memory (RAM), read-only memory (ROM), A storage of a distributed computing system, an optical disk (such as a compact disk (CD), a digital versatile disk (DVD), or a Blu-ray disk (BD) ^TM ), a flash memory device, a memory card, or the like may be provided.

In the present invention, a program for realizing one or more functions of the above embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device read and execute the program. processing is also feasible. Also, it can be implemented by a circuit (eg ASIC) that realizes one or more functions.

Although the present invention has been described with reference to exemplary embodiments, it is apparent that the present invention is not limited to these embodiments. The scope of protection of the following claims is to be interpreted most broadly to encompass all modifications and equivalent structures and functions.

Claims (18)

As an image processing device capable of performing image processing by a plug-in application and image processing by a native application, respectively,
a memory device that stores a set of instructions; and
Executing the above set of instructions,
If execution of new image processing by the native application is requested during execution of image processing by a native application pre-installed in the image processing device, after the execution of the new image processing is requested, the execution of the new image processing by the native application Acquiring the memory usage when a new image process is executed and the memory usage for each of the image processes already executed by the native application;
The total memory usage obtained from the acquired memory usage of each image process and the memory usage when executing the requested new image process is compared with the allowable memory capacity representing the memory usage allowed in the process executing the native application. do,
As a result of the comparison, if the total memory usage amount does not exceed the allowable memory capacity, the new image processing is executed, and if the total memory usage amount exceeds the allowable memory capacity, the new image processing is not executed, and the request request at least one processor for notifying an error indicating that the new image processing cannot be executed due to memory shortage;
When image processing by the plug-in application is executed in a process in which the plug-in application runs, the allowable memory capacity used by the process in which the native application runs is not considered.
delete According to claim 1,
the at least one processor executing instructions within the memory device;
If new image processing by the native application is requested during execution of image processing by the native application pre-installed in the image processing device, memory usage when executing the new image processing by the native application; judging whether or not parallel processing is feasible from the memory usage of each image processing already executed by the native application;
As a result of the determination, if the parallel processing is not feasible, the new image processing and the already executing image processing are sequentially executed, and if the parallel processing is feasible, the new image processing and the already executing image processing are executed. An image processing device that executes processing in parallel.
According to claim 3,
the at least one processor executing instructions within the memory device;
An image processing device that dynamically determines whether or not the parallel processing is possible for each page of image processing.
According to claim 3,
the at least one processor executing instructions within the memory device;
An image processing apparatus that transmits an error indicating that image processing cannot be executed when an execution memory for executing image processing cannot be allocated.
According to claim 1,
When the request source receives the error, the request source requests new image processing again after a predetermined time has elapsed.
According to claim 1,
A source of request for a new image processing device by a native application is an image processing device operating in a process different from the process in which the new image processing device is executed.
An image processing device capable of executing image processing in a first execution environment for executing a program written in a first programming language and image processing in a second execution environment for executing a program written in a second programming language, comprising:
a memory device that stores a set of instructions; and
Executing the above set of instructions,
When execution of new image processing by the second application written in the second programming language is requested during execution of image processing in the second execution environment, when executing the new image processing by the second application Acquiring a memory usage amount and a memory usage amount of each image process already being executed in the second execution environment;
Comparing the total memory usage obtained from the acquired memory usage of each image process and the memory usage when executing the requested new image process with an allowable memory capacity indicating a memory usage allowed for use in the second execution environment, ,
As a result of the comparison, if the total memory usage amount does not exceed the allowable memory capacity, the new image processing is executed; if the total memory usage amount exceeds the allowable memory capacity, the new image processing is not executed, and the request source at least one processor for notifying an error indicating that the new image processing cannot be executed due to lack of memory;
When image processing by the first application is executed in a process in which the first application described in the first programming language runs, the allowable memory capacity used by the process in which the second application runs is not taken into consideration. processing device.
delete According to claim 8,
the at least one processor executing instructions within the memory device;
Memory for executing new image processing by the second application, when the new image processing by the second application described in the second programming language is requested during execution of image processing in the second execution environment. judging whether or not parallel processing is feasible from the usage amount and the memory usage amount of each of the image processing already executed in the second execution environment;
As a result of the determination, if the parallel processing is not feasible, a new image process and an image process already being executed are sequentially executed, and if the parallel processing is feasible, a new image process and an image process already being executed are executed in parallel. An image processing device that runs.
According to claim 10,
the at least one processor executing instructions within the memory device;
An image processing device that dynamically determines whether or not the parallel processing is possible for each page of image processing.
According to claim 10,
the at least one processor executing instructions within the memory device;
An image processing apparatus that transmits an error indicating that image processing cannot be executed when an execution memory for executing image processing cannot be allocated.
According to claim 8,
When the request source receives the error, the request source requests new image processing again after a predetermined time has elapsed.
According to claim 1,
The memory usage amount when performing image processing is maintained for each function included in image processing.
As a control method of an image processing apparatus capable of performing image processing by a plug-in application and image processing by a native application, respectively,
If execution of new image processing by the native application is requested during execution of image processing by a native application pre-installed in the image processing device, after the execution of the new image processing is requested, the execution of the new image processing by the native application Acquiring a memory usage when a new image process is executed and a memory usage for each image process already executed by a native application;
The total memory usage obtained from the acquired memory usage of each image process and the memory usage when executing the requested new image process is compared with the allowable memory capacity representing the memory usage allowed in the process executing the native application. step of doing,
As a result of the comparison, if the total memory usage amount does not exceed the allowable memory capacity, the new image processing is executed; if the total memory usage amount exceeds the allowable memory capacity, the new image processing is not executed, and the request source notifying an error indicating that the new image processing cannot be executed due to insufficient memory,
When image processing by the plug-in application is executed in a process in which the plug-in application runs, the allowable memory capacity used by the process in which the native application runs is not considered.
Control of an image processing apparatus capable of executing image processing in a first execution environment for executing a program written in a first programming language and image processing in a second execution environment for executing a program written in a second programming language. As a method,
When execution of new image processing by the second application written in the second programming language is requested during execution of image processing in the second execution environment, when executing the new image processing by the second application acquiring a memory usage amount and a memory usage amount of each image process already being executed in the second execution environment;
Comparing the total memory usage obtained from the acquired memory usage of each image process and the memory usage when executing the requested new image process with an allowable memory capacity indicating a memory usage allowed for use in the second execution environment. steps,
As a result of the comparison, when the total memory usage does not exceed the allowable memory capacity, the new image processing is executed, and when the total memory usage exceeds the allowable memory capacity, the new image processing is not executed, and the request request notifying the source of an error indicating that the new image processing cannot be executed due to insufficient memory;
When image processing by the first application is executed in a process in which the first application described in the first programming language runs, the allowable memory capacity used by the process in which the second application runs is not taken into consideration. method.
A non-transitory computer-readable storage medium storing a computer program for causing a computer to execute each step in a control method of an image processing apparatus capable of executing image processing by a plug-in application and image processing by a native application, respectively, wherein the The control method is
If execution of new image processing by the native application is requested during execution of image processing by a native application pre-installed in the image processing device, after the execution of the new image processing is requested, the execution of the new image processing by the native application Acquiring a memory usage when a new image process is executed and a memory usage for each image process already executed by a native application;
The total memory usage obtained from the acquired memory usage of each image process and the memory usage when executing the requested new image process is compared with the allowable memory capacity representing the memory usage allowed in the process executing the native application. steps to do,
As a result of the comparison, if the total memory usage amount does not exceed the allowable memory capacity, the new image processing is executed; if the total memory usage amount exceeds the allowable memory capacity, the new image processing is not executed, and the request source notifying an error indicating that the new image processing cannot be executed due to insufficient memory,
When image processing by the plug-in application is executed in a process in which the plug-in application runs, the allowable memory capacity used by a process in which the native application runs is not considered.
Control of an image processing apparatus capable of executing image processing in a first execution environment for executing a program written in a first programming language and image processing in a second execution environment for executing a program written in a second programming language. A non-transitory computer-readable storage medium storing a computer program for causing a computer to execute each step in the method, the control method comprising:
When execution of new image processing by the second application written in the second programming language is requested during execution of image processing in the second execution environment, when executing the new image processing by the second application acquiring a memory usage amount and a memory usage amount of each image process already being executed in the second execution environment;
Comparing the total memory usage obtained from the acquired memory usage of each image process and the memory usage when executing the requested new image process with an allowable memory capacity indicating a memory usage allowed for use in the second execution environment. steps,
As a result of the comparison, when the total memory usage does not exceed the allowable memory capacity, the new image processing is executed, and when the total memory usage exceeds the allowable memory capacity, the new image processing is not executed, and the request request notifying the source of an error indicating that the new image processing cannot be executed due to insufficient memory;
When image processing by the first application is executed in a process in which the first application described in the first programming language runs, the allowable memory capacity used by the process in which the second application runs is not considered. media.

Images