JP2006165614A - Multifunction system provided with automatic management function - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a multifunction system provided with an automatic management function for automatically managing a blur or the like of an image imaged by a digital camera and arranging unnecessary files to carry out efficient management. <P>SOLUTION: The multifunction system including a print means capable of extracting an image produced by the digital camera or the like, storing the image into a hard disk, and carrying out printout, is characterized in that the system judges the sharpness in accordance with a result of an extracted edge part of an image; automatically analyzes the quality of the stored image by comparing the sharpness with a prescribed value to carry out judgment of a blur caused at photographing by the digital camera or like processing, judges the priority of the image in accordance with the quality of the image, and deletes the image with lower priority, or reduces the quantity of data by using a compression means at a high compression rate and stores the compressed image again. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a multi-function system having an automatic management function related to a multi-function system capable of storing and printing digital camera images on a hard disk.

Conventionally, multi-function systems capable of storing and printing digital camera images on a hard disk have already been proposed. Also, it is common practice to perform operations such as previewing, erasing and moving images on a hard disk built in a multi-function system on an operation unit.
JP 2001-243155 A

  However, the conventional method does not use a means for determining the image quality of a digital camera image and automatically erasing the image data. It takes a lot of time to find an image that seems unnecessary, such as when it is out of focus. In addition, when previewing an image on a digital camera liquid crystal, it is often difficult to determine the image quality of the image data due to the limitation of the resolution of the monitor. Conventionally, it has to be confirmed or printed out on a PC monitor. A sufficient image could not be selected.

  Therefore, the present invention has an image I / F capable of sucking up an image generated by a digital camera and the like, an image storage means for storing the sucked image in a hard disk, and a print means capable of printing out the image, The quality of the image stored in the image storage means is automatically analyzed, the priority of the image is determined according to the image quality, and an image with a low priority is deleted or compressed at a high compression rate based on the priority It is possible to efficiently manage a large number of digital camera images by proposing a multi-function system having an automatic image management function characterized in that the data amount is reduced and stored again by a simple compression means.

  According to the present invention, there is provided an image I / F capable of sucking up an image generated by a digital camera and the like, an image storing means for storing the picked-up image on a hard disk, and a printing means capable of printing out the image. Automatically analyzing the quality of the image stored in the image storage means, determining the priority of the image according to the quality of the image, and erasing or compressing the low priority image based on the priority Providing a multi-function system with an automatic image management function characterized by reducing the amount of data and re-storing it with an efficient compression means, enabling efficient management of a large number of digital camera images .

  Examples of the present invention will be described below.

  FIG. 1 is a conceptual schematic diagram illustrating the system configuration of the first embodiment.

  In FIG. 1, reference numeral 101 denotes a network using a known technology for connecting devices. In this embodiment, it is assumed that Ethernet (registered trademark) using the TCP / IP protocol is used.

  Reference numeral 102 denotes a network scanner that optically reads a document printed on paper or the like and has a network interface. The read image data is a RGB color scanner.

  Reference numerals 108, 107, and 106 each have a network interface, receive print data and image data sent via the network interface, and actually print on a medium such as paper using a known printing technique such as an electrophotographic technique. It is a network printer. Network printers 108, 107, and 106 are also connected to each device via the network 101. Here, reference numeral 108 denotes a monochrome digital multifunction peripheral, 107 denotes a color laser printer, and 106 denotes a monochrome laser beam printer.

  A fax 104 includes a network interface and transmits / receives image data via the public line 105. An interface that transmits image data read by the scanner 102 on the network 101, outputs received image data from the printers 108, 107, and 106, and inputs and outputs image data to be filed on the PC 103 on the public line 105. is there.

  Details of the hardware and software of this embodiment will be described below.

[hardware]
Overall Configuration The overall configuration diagram is shown in FIG. The Controller Unit 2000 is a controller for inputting / outputting image information and device information by connecting to a scanner 2070 as an image input device and a printer 2095 as an image output device while connecting to a LAN 2011 or a public line (WAN) 2051. is there.

  A CPU 2001 is a controller that controls the entire system. A RAM 2002 is a system work memory for operating the CPU 2002, and is also an image memory for temporarily storing image data. A ROM 2003 is a boot ROM, and stores a system boot program. The HDD 2004 includes a hard disk drive and an IDE controller, and stores system software, image data, and management information thereof. An operation unit I / F 2006 is an operation unit (UI) 2012 and an interface unit, and outputs image data to be displayed on the operation unit 2012 to the operation unit 2012. Also, it plays a role of transmitting information input by the user of the system from the operation unit 2012 to the CPU 2001. A network 2010 is connected to the LAN 2011 and inputs / outputs information. A Modem 2050 is connected to the public line 2051 and inputs / outputs information. The above devices are arranged on the system bus 2007. An Image Bus I / F 2005 is a bus bridge that connects a system bus 2007 and an image bus 2008 that transfers image data at high speed, and converts a data structure. The image bus 2008 is configured by a PCI bus or the like. The following devices are arranged on the image bus 2008. The USB controller 2060 has a USB host function. When a digital camera is connected, a digital camera image can be sucked from the USB controller 2060. A scanner image processing unit 2080 corrects, processes, and edits input image data. The printer image processing unit performs printer correction, resolution conversion, and the like on the print output image data. The image rotation unit 2030 rotates image data. The image compression unit 2040 performs compression / decompression processing of JPEG for multi-value image data and JBIG, MMR, and MH for binary image data.

Image Input / Output Unit An image input / output device is shown in FIG. A scanner unit 2070 serving as an image input device illuminates an image on paper as an original and scans a CCD line sensor (not shown), thereby converting the image into raster signal data 2071 into an electrical signal. The original paper is set on the tray 2073 of the original feeder 2072, and when the apparatus user gives a reading start instruction from the operation unit 2012, the controller CPU 2001 gives an instruction to the scanner 2070 (2071), and the feeder 2072 copies the original paper one by one. Feeds and reads the original image.

  The printer unit 2095, which is an image output device, is a part that converts raster image data 2096 into an image on paper. The method is an electrophotographic method using a photosensitive drum or a photosensitive belt, and ink is ejected from a micro nozzle array. In addition, there is an ink jet method for printing an image directly on a sheet, but any method may be used. The printing operation is started by an instruction 2096 from the controller CPU 2001. The printer unit 2095 has a plurality of paper feed stages so that different paper sizes or different paper orientations can be selected, and there are paper cassettes 2101, 2102, 2103, 2104 corresponding thereto. A paper discharge tray 2111 receives paper that has been printed.

Operation Unit The configuration of the operation unit 2012 is shown in FIG. The LCD display unit 2013 has a touch panel sheet pasted on the LCD, displays a system operation screen, and transmits position information to the controller CPU 2001 when a displayed key is pressed. A start key 2014 is used to start a document image reading operation. At the center of the start key 2014, there is a green and red two-color LED 2018, which indicates whether or not the start key 2014 is in a usable state. A stop key 2015 serves to stop an operation in operation. The ID key 2016 is used when inputting the user ID of the user. A reset key 2017 is used when initializing settings from the operation unit.

Scanner Image Processing Unit The configuration of the scanner image processing unit 2080 is shown in FIG. The image bus I / F controller 2081 is connected to the image bus 2008 and controls the bus access sequence and generates control and timing of each device in the scanner image processing unit 2080. The filter processing unit 2082 performs a convolution operation with a spatial filter. For example, the editing unit 2083 recognizes a closed region surrounded by a marker pen from the input image data, and performs image processing such as shading, shading, and negative / positive inversion on the image data in the closed region. A scaling unit 2084 performs enlargement and reduction by performing an interpolation operation in the main scanning direction of the raster image when changing the resolution of the read image. The scaling in the sub-scanning direction is performed by changing the scanning speed of an image reading line sensor (not shown). A table 2085 is table conversion performed to convert image data, which is read luminance data, into density data. Binarization 2086 binarizes multi-value grayscale image data by error diffusion processing or screen processing.

  The processed image data is transferred to the image bus via the image bus controller 2081 again.

Printer Image Processing Unit The configuration of the printer image processing unit 2090 is shown in FIG. The image bus I / F controller 2091 is connected to the image bus 2008, and controls the bus access sequence and generates control and timing of each device in the scanner image processing unit 2090. A resolution conversion unit 2092 performs resolution conversion for converting image data from the network 2011 or the public line 2051 into the resolution of the printer 2095. The smoothing processing unit 2093 performs processing to smooth out jaggies of the image data after resolution conversion (roughness of an image appearing at a black and white border such as an oblique line).

Image Compression Unit The configuration of the image compression unit 2040 is shown in FIG. Image bus The / F controller 2041 is connected to the image bus 2008 to control the bus access sequence, timing control for exchanging data with the input buffer 2042 and the output buffer 2045, mode setting for the image compression unit 2043, and the like. Control. The processing procedure of the image compression processing unit is shown below.

  Settings for image compression control are performed from the CPU 2001 to the image bus I / F controller 2041 via the image bus 2008. With this setting, the image bus I / F controller 2041 performs settings necessary for image compression (for example, MMR compression and JBIG expansion) for the image compression unit 2043. After performing the necessary settings, the CPU 2001 again permits image data transfer to the image bus I / F controller 2041. In accordance with this permission, the image bus I / F controller 2041 starts transferring image data from each device on the RAM 2002 or the image bus 2008. The received image data is temporarily stored in the input buffer 2042, and the image is transferred at a constant speed in response to an image data request from the image compression unit 2043. At this time, the input buffer determines whether image data can be transferred between the image bus I / F controller 2041 and the image compression unit 2043, reads the image data from the image bus 2008, and reads the image compression unit 2043. When it is impossible to write an image on the screen, control is performed so as not to transfer data (hereinafter, such control is referred to as handshaking). The image compression unit 2043 temporarily stores the received image data in the RAM 2044. This is because several lines of data are required depending on the type of image compression processing to be performed, and several lines of image data are prepared in order to compress the first one line. This is because the image cannot be compressed unless it is empty. The image data subjected to the image compression is immediately sent to the output buffer 2045. The output buffer 2045 performs handshaking with the image bus I / F controller 2041 and the image compression unit 2043 and transfers the image data to the image bus I / F controller 2041. The image bus I / F controller 2041 transfers the transferred compressed (or expanded) image data to each device on the RAM 2002 or the image bus 2008. Such a series of processing is repeated until there is no processing request from the CPU 2001 (when processing of the necessary number of pages is completed) or until a stop request is issued from this image compression unit (when an error occurs during compression and expansion). It is.

Image Rotation Unit The configuration of the image rotation unit 2030 is shown in FIG. The image bus I / F controller 2031 is connected to the image bus 2008 to control the bus sequence, control to set a mode or the like in the image rotation unit 2032, and timing to transfer image data to the image rotation unit 2032 Take control. The processing procedure of the image rotation unit is shown below.

  Settings for image rotation control are performed from the CPU 2001 to the image bus I / F controller 2031 via the image bus 2008. With this setting, the image bus I / F controller 2041 makes settings necessary for image rotation (for example, image size, rotation direction / angle, etc.) to the image rotation unit 2032. After performing the necessary settings, the CPU 2001 again permits image data transfer to the image bus I / F controller 2041. In accordance with this permission, the image bus I / F controller 2031 starts transferring image data from each device on the RAM 2002 or the image bus 2008. Here, the size is 32 bits and the image size to be rotated is 32 × 32 (bits), and when transferring image data on the image bus 2008, image transfer is performed in units of 32 bits ( The image to be handled is assumed to be binary).

  As described above, in order to obtain a 32 × 32 (bit) image, it is necessary to perform the above unit data transfer 32 times, and it is necessary to transfer image data from discontinuous addresses (see FIG. 11). ).

  The image data transferred by the discontinuous addressing is written in the RAM 2033 so that it is rotated at a desired angle at the time of reading. For example, if the rotation is 90 degrees counterclockwise, the 32-bit image data transferred first is written in the Y direction as shown in FIG. By reading in the X direction at the time of reading, the image is rotated.

  After the 32 × 32 (bit) image rotation (writing to the RAM 2033) is completed, the image rotation unit 2032 reads the image data from the RAM 2033 by the above-described reading method, and transfers the image to the image bus I / F controller 2031.

  The image bus I / F controller 2031 that has received the rotated image data transfers the data to each device on the RAM 2002 or the image bus 2008 by continuous addressing.

  Such a series of processing is repeated until there is no processing request from the CPU 2001 (when processing of the necessary number of pages is completed).

Device I / F Unit The configuration of the device I / F unit 2020 is shown in FIG. The image bus I / F controller 2021 is connected to the image bus 2008, and controls the bus access sequence and generates control and timing of each device in the device I / F unit 2020. In addition, control signals to the external scanner 2070 and printer 2095 are generated. The scan buffer 2022 temporarily stores the image data sent from the scanner 2070 and outputs the image data in synchronization with the image bus 2008. The serial-parallel / parallel-serial conversion 2023 arranges the image data stored in the scan buffer 2022 in order or decomposes and converts the image data into a data width that can be transferred to the image bus 2008. The parallel-serial / serial-parallel conversion 2024 decomposes the image data transferred from the image bus 2008 or arranges the image data in order, and converts the image data into a data width that can be stored in the print buffer 2025. A print buffer 2025 temporarily stores image data sent from the image bus 2008 and outputs the image data in synchronization with the printer 2095.

  The processing procedure at the time of image scanning is shown below. The image data sent from the scanner 2070 is stored in the scan buffer 2022 in synchronization with the timing signal sent from the scanner 2070. When the image bus 2008 is a PCI bus, when the image data is 32 bits or more in the buffer, the image data is sent from the buffer to the serial-parallel / parallel-serial conversion 2023 in the first-in first-out manner. Is transferred to the image bus 2008 through the image bus I / F controller 2021. The processing procedure at the time of image printing is shown below. When the image bus 2008 is a PCI bus, 32-bit image data sent from the image bus is received by the image bus I / F controller, sent to the parallel-serial / serial-parallel conversion 2024, and the number of input data bits of the printer 2095 Are stored in the print buffer 2025. When the image bus 2008 is IEEE1394, the serial image data sent from the image bus is received by the image bus I / F controller, sent to the parallel serial / serial / parallel conversion 2024, and the number of input data bits of the printer 2095 is determined. It is converted into image data and stored in the print buffer 2025. Then, in synchronization with the timing signal sent from the printer 2095, the image data in the buffer is sent to the printer 2095 in a first-in first-out manner.

[Software]
Overall Configuration of Software Block FIG. 2 is a software block diagram of a multi-function machine that implements the present invention.

  Reference numeral 1501 denotes a UI, that is, a user interface, which is a module that mediates with the device when the operator performs various operations and settings of the multifunction peripheral. This module transfers input information to various modules, which will be described later, and requests processing or sets data in accordance with the operation of the operator.

  Reference numeral 1502 denotes an address-book, that is, a database module that manages a data transmission destination, a communication destination, and the like. The contents of the Address-Book are used to add, delete, and acquire data by an operation from the UI 1501 and to provide data sending / communication destination information to each module described later by the operation of the operator.

  Reference numeral 1503 denotes a Web-Server module, which is used for notifying management information of the multifunction peripheral in response to a request from a Web client (not shown). The management information is read via a later-described Control-API 1518 and notified to a Web client via an HTTP 1512, a TCP / IP 1516, and a Network-Driver 1517 which will be described later.

  Reference numeral 1504 denotes a universal-send, that is, a data distribution module, which distributes data instructed to the operator by the UI 1501 to a communication (output) destination similarly designated. When the operator uses the scanner function of this device to instruct the generation of distribution data, the device is operated via the below-described Control-API 1518 to generate data.

  Reference numeral 1505 denotes a module that is executed when a printer is designated as an output destination in the Universal-Send 1504.

  A module 1506 is executed when an E-mail address is designated as a communication destination in the Universal-Send 1504.

  A module 1507 is executed when a database is specified as an output destination in the Universal-Send 1504.

  Reference numeral 1508 denotes a module that is executed when a multifunction device similar to this device is designated as an output destination in the Universal-Send 1504.

  Reference numeral 1509 denotes a Remote-Copy-Scan module, which uses the scanner function of this multifunction device, and is equivalent to the Copy function realized by this multifunction device alone, using another multifunction device connected via a network as an output destination. This module performs processing.

  Reference numeral 1510 denotes a Remote-Copy-Print module, which uses the printer function of this multifunction device, and is equivalent to the Copy function realized by this multifunction device alone with another multifunction device connected via a network or the like as an input destination. This module performs processing.

  Reference numeral 1511 denotes a module for reading out and printing Web-Pull-Print, that is, information on various home pages on the Internet or an intranet.

  Reference numeral 1512 denotes a module used when the multi-function peripheral communicates using HTTP, and provides communication to the Web-Server 1503 and Web-Pull-Print 1511 modules described above using a TCP / IP 1516 module described later.

  An lpr module 1513 provides communication to the printer module 1505 in the above-described Universal-Send 1504 by a TCP / IP 1516 module described later.

  An SMTP module 1514 provides communication to the E-mail module 1506 in the above-described Universal-Send 1504 by a TCP / IP 1516 module described later.

  Reference numeral 1515 denotes an SLM, ie, a Salutation-Manager module, which communicates with the database module 1517, DP module 1518, Remote-Copy-Scan 1509 module, and Remote-Copy-Print 1510 module in the above-mentioned Universal-Send 1504 by the TCP / IP 1516 module described later. It is to provide.

  Reference numeral 1516 denotes a TCP / IP communication module, which provides network communication to the various modules described above using a network-driver described later.

  Reference numeral 1517 denotes a network driver that controls a portion physically connected to the network.

  1518 is a Control-API, which provides an interface with a downstream module such as Job-Manager 1519 described later for an upstream module such as Universal-Send 1504, and reduces dependency between upstream and downstream modules. It enhances the applicability of each.

  Reference numeral 1519 denotes a job manager, which interprets processing instructed from the various modules described above via the control-API 1518 and gives instructions to each module described later. In addition, this module centrally manages hardware processing executed in the multifunction peripheral.

  Reference numeral 1520 denotes a CODEC-Manager that manages and controls various compression / decompression of data in the process instructed by the Job-Manager 1519.

  Reference numeral 1521 denotes an FBE-Encoder which compresses data read by a scan process executed by the Job-Manager 1519 and Scan-Manager 1524 according to the FBE format.

  Reference numeral 1522 denotes a JPEG-CODEC, which performs JPEG compression of read data and JPEG expansion processing of print data in scan processing executed by the Job-Manager 1519 and Scan-Manager 1524 and print processing executed by the Print-Manager 1526. Is.

  Reference numeral 1523 denotes an MMR-CODEC, which performs MMR compression of read data and MMR expansion processing of print data in scan processing executed by the job manager 1519 and scan manager 1524 and print processing executed by the print manager 1526. Is.

  Reference numeral 1524 denotes a scan manager, which manages and controls scan processing instructed by the job manager 1519.

  Reference numeral 1525 denotes a SCSI driver, which communicates between the Scan-Manager 1524 and the scanner unit to which the multifunction peripheral is internally connected.

  Reference numeral 1526 denotes a print manager, which manages and controls print processing instructed by the job manager 1519.

  Reference numeral 1527 denotes an engine-I / F driver, which provides an interface between the print-manager 1526 and the printing unit.

  A parallel port driver 1528 provides an I / F when the Web-Pull-Print 1511 outputs data to an output device (not shown) via the parallel port.

Application An embodiment of an embedded application according to the present invention will be described below with reference to the drawings.

  FIG. 13 shows a built-in application block relating to distribution of the present invention.

  Reference numeral 4050 denotes a block indicating the operation unit application of the present invention described in 3000 above.

  4100 is a block diagram showing the transmission side of the remote copy application.

  4150 is a block diagram showing the transmission side of the broadcast distribution.

  4200 is a block diagram showing a Web Pull Print module.

  4250 is a block diagram showing the Web Server module.

  4300 is a block diagram showing the remote copy receiving side (printing side).

  Reference numeral 4350 is a block diagram for receiving and printing an image transmitted by broadcast delivery by a general-purpose printer.

  4400 is a block diagram showing the remote print receiving side (printing side).

  4450 is a block diagram for receiving and storing an image transmitted by the broadcast distribution by a known Notes Server.

  4500 is a block diagram for receiving and storing a binary image from an image transmitted by broadcast distribution.

  Reference numeral 4550 is a block diagram for receiving and storing an image transmitted by the broadcast distribution by a known Mail Server.

  Reference numeral 4600 denotes a block diagram for receiving and storing a multi-valued image transmitted by broadcast distribution.

  4650 is a diagram showing a known Web Server including information content.

  4700 is a diagram showing a known Web Browser that accesses the Web Server of the present invention.

Hereinafter, the application group will be described in detail with reference to each block.

Details of the User Interface (hereinafter referred to as UI) shown in the User Interface application 4050 block are as described above. Here, the Address Book 4051 will be described. This Address Book is stored in a non-volatile storage device (non-volatile memory, hard disk, etc.) in the device of the present invention, in which the characteristics of the device connected to the network are described. For example, those listed below are included.

Official device name or alias name Device network address Device processable network protocol Device processable document format Device processable compression type Device processable image resolution Paper size for printers , Paper source information Folder name where documents for server (computer) devices can be stored

  Each application described below can determine the characteristics of the delivery destination based on the information described in the above address book 4051.

  The Address Book can be edited, and can be downloaded and used, or directly referenced, stored in a server computer or the like in the network.

Remote Copy Application The remote copy application discriminates resolution information that can be processed by the device designated as the delivery destination from the Address Book 4051, and compresses the binary image read by the scanner using a known MMR compression. It is converted into a known TIFF (Tagged Image File Format), passed through the SLM 4103, and transmitted to the printer device on the network. Although not described in detail, the SLM 4103 is a kind of network protocol including device control information called a known Salutation Manager (or Smart Link Manager).

Broadcast distribution application Unlike the remote copy application, the broadcast distribution application can transmit images to a plurality of distribution destinations by one-time image scanning. Further, the distribution destination is not limited to the printer device, but can be directly distributed to a so-called server computer.

  The following is a pure description according to the delivery destination.

  If the destination device determines that the well-known network printer protocol LPD (Line Printer Daemon) and the well-known LIPS can be processed as a printer control command from the Address Book 4051, the image reading is similarly performed according to the image resolution determined from the Address Book 4051. In this embodiment, the image itself is compressed using a well-known FBE (First Binary Encoding), further LIPS-coded, and transmitted to the counterpart device using the LPR which is a well-known network printer protocol.

  If the delivery destination device is communicable with the SLM and is a server device, the address book 4051 is used to determine the server address and the folder in the server, and the binary image read by the scanner is read in the same way as the remote copy application. It is possible to compress using known MMR compression, convert it into a known TIFF (Tagged Image File Format), and store it in a specific folder of a server device on the network through the SLM.

  In the device of this embodiment, when the server as the counterpart device determines that a known JPEG-compressed multi-valued image can be processed, an image obtained by multi-value reading similar to the above-described binary image is used. Using compression, it is also possible to convert to a known JFIF and store it in a specific folder of a server device on the network through the SLM.

  When the delivery destination device is a known E-Mail server, the e-mail address described in Address Book 4051 is determined, the binary image read by the scanner is compressed using a known MMR compression, A TIFF (Tagged Image File Format) is used, and a known SMTP (Simple Mail Transfer Protocol) 4153 is transmitted to the E-Mail server. Subsequent distribution is performed in accordance with Mail Server 4550.

Web Pull Print Application Since the Web Pull Print application is not directly related to the present embodiment, the description thereof is omitted.

Web Server Application Since the Web Server application is not directly related to the present embodiment, the description thereof is omitted.

Device Information Service (DIS)
A database that stores setting values for devices, functions of devices (scanners, printers, etc.), status, billing information, etc. in the controller in a data format conforming to the Control API, and the device information service (hereinafter referred to as DIS) Defined as). FIG. 14 shows exchanges between the DIS 7102 and the job manager 7101 and the scan and print document managers 7103 and 7104.

  Basically, dynamic information such as a job start command is instructed directly from each job manager 7101 to each document manager, and static information such as device functions and job contents refers to the DIS 7102. Static and dynamic information and events from each DocumentManager are transmitted to the JobManager 7101 via the DIS 7102.

  When data is set and acquired from each DocumentManager to the DIS database, the internal data format of DIS is based on the Control API. Therefore, mutual conversion between the data format conforming to the Control API and the data format understood by each DocumentManager is possible. Process. For example, when setting status data from each DocumentManager, device-specific data is interpreted, converted into corresponding data defined by the Control API, and written to the DIS database.

When data is set and acquired from the JobManager to the DIS database, no data conversion occurs between the JobManager and the DIS.
In the DIS, event data is updated based on various event information notified from the DocumentManager.

  FIG. 15 shows various databases (hereinafter referred to as DB) held in the DIS, and each DB will be described. A rounded rectangle in FIG. 15 represents each DB.

  7201 is a superviser DB, which holds status and user information about the entire device, and holds information that needs to be backed up, such as a user ID and password, in an HD device or a non-volatile storage device such as a backup memory. Is done.

  Reference numeral 7202 denotes a Scan Component DB, and reference numeral 7203 denotes a Print Component DB. These Component DBs are held corresponding to each existing component. For example, in the case of a device consisting only of a printer, only the PrintComponentDB exists, and for example, in the case of a device equipped with a FAX, the FAX ComponentDB is held. In each ComponentDB, the corresponding DocumentManager sets the function and status of the Component at the time of initialization.

  Reference numeral 7204 denotes a ScanJobServiceDB, and 7205 denotes a PrintJobServiceDB. These JobServiceDBs, like ComponentDB, set functions that can be used by the corresponding DocumentManager at the time of initialization, and their support status.

  Next, JobDB and DocumentDB will be described. Reference numeral 7206 denotes a ScanJobDB, 7207 denotes each JobDB of the PrintJobDB, 7208 denotes a ScanDocumentDB, and 7209 denotes a PrintDocumentDB.

  JobDB and DocumentDB are dynamically secured and initialized by JobManager each time a job and its accompanying document are generated, and necessary items are set. Each DocumentManager reads out items necessary for processing from JobDB and DocumentDB before starting processing of Job, and starts Job. After that, when the job is finished, these jobs and the DB of the document associated therewith are released. Since Job has one or more Documents, a plurality of DocumentDBs may be secured for a certain Job.

  Reference numeral 7210 denotes a database holding event information notified from each document manager, and 7211 denotes a counter table for recording the number of scans and the number of prints of the apparatus.

  Events notified from Document Manager include Component status transition from Scan Document Manager, Scan processing operation completion and various errors, Component Status transition from Print Document Manager, Print processing operation completion, paper jam, paper feed cassette open, etc. The event ID for identifying each event is determined in advance.

  When an event is issued from the DocumentManager, the DIS registers the event ID issued in the event database 7211 and, if necessary, detailed data associated with the event. In addition, when the cancellation of the event is notified from the DocumentManager, the event data designated to be deleted is deleted from the event database 7211.

  When an event is polled by the job manager, the DIS refers to the event database 7210, returns the event ID currently generated and detailed data associated with the event to the job manager if necessary, and if no event has occurred. Reply to that effect.

  Further, when the event of the completion of the scan processing operation and the completion of the print processing operation is notified, the counter value of the user who performed the scan and print is updated. This software counter is written back each time the value is updated in the backed-up memory device or the non-volatile storage device of the HD device so that the value is not lost due to accidental power interruption or the like.

Scan Operation Details of the scan operation will be described below. FIG. 16 is a conceptual diagram of blocks related to the scanning operation. A CPU 8101, a memory 8102, an image compression / decompression board 8104, a scanner 8107, and a SCSI I / F circuit 8103 that provides an I / F for connecting this system are connected to the PCI bus 8105. A SCSI I / F circuit 8103 and a scanner (or a scanner function unit of a copier having a composite function) 8107 are connected by a SCSI interface cable 8106.

  Further, an IDE controller 8108 is connected to the PCI bus 8105, and is connected to an IDE hard disk 8110 via an IDE cable 8109. FIG. 17 shows a software structure related to the scan operation. The JobManager 8201 has a function of classifying and storing application level requests. The DIS8202 stores parameters necessary for the scanning operation from the application level. A request from the application is stored in the memory 8102. The scan operation management unit 8203 acquires information necessary for scanning from the job manager 8201 and the DIS 8202. The scan operation management unit 8203 receives the job number and document number table data 8301 in FIG. 18 from the job manager 8201, and receives the scan parameter 8302 from the DIS 8202 based on the job number and document number table data 8301. As a result, scanning is performed based on the scanning conditions requested by the application.

  The scan operation management unit 8203 passes the scan parameters 8302 acquired from the DIS 8202 to the scan sequence control unit 8204 in the order of document numbers. Upon receiving the scan parameter 8302, the scan sequence control unit 8204 controls the SCSI control unit 8207 in accordance with the content of the scan image attribute 8308. Accordingly, by operating the SCSI controller 8103 connected to the PCI 8105 in FIG. 16, a scan is executed by sending a SCSI control command to the scanner 8107 via the SCSI cable 8106. Scanned images are stored in the SCSI controller 8103 via the SCSI cable 8106 and further stored in the memory 8102 via the PCI 8105. The scan sequence control unit 8204 compresses the scan image stored in the Memory 8102 according to the content of the scan image compression format 8309 of the scan parameter 8302 when the scan is completed and the image is stored in the Memory 8102 via the PCI 8105. Therefore, a request is issued to the compression / decompression control unit 8205. The compression / decompression control unit 8205 that has received the request uses the CODEC 8104 connected to the PCI 8105 to perform compression according to the designation of the scan image compression format 8309 from the scan sequence control unit 8204. The compression / decompression control unit 8205 stores the compressed image in the Memory 8102 via the PCI 8105.

  When the compression / decompression control unit 8205 compresses the scan image into the format specified by the scan image compression format 8309 and stores it in the Memory 8102, the scan sequence control unit 8204 stores the scan image in the Memory 8102 according to the image file type 8307 of the scan parameter 8302. File compressed compressed images. The scan sequence control unit 8204 requests the file system 8206 to create a file in the file format specified by the image file type 8307 of the scan parameter 8302. The file system 8206 converts the compressed image stored in the Memory 8102 into a file according to the image file type 8307 from the scan sequence control unit 8204, transfers the file to the IDE Controller 8108 via the PCI 8105, and transfers the IDE Hard Disk 8110 via the IDE Cable 8109. The scanned compressed image is converted into a file by transferring to. When the file system 8206 stores the image filed in the IDE Hard Disk 8110, the scan sequence control unit 8204 sends back a scan end notification to the scan operation management unit 8203, assuming that one current process on the Scanner 8107 has ended. .

  At this time, if there is a document that has not been scanned on the scanner 8107 and a scan request is issued from the job manager 8201, the scan operation is again performed by the scan sequence control unit using the scan parameter 8302 stored in the DIS 8202. Request.

  If there is no unscanned document on the Scanner 8107, or if there is no scan request from the JobManager 8201, a scan end notification is issued to the JobManager 8201, assuming that the scan operation has ended.

Printing Operation The printing operation will be described in detail below.

  FIG. 19 is a conceptual diagram of blocks relating to the printing operation. A CPU 9001, a memory 9002, an image compression / expansion board 9004, a printer 9007, and an engine I / F board 9003 that provides an I / F for connecting this system are connected to the PCI bus 9005. An Engine I / F board 9003 and a printer (or a printer function unit of a copier having a composite function) 9007 are connected by an engine interface cable 9006.

  The Engine I / F board has a DPRAM inside, and through this DPRAM, parameter setting to the printer, reading of the printer status, and exchange of print control commands are performed. The board has a video controller, and transmits image data developed on the PCI to the printer via the engine interface cable in accordance with VCLK (Video Clock) and HSYNC given from the printer via the engine interface cable. The timing of this transmission is shown in FIG. VCLK continues to come out and HSYNC is given in synchronization with the start of one line of the printer. The video controller reads data for the set image width (WIDTH) from the set memory (SOURCE) on the PCI and outputs it to the engine interface cable as a video signal. After repeating this for the designated line (LINES), an IMAGE_END interrupt is generated.

  As described above, when a print job instruction is passed from the application program on the CPU to the Control API, the Control API passes this to the controller-level JobManager as a job. Furthermore, this JobManager stores the job settings in the DIS and instructs the PrintManager to start the job. When the PrintManager receives a job, it reads information necessary for job execution from the DIS and sets it in the printer via the Engine I / F board and DPRAM.

FIG. 21 shows setting items of the Engine I / F board, and FIG. 22 shows setting items, control commands, and status commands via the DPRAM of the printer.
For the sake of simplicity, the operation will be specifically described assuming that this job is a non-compressed, letter (11 "x8.5") size binary image, two pages, one copy, and a printer having 600 dpi performance.

  First, when receiving this job, PrintManager calculates the number of image bytes of the width of this image (in this case, “8.5” side).

    WIDTH = 8.5 × 600 ÷ 8≈630 (Bytes)

  Next, the number of lines is calculated.

    LINES = 11 × 600 = 6600 (Lines)

  These calculated values and the SOURCE address storing the given first page image are set in WIDTH, LINES, and SOURCE shown in FIG. At this point, the Engine I / F board is ready for image output, but the HSYNC signal from the printer does not come (VCLK is coming) and no image data is being output.

  Next, PrintManager writes 1 as the number of output copies to a predetermined address (BookNo) of the DPRAM shown in FIG. After that, an output paper feed request (FEED_REQ) for the first page is issued, and an IMAGE_REQ from the printer is awaited. When IMAGE_REQ is received from the printer, IMAGE_START is issued. In response to this, the printer starts to issue HSYNC, and the Engine I / F board waiting for HSYNC outputs an image. When the printer detects the trailing edge of the output paper, it outputs IMAGE_END, and when the output paper is discharged, it outputs SHEET_OUT. The PrintManager receives IMAGE_END of the first page, sets WIDTH, LINES, and SOURCE of the second page to the Engine I / F board, issues FEED_REQ, and waits for IMAGE_REQ. The operation after the IMAGE_REQ of the second page comes is the same as that of the first page.

[Automatic digital camera image management function]
Here, the automatic management function of the digital camera image which is the center of the present invention will be described. In this embodiment, an image of a digital camera is taken up from the USB controller 2060 and stored in the HDD 2004. When the user connects the digital camera to the USB I / F unit, a display as shown in FIG. 23 appears on the operation unit 2012. If the user selects automatic management (deletion) of digital camera images in FIG. 23, the digital camera images stored in the HDD 2004 are sequentially developed in the RAM 2002. Since the digital camera image is generally a compressed image, the image compression unit 2040 decompresses the bitmap data and develops it again in the RAM 2002. The decompressed image data on the RAM 2002 is subjected to edge extraction by the filter processing unit 2082 in the scanner image processing unit 2080. As a parameter of the filter processing unit 2082 used for edge extraction, a general filter coefficient as shown in FIG. 24 may be used. The scanner image processing unit 2080 has a function of counting the edge amount of the edge-extracted image. When the digital camera image processing is completed, the CPU 2001 reads a predetermined register area of the scanner image processing unit 2080 to read the image. The edge amount can be known.

  Examples of photographs before and after edge extraction are shown in FIGS. FIG. 25 shows a case where the photograph is normal, and FIG. 26 shows a case where the photograph is blurred. As shown in FIG. 26, when there is blurring in the image, the result of edge extraction is generally an image with low contrast, so the edge amount is smaller than in the case of FIG. Further, the CPU 2001 samples an image for each predetermined pixel on the image in order to determine the subject, creates a distribution of color information and luminance information, and generates a subject ID. Based on these pieces of information, the subject ID and the edge amount are stored as additional information of the original image data of HD2004 as shown in FIG. The image developed in the RAM 2002 releases the area of the RAM 2002 for development of the next image when the above feature extraction operation is completed and additional information to be stored in the HD 2004 is generated.

  When the feature extraction operation is completed for one stored image, an image having an edge amount equal to or less than a predetermined threshold is deleted based on the additional information shown in FIG. Here, 70% of the average value of the edge amount is set as a threshold value for each subject having the same ID. In FIG. 27, A3, B2, B4, and C1 are determined as images to be erased. When erasing an image, the user's PC is notified by means such as e-mail. The user can check a list of images to be erased among images stored in the HD 2004 on the PC. The state which is displaying the list of the image of FIG. 28 is shown.

  The screen in FIG. 28 can be viewed on a normal web browser, and in addition to image display, it is possible to refer to device status, copy and print job history, and the like. In addition, this screen has a link on the e-mail message and can be displayed with one click. The image to be erased is displayed as a thumbnail on the screen of FIG. 28. By clicking the “browse” button displayed below the thumbnail, the image can be enlarged and used for user image quality judgment. . In addition, for an image that the user determines to be unnecessary, the target image can be deleted by clicking the “delete” button displayed below the thumbnail.

  As described above, when a large number of digital camera images are stored in the HD 2004, the user automatically discriminates the out-of-focus image, so that even if a large number of photos are stored in the HD, the user can only delete the image candidates to be erased. Judgment can be made, and efficient digital camera image management is possible. In the present embodiment, the out-of-focus image erasing unit has been described, but instead of erasing, a method of replacing the HD 2004 image by re-compressing the image compression unit 2040 with a compression method having a higher compression rate may be used. In any case, the capacity of HD2004 can be effectively used.

  Also, in this embodiment, the means for specifying the out-of-focus image by extracting the edge of the image has been described. However, the image is selected not by the edge of the image but by the brightness of the image, and an image for which sufficient light quantity cannot be obtained at the time of shooting. A means for erasing the image may be used.

1 is an overall configuration diagram of a network system in the present invention. The whole software block diagram of this system. 1 is an overall block diagram of this system. FIG. 3 is an external view of a scanner unit, a printer unit, and an operation unit. The figure which shows an operation part. The block diagram of a scanner image processing part. FIG. 3 is a block diagram of a printer image processing unit. The block diagram of an image compression process part. The block diagram of a device I / F part. The block diagram of an image rotation part. Explanatory drawing of an image rotation process. Explanatory drawing of an image rotation process. The block diagram of embedded application description. The figure which shows the exchange between DIS, JobManager, PrintManager, and ScanManager. The figure which shows the database and counter inside DIS. Block diagram of hardware control related to scanning The block diagram of the software control in a scan. Schematic diagram of a parameter table in scanning. The block diagram regarding printing. FIG. 7 is a timing diagram of print image data transfer. Print parameter register table in the Engine I / F board. A communication command table between the printer and the Engine I / F board. The figure which shows the operation part display when a digital camera is connected. The figure which shows the example of the extraction filter of an edge. The figure which shows the example of an image and edge extraction result in case a photograph is normal. The figure which shows the example in case a photograph is out of focus, and an edge extraction result. The figure which shows the additional information by image ID and edge information. A state in which a list of images is displayed on the web is shown.

Explanation of symbols

101 Network 102 Network Scanner 103 PC
104 Fax
105 Public line 106, 107, 108 Network printer

Claims (4)

  An image I / F capable of sucking up an image generated by a digital camera or the like, an image storage means for storing the picked-up image on a hard disk, and a print means capable of printing out the image, the image storage means Automatically analyze the quality of the image stored in the image, determine the priority of the image according to the quality of the image, and based on the priority, the low-priority image is erased or compressed with a high compression ratio A multi-function system with an automatic management function characterized by reducing the amount of data and re-saving.   2. The multi-function system having an automatic management function according to claim 1, wherein the determination of the priority of the image determines the sharpness of the image according to a detection result of an edge portion of the image, and the sharpness and a predetermined value are determined. A multi-function system with an automatic management function, characterized in that it is based on means for judging blurring during digital camera shooting by comparing with the camera.   2. The multifunction system having an automatic management function according to claim 1, wherein the determination of the priority of the image is a brightness of an image photographed with a digital camera, and is judged based on a light amount at the time of photographing. A multi-function system with a featured automatic management function.   2. A multi-function system having an automatic management function according to claim 1, wherein when there is an image determined that the priority of the image is low, a warning is given to the user to perform image erasure or high compression on the operation unit or the like. A multi-function system with an automatic management function that displays and determines the final image erasure or high compression to the user.