JP4358057B2 - Computer apparatus and image processing program - Google Patents

Description

The present invention relates to a computer system and image processing program for transmitting print data formed on the basis of the captured image to the printer.

  In recent years, photographing apparatuses such as digital cameras have rapidly spread. The imaging device includes an image sensor that outputs an image signal. The image data of the subject is formed on the basis of the image signal output from the image sensor, and the image data is stored on a recording medium attached to the image capturing device by DCF (Design rule for Camera File system). Image data recorded on the recording medium can be read out to the computer apparatus by mounting the recording medium on a card reader or by directly connecting the photographing apparatus to the computer apparatus. When a photographed image is printed by a printer connected to the computer device, print data formed based on the photographed image is transmitted from the computer device to the printer, and the printer displays the photographed image according to the print data as a printing sheet. Print on.

  The computer device is provided with an image display unit such as a liquid crystal display, and the captured image can be displayed on the image display unit by using an image processing program having a function of displaying the captured image on the image display unit. There is also an image processing program having a function of uniformly compressing captured images and displaying them side by side on an image display unit. When a plurality of captured images are compressed and displayed on the image display unit, there is an advantage that it is possible to grasp what image was captured at a glance. In the lens-fitted photo film unit, an index print sheet on which all photographed images in the photographic film are printed is handed over to the developer. For example, when a store is requested to develop a photographic film, an index print sheet is provided in which a plurality of images recorded on the photographic film are reduced and printed side by side on one recording sheet. Since all the recorded images are printed on one sheet on the index print sheet, it is possible to grasp the contents of shooting at a glance, and it is easy to select an image to be printed by looking at the index print sheet It was. In particular, the invention described in Patent Document 1 shows an index print sheet that is provided with an extra print order sheet on the main body of the index print sheet to enhance convenience when ordering extra prints.

JP-A-7-239544

  However, when a plurality of images acquired by shooting with an image processing program incorporated in a computer apparatus are compressed and arranged on the image display unit, the image includes a face because the shot images are thinned out for each predetermined pixel. In this case, the face is also thinned out. For this reason, it may not be possible to identify who is in the image even if the image displayed on the image display unit of the computer apparatus is viewed.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a computer device and an image processing program that make it easy to grasp who is in an image when an image acquired by shooting is displayed. There is.

In order to achieve the above object, in the computer device of the present invention, in the computer device that reads a captured image obtained by photographing from a recording medium and displays it on the image display unit, a detecting means for detecting a face portion from the photographed image, Extracting means for extracting the face portion detected by the means with a predetermined image size, and displaying a plurality of face images extracted by the extracting means side by side on the image display unit, and occupying the entire captured image of the face image And display control means for displaying a symbol indicating a ratio on the image display unit together with the face image .

  Further, the present invention is characterized in that there is provided print data generation means for generating print data for printing so that a plurality of face images extracted by the extraction means are arranged on the printing sheet.

  In addition, the print data generation means includes an identification number assigned to the photographed image that is the basis of the face image and an entry field for filling in a check mark when ordering printing of the photographed image together with each face image. Print data is generated so as to be printed on a printing sheet.

In the image processing program of the present invention, in the image processing program for reading a photographed image acquired by photographing from a recording medium and displaying it on an image display unit provided in a computer device, detection for detecting a face portion from the photographed image Processing, extraction processing for extracting a face portion detected by the detection processing at a predetermined image size, a plurality of face images extracted by the extraction processing are displayed side by side on an image display unit, and the photographing of the face image is performed The computer apparatus is caused to execute display control processing for displaying a symbol indicating a ratio of the entire image on the image display unit together with the face image .

  The computer device is connected to a printer that prints an image on a printing sheet based on the print data, and generates print data so that a plurality of face images extracted by the extraction process are printed side by side on the print sheet. A print data generation process is executed by a computer device.

According to the computer device of the present invention, the detecting means for detecting the face portion from the photographed image, the extracting means for extracting the face portion detected by the detecting means with a predetermined image size, and the face extracted by the extracting means A plurality of images displayed side by side on the image display unit, and display control means for displaying on the image display unit together with the face image a symbol indicating the proportion of the face image in the entire captured image. Since the face portion is displayed on the image display unit with a predetermined image size, it is possible to display a large face image on the image display unit, which makes it easier to determine who is in the captured image and is more convenient. A highly reliable computer device can be provided. In addition, it is possible to cause the user to guess how much the face occupies in the captured image, thereby providing a more convenient computer device.

  Further, by providing print data generation means for generating print data for printing so that a plurality of face images extracted by the extraction means are arranged on the print sheet, the face image extracted by the extraction means Since the images are printed side by side, it is easy to check who is in each captured image by observing the printing sheet on which the face image is printed.

  In addition, the print data generation means includes an identification number assigned to the photographed image that is the basis of the face image and an entry field for filling in a check mark when ordering printing of the photographed image together with each face image. By generating print data to be printed on a printing sheet, it is easy to determine from which captured image the face image was extracted, and when ordering printed image from a photo printing shop, etc. By entering a check mark in the entry field, it is possible to order photo printing, which increases convenience.

According to the image processing program of the present invention, a detection process for detecting a face part from the captured image, an extraction process for extracting the face part detected by the detection process with a predetermined image size, and an extraction process. A display control process for displaying a plurality of extracted face images side by side on the image display unit, and displaying a symbol indicating a ratio of the face image in the entire captured image together with the face image on the image display unit; By causing the apparatus to execute, a plurality of face portions included in the photographed image can be displayed side by side on the image display unit with a predetermined size, which makes it easy to determine who is in the photographed image. Further, it is possible to make the user guess how much the face occupies in the photographed image, and this increases the convenience.

  The computer device is connected to a printer that prints an image on a printing sheet based on the print data, and generates print data so that a plurality of face images extracted by the extraction process are printed side by side on the print sheet. By causing the computer device to execute the print data generation process, a plurality of face images are printed side by side on the printing sheet, so that a user who looks at the printing sheet can easily determine who is in the captured image.

  FIG. 1 shows an overall view of the printing system of the present invention. The printing system 2 includes a digital camera 4, a personal computer (hereinafter referred to as a personal computer) 5, and a printer 6. In the digital camera 4, shooting of the subject is started in response to pressing of the shutter button 8 to form image data, and the image data is recorded on a recording medium attached to the digital camera 4. The digital camera 4 is provided with a USB port 10 for connecting a USB cable 9 for data communication. Image data recorded on a recording medium can be output to the outside via the USB cable 9.

  The personal computer 5 includes an image display unit 12 for displaying an image, and an operation unit 15 provided with an operation panel, operation keys, and the like. The operation unit 15 includes a USB port (not shown) for inserting the USB cable 9. It has been. A mouse 16 can be connected to the operation unit 15 in order to improve operability. One end of the USB cable 9 is inserted into the USB port, and the other end of the USB cable 9 is inserted into the USB port 10 provided in the digital camera 4, thereby enabling communication with the digital camera 4. Further, the operation unit 15 is provided with a printer port (not shown) to which a printer cable 19 is connected.

  The printer 6 is provided with a paper feed base 20 for placing printing paper (printing sheet) and the like, and a power button 22 is provided on the side thereof. A connection port (not shown) for connecting a printer cable 19 is provided on the back surface of the printer 6, and the printer cable 19 from the personal computer 5 is transmitted from the personal computer 5 by being connected to the connection port of the printer 6. Print data can be received.

  FIG. 2 shows a block diagram of the digital camera 4. The digital camera 4 includes a motor controller 30 that controls driving of a motor included in the lens barrel 25, an analog processing circuit 35 that processes image signals, a CPU 37 that controls the entire operation of the digital camera 4, an SDRAM 39, and various signals. An I / O control circuit 40 for inputting / outputting, an image correction circuit 41 for adjusting image quality, image size, etc., a compression processing circuit 43 for thinning out to a predetermined image quality, a media controller 45 for recording image data on a recording medium 47, A display control unit 50 for controlling the driving of the display panel 13 provided in the liquid crystal display 49 is provided.

  A subject is imaged on the CCD image sensor 32 through the photographing lens 5 held by the lens barrel 25, and the subject image formed on the CCD image sensor 32 whose drive is controlled by the timing generator 33 is photoelectrically converted into an image signal. The converted image signal is input to the analog processing circuit 35. The analog processing circuit 35 forms image data composed of RGB digital data based on the image signal from the CCD image sensor 32. This series of operations is controlled by the CPU 37.

  When the shutter button 8 is pressed in the still image shooting mode, a signal is input to the CPU 37 via the I / O control circuit 40, and the image data output from the analog processing circuit 35 in response to a command from the CPU 37 is input to the SDRAM 39. Accumulated. The image data stored in the SDRAM 39 is input to the image correction circuit 41, where various image processing such as gamma correction and contour correction is performed, and the image data subjected to the image processing is temporarily stored in the SDRAM 39.

  The image data stored in the SDRAM 39 is input to the compression processing circuit 43 and compressed in a predetermined image quality mode. The compressed image data is input to the media controller 45 and recorded on the recording medium 47 attached to the digital camera 2. The image data is compressed according to the JPEG (Joint Photographic Experts Group) standard, and the compressed image data is attached with identification information according to a predetermined format, for example, DCF (Design Rule for Camera File system). Then, it is recorded on the recording medium 47 as an image file.

  FIG. 3 shows a schematic block diagram of the personal computer 5. The personal computer 5 includes a central processing unit 50, a RAM 52, a hard disk 54, a display control unit (display control means) 58, an information reading device 60, a printer interface (hereinafter referred to as printer I / F) 62, an external interface (hereinafter referred to as external). 64, input interface (hereinafter referred to as input I / F) 65, face detection unit (detection unit) 68, face image extraction unit (extraction unit) 70, print data generation unit (print data generation unit) ) 72 and the like.

  The external I / F 64 is formed according to the USB 2.0 standard, for example, and the external I / F 64 is provided with a USB port into which a USB cable is inserted. By inserting the USB cable 9 from the digital camera 4 into this USB port, the image file can be read from the recording medium 47 attached to the digital camera 4. In addition, even when a card reader that reads the image file by accessing the recording medium 47 is connected to the external interface 64, the image file in which the photographed image is stored can be read from the recording medium 47.

  The hard disk 54 stores data such as an operating system for starting the personal computer 5 and various application programs, and the central processing unit 50 controls various operations in accordance with these operating systems and application programs. The information reading device 60 can read various data and programs from a recording medium such as a CD-ROM, and various programs can be incorporated using the information reading inferior device 60.

  When the user operates the keyboard 73 or the mouse 16, an operation signal is input to the central processing unit 50 via the input I / F 65, and the central processing unit 50 executes various commands in response to this. The RAM 52 temporarily stores data and programs so that instructions can be executed smoothly. The information reading device 60 reads information from a recording medium such as a CD-ROM.

  The face detection unit 68 detects a face part from the photographed image according to the face detection program read from the hard disk 54. When a face part is detected from a photographed image, the photographed image is collated with a face pattern image prepared in advance, and a part similar to the face pattern image is detected from the photographed image. Whether the image is similar to the face pattern image is determined based on image feature information such as density data, and position information of a portion similar to the face pattern image is input to the face image extraction unit 70. Further, when a face portion is detected, rate information indicating how much the detected face portion occupies the entire captured image is calculated.

  In the face image extraction unit 70, based on the position information input from the face detection unit 68, a square area including a portion similar to the face pattern image is extracted from the captured image. The face image extraction unit 70 is provided with a compression / expansion circuit 70a, and a face image is formed by compressing or expanding the extracted rectangular region image to a predetermined size. The face image data is stored together with the rate information detected by the face detection unit 68 in an image file in which the photographed image is stored.

  The image display unit 12 displays various images according to user operations. When an image processing program is activated to observe a captured image, a menu panel 90 (see FIG. 5), a display icon 92 (see FIG. 5), and the like are displayed on the image display unit 12. The menu panel 90 includes a menu for sending captured images by e-mail, a menu for printing captured images, a menu for processing captured images, and the like. The display icon 92 is provided with a plurality of display modes selectable. . When the index display mode for extracting a plurality of face parts included in the photographed image from the display icons 92 at a predetermined size and displaying them in a row is selected, the face parts are extracted from the photographed images stored in the respective photographed image files. A predetermined number, for example, six face images formed based on the detected face portions are displayed side by side on the image display unit 12. When the face image is displayed on the image display unit 12, the ratio of the face portion to the entire captured image is displayed as a numerical value based on the rate information, and the identification number assigned to the image file is also displayed. When a menu for printing a photographed image is selected from the menu panel 90, a print number input field for inputting the number of prints is displayed corresponding to each face image.

  The print data generation unit 72 generates print data based on the image data stored in each image file and the face image data. The print data is composed of setting data for setting the printer and print content data for drawing an image on the printing paper. The print content data is formed based on the image data and the face image data. The setting data includes information such as the print size, the presence / absence of color print, the image quality mode, the print direction, and the like, which are formed according to the user's operation. For example, when a menu for printing a photographed image is selected from the menu panel 90, setting data is formed based on the number of prints input by the user, and print content data based on the image data of the photographed image selected by the user. Is formed. When performing index printing in which a plurality of face images are arranged and printed on a printing paper, print content data is formed based on the face image data read from each image file.

  The printer I / F 62 is provided with a printer cable connection port (not shown) into which the printer cable 19 is fitted. When the printer cable 19 from the personal computer 5 is connected to the printer cable connection port, the printer cable 19 is connected via the printer cable 19. Thus, print data can be transmitted from the personal computer 5 to the printer 6.

  FIG. 4 shows a schematic block diagram of the printer 6. The printer 6 includes a power button 22, a power control unit 75, a communication interface (hereinafter referred to as communication I / F) 76, a compression / decompression engine 78, a buffer memory 80, a print engine 83, a central control unit 85, and the like. ing. When the power button 22 is pressed, power is supplied to each part of the printer by the power control unit 75 accordingly.

  The communication I / F 76 has a connection port to which the printer cable 19 is connected. Print data from the personal computer 5 is received via the printer cable 19 connected to the connection port. The print data received by the communication I / F 76 is temporarily stored in the buffer memory 80 so that the print data can be input smoothly. The print data temporarily stored in the buffer memory 80 is input to the compression / decompression engine 78.

  The compression / decompression engine 78 compresses or decompresses the print content data based on the setting data included in the print data. After the compression process or the expansion process, the print data is input to the print engine 83.

  The print engine 83 includes a data conversion unit, a frame buffer, and a printing unit, and these are controlled by a central control unit 85. The data conversion unit converts the print content data included in the print data into raster format image data. The raster format image data is developed in the frame buffer and then input to the printing unit, and the printing unit prints an image on a printing paper set in advance on the paper feed table 20 based on the image data.

  FIG. 5 shows a plan view of the image display unit 12 in which the index display mode is selected and the face images are displayed side by side as viewed from the front. When an image processing program is activated to observe a captured image, the image display unit 12 has a menu panel 90 on which various menus are arranged, and a display for designating how the captured image is displayed on the image display unit 12. An icon 92 or the like is displayed. As a display mode indicated by the display icon 92, a thumbnail display mode for displaying a photographed image after being compressed to a certain size, a preview display mode for displaying the photographed image one by one on the image display unit 12, and details about the photographed image are shown. There are four display modes: a detailed display mode for displaying information and an index display mode for detecting and displaying a list of faces included in the captured image. The user selects a desired display mode from among these and displays the image on the image display unit 12. Display an image.

  When the index display mode is selected by the user, face image data and rate information stored in each image file and identification information assigned to each image file are read out, and the image display unit 12 receives the face display data. The face size indicating the ratio of the image to the entire image and the identification number 93 are displayed side by side with the face image 94. When two faces are detected in one photographed image, the same identification number is displayed below the face image, and when no face portion is detected from the photographed image, the face image and identification of the image file are detected. Numbers are omitted. When the face image displayed on the image display unit 12 is to be switched to the next six face images, the feed icon 95 for moving to the next screen is clicked.

  The menu panel 90 is provided with a print menu for printing a photographed image that is the basis of a face image. When the print menu is selected from the menu panel 90, as shown in FIG. A print number input field 97 for inputting the number of prints and a print icon 99 for designating whether or not to print the photographed image that is the basis of the face image are displayed. Every time the print icon 99 is clicked, whether or not to print is switched, and when the print icon 99 is not printed, the print icon 99 becomes a cross and a face image is shaded. Based on the number of prints input in the number-of-prints-input column 97, the print data generation unit 72 forms setting data. The print data formed by the print data generation unit 72 is transmitted to the printer 6, and the number of photographed images input in the print number input field 97 is printed.

  The menu panel 90 is provided with an index print menu in which face images are arranged and printed on a single print sheet. When the index print menu is selected, the image display unit 12 displays a face read from each image file. A virtual screen on which images are arranged is displayed, and the completion is notified to the user in advance. When index printing is permitted by the user who has seen the virtual screen, print data formed based on the face image data displayed and input on the image display unit 12 is input to the printer 6 and displayed on the virtual screen. A plurality of face images are printed side by side by the printer 6 on a single printing sheet.

  In addition to the index print menu, the menu panel 90 is provided with a print menu for ordering index print sheets that can easily be used for ordering photo prints at a store handling photo prints. As shown in FIG. 7, when printing of the order index print sheet is selected from the menu panel 90, the image display unit 12 displays a face image, a face size indicating the ratio of the face image to the entire image, and an identification number. In addition, a check box 110 for indicating whether or not to place a print order is shown. When the user is permitted to print the order index print sheet, print data for printing a face image, an identification number, a check box, and the like on one print sheet is transmitted to the printer 6. The printer 6 to which the print data is input prints a face image, an identification number, and a print order check box on a print sheet to form an order index print sheet. The user writes a check mark in a check box provided corresponding to the face image from the order index print sheet and brings it to a store that handles photo printing, and delivers the order index print sheet together with the recording medium 47. Thus, it is possible to simply request printing of the photographed image.

  The operation of the above configuration will be described with reference to the flowchart of FIG. The image file recorded on the recording medium 47 attached to the digital camera 4 is stored on the personal computer 5. When the image file recorded on the recording medium 47 is transferred to the personal computer 5, the digital camera 4 and the personal computer 5 are connected with the USB cable 9 or the recording medium 47 is attached to a card reader connected to the personal computer 5. The image file recorded on the recording medium 47 can be read out.

  When the image processing program incorporated in the personal computer 5 is activated, the image display unit 12 provided in the personal computer 5 displays captured images in various modes based on the image data in the image file. It becomes possible. For example, the thumbnail display mode in which the images stored in the respective image files are uniformly compressed and the compressed images are displayed side by side on the image display unit 12, and the user among the images stored in the respective image files is displayed. One selected image is displayed in a large size on the image display unit 12 and another image is displayed in a small size, a detailed display mode in which information such as the data size of the image file is displayed, and an image stored in each image file The user can select a desired display mode from an index display mode in which a face is detected from the image and a face image obtained by adjusting the detected face portion to a certain size is displayed side by side on the image display unit 12. The image processing program is installed in advance from a storage medium such as a CD-ROM using the information reading device 60.

  When an index display mode is selected when displaying a photographed image acquired by photographing on the image display unit 12, a face part is detected by the face detection unit 68 based on the photographed image and detected by the face detection unit 68. A face image adjusted to a certain size based on the face portion is extracted by the face image extraction unit 70. Six extracted face images are displayed side by side on the image display unit 12 together with the identification number of the image file storing the captured image that is the source of the face image and the face size indicating the ratio of the face portion to the entire image. The The number of faces displayed on the image display unit 12 is not limited to six and may be changed as appropriate.

  When the print menu is selected from the menu panel 90 or the print menu is selected from the file menu displayed on the image display unit 12, an input field 97 for inputting the number of prints corresponding to each face image is displayed. When the print instruction is displayed on the image display unit 12, setting data is formed based on the number of sheets input in the input field 97, and the setting data is sent to the printer 6 together with the print content data formed based on the image data. Sent.

  In the printer 6 that has received the print data, the color tone, image quality, paper size, and the like are set based on the setting data, and the photographed image is printed by the print engine 83 based on the print content data. The captured image is printed on the printing paper by the number of copies input in the input field 97.

  When the index print is selected from the menu panel 90, print data formed based on image data or the like for forming a face image is input to the printer 6, and the printer 6 prints a plurality of face images side by side on a print sheet. At this time, whether or not to print the identification number and the face size together with the face image is determined according to the user's setting operation.

  When the print menu of the order index print sheet is selected from the menu panel 90, the print order check box 110 is printed on the printing paper together with the face image. The user determines which image to print while looking at the face image on the order index print sheet, and when placing a print order, enters a check mark in a check box printed corresponding to the face image. The order index print sheet is handed over to the photo printing shop together with the recording medium 47 on which the photographed image is recorded, so that the photographed image with the check mark in the check box can be requested to be printed.

  In the above-described embodiment, the face size indicating the ratio of the face portion to the entire captured image is displayed as a number, but this face size may be displayed as another symbol. As shown in FIG. 9, when the index display mode is selected, a symbol indicating the ratio of the face image to the entire image is displayed on the image display unit together with the face image in the image display. For example, when the face portion occupies 35% or more of the entire image, the face symbol 120 is displayed, and when the face portion is 20% or more and less than 35% of the entire image, the upper body symbol 122 is displayed. If the face portion is less than 20% of the entire image, the whole body symbol 124 is displayed. In this way, the ratio of the face image to the entire image may be displayed. By using such symbols to indicate how much the size of the face image occupies in the captured image, the interest can be enhanced and the user can perceive to what extent the captured image is.

  In the above embodiment, the face image is printed on the printing paper, but the printing sheet is not limited to this. For example, the face image may be printed on a printing sheet using a release paper that can be peeled off from the mount. A plurality of release papers are arranged in advance on the printing sheet using the release paper according to the index print, and the back surface of the release paper on which the adhesive layer is formed is covered with a mount. An index print is selected from the menu panel 90 to print a face image on the release paper. By printing the face image on the release paper in this way, the release paper on which the face image is printed can be freely pasted and played, and the printing operation can be interesting.

1 is a conceptual diagram schematically showing an entire printing system. 1 is a block diagram schematically showing an electrical configuration of a digital camera. It is the block diagram which showed roughly the electrical structure of the personal computer. FIG. 3 is a block diagram schematically showing an electrical structure of a printer. It is the top view which observed the image display part when index display mode is selected from the front. It is the top view which observed the image display part from the front when a print menu is selected from a menu panel in index display mode. It is the top view which observed the image display part when the index print for order is selected from the front. It is a flowchart explaining the effect | action of the printing system of this invention. It is the top view which observed the image display part by which the ratio with respect to the picked-up image of a face image was displayed from the front.

Explanation of symbols

2 Printing system 4 Digital camera (photographing device)
5 Personal computer (computer device)
6 Printer 12 Image display unit 47 Recording medium 50 Central processing unit 58 Display control unit (display control means)
68 Face detection unit (detection means)
70 Face image extraction unit (extraction means)
72 Print Data Generation Unit (Print Data Generation Unit)
83 Print engine 85 Central control unit

Claims (5)

In a computer device that reads a captured image acquired by shooting from a recording medium and displays it on an image display unit,
Detecting means for detecting a face portion from the captured image;
Extraction means for extracting the face portion detected by the detection means at a predetermined image size;
A plurality of face images extracted by the extracting means are displayed side by side on the image display section, and a display control means for displaying a symbol indicating the ratio of the face image in the entire captured image together with the face image on the image display section. A computer apparatus comprising:   2. The computer apparatus according to claim 1, further comprising print data generation means for generating print data for printing so that a plurality of face images extracted by the extraction means are arranged on a printing sheet.   The print data generation means includes an identification number assigned to a photographed image that is the basis of the face image, and an entry field for filling in a check mark when ordering printing of the photographed image. 3. The computer apparatus according to claim 2, wherein print data is generated so as to be printed on the printing sheet together with an image. In an image processing program for reading a photographed image acquired by photographing from a recording medium and displaying it on an image display unit provided in a computer device,
Detection processing for detecting a face portion from the captured image;
An extraction process for extracting the face portion detected by the detection process at a predetermined image size;
A display control process for displaying a plurality of face images extracted by the extraction process side by side on the image display unit, and displaying a symbol indicating the ratio of the face image in the entire captured image together with the face image on the image display unit And an image processing program for causing the computer device to execute the process. A printer that prints an image on a printing sheet based on print data is connected to the computer device.
5. The image according to claim 4 , wherein the computer apparatus executes print data generation processing for generating print data so that a plurality of face images extracted by the extraction processing are printed side by side on the print sheet by the printer. Processing program.

Images