JP4838777B2 - Image processing apparatus, image processing apparatus control method, program, and storage medium - Google Patents

Description

The present invention relates to an image processing apparatus that handles a composite image composed of a plurality of images, a control method for the image processing apparatus, a program, and a storage medium.

In recent years, with the widespread use of digital cameras, there are increasing opportunities to view image data taken with digital cameras on a personal computer or television receiver at home. In this case, as a browsing method, a single image data selected by the user is displayed, or a plurality of image data is switched at a predetermined time, and a slide show display in which a plurality of images are sequentially displayed is proposed.

Furthermore, recently, a slide show display having a complicated display function such as simultaneously displaying, switching, and superimposing a plurality of image data has been proposed as a display method of image data in the slide show display so that the user can browse more happily. Yes. Patent Document 1 below discloses an invention relating to an image forming program capable of displaying and printing one piece of image data and partial image data obtained by extracting a part of the image data. However, in the invention disclosed in Patent Document 1, a fixed image data area without change is designated and displayed or recorded on a display device or a print medium.

In addition, when a plurality of image data are displayed simultaneously, it has already been proposed to display or print by designating still image data.
JP 2003-196283 A

  In a slide show display having a complicated display function such as displaying, switching, and superimposing a plurality of image data at the same time, there is a request for designating and displaying specific image data. That is, even when the user is performing a slide show display, if a specific image data is designated from among a plurality of image data included in the slide show display and can be displayed or printed, the designation of the print image becomes easy. . In this case, even if the image data is dynamically changing, if it can be easily specified, the usability of the user is improved.

  Accordingly, an object of the present invention is to provide a system that allows specific image data to be specified from composite image data composed of a plurality of image data, and that enables display and printing.

In order to achieve the above object of the present invention, an image processing apparatus according to an embodiment of the present invention includes:
Display control means for displaying a composite image composed of a plurality of images on a display device while dynamically changing one or more of the plurality of images;
Receiving means for receiving an output instruction while displaying the composite image on the display device by the display control means;
If any of the plurality of images at the timing of receiving the output instruction by the receiving unit is being changed, and the composite image in the previous timing of the change, and the composite image at the timing after said change a user as an image to be force out any of its is characterized by having a selection means for selectively displayed.

In order to achieve the above object of the present invention, a method for controlling an image processing apparatus according to another embodiment of the present invention includes:
Display control means, and a composite image composed of a plurality of images, the display control step of displaying on the display device with dynamically changing one or more images of the plurality of images,
An accepting step for accepting an output instruction from a user while the accepting means is displaying the composite image on the display device by the display control step;
When any of the plurality of images is changing at the timing when the selection unit receives the output instruction in the receiving step, the composite image at the timing before the change and the timing after the change wherein the composite image, the user as an image to be force out any of its is characterized by having a selection step of selectively displayed.

In order to achieve the above object of the present invention, still other embodiments of the present invention include:
A program for causing a computer to function as each unit of the image processing apparatus of the present invention is provided.

In order to achieve the above object of the present invention, still other embodiments of the present invention include:
A computer-readable storage medium storing a program for causing a computer to function as each unit of the image processing apparatus of the present invention is provided.

  According to the present invention, it is possible to designate specific image data from a display screen of composite image data composed of a plurality of image data, and to perform display or printing.

  Hereinafter, a television broadcast receiving apparatus (hereinafter referred to as a TV receiving apparatus) 100 will be described as an example regarding an image processing apparatus to which an embodiment of the present invention is applied.

  FIG. 1 is a schematic diagram of a system in which a printer device 200 is connected to a TV receiver 100 that is an image processing apparatus according to a first embodiment of the present invention. The TV receiver 100 includes an antenna 180, receives a broadcast signal from a broadcasting station, and acquires a video signal, an audio signal, and other information signals. These video signals, audio signals, and other information signals are output to a display unit 110 (details will be described later) such as an LCD panel or CRT, and further to an audio output unit 111 such as a speaker. Basically, the TV receiving device 100 performs various controls by signals from the remote control device 150. Of course, in some cases, the broadcast signal of the broadcast station may be received from the cable of the cable TV company without using the antenna 180.

The display unit 110 not only displays broadcast video, but also displays video signals of other AV devices, image signals stored in a memory described later, and various controls using the remote control device 150. Used as a user interface. Therefore, it is also used as a user interface when performing printing control with the connected printer device 200. The TV receiving device 100 and the printer device 200 are connected by a USB cable 140. The combination of the TV receiving device 100 and the printer device 200 can be implemented by wire or wireless. In the wired example , USB connection is conceivable, and in the wireless example , wireless LAN connection or IR communication connection is conceivable. In the illustrated example, the TV receiving device 100 and the printer device 200 are connected by a USB cable 140. The TV receiver 100 is connected to the Internet via a network cable 145 and a router 146 . Therefore, the TV receiver 100 is configured to be able to browse information on the Internet. Note that the printer device 200 may also be connected via the network cable 145.

Next, the circuit block of the TV receiver 100 will be described in detail with reference to the functional block diagram of FIG.
FIG. 2 is a functional block diagram illustrating a circuit configuration of the TV receiver 100 configured as Embodiment 1 of the present invention. In FIG. 2, a tuner unit 101 amplifies a high-frequency signal of a received television broadcast (hereinafter referred to as TV broadcast), selects a broadcast channel to be received, demodulates it, video / audio program data, various types Output TS data mixed with data.

  Reference numeral 102 denotes a data separation unit that converts TS data output from the tuner unit 101 into video / audio program data, program information data, data broadcast data (data broadcast content, various metadata, control document, Other data broadcasting data). The separated video / audio program data is supplied to the AV decoder unit 103 described later, and other program information data and data broadcast data are output to the memory unit 105 through the internal bus 104.

  The AV decoder unit 103 decodes the video / audio program data supplied from the data separation unit 102 and the video / audio data encoded by MPEG or the like supplied from the memory unit 105 through the internal bus 104.

  The audio data output from the AV decoder unit 103 is supplied to the audio control unit 107, mixed with other audio data as necessary, and then output from the audio output unit 111 as sound. The video data output from the AV decoder unit 103 is displayed on the display unit 110 after being combined with other video data, character data, graphic data, and the like to be superimposed by the display composition control unit 108.

The audio control unit 107, and the audio data from the AV decoder unit 103, switches the voice data from the internal bus 104, or synthesized, and the output sound volume, sound quality, the audio output unit 111 and controls the realism To do.

  The display composition control unit 108 processes the video program data from the AV decoder unit 103 and image data such as a digital camera generated by the graphic control unit 109 based on the control of the system control unit 112. That is, the display composition control unit 108 performs switching, composition, enlargement / reduction, other various conversions, corrections, and the like of a plurality of image data, and outputs them to the display unit 110.

Graphic controller 109, the data broadcast screen is generated based on the TV application screen for viewing digital camera of the receiving apparatus 100, control of the system control unit 112 to be described later a GUI screen or the like, such as a message.

  The display unit 110 displays the video / image data output from the display composition control unit 108, and can display a high-quality image with a resolution of 1920 × 1080 pixels, a frame rate of 60 Hz, and a size of 50 inches, for example. Including a display device.

  The memory unit 105 temporarily stores the data broadcast content and program information data separated by the data separation unit 102. Further, slide show display on the TV receiver 100 or digital camera image development data for display, display data table, display state table, print candidate buffer, and other control data are temporarily stored. Further, it is also used as a work memory used by the system control unit 112 for program execution.

113 denotes a data storage unit, for example, a HDD device, and a video / audio program data received, is also used to store image data or the like of a digital camera that is stored in the memory card 115. In addition, a print candidate list as print candidates designated for printing (hereinafter referred to as print bookmark) during the slide show display is also stored in the data storage unit 113. Furthermore, display data including OSD (On Screen Display) and GUI (Graphical User Interface) are also stored.

  Reference numeral 116 denotes an interface unit for transferring data to the printer device 200 when the printer device 200 is connected and various data is printed.

  Reference numeral 114 denotes an external memory connection unit, which includes a connector unit for connecting a memory card 115 such as a digital camera.

  The memory card 115 is composed of a semiconductor non-volatile memory used for storing image data such as a digital camera, and the TV receiver 100 stores image data such as a digital camera for slide show display and printing. ing.

  Reference numeral 117 denotes an Internet connection unit, which is connected to the Internet via a router 146, for example, and transmits and receives various data by connecting to a broadcasting station server, a billing server, and the like. Of course, it is possible to browse various other Internet information.

  A remote control control unit 118 performs remote control transmission / reception using infrared rays with the remote control device 150 and transfers received data to the system control unit 112.

  The system control unit 112 comprehensively controls each unit in the TV receiver 100. The system control unit 112 includes a CPU, a main storage memory, a bus control unit, a program storage memory, a parameter storage memory, an ID storage memory, a clock unit, a timer unit, and the like. Then, the reception channel is switched under the control of the tuner unit 101 and the data separation unit 102, and control is performed so as to receive a signal from a desired broadcast station.

The system control unit 112 also separates video / audio program data, program information, data broadcast data, and the like, displays a program, and generates data broadcast and EPG (Elctronic Program Guide) data. Further, the graphic control unit 109 is controlled to perform display such as data broadcasting and EPG. Further, image data from a digital camera or the like is read from the memory card 115 and controlled to be displayed as a slide show. Details of this will be described later.

  It also controls display of other applications in the TV receiver 100, display of messages, operation panels, and the like. When there is a request for printing image data from a digital camera or the like, the printer device 200 connected to the interface unit 116 is recognized and controlled to print the requested image data.

Further, the system control unit 112 controls the display synthesis control unit 108 to perform various information display processing such as synthesis and correction of video data from the AV decoder unit 103 and image data from the graphic control unit 109 and the like. 110 is displayed. Similarly, the system controller 112 controls the audio controller 107 performs control of the synthesis and output of audio, and controls the output to the audio output unit 111. Moreover, transmission / reception of data with the remote control device 150 operated by a viewer who is a user is controlled, and control within the TV receiving device 100 is performed based on the data. The internal bus 104 is a data and control bus. As described above, the internal bus 104 is a bus provided in the TV receiver 100 used for transferring image data and audio data and transferring information between the units.

FIG. 3 shows details of the operation surface of the remote control device 150 used with the TV receiver 100 according to the embodiment of the present invention . Key button of the remote control device 150 includes a power key 151, a volume key 152, channel key 153, etc., the key used during normal TV viewing. Furthermore, buttons such as a data broadcast key 154 (hereinafter abbreviated as “d key”) used for shifting to the data broadcast, a menu key 155 for operating the application of the TV receiving apparatus 100, a data broadcast, an application, and the like are provided. Furthermore, a cursor, an enter key, and a cancel key 156 for operating the GUI and operation panel are provided. Reference numerals 157R to 157B denote a red key, a yellow key, a blue key, and a green key, which are color keys used as function keys in the TV receiver 100. In the TV receiver 100 of the present embodiment, it is also used for slide show display and print image setting.

The red key 157R is used as a key for performing a print bookmark during the slide show display operation, but can be switched to directly start the print menu by switching. Also, remote control device 150 comprises a display unit 160, and displays the time and various messages. The remote control device 150 transfers the key code through the remote control control unit 118 of the TV receiving device 100.

  FIG. 4 is a screen during the operation of the slide show display, and is an image in which a strip type slide show display described later is executed on the display unit 110. In the figure, four strip-shaped image data A, B, C and D are displayed. A user interface operable by the remote controller 150 is displayed below the four strip-shaped image data A, B, C, and D. Thereby, the functions of the red key 157R, the yellow key 157Y, the blue key 157B, and the green key 157G during the operation of the slide show display are displayed.

FIG. 5 is a diagram illustrating a hierarchical structure of software for each control unit of the system control unit 112 of the TV receiver 100. 501 is a basic system control unit including OS, the other control unit on the basis of the management of the basic system control unit 501, the slide show display control unit 502, print candidate generation unit 503, print control unit 504 and other control unit It has a hierarchical structure in which 505 operates.

The slide show display control unit 502 generates a display data table to be described later based on an operation and setting by the viewer, and generates a display state table to be described later based on the display data table. Printing candidate generation unit 503, it is received while in slideshow display, generates a print candidate list based on the output instruction in a printing bookmark operation from viewers, and stores in the data storage unit 113. The print control unit 504 selects print image data from the print candidate list based on an operation by the viewer. Then, the printer device 200 is controlled through the interface unit 116, and image data such as a digital camera stored in the memory card 115 requested by the viewer is printed.

  The other control unit 505 includes the TV receiver 100 and all other control units including TV broadcast reception, data broadcast control, communication control, display control, and remote control.

  In the above-described slide show display, the display control unit in the other control unit 505 reads the image data stored in the memory card 115 based on the display state table and develops it as display image data. Then, the graphic control unit 109 and the display composition control unit 108 are controlled to control the slide show display.

FIG. 6 is a display data table in which image data to be displayed and display information, control information, and print setting information when performing a slide show display are collectively described. The display data table includes common display information 601 for slide show display in FIG. 6A and individual display information 602 for each image data in FIG. 6B . Common display information 601, the display form of the image, display interval, consisting of Table 示順, five items of transition effect and the print mode. These reflect the contents set by the user using the remote controller 150 before the start of the slide show display.

  As the display form of the slide show display, one image is sequentially displayed on one screen, and in addition to the normal slide show display, a strip slide show display every two pages, a slide show display every four pages, a random overlap type slide show display, and the like can be considered. . The strip-type slide show display is a display form in which one piece of image data is appropriately cut out and displayed in a strip shape as described with reference to FIG.

In the first embodiment of the present invention, as in the display state 703 shown in FIG. 7 (c) to be described later, and it divides the display screen of the display unit 110 in a vertical four displays the image A in this order. A case will be described in which a strip-type slide show display operation is performed in which when all four images are displayed, the next image is displayed so as to overlap the first image. The random overlapping slide show display is a display form in which a plurality of images are displayed so as to be scattered over the entire screen as shown in a display state 803 shown on the right side of FIG. 8C described later. The display position of each image is a slide show. The display control unit 502 appropriately calculates and determines.

Further, these display intervals are time intervals until the display of the next image is started in the slide show display, and the display is temporarily stopped during that time. The display interval is set according to the user's preference. In the embodiment of the present invention, the setting is 3 seconds. As the display order, the display order of images to be displayed as a slide show can be selected from file name order, shooting date / time order, or random order.

  The transition effect is a manner of appearance of an image when the next image is displayed with respect to the current display. In the embodiment of the present invention, slide-in, dissolve, wipe, and the like are prepared.

  The print mode is a setting mode for automatically selecting a print candidate image when performing a print bookmark for printing during the slide show display as a setting related to the entire slide show display. This can be selected from three print modes: print candidate selection mode 1, print candidate selection mode 2, and direct print mode.

Here, the print candidate selection mode 1 is based on the assumption that the image that the user wants to print is in the image displayed when the print bookmark button is pressed. And when printing bookmark, if not in the slide show display is dynamically changed, the respective image and the entire slide show display constituting a composite image (composite image) is printed candidate. If the slide show display is dynamically changing, the images constituting the slide show display before and after the change and the entire slide show display are set as print candidates.
That is, a composite image including an image additionally displayed by dynamic change and a composite image before the dynamic change and not including the additional displayed image are set as print candidates. include.

In print candidate selection mode 2, in addition to print candidate selection mode 1 described above, at the time of print bookmark, at least one image constituting the display is included in the entire slide show display other than the current slide show display. The candidate is selected based on the assumption that there is also. That is, all the other slide show displays that include each “visible” image at the timing when the press of the print bookmark button, which is an output instruction, is received are set as print candidates. In this case, only the slide show display image before the timing when the pressing of the print bookmark button is accepted is not a print candidate. In other words, after the timing of accepting the press of the print bookmark button, the slide show display further proceeds, and the slide show display images until all the images displayed at the time of the print bookmark are “hidden or disappeared” are also set as print candidates. .

  Direct print mode is a mode in which the slideshow display is paused when a bookmark key press as an output instruction is accepted, the previous image and the image contained in it are set as print candidates, the print menu screen is started, and printing is performed. It is.

On the other hand, as individual information of each individual image in the display data table, as shown by 602 in FIG. 6B , the file name of the image, the storage location, the display order of each individual image, the cut position, the cut size, The overlap with other images at the time of display, the display position, the rotation angle of the image, and the magnification are described for each image. These settings are calculated by the slide show display control unit 502 based on the display mode settings input by the user using the remote control device 150 and the images selected for display before starting the slide show display. It is.

FIGS. 7B and 7C show the display state table 702 and the display state 703 of the display screen arranged in the case of the strip type slide show display. The display state table 702 describes, in the individual display information 602, an image related to the current display (all images other than images that are not displayed at all below other images) and their states. Then, the display change table and the display state items are added to the display state table 702 of FIG. One image for slide show display is generated according to the display state table 702. FIG. 7A shows common display information for slide show display.

In the display state table 702 of FIG. 7B , the display change indicates whether the display is changing. When the display change term is “C”, it indicates that “the display is changing”. “The display is changing” means that “the image is being displayed from where there is no image”, “the image that is visible is being erased”, or “the image that is visible is superimposed by the display of another image” This is the case of “being invisible”. Further, when the display change term is “F”, it indicates that “the display has not changed”.

Further, the display state is determined by the following criteria as to whether or not an individual image constituting a composite image for slide show display is displayed on the screen. That is, when the display state item is “V”, the individual image is “visible”. The "to have seen" state, (If you are in a display change, change operation display screen at the time it was finished) display screen based on the display state table 702 in the following manner in. That is, the determination is made based on a criterion that a certain amount or more of the face portion of the image (20% or more in the present embodiment) is displayed or a certain amount or more of the entire image (50% or more in the present embodiment) is displayed. .

  Further, when the item of the display state is “H”, it means that the image is “hidden by other images or disappears and cannot be seen”, and is other than the above “visible”.

Display state table 702 in FIG. 7 (b), the slide show display display is started, the slideshow control unit 502, Ru is generated in the memory unit 105 of the TV receiver 100. The slide show display control unit 502 rewrites each time there is a dynamic display change. Therefore, the latest display state is always shown, and the display composition control unit 108 controls display on the display unit 110 along the display state table.

Figure 7 (b), the from the absence of display, display an image A starts at time D1, the display state table 702 to the situation until the image F of D10 point is displayed all, and FIG. 7 (c) in represents a display state 703 of the screen at that time. The hatched images at the times D1, D3, D5, D7, and D9 indicate that the display is changing (display change “C”). In addition, as shown by the common display information 701 in FIG. 7A , the display interval is set to 3 seconds, the display order is set to the file name order, the transition effect is set to slide-in, and the print mode is set to the print candidate selection mode 1. . Therefore, the dynamic display is temporarily stopped for 3 seconds from the time of D2, D4, and D8 until the next additional display of the images B, C, and F is started.

Figure 8 (a) ~ (c), the common display information 801, in which the random overlapping type slideshow display of the display status table 802 and the display the display state 803 of the screen was shown.

In the present embodiment, a composite image is shown starting from the time when the image A and the image B of D′ 1 are displayed and up to the time when the image I of D′ 11 is displayed. Also in this random overlapping slide show display, the display state table 802 in FIG. 8B is created as described above. Similarly to FIG. 7C , the hatched image indicates that the image is changing (display change “C”). In FIG. 8 (c), since D'7 point image "display is being changed" state, is omitted because it is difficult to express in the drawings.

9A to 9D show a case where the user presses the print bookmark button in the display state at the time of D4, D5, D6, and D9 during the operation of the strip type slide show display of FIG. 7C . The images registered in the print candidate list as print candidate images are shown. That is, when the print bookmark button is pressed at the time D4, the image A, the image B, and the composite image of the image A and the image B become print candidate images. The composite image of the actual image A and image B is displayed on the left half of the display unit 110. However, in printing, the composite image extended in the width direction becomes a print candidate image. Accordingly, three print candidate screens are registered at the time D4, five at the time D5, four at the time D6, and seven at the time D9.

Figure 10 presses the print bookmark button when displaying the two time points D4 and D9 of FIG. 7 (c), after terminating the slideshow display, when the operation for printing, displaying T V receiver 100 An example of an image displayed on the unit 110 is shown . Here, the print candidate images registered at the time D4 and the time D9 are displayed in a list so that the user can select them as image options to be printed .

(A) to (d) of FIG. 11, in random overlapping type slideshow display of the operation of FIG. 8 (c), D'1, D'5, in the display state at the time of D'6 and D'8, printing A display image registered in the print candidate list as a print candidate image when the bookmark button is pressed is shown.

FIG. 12 is a list of print candidate images that are registered by pressing the print bookmark button twice and displayed on the display unit 110 when D ′ 1 and D ′ 8 in FIG. 8C are displayed. It is an image.

It will now be described with regarding the buffer memory about the table that is used in this embodiment. The print candidate buffer is for temporarily storing a display state table that may be a print candidate, and is generated in the memory unit 105 by the slide show display control unit 502. The display image list is a list in which print candidate images are registered for the individual images (display state “V”) determined to be “visible” in the slide show display image. This is generated in the data storage unit 113 as necessary when the print bookmark button is pressed, and is used together with the print candidate list when displaying the print candidate image. Further print candidate list, the candidate print creation section 503 is for a display state table containing an image to be printed candidates keep selected from the candidate print buffer, generating the data storage unit 113 Used for printing.

<Embodiment 1>
Next, regarding the operation when the strip-type slide show display is used, the operation of the first embodiment will be described with reference to FIGS. 7 and 13 to 15.

  After the user sets the above-described parameters and image data such as the display form, transition mode, and display interval of the slide show display using the remote control device 150, the slide show display is executed. FIG. 13 shows the flow of operations for controlling the slide show display.

After the start of the process, in step S1301, the slide show display control unit 502 checks the set value, and generates a display data table in step S1302. Thus, based on the generated display data table, in step S1302, it generates a display status table for Viewing control. In step S1303, it is determined whether it is a rewriting timing based on the display interval in the common display information 701. If it is the rewriting timing, the process proceeds to step S1304 and rewriting is performed. If it is not the rewrite timing, it will wait until the rewrite timing is reached. Accordingly, during this period, dynamic display is temporarily stopped.

  Next, in step S1305, the rewritten display state table is checked for a “display change” state. If “display change is not present”, that is, if the display state table is only “display change“ F ””, step S1306 is performed. Proceed to Then, the display state table is also stored in the print candidate buffer. However, if there is a display change, that is, if there is at least one “display change“ C ””, it is not stored in the print candidate buffer. After the display state table is stored in the print candidate buffer, the process advances to step S1307 to determine whether the slide show display is completed. If NO in step S1302, the flow returns to step S1302, the next display rewrite timing is determined, and the next display state table is rewritten in step S1304. In step S1306, the “next display state table” is additionally stored in the print candidate buffer. This series of processing is performed until the slide show display ends.

  In the display of the slide show display, the display control unit in the other control unit 505 detects that the display state table has been rewritten, performs display control based on the display state table, and performs the slide show display display.

Figure 14 is a flow of operations of the printing candidate creation unit 503, the processing routine, when the slide show display is started, the process was started, the print bookmark button in step S1401 (e.g., red remote control device 150 It waits for the key 157R) to be pressed.

Here, when the user viewing the slide show display presses the print bookmark button (red key 157R) for print image registration, it is accepted as an output instruction. The print candidate creation unit 503 checks the slideshow display setting value in step S1402. If the print mode is determined to be the print candidate selection mode 1 in step S1403, the latest display state table registered in the print buffer is registered in the print candidate list in step S1404. In step S1405, it is checked whether the current display state is “display change”. If the “display change” is in progress, the process advances to step S1406 to wait for the generation of the storage operation from the display state table to the print buffer. If a save operation has occurred, the process advances to step S1407 to register the saved display state table in the print candidate list. After registration, the process advances to step S1408 to check whether the slide show display is completed. If not completed, the process returns to step S1401 to wait for the next print bookmark button to be pressed.

If it is determined in step S1405 that “display change” is not in progress, the flow advances to step S1408 to check whether the slide show display has ended. If not, the flow returns to step S1401 to wait for the next print bookmark button to be pressed. Further, in the determination of step S1403, if not a print candidate selection mode 1, the process proceeds to step S1409, performs the processing of another mode.

Note that whenever the print bookmark button is pressed at a timing other than step S1401 of this operation routine, the process returns to step S1401 to resume the operation. In this way, Yuku progressed select the image you want to print with the appreciation of the slide show display.

  FIG. 15 is an operation flow of an operation routine when performing printing. After the selection of the image to be printed is finished, the slide show display is ended, and the user uses the remote controller 150 to open the menu screen in step S1501 and display the print menu in order to print the image with the print bookmark in the slide show display. . If the user presses the button for displaying a list of print candidates, the process proceeds to step S1502, the list of print candidates is displayed, and the process further proceeds to step S1503 to check the print status table from the print candidate list and determine the print candidate image. To do.

  Here, determination of a print candidate when the print bookmark button is pressed at some timing will be described with reference to FIG.

FIGS. 9A to 9D show print candidate images when the print bookmark button is pressed at the time of D4, D5, D6, and D9 in FIG. 7C . The images with ★ on the right side of D4, D5, and D9 are slide show display images at the timing when the print bookmark button is pressed, and are described for explanation by adding “x”, but are not set as print candidate images It is.

As described above, FIG. 9A shows a case where the print bookmark button is pressed at the time D4 in FIG. 7C . In this case, the contents of the latest print candidate buffer at the time D4 ( the display state table 702 at the time D4 in FIG. 7C) are first saved in the print candidate list. The time point D4 is a timing when there is no display change. Therefore, without waiting for the storage of the print candidate buffer again, the slide show display image A and image B composed of the individual images, images A and B in the display state table 702 at the time D4 and the display state table 702 are displayed. The combined image is a printing candidate.

  In this case, if the composite image displayed in the slide show is used as a print candidate as it is, it becomes an image of the right x mark. However, in the case of the strip type slide show display, since the overall balance of this image is bad, the composite image obtained by horizontally extending the composite image is set as a print candidate image corresponding to the composite image of the slide show display.

FIG. 9B shows a case where the print bookmark button is pressed at the time D5 in FIG. 7C . In this case, first, the contents of the latest print candidate buffer at the time D4 ( the display state table 702 at the time D4 in FIG. 7C) are stored in the print candidate image list. Since the time point D5 is a timing during the display change, the storage of the display state table 702 at the next time point D6 is saved in the print candidate buffer, and the contents of the latest saved print candidate buffer (FIG. 7 (c) ) Is also registered in the print candidate image list.

The print candidate image corresponding to the time point D6 is FIG. 9C, and the print candidate image at the time point D5 in FIG. 7C is the print candidate image at the time point D4 or the time point D6. It becomes an image included in That is, as shown in FIG. 9B, the image whose display is changing at the time when the print bookmark button is pressed (the image of the x mark on the right in FIG. 9B) is not a print candidate.

FIG. 9D shows a print candidate image when the print bookmark button is pressed at the time D9 in FIG. 7C . Also in this case, as described above, the combined image of the slide show display at the time when the print bookmark is pressed is not a print candidate, and the combined image of the slide show display without change of the time display of D8 and D10 before and after that and the individual images constituting the combined image It becomes.

FIG. 10 shows an image when the print candidate images are collectively displayed on the display unit 110 of the TV receiver 100 when the print bookmark button is pressed at the time of D4 and D9 in FIG. It is.

In this way, in step S1502, as shown in FIG. 12, the determined print candidate images are displayed in a list so as to be selectable by the user as image options to be output . From here, the process proceeds to step S1503 to select a print candidate image and the number of prints. When the print image is thus determined, the red key 157R of the remote control device 150 assigned to the print start button is pressed, and printing is performed in step S1504. At this time, if you want to set the print details selects the detailed items by yellow key 157Y of the remote control device 150.

<Embodiment 2>
In the first embodiment, individual images that are “visible” when the print bookmark button is pressed, or slide show display images before and after that and “visible” individual images are set as print candidate images. However, in Embodiment 2, when the random overlapping type slideshow display shown in FIG. 8 (c), for the case of applying the print candidate selection mode 2 will be described together with the flow of the operation of FIG. 16.

  The operation of the second embodiment is an example in which all other slide show display images including individual images that are “visible” when the print bookmark button is pressed are set as print candidates.

  In this case, not only before the press of the print button, but also after the press of the print button, the slide show display further proceeds, and immediately after the print button is pressed, all of the individual images that are “visible” are “hidden or disappear or disappear” Are also candidates for printing.

First, the slide show display proceeds, and at a certain point, the user presses the print bookmark button using the remote controller 150. If it is detected that the print bookmark button is pressed in step S1601 after the process is started, the setting contents of the slide show display are confirmed in step S1602. Thereafter, the process proceeds to step S1603, and the selection mode for determining the print candidate is checked. If the selection mode for determining the print candidate is the print candidate selection mode 2, the process advances to step S1604 to register the latest display state table of the print candidate buffer in the print list. However, if the print candidate selection mode 2 is not selected, other processing is performed in step S1611.

In the case of the print candidate selection mode 2, the process proceeds to step S1605 after the registration process in step S1604. Then, the aforementioned “visible” individual images are examined from the display state table and registered in the display image list. Further, in step S1606, it is checked whether or not the individual images registered in the display image list are “visible” in the slide show display images generated from all other display state tables in the print candidate buffer. All the display state tables in the “visible” state are registered in the print candidate buffer.

Then, in step S1607, investigated whether the currently displayed slide show, which is "display change", if "being displayed change", the candidate print buffer than slideshow control unit 50 2 It is checked in step S1612 whether or not there has been stored. If it is stored, the process advances to step S1613 to add the latest display state table stored in the print buffer to the print candidate list. Further, the process proceeds to step S1614, and an individual image that is visible is detected, and the individual image is additionally registered in the display image list. Thereafter, it is checked in step S1608 whether or not there is a storage in the print candidate buffer. If there is a storage, the process proceeds to step S1609. In step S1609, it is checked whether the “visible” individual image in the display image list is displayed in the latest display state table stored in the print candidate buffer. If even one individual image is displayed, the process advances to step S1615 to add to the print candidate buffer. If it is determined in step S1607 that “display is not changing”, the same operation as described above is performed.

  Then, the process returns to step S1608, and again waits for storage in the print candidate buffer. If no individual image is detected in the display state table, it is checked in step S1610 whether the slide show display is completed. If not, the process returns to step S1601 for detecting a print bookmark button.

  If the print bookmark button is pressed again during the operation routine of the random overlap type slide show display, the process is stopped and the operation is performed again from step S1601. However, at this time, the contents of the print candidate list and the display image list remain as they are.

  Further, when the operation of the random overlap type slide show display is ended halfway, the display is ended at that time, the saving to the print image buffer is ended, and the creation of the print candidate list is also ended at that time. When the slide show display appreciation is thus completed, the operation is performed according to FIG. 15 as in the first embodiment. That is, as shown in FIG. 15, after starting the process, the user first selects a print button from the print menu displayed in step S1501, and selects a print candidate button. In step S1502, the individual images that are “visible” from the display image list and the slideshow display status image are reproduced based on the display status table from the print candidate list and displayed as print candidate images.

FIG. 12 shows a display of a print candidate image on the display unit 110 of the TV receiver 100 when the print bookmark button is pressed at both time points D ′ 1 and D′ 8 in FIG. This is an image included in either FIG. 11 (a) or FIG. 11 (d). Thus, after the list of print candidate image, select the image and the number of sheets to be printed in step S1503, to start printing in step S1504. Note that in FIGS. 11A to 11D , an image displayed with a cross is not registered as a print candidate image.

<Other embodiments>
In the first and second embodiments described above, printing bookmarks are first performed during the slide show display, and after the slide show display, the print candidate images are collectively displayed, and a print image is selected from the images. However, when the slide show display is set, the print candidate selection mode is set to “direct printing”. Then, according to the print candidate selection procedure of print mode selection 1, every time the print bookmark button is pressed, a mode is provided in which the display operation of the slide show display is paused and the print candidate screen can be displayed. A flowchart showing the operation in this case is shown in FIG.

A description of the same parts as those in the first and second embodiments is omitted. That is, the print bookmark button in the first half of the process is pressed, and steps S1701 to S1707 are the same as in the first embodiment. However, after that, in step S1708, the slide show display control unit 502 is instructed to pause, and then in step S1709, the print activation routine is activated. The print activation routine S1709 displays a print candidate image registered in the print list and performs a print operation. Note that S1713 is processing in another mode, as in the previous embodiment.

Thereafter, the slide show display control unit 502 checks in step S1710 whether the printing routine has been completed. Here, when it is detected that has ended, the process proceeds to step S1711, issues an instruction of the slide show display of the resumption, in step S1712 to be written the show is finished, continue the slide show display. In this way, it is possible to print while viewing the slide show display.

  In the above-described embodiment of the present invention, the strip type slide show display and the random overlap type slide show display have been described. However, the present invention can also be applied to other types of slide show displays. The individual images constituting the composite image are not only composed of images from various image information sources, but also from various image information sources such as broadcast signals, DVD video information, and video information stored in the HDD device. It is also possible to use a mixture of images.

  The object of the present invention can also be achieved by supplying a system or apparatus with a storage medium storing software program codes for realizing the functions of the above-described embodiments. That is, it goes without saying that this can also be achieved by the computer (or CPU or MPU) of the system or apparatus reading and executing the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.

  As a storage medium for supplying the program code, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, nonvolatile semiconductor memory card, ROM, or the like can be used. . Further, the functions of the above-described embodiments may be realized by executing the program code read by the computer.

  However, when the OS (operating system) operating on the computer performs part or all of the actual processing based on the instruction of the program code, and the functions of the above-described embodiments are realized by the processing. Needless to say, is also included.

  Furthermore, the program code read from the storage medium may be written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. After that, based on the instruction of the program code, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing, and the processing of the above-described embodiment is realized by the processing. Needless to say.

1 is a diagram showing an overall system configuration of a composite image processing apparatus in an embodiment of the present invention. It is a block diagram of a TV receiver used in the composite image processing apparatus in the embodiment of the present invention. It is a figure showing the operation surface of the remote control apparatus which controls TV receiver used by embodiment of this invention. It is a figure of the strip type slide show display performed by embodiment of this invention. It is a figure explaining the hierarchical structure of the software of the system control part used by embodiment of this invention. It is a figure which shows the display data table used by embodiment of this invention. It is a figure which shows the display state table and display state in the strip type slide show display performed by embodiment of this invention. It is a figure which shows the display state table and display state in the random overlap type slide show display performed in embodiment of this invention. It is a figure explaining registration of the printing candidate image in the strip type slide show display performed in the embodiment of the present invention. It is a figure which shows the state by which the list of the registered print candidate images displayed after completion | finish of the strip type slide show display performed by embodiment of this invention was displayed. It is a figure explaining registration of the printing candidate image in the random overlap type slide show display performed in the embodiment of the present invention. It is a figure which shows the state by which the list of the registered print candidate images displayed after completion | finish of the random overlap type slide show display performed in embodiment of this invention was displayed. Is a flow chart for explaining an operation of registering candidate print image according to the first embodiment of the present invention. Is a flow chart for explaining an operation of registering candidate print image according to the first embodiment of the present invention. Is a flow chart for explaining the printing operation of the first and second embodiments of the present invention. Is a flow chart for explaining an operation of registering candidate print image according to the second embodiment of the present invention. It is a flowchart explaining operation | movement of other embodiment of this invention.

Claims (8)

Display control means for displaying a composite image composed of a plurality of images on a display device while dynamically changing one or more of the plurality of images;
Receiving means for receiving an output instruction while displaying the composite image on the display device by the display control means;
If any of the plurality of images at the timing of receiving the output instruction by the receiving unit is being changed, and the composite image in the previous timing of the change, and the composite image at the timing after said change the image processing apparatus characterized by having a selection means for the user to selectively displayed as images to be force out any of it. The composite image at the timing after the change, the a dynamic synthetic image including the additional image displayed Ri by the change, the composite image in the previous timing of the change, before SL additional display The image processing apparatus according to claim 1, wherein the image processing apparatus is a composite image that does not include the processed image. The selecting means further outputs each of a plurality of images constituting the composite image at a timing before the change and each of a plurality of images constituting the composite image at a timing after the change. The image processing apparatus according to claim 1, wherein an image to be selected is displayed so as to be selectable by a user . The display control hand stage, performs display of the composite image while periodically and temporarily stops the dynamic change of the image,
Composite image in which the selection means is displayed, wherein the front and rear timing of accepting the output instruction by the receiving unit, a dynamic change in the image is a composite image displayed in a state of being temporarily stopped The image processing apparatus according to claim 1.   The image processing apparatus according to claim 1, further comprising: a unit that outputs the composite image selected through the selection unit to a printing apparatus. Display control means, and a composite image composed of a plurality of images, the display control step of displaying on the display device with dynamically changing one or more images of the plurality of images,
An accepting step for accepting an output instruction from a user while the accepting means is displaying the composite image on the display device by the display control step;
When any of the plurality of images is changing at the timing when the selection unit receives the output instruction in the receiving step, the composite image at the timing before the change and the timing after the change method of controlling an image processing apparatus characterized by comprising a selection step of the the composite image, the user is selectively displayed as images to be force out any of it. A program for causing a computer to function as each unit in the image processing apparatus according to any one of claims 1 to 5 . A computer-readable storage medium storing the program according to claim 7 .

Images