KR100626688B1 - Browsing system - Google Patents

Abstract

(Problem) When using a digital camera as a client and a printer as a server, for example, when operating the server from the client, the operation of the server can be performed without making the client configuration large. .

(Solution means) The digital camera 1 and the printer 2 are connected, and the image data acquired by the digital camera 1 is directly printed by the printer 2. An operation screen for operating the printer 2 is provided to the digital camera 1 as image data.

Description

Browsing System {BROWSING SYSTEM}

1 is a view showing the configuration of a direct print system to which a browsing system according to an embodiment of the present invention is applied.

2 is an external perspective view of a digital camera.

3 is a plan view of a mode switching dial.

4 is a block diagram of a signal processing system of a digital camera.

5 is a diagram showing a recording structure of image data.

6 is an external perspective view of the printer.

7 is a plan view of a mode changeover switch.

8 is a block diagram of a signal processing system of a printer.

9 is a diagram illustrating an example of a UI image.

Fig. 10 is a diagram showing an example of description of a UI description file.

11 is a flowchart (1) showing processing performed between the digital camera and the printer in the present embodiment.

12 is a flowchart (2) showing processing performed between the digital camera and the printer in the present embodiment.

Fig. 13 is a diagram showing a selection screen of a printer.

14 is a flowchart of display processing of an operation screen;

15 is a flowchart of a print menu selection process.

16 is a view showing a state in which a selected active region is inverted.

Fig. 17 shows the description of Multi.xml;

Fig. 18 is a diagram showing a UI image represented by UI image data having a file name 0010.jpg;

19 is a flowchart (1) showing image selection processing performed in an image selection routine.

20 is a flowchart showing an image selection process performed in an image selection routine.

Fig. 21 is a diagram showing an image selection screen in the image selection routine.

Fig. 22 is a diagram showing a description of mu1ti2.xml.

Fig. 23 is a diagram showing a UI image represented by UI image data whose file name is 0031.jpg;

* Description of the symbols for the main parts of the drawings *

1 digital camera 2 printer

14 LCD 20 Mode Shift Dial

22 Cancel Button 24 Run Button

28 Up, Down, Left, Right 30, 96 Antenna

32, 98 Communication Connector 40 Imaging Section

42, 110 CPU 52 Input

60 Memory Cards 64, 116 System Memory

66, 118 Nonvolatile Memory 72, 122 Wireless Interface

73, 124 Wired Interface 92 Mode Switch

120 Print Engine 140, 142, 144 Operation Screen

140B, 140C, 140D, 142B, 142C, 142D, 146B Active Area

146 Image Select Screen

The present invention relates to a browsing system in which an operation screen for operating a server from a server is provided to the client as browsed content, the operation screen is browsed and displayed on the client, and the server is operated through the displayed operation screen.

A so-called direct print system has been proposed in which a printer and a digital camera are directly connected without a personal computer and the printer is operated by operating the printer from the digital camera. In such a direct print system, a printer selects a digital camera command, and a digital camera understands the printer's command, respectively, so that image data to be printed is selected or printed out.

However, commands for executing special functions according to the printer, such as the size of paper available to the printer, the type of paper available (glossy paper, plain paper, etc.), the number of images printable on one sheet of paper, CD-R printing, and the like. In order for the digital camera to understand all the printers on the market, a large amount of memory is required, which increases the cost of the digital camera. On the contrary, in order to understand the commands for executing various functions of the digital camera with respect to all the digital cameras on the market, the printer side also needs a large amount of memory, which increases the cost of the printer. For this reason, in the present state, even if the direct print system can be configured only between the specific printer and the specific digital camera, or the direct print system can be configured, only the basic functions of the printer or the digital camera can be used.

Therefore, by having the digital camera function as a web browser, the digital camera functions as a client and a printer as a server, the digital camera is provided as a content for displaying an operation screen from the printer to the digital camera, and the web browser is a digital camera. By using it as a user interface (UI) of the system, the system which has been able to perform control of both, even without understanding each command in both a digital camera and a printer is proposed (refer patent document 1 to 3). Moreover, the system which uses a browser, such as a mobile telephone, as a UI for control of home appliances etc. is also known.

Further, for example, a device (controlled device) to which an AV device or the like is controlled and a control device such as a television that controls the controlled device are connected, and the operation information for the controlled device to operate the controlled device to the control device ( Image information for displaying the operation screen, voice information for instructing the operation, etc.), the operation information is displayed on the control device, the control device receives the input of the operation through the operation screen, and the controlled device is The system which made it operate is also proposed (for example, refer patent document 4 to 7).

Applying these systems to a direct print system enables the digital camera to operate the printer without understanding the printer's instructions.

(Patent Document 1)

Japanese Patent Laid-Open No. 10-224676

(Patent Document 2)

Japanese Patent Laid-Open No. 2000-196799

(Patent Document 3)

Japanese Patent Laid-Open No. 2001-222318

(Patent Document 4)

Japanese Patent Laid-Open No. 9-149325

(Patent Document 5)

Japanese Patent Laid-Open No. 11-249709

(Patent Document 6)

Japanese Patent Laid-Open No. 11-328081

(Patent Document 7)

Japanese Patent Laid-Open No. 2001-136588

 However, in the systems described in Patent Documents 1 to 3, since the digital camera functions as a web browser, when a character provided as a character code is included in the content provided by the printer, a font for displaying it is stored. There is a need. However, since digital cameras are manufactured for the purpose of photographing or displaying an image, they often store only the minimum fonts necessary for an instruction such as photographing or displaying an image. For this reason, in order to display all the characters that the printer provides to the digital camera for displaying the operation screen, the digital camera needs to store all the fonts that can be used in the operation screen in correspondence with all the character codes. The structure becomes large, and the cost of a digital camera becomes high.

In addition, in the systems described in Patent Documents 4 to 7, in the case where the operation information is transmitted to the digital camera as an image, it is necessary to arrange the components constituting the operation screen such as a button for performing the operation on the operation screen. have. However, when arrange | positioning a component on an operation screen in this way, since the position and size which arrange | position a component in a digital camera need to be changed in various ways, the burden of operation of a digital camera is large.

When the system of Patent Documents 1 to 7 is applied to a direct print system, the operation screen is provided from the printer to the digital camera and displayed on the digital camera, but the image to be printed is stored in the digital camera. For this reason, in order to display an operation screen for selecting an image to print on a digital camera, the printer has previously acquired a list of image data stored in the digital camera, a list of image data, or a list of thumbnail images of the image data. It is necessary to generate an operation screen for selecting an image to print out using the acquired image data, a list or a thumbnail image, and provide it to the digital camera. In addition, in order for the printer to acquire image data from the digital camera, the printer must understand the recording structure in the image data in the digital camera. Therefore, a long time is required for the transmission and reception of image data, a list, or a thumbnail image, and the burden of processing of both the digital camera and the printer is increased.

This invention is made | formed in view of the said situation, When carrying out operation of a server from a client using a digital camera as a client, a printer as a server, for example, and do not make the structure of a client large scale, The primary purpose is to enable operation of the server.

In addition, the second object is to reduce the burden on the client when displaying the operation screen.

Moreover, especially when a digital camera functions as a client and a printer as a server, it aims at a 3rd object to be able to select the image which prints out, without putting a burden on both a digital camera and a printer.

 The first browser system according to the present invention comprises a client and a server, and the server provides an operation screen including an operation component for operating the server to the client as browsed content,

The client includes a browsing means for browsing the content, a display screen for displaying the operation screen which is the browsed content, and an operation means for accepting an operation on the server through the operation screen. ,

The server is characterized in that it provides the client with an operation screen consisting only of an image including the operation component as the content.

"Operation component" means a button for selecting an operation command included in an operation screen, a character constituting the operation command, a logo image displayed on the operation screen, an image representing an active area when functioning as a touch panel, and the like.

The "operation means" may be not only a key and a button for selecting an operation command on the operation screen but also a so-called touch panel for selecting an operation command by touching the operation screen.

The term "image including an operation component" means an image in which the operation component is included in one image, and does not include that the image of the background of the operation screen and the image of the operation component are separate.

Further, in the first browsing system according to the present invention, the client includes storage means for storing the image data, control means for displaying the image data on the display screen and selecting the image data. You may do it.

In this case, the control means is started when the operation means receives the selection start instruction of the image data via the operation screen for accepting the instruction to start the selection of the image data. You may also

Moreover, in the 1st browsing system by this invention, it has the image size assumed to display the said operation screen on the virtual display screen of a predetermined size, and the arrangement | positioning on the said operation screen of the said operation component is on the said image size Shall be prescribed by the absolute coordinate in

The client may enlarge and reduce the operation screen to display on the display screen so as to fit the size of the display screen.

In the first browsing system according to the present invention, the operation screen is composed of image data in JPEG format, and the boundary of the operation component is an integer multiple of the number of pixels of the compressed block in the image data in JPEG format. The operation component may be disposed on the operation screen such that the position of the operation component becomes.

The second browsing system according to the present invention comprises a digital camera and a printer, and the printer provides an operation screen including an operation component for operating the printer as the browsed content to the digital camera,

The digital camera includes browsing means for browsing the contents, a display screen for displaying the operation screen that is the browsed content, operation means for receiving an operation on the printer through the operation screen, and image data by shooting. A browsing system comprising: an image pickup means for acquiring an image; a storage means for storing the image data; and a control means for displaying the image data on the display screen and selecting the image data.

And when the operation means receives the selection start instruction of the image data via the operation screen for receiving the instruction to start the selection of the image data, the control means is activated to execute the selection process of the image data. .

(Example)

Hereinafter, embodiments of the present invention will be described with reference to the drawings. 1 is a view showing the configuration of a direct print system to which a browsing system according to an embodiment of the present invention is applied. As shown in Fig. 1A, the direct printing system according to the present embodiment wirelessly connects the digital camera 1 and the printer 2 as a client and a server, respectively, from the digital camera 1 to the printer 2; ) To print out the image data acquired by the digital camera 1. As shown in Fig. 1B, the digital camera 1 and the printer 2 are connected by wire with a cable 3 of a standard such as IEEE1394, USB, Ethernet (registered trademark), and the digital camera. The printer 2 may be operated from (1) to print out the image data acquired by the digital camera 1. The printer 2 may not only be directly connected to the digital camera 1 but also may be on the Internet.

2 is an external perspective view of a digital camera. As shown in Fig. 2, the digital camera 1 includes a photographing lens 12 for forming an image of a subject on an image pickup unit, a liquid crystal monitor (LCD) 14 for displaying various information such as image data and coma numbers; , A power switch 16 for inputting the start and stop of the digital camera 1, a release button 18 for instructing the low cost shooting of the digital camera 1, and a shooting mode provided in the digital camera 1; The desired mode from among the items displayed on the LCD 14 and the mode change dial 20 for switching and setting various modes such as a playback mode and a direct print mode, and stopping the processing or canceling the selected processing. To display a menu of various modes provided in the digital camera 1 and the cancel button 22 to be pressed at the time of execution, the execution button 24 to be pressed at the time of executing the item selected from the items displayed on the LCD 14, and the like. Press An antenna that wirelessly communicates with the printer 26 by the buttons 26, the up, down, left and right keys 28 to operate when increasing or decreasing the coma number displayed on the LCD 14, and selecting a menu. 30 and a communication connector 32 for communicating with the printer 2 by wire.

3 is a plan view of the mode switching dial 20. As shown in Fig. 3, the mode switching dial 20 is connected to a setup mode for performing the setup of the digital camera 1, a direct print mode, a personal computer, and transfer of image data to the personal computer. PC mode (PC) to play, video mode (Mov) to shoot video, camera mode (Cam) to shoot still images, and playback mode (Play) to display captured images on LCD 14 It is. In addition, in FIG. 3, the state which the mode switching dial 20 switched to the direct print mode is shown.

4 is a block diagram of a signal processing system of the digital camera 1. In the digital camera 1, the imaging unit 40 which forms an object image on a light receiving surface, performs photoelectric conversion, and outputs it as image data, controls the entire digital camera 1, and controls sampling timing of image data. CPU 42 for controlling image data recording control, communication control, display control and browsing of operation screen, and a signal for processing such as image size change, sharpness correction, gamma correction, contrast correction and white balance correction A processing unit 44, an A / D converter 46 for converting image data of analog information into digital image data, a strobe 48, a strobe control unit 50 for controlling the operation of the strobe 48, Input unit used when a user inputs information such as a release button 18, a mode switching dial 20, a cancel button 22, an execution button 24, a menu button 26, and up, down, left, right keys 28 or the like ( 52 and setting of the input unit 52 The interface I / O (54) for inputting information is provided.

In addition, the digital camera 1 is detachably attached to the compression thawing unit 56 and the memory card slot 58 to decompress image data by a method represented by JPEG or Motion JPEG, or to decompress the compressed image data. The card interface 62 which converts image data in order to record or read image data in the memory card 60 is provided. The memory card 60 is a removable recording medium represented by semiconductor, magnetic recording and optical recording.

In addition, the digital camera 1 includes an operation program of the CPU 42 including a program of a web browser and a program for executing an image selection routine for selecting an image, a ROM in which each constant is stored, and a task at the time of program execution. System memory 64 constituted by RAM serving as an area, a rewritable nonvolatile memory 66 that can continuously store various set constants of the digital camera 1 after power off, and timer photography A timer 68 driven at time, a calendar clock 70 indicating the current time, a wireless interface 72 used for transmitting and receiving image data and various information with the printer 2 by wireless communication, A wired interface 73 of a standard such as USB, IEEE1394, Ethernet (registered trademark) or the like used for transmitting and receiving image data and various types of information to and from the printer 2 by wireless communication; Frame memory 76 composed of an LCD control unit 74 for performing D / A or the like for displaying data on the LCD 14, and a VRAM or the like for temporarily storing display image data commanded from the CPU 42. And an OSD 78 for converting into text or message data indicating code information commanded from the CPU 42 and displaying the image on-screen together with the image; and a touch panel 80 for performing various inputs from the LCD 14; And a touch panel controller 82 for controlling the touch panel 80 is provided. Moreover, the battery 84 which supplies electric power to each part is also provided.

Then, the CPU 42 reads and executes a program of the web browser from the system memory 64, so that the CPU 42 functions as a browse means.

In the nonvolatile memory 66, the MAC address of the printer 2 necessary for performing communication in the direct print mode described later is stored. In addition, when direct printing is assumed to be performed with a plurality of types of printers 2, the MAC addresses of a plurality of printers that are supposed to perform communication are stored in the nonvolatile memory 66.

In addition, in this embodiment, input from both the touch panel 80 and the input part 52 is possible.

An antenna 30 is connected to the wireless interface 72, and a communication connector 32 is connected to the wired interface 73, respectively, and transmits and receives various information including image data to other communication devices such as the printer 2. It is possible to do.

The wireless interface 72 is an interface using light such as radio waves, ultrasonic waves, and infrared rays. When using radio waves, it may be based on specifications of wireless communication such as a wireless LAN (local area network).

5 is a diagram showing a recording structure of image data in the memory card 60. As shown in FIG. As shown in FIG. 5, a directory ("O01Vacation" and "002Birthday" in FIG. 5) having a three-digit number and name is formed in the lower layer of the root directory (Root). Image data consisting of file names having a digit number is stored. If a file name is missing, such as DSCFO002.JPG in the O02Birthday directory, the image data of the file name does not exist. The three-digit number of the directory is the directory number, and the four-digit number of the image data is the comma number. For this reason, for example, DSCFOOO1.JPG in the OO1Vacation directory may be represented by OO1-OOO1 as a directory number and comma number. When the image data is displayed on the LCD 14, the directory number and coma number are displayed as in O01-0001.

6 is an external perspective view of the printer 2. As shown in FIG. 2, the printer 2 includes a card slot 90 into which the memory card 60 is inserted and a mode switching switch 92 for setting a mode for reading image data into the printer 2. And an operation switch group 94 for performing various inputs for operating the printer 2, an antenna 96 for performing wireless communication with the digital camera 1, and a wire with the digital camera 1 A display group 102 including a communication connector 98 for communicating with the printer, a discharge tray 100 for receiving the printed output, and an LED for displaying the operation state of the printer 2; It is.

7 is a plan view of the mode changeover switch 92. As shown in Fig. 7, the mode changeover switch 92 includes a card mode (Card) for reading image data from the memory card 60, and a wireless personal computer mode (PC (Wireless) for reading image data from a personal computer wirelessly. ), A wireless camera mode (Cam (Wire1ess)) for wirelessly reading image data from the digital camera 1, a wired personal computer mode (PC) for reading image data from a personal computer connected by wire, a digital connected by wire The wired camera mode Cam for reading image data from the camera 1 is configured to be switchable. 7, the mode changeover switch 92 is switched to the wireless camera mode.

In the present embodiment, the printer 2 is assumed to be used in connection with the digital camera 1 or a personal computer. However, when connecting with a personal computer, the user displays an operation screen on the personal computer to display the printer (2). In the case of direct printing by connecting to the digital camera 1, the user displays the operation screen on the LCD 14 of the digital camera 1 to operate the printer 2. . For this reason, the printer 2 does not have an integrated display for performing an operation.

8 is a block diagram of a signal processing system of the printer 2. In the printer 2, the CPU 110 which controls the whole printer 2 and performs image data reading control, print control, communication control and display control, and an operation switch group 94 and a display group A card interface 114 for converting data to record or read image data in the memory card 60 loaded in the card slot 90 and the I / O 112, which is an interface for inputting setting information of 102; System memory 116 constituted by a RAM, which is an operating program of the CPU 110, a ROM which stores each constant, and a RAM which is a work area for executing a program, and various setting constants of the printer 2; The rewritable nonvolatile memory 118 that can continue to be stored even after the power is turned off, the print engine 120 including a print head for performing printing, a light source, a paper feed mechanism, and the like, and wirelessly communicate image data and various information. Wireless interface 122 used for transmitting and receiving to and from the digital camera 1 and USB, IEEE1394, and Ethernet (registered for transmitting and receiving image data and various information to and from the digital camera 1 by wired communication). A wired interface 124 of a standard), a display control unit 128 for performing D / A or the like for displaying image data on an external monitor 126 connected to the printer 2, and a CPU 110. The frame memory 130 is constituted of a VRAM or the like which temporarily stores the commanded display image data.

As described later, UI image data and UI description file representing a user interface (UI) image for displaying an operation screen on the digital camera 1 when performing direct printing are stored in the nonvolatile memory 118. have.

An antenna 96 is connected to the wireless interface 122, and a communication connector 98 is connected to the wired interface 124, which transmits and receives various information including image data to and from another communication device such as the digital camera 1. It is possible.

The wireless interface 122 is an interface using light such as radio waves, ultrasonic waves, and infrared rays. When using radio waves, it may be based on specifications of wireless communication such as a wireless LAN (local area network).

9 is a diagram illustrating an example of a UI image. 9, the UI image which shows the initial operation screen displayed on the digital camera 1 first when direct printing is performed is shown. As shown in FIG. 9, the UI image 140 is comprised by drawing the image of the three active areas 140B, 140C, 140D which are operation components, and the logo image 140E on the background image 140A. The active areas 140B, 140C, and 140D are areas that can be manipulated by the touch panel 80, and the UI images 140 are displayed on the LCD 14 to be touched by touching the active areas 140B, 140C, and 140D. Instructions corresponding to the active areas 140B, 140C, 140D are transmitted from the digital camera 1 to the printer 2. In addition to the touch panel 80, the user selects the desired active regions 140B, 140C, and 140D by the up, down, left, and right keys 28, and presses the execution button 24 to activate the active regions 140B, 140C, An instruction corresponding to 140D) may be sent from the digital camera 1 to the printer 2.

In addition, in the UI image 140 shown in FIG. 9, the active areas 140B, 140C, and 140D each print a standard print which prints one image of one sheet of paper, and print a plurality of thumbnail images on one sheet of paper. The print menu of the multiprint which prints a plurality of images on an index print and a sheet of paper is shown. Then, the user can select the print menu by selecting one of the active areas 140B, 140C, and 140D.

Here, the UI image 140 has an image size assumed to be displayed on a virtual display screen of a size that the digital camera 1 has as a standard. In this embodiment, the number of pixels of the virtual display screen is 320x240 pixels. The origin of the upper left corner of the UI image 140, the x-axis in the horizontal direction of the page, and the y-axis in the vertical direction of the page are set, and the xy coordinates of the lower-right corner are (319, 239). The printer 2 transmits the UI image data indicating the UI image 140 to the digital camera 1 as it is. In addition, the UI image data file name indicating the UI image 140 for displaying the initial operation screen is set to OO01.jpg.

When the digital camera 1 receives the UI image data, the digital camera 1 enlarges and contracts the UI image 140 to fit the size of the LCD 14 of its own, and initially displays the processed UI image 140 on the LCD 14. It is displayed as an operation screen. For example, when the size of the LCD 14 is 240 x 180 pixels, the UI image 140 is reduced by 0.75 times and the reduced UI image 140 is displayed on the LCD 14. In addition, the signal processing section 44 performs the enlargement and reduction processing. In the case where the size of the LCD 14 is 320x240 pixels, the UI image 140 is displayed on the LCD 14 without performing any scaling process.

In addition, the UI image data is compressed by compression methods such as JPEG format, TIFF format, and GIF format in order to reduce the capacity, and the digital camera 1 compresses the compressed UI image data by the compression thawing unit 56. After thawing, an enlargement / reduction process is performed to display on the LCD 14.

Here, since JPEG image data is divided into a plurality of compression blocks, and each compression block is subjected to compression processing, block deformation occurs at the boundary of the compression block in an image displayed by thawing the image data in JPEG format. . For this reason, in the present embodiment, when the UI image data is made of image data in JPEG format, the boundaries of the active areas 140B, 140C, and 140D are integer multiples of the pixels (8x8 pixels) of the compression block. Active areas 140B, 140C, and 140D are drawn in the background image 140A as much as possible.

For example, the x coordinate of the left side of the active region 140B is 32, which is an integer multiple of 8 pixels, and the x coordinate of the right side is 144, which is an integer multiple of 8 pixels. The y-coordinate on the right side is 32, which is an integer multiple of 8 pixels, and the y-coordinate on the lower side is 104. The x-coordinate of the left side of the active region 140C is 176, the x-coordinate of the right side is 288, the y-coordinate of the upper side is 32, and the y-coordinate of the lower side is 104. The x-coordinate of the left side of the active region 140D is 32, the x-coordinate of the right side is 144, the y-coordinate of the upper side is 136, and the y-coordinate of the lower side is 208.

For this reason, block deformation becomes inconspicuous when the UI image 140 is displayed on the LCD 14, whereby the image quality of the UI image 140 can be improved.

10 is a diagram illustrating an example of description of a UI description file. 10 is a UI description file for displaying the UI image 140 shown in FIG. 9 as an operation screen. As shown in Fig. 10, the UI description file has a file name of "startup.xml", and the width (w) is 320 pixels, the height (h) is 240 pixels, and the file name is an image of the operation screen according to the fourth line description. UI image data of 0001.jpg is specified. In addition, the description of the fifth to seventh lines defines the position, size, and hyperreference (href) of the active regions 140B, 140C, and 140D. Specifically, the position and size of the active regions 140B, 140C, 140D are defined by the coordinates, the width w, and the height h of the upper left corner of each of the active regions 140B, 140C, 140D. When the active areas 140B, 140C, and 140D are selected, the file name of the UI description file requesting transmission is described as href.

When the digital camera 1 is connected to the printer 2, the digital camera 1 functions as a web browser, and requests startup.xml to the printer 2. Since the file name of startup.xml is fixed here, the initial operation screen can be displayed on the LCD 14 of the digital camera 1 regardless of the type of the printer 2. The digital camera 1 interprets the description of the file when the UI description file having the file name startup.xml is transmitted from the printer 2 and makes a request for the necessary UI image data to the printer 2 or to the LCD 14. An active area for operation by the touch panel 80 is set at a position specified by the UI description file on the displayed operation screen.

Next, the processing performed in this embodiment will be described. 11 and 12 are flowcharts showing processing performed between the digital camera 1 and the printer 2 in the present embodiment. In addition, in this embodiment, the mode switching dial 20 of the digital camera 1 is switched to the direct print mode, the mode switching switch 92 of the printer 2 is switched to the wireless camera mode, and wirelessly. A process of performing communication between the digital camera 1 and the printer 2 to print out image data acquired by the digital camera 1 in the printer 2 will be described. Moreover, in the process of the digital camera 1 of the flowchart shown to FIG. 11 and FIG. 12, when a user presses the cancel button 22 in any step, it is assumed that a process is stopped and it returns to step S1.

First, when the user of the digital camera 1 switches the mode switching dial 20 to the direct print mode, the digital camera 1 displays the selection screen of the printer 2 performing direct printing on the LCD 14, Here, selection of the printer 2 which performs direct printing by the user is accepted (step S1).

13 is a diagram illustrating a selection screen of the printer 2. As shown in FIG. 13, in this embodiment, the model names of the three printers 2 of "FUJIFILM NC-100", "FUJIFILM NC-50", and "xxxxx IJ-30" are displayed on the LCD 14. In addition, the model name of the printer 2 that is supposed to perform direct printing can be displayed by the user touching the up arrow or the down arrow displayed on the LCD 14 or by moving the up, down, left, and right keys 28 differently. . In addition, MAC address is provided to each model name, respectively.

In this embodiment, the following description will be given as a user's selection of "FUJIFILM NC-1OO". When the user selects the printer 2, the selected printer name is inverted and the digital camera 1 transmits a connection request to the printer 2 via the wireless interface 72 and the antenna 30 (step). S2). The printer 2 completes the connection in accordance with the connection request, and notifies the digital camera 1 of the fact (step S3). The digital camera 1 makes a request to the printer 2 for a UI description file whose file name is startup.xml (Get (startup.xml), step S4), and the printer 2 receives this request and starts.xml Is transmitted to the digital camera 1 (step S5).

The digital camera 1 interprets startup.xml (step S6). Then, a request is made to the printer 2 for UI image data whose file name is 0001.jpg necessary for displaying the initial operation screen (Get (0OO1.jpg), step S7). The printer 2 receives this request and transmits OO01.jpg to the digital camera 1 (step S8). The digital camera 1 performs display processing as an initial operation screen of 0001.jpg (step S9).

14 is a flowchart of display processing of an operation screen. First, the UI image data whose file name is OO01.jpg is defrosted (step S51), and the decoded UI image data is enlarged and reduced to fit the size of the LCD 14 (step S52). Then, the UI image 140 represented by the enlarged and reduced UI image data is displayed on the LCD 14 as an operation screen (step S53), and the processing ends.

When the initial operation screen is displayed on the LCD 14, the user of the digital camera 1 selects the print menu, and the digital camera 1 performs the process of selecting the print menu by receiving it (step S10).

15 is a flowchart of a print menu selection process. First, assuming that the UI image data is enlarged and reduced, the digital camera 1 recalculates the positions and sizes of the active regions 140B, 140C, and 140D in accordance with the magnification at the time of enlargement and reduction (step S61). For this reason, the position and size of the active regions 140B, 140C, and 140D on the initial operation screen displayed on the LCD 14 correspond to the position and size of the active regions 140B, 140C, and 140D before expansion and contraction. .

Subsequently, monitoring of whether the user touches or touches the touch panel 80 is started (step S62), and if step S62 is affirmed, it is determined whether the cancel button 22 is pressed by the user. (Step S63). If step S63 is affirmed, the communication with the printer 2 being connected is disconnected, and the flow returns to step S1 (step S64).

If step S63 is negative, it is determined whether the input by touching the selected touch panel 80, that is, the touch panel 80 is from the active area (step S65), and if step S65 is negative, step S62 Go back. If step S65 is affirmed, the color of the selected active region is inverted (step S66), and the operation screen in which the color of the selected active region is inverted is displayed on the LCD 14 (step S67), and the processing ends.

Here, for example, when the user selects a multiprint, as shown in Fig. 16, the color of the active region 140D corresponding to the multiprint is inverted. Thus, the user can easily recognize which active area he has selected. In addition, instead of inverting the colors, the user may be made aware of which active area the active area is selected by, for example, increasing the luminance of the active area, making the monochrome display, and performing the bordering. In addition, hereafter, as a user selected multiprint, it demonstrates.

Returning to Fig. 11, when the user selects a multiprint, the digital camera 1 obtains an href corresponding to the active area of the multiprint (step S11), and the file name described in the href of the multiprint is mu1ti.xml. A request for obtaining a UI description file is made to the printer 2 (Get (Multi.xml), step S12). The printer 2 receives this request and transmits multi.xml to the digital camera 1 (step S13).

17 is a diagram illustrating a description of Multi.xml. As shown in Fig. 17, Multi.xml designates UI image data having a width of 320 pixels, a height of 240 pixels, and a file name of 0010.jpg as the image of the operation screen by the fourth row description. have.

18 is a diagram showing a UI image represented by UI image data whose file name is OO1O.jpg. As shown in FIG. 18, the UI image 142 is comprised by drawing the image of the three active areas 142B, 142C, and 142D which are operation components, and the logo image 142E on the background image 142A.

In the UI image 142 shown in Fig. 18, the active areas 142B, 142C, and 142D print four images on 2-up and one sheet, respectively, which print two images on one sheet of paper. 4-up, 9-up print menu for printing 9 images on a single sheet of paper. Then, the user selects one of the active areas 142B, 142C, and 142D to select the print menu. In addition, the UI image 142 has an image size assumed to be displayed on a virtual display screen of a size that the digital camera 1 has as a standard, similar to the UI image 140 (320 x 240 pixels).

On the other hand, the fifth to seventh lines of Milti.xml prescribe the positions, sizes, and hrefs of the active regions 142B, 142C, and 142D. Specifically, the position and size of the active regions 142B, 142C and 142D are defined by the coordinates, the width w and the height h of the upper left corner of each of the active regions 142B, 142C and 142D. When the active areas 142B, 142C, and 142D are selected, the file name for requesting transmission is described as href. In addition, although described as an image-select following the href, the image-select is an image selection routine (image selection routine) executed by the digital camera 1 when the corresponding active regions 142B, 142C, and 142D are selected. Command to specify the number of commas to be selected by the image selection routine.

The digital camera 1 interprets Multi.xml (step S14) and makes a request to the printer 2 for UI image data having a file name of 0010.jpg necessary for displaying a multiprint operation screen (Get (O01O). .jpg), step S15). The printer 2 receives this request and transmits 0010.jpg to the digital camera 1 (step S16). The digital camera 1 performs display processing as an operation screen of 0010.jpg (step S17). Since this display process is the same as the display process of step S9, detailed description is abbreviate | omitted here.

When the operation screen is displayed on the LCD 14, the user of the digital camera 1 selects the print menu, and the digital camera 1 performs the process of selecting the print menu by receiving it (step S18). Since the selection processing of the print menu is the same processing as that in step S10, detailed description thereof will be omitted here. In addition, it is assumed that the user selects 2-up in the UI image 142. For this reason, the active area 142B in the UI image 142 is inverted.

When the user selects 2-up, the digital camera 1 obtains an href corresponding to the 2-up active area (step S19), and the UI description file whose file name described in the 2-up href is Multi2.xml. A request is made to the printer 2 (Get (Multi2.xml), step S20). The printer 2 receives this request and transmits Multi2.xml to the digital camera 1 (step S21). In addition, the printer 2 prepares to print 2-up of the multiprint (step S22), and prepares to receive a 2-coma image (step S23).

On the other hand, the digital camera 1 starts the program of the image selection routine in accordance with the instruction of the image-select corresponding to the 2-up active region (step S24). As shown in FIG. 5, the image selection routine performs a process of selecting two image data for 2-up printing from a plurality of image data stored in the memory card 60. As shown in FIG. 19 and 20 are flowcharts showing image selection processing performed in the image selection routine. First, the digital camera 1 sets the remaining coma number n to be selected (step S71), and displays the remaining coma number on the LCD 14 (step S72). The remaining number of commas n is the number of commas described in the image-select corresponding to the active area selected by the user in the UI image 142 (here, 2).

Subsequently, the digital camera 1 sets the current coma number to be displayed as the newest, that is, the coma number of the most recently photographed image data (step S73), and displays the image of the current coma number on the LCD 14. (Step S74). For this reason, the image selection screen is displayed on the LCD 14. 21 is a diagram illustrating an image selection screen in the image selection routine. As shown in Fig. 21, the image selection screen 144 includes an image of the current coma number 144A, the remaining number of coma numbers 144B, the coma number 144C, the shooting date and time 144D, and the left and right arrow keys 144E and 144F. ) Is displayed.

Subsequently, monitoring of whether the user touches the touch panel 80 or any input is started (step S75), and if step S76 is affirmed, it is determined whether the cancel button 22 is pressed by the user. It determines (step S76). If step S77 is affirmed, the communication with the printer 2 in the connection is disconnected, and the flow returns to step S1 (step S77).

If step S76 is denied, it is determined whether the right key of the up, down, left, right keys 28 has been pressed by the user (step S78). If step S78 is affirmed, the current coma number is increased (step S79), and step S74 Return to If Step S78 is denied, it is determined whether the left key of the up, down, left, and right keys 28 has been pressed by the user (Step S80). If Step S80 is affirmed, the current coma number is decreased (Step S81), and Step S74 Return to

On the other hand, if step S80 is denied, it is determined whether the area of the right arrow key 144F of the image selection screen 144 has been touched by the user (step S82), and if step S82 is affirmed, the current coma number is increased. (Step S83), it returns to step S74. If step S82 is denied, it is determined whether the area of the left arrow key 144E of the image selection screen 144 has been pressed by the user (step S84). If step S84 is affirmed, the current coma number is decreased ( Step S85), the process returns to step S74.

If step S84 is denied, it is determined whether the execution button 24 is pressed by the user (step S86). If step S86 is denied, the flow returns to step S75. If step S86 is affirmed, it is stored in the system memory 64 as image data for printing the image data of the current coma number (step S87), and the remaining coma number is decreased one by one (step S88), and the reduced remaining coma number (Step S89). In addition, it is determined whether or not the remaining coma number is zero (step S90). If step S90 is negative, the process returns to step S74. If step S90 is affirmed, the process ends as all the images to be printed are selected and finished.

12, following step S24, the digital camera 1 transmits the image data selected in the image selection routine to the printer 2 (Put (first comma of the selected images, step S25).) Printer 2 ), Upon receiving the image data, notifies the digital camera 1 of the completion of the reception (OK, step S26.) In this embodiment, 2-up is selected as the print menu, and in the digital camera 1 Since the 2 coma image data is selected, the digital camera 1 subsequently transmits the 2 coma image data to the printer 2 (step S27), and the printer 2 digitally receives the fact that the reception has been completed. The camera 1 is notified (step S28). The printer 2 executes printing upon receiving image data of two commas (step S29).

Fig. 22 is a diagram showing a description of Multi2.xml. As shown in Fig. 22, Multi2.xml designates UI image data having a width of 320 pixels, a height of 240 pixels, and a file name of 0031.jpg as the image of the operation screen by the fourth row description. . In addition, the UI image represented by this UI image data represents an operation screen for notifying the user that the printing is completed.

Fig. 23 is a diagram showing a UI image represented by UI image data whose file name is 0031.jpg. As shown in Fig. 23, the UI image 146 shows that one active region 146B, which is an operation component, a logo image 146C, and multiprint 2-up are completed on the background image 146A. MultiPrint 2-up Executed ”is constructed by drawing a character image 146D.

In addition, in the UI image 146 shown in FIG. 23, the active area 146C is an area for continuously selecting a constant for printing. And the printing continues by the user touching the active area 146B. In addition, the UI image 146 has the image size assumed to be displayed on the virtual display screen of the size which the digital camera 1 has as a standard similarly to the UI image 140 (320 x 240 pixels).

In the fifth line of Multi2.xml, on the other hand, the position of the active region 146C is defined. Specifically, when the position and size of the active region 146C are defined by the coordinates, the width w and the height h of the upper left corner of the active region 146C, and the active region 146C is selected. Next, the file name for requesting transmission is described as href.

The digital camera 1 interprets Multi2.xml (step S3O) and makes a request to the printer 2 for UI image data whose file name is 0031.jpg, which is necessary for displaying the printed operation screen (Get (OO31). .jpg), step S31). The printer 2 receives this request and transmits 0031.jpg to the digital camera 1 (step S32). The digital camera 1 performs display processing as an operation screen of 0031.jpg (step S33). Since this display process is the same as the display process of step S9, detailed description is abbreviate | omitted here.

When the operation screen is displayed on the LCD 14 and the user of the digital camera 1 touches the constant, the digital camera 1 selects the constant (step S34), and the digital camera 1 receives the active area of the constant. Is obtained (Step S35), and a request is made to the printer 2 for the UI description file whose file name described in the href of the constant startup-xml (Get (startup.xml), Step S36). The printer 2 receives this request, sends startup.xml to the digital camera 1 (step S37), and returns to step S6.

Thus, in this embodiment, the printer 2 provides the operation screen to the digital camera 1 as UI image data, and the digital camera 1 displays the UI image data on the LCD 14 as the operation screen. It is. For this reason, the digital camera 1 can display the operation screen on the LCD 14 only by performing a process of browsing the UI image data provided from the printer 2 and displaying it on the LCD 14. Therefore, there is no need to prepare fonts for displaying characters in the digital camera 1, and therefore, the printer 2 can be printed from the digital camera 1 without making the structure of the digital camera 1 large. ) Can be performed.

In addition, when the UI image 142 performing an operation involving the selection of the image to be printed is displayed on the digital camera 1, and the user makes an instruction involving the selection of the image data, the image selection routine of the digital camera 1 is performed. Since the printer 2 executes the selection process for the image data, the printer 2 does not need to understand the data recording structure of the digital camera 1 and access the digital camera 1 to select the image data. For this reason, image data, a list of image data, or a thumbnail image are transmitted from the digital camera 1 to the printer 2, or an operation screen for selecting an image in the printer 2 is generated using the image data. There is no need to do it. Therefore, the burden on the digital camera 1 and the printer 2 at the time of image selection can be reduced. In particular, since the digital camera 1 originally has a function of selecting an image when displaying an image on the LCD 14 or determining an image to be printed, the digital camera 1 selects an image without burdening the digital camera 1 at all. I can do it.

In addition, the UI image representing the operation screen is assumed to have an image size assuming display on the virtual display screen, and the arrangement on the operation screen of the active area is defined by absolute coordinates on the image size of the virtual display screen. The digital camera 1 does not consider the layout of the active area at all, and simply displays an operation screen for operating the printer 2 on the LCD 14 by simply scaling the UI image to fit the size of the LCD 14. I can display it. Therefore, the burden on the digital camera 1 at the time of displaying an operation screen can be reduced.

Further, in the above embodiment, the direct printing is performed by connecting the digital camera 1 and the printer 2, but the print order device and the digital camera 1 installed in the front of the photo shop are connected to the print order. The present invention can also be applied to the case where In this case, the print receiving device functions as a server, displays an operation screen like the printer 2 in the above embodiment on the digital camera 1, and receives image data selected by the user from the digital camera 1. Then, printout is performed by sending to a printer connected to the print receiving device. In this case, the print acceptance device may display the print fee and the time until the printing is completed, and may notify the user of the print fee and the time until the printing is completed.

The present invention can also be applied to a case where an image server for storing and managing image data is accessed from the digital camera 1 via a network and the image data is transmitted from the digital camera 1 to the image server. In this case, an image server is provided to the digital camera 1 in the same manner as the printer 2 of the above embodiment for an operation screen for transmitting image data. For this reason, the user of the digital camera 1 can transmit the image data acquired by the digital camera 1 to the image server by operating the operation screen.

In addition, when the image server is connected to the print server, print orders can be made at the same time. In this case, the image server provides the digital camera 1 with an operation screen for placing a print order. In this case, furthermore, the selection of the reception shop of the completed printer, the selection of a different service menu for each print order destination, and the like can be made. However, in the same manner as above, the operation screen for making the selection is provided as image data. I can do a print order without putting a burden on).

In the above embodiment, the direct printing is performed by connecting the digital camera 1 and the printer 2, but the client system is composed of a client and a server. The invention can be applied. For example, in a case where a browsing system is configured as a server by a client of a portable terminal device such as a cellular phone or a PDA and an image server for storing image data, displaying of characters in the portable terminal device is compared with a digital camera. However, if the operation screen of the image server is provided to the portable terminal apparatus as an image including the components of the operation screen, it is not necessary to display a character from the character code or to determine the arrangement of the parts constituting the operation screen. Therefore, the operation screen can be displayed at high speed.

According to the present invention, the server provides the client with an operation screen composed only of an image including the operation component as content. The client browses the content and displays the operation screen on the display screen. Here, since the operation screen is made up of only images, the client can display the operation screen on the display screen only by performing a process of browsing and displaying the content provided from the server. Therefore, even if a character is included in the operation screen provided from the server, since it is an image that is not represented by a character code, it is not necessary to prepare a font for displaying the character in the client. The server can be operated by the client without making a large scale.

In particular, by setting the client as the digital camera and the server as the printer, a direct print system can be constructed without making the configuration of the digital camera large.

Further, when the operation means of the client receives the selection start instruction of the image data via the operation screen for receiving the instruction to start the selection of the selection of the image data, the control means is activated to execute the selection process of the image data, so that the server stores the client's storage means. This eliminates the need to understand the data recording structure and access the client to select image data. Moreover, it is not necessary to send image data, a list of image data, or a thumbnail image from the client to the server, or to generate an operation screen for selecting an image on the server using the image data. Therefore, the burden on the client and server at the time of image selection can be reduced. In particular, when the client is a digital camera, since the digital camera has a function of displaying an image on the display screen or selecting an image to be displayed on the display screen, the selection of the image is not burdened to the client at all. Can be done.

In addition, it is assumed that the operation screen is displayed on the virtual display screen of a predetermined size, and the image size is assumed. By enlarging and reducing the operation screen to fit the size of its display screen, the client enlarges and reduces the operation screen to fit the size of his display screen without any consideration of the arrangement of the operation screen components. The operation screen for operating the server can be displayed on the display screen only by doing so. Therefore, the burden on the client when displaying the operation screen can be reduced.

Here, since JPEG image data divides an image into a plurality of blocks (compression blocks) and performs compression processing for each block, block deformation occurs at the boundary of blocks in an image displayed by thawing image data in JPEG format. do. For this reason, in the case where the operation screen is made of image data in JPEG format, the block deformation is arranged by arranging the operation component so that the boundary of the operation component is an integer multiple of the pixels of the compressed block in the image data in JPEG format. This becomes inconspicuous, and as a result, the image quality of the operation screen can be improved.

Claims (6)

A client and a server, the server providing an operation screen including an operation component for operating the server as the browsed content to the client, The client includes a browsing means for browsing the content, a display screen for displaying the operation screen which is the browsed content, and an operation means for accepting an operation on the server through the operation screen. , The server provides the client with the operation screen consisting of only the image including the operation component as the content, The operation component is formed on the operation screen such that the operation screen is made of image data in JPEG format, and the boundary of the operation component is an integer multiple of the number of pixels of the compression block in the JPEG format image data. A browsing system, which is arranged. The browsing system according to claim 1, wherein said client comprises storage means for storing said image data, and control means for performing display processing of said image data on said display screen and selection processing of said image data. . 3. The control means according to claim 2, wherein the control means starts when the operation means receives the selection start instruction of the image data via an operation screen for accepting the instruction to start selection of the image data, and executes the selection processing of the image data. Browsing system, characterized in that. The said operation screen has the image size assumed to display on the virtual display screen of a predetermined size, The arrangement | positioning on the said operation screen of the said operation component has the said image size in any one of Claims 1-3. Defined by absolute coordinates in, And the client displays the display screen on the display screen by enlarging and reducing the operation screen to fit the size of the display screen. delete A digital camera and a printer, the printer providing an operation screen including an operation component for operating the printer as the browsed content to the digital camera, The digital camera includes browsing means for browsing the contents, a display screen for displaying the operation screen that is the browsed content, operation means for receiving an operation on the printer through the operation screen, and image data by shooting. A browsing system comprising: an image pickup means for acquiring an image; a storage means for storing the image data; and a control means for displaying the image data on the display screen and selecting the image data. When the operation means receives the selection start instruction of the image data via the operation screen for receiving the selection start instruction of the image data, the control means is started to execute the selection process of the image data, The operation component is formed on the operation screen such that the operation screen is made of image data in JPEG format, and the boundary of the operation component is an integer multiple of the number of pixels of the compression block in the JPEG format image data. A browsing system, which is arranged.

Images