JP6981215B2 - Multifunction device, screen display method, and computer program - Google Patents

Description

The present invention relates to a technique for simultaneously displaying the screens of two systems such as an image forming apparatus and a server.

Image forming devices with various functions such as copying, scanning, faxing, and boxing are widespread. Such an image forming apparatus is sometimes called "MFP (Multi Function Peripherals)".

Further, in recent years, a technique for integrally configuring an image forming apparatus with a physical server (so-called server machine or server unit) has been proposed. Thereby, the expandability of the function of the image forming apparatus can be easily improved as compared with the conventional case. Hereinafter, a device that integrates an image forming device and a server will be referred to as a “multifunction device”.

The screen displayed by the image forming apparatus and the screen displayed by the server are different. When there is only one display touch panel display provided in the multifunction device, the screen of the image forming apparatus and the screen of the server may be switched for display.

The following patent documents disclose a technique for switching between different hardware to generate and display a screen.

The information processing apparatus described in Patent Document 1 includes first and second graphics chips, detection means, and display means. The first graphics chip has a first drawing processing capability. The second graphics chip has a second drawing processing capability. The detection means detects a request for switching from the execution of the first graphics chip to the execution of the second graphics chip. The display means displays a first screen that guides the termination of the application when the detection means detects a request for switching from the execution of the first graphics chip to the execution of the second graphics chip. The display of the first screen can guide the user to switch the graphics chip safely and easily.

Japanese Unexamined Patent Publication No. 2010-20596

Each of the image forming apparatus and the server generates a screen, one of the two sends a screen to the other, and the other creates a touch panel display by arranging the screen transmitted from one and the generated screen side by side. Display on. This makes it possible to display both screens at the same time.

However, when both screens are displayed at the same time, there may be a delay in switching screens. The information processing apparatus described in Patent Document 1 described above does not display a plurality of screens at the same time, and cannot solve this problem.

In view of these problems, it is an object of the present invention to suppress delays in screen switching in a multifunction device that simultaneously displays the screens of two systems such as an image forming apparatus and a server. And.

The composite machine according to one embodiment of the present invention is a composite machine having a first system and a second system, and the first screen, which is a screen of the first system, is added to the first system. A first transmission means for transmitting to the second system is provided, and the second system transmits the second screen, which is the screen of the second system, to the first system. Is provided, and when it becomes necessary for the first system to further update the first screen, the first screen and the first screen transmitted from the second system are transmitted. It is necessary to have the first display control means for displaying the second screen side by side on the display in a state where the first screen is updated, and the second system to further update the second screen. When it occurs, the second screen and the first screen transmitted from the first system are arranged side by side in a state where the second screen is updated and displayed on the display. A display control means is provided.

The composite machine according to another embodiment of the present invention is a composite machine having a first system and a second system, and the first screen, which is a screen of the first system, is displayed on the first system. A first transmission means, which transmits a second screen to the second system, is provided, and the second system transmits a second screen, which is a screen of the second system, to the first system. A second transmission means is provided, and when the first operation is further performed on the first system, the transmission is transmitted from the first screen and the second system. When the first display control means for displaying the second screen side by side on the display, the second system, and the second operation for the second system are performed, the second operation is performed. A second display control means for displaying the screen of the above and the first screen transmitted from the first system side by side on the display is provided.

According to the present invention, in a multifunction device that simultaneously displays the screens of two systems such as an image forming apparatus and a server, it is possible to suppress a delay in switching screens as compared with the conventional case.

It is a figure which shows the whole example of a multifunction device. It is a figure which shows the example of the hardware composition of a multifunction device. It is a figure which shows the example of the hardware composition of the MFP unit. It is a figure which shows the example of the functional configuration of the MFP unit. It is a figure which shows the example of the hardware configuration of a server unit. It is a figure which shows the example of the functional configuration of a server unit. It is a figure which shows the example of the arrangement data. It is a figure which shows the example of the operation screen. It is a figure which shows the example of the arrangement data. It is a figure which shows the example of the operation screen. It is a figure which shows the example of the compound operation screen. It is a figure which shows the example of the compound operation screen. It is a flowchart which shows the example of the whole processing flow of the MFP unit. It is a flowchart which shows the example of the whole processing flow of the MFP unit. It is a figure which shows another example of the functional configuration of the MFP unit. It is a figure which shows another example of the functional configuration of a server unit. It is a figure which shows the example of the operation screen. It is a flowchart which shows the example of the whole processing flow of the MFP unit. It is a flowchart which shows the example of the whole processing flow of the MFP unit. It is a flowchart which shows the example of the whole processing flow of the MFP unit. It is a flowchart which shows the example of the whole processing flow of the MFP unit.

[First Embodiment]
FIG. 1 is a diagram showing an overall example of the multifunction device 1. FIG. 2 is a diagram showing an example of the hardware configuration of the multifunction device 1. FIG. 3 is a diagram showing an example of the hardware configuration of the MFP unit 2. FIG. 4 is a diagram showing an example of the functional configuration of the MFP unit 2. FIG. 5 is a diagram showing an example of the hardware configuration of the server unit 3. FIG. 6 is a diagram showing an example of the functional configuration of the server unit 3.

The multifunction device 1 shown in FIG. 1 is a device that integrates various functions. As shown in FIGS. 1 and 2, the multifunction device 1 is composed of an MFP unit 2, a server unit 3, a touch panel display 4, a selector 5, and the like.

The server unit 3 is housed in the housing of the MFP unit 2. The touch panel display 4 is arranged in front of the scan unit 20 g so that the touch surface and the display surface are slightly horizontal.

The MFP unit 2 is a device corresponding to an image forming apparatus generally called "MFP (Multi Function Peripherals)" and has functions such as copying, PC printing, faxing, scanning, and boxing.

The PC print function is a function of printing an image on paper based on image data received from an external device of the multifunction device 1 or a server unit 3.

The box function is a function in which a storage area called a "box" or a "personal box" is given to each user, and each user saves and manages image data or the like according to his / her own storage area. A box corresponds to a "folder" or "directory" on a personal computer.

The server unit 3 is a device corresponding to a server machine or a personal computer, and has a function such as a web server or an FTP (File Transfer Protocol) server. As the server unit 3, an embedded computer (for example, embedded Linux (registered trademark) or embedded Windows (registered trademark)) is used. Embedded computers are sometimes referred to as "embedded computer systems" or "built-in servers".

The touch panel display 4 is shared by the MFP unit 2 and the server unit 3. Then, the screen of the MFP unit 2 and the screen of the server unit 3 are displayed for the user who directly operates the multifunction device 1. Further, data indicating the coordinates of the touched position of the touch surface of the touch panel (hereinafter, referred to as “coordinate data 6A”) is transmitted to the selector 5.

The selector 5 transmits a video signal for displaying a screen received from the MFP unit 2 or the server unit 3 to the touch panel display 4. Further, the coordinate data 6A received from the touch panel display 4 is transmitted to the MFP unit 2 or the server unit 3.

Basic services are provided to the user by the functions of the MFP unit 2 and the server unit 3. Furthermore, by combining these functions, an applied service is provided to the user.

As shown in FIG. 3, the MFP unit 2 includes a CPU (Central Processing Unit) 20a, a RAM (Random Access Memory) 20b, a ROM (Read Only Memory) 20c, an auxiliary storage device 20d, and a first NIC (Network Interface Card). It is composed of 20e, a second NIC 20f, a scan unit 20g, a print unit 20h, a finisher 20i, a video board 20j, an input interface 20k, and the like.

The first NIC20e communicates with an external device by a protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol).

The second NIC20f is connected to the second NIC30f (see FIG. 5) of the server unit 3 by a twisted pair cable, and communicates with the server unit 3 by a protocol such as TCP / IP.

The scan unit 20 g reads an image written on a sheet set on a platen glass and generates image data.

In the print unit 20h, in addition to the image read by the scan unit 20g, the image shown in the image data received from the external device of the multifunction device 1 by the first NIC 20e or received from the server unit 3 by the second NIC 20f is printed on paper. Print on.

The finisher 20i performs post-processing on the printed matter obtained by the print unit 20h, if necessary. Post-treatment includes staple binding, punching, and bending.

The video board 20j converts screen data into a video signal and transmits it to the selector 5. It is also called a "graphic board", "LCD (liquid crystal display) controller" or "video card".

HDMI (High-Definition Multimedia Interface) (registered trademark), D-SUB (D-Subminiature), or the like is used as an interface between the video board 20j and the first input terminal 50a. The same applies to the interfaces of the video board 30g, the second input terminal 50b, and the third output terminal 50f, which will be described later.

As the interface of the second NIC20f, IEEE (Institute of Electrical and Electronics Engineers) 802.3 or the like is used. The same applies to the second NIC30f described later.

The input interface 20k is connected to the first output terminal 50d of the selector 5 by a cable, and receives the coordinate data 6A from the touch panel display 4.

As an interface of the input interface 20k and the first output terminal 50d, IEEE1394, USB (Universal Serial Bus), or the like is used. The same applies to the input interface 30h, the second output terminal 50e, and the third input terminal 50c, which will be described later.

A program for realizing each function such as the above-mentioned copy is stored in the ROM 20c or the auxiliary storage device 20d. As the auxiliary storage device 20d, a hard disk drive, SSD (Solid State Drive), or the like is used.

Further, the screen output program 20P (see FIG. 4) is stored in the ROM 20c or the auxiliary storage device 20d. The screen output program 20P transmits the screen data of the screen of the MFP unit 2 to the server unit 3, or synthesizes the screen of the server unit 3 and the screen of the MFP unit 2, and the screen data of the synthesized screen is the video board 20j. It is a program to output to.

These programs are loaded into the RAM 20b as needed and executed by the CPU 20a.

As shown in FIG. 5, the server unit 3 includes a CPU 30a, a RAM 30b, a ROM 30c, an auxiliary storage device 30d, a first NIC30e, a second NIC30f, a video board 30g, an input interface 30h, and the like.

The first NIC30e communicates with an external device of the multifunction device 1 by a protocol such as TCP / IP.

The second NIC30f is connected to the second NIC20f (see FIG. 3) of the MFP unit 2 by a twisted pair cable, and communicates with the MFP unit 2 by a protocol such as TCP / IP.

The video board 30g converts screen data into a video signal and transmits it to the selector 5. The input interface 30h is connected to the second output terminal 50e of the selector 5 by a cable, and receives the coordinate data 6A from the selector 5.

The ROM 30c or the auxiliary storage device 30d stores a program for realizing a function of downloading an application and a function of installing the application. A hard disk drive, SSD, or the like is used as the auxiliary storage device 30d.

Further, the screen output program 30P (see FIG. 6) is stored in the ROM 30c or the auxiliary storage device 30d. The screen output program 30P transmits the screen data of the screen of the server unit 3 to the MFP unit 2, or synthesizes the screen of the server unit 3 and the screen of the MFP unit 2, and the screen data of the synthesized screen is the video board 30g. It is a program to output to.

These programs are loaded into the RAM 30b as needed and executed by the CPU 30a.

As shown in FIG. 2, the touch panel display 4 is composed of a display module 4A, a touch panel module 4B, and the like.

The display module 4A displays a screen based on the video signal transmitted from the selector 5. As the display module 4A, a flat panel display such as an organic EL (Electro Luminescence) display or a liquid crystal display is used.

The touch panel module 4B transmits the coordinate data 6A to the selector 5 each time it detects that the touch surface is touched.

As shown in FIG. 2, the selector 5 has a first input terminal 50a, a second input terminal 50b, a third input terminal 50c, a first output terminal 50d, a second output terminal 50e, and a third output. It is composed of a terminal 50f, a controller 50g, and the like.

The first input terminal 50a is connected to the video board 20j of the MFP unit 2 by a cable, and a video signal is input from the video board 20j. The second input terminal 50b is connected to the video board 30g of the server unit 3 by a cable, and a video signal is input from the video board 30g. The third input terminal 50c is connected to the touch panel module 4B by a cable, and the coordinate data 6A is input from the touch panel module 4B.

The first output terminal 50d is connected to the input interface 20k of the MFP unit 2 by a cable, and outputs the coordinate data 6A to the MFP unit 2. The second output terminal 50e is connected to the input interface 30h of the server unit 3 by a cable, and outputs the coordinate data 6A to the server unit 3. The third output terminal 50f outputs the video signal transmitted from the MFP unit 2 or the server unit 3 to the display module 4A.

The controller 50g transmits the video signal input to the first input terminal 50a or the second input terminal 50b to the display module 4A.

Further, when the coordinate data 6A is input from the third input terminal 50c, the controller 50g performs a process of outputting the coordinate data 6A from the first output terminal 50d or the second output terminal 50e as follows. ..

When the coordinate data 6A is transmitted from the touch panel module 4B and input from the third input terminal 50c, the controller 50g determines whether the video signal is input from the first input terminal 50a or the second input terminal 50b. To determine. When input is made from the first input terminal 50a, the coordinate data 6A is output from the first output terminal 50d. When the input is from the second input terminal 50b, the input is output from the second output terminal 50e.

According to the screen output program 20P, the arrangement data storage unit 201 to the discrimination unit 206 are realized in the MFP unit 2, and according to the screen output program 30P, the arrangement data storage unit 301 to the discrimination unit 306 are realized in the server unit 3.

FIG. 7 is a diagram showing an example of the arrangement data 6C. FIG. 8 is a diagram showing an example of the operation screen 5B1. FIG. 9 is a diagram showing an example of the arrangement data 6E. FIG. 10 is a diagram showing an example of the operation screen 5B2. FIG. 11 is a diagram showing an example of the combined operation screen 5B3. FIG. 12 is a diagram showing an example of the combined operation screen 5B4.

Hereinafter, the operation of the multifunction device 1 in the first embodiment will be described with reference to FIGS. 4 to 12.

The user turns on the power of the multifunction device 1. Then, each of the MFP unit 2 and the server unit 3 independently starts the necessary programs (operating system, firmware, etc.) in sequence.

Then, the following processing is performed in the MFP unit 2, the server unit 3, the touch panel display 4, and the selector 5.

The layout data 6C is stored in the layout data storage unit 201 (see FIG. 4) of the MFP unit 2 as shown in FIG. 7 for each icon for receiving an instruction to execute the function of the MFP unit 2 from the user. There is.

The placement data 6C indicates an "icon name", a "function", and a "position". In addition, image data for displaying the icon is included. As the image data, a file in a format such as GIF (Graphics Interchange Format) or PING (Portable Network Graphics) is used.

The "icon name" is the name of the icon and identifies the icon. The "function" is, for example, a function executed when an instruction from the user is received by tapping the icon.

The "position" is the position of the icon on the operation screen 5B1 for operating the MFP unit 2. That is, the "position" indicates each of the coordinates (X coordinate and Y coordinate) of the four vertices of the outer frame surrounding the icon when the entire area of the operation screen 5B1 is represented by the XY coordinate system. The coordinates of the four vertices also represent the size of the icon.

The outer frame surrounding the icon (specifically, the rectangular frame surrounding the icon in the "image" of each of the arrangement data 6C in FIG. 7) and the coordinates contained therein are described as "icon coordinates". do.

Further, in the arrangement data storage unit 201, the position of the screen generated by the MFP unit 2 such as the operation screen 5B1 in the entire area of the display surface of the touch panel module 4B (hereinafter, referred to as “whole area”) and the position of the screen and the position of the screen generated by the MFP unit 2 such as the operation screen 5B1. The size and the overall layout data 6D indicating the position and size of the screen generated by the server unit 3 such as the operation screen 5B2 described later for operating the server unit 3 are also stored.

In this example, the position of the operation screen 5B1 is the left half area when the entire area is equally divided in the horizontal direction (X-axis direction), and the size of the operation screen 5B1 is equal to the size of the area. Is shown in the overall layout data 6D. Further, the fact that the position of the operation screen 5B2 is the right half area when the entire area is equally divided in the horizontal direction and that the size of the operation screen 5B2 is equal to the size of the area are found in the overall arrangement data 6D. Shown.

The generation unit 202 of the MFP unit 2 generates the operation screen 5B1 as shown in FIG. 8 based on the arrangement data 6C and the overall arrangement data 6D stored in the arrangement data storage unit 201.

In the placement data storage unit 301 (see FIG. 6) of the server unit 3, the placement data 6E is stored as shown in FIG. 9 for each icon for receiving an instruction to execute the function of the server unit 3 from the user. There is.

The arrangement data 6E indicates an "icon name" and an "function" as in the arrangement data 6C described above. In addition, image data for displaying the icon is included.

The "position" is the position and size of the icon on the operation screen 5B2 for operating the server unit 3. That is, the "position" indicates each of the coordinates (X coordinate and Y coordinate) of the four vertices of the icon when the entire area of the operation screen 5B2 is represented by the XY coordinate system.

Further, the arrangement data storage unit 301 also stores the overall arrangement data 6D in the same manner as the arrangement data storage unit 201 described above.

The generation unit 302 of the server unit 3 generates the operation screen 5B2 as shown in FIG. 10 based on the arrangement data 6E and the overall arrangement data 6D stored in the arrangement data storage unit 301.

The unit output unit 203 (see FIG. 4) of the MFP unit 2 transmits the screen data 6B1 of the operation screen 5B1 generated by the generation unit 202 to the server unit 3. The screen data 6B1 is the bitmap data of the operation screen 5B1 or the compressed data thereof.

Alternatively, the unit output unit 303 (see FIG. 6) of the server unit 3 transmits the screen data 6B2 of the operation screen 5B2 generated by the generation unit 302 to the MFP unit 2. The screen data 6B2 is the bitmap data of the operation screen 5B2 or the compressed data thereof.

Only one of the unit output unit 203 and the unit output unit 303 performs this process. Which of the two is performed is switched as described later. Which one is to be performed first may be set in advance in the screen output program 20P or the screen output program 30P.

In this example, first, the unit output unit 203 transmits the screen data 6B1 to the server unit 3.

When the synthesis unit 304 receives the screen data 6B1, the operation screen 5B1 and the operation generated by the generation unit 302 shown in the screen data 6B1 according to the position shown in the overall arrangement data 6D stored in the arrangement data storage unit 301. The composite operation screen 5B3 is generated by arranging the screens 5B2 side by side and synthesizing them.

In this example, the synthesis unit 304 arranges the operation screen 5B1 so that the operation screen 5B1 is arranged in the left half area of the entire area and the operation screen 5B2 is arranged in the right half area of the entire area. And the operation screen 5B2 is arranged. By synthesizing both screens, a composite operation screen 5B3 as shown in FIG. 11 is generated. Note that Xmid is half the value of the horizontal length of the entire region, and is Xmax / 2.

The selector output unit 305 causes the video board 30g to execute a process of converting the screen data of the composite operation screen 5B3 into the video signal 6B3 for the display module 4A and transmitting the data to the selector 5.

When the video signal 6B3 is input from the second input terminal 50b, the controller 50g of the selector 5 outputs the video signal 6B3 from the third output terminal 50f to the display module 4A. That is, the video signal 6B3 is relayed from the server unit 3 to the display module 4A.

Upon receiving the video signal 6B3, the display module 4A displays the combined operation screen 5B3.

After that, the user tries to execute the function of the MFP unit 2 or the server unit 3 by tapping the icon corresponding to the function on the composite operation screen 5B3 displayed on the touch panel display 4. In this example, in order to execute the box function of the MFP unit 2, tap the box icon among the icons arranged on the left half of the composite operation screen 5B3 (that is, the part of the operation screen 5B1).

Then, the following processing is performed in the MFP unit 2, the server unit 3, the touch panel display 4, and the selector 5.

The touch panel module 4B (see FIG. 2) generates data indicating the position tapped by the user as coordinate data 6A and transmits the data to the selector 5.

When the coordinate data 6A is input to the third input terminal 50c, that is, when the coordinate data 6A is received from the touch panel module 4B, the controller 50g of the selector 5 causes the video signal 6B3 to be the first input terminal 50a and the second input terminal. It is determined from which of 50b the input is made. The coordinate data 6A is output from the first output terminal 50d or the second output terminal 50e according to the discriminated result. That is, the coordinate data 6A is transmitted to the MFP unit 2 or the server unit 3.

In this example, the controller 50g determines that the video signal 6B3 is input from the second input terminal 50b. Therefore, the coordinate data 6A is output from the second output terminal 50e, that is, transmitted to the server unit 3.

When the discriminating unit 306 (see FIG. 6) of the server unit 3 receives the coordinate data 6A, the coordinates shown in the coordinate data 6A are set to the operation screen 5B2 based on the overall arrangement data 6D stored in the arrangement data storage unit 301. It is determined whether it is the coordinates of any position of the above or the coordinates of any position of the operation screen 5B1.

In this example, the discrimination unit 306 determines that the coordinates shown in the coordinate data 6A are the coordinates of any position on the operation screen 5B1.

When it is determined that the coordinates shown in the coordinate data 6A are the coordinates of any position of the operation screen 5B1, the unit output unit 303 transmits the screen data 6B2 of the operation screen 5B2 generated most recently to the MFP unit 2. do. At this time, the coordinate data 6A is also transmitted. When a plurality of coordinate data 6A are continuously transmitted from the touch panel module 4B, all of these coordinate data 6A are transmitted to the MFP unit 2.

When the MFP unit 2 receives the coordinate data 6A and the screen data 6B2, the generation unit 202 (see FIG. 4) has the coordinates shown in the coordinate data 6A from the arrangement data 6C stored in the arrangement data storage unit 201. Operation screen 5C1 that should be displayed immediately after the placement data 6C included in the coordinates of the icon is specified and the icon of the placement data 6C is tapped (for example, a screen for setting the function associated with the icon). To generate.

The synthesizing unit 204 generates the composite operation screen 5B4 by arranging the generated operation screen 5C1 and the operation screen 5B2 shown in the received screen data 6B2 side by side. At this time, the operation screen 5B2 is arranged according to the position shown in the overall arrangement data 6D stored in the arrangement data storage unit 201. Further, the operation screen 5C1 is arranged with the position of the operation screen 5B1 shown in the overall arrangement data 6D as the position of the operation screen 5C1.

In this example, the synthesis unit 204 arranges the operation screen 5C1 so that the operation screen 5C1 is arranged in the left half area of the entire area and the operation screen 5B2 is arranged in the right half area of the entire area. And the operation screen 5B2 is arranged. By synthesizing both screens, a composite operation screen 5B4 as shown in FIG. 12 is generated.

The selector output unit 205 causes the video board 20j to execute a process of converting the screen data of the composite operation screen 5B4 into a video signal 6B4 for the display module 4A and transmitting the data to the selector 5.

The controller 50g of the selector 5 relays the video signal 6B4 from the server unit 3 to the display module 4A. The display module 4A displays the received composite operation screen 5B4.

When the determination unit 306 of the server unit 3 determines that the coordinates shown in the coordinate data 6A are the coordinates of any position on the operation screen 5B2, the MFP unit 2 and the server unit 3 perform the following processing. Is done.

The generation unit 302 identifies the arrangement data 6E in which the coordinates shown in the coordinate data 6A are included in the coordinates of the icon from the arrangement data 6E stored in the arrangement data storage unit 301. At this time, out of the coordinates shown in the coordinate data 6A, the value obtained by subtracting the value of Xmid from the value of the X coordinate is used as the X coordinate shown in the coordinate data 6A.

The generation unit 302 generates the operation screen 5C2 to be displayed immediately after the icon of the specified arrangement data 6E is tapped. Request the most recently generated operation screen 5B1 to the MFP unit 2.

The unit output unit 203 (see FIG. 4) of the MFP unit 2 transmits the screen data 6B1 of the operation screen 5B1 generated most recently to the server unit 3.

Upon receiving the screen data 6B1, the synthesizing unit 304 of the server unit 3 generates the composite operation screen 5B4 in the same manner as generating the composite operation screen 5B3 described above. However, the operation screen 5C2 is synthesized instead of the operation screen 5B2.

The selector output unit 305 causes the video board 30g to execute a process of converting the screen data of the composite operation screen 5B4 into the video signal 6B4 and transmitting it to the selector 5.

Similar to the above, when the controller 50g of the selector 5 (see FIG. 2) receives the video signal 6B4 from the server unit 3, it relays to the display module 4A. Upon receiving the video signal 6B4, the display module 4A displays the combined operation screen 5B4.

13 and 14 are flowcharts showing an example of the overall processing flow of the MFP unit 2.

Next, the overall processing flow of each of the MFP unit 2 and the server unit 3 in the first embodiment will be described with reference to the flowcharts of FIGS. 13 and 14.

The MFP unit 2 and the server unit 3 execute the processes shown in FIGS. 13 and 14 based on the screen output program 20P and the screen output program 30P, respectively.

When the user turns on the power of the multifunction device 1, the MFP unit 2 and the server unit 3 are started independently.

When the screen output program 20P is started, the MFP unit 2 generates the operation screen 5B1 (# 601 in FIG. 13). When the operation screen 5B1 is set to be transmitted to the server unit 3 (Yes in # 602), the operation screen 5B1 is transmitted to the server unit 3 (# 603).

When the operation screen 5B1 is not set to be transmitted to the server unit 3 (No in # 602), the MFP unit 2 receives the operation screen 5B2 from the server unit 3 (# 604). By arranging the generated operation screen 5B1 and the received operation screen 5B2 side by side and synthesizing them, the composite operation screen 5B3 is generated (# 605) and transmitted to the selector 5 (# 606).

When the MFP unit 2 receives the coordinate data 6A from the selector 5 (Yes in # 611 of FIG. 14), the coordinates shown in the coordinate data 6A are the coordinates of any position of the operation screen 5B1, or the operation screen 5B2. It is determined whether the coordinates are at any of the positions of (# 612).

When the MFP unit 2 determines that the coordinates shown in the coordinate data 6A are the coordinates of any position on the operation screen 5B1 (Yes in # 613), the arrangement of the icons tapped by the user based on the coordinate data 6A. The data 6C is specified, and the operation screen 5C1 immediately after the icon is tapped is generated (# 614). The operation screen 5B2 generated most recently by the server unit 3 is requested to the server unit and received (# 615).

The MFP unit 2 generates the composite operation screen 5B4 by synthesizing the generated operation screen 5C1 and the received operation screen 5B2 (# 616), and transmits the composite operation screen 5B4 to the selector 5 (# 617).

When the MFP unit 2 determines that the coordinates shown in the coordinate data 6A are the coordinates of any position of the operation screen 5B2 (No in # 613), the MFP unit 2 uses the coordinate data 6A and the most recently generated operation screen 5B1 as a server. It is transmitted to the unit 3 (# 618).

The MFP unit 2 does not receive the coordinate data 6A from the selector 5 (No in # 611), but receives the coordinate data 6A and the operation screen 5B2 most recently generated by the server unit 3 from the server unit 3 (#). Yes), the arrangement data 6C of the icon tapped by the user is specified based on the coordinate data 6A, and the operation screen 5C1 immediately after the icon is tapped is generated (# 621). By synthesizing the generated operation screen 5C1 and the received operation screen 5B2, the composite operation screen 5B4 is generated (# 622) and transmitted to the selector 5 (# 623).

The MFP unit 2 does not receive the coordinate data 6A from the selector 5 (No in # 611), and does not receive the coordinate data 6A and the operation screen 5B2 most recently generated by the server unit 3 from the server unit 3. (No in # 620) When a request from the server unit 3 is received (Yes in # 624), the most recently generated operation screen 5B1 in response to the request is transmitted to the server unit 3 (# 625).

The above processing continues until the operating system of the MFP unit 2 is terminated (No in # 619).

When the screen output program 30P is started, the server unit 3 performs the same processing as the processing in the above-mentioned MFP unit 2.

That is, the server unit 3 generates the operation screen 5B2 (# 601). Then, the operation screen 5B2 is transmitted to the MFP unit 2, or the composite operation screen 5B3 is generated and transmitted to the selector 5 (# 602 to # 606).

When the server unit 3 receives the coordinate data 6A from the selector 5, the server unit 3 generates the composite operation screen 5B3 and transmits the coordinate data 6A to the selector 5, or transmits the coordinate data 6A and the operation screen 5B2 to the MFP unit 2 ( # 611 to # 618). When the coordinate data 6A and the operation screen 5B1 are received from the MFP unit 2 without receiving the coordinate data 6A from the selector 5, the operation screen 5B1 and the composite operation screen 5B3 are generated, and the generated composite operation screen 5B3 is selected by the selector 5. Send to (# 620- # 623). When a request from the MFP unit 2 is received without receiving the coordinate data 6A from the selector 5 and the MFP unit 2, the operation screen 5B1 is transmitted to the MFP unit 2 in response to the request (# 620, # 624, # 625).

According to the first embodiment, when the operation screen 5B1 of the MFP unit 2 and the operation screen 5B2 of the server unit 3 are displayed side by side, the delay generated when switching the operation screen 5B1 or the operation screen 5B2 is longer than before. It can be suppressed.

[Second Embodiment]
FIG. 15 is a diagram showing another example of the functional configuration of the MFP unit 2. FIG. 16 is a diagram showing another example of the functional configuration of the server unit 3. FIG. 17 is a diagram showing an example of the operation screen 5B7.

According to the second embodiment, when the output source of the video signal changes from the MFP unit 2 to the server unit 3 or from the server unit 3 to the MFP unit 2, a delay occurs in the screen switching. It can be suppressed more than the embodiment. This mechanism will be described below. The points that overlap with the first embodiment will be omitted.

In the second embodiment, when the user taps the icon, the function associated with the icon is executed, and when the user taps the icon for a long time, the icon is displayed in the selected state.

The hardware configuration of the multifunction device 1 is the same as that of the first embodiment, and is as shown in FIGS. 1 to 3 and 5 above. The function of each hardware is the same as that of the first embodiment.

However, the screen output program 21P (see FIG. 15) is stored in the ROM 20c or the auxiliary storage device 20d of the MFP unit 2 instead of the screen output program 20P (see FIG. 4). The screen output program 21P generates the difference data 6F1 and sends it to the server unit 3 at predetermined time intervals, or synthesizes the screen of the MFP unit 2 and the screen of the server unit 3 and produces the screen data of the synthesized screen. This is a program for outputting to the video board 20j.

Further, the screen output program 31P (see FIG. 16) is stored in the ROM 30c or the auxiliary storage device 30d of the server unit 3 instead of the screen output program 30P (see FIG. 6). The screen output program 31P generates the difference data 6F2 and sends it to the MFP unit 2 at predetermined time intervals, or synthesizes the screen of the server unit 3 and the screen of the MFP unit 2 and produces the screen data of the synthesized screen. This is a program for outputting to a video board 30 g.

According to the screen output program 21P, the arrangement data storage unit 211 or the screen storage unit 221 shown in FIG. 15 are realized in the MFP unit 2. According to the screen output program 31P, the arrangement data storage unit 311 or the screen storage unit 321 shown in FIG. 16 is realized in the server unit 3.

When the user turns on the power of the multifunction device 1, each of the MFP unit 2 and the server unit 3 sequentially starts the necessary programs.

Then, the following processing is performed in the MFP unit 2, the server unit 3, the touch panel display 4, and the selector 5.

The layout data storage unit 211 (see FIG. 15) of the MFP unit 2 stores the layout data 6C and the overall layout data 6D as in the layout data storage unit 201 (see FIG. 4) of the first embodiment. .. Further, in the arrangement data storage unit 311 (see FIG. 16) of the server unit 3, the arrangement data 6E and the overall arrangement data 6D are stored as in the arrangement data storage unit 301 (see FIG. 6) of the first embodiment. ing.

The generation unit 212 of the MFP unit 2 generates the operation screen 5B1 based on the arrangement data 6C and the overall arrangement data 6D stored in the arrangement data storage unit 211, similarly to the generation unit 202 of the first embodiment. ..

The unit output unit 213 transmits the generated screen data 6B1 of the operation screen 5B1 to the server unit 3.

The generation unit 312 of the server unit 3 generates the operation screen 5B2 based on the arrangement data 6E and the overall arrangement data 6D stored in the arrangement data storage unit 311 as in the generation unit 302 of the first embodiment. ..

The unit output unit 313 transmits the generated screen data 6B2 of the operation screen 5B2 to the MFP unit 2.

In the first embodiment, of the unit output unit 203 and the unit output unit 303, only the unit output unit belonging to the unit that does not generate the combined operation screen 5B3 transmitted the screen data. However, in the second embodiment, both the unit output unit 213 and the unit output unit 313 transmit screen data.

When the compositing unit 214 of the MFP unit 2 receives the screen data 6B2, it synthesizes the operation screen 5B1 and the operation screen 5B2 side by side in the same manner as the compositing unit 304 of the first embodiment, as shown in FIG. Generate the composite operation screen 5B3. The operation screen 5B2 is stored in the screen storage unit 221 as screen data.

Upon receiving the screen data 6B1, the synthesizing unit 314 of the server unit 3 generates the composite operation screen 5B3 by arranging the operation screen 5B2 and the operation screen 5B1 side by side in the same manner as the synthesizing unit 304 of the first embodiment. .. The operation screen 5B1 is stored in the screen storage unit 321 as screen data.

The selector output unit 215 of the MFP unit 2 causes the video board 20j to execute a process of converting the generated screen data of the composite operation screen 5B3 into a video signal 6B3 for the display module 4A and transmitting it to the selector 5. Alternatively, the selector output unit 315 of the server unit 3 causes the video board 30g to execute a process of converting the generated screen data of the composite operation screen 5B3 into a video signal 6B3 for the display module 4A and transmitting it to the selector 5.

Only one of the selector output unit 215 and the selector output unit 315 performs this process. Which of the two is performed is switched as described later. Which one is to be performed first may be set in advance in the screen output program 21P or the screen output program 31P.

In this example, first, the selector output unit 315 of the server unit 3 converts the screen data into the video signal 6B3 and transmits it to the selector 5.

Similar to the first embodiment, the controller 50g of the selector 5 (see FIG. 2) relays the video signal 6B3 from the server unit 3 to the display module 4A. The display module 4A displays the received composite operation screen 5B3.

The user long-tap the icon to select an icon on the combined operation screen 5B3 (see FIG. 11). In this example, among the icons of the operation screen 5B2 of the composite operation screen 5B3, the PC print icon is long-tapped.

Then, the following processing is performed in the MFP unit 2, the server unit 3, the touch panel display 4, and the selector 5.

Similar to the first embodiment, the touch panel module 4B (see FIG. 2) generates data indicating the position tapped by the user as coordinate data 6A and transmits the data to the selector 5.

When the controller 50g of the selector 5 receives the coordinate data 6A from the touch panel module 4B, the controller 50g determines that the video signal 6B3 is input from the second input terminal 50b, and transmits the coordinate data 6A to the server unit 3. Send to.

When the discriminating unit 316 of the server unit 3 (see FIG. 16) receives the coordinate data 6A, the discriminating unit 316 (see FIG. 16) receives the coordinate data based on the overall arrangement data 6D stored in the arrangement data storage unit 311. It is determined that the coordinates shown in 6A are the coordinates of any position on the operation screen 5B2.

Then, the determination unit 316 identifies the arrangement data 6E in which the coordinates shown in the coordinate data 6A are included in the coordinates of the icon from the arrangement data 6E stored in the arrangement data storage unit 311. At this time, out of the coordinates shown in the coordinate data 6A, the value obtained by subtracting the value of Xmid from the value of the X coordinate is used as the X coordinate shown in the coordinate data 6A. In this example, the placement data 6E1 is specified.

Then, the determination unit 316 indicates whether the user has instructed to execute the function associated with the icon of the specified arrangement data 6E, or whether the user has instructed to simply make the icon in the selected state. , Determine as follows.

The determination unit 316 determines whether the user has made a gesture for the icon, that is, whether the user has tapped or long-tapped the icon, based on the coordinate data 6A received after the first coordinate data 6A. When it is determined that the user has tapped, it is determined that the user has instructed to execute the function associated with the icon. When it is determined that the icon has been long-tapped, it is determined that the user has instructed to keep the icon selected.

When it is determined that the user has instructed to make a certain icon in the selected state, the generation unit 312 updates the operation screen 5B2 so that the icon is in the selected state. For example, as shown in FIG. 17, the icon is shaded. Hereinafter, the updated operation screen 5B2 will be referred to as "operation screen 5B7".

The synthesis unit 314 reads the operation screen 5B1 from the screen storage unit 321 and synthesizes the operation screen 5B1 and the generated operation screen 5B7 side by side in the same manner as the synthesis unit 304 of the first embodiment. Generate 5B8.

The selector output unit 315 causes the video board 30g to execute a process of converting the generated screen data of the composite operation screen 5B8 into a video signal 6B8 and transmitting it to the selector 5.

Similar to the first embodiment, the controller 50g of the selector 5 (see FIG. 2) relays the video signal 6B8 to the display module 4A when it receives the video signal 6B8 from the server unit 3. Upon receiving the video signal 6B8, the display module 4A displays the combined operation screen 5B8.

As described above, the unit output unit 313 transmitted the image data 6B2 to the MFP unit 2 when the image data 6B2 of the operation screen 5B2 was generated by the generation unit 312.

However, when a new screen is generated by updating a part of a certain screen, instead of transmitting the image data of the entire new screen, the image data of the changed part and the data indicating the position of the changed part are transmitted. , Send as difference data. For example, since the operation screen 5B7 is generated by shading a certain icon in the operation screen 5B2, the updated image data of the icon and the position of the icon (position shown in the arrangement data 6E1) are displayed. The indicated data is transmitted as difference data 6F2. The same applies to the unit output unit 213 described later.

However, if the screen changes continuously, more differential data will be generated than otherwise. If all of these are transmitted to the MFP unit 2, the load will increase. Therefore, the unit output unit 313 may transmit the difference data 6F2 to the MFP unit 2 at a predetermined time interval (for example, an interval of 2 seconds). Even when the screen does not change continuously, the difference data 6F2 may be transmitted to the MFP unit 2 at predetermined time intervals. The same applies to the unit output unit 213 described later.

The generation unit 212 and the synthesis unit 214 (see FIG. 15) of the MFP unit 2 perform the following processing each time the difference data 6F2 is transmitted.

The generation unit 212 generates the operation screen 5B1 in the same manner as described above. If there is no difference from the most recently generated operation screen 5B1, it is not necessary to generate it.

The synthesis unit 214 reads out the operation screen 5B2 stored in the screen storage unit 221. The processed icon indicated by the image data included in the difference data 6F2 is synthesized at the position indicated by the difference data 6F2 on the operation screen 5B2. The composite operation screen 5B8 is generated by arranging and synthesizing the latest operation screen 5B1 and the operation screen 5B2 in which the processed icon is combined, that is, the operation screen 5B7 in the same manner as the synthesis unit 204 of the first embodiment.

When the user long-tap any of the icons of the operation screen 5B1 of the composite operation screen 5B3 while the server unit 3 outputs the video signal to the selector 5, the following processing is performed.

The touch panel module 4B (see FIG. 2) generates data indicating the position tapped by the user as coordinate data 6A and transmits the data to the selector 5 in the same manner as described above.

When the controller 50g of the selector 5 receives the coordinate data 6A from the touch panel module 4B, the controller 50g determines that the video signal 6B3 is input from the second input terminal 50b, and transmits the coordinate data 6A to the server unit 3. Send to.

When the discriminant unit 316 (see FIG. 16) of the server unit 3 receives the coordinate data 6A, it is shown in the coordinate data 6A based on the overall arrangement data 6D stored in the arrangement data storage unit 311. It is determined that the coordinates correspond to the coordinates of any position on the operation screen 5B1. The unit output unit 313 transmits the coordinate data 6A to the MFP unit 2.

When the coordinate data 6A is transmitted, the determination unit 216 (see FIG. 15) of the MFP unit 2 displays the coordinates shown in the coordinate data 6A from the arrangement data 6C stored in the arrangement data storage unit 211. The arrangement data 6C included in the coordinates of is specified.

The generation unit 212 generates the operation screen 5B6 including the processed icon by updating the icon in the operation screen 5B1 in the same manner as the generation unit 312 described above.

The compositing unit 214 reads the operation screen 5B2 from the screen storage unit 211, arranges the operation screen 5B2 and the generated operation screen 5B6 in the same manner as the compositing unit 204 of the first embodiment, and synthesizes the composite operation screen. Generate 5B8.

The selector output unit 215 causes the video board 20j to execute a process of converting the screen data of the composite operation screen 5B8 into a video signal 6B8 and transmitting the data to the selector 5.

Similar to the first embodiment, the controller 50g of the selector 5 (see FIG. 2) relays the video signal 6B8 to the display module 4A when it receives the video signal 6B8 from the server unit 3. Upon receiving the video signal 6B8, the display module 4A displays the combined operation screen 5B8.

Further, the unit output unit 213 uses the image data of the processed icon and the data indicating the position indicated by the specified arrangement data 6C as the difference data 6F1 as the difference data 6F1 at a predetermined time interval (for example, an interval of 2 seconds). Send to unit 3.

The generation unit 312 and the synthesis unit 314 (see FIG. 16) of the server unit 3 perform the following processing each time the difference data 6F1 is transmitted.

The generation unit 312 generates the operation screen 5B2 in the same manner as described above. If there is no difference from the most recently generated operation screen 5B2, it may not be generated.

The synthesis unit 314 reads out the operation screen 5B1 stored in the screen storage unit 321. The processed icon indicated by the image data included in the difference data 6F1 is synthesized at the position indicated by the difference data 6F1 on the operation screen 5B1. The composite operation screen 5B8 is generated by arranging and synthesizing the latest operation screen 5B2 and the operation screen 5B6 in which the processed icon is combined in the same manner as in the synthesis unit 304 of the first embodiment.

18 to 21 are flowcharts showing an example of the overall processing flow of the MFP unit 2.

Next, the overall processing flow of each of the MFP unit 2 and the server unit 3 in the present embodiment will be described with reference to the flowcharts of FIGS. 18 to 21.

The MFP unit 2 and the server unit 3 execute the processes shown in FIGS. 18 to 21 based on the screen output program 21P.

When the user turns on the power of the multifunction device 1, the screen output program 21P and the screen output program 31P of the MFP unit 2 and the server unit 3 are started independently.

When the MFP unit 2 starts the screen output program 21P, it generates the operation screen 5B1 (# 701 in FIG. 18) and transmits the operation screen 5B1 to the server unit 3 (# 702). The operation screen 5B2 is received from the server unit 3 and stored (# 703). The combined operation screen 5B3 is generated by arranging the generated operation screen 5B1 and the received operation screen 5B2 side by side and synthesizing them (# 704). When the composite operation screen 5B3 is set to be transmitted to the selector 5 (Yes at # 705), the composite operation screen 5B3 is transmitted to the selector 5 (# 706).

When the MFP unit 2 receives the coordinate data 6A from the selector 5 (Yes in # 711 of FIG. 19), the coordinates shown in the coordinate data 6A are the coordinates of any position on the operation screen 5B1, or the operation screen 5B2. It is determined whether the coordinates are at any of the positions of (# 712).

When the MFP unit 2 determines that the coordinates shown in the coordinate data 6A are the coordinates of any position on the operation screen 5B1 (Yes in # 713), the MFP unit 2 determines the gesture of the user (# 714).

When the MFP unit 2 determines that the user's gesture is a long tap (Yes in # 715), the MFP unit 2 identifies the placement data 6C of the icon tapped by the user based on the coordinate data 6A, and uses the placement data 6C as the placement data 6C. A post-processed icon is generated using the included image data (# 716), and an operation screen 5B6 is generated using the post-processed icon (# 717). When it is determined that the gesture of the user is a tap (No in # 715), the arrangement data 6C of the icon tapped by the user is specified based on the coordinate data 6A, and the operation screen 5C1 immediately after the icon is tapped. Is generated (# 717).

The MFP unit 2 reads the stored operation screen 5B2 (# 718), and combines the generated operation screen (that is, the operation screen 5B1 or the operation screen 5C1) with the read operation screen 5B2 to form a composite operation screen (# 718). That is, the compound operation screen 5B4 or the compound operation screen 5B8) is generated (# 719). The generated composite operation screen is transmitted to the selector 5 (# 720).

When the MFP unit 2 determines that the coordinates shown in the coordinate data 6A are the coordinates of any position on the operation screen 5B2 (No in # 713), the MFP unit 2 transmits the coordinate data 6A to the server unit 3 (# 721). ..

When the MFP unit 2 receives the coordinate data 6A not from the selector 5 but from the server unit 3 (No in # 711, Yes in # 731 in FIG. 20), the MFP unit 2 determines the gesture of the user (# 732).

When the MFP unit 2 determines that the user's gesture is a long tap (Yes in # 733), the MFP unit 2 identifies the placement data 6C of the icon tapped by the user based on the coordinate data 6A, and uses the placement data 6C as the placement data 6C. A post-processed icon is generated using the included image data (# 734), and an operation screen 5B6 is generated using the post-processed icon (# 735). When it is determined that the gesture of the user is a tap (No in # 733), the arrangement data 6C of the icon tapped by the user is specified based on the coordinate data 6A, and the operation screen 5C1 immediately after the icon is tapped. Is generated (# 735).

The MFP unit 2 reads the stored operation screen 5B2 (# 736) and combines the generated operation screen and the read operation screen 5B2 to generate a composite operation screen (# 737). The generated composite operation screen is transmitted to the selector 5 (# 738).

When the latest screen of the MFP unit 2 is updated (Yes in # 741 of FIG. 21), the MFP unit 2 determines the difference data 6F1 every time a predetermined time elapses, that is, at a predetermined time interval (Yes in # 742). Is transmitted to the server unit 3 (# 743).

The above-mentioned processing is appropriately executed until the operating system of the MFP unit 2 is terminated (No in # 744).

When the screen output program 31P is started, the server unit 3 performs the same processing as the processing of steps # 701 to # 744 of the MFP unit 2 described above.

That is, the server unit 3 generates the operation screen 5B2 and transmits it to the MFP unit 2 (# 701 to # 702). The combined operation screen 5B3 is generated and transmitted to the selector 5 according to the setting (# 703 to # 706).

When the server unit 3 receives the coordinate data 6A from the selector 5, the server unit 3 generates an operation screen and a composite operation screen and transmits the composite operation screen to the selector 5, or the coordinate data 6A is sent to the MFP unit 2. Send (# 711 to # 721). When the coordinate data 6A is received from the MFP unit 2 instead of from the selector 5, the operation screen and the composite operation screen are generated, and the generated composite operation screen is transmitted to the selector 5 (# 731 to # 738).

Further, when the latest screen of the server unit 3 is updated, the server unit 3 transmits the difference data 6F2 to the MFP unit 2 at predetermined time intervals (# 741 to # 743).

According to the second embodiment, when the output source of the video signal changes from the MFP unit 2 to the server unit 3 or from the server unit 3 to the MFP unit 2, a delay occurs in the screen switching. It can be suppressed more than the embodiment.

[Other embodiments]
In the first embodiment, the server unit 3 requests the MFP unit 2 for the most recently generated operation screen 5B1 when the operation screen 5B2 is touched. However, the operation screen 5B1 may be received from the MFP unit 2 in advance and the operation screen 5B1 may be stored. Then, when the operation screen 5B2 is touched, the stored operation screen 5B1 may be read out.

Further, the MFP unit 2 may also receive the most recently generated operation screen 5B2 from the server unit 3 in advance and store the operation screen 5B2. Then, when the coordinate data 6A is received from the controller 50g and the operation screen 5B1 is touched, the stored operation screen 5B2 may be read out.

In the second embodiment, the MFP unit 2 transmits the difference data 6F1 to the server unit 3 at a predetermined time interval, and the server unit 3 transmits the difference data 6F2 to the MFP unit 2 at a predetermined time interval. However, when at least one of the MFP unit 2 and the server unit 3 is in a power saving state, the difference data 6F1 and the difference data 6F2 may be transmitted when a specific event occurs instead of a predetermined time interval. good.

For example, the MFP unit 2 generates the difference data 6F1 when it becomes necessary to update the operation screen 5B1 because the screen of the MFP unit 2 such as the operation screen 5B1 is touched while the power is saved. May be transmitted to the server unit 3. Similarly, when the server unit 3 needs to update the screen of the server unit 3 such as the operation screen 5B2 in the power saving state, the server unit 3 may generate the difference data 6F2 and send it to the MFP unit 2. good.

In the first embodiment and the second embodiment, the server unit 3 first converts the screen data of the composite operation screen 5B3 into the video signal 6B3 for the display module 4A and transmits the process to the selector 5 with the video board 30g. Was made to execute. However, the MFP unit 2 may first cause the video board 20j to perform the processing.

In the first embodiment and the second embodiment, the MFP unit 2 or the server unit 3 appropriately generates a composite operation screen in response to the user touching the touch panel display 4. However, the MFP unit 2 or the server unit 3 may generate a new composite operation screen even when an event other than the touch to the touch panel display 4 occurs.

For example, when an error such as a paper jam or out of toner or a specific event such as reception of a fax occurs in the MFP unit 2, the MFP unit 2 requests the server unit 3 for the operation screen 5B2 as necessary, and the server The unit 3 generates the operation screen 5B2 in response to the request and transmits it to the MFP unit 2. When the MFP unit 2 receives the operation screen 5B2 from the server unit 3, it generates an operation screen including a message to the effect that the event has occurred, and synthesizes the generated operation screen and the received operation screen 5B2 to create a new operation screen. Generate a compound operation screen. If the operation screen 5B2 has already been received, the operation screen 5B2 may be used. The operation screen 5B2 may be updated based on the difference data. In this case, the updated operation screen 5B2 may be used. Similarly, when a specific event occurs in the server unit 3, the server unit 3 may generate a new composite operation screen.

In the second embodiment, the time interval in which the MFP unit 2 transmits the difference data 6F1 to the server unit 3 and the time interval in which the server unit 3 transmits the difference data 6F2 to the MFP unit 2 are the same. However, the difference data 6F1 and 6F2 may be transmitted at different time intervals. That is, different time intervals may be set for each of the MFP unit 2 and the server unit 3. In this case, each of the MFP unit 2 and the server unit 3 may notify each other of the set time interval in advance. Then, the MFP unit 2 and the server unit 3 may try to synthesize the processed icons at the time interval notified from the other.

Alternatively, when the set time intervals are different, the difference data may be transmitted according to the one with the shorter time interval and the one with the longer time interval.

For example, if the time interval in which the MFP unit 2 transmits the difference data 6F1 is 5 seconds and the time interval in which the server unit 3 transmits the difference data 6F2 is 1 second, the server unit 3 sets the time interval from 1 second. The difference data 6F2 may be transmitted in 5 seconds.

The time interval of each of the MFP unit 2 and the server unit 3 may be determined and set according to the image drawing ability of each of the MFP unit 2 and the server unit 3. The time interval of each of the MFP unit 2 and the server unit 3 may be determined, for example, as the frame rate or refresh rate of each of the video board 20j and the video board 30g becomes shorter. For example, when the frame rate is N / sec, the time interval may be determined to be K / N. In addition, "K" is a constant.

In the first embodiment or the second embodiment, when the input terminal into which screen data is input is switched from the first input terminal 50a to the second input terminal 50b (or vice versa), the MFP unit 2 and the server The unit that outputs the video signal before switching among the units 3 may turn off the backlight of the display module 4A. This makes it possible to reduce screen flicker that occurs when the input terminals are switched.

In addition, the configuration of the whole or each part of the multifunction device 1, the MFP unit 2, and the server unit 3, the content of processing, the order of processing, the configuration of data, the configuration of screens, etc. shall be appropriately changed according to the gist of the present invention. Can be done.

2 MFP unit (first system)
3 Server unit (second system)
5B1 operation screen (first screen)
5B2 operation screen (second screen)
6F1 difference data (first partial image)
6F2 difference data (second partial image)
203 Unit output unit (first transmission means, first partial image transmission means)
204 Composite unit (first display control means)
205 Selector output unit (first display control means)
213 Unit output unit (first transmission means, first partial image transmission means)
214 Composite unit (first display control means)
215 Selector output unit (first display control means)
303 Unit output unit (second transmission means, second partial image transmission means)
304 Composite unit (second display control means)
305 Selector output unit (second display control means)
313 Unit output unit (second transmission means, second partial image transmission means)
314 synthesis unit (second display control means)
315 Selector output unit (second display control means)

Claims (13)

A multifunction device having a first system and a second system.
In the first system,
A first transmission means for transmitting a first screen, which is a screen of the first system, to the second system.
Is provided,
In the second system,
A second transmission means for transmitting a second screen, which is a screen of the second system, to the first system.
Is provided,
In addition to the first system,
When it becomes necessary to update the first screen, the first screen and the second screen transmitted from the second system are in a state where the first screen is updated. The first display control means for displaying side by side on the display,
In addition to the second system,
When it becomes necessary to update the second screen, the second screen and the first screen transmitted from the first system are in a state where the second screen is updated. A second display control means for displaying side by side on the display,
Is provided,
A multifunction device that is characterized by that. The first display control means needs to newly display a first notification screen for notifying the first specific event when a first specific event occurs in the first system. In this case, the first notification screen is displayed as the first screen side by side with the second screen.
The second display control means needs to newly display a second notification screen for notifying the second specific event when a second specific event occurs in the second system. In this case, the second notification screen is displayed as the second screen side by side with the first screen.
The multifunction device according to claim 1. A multifunction device having a first system and a second system.
In the first system,
A first transmission means for transmitting a first screen, which is a screen of the first system, to the second system.
Is provided,
In the second system,
A second transmission means for transmitting a second screen, which is a screen of the second system, to the first system.
Is provided,
In addition to the first system,
A first display control for displaying the first screen and the second screen transmitted from the second system side by side on a display when the first operation for the first system is performed. Means and
In addition to the second system,
When the second operation for the second system is performed, the second screen and the first screen transmitted from the first system are displayed side by side on the display. Control means and
Is provided,
A multifunction device that is characterized by that. The first display control means further needs to newly display a first notification screen for notifying the first specific event when the first specific event occurs in the first system. When it occurs, the first notification screen is displayed as the first screen side by side with the second screen.
The second display control means further needs to newly display a second notification screen for notifying the second specific event when the second specific event occurs in the second system. When it occurs, the second notification screen is displayed as the second screen side by side with the first screen.
The multifunction device according to claim 3. In the first system,
A first partial image transmission means, which transmits a first partial image which is a part after the update to the second system when a part of the first screen is updated, is provided.
In the second system,
A second partial image transmission means, which transmits a second partial image which is a part of the updated part to the first system when the second screen is updated, is provided.
The first display control means updates the first screen and the second screen by using the second partial image transmitted from the second system. Display it in the state that it was made to
The second display control means updates the first screen by using the first partial image transmitted from the first system for the second screen and the first screen. Display in the state of being made,
The multifunction device according to any one of claims 1 to 4. The first partial image transmitting means transmits the first partial image to the second system at predetermined time intervals.
The second partial image transmitting means transmits the second partial image to the first system at the predetermined time intervals.
The multifunction device according to claim 5. The predetermined time is a first time interval preset as a timing for the first partial image transmitting means to transmit the first partial image, and the second partial image transmitting means is the second portion. The longer of the second preset time intervals for transmitting images,
The multifunction device according to claim 6. The first partial image transmitting means transmits the first partial image to the second system at predetermined time intervals when the multifunction device is not in a power saving state.
The second partial image transmitting means transmits the second partial image to the first system at predetermined time intervals when the multifunction device is not in a power saving state.
The multifunction device according to claim 6 or 7. The display is provided with a backlight
The second display control means displays the first screen and the second screen on behalf of the first display control means, or the first display on behalf of the second display control means. The control means has a control means for controlling the display so that the backlight is turned off when the first screen and the second screen are displayed.
The multifunction device according to any one of claims 1 to 8. It is a screen display method for displaying the first screen which is the screen of the first system and the second screen which is the screen of the second system.
In the first system,
The first screen is transmitted to the second system, and the first screen is transmitted to the second system.
In the second system,
The second screen is transmitted to the first system, and the second screen is transmitted to the first system.
In addition to the first system,
When it becomes necessary to update the first screen, the first screen and the second screen transmitted from the second system are in a state where the first screen is updated. Display them side by side on the display
In addition to the second system,
When it becomes necessary to update the second screen, the second screen and the first screen transmitted from the first system are in a state where the second screen is updated. Display them side by side on the display.
The screen display method characterized by that. It is a screen display method for displaying the first screen which is the screen of the first system and the second screen which is the screen of the second system.
In the first system,
The first screen is transmitted to the second system, and the first screen is transmitted to the second system.
In the second system,
The second screen is transmitted to the first system, and the second screen is transmitted to the first system.
In addition to the first system,
When the first operation is performed on the first system, the first screen and the second screen transmitted from the second system are displayed side by side on a display.
In addition to the second system,
When the second operation for the second system is performed, the second screen and the first screen transmitted from the first system are displayed side by side on the display.
The screen display method characterized by that. A computer program used in a first computer that shares a display with a second computer.
To the first computer
When it becomes necessary to update the first screen, which is the screen of the first computer, the first screen and the second screen, which is the screen of the second computer, transmitted from the second computer. The screen of the above is arranged side by side in a state where the first screen is updated and displayed on the display.
When the second computer needs to update the second screen, the second computer updates the second screen and the first screen. A process of transmitting the first screen to the second computer is executed so that the first screen can be displayed side by side on the display.
A computer program that features that. A computer program used in a first computer that shares a display with a second computer.
To the first computer
When the first operation is performed on the first computer, the first screen which is the screen of the first computer and the screen of the second computer transmitted from the second computer are the second. The process of displaying the second screen side by side on the display in a state where the first screen is updated is executed.
When the second operation is performed on the second computer, the second computer displays the second screen and the first screen side by side on the display in a state where the second screen is updated. The process of transmitting the first screen to the second computer is executed so that the first screen can be transmitted to the second computer.
A computer program that features that.

Images