JP6287071B2 - Image processing device - Google Patents

Description

  The present invention relates to an image processing apparatus that displays a screen on a display.

Recent multifunctional image processing apparatuses include a display for displaying various screens.
For example, an application program (hereinafter simply referred to as “application”) A that displays an operation screen such as copying or accepts an operation input from a user, or displays various information via a network. By installing the application B for providing information that accepts search input for the information individually and starting the required application, only the operation screen is displayed or only the information providing screen is displayed. Or switching from the operation screen to the information providing screen.

When such screen switching is performed, if the entire screen is switched instantaneously, it is often difficult for the user to visually recognize that the screen has been switched.
Therefore, conventionally, control is performed in which the screen is switched little by little instead of instantaneously switching the screen. For example, while the image 1 on the screen displayed on the display gradually slides in one direction and disappears outside the frame of the display (slide out), a new image 2 is moved out of the frame of the display in the same direction. There is control to switch the screen so that it gradually slides into the frame (slide in).

  If such switching control is performed, the user can visually observe how the images are switched on one screen, so that the switching of the screen can be easily recognized.

JP 2012-38039 A Japanese Patent Laid-Open No. 2004-294677

  However, the screen data of the image 1 rewritten by the app A and the screen data of the image 2 rewritten by the app B are combined in the middle of the rewriting to generate one screen data. When the screen is switched so that the image 2 by the app B slides in while the image 1 slides out, there is a problem that the screen flickers if the rewriting time (speed) differs between the apps. is there.

Specifically, if the rewriting of the image 2 is slower than the image 1, the image 2 entering the frame by the slide-in cannot catch up with the image 1 that disappears outside the frame by the slide-out on the display. The screen is switched as if there is a gap between the image 1 and the image 2.
On the contrary, if the rewriting of the image 2 is faster than the image 1, the screen is switched in a state where a part of the image 2 is overlapped with the image 1. The gap or overlap between the two images appears to the user as flickering on the screen.

  Such a problem is caused by, for example, switching screens between different apps A and B in an environment in which app B is provided by a third vendor to add another function to existing app A. This is likely to occur when the screen data cannot be completely rewritten at the same time. Further, the present invention is not limited to slide-in and the like, and can generally occur for screen switching control including wipe-in and wipe-out, for example.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide an image processing apparatus that can suppress flickering during screen switching.

In order to achieve the above object, an image processing apparatus according to the present invention gradually erases a first image from a part thereof entirely on a display provided in an operation unit that receives input from a user. An image processing apparatus for switching a screen so that a new second image appears gradually, wherein a first storage unit, a second storage unit, an intermediate storage unit, and the first image are gradually erased A first application for writing screen data to the first storage, a second application for writing screen data for gradually displaying the second image to the second storage, and the first of the second application, each time a predetermined amount of data is written during the writing to the storage unit by the writing is faster application screen data, first picture de written that An intermediate processing unit for storing the data in the intermediate storage unit, in the middle writing into the storage unit by writing slower application screen data, the amount of the second screen data to be written by the slower application of the plant each reaching quantification, the second corresponding to the amount written as the screen data, the said stored in the intermediate storage unit the first screen data synthesizing section for synthesizing the second screen data And a display control unit for sending the combined screen data to the display and displaying the image on the display every time the combining unit synthesizes the screen data.

  Each time the first application and the second application write a predetermined amount of data, they output a write notification indicating that, and the intermediate processing unit outputs the first application and the second application. Among the applications, the application that outputs the write notification first is set as the faster application, and the combining unit sends the write notification later than the faster application of the first application and the second application. The output application may be the slower application.

Here, the predetermined data amount is equal to or less than the predetermined amount and the same value in each of the first application and the second application, or is different from the predetermined amount and one is the other. It may be a multiple.
In addition, the intermediate processing unit is configured to store the screen data stored in the intermediate storage unit by the application based on the writing notification from the faster application and the past writing notification before this. The screen data written in the storage unit may be stored in the intermediate storage unit by rewriting only the data corresponding to the difference from the screen data written in the unit.

Further, the predetermined amount of data may be band unit data indicating a predetermined data amount.
The first application may store the screen data in a predetermined direction in the screen displayed on the display so that a transparent area gradually expands from one end to the other end of the first image. The second image is gradually written in the first storage unit, and the second application gradually enters the frame from outside the frame of the screen in the same direction as the predetermined direction in the screen displayed on the display. As described above, the screen data is gradually written to the second storage unit, and the composition unit displays the image represented by the screen data by the first application at the top, and below the screen data by the second application. The respective screen data may be combined so that one image is generated by overlapping the displayed images.

  Further, the screen is switched so that the fourth image different from the second image gradually appears while the third image different from the first image is gradually erased from a part to the whole. The first application can write screen data for gradually erasing the third image into the first storage unit, and the second application can write the fourth image. Screen data for gradually appearing can be written in the second storage unit, the predetermined amount H applied to the screen data for the first image and the second image, and the third image And the predetermined amount H1 applied to each screen data for the fourth image may be different.

Here, the third image and the fourth image may have a smaller display area on the display than the first image and the second image, and the predetermined amount H1 may be larger than the predetermined amount H.
Each of the first application and the second application outputs a writing start notification including the writing range at the start of writing screen data, and the combining unit includes a writing range included in the output writing start notification. Based on the above, when it is determined that the first image and the second image are different in size and the smaller image fits within the larger image, the images overlap vertically at positions based on the writing range. The respective screen data may be synthesized.

Furthermore, each of the first application and the second application outputs a writing start notification including the writing range at the start of writing screen data, and the intermediate processing unit writes the writing included in the output writing start notification. Based on the range, it is determined whether or not the first image and the second image overlap, and if it is determined that they do not overlap, storage of the screen data in the intermediate storage unit is prohibited, and the combining unit When the storage of the screen data in the intermediate storage unit is prohibited, the composition is prohibited, and instead the screen data written in the first storage unit by the first application, The screen data written in the second storage unit by the second application may be synthesized at regular intervals.
Further, the combining unit is stored in the intermediate storage unit, and the first screen data having the same coordinate position as the coordinate position indicating the range written as the second screen data, and the second screen data It may be combined with the screen data.

  If comprised as mentioned above, the synthetic | combination screen data synthesize | combined by the synthetic | combination part will be the thing by which the two screen data which should be synthesize | combined by the application of one side and the other are synthesize | combined. Therefore, for example, it is possible to prevent the occurrence of screen flicker due to the occurrence of a gap between images because the image that slides in cannot catch up with the image that slides out.

1 is a diagram showing an overall schematic configuration of an MFP according to an embodiment. 2 is a block diagram illustrating a configuration of a control unit of the MFP. FIG. It is a figure for demonstrating the synthesis | combination of screen data. (A) is a figure which shows the example of the screen produced | generated by the applications 1-3 just before the screen switching start, (b) is a figure which shows the example of the screen produced | generated newly, (c) ) Is a diagram showing how the screen changes between the start and end of screen switching. It is a figure for demonstrating the control method (Example) in the case of switching screens. It is a figure which shows the example of a display at the time of superimposing two screens. It is a figure for demonstrating the comparative example when not performing screen switching control. It is a figure which shows a part of sequence diagram of screen switching control. It is a figure which shows the remaining one part of the sequence diagram of screen switching control. It is a figure which shows another remaining part of the sequence diagram of screen switching control. It is a flowchart which shows the content of the screen data writing process by an application. It is a flowchart which shows the content of the screen switching process by a drawing control part. It is a flowchart which extracts and shows only a part of screen switching process concerning a modification. It is a figure which shows the mode of the screen switching which concerns on a modification. It is a figure which shows the example of the screen data in the case of the screen switching control which concerns on a modification.

Hereinafter, an example in which an embodiment of an image processing apparatus according to the present invention is applied to a multifunction peripheral (MFP) will be described.
<Overall configuration of MFP>
FIG. 1 is a diagram showing an overall schematic configuration of an MFP 10 according to the present embodiment.
As shown in the figure, the MFP 10 includes a scanner unit 11, a print unit 12, an operation unit 13, a control unit 14, and the like, and is based on a scan job for reading an image of a document and image data obtained by reading. A print job that prints an original image on a sheet and a print request that receives a job request from an external terminal (not shown) connected via a network such as a LAN and prints an image related to the received job on a sheet It has a function to execute various jobs such as jobs.

The scanner unit 11 is an image reading device that reads an image of a document and obtains image data.
The print unit 12 is an image forming apparatus that prints an image on a sheet.
The operation unit 13 is disposed at a position where the user can easily operate when standing in front of the MFP 1, here in front of the scanner unit 11.
The operation unit 13 includes a display 9 on which a transparent touch panel is attached, in addition to various keys for receiving inputs such as the number of copies and a job start instruction from the user.

The display 9 displays screens related to various jobs based on instructions from the control unit 14 and accepts touch input for job execution from the user via the touch panel. The input information received by the operation unit 13 is sent to the control unit 14.
<Configuration of control unit>
As shown in the block diagram of FIG. 2, the control unit 14 includes a communication interface (I / F) unit 21, a CPU 22, a ROM 23, an application storage unit 24, a data storage unit 25, a drawing control unit 26, A display control unit 27 is provided, and each unit can communicate with each other via a bus.

The communication I / F unit 21 is an interface for connecting to a network, such as a LAN card or a LAN board in this case, and print job data from the outside (not shown) or a server on the Internet (not shown) via the LAN. Data indicating various types of information is received.
The CPU 22 reads a necessary program from the ROM 23 and controls operations of the scanner unit 11 and the print unit 12 to smoothly execute jobs such as copying and printing. For example, in the case of a print job, when print job data from the communication I / F unit 21 is accepted, the data is converted into data to be printed by the print unit 12. When the image data obtained by the scanner unit 11 is received, the image data is converted into data for printing. Then, the converted data is transmitted to the printing unit 12, and the printing unit 12 is caused to execute printing based on the data.

Further, the CPU 22 reads out various applications stored in the application storage unit 24 as necessary, and executes functions of the read applications.
The application storage unit 24 is a nonvolatile storage unit, and stores a first application 1, a second application 2, and a third application 3.
The first application 1 (hereinafter referred to as “application 1”) is a program for displaying on the display 9 of the operation unit 13 an operation screen used for an operation when the user executes a copy job or the like. The operation screen includes various screens such as a sheet size selection screen for accepting selection of a sheet size from a user in a copy job and a density selection screen for accepting selection of copy density.

The second application 2 (hereinafter referred to as “application 2”) is a program for displaying a management screen on the display 9 of the operation unit 13 when the user refers to management information (such as the cumulative number of prints) of the MFP 10. . The management information is stored in a storage unit (not shown), and the number of sheets is updated for each print or copy job.
The third application 3 (hereinafter referred to as “application 3”) receives various types of information acquired from an external server on the network, etc. via the communication I / F unit 21 separately from a job such as copying and management information. This is a program for displaying on the display 9 of the operation unit 13 an information screen for providing information for the user to refer to and search for and input the information.

The application 1 and the application 2 are applications used for job execution and management of the MFP 10, whereas the application 3 is an application having functions such as information reference unrelated to the job and management. Since it is not a unique function, for example, an application provided from a third vendor can be configured to be used as the application 3.
Here, the apps 1 to 3 used in the present embodiment buffer the screen data for displaying the screen in an area of the same size on the display 9 in the app 3 than in the apps 1 and 2 (described later). ) Has a relationship that it takes a long time to write.

  Due to the difference in writing time (speed), screen switching control (described later) is executed so that flicker does not occur when switching from the screen by the application 1 or 2 to the screen by the application 3. In this embodiment, wipe-in and wipe-out are used as the screen switching method. The applications 1 to 3 operate on an OS (Operation System) (not shown) and execute their functions.

The data storage unit 25 includes a first buffer 31, a second buffer 32, a third buffer 33, an intermediate buffer 34, and a VRAM (Video RAM) 35.
The first buffer 31 is a storage unit in which screen data of an operation screen generated by the application 1 is written.
The second buffer 32 is a storage unit in which screen data of a management screen generated by the application 2 is written.

The third buffer 33 is a storage unit in which screen data of an information screen generated by the application 3 is written. Hereinafter, when the applications 1 to 3 are not particularly distinguished, they are collectively referred to as “applications”, and a buffer corresponding to one application may be referred to as a “buffer” without a reference numeral.
The intermediate buffer 34 is used as a storage unit for temporarily storing screen data by an application when screen switching control is performed.

The VRAM 35 is a storage unit for temporarily storing screen data necessary for displaying a screen on the display 9 of the operation unit 13.
The drawing control unit 26 comprehensively controls which application displays or switches the screen on the display 9, and includes an intermediate processing unit 51 and a data synthesis unit 52.
The intermediate processing unit 51 executes screen switching control using the intermediate buffer 34.

In a case other than screen switching control, the data composition unit 52 reads screen data from a buffer in which screen data of a screen to be displayed on the display 9 is written based on an instruction from the user, and writes the screen data in the VRAM 35.
For example, when displaying an operation screen by the application 1, the screen data generated by the application 1 and written in the first buffer 31 is read and written in the VRAM 35.

  On the other hand, in the screen switching control, the screen data written in the buffer by the application responsible for wiping out the image displayed on the screen among the apps 1 to 3 and the screen written in the buffer by the application responsible for wiping in the new image are displayed. The data is combined every time a certain amount of data is generated from the start to the end of screen switching, and the combined screen data is sequentially written and updated in the VRAM 35 each time the data is combined.

In the present embodiment, for example, the screen data that is the wiped-out image 41 is superimposed at the top, and the screen 42 that represents the wiped-in image is superimposed on the screen data. This is performed by combining the screen data of the screen 41 and the screen data of the screen 42 so that one screen is generated.
The user can view the image of the top screen 41 and cannot in principle see the image of the screen 42 hidden under the screen 41, but the application is displayed on the screen 41 so that a part of the image of the screen 41 includes a transparent area (described later). By generating the screen data 41, the partial image corresponding to the transparent area of the image of the screen 42 positioned below the screen 41 can be viewed by the user through the transparent area. Yes.

  Every time the composite screen data on the VRAM 35 is rewritten (updated) from the start to the end of the screen switching, the image on the screen 41 is in a predetermined direction (in the example of FIG. 3, the direction is from the bottom to the top). As the entire area disappears gradually from the lower side to the upper side, the display content changes so that the disappeared lower area becomes a transparent area and expands upward, and the image on the screen 42 The display contents transition so that the display image gradually enters (appears) from outside the frame of the display area (entire surface) of the display 9 in the same direction (from the bottom to the top).

Accordingly, the user can wipe the image of the screen 42 located below the screen 41 from outside the frame of the display area of the display 9 through the transparent area gradually expanding on the screen 41 during the screen switching. You can see it coming inside.
Note that the size of the screen 41 or the like is not limited to the size when the screen is displayed in the full frame of the display 9. For example, a part of the rectangular area of the entire display area of the display 9 is the size of the screen 41 or the like. As an alternative, the screen 41 or the like may be displayed.

The display control unit 27 sends the screen data (synthesized screen data) written in the VRAM 35 to the display 9 and executes control for causing the display 9 to display a screen image related to the screen data.
<Overview of screen switching control>
First, the outline of the screen switching control will be described with reference to FIG.

  4A shows a screen 61 based on the screen data written in the first buffer 31 by the application 1 and a screen 62 based on the screen data written in the second buffer 32 by the application 2 immediately before the start of screen switching. FIG. 4B shows an example of the screen 64 based on the screen data newly written to the third buffer 33 by the application 3. Is shown.

FIG. 4 (c) shows a transition from the start to the end when switching to the screen 64 is instructed by an operation input of a key or the like by the user while the screen 61 is currently displayed on the display 9. The example of the state of the display screen to perform is shown in order of passage of time.
The reference numeral 91 shown in the figure indicates an outer frame of the entire display area of the display 9, and the reference numeral 70 indicates a boundary line between the screen image to be wiped out and the screen image to be wiped in.

As shown in FIG. 4C, the screen switching of the present embodiment is such that the image of the screen 61 by the application 1 that was initially displayed is in a predetermined direction from the lower part (one end) to the upper side (the other The image of the new screen 64 by the application 3 appears gradually from the lower part to the upper part (wipe-in) in the erased area while being gradually erased (wiped out) toward the edge). To be done.
<Screen switching control method>
A control method for performing such screen switching will be described with reference to FIG.

FIG. 5 is a schematic diagram for explaining a method of synthesizing screen data at the time of screen switching according to the embodiment. During the screen switching, the first buffer 31, the second buffer 32, the third buffer 33, and the intermediate buffer. 34, an example of screen data corresponding to one screen area written in each of the VRAM 35 is shown in order of time passage (time points t0 to t6).
Here, a time point t0 in the figure is a screen switching start time, and a time point t6 is a screen switching end time. In addition, as an example of the screen data image written in the first buffer 31 or the like, an alphabetic character (for example, A or B) and a background portion (background) other than the character in the outer frame 92 of one rectangular screen region. ). Note that the base is assumed to be non-transparent unless otherwise specified as transparent. At the time point t0, the background in each screen data is non-transparent.

  In the outer frame 92, the upper direction is defined as the upper direction, the lower direction is defined as the lower direction, the left direction is defined as the left direction, and the right direction is defined as the right direction. , 0], the corner position of the lower left corner is defined as [0, 10], the corner position of the upper right corner is defined as [10, 0], and the corner position of the lower right corner is defined as [10, 10]. May be expressed as a coordinate position. The coordinate position is common to all the buffers 31 to 34 and the VRAM 35.

  As shown in the figure, at time t0, screen data Z0 indicating the screen by the application 1 is written in the first buffer 31, and screen data indicating the screen by the application 2 is written in the second buffer 32. The screen data Z2 indicating the screen by the application 3 is written in the third buffer 33, and the screen data indicating the same image as the screen data written in the first buffer 31 is written in the VRAM 35. .

Since the image of the screen data written in the VRAM 35 is displayed on the display 9, the screen data written in the VRAM 35 at that time, that is, the same screen image as the screen by the application 1 is displayed on the display 9 at the time t 0. It will be displayed.
In the figure, the screen image newly generated by the app 3 while the image of the screen displayed on the display 9 at the time t0 (that is, the same screen as the screen by the app 1) is wiped out from the time t0 to the time t6. An example of how the screen switches as if wipes in is shown.

The screen data written in the first buffer 31 disappears upward from the lower end of the original image as time elapses from the time point t0 to the time points t1 and t2. Instead, it can be seen that the transparent region (shaded portion) P is gradually rewritten so as to expand upward.
This rewriting to the transparent area P is performed by changing the screen data Z0 at the time t0 from the lower end of the original image to the upper direction by the application 1, for example, data indicating transparency by raster scanning with the horizontal direction as a scanning line. This is done by writing in pixel units.

  The transparent area P1 at the time point t1 corresponds to a rectangular area having four points [0, 7], [0, 10], [10, 7], and [10, 10] indicated by the coordinate positions as corners, and the time point t2 The transparent area P2 in FIG. 4 corresponds to a rectangular area with four points [0, 4], [0, 10], [10, 4], [10, 10] indicated by coordinate positions as corners, and after time t3. The transparent area P3 is a rectangular area (the whole of one screen area) whose corners are four points [0, 0], [0, 10], [10, 0], and [10, 10] indicated by coordinate positions. And P1 <P2 <P3.

Note that the drawing does not show how screen data is written between time points t0 and t1 or between time points t1 and t2, but the transparent area is written by application 1 between time points t0 and t3. It is continuously executed continuously.
The screen data written in the second buffer 32 is the same (not changed) from time t0 to time t6. This is because the screen by the application 2 written in the second buffer 32 is not to be switched, and in the example of the figure, the application 2 writes the screen data to the second buffer 32 from time t0 to time t6. Do not execute.

When the screen data written in the third buffer 33 reaches the time point 2, the lower part of the new image appears in the area indicated by Q1 instead of the lower part of the original image at the time point t0. It can be seen that it has been rewritten.
This rewriting indicates the image portion of the screen data Z2 at time t0 from the lower end of the original image upward from the lower end of the original image by the application 3, for example, from the lower end of the new image upward. This is done by writing data.

Similar to the application 1 described above, the rewriting of the screen data to the third buffer 33 by the application 3 is continuously performed between the time points such as the time points t0 to t2. It is omitted.
The writing area (new image area) Q1 of the screen data Z3 from the application 3 to the third buffer 33 at the time t2 from the time t0 can be represented by points [0, 7], [0, 10], This corresponds to a rectangular area with corners [10, 7] and [10, 10]. The size of the new image area Q1 is equal to the size of the transparent area P1 by the application 1 at time t1, and the transparent area P1 and the new image area Q1 are the same coordinate positions in one screen area. It will be.

  That is, when it is assumed that the screen Z1a (FIG. 6) when the screen data Z1 by the application 1 at the time t1 is displayed on the display 9 and the screen data Z3 by the application 3 at the time t2 is displayed on the display 9 is displayed. If one screen Z4a is generated (synthesized) by superimposing the screen Z3a (FIG. 6) on the screen Z1a so that the screen Z1a is at the top and the screen Z3a is hidden below it, the original image area on the screen Z3a Q1a is hidden behind the original image area P1a in the top screen Z1a and cannot be seen, and the new image area Q1 in the screen Z3a can be seen through the transparent area P1 in the top screen Z1a.

In this composite screen Z4a, the boundary line 75 indicating the boundary between the image to be wiped out and the image to be wiped in is a single straight line parallel to the left-right direction, so there is a gap between the image to be wiped out and the image to be wiped in. Screen flicker due to vacancy or overlapping of parts can be prevented.
The composite screen Z4a corresponds to a virtual screen when it is assumed that the composite screen data Z4 written in the VRAM 35 at time t2 shown in FIG.

In order to generate such composite screen data Z4, it is desirable that generation of screen data Z1 by application 1 and generation of screen data Z3 by application 3 are performed in synchronization during screen switching.
However, as described above, the application 3 is slower in generating screen data and writing in the buffer than the application 1, so even if the screen data is written in the area of the same size, the screen data Z1 has the time t1. However, the screen data Z3 cannot be performed until the time t2 after the time t1, and the time is shifted.

Therefore, in the present embodiment, the following processing is performed.
That is, the screen data Z1 written in the first buffer 31 at time t1 is read and stored in the intermediate buffer 34. Since the screen data stored in the intermediate buffer 34 is the same data as the screen data Z1 by the application 1, it is referred to as screen data Z1.
Thereafter, when the writing of the screen data to the third buffer 33 by the application 3 proceeds to the area Q1 having the same coordinate position as the transparent area P1 of the screen data Z1 stored in the intermediate buffer 34 (time t2), the third The screen data Z3 currently written in the buffer 33 and the screen data Z1 stored in the intermediate buffer 34 are combined, and the combined screen data Z4 is written in the VRAM 35.

Then, the composite screen data Z4 written in the VRAM 35 is transferred to the display 9 and displayed on the display 9. Needless to say, the screen data is continuously written to the third buffer 33 by the application 3 after the time point t2 as in the case of the application 1.
Such composition of the screen data is repeatedly executed until the screen switching ends.
Specifically, the screen data Z5 written in the first buffer 31 at time t2 is read and stored in the intermediate buffer 34. Since the stored screen data is the same data as the screen data Z5 by the application 1, it is referred to as screen data Z5.

  Thereafter, when the writing of the screen data to the third buffer 33 by the application 3 proceeds to the area Q2 having the same coordinate position as the transparent area P2 of the screen data Z5 stored in the intermediate buffer 34 (time t4), the third The screen data Z6 currently written in the buffer 33 and the screen data Z5 stored in the intermediate buffer 34 are combined, and the combined screen data Z7 is written (updated) in the VRAM 35.

The composite screen data Z7 written in the VRAM 35 is transferred to the display 9 and displayed on the display 9.
At time t3 prior to time t4, the screen data Z8 written in the first buffer 31 is stored in the intermediate buffer 34 (Z8).
After the time t4, the screen data is written to the third buffer 33 by the application 3 until the region Q3 having the same coordinate position as the transparent region P3 (the whole screen) of the screen data Z8 stored in the intermediate buffer 34. When the process proceeds (time t6), the screen data Z9 currently written in the third buffer 33 and the screen data Z8 stored in the intermediate buffer 34 are combined, and the combined screen data Z10 is written in the VRAM 35.

The composite screen data Z10 written in the VRAM 35 is transferred to the display 9 and displayed on the display 9. Thereby, the screen switching ends.
In the above, the example in which the composite screen is generated only at each of the time points t2, t4, and t6 has been described. However, the narrower the time interval between the time points, the shorter the generation interval of the composite screen, and the VRAM 35 per unit time. Thus, the number of updates of the composite screen increases, and accordingly, the boundary line 75 between the display image to be wiped out and the display image to be wiped in appears to move more smoothly in the vertical direction. The number of times the composite screen is updated depends on the processing capacity of each application for writing screen data to the buffer, and the processing capacity of transferring and storing screen data to the intermediate buffer 34 and VRAM 35, but it should be several tens of times per second, for example. Can do.
<Comparative example without screen switching control>
FIG. 7 is a diagram for explaining a comparative example when the above-described screen switching control is not performed.

  In this comparative example, the screen data writing to the first buffer 31 by the application 1 and the screen data writing to the third buffer 33 by the application 3 are the same as the embodiment in FIG. 34 does not exist, and the screen data written in the first buffer 31 and the screen data written in the third buffer 33 are combined at each time point.

Since the application 3 writes screen data to the buffer later than the application 1, in the comparative example, for example, at the time t1, the application 3 uses the application 3 to write the transparent area P1 into the first buffer 31. Writing of the new image area Q4 to the third buffer 33 has not caught up.
For this reason, when the synthesized screen data Z23 obtained by synthesizing the screen data Z21 written in the first buffer 31 and the screen data Z22 written in the third buffer 33 at time t1, the image area P4a by the application 1 is The screen is such that the original image area Q4a by the application 3 and the new image area Q4 by the application 3 are arranged vertically.

This screen corresponds to a screen in which a gap is generated between the image area P4a (image to be wiped out) by the application 1 and a new image area Q4 (image to be wiped in) by the application 3, and causes screen flicker.
At each time point after time point t2, when the synthesized screen data Z24, Z25, etc. are viewed, it can be seen that only data including a flicker factor can be generated as in time point t1, and as a result, in the configuration of the comparative example, screen switching starts. From (time 0) to the end (time t6), the screen is likely to switch while the screen flickers.

In the present embodiment, since screen switching control as shown in FIG. 5 is performed, screen flicker during switching can be prevented and screen switching can be executed more smoothly.
<Screen switching control sequence diagram>
8 to 10 are diagrams showing sequence diagrams of the screen switching control according to the present embodiment, and show an example in which the same screen switching as the screen switching example shown in FIG. 5 is performed.

As shown in FIG. 8, the applications 1 and 3 accept a screen switching instruction (G1, G2).
This screen switching instruction is input when, for example, the user performs a key input operation on the operation unit 13 for switching from the current operation screen (screen by the application 1) to the information screen (screen by the application 3). Issued when the CPU 22 receives information.
The application 1 that has received the switching instruction starts a process of writing screen data for wiping out the image of the operation screen currently displayed on the display 9 in the first buffer 31. Specifically, as shown in FIG. 5 described above, writing of screen data is started so that the transparent region P expands from the bottom to the top of the screen. The screen data Z0 at the time point t0 corresponds to the screen data Z0 shown in FIG.

The application 1 transmits a writing start notification indicating the writing start to the drawing control unit 26 (G3). This writing start notification includes information indicating the writing range by the coordinate position.
The writing range is a rectangle, and is specified by the coordinate position of one corner and the coordinate position of the other corner. In the example of FIG. 5, the writing range is the entire screen, and the coordinate position [0, 0] indicating the upper left corner and the coordinate position [10, 10] indicating the lower right corner are the coordinate positions indicating the writing range. become.

Similar to the application 1, the application 3 that has received the switching instruction starts a process of writing screen data for wiping in an image of a new information screen into the third buffer 33, and includes information indicating a writing range by a coordinate position. A writing start notification is transmitted to the drawing control unit 26 (G4). The writing range is the same as that of the application 1.
The drawing control unit 26 determines whether the ranges written by the apps 1 and 3 overlap based on the information indicating the writing ranges from the apps 1 and 3 (G5).

If they overlap as shown in the example of FIG. 5, it causes screen flicker due to wipe-out and wipe-in, and if they do not overlap (a small screen is displayed in a separate area for each application in one screen. In other words, there is no cause of screen flicker. Below, the example in case of overlapping is demonstrated.
When the application 1 writes a predetermined amount of H data (transparent area data) from the start of writing during the writing of the screen data to the first buffer 31 (time t1: generation of screen data Z1), the written transparency A writing notification indicating the range of the region P1 by the coordinate position is transmitted to the drawing control unit 26 (G6). In the example of FIG. 8, the coordinate positions are [0, 7] and [10, 10].

Here, the predetermined amount H of data is, for example, data corresponding to (N / n) scanning lines when the total number N of scanning lines when raster scanning the entire range of one screen is equally divided into a plurality of n. It can be a quantity (number of pixels). This predetermined amount H is also applied to the application 3.
The predetermined amount H indicates the amount of change in one step (one step) when the display image in one screen changes stepwise by wipe-out and wipe-in. Therefore, the smaller the predetermined amount H (the value of n becomes smaller). The larger the number), the number of times the synthesized screen data is rewritten to the VRAM 35 from the start to the end of the screen switching increases, and the screen transition seems to be performed more smoothly for the user.

When the drawing control unit 26 receives the writing notification (G6) from the application 1, it determines whether a writing notification from the application 3 indicating the same coordinate position is received. Is read from the first buffer 31 and stored in the intermediate buffer 34 (G7). The intermediate processing unit 51 takes charge of this G7.
Here, the screen data Z1 is stored in the intermediate buffer 34 with information indicating the coordinate positions ([0, 7] and [10, 10] in the above example) included in the write notification (G6), the screen data Z1, and the like. Are executed in a state of being associated with each other. As a result, for each of the one or more screen data stored in the intermediate buffer 34, by referring to the information indicating the coordinate position, to which coordinate position the screen data is written is specified. Can do.

  Therefore, among the one or more pieces of screen data stored in the intermediate buffer 34, screen data at the same coordinate position as the screen data corresponding to the coordinate position included in the write notification received from another application after the storage is stored in the intermediate buffer 34. Can be read from. Even when screen data (such as Z3) different from Z1 is stored in the intermediate buffer 34, the screen data and its coordinate position are managed in association with each other as described above.

When the application 3 writes a predetermined amount of H data from the start of writing during the writing of the screen data to the third buffer 33 (time t2), the drawing control unit 26 sends a writing notification indicating the written range by the coordinate position. (G8). In the example of FIG. 8, the coordinate positions are [0, 7] and [10, 10].
When the drawing control unit 26 receives the writing notification (G8) from the application 3, the drawing control unit 26 has already received the writing notification from the application 1 indicating the same coordinate position, so the screen data Z3 by the application 3 is stored in the third buffer. The screen data Z1 by the application 1 written to the same coordinate position is read from the intermediate buffer 34 (G10).

Then, the read screen data Z1 and Z3 (showing the same coordinate position) are combined, and the combined screen data Z4 is written in the VRAM 35 (G11). The data composition unit 52 is in charge of this G11.
The composite screen data Z4 written in the VRAM 35 is sent to the display 9, and an image related to the composite screen data Z4 is displayed on the display 9.

  Moving to FIG. 9, the application 1 is in the middle of writing the screen data to the first buffer 31, and the range written at the time of the previous writing notification (in the above example, the coordinate positions [0, 7] and [10, 10] Then, when a predetermined amount of data H is written (generation of screen data Z5), a writing notification indicating the written range by the coordinate position is transmitted to the drawing control unit 26 (G12). In the example of FIG. 9, the coordinate positions are [0, 4] and [10, 7].

When the drawing control unit 26 receives the writing notification from the application 1 and determines that the writing notification from the application 3 indicating the same coordinate position is not received, the drawing control unit 26 receives the screen data Z5 from the application 1 as the first. The data is read from the buffer 31 and stored in the intermediate buffer 34 (G13). This intermediate processing unit 51 is in charge of G13.
The screen data Z5 is stored in the intermediate buffer 34 by, for example, a method of writing the entire screen data Z5 into the intermediate buffer 34 in a storage area different from the screen data Z1 already stored in the intermediate buffer 34, or the screen data Z5. Among them, only the difference from the screen data Z1 already stored in the intermediate buffer 34, that is, the data corresponding to the partial area indicated by the coordinate positions [0, 4] and [10, 7] is stored in the intermediate buffer 34. It may be performed by a method of rewriting the stored screen data Z1. This also applies to the case where other screen data Z5, Z8, etc. described later are stored in the intermediate buffer 34.

  When the writing by the application 1 proceeds and data of a predetermined amount H is further written from the range written at the time of the previous writing notification (in the above example, coordinate positions [0, 4] and [10, 7]) (time point t3: Generation of screen data Z8), a writing notification indicating the written range by the coordinate position is transmitted to the drawing control unit 26 (G14). In the example of FIG. 9, the coordinate positions are [0, 0] and [10, 4].

Since the screen data Z8 corresponds to data that has been written to the entire writing range (data in which the entire region is a transparent region), the application 1 sends a writing end notification indicating the end of writing to the drawing control unit 26 (G15). ).
When the drawing control unit 26 receives the writing notification (G14) from the application 1 and determines that the writing notification from the application 3 indicating the same coordinate position is not received, the drawing control unit 26 displays the screen data Z8 by the application 1. Are read from the first buffer 31 and stored in the intermediate buffer 34 (G16). The intermediate processing unit 51 takes charge of this G16.

  The application 3 that is executing the writing of the screen data to the third buffer 33 further determines from the range written at the previous writing notification (in the above example, the coordinate positions [0, 7] and [10, 10]). When the fixed amount H data is written (time t4: generation of the screen data Z6), a writing notification indicating the written range by the coordinate position is transmitted to the drawing control unit 26 (G17). In the example of FIG. 9, the coordinate positions are [0, 4] and [10, 7].

Upon receiving the writing notification (G17) from the application 3, the drawing control unit 26 determines that the writing notification from the application 1 indicating the same coordinate position has already been received, and the screen data Z6 by the application 3 is received. Reading from the third buffer 33 (G18), the screen data Z5 by the application 1 written to the same coordinate position is read from the intermediate buffer 34 (G19).
Then, the read screen data Z5 and Z6 (showing the same coordinate position) are synthesized, and the synthesized screen data Z7 is written in the VRAM 35 (G20). The data composition unit 52 is in charge of this G20.

The composite screen data Z7 written in the VRAM 35 is sent to the display 9, and an image related to the composite screen data Z7 is displayed on the display 9 instead of the image related to the composite screen data Z4 that has been displayed on the display 9 until now. The
Moving to FIG. 10, the writing by the application 3 proceeds, and a predetermined amount of data H is further obtained from the range written in the previous writing notification (in the above example, the coordinate positions [0, 4] and [10, 7]). When writing is performed (time t6: generation of screen data Z9), a writing notification indicating the writing range as a coordinate position is transmitted to the drawing control unit 26 (G21). In the example of FIG. 10, the coordinate positions are [0, 0] and [10, 4].

Since the screen data Z9 corresponds to data that has been written to the entire writing range, the application 3 sends a writing end notification indicating the end of writing to the drawing control unit 26 (G22).
When receiving the writing notification (G21) from the application 3, the drawing control unit 26 determines that the writing notification from the application 1 indicating the same coordinate position has already been received, and the screen data Z9 by the application 3 is received. Reading from the third buffer 33 (G23), the screen data Z8 by the application 1 written to the same coordinate position is read from the intermediate buffer 34 (G24).

Then, the read screen data Z8 and Z9 (showing the same coordinate position) are combined, and the combined screen data Z10 is written in the VRAM 35 (G25). The data composition unit 52 is in charge of this G25.
The composite screen data Z10 written in the VRAM 35 is sent to the display 9, and an image related to the composite screen data Z10 is displayed on the display 9 instead of the image related to the composite screen data Z7 that has been displayed on the display 9 so far. The

The drawing control unit 26 receives the writing end notification from each of the applications 1 and 3, writes screen data to the first buffer 31 by the application 1, and writes screen data to the third buffer 33 by the application 3. Determine the end of writing.
<Screen switching control flow>
FIG. 11 is a flowchart showing the contents of the screen data writing process executed by each of the applications 1 to 3 during the screen switching control. Here, processing by the application 1 is described as an example, but basically the same processing is executed for the other applications 2 and 3 as well.

As shown in the figure, when the application 1 receives a screen switching instruction, the application 1 transmits a writing start notification to the drawing control unit 26 (step S1), and performs a process of writing screen data based on the screen switching instruction to the first buffer 31. Start (step S2).
Thereafter, the screen data is gradually stored in the first buffer 31 so that the screen (such as the screen 61 in FIG. 4) of the application 1 is gradually erased in one direction from the bottom (one end) to the top (the other end) on the display 9. It will be written. In the case of the application 3, the screen data is displayed so that the screen (such as the screen 64 in FIG. 4) gradually appears on the display 9 from the bottom to the top in one direction and gradually appears in the screen erasure area by the application 1. 3 are gradually written into the buffer 33.

It is determined whether or not the writing amount J from the start of writing screen data has reached a predetermined amount H (step S3). The application 1 sets the amount of data written in the first buffer 31 by one pixel or one scanning line as a write amount J, and when the count value reaches a predetermined amount H, the screen data write amount It is determined that J has reached a predetermined amount H.
When it is determined that the writing amount J has reached the predetermined amount H (“YES” in step S3), a writing notification indicating the written range by the coordinate position is transmitted to the drawing control unit 26 (step S4). Move.

In step S5, it is determined whether or not screen data has been written.
If it is determined that the writing of the screen data is not completed (“NO” in step S5), the process returns to step 3.
In step S3, it is determined whether or not the writing amount J since the writing amount J has reached the predetermined amount H last time has reached the predetermined amount H. This determination is made, for example, by resetting the count value to 0 when the writing of a predetermined amount of screen data has been completed last time and starting counting from 0, and then the count value (writing amount J) is set to a predetermined amount H. This is done by determining whether or not

When it is determined that the writing amount J has reached the predetermined amount H (“YES” in step S3), a writing notification indicating the writing range by the coordinate position is transmitted to the drawing control unit 26 (step S4), and the screen data If writing has not been completed (“NO” in step S5), the process returns to step S3 again, and step 3 and subsequent steps are executed.
The application 1 transmits a writing notification to the drawing control unit 26 every time the writing amount J of the screen data reaches a predetermined amount H from the start to the end of the writing of the screen data to the first buffer 31 (steps S3 to S3). S5).

When the application 1 determines that the writing of the screen data has ended (“YES” in step S5), the application 1 transmits a writing end notification to the drawing control unit 26 (step S6) and ends the processing.
FIG. 12 is a flowchart showing the contents of the screen switching process executed by the drawing control unit 26.

  As shown in the figure, when the drawing control unit 26 receives a writing start notification from each application (in the above example, the applications 1 and 3) (step S11), the drawing control unit 26 selects each application based on the writing range included in the writing start notification. It is determined whether or not there is an overlap on each screen (step S12). This determination is performed by specifying the writing range on one screen by one application and the writing range on one screen by the other application from the respective coordinate positions.

For example, as shown in the example of FIG. 5, when one and the other apps rewrite the entire area of one screen, it is determined that there is an overlap. Apart from this, there is no overlap when a small screen is displayed in a partial area of one application on one screen and another small screen is displayed in a window in the other application. It is determined.
When the drawing control unit 26 determines that there is an overlap (“YES” in step S13), the drawing control unit 26 determines whether a writing notification is received from any of the applications (step S14).

If it is determined that the writing notification is received (“YES” in step S14), information indicating the coordinate position included in the writing notification (in the example of FIG. 8, [0, 7], [10, 10], etc.) ) Is determined whether or not the writing notification indicating the same coordinate position as that of the other application has been received (step S15).
In the case of receiving a writing notification from the app 1 in FIG. 8 (G6), the writing notification (G8) indicating the same coordinate position from the app 3 as the other app has not been received yet. , It is determined that it has not been received. Determining that no reception has occurred is equivalent to determining that the application that has output the writing notification is the application that writes the screen data to the buffer faster and the other application is the slower application.

When the drawing control unit 26 determines that it has not been received ("NO" in step S16), the drawing control unit 26 determines that the application that has output the writing notification is the faster writing application of the screen data to the buffer. The screen data written in the buffer is read and stored in the intermediate buffer 34 (step S17), and the process returns to step 14.
In FIG. 8, when the application 1 outputs a write notification (G6) as an example, the screen data Z1 by the application 1 is read from the first buffer 31, and the screen data Z1 is stored in the intermediate buffer 34 (G7).

The screen data Z1 is stored in the intermediate buffer 34 by associating the information ([0, 7] and [10, 10]) indicating the coordinate position included in the writing notification with the screen data Z1 as described above. . The screen data and the coordinate position are associated with each other and stored in the intermediate buffer 34 as well for other screen data Z3 and the like.
In step S <b> 14, the drawing control unit 26 determines again whether a writing notification from any application is received.

If it is determined that the writing notification is received (“YES” in step S14), it is determined whether or not a writing notification indicating the same coordinate position as the coordinate position included in the writing notification has been received from the other application (step S14). S15).
In the case of receiving the write notification from the application 3 in FIG. 8 (G8) as an example, the write notification (G6) indicating the same coordinate position from the other application, app 1, has already been received. Judge that it has been received.

  When the drawing control unit 26 determines that it has been received (“YES” in step S16), the drawing control unit 26 determines that the application that has output the writing notification is the application with the slower writing of the screen data to the buffer. 34, the screen data indicating the same coordinate position as the screen data by the application that has output the writing notification is read from the intermediate buffer 34 (step S18), and the screen data by the application that has output the writing notification is read from the screen data. Read from the buffer corresponding to the application (step S19).

Then, the drawing control unit 26 synthesizes the read screen data to generate synthesized screen data (step S20).
In FIG. 8, when the application 3 outputs a write notification (G8) as an example, the screen data Z1 at the same coordinate position is read from the intermediate buffer 34 (G10), and the screen data Z3 by the application 3 is read from the third buffer 33. Read (G9), and the read screen data Z1 and screen data Z3 are combined (G11).

When writing the composite screen data to the VRAM 35 (step S21), the drawing control unit 26 determines whether the writing is finished (step S22). The determination of the end of writing is performed by determining that the synthesis of screen data (G25 in the example of FIG. 10) by the application that has received the notification of the end of writing has ended.
When the drawing control unit 26 determines that the writing has not been completed (“NO” in step S22), the drawing control unit 26 returns to step S14 and executes the processes in and after step S14.

Until the end of writing is determined, the processes of steps S14 to S22 are repeatedly executed. Thus, every time screen data at the same coordinate position is written by one and the other application, composite screen data obtained by combining the screen data at the same coordinate position is sequentially written into the VRAM 35 and updated.
When the drawing control unit 26 determines the end of writing (“YES” in step S22), the drawing control unit 26 ends the process.

  If the drawing control unit 26 determines that there is no overlap in the writing area of each application (“NO” in step S13), the drawing control unit 26 reads the screen data of each application from the respective buffers corresponding to each application at a constant cycle. Then, each time the data is read, a process of writing the combined screen data into the VRAM 35 is performed until the writing is completed (step S23), and then the process is terminated. The reading at a constant cycle can be, for example, several tens of times per second.

The process of step S23 is performed by prohibiting the storage of the screen data in the intermediate buffer 34, and by determining the prohibition, the screen data from the first buffer 31 to the third buffer 33 and the screen data from the intermediate buffer 34 are This corresponds to processing for prohibiting synthesis.
As described above, every time a predetermined amount of screen data is written by the faster application while the screen data is being written to the buffer by the two applications responsible for screen switching, the screen data at that time is temporarily stored. Is stored in the intermediate buffer 34.

  Each time screen data to be combined with the screen data stored in the intermediate buffer 34 (in the above example, screen data having the same coordinate position indicating the written range) is written by the later-written application. By combining the screen data of the slower application and the corresponding screen data stored in the intermediate buffer 34 (by the faster application), and sequentially writing the combined screen data to the VRAM 35 The composition screen data written in the VRAM 35 is updated.

  Therefore, the time required for two applications to write screen data of the same data amount has different characteristics, and even if the configuration is such that screen data generated separately by each application is written to each buffer, it is stored in the VRAM 35. The combined screen data to be written is obtained by combining two screen data to be combined (written up to the same coordinate position) by the respective apps of one and the other.

Thereby, for example, it is possible to prevent the occurrence of screen flickering due to a gap between the display images that the display image to be wiped in does not catch up with the display image to be wiped out.
The present invention is not limited to the image processing apparatus, and may be a display screen switching method, for example. The method may be a program executed by a computer. The program according to the present invention includes, for example, a magnetic disk such as a magnetic tape and a flexible disk, an optical recording medium such as a DVD-ROM, DVD-RAM, CD-ROM, CD-R, MO, and PD, a flash memory recording medium, etc. It can be recorded on various computer-readable recording media, and may be produced, transferred, etc. in the form of the recording medium. Various wired and wireless networks including the Internet in the form of programs, broadcasting, In some cases, the data is transmitted and supplied via a telecommunication line, satellite communication, or the like.

(Modification)
As described above, the present invention has been described based on the embodiments. However, the present invention is not limited to the above-described embodiments, and the following cases are also included in the present invention.
(1) In the above embodiment, the drawing control unit 26 receives the writing notification indicating the same coordinate position from the other application at the time of receiving the writing notification from one application ( In step S16 in FIG. 12, “NO”), the screen data from one application is stored in the intermediate buffer 34 (step S17), that is, whether or not there is a writing notification from the other application is stored in the intermediate buffer 34 of the screen data. The condition for determining whether or not writing is necessary is not limited to this.

For example, without referring to the writing notification from the other application, whether or not there is a difference (difference) in the coordinate position included in each writing notification of the current time and the past (previous) for each application. It can also be a condition for determining whether or not writing to the buffer 34 is necessary.
FIG. 13 is a flowchart showing a part of the screen switching process based on this determination condition. Only parts different from the screen switching process shown in FIG. 12 are extracted, and the other parts are the same as the flowchart shown in FIG. It has become.

As illustrated in FIG. 13, when a writing notification from the application is received (“YES” in step S14), the coordinate position included in the current writing notification and the coordinate position included in the previous writing notification from the same application are displayed. Whether or not there is a difference is determined (step S31).
Each time this writing notification is received from the app, this determination is made by associating information that associates the name of the app with the number of times that the writing notification is received and the coordinate position included in the writing notification. This is done by comparing the current and previous coordinate positions for the application that has managed and output the writing notification.

If it is determined that there is a difference ("YES" in step S32), the screen data corresponding to the current writing notification is not stored in the intermediate buffer 34, and the screen data is stored in the intermediate buffer 34 (step S32). S33), the process proceeds to step S34.
On the other hand, if it is determined that there is no difference (“NO” in step S32), it is determined that the screen data corresponding to the current writing notification is already stored in the intermediate buffer 34, and the process returns to step S34 without executing step S33. Move.

In step S34, it is determined whether screen data from another application that indicates the same coordinate position as the screen data by the application that has output the writing notification among the screen data stored in the intermediate buffer 34 exists.
This determination is made by referring to the coordinate position managed in association with the screen data for each of the one or more screen data stored in the intermediate buffer 34.

If it is determined that it exists (“YES” in step S35), screen data from another application indicating the same coordinate position is read from the intermediate buffer 34 (step S36), and the processing from step S19 is executed. On the other hand, if it is determined that it does not exist ("NO" in step S35), the process returns to step S14 and waits for reception of the next write notification.
When the screen data is written to the intermediate buffer 34 only when there is a difference in the coordinate positions included in the previous and current writing notifications, the intermediate buffer of the screen data is determined by determining the presence or absence of the difference. Whether to write to 34 can be determined.

That there is a difference between the coordinate positions included in the previous and current writing notifications means that the screen data has been rewritten by the amount of the difference.
For example, writing of screen data to the buffer is in units of one scanning line, and writing notification indicating the same coordinate position as before is completed until the writing of data to all pixels corresponding to one scanning line is completed. When an application by a third vendor that outputs a plurality of times is used, it is not necessary to store screen data in the intermediate buffer 34 every time a write notification is received from the application. The processing burden can be reduced.

(2) Further, instead of determining whether or not there is a difference as described above, for example, a method of determining that storage in the intermediate buffer 34 is necessary only when the difference exceeds a threshold value may be employed.
For example, each application is configured to output a writing notification every time data of one scanning line is written by raster scanning. If the threshold value is 5, the data amount of five scanning lines is set as one band unit. Every time data for five scanning lines is written into the buffer by the application, the screen data by the application is stored in the intermediate buffer 34.

As the threshold value (data amount of one band) is reduced, the number of times screen data being written to the buffer by the application is stored in the intermediate buffer 34 between the start and end of screen switching increases.
This is equivalent to an increase in the number of times that the composite screen data is rewritten into the VRAM 35, so that the user can switch the display screen on the display 9 more smoothly as in the case where the predetermined amount H is reduced. You can see what is going on. As the threshold value (data amount of one band), a value common to each application may be determined in advance, or a different value may be determined in advance for each application.

If the threshold is different for each application, for example, if application 1 is threshold 5, application 3 can be combined with screen data of the same writing amount (coordinate position) such that one is a multiple of the other like threshold 10 Decided.
In the embodiment, each application has the same predetermined amount H (corresponding to the above threshold value). However, a configuration in which the predetermined amount H is different for each application as in this modification is applied to the embodiment. Even in this case, if one of the applications is a multiple of the other, the screen data at the same coordinate position can be synthesized.

(3) In the embodiment, a case where one predetermined value H (corresponding to the above-described threshold value) is applied when switching an image of one screen 61 by the application 1 to an image of one screen 64 by the application 3. An example has been described, but the present invention is not limited to this.
For example, the app 1 can display a third image different from the image (first image) on the screen 61, and the app 3 is also a fourth image different from the image (second image) on the screen 64. Can be applied to the screen data of the third image by the app 1 and the screen data of the fourth image by the app 3, and the same predetermined amount H may be applied as described above. A predetermined amount H1 may be applied.

As described above, the smaller the predetermined value H, the smaller the amount of change in one step when the display screen transitions in stages due to wipe-in and wipe-out, and the screen switching seems to be performed more finely (smoothly). Visible to the user.
Accordingly, when a plurality of different combinations are determined in advance for one image to be wiped out and one image to be wiped out among a plurality of different images, and screen switching is performed more finely for each combination. May decrease the predetermined value H, and if not necessary, the predetermined value H may be changed so as to increase the predetermined value.

It is possible to determine in advance by experiment or the like which size the predetermined value H is set for which image combination.
For example, since the switching operation is less visible to the user than when the image size (display area) on the display 9 is smaller, the predetermined amount H can be increased.
Specifically, when the third image and the fourth image have a smaller display area on the display 9 than the first image and the second image, the predetermined amount for the first image and the second image is set to H, Assuming that the predetermined amount for the 3rd image and the 4th image is H1, if the relationship of H <H1, the screen switching is made to be performed more smoothly (finely) for the 1st image and the 2nd image. For the third image and the fourth image, the number of times screen data is written to the intermediate buffer 34 is reduced, and the processing load on the drawing control unit 26 can be reduced accordingly.

(4) Further, instead of the above, for example, the screen data by each application may be stored in the intermediate buffer 34 without any particular determination each time a write notification is received.
In this case, while the screen data of both applications is being written to the buffer, all the screen data of both applications is stored in the intermediate buffer 34, and the screen data of both applications stored in the intermediate buffer 34 is included. The screen data indicating the same coordinate position in the writing area (the screen data to be combined) are combined from the one with the earlier writing order, and the combined screen data is written to the VRAM 35 for each combination.

(5) In the above embodiment, the application 1 that generates screen data for wipe-out is faster in writing screen data to the buffer than the application 3 that generates screen data for wipe-in. Although explained, it is not limited to this.
For example, when screen data is written faster in the app 3 than in the app 1, the operation is as follows. That is, (a) When screen data Z3 is written in the third buffer 33 by the faster application 3, the screen data Z3 is written in the intermediate buffer 34.

(B) Thereafter, when screen data Z1 corresponding to the same writing amount (coordinate position) as the screen data Z3 is written to the first buffer 31 by the later application 1, the screen data Z1 is read from the first buffer 31. The screen data Z3 is read from the intermediate buffer 34.
(C) The read screen data Z1 and Z3 are combined (in the combining order, Z1 is the highest and Z3 is below Z1), and the combined screen data Z4 is written into the VRAM 35. Thereafter, each time the screen data is written in the third buffer 33 by the application 3 by the predetermined amount H, the above (a) to (c) are repeatedly executed. That is, the overlapping order of the images is determined so that the wiped-out image is at the top and the wiped-in image is positioned at the bottom, and the screen data is synthesized based on the determined order.

  Note that, from the start to the end of screen switching, the application 1 has a relationship that writing to the buffer is faster than the application 3 in a certain partial section α, but the relationship is reversed in another partial section β. If the screen data from the faster application is temporarily stored in the intermediate buffer 34, the screen data from the slower application is then combined with the screen data from the slower application to generate composite screen data. be able to.

(6) In the above-described embodiment, the drawing control unit 26 writes a predetermined amount of data from the application as a writing notification indicating the partial area of the writing target range to which the screen data has been written in the buffer. However, the present invention is not limited to this.
Other methods that can detect the amount of writing while writing screen data to the buffer without receiving a write notification from the app, for example, if the buffer can detect the amount of writing to itself, draw from the buffer For example, the control unit 26 may acquire a write amount detection value.

  In addition, for example, each application and the drawing control unit 26 have a memory space that can be referred to, and each application writes the coordinate position of the written area or the writing amount (for example, the writing of the screen data to the buffer) (for example, The number of lines written, the number of pixels, the value indicating the ratio (%) to the total writing amount (whole image), etc.) are written into the memory space at regular intervals. In addition, by polling the memory space, it is possible to adopt a configuration for determining the writing amount of each application.

  (7) In the above-described embodiment, an example in which the screens of the applications 1 to 3 have the same size has been described. However, the present invention is not limited to this, and can be applied to different cases. For example, with respect to the size of the image by the application 1, the image by the application 3 has the same horizontal length (width) and the vertical length (height) is half the size. A case where the screen is switched so that a new image by the application 3 is inserted in the half area can be considered.

In this case, on the display screen at the end of switching, the image by the application 3 is displayed in the lower half area, and the upper half area becomes a transparent area. If the screen data of the apps 1 to 3 are combined and the overlapping order of the images by the apps is set from the top to the apps 1 (top), 3, 2 (bottom), the upper half of the display screen The image by the application 2 is displayed.
The size of each image is different, and the determination that the smaller image fits within the larger image can be made by referring to the writing range (coordinate position) included in the writing start notification from each application. . It can be realized by combining the screen data by each application so that each image overlaps vertically at a position based on the coordinate position.

(8) In the above embodiment, an example has been described in which the three applications 1 to 3 function as data writing means for writing screen data for wipe-in and wipe-out into the corresponding buffers. The number is not limited to three and may be plural.
Of the multiple apps, an app responsible for rewriting the screen data for wiping out the current display image and another app responsible for rewriting the screen data for wiping in the new image are executed separately. The

(9) In the above embodiment, the screen is switched by wipe-in and wipe-out. However, the present invention is not limited to this. For example, the present invention can also be applied to the above switching control by slide-in and slide-out.
In the case of slide-in and slide-out, control is performed so that the screen 61 is switched from the state in which the screen 61 is displayed to the screen 64 through the screens 65, 66, and 67 as shown in the example of FIG.

  That is, the image 81 by the application 1 that is initially displayed on the display 9 is gradually slid in one direction (in this case, upward) and disappears from the outer frame 91 (slide out), but in the erase region. The screen is switched so that a new image 82 by the application 3 gradually slides in the same direction, that is, from the outside to the inside of the frame from the bottom to the top (slide in).

FIG. 15 is a schematic diagram illustrating an example of screen data when screen switching control by slide-out and slide-in is executed.
The screen data Z1b to be slid out has a transparent area P1 below it, and the transparent area P1 is the same as the screen data Z1 according to the wipe-out example in FIG. On the other hand, in the screen data Z1b shown in FIG. 15, since the original image area 83 is slid upward by the width of the transparent area P1, this image area 83 depends on the wipe-out example of FIG. It is different from the screen data Z1.

  That is, in the case of the wipeout in the embodiment, a configuration may be adopted in which a writing notification is output to the drawing control unit 26 when only the portion of the transparent region P1 in the entire screen is rewritten by a predetermined amount H. In the case of the slide-out in this modification, it is necessary to rewrite the entire screen including the transparent area P1 and the image area 83 with respect to the screen data Z0 as in the screen data Z1b shown in FIG. A configuration is adopted in which a writing notification is output to the drawing control unit 26 after the writing is completed.

Subsequently, rewriting of the entire screen from the current screen data Z1b to the next screen data Z5b is started, and when writing of the screen data Z5b to the first buffer 31 is completed, a writing notification is again sent to the drawing control unit 26. Output. The rewriting of the screen data for the entire screen by the application 1 is repeatedly executed until the screen switching ends.
In the case of slide-in, the configuration is such that the entire screen data is rewritten in the same way as slide-out, and the application 3 sets the upper end of the incoming new image area Q1b as shown in the screen data Z3b. The screen data is written into the third buffer 33 so as to be displayed from the part.

  In the wipe-in according to the embodiment, the screen data is written so as to be displayed from the lower end portion of the new image area Q1 as shown in the screen data Z3 of FIG. 5. In this respect, FIG. It is different from the slide-in shown. In this modification, the application 3 also outputs a writing notification to the drawing control unit 26 when the writing of the screen data for the entire screen is completed, as with the application 1.

Subsequently, as shown in FIG. 15, rewriting from the current screen data Z3b to the next screen data Z6b is started, and when rewriting of the screen data Z6b to the third buffer 33 is completed, a writing notification is again sent to the drawing control unit. 26. The rewriting of the screen data for one entire screen by the application 3 is repeatedly executed until the screen switching is completed.
While the writing of the screen data by the application 1 to the first buffer 31 and the writing of the screen data by the application 3 to the third buffer 33 are performed in parallel, the screen data Z1b by the application 1 is stored in the intermediate buffer 34. After the screen data Z3b is written by the application 3, the screen data Z1b and Z3b are combined and the combined screen data Z4b is stored in the VRAM 35 as in the above embodiment. .

Thereafter, the composite screen data obtained by combining the screen data written by the applications 1 and 3 written up to the same coordinate position in the VRAM 35 may be repeatedly executed until the screen switching ends. This is the same as the embodiment.
In the case of using this slide-in and slide-out, each of the apps 1 to 3 outputs a writing notification indicating the writing to the drawing control unit 26 on the condition that the screen data for one whole screen has been rewritten. In step S3 of 11, the predetermined amount H is preset to a writing amount corresponding to the entire screen.

In the slide-in, for example, as shown in the screen data Z3b (FIG. 15) by the application 3, there is no need to rewrite the original image area Q1a. Therefore, every time the writing to the new image area Q1b is completed, It is also possible to take a configuration for outputting a notification.
In the case of adopting this configuration, if the application 3 is faster than the application 1 to write a predetermined amount of screen data, the intermediate buffer 34 stores the screen data by the application 3.

  In addition, the present invention can be similarly applied to screen switching control other than wipe-in and slide-in. That is, a new second image is displayed on the display 9 while gradually erasing the first image from a part of the first image. The present invention can be applied to general control for switching screens so that images appear gradually. Further, the moving direction of the image by wipe-in or the like is not limited to the direction from the bottom to the top on the display 9 as described above, and takes one direction such as the direction from the top to the bottom and from the bottom right corner to the top left corner. Can do.

  (10) In the above embodiment, an example in which the image processing apparatus according to the present invention is applied to an MFP has been described. However, the present invention is not limited to this. Any image processing apparatus including an operation unit 13 such as an operation panel having a display 9 can be applied to, for example, a copying machine, a printer, a scanner, and a facsimile apparatus. In addition, a configuration in which the processing of the above-described embodiment or the like is performed by software may be performed, or a configuration in which a hardware circuit is used.

  Further, the contents of the above embodiment and the above modifications may be combined as much as possible.

  The present invention can be widely applied to an image processing apparatus having a function of switching a screen displayed on a display.

DESCRIPTION OF SYMBOLS 1 1st application 2 2nd application 3 3rd application 9 Display 10 Image processing apparatus 13 Operation part 14 Control part 26 Drawing control part 27 Display control part 31 1st buffer 32 2nd buffer 33 3rd buffer 34 Intermediate buffer 35 VRAM
41, 42, Z1a, Z3a Screen 51 Intermediate processing section 52 Data composition section 81, 82, P1a, Q1, Q1a, Q1b, Q2 Image area P1, P2, P3 Transparent area (image area)
Z0, Z1, Z2, Z3, Z5, Z6, Z8, Z9, Z1b, Z3b, Z5b Screen data Z4, Z7, Z10, Z4b Composite screen data Z4a Composite screen

Claims (11)

On the display provided in the operation unit that receives input from the user, the screen is switched so that a new second image appears gradually while gradually erasing the first image from a part of the first image. An image processing apparatus,
A first storage unit, a second storage unit, an intermediate storage unit,
A first application for writing screen data for gradually erasing the first image into the first storage unit;
A second application for writing screen data for gradually appearing the second image in the second storage unit;
Each time a predetermined amount of data is written in the middle of writing to the storage unit by the faster application of the screen data among the first and second applications, the written first screen data is added to the intermediate data. An intermediate processing unit to be stored in the storage unit;
When the amount of the second screen data written by the slower application reaches the predetermined amount during the writing of the screen data to the storage unit by the slower application , the second screen data is written as the second screen data. corresponding to the amount that, with the said stored in the intermediate storage unit the first screen data synthesizing section for synthesizing the second screen data,
Each time the screen data is combined by the combining unit, a display control unit that sends the combined screen data to the display and displays the image on the display;
An image processing apparatus comprising: Each time the first application and the second application write a predetermined amount of data, they output a write notification indicating that,
The intermediate processing unit
Of the first application and the second application, the application that output the write notification first is the faster application,
The synthesis unit is
2. The image processing apparatus according to claim 1, wherein, among the first application and the second application, an application that outputs the writing notification later than the faster application is set as the slower application. The predetermined amount of data is:
The difference between the first application and the second application is the same value or less than the predetermined amount, or a different value less than or equal to the predetermined amount and one is a multiple of the other. The image processing apparatus described. The intermediate processing unit
Based on the writing notification from the faster application and the past writing notification before this, out of the screen data stored in the intermediate storage unit, the screen data written in the storage unit by the application 4. The image processing apparatus according to claim 2, wherein the screen data written in the storage unit is stored in the intermediate storage unit by rewriting only the data corresponding to the difference between the two. .   The image processing apparatus according to claim 1, wherein the predetermined amount of data is data in a band unit indicating a predetermined amount of data. The first application is
In the screen displayed on the display, the screen data is gradually written to the first storage unit so that the transparent area gradually expands from one end of the first image to the other end in a predetermined direction.
The second application is
The screen data is gradually stored in the second storage unit so that the second image gradually enters the frame from the outside of the screen in the same direction as the predetermined direction in the screen displayed on the display. writing,
The synthesis unit is
Each screen data is generated such that an image represented by the screen data by the first application is at the top, and an image represented by the screen data by the second application is overlapped thereunder to generate one screen. 6. The image processing apparatus according to claim 1, wherein the image processing apparatus is synthesized. The screen may be switched so that a fourth image different from the second image gradually appears while a third image different from the first image is gradually erased from a part to the whole. Is possible,
The first application is
Screen data for gradually erasing the third image can be written to the first storage unit,
The second application is
Screen data for gradually appearing the fourth image can be written to the second storage unit,
The predetermined amount H applied to each screen data for the first image and the second image is different from the predetermined amount H1 applied to each screen data for the third image and the fourth image. The image processing apparatus according to any one of claims 1 to 6.   The third image and the fourth image have a smaller display area on the display than the first image and the second image, and the predetermined amount H1 is larger than the predetermined amount H. 8. The image processing apparatus according to 7. Each of the first application and the second application outputs a writing start notification including a writing range at the start of writing screen data,
The synthesis unit is
When it is determined that the first image and the second image are different in size based on the writing range included in the output writing start notification and the smaller image fits in the larger image, The image processing apparatus according to any one of claims 1 to 8, wherein the respective screen data are combined so as to overlap each other at a position based on a writing range. Each of the first application and the second application outputs a writing start notification including a writing range at the start of writing screen data,
The intermediate processing unit
Based on the writing range included in the output writing start notification, it is determined whether or not the first image and the second image overlap. If it is determined that they do not overlap, the intermediate storage of the screen data is performed. Prohibits storage in the department,
The synthesis unit is
When the storage of the screen data in the intermediate storage unit is prohibited, the composition is prohibited, and instead, the screen data written in the first storage unit by the first application, and the second 10. The image processing apparatus according to claim 1, wherein the image data written in the second storage unit by an application is synthesized at a predetermined period. The synthesis unit is
The first screen data having the same coordinate position as the coordinate position indicating the range written as the second screen data and stored in the intermediate storage unit, and the second screen data are combined. The image processing apparatus according to claim 1, wherein:

Images