JP4854486B2 - Image display device, image display method, and image display program - Google Patents

Description

  The present invention relates to an image display device, an image display method, and an image display program for switching and displaying a plurality of still images subjected to effect processing.

  In recent years, a slide show function that can automatically switch and display a plurality of recorded still images at predetermined time intervals in devices capable of capturing and recording still images such as digital still cameras and mobile phone terminals. The things we have are increasing. In this case, you can not only simply display multiple still images one after another, but also add a visual effect by synthesizing decorative images etc. to the still images, or make the still images appear to move on the display screen Etc. may be given. As a method for giving motion to a still image, a part of a region is cut out using a single still image as a material, and the region is moved from right to left, top to bottom, etc. A method of displaying on a screen is known. By performing such processing, it is possible to make the base still image relatively appear to move on the display screen. Such a visual effect added to an image is called an effect.

  In addition to the above-described effect that moves a single still image, there is an effect that is used when switching the display of different still images. Examples of such effects include the fade effect that gradually changes the currently displayed image to another image, and the wipe effect that switches the currently displayed image while wiping to another image. It has been. By using these effect processes when switching the display of different still images, various types of still images recorded on a storage medium or the like can be continuously displayed without a sense of incongruity.

Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique that allows a still image recorded by a digital camera or the like to be viewed as a moving photo movie.
JP 2006-229467 A

  By the way, when effect processing is performed on each still image displayed using the slide show function, the still image display switching can be performed when the displayed image is still, that is, when no effect is applied. Applying effects was done. For this reason, at the timing of switching to a different still image, the effect that caused movement to the image before switching is stopped, and the displayed image stops moving only during the switching time. There was a problem of being visible.

  In addition, when an effect is applied and the image is changing, to switch to a new still image using a new effect, it is necessary to know where the previous image has moved relative to the original image. It is necessary to keep it. For example, as illustrated in FIG. 7, a still image is used as a material, a part of the area is cut out as a frame f1 (fine broken line), and the position is frame f2 (a slightly rough broken line), frame f3 ( It is assumed that there is an effect that the face mark appears to move from the left to the right on the screen displayed on the display unit by moving it as an alternate long and short dash line). . In order to switch to the next still image while the image of the frame f3 indicated by the bold line is displayed on the screen, the image of the currently displayed frame f3, one frame generated from the new still image, To create a new effect. At this time, the image size of the frame f3 and the position of the reference pixel (for example, any one of the coordinates of the four corners of the frame) are required.

  However, in general, the display switching timing from the currently displayed image to the image generated based on the next still image is often the timing at which the decoding processing of the next still image is completed. The length of the processing time varies depending on the data amount of the still image and the processing status of the image processing at that time. Therefore, the position of the currently displayed frame in the still image that is the original material changes each time depending on the length of the decoding process of the next image, and it can be said that the prediction is very difficult.

  If the coordinate position in the original still image of the currently displayed frame can be grasped in real time at the timing when the decoding process of the next still image is completed, switching to the next image can be performed using the coordinate information. It becomes possible. However, if this is realized, there is a problem that the processing becomes complicated.

  The present invention has been made in view of such a point, and an object of the present invention is to smoothly switch images to which an effect has been applied without stopping movement by simple processing.

In the present invention, when a plurality of encoded image data are sequentially read out and decoded, and the decoded image data is displayed as an image, the first storage unit stores the decoded image data in the order of decoding. To remember. Then, the image data stored in the first storage unit is read out, and predetermined effect processing is performed on the read-out image data to generate effect image data composed of a plurality of frames. Also, the effect image data is stored in the second storage unit in the order based on the effect processing, and the effect image stored in the second storage unit when the decoded image data is input to the first storage unit. The last frame of the data is stored in the third storage unit. Further, new effect image data is generated using the effect image data generated from the image data newly stored in the first storage unit and the last one frame of image data stored in the third storage unit. To be displayed.

With this configuration, when the image data decoded by the decoding processing unit is output to the first storage unit, that is, when the decoding processing of the next image data is completed, the third storage unit The effect image data is newly generated using one frame of the stored effect image data and the effect image data generated from the new image data, and is displayed on the display unit.

In this case, since one frame stored in the third storage unit is effect image data and an effect effect has already been added, a plurality of effects are applied to newly generated effect image data. A visual effect is created.
In addition, since the new image data is subjected to the effect processing and synthesized with one frame stored in the third storage unit to generate new effect image data, even in a stage where different still images are switched, The movement in the displayed image is not stopped and smooth switching can be realized.

  According to the present invention, images to which an effect has been applied can be switched smoothly by simple processing without stopping the movement.

  Hereinafter, an embodiment of the present invention will be described with reference to FIGS. In the present embodiment, the image display device of the present invention is applied to a mobile phone terminal capable of capturing and recording a still image.

  First, an internal configuration example of the mobile phone terminal 1 will be described with reference to FIG. The mobile terminal device 1 includes a communication unit 13 connected to an antenna 11, and transmits and receives a transmission signal and a reception signal with a mobile phone base station (not shown) via the antenna 11 under the control of the control unit 12. I do. The communication unit 13 modulates and demodulates radio waves exchanged with the mobile phone base station. For example, a W-CDMA (Wideband Code Division Multiple Access) method or the like is used as a wireless communication method for reception and transmission by the communication unit 13, but is not limited thereto.

  The mobile phone terminal 1 includes a display unit 14 configured with a liquid crystal display (LCD) and an operation unit 15 configured with a jog dial, a keypad, and the like. The operation unit 15 can input an input operation signal such as an input operation such as a telephone number or an e-mail message, or a setting operation of various modes.

  In addition, the mobile phone terminal 1 includes an imaging unit 16 including a lens, an imaging element, and the like (not shown). In the imaging device, an optical image obtained through the lens is photoelectrically converted into an imaging signal, and the imaging signal is supplied to an analog / digital conversion unit (not shown) in the imaging unit 16. The imaging signal converted into a digital signal by the analog / digital conversion unit is supplied to an image signal processing unit (not shown), subjected to image processing and encoding processing by the image signal processing unit, and then a storage unit 17 to be described later. Or recorded on an external storage medium connected via the external storage medium I / F unit 18.

  The control unit 12 includes an arithmetic control device (processor) such as a CPU (Central Processing Unit), for example, and in accordance with each computer program recorded in a ROM (Read Only Memory) (not shown), a RAM (Random Access Memory) (not shown). Is used as a work area for various processes, and a predetermined process is executed.

  In addition, the mobile phone device 1 includes a storage unit 17. The storage unit 17 includes a non-volatile memory such as a flash memory (semiconductor memory), and stores various data and computer programs such as a phone book, schedule, mail message, image, music, application software, bookmark, and web page. Storage device.

  Further, the cellular phone device 1 includes an external storage medium I / F unit 18 as an interface unit to which an external storage medium such as a USB (Universal Serial Bus) memory or a memory card such as a memory stick is connected. Then, an external storage medium connected to the external storage medium I / F unit 18, a decoding processing unit 22 that reads and decodes (decodes) encoded data stored in the storage unit 17, and a decoding processing unit 22 An effect processing unit 23 that performs effect processing on the decoded image data is also provided.

  The effect processing unit 23 generates effect image data composed of a plurality of frames based on one still image, and transmits the effect image data to the display buffer unit 25 described later. When the generated effect image data is composed of n frames, frames 1 to n are sequentially output to the display unit 14 via the display buffer unit 25 and displayed on the display unit 14. In addition, in order to be able to control the timing of applying an effect to a still image and the timing of switching between different still images, an effect buffer unit 24 (first storage unit) for temporarily storing image data is displayed. A buffer unit 25 (second storage unit) is provided. The effect buffer unit 24 is a buffer used for controlling the timing of applying the effect, and the display buffer unit 25 is a buffer used for controlling the display timing of the effect image data after effect processing. .

  In the present invention, the last frame of the effect image data to be switched is used so that different images with different effects can be smoothly switched and displayed, and the last frame is stored. The last frame buffer unit 26 (third storage unit) is provided. Details of the processing of the effect processing unit 23 and each buffer unit will be described later.

  A signal for controlling each unit described above is transmitted on the control line 31 which is a signal line. Data exchanged between the respective units is transmitted on the data line 32. In addition, about a power supply, it shall be supplied to each part from the power supply part which is not shown in figure.

  Here, a reception system at the time of a voice call will be described. The control unit 12 extracts a packet from the reception signal received and demodulated by the communication unit 13, extracts voice data, control data, and the like from the packet, and supplies the extracted voice data to the voice processing unit 21. The audio processing unit 21 performs predetermined audio processing such as conversion from digital audio data to an analog audio signal, amplification, and the like, and converts the electrical signal into audio by the speaker 19 and outputs it.

  On the other hand, a transmission system during a voice call will be described. The sound processing unit 21 collects sound with the microphone 20 and converts it into an electric signal to obtain an analog sound signal. Then, the captured analog audio signal is converted into digital audio data and supplied to the communication unit 13. The communication unit 13 generates a packet by adding control information such as a transmission destination address to the voice data, performs predetermined modulation processing on the generated packet, converts the frequency into a transmission signal of a predetermined transmission frequency, The converted transmission signal is wirelessly transmitted from the antenna 11.

  Note that BGM or the like may be played when an image to which an effect is applied is displayed on the display unit 14. In this case, audio data stored in the storage unit 17 or the like is read and supplied to the audio processing unit 21. The sound may be emitted through the speaker 19.

  Next, details of processing in the effect processing unit 23, the effect buffer unit 24, the display buffer unit 25, and the last frame buffer unit 26 will be described with reference to FIG. First, the decoding processing unit 22 reads out image data recorded on an external storage medium connected via the storage unit 17 or the external storage medium I / F unit 18 and performs decoding processing. The data is output to the effect buffer unit 24.

  The effect buffer unit 24 is configured by a FIFO (First In First Out) memory including a plurality of buffers, and stores the image data input from the decoding processing unit 22 in the input order. The image data stored in the effect buffer unit 24 is moved from the buffer Ebn to the buffer Eb1 so as to be pushed out every time the next image data is input, and sequentially from the oldest image data stored in the buffer Eb1. , Read to the effect processing unit 23.

  The effect processing unit 23 cuts out a part of the image data read from the effect buffer unit 24 and performs effect processing such as moving the region from right to left, top to bottom, etc. Effect image data composed of a plurality of frames is generated. 3 and 4 show examples of effect image data to which the effect processing unit 23 has applied the effect processing. In the example of FIG. 3, an effect process is performed in which the cat moves from the right side (a) of the screen to the center (b) and the left side (c). In the example of FIG. Effect processing that gradually moves in the order of (a), (b), and (c) is performed.

  If the display on the display unit 14 is performed in the order of the still image of the cat shown in FIG. 3 and the still image of the airplane shown in FIG. 4, the effect processing unit 23 performs an effect based on the still image of the cat shown in FIG. The image data generation process is continuously performed until the still image of the airplane in FIG. 4 is decoded by the decoding processing unit 22 and output to the effect buffer unit 24. Therefore, the number of frames of effect image data generated based on one still image increases or decreases depending on the time during which the next still image is decoded by the decoding processing unit 22.

  Returning to FIG. 2 again, the description is continued. The effect image data generated by the effect processing unit 23 is stored in the display buffer unit 25 in the order of generation. The display buffer unit 25 is also composed of a FIFO memory, and the effect image data stored in the display buffer unit 25 sequentially moves from the buffer Dbn to the buffer Db1. Then, the frame stored in the buffer Db1 is read out and displayed on the display unit 14.

  However, when the effect processing unit 23 detects that the new image data decoded by the decoding processing unit 22 is output to the effect buffer unit 24, the display buffer unit 25 controls the effect processing unit 23. The oldest frame stored in the buffer Db1 is stored in the last frame buffer unit 26.

  Then, the effect processing unit 23 newly generates the effect image data using one frame generated from the image data newly stored in the effect buffer unit 24 and one frame stored in the last frame buffer unit 26. Generate. The effect image data generated by combining different image data is also output to the display buffer unit 25 in the order of generation, and is displayed on the display unit 14 in order from the frame stored in the buffer Db1.

  Next, referring to FIG. 5 and FIG. 6, the decoding processing by the decoding processing unit 22, the image data storage processing to the effect buffer unit 24, and the effect image data output processing from the effect processing unit 23 to the display unit 14. The temporal relationship with will be explained.

  In FIG. 5, three still images are switched among a plurality of still images recorded on an external storage medium connected via the storage unit 17 or the external storage medium I / F unit 18 (see FIG. 1). In this example, A, B, and C are assigned to three still images. And processing in each part shall be performed in order of A, B, and C. First, when the decoding of the image data A is completed by the decoding processing unit 22, the decoded data is input to the effect buffer unit 24, and after the effect processing is added by the effect processing unit 23, the display buffer unit 25 (FIG. 1). The output from the display buffer unit 25 to the display unit 14 is performed frame by frame in the order in which the effect image data is stored. In FIG. 5, the reference numerals A1, A2, and A3 are assigned to the frames of the effect image data output to the display unit 14 in the order of output. A in A1 means a still image A, and 1 indicates a frame number. The symbols f1 to fn are assigned to a plurality of frames output from the display buffer unit 25 to the display unit 14.

  If the image data A in FIG. 5 is the cat image data shown in FIG. 3 and the image data B is the airplane image data shown in FIG. 4, the code processing unit 22 decodes the image data B (airplane). During this period, the effect image data is continuously generated by the effect processing unit 23 based on the image data A (cat). That is, until the timing when “B decoding complete” is displayed in FIG. 5, effect processing is performed in which the cat of the image data A is repeatedly displayed while moving from the right side to the left side of the screen.

  For example, the cat of the image data A is moved from the right position as shown in FIG. 3A to the middle position as shown in FIG. 3B, as shown in FIG. 3C. Assume that the unit is a unit of effect until it moves to the left position. In this case, until the decoding process of the image B, which is image data to be displayed next, is completed, the effect processing unit 23 causes the effect processing unit 23 to display (a) → (b) → (c) → (a) → (b The effect image data continues to be generated in the order of), and is stored in the display buffer unit 25 in the order of generation.

  The frame input to the display buffer unit is pushed by a frame input later, and the storage position is changed to buffer Dbn, buffer Dbn-1, and buffer Db1, and the frames stored in buffer Db1 are sequentially started. 3 (a) is a frame A1, FIG. 3 (b) is a frame A2, and FIG. 3 (c) (frame A3) → FIG. 3 (a) (frame A4) → FIG. 3 (b) (frame). A5) are displayed in this order.

  In FIG. 5, since the decoding of B is completed when the frame A15 is displayed and the B image data is stored in the effect buffer unit 24, the frame A15 is used as the last frame of the image data A as the last frame buffer unit 26 ( (See FIG. 1). That is, the frame A15 is the last (latest) frame of the image data A that has already been subjected to the effect processing when the decoding processing of the image data B to be displayed next is completed. In the present invention, this frame is stored in the last frame buffer unit 26 for the purpose of using it as a material for effect processing to be performed next. Then, the effect processing unit 23 synthesizes the frame stored in the last frame buffer unit 26 and one frame generated from the image data to be displayed next, and newly generates effect image data.

  FIG. 6 shows an example of a display image on the display unit 14 at each stage where the image A and the image B are combined. In FIG. 6, an effect is used in which a trapezoidal window frame moves from the bottom of the screen to the top. This effect is an effect in which the image displayed in the window frame and the image displayed in the other area are interchanged while gradually changing the blend ratio. By combining the image A and the image B using this effect, the old image A is gradually switched to the new image B. Further, in FIGS. 6C to 6D, the image data A before switching is obtained by diverting the image of the last frame A15. However, in the image data B, as illustrated in FIG. It uses frames with effect processing that make the plane appear to move from bottom to top. FIG. 6A shows a state in which the effect processing is performed on the image data A alone. When the next frame, FIG. 6B, is displayed, the next image data is displayed. Assume that decoding of a certain B is completed. When applied to the example of FIG. 5, FIG. 6A is a frame A14 (f14), and FIG. 6B is a frame A15 (f15). In FIG. 6, the same reference numerals are assigned to the elements corresponding to the frame shown in FIG.

  In FIG. 5, the frame A15 which is the last frame is output to the last frame buffer unit 26 and read by the effect processing unit 23. Then, it is combined with B1 that is the first frame of the image data B that has been newly decoded by the effect processing unit 23 to obtain new effect image data (frame f16). The display image at this time is as shown in FIG. In FIG. 6C, the frame A15 generated from the new image data B is displayed on the lower part of the screen of the frame A15 shown in FIG. 6B as a trapezoidal window frame. It is displayed in the form of dividing.

  FIG. 6D is a diagram showing an example of the effect at a time point later in time than the time point shown in FIG. In FIG. 6D, it can be seen that the ratio of the image data B (airplane) is increased as compared with the image data A (cat) as the ratio displayed on the screen. The cat image displayed at the time of FIG. 6D is an image of the frame A15, and the image of the airplane is that of the frame B5. In FIG. 6E, it can be seen that the display is switched to completely new image data B.

  In this way, by using the effect of switching the display of different images, the rate at which the image A before switching is displayed is gradually reduced, and the rate at which the new image B is displayed is increased, thereby allowing the new and old different image data to be displayed. However, it will switch smoothly visually.

  That is, in each frame shown in FIGS. 6C to 6E, the position of the airplane in the image data B is gradually moving from the bottom to the top, and the stage of switching from the old image to the new image (FIG. 6). 6 (c) and (d)), the displayed image does not stop moving and is expressed with movement.

  Returning to FIG. 5 again, the description will be continued. In the portion displayed as “output from the display buffer unit”, frames B1 to B5 generated by effect processing on the new image data B, and before switching Frames f16 to f20 are configured using A15 which is the last frame of the image data A. It can be seen that the rate at which the last frame A15 is displayed gradually decreases as the frame advances, and the rate at which the frame generated based on the new image data B is displayed is increased.

  It is assumed that the time required for switching between different still images (in the example of FIG. 5, the time during which frames f16 to f20 or frames f41 to f45 are displayed) varies depending on the type of effect.

  In the frame f21, after the display is completely switched to the image data B, the effect processing unit 23 continuously effects the image data B until the next image data C is decoded. Is done. When the frame B25, which is a frame generated from the image data B, is output to the display unit 14, the decoding process in the decoding processing unit 22 is completed, and thus the frame B25 is output to the last frame buffer 26 this time. Then, using the last frame B25 and the frame C1 generated from the new image data C, a frame f41 that is new effect image data is generated and output to the display unit 14. Thereafter, processing similar to that described as switching processing between the image data A and the image data B is performed.

  In this manner, the oldest frame stored in the display buffer unit 25 is stored in the last frame buffer unit 26 at the timing when the decoding processing of the image data to be displayed next to the currently displayed image data is completed. . This oldest frame is the last frame of the currently displayed image data. Then, new effect image data is generated using the frame of the original image stored in the last frame buffer unit 26 and the effect image data (frame) generated from the newly decoded next image. Thus, the display between different still images can be easily switched without worrying about the coordinate position in the original still image of the currently displayed frame.

  Further, since the frame stored in the last frame buffer unit 26 is a frame subjected to the effect processing by the effect processing unit 23, the frame generated from the last frame stored in the last frame buffer unit 26 and new image data. In the effect image data generated by the frame, it is possible to give a visual effect that a plurality of effects are applied simultaneously.

  In addition, new image data is subjected to effect processing and then combined with the last frame to generate new effect image data, so that the movement in the displayed image stops even when different still images are switched. This eliminates the possibility of smooth switching.

  In the embodiment described so far, as an effect that gives a motion to a still image, an effect that gives an effect of moving an image from the right to the left and the bottom to the top of the screen is taken as an example, and an effect that switches between different images As an example, the effect of moving the trapezoidal window frame from the bottom to the top was taken as an example, but it is not limited to these effects, and the effect of distorting and displaying a part of the image or gradually changing the gradation on the screen The present invention can be applied to various other effects such as an effect to be performed, an effect of zooming in or out of the entire image, and an effect of scrolling.

  Further, the series of processes in the above-described embodiment can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, it is possible to execute various functions by installing programs that make up the software into a computer built into dedicated hardware, or by installing various programs. For example, a general-purpose personal computer or the like installs and executes a program constituting desired software.

  In addition, a recording medium in which a program code of software that realizes the functions of the above-described exemplary embodiments is supplied to a system or apparatus, and a computer (or a control device such as a CPU) of the system or apparatus is stored in the recording medium. Needless to say, this can also be achieved by reading and executing the program code.

  Further, by executing the program code read by the computer, not only the functions of the above-described exemplary embodiments are realized, but also the OS running on the computer based on the instruction of the program code performs actual processing. In some cases, the functions of the above-described exemplary embodiments are realized by performing part or all of the above.

  Furthermore, in the above-described embodiment, an example applied to a mobile phone terminal is given. However, if the device includes a decoding processing unit that decodes encoded image data and a display unit that displays image data, It can be applied to various other devices.

It is a block diagram which shows the structural example of the mobile telephone terminal by one embodiment of this invention. It is explanatory drawing which shows the structural example of each part concerning the decoding to display of an image by one embodiment of this invention. It is explanatory drawing which shows the example of an effect process by one embodiment of this invention. It is explanatory drawing which shows the example of an effect process by one embodiment of this invention. It is explanatory drawing which shows the process example from the decoding to display by one embodiment of this invention. It is explanatory drawing which shows the example of an effect process by one embodiment of this invention. It is explanatory drawing which shows the example of the conventional effect process.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Mobile phone terminal, 11 ... Antenna, 12 ... Control part, 13 ... Communication part, 14 ... Display part, 15 ... Operation part, 16 ... Imaging part, 17 ... Memory | storage part, 18 ... External storage medium I / F part, DESCRIPTION OF SYMBOLS 19 ... Speaker, 20 ... Microphone, 21 ... Audio processing part, 22 ... Decoding processing part, 23 ... Effect processing part, 24 ... Effect buffer part, 25 ... Display buffer part, 26 ... Last frame buffer part, 31 ... Control Line, 32 ... Data line

Claims (6)

In an image display device that includes a decoding processing unit that sequentially reads and decodes a plurality of encoded image data, and displays the image data decoded by the decoding processing unit on a display unit,
A first storage unit that stores a plurality of pieces of image data decoded by the decoding processing unit in the order of decoding;
An effect processing unit that reads out the image data stored in the first storage unit, performs predetermined effect processing on the read image data, and generates effect image data composed of a plurality of frames;
The effect image data generated by the effect processing unit is stored in order based on the effect processing, and a second storage unit that outputs to the display unit;
A third storage unit for storing the last frame of the effect image data stored in the second storage unit;
The effect processing unit includes the effect image data generated from the image data newly stored in the first storage unit and the last one frame of the effect image data stored in the third storage unit. used to generate a new effect image data, the image display device you output to the second storage unit. The third storage unit is the last of the effect image data stored in the second storage unit when the image data decoded by the decoding processing unit is input to the first storage unit. the image display apparatus according to claim 1 you storing one frame. The image display device according to claim 1,
The effect processing unit, for each of a plurality of image data said decoding, different effect processing line cormorants image display device. The image display device according to claim 1,
Wherein the first storage unit and the second storage unit, the image display device image data in first-in first-out scheme Ru is input. In an image display method for sequentially reading and decoding a plurality of encoded image data and displaying the decoded image data,
Storing the plurality of decoded image data in the first storage unit in the order of decoding;
Read the image data stored in the first storage unit, perform predetermined effect processing on the read image data, generate effect image data composed of a plurality of frames,
Storing the effect image data in the second storage unit in the order based on the effect processing;
When the decoded image data is input to the first storage unit, the last frame of the effect image data stored in the second storage unit is stored in a third storage unit,
New effect image data is generated using the effect image data generated from the image data newly stored in the first storage unit and the last one frame of image data stored in the third storage unit. image display how to display in. In an image display program for sequentially reading and decoding a plurality of encoded image data and causing a computer to execute a procedure for displaying the decoded image data,
Storing the plurality of decoded image data in the first storage unit in the order of decoding;
A procedure of reading image data stored in the first storage unit, performing predetermined effect processing on the read image data, and generating effect image data composed of a plurality of frames;
Storing the effect image data in the second storage unit in the order based on the effect processing;
A procedure for storing the last frame of the effect image data stored in the second storage unit in the third storage unit when the decoded image data is input to the first storage unit; ,
New effect image data is generated using the effect image data generated from the image data newly stored in the first storage unit and the last one frame of image data stored in the third storage unit. image display program that have a procedure and that to display.

Images