JP2010102267A - Image display device and portable terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display device largely reducing the processing loads when a displayed video is moved to an optional position or expanded on a display screen. <P>SOLUTION: This image display device displays a static image capturing a moving image displayed on a layer 206 for moving image on a layer 206 for moving. A multimedia engine 202 stops displaying of the moving image displayed on the layer 204 at the timing of capturing by a capturing part 214. A synthesis processing part 207 generates a synthesized image by overlapping the layer 204 for moving image, a layer 205 for background, and the layer 206 for moving, and thereby, the processing loads can be largely reduced. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image display device that can freely change the display position of a video on a display screen.

  2. Description of the Related Art An image display device that displays an image having a display area smaller than the display area of a display screen on a display screen displaying an arbitrary image so as to overlap the image is widely known. For example, there may be a case where a television image having a display area smaller than the display area of the application screen is displayed on the application screen being executed displayed on the monitor of the personal computer.

As described above, when the display area of the video is smaller than the display area of the display screen, generally, the display position and the display size of the video can be changed. For example, Patent Document 1 discloses a technique for moving an image being displayed on a screen to a desired position.
JP 2004-240553 (released September 9, 2004)

  By the way, when moving the image being displayed on the display screen to an arbitrary position, it is necessary to perform at least the following two processes simultaneously. That is, it is necessary to simultaneously perform a moving process for moving the video display position to an arbitrary display position and a display process for displaying the video. In order to perform these processes without stress, it is necessary to increase the memory capacity for temporarily storing the processing target data and to increase the performance of the CPU. In particular, when the video is a moving image, the processing load is increased.

  In general, when the processing load as described above increases, the problem can be solved by increasing the memory capacity and increasing the CPU performance, but the power consumption and heat generation increase with the performance of the CPU. To do. In the case of a stationary information processing device such as a personal computer, the problem of power consumption does not matter so much, and since the cooling device can be installed freely, the amount of heat generation does not matter so much, but a notebook computer, PDA (Personal In the case of a portable terminal device such as a digital assistant) or a cellular phone, it is not easy to improve the CPU performance. That is, in the case of a portable terminal device, if the power consumption is not reduced as much as possible, the driving time is shortened. Therefore, it is desirable to use a CPU that consumes as little power as possible. Thus, a CPU with low power consumption generally has a low processing capability and is not suitable for high-load processing such as moving a moving image as described above.

  The present invention has been made in view of the above problems, and its purpose is to greatly reduce the processing load when moving or enlarging an image being displayed on a display screen to an arbitrary position. Another object of the present invention is to provide an image display device that can perform the above.

  In order to solve the above problem, an image display device according to the present invention displays a composite image in which images displayed on a plurality of layers are superimposed, and a moving image display control unit that displays a moving image on a first layer. A background image display control means for displaying a background image on the second layer, a still image display control means for displaying a still image on the third layer, and a composition for generating a composite image by superimposing the images displayed on each layer A moving image in which the combined image generated by the image generating unit and the combined image generating unit is displayed on the first layer by the moving image display control unit; and a background image displayed on the second layer by the background image display control unit. And a still image capture unit for acquiring a still image from the moving image specified by the moving image specifying unit. The still image display control means causes the still image acquired by the still image acquisition means to be displayed on the third layer, and the moving image display control means performs still image acquisition by the still image acquisition means. The display of the moving image displayed on the first layer is stopped at the timing, and the composite image generating means adds the moving image displayed on the first layer and the background image displayed on the second layer to the first layer. It is characterized in that a composite image is generated by superimposing still images displayed in three layers.

  According to said structure, when the moving image currently displayed on the 1st layer for displaying a moving image is designated by the said moving image designation | designated means, a still image is acquired from the moving image designated by the said still image acquisition means, The still image display control unit displays the still image acquired by the still image acquisition unit on the third layer. The moving image display control unit stops displaying the moving image displayed on the first layer at the timing of the still image acquisition by the still image acquisition unit, and the composite image generation unit is displayed on the first layer. In addition to the moving image and the background image displayed on the second layer, the still image displayed on the third layer is superimposed to generate a composite image.

  As a result, since the still image corresponding to the moving image displayed on the first layer is displayed on the third layer, the synthesized image is moved or enlarged. Will be processed.

  Therefore, in the case of the above configuration, the moving process and the enlargement process of the target image (the moving image specified by the user) are only performed on the still image on the third layer. Compared with the case where the display position and enlargement processing are performed directly, the processing amount can be greatly reduced. That is, it is possible to greatly reduce the processing load when moving or enlarging the video being displayed on the display screen to an arbitrary position.

  For this reason, if the above configuration is used, a CPU with low processing power, low power consumption, and low heat generation can be used. Therefore, a portable terminal such as a mobile phone that requires low power consumption and low heat generation is required. There is an effect that it can be used effectively.

  The moving image display control means further includes movement enlargement control means for performing movement processing and enlargement processing on the still image displayed on the third layer by the still image display control means. When the end of the still image movement process and the enlargement process is detected, the display of the moving image displayed on the first layer is resumed at the movement position and the enlargement ratio processed for the still image. It is preferable to do this.

  According to the above configuration, when the moving image display control unit detects the end of the still image moving process and the enlarging process by the movement enlarging control unit, the moving position and the enlargement processed for the still image are detected. By resuming the display of the moving image displayed on the first layer at a rate, the moving image initially displayed on the first layer can be moved to a desired position and displayed at a desired magnification. it can.

  When at least two different moving images are displayed on the first layer, the moving image specifying means moves the specified moving image with a small processing amount by specifying one moving image from the displayed composite image. It becomes possible to enlarge.

  The movement enlargement control means may perform a translucent process on the still image displayed on the third layer.

  In this case, since the still image to be subjected to the movement enlargement process is translucent, the user can grasp the background image overlapping the still image.

  As a result, the still image enlarged at the desired enlargement ratio can be accurately arranged at the desired position, so that the operability by the user can be improved.

  A display unit configured to display the composite image; and a touch panel stacked on the display surface so as to correspond to the display surface of the display unit. The moving image specifying unit outputs the touch panel when the touch panel is touched. The coordinate information indicating the display position of the moving image displayed on the display means may be obtained from the detected signal, and the moving image may be designated by this coordinate information.

  According to said structure, since a touch panel can be used as a moving image designation | designated means, the user can perform the process of designation | designated, movement, expansion, etc. with respect to the desired moving image sensuously.

  As described above, the image display device having the above configuration is suitable for a portable terminal because it suppresses the processing amount and the heat generation amount.

  An image display device according to the present invention includes a moving image display control unit that displays a moving image on a first layer and a background image on a second layer. Background image display control means for displaying; still image display control means for displaying a still image on the third layer; composite image generation means for generating a composite image by superimposing images displayed on each layer; and When the composite image generated by the means is a composite image in which the moving image displayed on the first layer by the moving image display control means and the background image displayed on the second layer by the background image display control means are superimposed. A moving image designating unit for designating a moving image from the displayed synthesized image, a still image obtaining unit for obtaining a still image from the moving image designated by the moving image designating unit, and the synthesized image. Display means, wherein the moving picture display control means displays one of the two different moving pictures displayed on the first layer by the moving picture designating means. When it is detected that a moving image is designated, the display position of the moving image is switched and displayed.

  According to said structure, when the said moving image display control means displays two different moving images on the said 1st layer, either one displayed on the said 1st layer by the said moving image designation | designated means When it is detected that the moving image is designated, the display position of the moving image can be easily switched by switching the display position of the moving image.

  A display unit configured to display the composite image; and a touch panel laminated on the display surface so as to correspond to the display surface of the display unit. The moving image display control unit includes: When the coordinate information indicating the display position of the moving image displayed on the display means is obtained from the detection signal output by touching the touch panel, and the moving image is specified by this coordinate information, the specified moving image is specified. You may make it replace the display position with the moving image which is not done.

  In this case, the user can easily change the display position of the moving image by simply touching the touch panel.

  As described above, the image display device according to the present invention includes a moving image display control unit that displays a moving image on the first layer in the image display device that displays a composite image in which images displayed on a plurality of layers are superimposed. Background image display control means for displaying a background image on two layers, still image display control means for displaying a still image on the third layer, and composite image generation means for generating a composite image by superimposing images displayed on each layer And the composite image generated by the composite image generation unit overlaps the moving image displayed on the first layer by the moving image display control unit and the background image displayed on the second layer by the background image display control unit. A moving image specifying means for specifying a moving image from the displayed combined image and a still image acquiring means for acquiring a still image from the moving image specified by the moving image specifying means. The still image display control means causes the still image acquired by the still image acquisition means to be displayed on the third layer, and the moving image display control means performs the first operation at the timing of the still image acquisition by the still image acquisition means. The display of the moving image displayed on the layer is stopped, and the composite image generating means displays the third layer in addition to the moving image displayed on the first layer and the background image displayed on the second layer. The effect that the processing load when moving or enlarging the image being displayed on the display screen to an arbitrary position can be greatly reduced by generating a composite image by superimposing the still images Play.

  In general, a layer is a position information storage unit that stores position information indicating at which position an image displayed on the layer is to be combined, and a half that indicates whether the image displayed on the layer is to be combined as semi-transparent. It consists of a semi-transparent information storage unit for storing transparent information and a frame buffer for storing actual image data.

  Rewriting the image data in the frame buffer requires a large amount of processing. However, when only moving the still image displayed on the layer, it is only necessary to rewrite the position information.

  Therefore, as described above, in the first layer for displaying a moving image, it is necessary to frequently rewrite the image data in the frame buffer, so the processing amount increases, but the third layer for displaying a still image is displayed. Since the layer only needs to rewrite the position information in the position information storage unit, the processing amount is smaller than the processing amount in the first layer.

  An embodiment of the present invention will be described as follows. Note that in this embodiment, an example in which an image display device is mounted on a mobile phone will be described.

  FIGS. 4A and 4B are views showing an overview of the mobile phone 1 including the image display device having the above-described configuration.

  As shown in FIGS. 4A and 4B, the mobile phone 1 is a slide-type mobile phone in which a first housing 10 and a second housing 20 are provided so as to be slidable in the direction of an arrow XY. . The mobile phone 1 is assumed to be equipped with various multimedia functions such as a one-segment receiving function, a moving picture reproducing function, a music reproducing function, and a videophone function in addition to a normal telephone function and a mail transmission / reception function.

  Here, in the mobile phone 1, the state shown in FIG. 4A, that is, the state in which the first housing 10 and the second housing 20 are completely overlapped is defined as the first state, and FIG. As shown, a state in which the first housing 10 and the second housing 20 are slid and moved is referred to as a second state.

  For example, when the telephone function and the mail transmission / reception function of the mobile phone 1 are used, the first state shown in FIG. 4A is a standby state, and the second state shown in FIG. 4B is a call (mail operation). It becomes a state. Further, when using a multimedia function such as a one-segment reception function, it is mainly used in the first state shown in FIG.

  The first housing 10 constitutes a main body that is a mobile phone main body, and as shown in FIG. 4B, the exposed surface when the first housing 10 slides relative to the second housing 20. Is the operation surface 10a.

  On the operation surface 10a, operation key groups necessary for realizing the functions of the mobile phone 1 such as a telephone function and a mail transmission / reception function are arranged. These operation key groups function as an input interface.

  The second casing 20 constitutes an image display unit that displays information (telephone number, moving image, still image, one-segment video, etc.) that can be displayed on the mobile phone 1, and further includes a second casing. The 20 display surfaces 20a constitute an operation surface using a touch panel on which a user can directly perform various operations by touching with a finger or the like.

  As described above, the mobile phone 1 employs a touch panel on the display surface 20 a of the second housing 20 as an input interface other than the operation key group disposed on the operation surface 10 a of the first housing 10. Thereby, the user can operate the mobile phone 1 even in the first state shown in FIG. When the display surface 20a of the second housing 20 is used as an operation surface, the second housing 20 is completely overlapped with the first housing 10 mainly as shown in FIG. Although used in a state, it is not limited to this.

  In the following, a display example when the mobile phone 1 uses the videophone function will be described. Here, in the videophone function, two display modes, a normal display mode and a movement enlargement display mode, can be executed.

  In general, in a videophone, the other party's video is displayed on the display screen, and further, his own video for confirming what kind of video is displayed on the other party is also displayed on the display screen. On the premise of such a case, the normal display mode is a mode in which the size and display position of a videophone video (video of yourself and the other party) are set in advance. The moving enlargement display mode is a unique mode of the present invention. The user designates one of two currently displayed videos (the partner video and the self video) and makes a desired one on the display screen. In this mode, the display is moved to a position and displayed in a desired size.

  Hereinafter, these two display modes will be described.

  Before describing the above display modes, how the image display device mounted on the second housing 20 displays in the mobile phone 1 according to the present embodiment will be briefly described. The image display device is configured to perform multi-layer display in which images displayed on a plurality of layers are combined and displayed. In the present embodiment, it is assumed that images displayed in three layers of a moving image layer, a background layer, and a moving layer are combined.

  Based on this point, the above two display modes will be described.

  Here, in the present embodiment, in the videophone function, as shown in FIG. 4A and FIG. 5A, layer-0 (moving layer), layer-1 (moving layer), layer-3 It is assumed that three image layers (background layer) are used.

  FIGS. 5A and 5B are diagrams illustrating layer composition in the normal display mode of the videophone function.

  In the normal display mode, as shown in FIG. 5A, the first video 31 (self video) and the second video 32 (other video) are displayed on layer-0, and nothing is displayed on layer-1. Instead, the background image 33 is displayed on the layer-3, and these layers are combined and displayed on the display surface 20a of the second casing 20 of the mobile phone 1 as a composite image 34 shown in FIG. Is done. In the normal display mode, the images are combined in the order of layer-3, layer-1, and layer-0.

  FIGS. 6A and 6B are diagrams for explaining layer composition in the moving enlargement display mode of the videophone function.

  In the movement enlargement display mode, as shown in FIG. 6A, only the first video 31 (self video) is displayed on the layer-0, and the still image obtained by capturing the second image on the layer-1 is displayed. The image 32a is moved and enlarged, the background image 33 is displayed on the layer-3, and these layers are combined to form a composite image 35 shown in FIG. 6B of the second casing 20 of the mobile phone 1. It is displayed on the display surface 20a. In the case of this movement enlargement display mode, they are combined in the order of layer-3, layer-0, and layer-1.

  This movement enlarged display mode is a temporary display mode that is executed while the user touches and moves (enlarges) the still image 32a. Specifically, in the movement enlargement display mode, it is determined that the still image 32a is moved in a state where the user touches a desired position, and enlarged to a desired enlargement ratio, and the touch of the still image 32a is released. Executed during.

  When the execution of the moving enlargement display mode is completed, the moved and enlarged still image 32 a moves to the layer-0 that is the moving layer, and the moving image corresponding to the still image 32 a is displayed as the second video 32.

  The outline of the above process will be described as follows.

  (1) A plurality of layers are prepared. In the present embodiment, three layers are prepared: a moving image layer, a background layer, and a moving layer.

  (2) For a moving image to be moved by dragging or the like, copy the frame (still image) of the moving image to the unused layer-1.

  (3) Layer-0 (moving image layer) and layer-3 (background layer) are displayed as they are, and layer-1 (moving layer) is moved to the top.

  (4) The movement process such as dragging is performed only on layer-1 (moving layer).

  (5) When the movement is completed (touch operation is completed), the still image of layer-1 is deleted and a moving image is reproduced with respect to the same coordinates of layer-0.

  The hardware configuration for realizing the above processing will be described below.

  As shown in FIG. 1, the image display device according to the present embodiment provided in the mobile phone 1 has a configuration including a display unit 100, a display data generation unit 200, and a data supply unit 300. This image display device can perform multi-layer display in which images displayed on a plurality of layers are combined and displayed.

  The display unit 100 includes a display panel 101 that displays display data generated by the display data generation unit 200, and a touch panel 102 that is stacked on the display panel 101 and functions for user operation input.

  The display panel 101 is preferably composed of a thin panel such as a liquid crystal display panel or an organic EL (electro-luminescence) panel.

  Further, although not shown, the display panel 101 is provided with a display control unit that converts display data received from the display data generation unit 200 into data that can be displayed on the display panel 101 and outputs the converted data.

  In addition, the touch panel 102 can be applied to either a capacitance method or a resistance film method, but the capacitance method is more preferable. This is because the electrostatic capacity method has advantages such as higher light transmittance than the resistive film method and multipoint detection.

  In the touch panel 102, the display data is generated as display data to be displayed as image display in conjunction with the user's touch operation using information obtained by touching the user (position information specified by touch on the display screen). A touch panel control unit (not shown) for sending to the unit 200 is provided.

  The display data generation unit 200 includes a display control unit 201, a multimedia engine (moving image display control means) 202, an input control unit 203, a moving image layer 204, a background layer 205, a moving layer 206, and a composition processing unit 207. It is out.

  The display control unit 201 acquires data from the data supply unit 300 and performs output control on the acquired data in an appropriate state with respect to each unit.

  In other words, the display control unit 201 transfers the acquired data to the multimedia engine 202 if the data is multimedia display data, and transfers the data to the background layer 205 if the data is background data. If so, the data is transferred to the movement layer 206. Details of the display control unit 201 will be described later.

  The multimedia engine 202 generates moving image data, which is a kind of display data for multimedia, from the data output from the display control unit 201 and displays it on the moving image layer 204 at the subsequent stage. .

  The input control unit 203 receives a detection signal from the touch panel 102 of the display unit 100 and transfers the detection signal to the display control unit 201 as a control signal. The detection signal acquired by the input control unit 203 is, for example, the display position and movement of the image acquired when the user touches the image displayed on the display panel 101 of the display unit 100 via the touch panel 102. It is a signal that includes information for detecting the quantity. The control signal output from the input control unit 203 to the display control unit 201 includes a control signal (capture instruction control signal) for instructing capture of the touched image (capturing a still image temporarily). It is.

  The moving image layer 204, the background layer 205, and the moving layer 206 are virtual display panels for displaying corresponding images (still images, moving images), and images displayed on these layers are: The images are overlaid by the synthesis processing unit 207 and sent to the display unit 100 as synthesized image data.

  The data supply unit 300 generates, for example, data stored in a storage device such as a hard disk drive (HDD) provided in the image display device, data obtained via a communication network such as the Internet, and the like as the display data The unit 200 is supplied.

  The moving image layer 204, background layer 205, and moving layer 206 will be described below with reference to FIG. Note that the moving image layer 204, the background layer 205, and the movement layer 206 have basically the same configuration and will be described together.

  As shown in FIG. 2, each of the layers described above includes a position information storage unit 401 that stores position information indicating where to combine an image displayed on the layer, and an image displayed on the layer 400. It is composed of a semi-transparent information storage unit 402 that stores semi-transparent information indicating whether or not to synthesize as semi-transparent, and a frame buffer 403 that stores actual image data.

  That is, each layer performs processing on the image data stored in the frame buffer 403 based on the position information stored in the position information storage unit 401 and the semitransparent information stored in the semitransparent information storage unit 402. The image data indicating the composition position of the image displayed on the layer and whether or not it is semi-transparent is output to the subsequent image composition unit 207.

  The multimedia engine 202 displays a moving image by rewriting the frame buffer 403 of the moving image layer 204 a plurality of times within a predetermined time.

  Further, the display control unit 201 changes the frame buffer 403 of the background layer 205 only when it is necessary to rewrite, for example, to update the call time.

  Furthermore, the display control unit 201 rewrites the frame buffer 403 of the moving layer 206 only when a movement start command is received in the normal display mode or when an enlargement / reduction command is received in the movement enlargement display mode. Further, when the display control unit 201 receives a movement command in the movement enlargement display mode, the display control unit 201 rewrites the position information in the position information storage unit 401 of the movement layer 206.

  Here, rewriting the frame buffer 403 requires a large amount of processing. On the other hand, when moving a still image, the position information stored in the position information storage unit 401 is simply rewritten without rewriting the image data written in the frame buffer 403. As a result, the still image appears to move on the composite image. Since the processing amount in this case is only rewriting position information having a smaller capacity than the image data, the processing amount is smaller than in the case where the image data written in the frame buffer 403 is rewritten.

  Here, the configuration of the display control unit 201 will be described in detail.

  As shown in FIG. 3, the display control unit 201 includes a data acquisition unit 211, a data type determination unit 212, a background data generation unit (background image display control unit) 213, a capture unit (still image acquisition unit) 214, movement data A generation unit (still image display control unit) 215 and a movement enlargement control unit (movement enlargement control unit) 216 are included.

  The data acquisition unit 211 acquires data from the data supply unit 300 and transfers the acquired data to the subsequent data type determination unit 212.

  The data type determination unit 212 determines the type of data transferred from the data acquisition unit 211, and transfers the data to an appropriate subsequent unit according to the determination result. That is, when the data type determination unit 212 determines that the acquired data is multimedia data such as a moving image, the data type determination unit 212 transfers the data to the multimedia engine 202 and is background data. Is transferred to the subsequent background data generation unit 213. The discrimination of data here is performed using, for example, an identification code given to each data.

  The background data generation unit 213 generates background data to be displayed on the background layer 205 from the background data transferred from the data type determination unit 212 and transfers the background data to the background layer 205.

  The display control unit 201 has a function of capturing a moving image currently displayed on the display unit 100 and acquiring it as moving data, not the flow from the data acquisition unit 211. In order to realize this function, the display control unit 201 includes the capture unit 214, the movement data generation unit 215, and the movement expansion control unit 216.

  The capture unit 214 captures a frame image (still image) at a touched timing from a moving image specified by an operation such as a user touching the touch panel 102 from the composite image displayed on the display panel 101. It has become. Specifically, the capture unit 214 has transferred moving image data transferred from the multimedia engine 202 to the moving image layer 204, and receives a capture instruction control signal from the input control unit 203 described above. Currently, a moving image is captured from moving image data sent from the multimedia engine 202 to obtain still image data, and the data is transferred to the movement data generation unit 215.

  The multimedia engine 202 has the ability to display a plurality of videos at the same time. However, while the capture operation by the capture unit 214 is being performed, the display of the specified videos is paused. When the moving enlargement process is completed from the capture operation, the paused video is displayed again.

  The movement data generation unit 215 generates movement data to be transferred from the transferred data to the movement layer 206. Note that the movement data generation unit 215 determines a movement amount and an enlargement ratio (including a reduction ratio) of a still image to be moved and enlarged, and then pastes the still image to the movement layer 206. The movement enlargement control unit 216 performs this control.

  The movement enlargement control unit 216 receives the detection signal obtained as a result of the user's touch operation on the touch panel 102 of the display unit 100, and the input control unit 203 determines the movement amount and enlargement rate of the still image to be moved. A control signal obtained from the input control unit 203 is sent to the movement data generation unit 215.

  In addition, the movement enlargement control unit 216 may make the still image to be processed a semi-transparent state. In this case, the user can move and enlarge the still image while confirming the background image, so that the still image can be arranged at an appropriate position in the display area and at an appropriate enlargement ratio. Thereby, it is possible to display a moving image having a desired enlargement ratio at a desired position.

  Hereinafter, a flow of processing in the display mode in the mobile phone 1 having the above configuration will be described.

  FIG. 7 is a flowchart showing a flow of processing when the operation is shifted to the movement enlargement display mode shown in FIGS. 6A and 6B from the state in which the operation is performed in the normal display mode. This process is executed by the display control unit 201 shown in FIG.

  First, the capture unit 214 determines whether or not there is a movement start command (capture instruction) (step S11). Here, the capture instruction received by the capture unit 214 is included in a control signal sent from the input control unit 203 shown in FIG. That is, when a detection signal obtained by the user touching the touch panel 102 of the display unit 100 is sent to the input control unit 203 and the input control unit 203 includes a capture instruction, the detection signal includes the capture instruction. It is sent to the capture unit 214 as a control signal.

  In step S11, when the capture unit 214 determines that there is a capture instruction, the process proceeds to step S12, and the capture unit 214 acquires a moving still image. Here, the capture unit 214 acquires a still image from the video transferred from the multimedia engine 202, and transfers the acquired still image to the movement data generation unit 215.

  Next, the movement data generation unit 215 pastes the acquired still image on the movement layer 206 (step S13), and turns on the display of the movement layer 206 (step S14). Here, the movement layer 206 is in a state in which the pasted still image is displayed, and the mobile phone 1 is in the movement enlargement display mode.

  In the movement enlargement display mode, the movement enlargement control unit 216 determines whether or not there is a movement command (step S15). Here, the movement command refers to the touch panel 102 when the user performs an operation for moving and enlarging the still image pasted on the movement layer 206 by touching the touch panel 102 of the display unit 100. The control signal sent from the input control unit 203 that has acquired the detection signal to the movement enlargement control unit 216 includes information on the movement amount and enlargement rate (including the reduction rate) of the still image to be moved.

  In step S15, when the movement enlargement control unit 216 determines that there is a movement instruction, a control signal including the movement instruction is sent to the movement data generation unit 215 to move and enlarge the still image (step S16). This operation is performed until there is no movement instruction in step S15. Then, when there is no movement instruction, the movement enlargement control unit 216 determines whether or not there is a movement end command (step S17). Here, the movement end command is a command indicating a case where a predetermined time has elapsed since the user's touch operation on the display panel 101 from the touch panel 102 was released. That is, even if the user cancels the touch operation once, if the touch operation is started again within a predetermined time, it is not determined that the movement is finished.

  If it is determined in step S17 that there is a movement end command, the movement enlargement control unit 216 instructs the movement data generation unit 215 to turn off the display on the movement layer 206 (step S18). As a result, the movement enlargement display mode ends, and a transition is made to the normal display mode.

  As described above, in the mobile phone 1 configured as described above, the multimedia engine 202 that displays the moving image on the moving image layer 204, the background data generation unit 213 that displays the background image on the background layer 205, and the moving layer 206 A moving data generation unit 215 that displays a still image, a synthesis processing unit 207 that superimposes images displayed on each layer to generate a synthesized image, and a synthesized image generated by the synthesis processing unit 207 include the multimedia engine. When the moving image displayed on the moving image layer 204 by 202 and the background image displayed on the background layer 205 by the background data generating unit 213 are combined images, a moving image is generated from the displayed combined image. A touch panel 102 to be specified and a camera for capturing a still image from the moving image specified by the touch panel 102. And a tea section 214.

  The movement data generation unit 215 displays the still image captured by the capture unit 214 on the movement layer 206, and the multimedia engine 202 displays the moving image layer 204 at the capture timing of the capture unit 214. The composition processing unit 207 generates a composite image by superimposing the moving layer 206 in addition to the moving image layer 204 and the background layer 205. Therefore, since the still image corresponding to the moving image displayed on the moving image layer 204 is displayed on the moving layer 206, the synthesized image is moved on the moving layer 206. Or enlargement processing.

  Therefore, in the case of the above-described configuration, the moving process and the enlarging process of the target image (the moving image specified by the user) are only performed on the still image on the moving layer 206 and are displayed on the moving image layer 204. Compared with the case where the display position and the enlargement process are performed by directly operating the moving image, the processing amount can be greatly reduced. That is, it is possible to greatly reduce the processing load when moving or enlarging the video being displayed on the display screen to an arbitrary position.

  For this reason, if the above configuration is used, a CPU with low processing capability, low power consumption, and low heat generation can be used. Therefore, the mobile phone 1 or the like that requires low power consumption and low heat generation is required. There is an effect that the terminal can be used effectively.

  In the above embodiment, in order to move the moving image displayed on the display screen of the mobile phone 1, it is necessary to drag the moving image while touching it. This is convenient because the moving position can be freely determined when the desired moving position varies depending on the user. However, simply, when it is desired to replace two moving images, one of the moving images is not moved, and the other moving image is moved to the position of the moving image that has been displayed. And one moving image is moved to the display position where the other moving image was displayed. Thus, in the configuration disclosed in the above embodiment, the number of processing steps is increased.

  However, with the following configuration, when two moving images are displayed, the display position of each moving image can be easily changed by touching one of the moving images.

  That is, the image display apparatus according to the present invention displays a background image on the multimedia engine 202 that displays a moving image on the moving image layer 204 and a background layer 205 as in the mobile phone 1 shown in FIGS. The background data generation unit 213, the movement data generation unit 215 that displays a still image on the movement layer 206, the combination processing unit 207 that generates a combined image by superimposing the images displayed on the respective layers, and the combination processing unit 207 Is a composite image obtained by superimposing the moving image displayed on the moving image layer 204 by the multimedia engine 202 and the background image displayed on the background layer 205 by the background data generating unit 213. Sometimes, the touch panel 102 that designates a moving image from the displayed composite image and the touch panel 102 And a capture unit 214 for capturing a still image from image.

  Then, the movement data generation unit 215 displays the still image captured by the capture unit 214 on the movement layer 206, and the multimedia engine 202 displays the moving image layer 204 at the capture timing of the capture unit 214. The composition processing unit 207 generates a composite image by superimposing the moving layer 206 in addition to the moving image layer 204 and the background layer 205. Therefore, since the still image corresponding to the moving image displayed on the moving image layer 204 is displayed on the moving layer 206, the synthesized image is moved on the moving layer 206. Or enlargement processing.

  What is different is the operation control by the multimedia engine 202.

  That is, when the multimedia engine 202 displays two different moving images on the moving image layer 204, one of the moving images displayed on the moving image layer 204 is designated by the touch panel 102. When this is detected, the display position (display coordinates) of the above moving image is switched and displayed.

  In the above example, an example in which a movie is specified by a touch operation using the touch panel 102 is shown. However, the present invention is not limited to this. For example, a movie is specified by displaying a cursor and clicking with a mouse. In this way, the moving image display position may be switched.

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope shown in the claims. That is, embodiments obtained by combining technical means appropriately modified within the scope of the claims are also included in the technical scope of the present invention.

  Finally, each block of the display data generation unit 200 of the mobile phone 1, particularly the display control unit 201, may be configured by hardware logic, or may be realized by software using a CPU as follows.

  That is, the display control unit 201 includes a CPU (central processing unit) that executes instructions of a control program for realizing each function, a ROM (read only memory) that stores the program, and a RAM (random access memory) that expands the program. And a storage device (recording medium) such as a memory for storing the program and various data. An object of the present invention is a recording medium on which a program code (execution format program, intermediate code program, source program) of a control program of the display control unit 201, which is software that realizes the functions described above, is recorded so as to be readable by a computer. This can also be achieved by supplying to the display control unit 201 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).

  Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  The display control unit 201 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Also, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  The present invention can be effectively applied to a device that needs to move a displayed moving image and has to use a CPU having a relatively low processing capability.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1, showing an embodiment of the present invention, is a block diagram illustrating a main configuration of an image display device. It is a block diagram which shows schematic structure of a layer. It is a block diagram which shows the principal part structure of the display control part with which the image display apparatus shown in FIG. 1 was equipped. (A) (b) is a perspective view which shows the external appearance of the mobile telephone provided with the image display apparatus shown in FIG. (A) is a figure which shows the state of each layer at the time of normal display mode in the image display apparatus shown in FIG. 1, (b) is a composite image at the time of combining each layer shown to the same figure (a). FIG. (A) is a figure which shows the state of each layer at the time of the movement expansion display mode in the image display apparatus shown in FIG. 1, (b) is a synthetic | combination at the time of synthesize | combining each layer shown to the same figure (a). It is a figure which shows an image. It is a flowchart which shows the flow of the process at the time of a movement expansion display mode.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Cellular phone 10 1st housing | casing 10a Operation surface 20 2nd housing | casing 20a Display surface 31 1st image 32 2nd image 32a Still image 33 Background image 34 Composite image 35 Composite image 100 Display unit 101 Display panel 102 Touch panel means)
200 Display Data Generation Unit 201 Display Control Unit 202 Multimedia Engine (Movie Display Control Unit)
203 Input control unit 204 Movie layer (first layer)
205 Background layer (second layer)
206 Moving layer (third layer)
207 Composition processing unit (composition processing means)
211 Data acquisition unit 212 Data type determination unit 213 Background data generation unit (background image display control means)
214 Capture unit (still image acquisition means)
215 Movement data generation unit (moving image display control means)
216 Movement expansion control unit (movement expansion processing means)
300 Data supply unit

Claims (8)

In an image display device that displays a composite image in which images displayed on a plurality of layers are superimposed,
Moving image display control means for displaying a moving image on the first layer;
Background image display control means for displaying a background image on the second layer;
A still image display control means for displaying a still image on the third layer;
A composite image generating means for generating a composite image by superimposing images displayed on each layer;
The composite image generated by the composite image generation unit is a combination of the moving image displayed on the first layer by the moving image display control unit and the background image displayed on the second layer by the background image display control unit. A video designating means for designating a video from the displayed composite image when it is an image,
Still image acquisition means for acquiring a still image from the video specified by the video specification means,
The still image display control means includes:
Displaying the still image acquired by the still image acquisition means on the third layer;
The moving image display control means
Stop the display of the video displayed on the first layer at the timing of the still image acquisition by the still image acquisition means,
The composite image generation means includes
In addition to the moving image displayed on the first layer and the background image displayed on the second layer, a still image displayed on the third layer is superimposed to generate a composite image. . A movement enlargement control means for performing a movement process and an enlargement process on the still image displayed on the third layer by the still image display control means;
The moving image display control means
The moving image displayed on the first layer at the movement position and the enlargement ratio processed for the still image when the movement and enlargement processing of the still image is detected by the movement enlargement control means. The image display apparatus according to claim 1, wherein display of the image is resumed. When at least two different videos are displayed on the first layer,
The image display device according to claim 1, wherein the moving image designating unit designates one moving image from the displayed composite image.   The image display apparatus according to claim 1, wherein the movement enlargement control unit performs a semi-transparent process on the still image displayed on the third layer. Display means for displaying the composite image;
A touch panel laminated on the display surface so as to correspond to the display surface of the display means,
The moving image specifying means obtains coordinate information indicating a display position of the moving image displayed on the display means from a detection signal output by touching the touch panel, and specifies the moving image by the coordinate information. The image display apparatus according to claim 1, wherein the image display apparatus is characterized.   A portable terminal comprising the image display device according to claim 1. In an image display device that displays a composite image in which images displayed on a plurality of layers are superimposed,
Moving image display control means for displaying a moving image on the first layer;
Background image display control means for displaying a background image on the second layer;
A still image display control means for displaying a still image on the third layer;
A composite image generating means for generating a composite image by superimposing images displayed on each layer;
The composite image generated by the composite image generation unit is a combination of the moving image displayed on the first layer by the moving image display control unit and the background image displayed on the second layer by the background image display control unit. A video designating means for designating a video from the displayed composite image when it is an image,
Still image acquisition means for acquiring a still image from the video specified by the video specification means;
Display means for displaying the composite image,
The moving image display control means
When two different videos are displayed on the first layer,
An image display device characterized in that, when it is detected by the moving image designating means that any one of the moving images displayed on the first layer is designated, the display positions of the respective moving images are switched and displayed. Display means for displaying the composite image;
A touch panel laminated on the display surface so as to correspond to the display surface of the display means,
The moving image display control means
When the moving picture designating means obtains coordinate information indicating the display position of the moving picture displayed on the display means from the detection signal output by touching the touch panel, and designates the moving picture by the coordinate information. The image display device according to claim 7, wherein display positions of the designated moving image and the non-designated moving image are switched.

Images