JP2011154533A - Device and program for controlling display - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display control device and a display control program, allowing a user to intuitively compare an original image and an image after image processing in linking with operation of the user. <P>SOLUTION: The display control device includes a display control part 114 generating a second image wherein the image processing is applied to an area AR of a first image represented by image data based on an area PR and the area AR set by an area setting means and the image data obtained by an image data acquisition means, and displaying the generated second image on a display part. The area AR and the area PR are adjacent to each other along a prescribed direction, and an area setting part 112 moves a boundary between the area AR and the area PR according to movement of a contact position when the contact position detected by a sensor control means moves. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a display control device and a display control program.

  With the widespread use of digital cameras, it has become common to obtain photographic images recorded with digital data. In the case of shooting with a conventional film camera, it was often accompanied by a print, but in the case of a digital system, it can be viewed with a digital camera that has shot, or with a personal computer that has captured image data, There are also changes in the way photos are enjoyed.

  Under such circumstances, so-called digital photo frames are realized and popularized so that digital photographs can be enjoyed in the same way as conventional printed photographs (for example, Patent Document 1).

  Such a digital photo frame can realize various display modes such as displaying a plurality of photos in a slide show format, which was not possible with a photo frame displaying a conventional print photo, utilizing the characteristics of the digital system. By applying image processing to the acquired photographic image, for example, it is possible to generate and display a photographic image (for example, a painting style) having a different taste while using the original photo as a base.

JP 2009-141678 A

  However, in the above technique, the user cannot intuitively compare the original image and the image after image processing in conjunction with the user's operation.

  An object of the present invention is to provide a display control device and a display control program that allow a user to intuitively compare an original image and an image after image processing in conjunction with a user operation.

In order to achieve the above object, a display control apparatus according to the first aspect of the present invention provides:
Sensor control means for detecting a contact position, which is a position where the user performs a contact operation in the sensor unit, with a sensor unit for detecting a contact operation from a user;
Image data acquisition means for acquiring image data representing the first image;
Area setting means for setting the first area and the second area in the first image represented by the image data acquired by the image data acquisition means according to the contact position detected by the sensor control means;
Based on the image data acquired by the image data acquisition means and the first area and the second area set by the area setting means, image processing is performed on the first area of the first image represented by the image data. Display control means for generating a second image subjected to the above and displaying the generated second image on the display unit,
The first region and the second region are adjacent to each other along a predetermined direction,
The area setting means moves the boundary between the first area and the second area according to the movement of the contact position when the contact position detected by the sensor control means moves.

In order to achieve the above object, a display control program according to the second aspect of the present invention provides:
On the computer,
Sensor control means for detecting a contact position, which is a position where the user performs a contact operation in the sensor unit, with a sensor unit for detecting a contact operation from a user;
Image data acquisition means for acquiring image data representing the first image;
Area setting means for setting the first area and the second area in the first image represented by the image data acquired by the image data acquisition means according to the contact position detected by the sensor control means;
Based on the image data acquired by the image data acquisition means and the first area and the second area set by the area setting means, image processing is performed on the first area of the first image represented by the image data. And a display control means for displaying the generated second image on the display unit,
The first region and the second region are adjacent to each other along a predetermined direction,
The area setting means moves the boundary between the first area and the second area according to the movement of the contact position when the contact position detected by the sensor control means moves.

  According to the present invention, it is possible to provide a display control device and a display control program that allow a user to intuitively compare an original image and an image after image processing in conjunction with a user operation.

It is a figure which shows the external appearance of the display control apparatus concerning Embodiment 1 of this invention. It is a figure which shows the hardware constitutions of the display control apparatus shown in FIG. It is a figure which shows the structure of the control part shown in FIG. It is a flowchart for demonstrating the "touch interlocking | linkage display process" concerning Embodiment 1 of this invention. 5 is a flowchart for explaining a “display change process (1)” executed in the “touch-linked display process” shown in FIG. 4. 5 is a flowchart for explaining a “display change process (2)” executed in the “touch-linked display process” shown in FIG. 4. FIGS. 5A and 5B are diagrams for explaining an operation example in “touch-linked display processing” shown in FIG. 4, in which FIG. 4A shows an example of an original image and a converted image, and FIG. 5B shows a state in which the original image is displayed; (C) shows an example of a region set on the touch sensor. It is a figure for demonstrating the operation example in "display change process (1)" shown in FIG. 5, (a) shows the example of the area | region set according to the finger slide detected by the touch sensor, (B) shows the example of the screen display switched according to finger slide, (c) shows the example of the display effect added at the time of image switching. It is a figure which shows the example of the display change concerning "display change process (2)" shown in FIG. It is a figure which shows the example of the display change concerning Embodiment 2 of this invention. It is a figure which shows the other example of the display change concerning Embodiment 2 of this invention. It is a figure which shows the example of the external appearance structure of the digital photo frame concerning Embodiment 3 of this invention. It is a figure which shows the operation example of the digital photo frame concerning Embodiment 4 of this invention, (a) shows the example of a screen display in the case of changing a process according to the finger contact area on a touch panel, (b) These are figures which show the example of the area | region designated by the multi touch on a touchscreen.

(Embodiment 1)
Embodiments according to the present invention will be described below with reference to the drawings. In the present embodiment, a case where the display control apparatus according to the present invention is realized by a digital photo frame 100 as shown in FIG. 1 is exemplified. As shown in FIG. 1, the digital photo frame 100 according to the present embodiment includes a display panel (display unit 120) in a housing simulating a photo frame (photo frame), and displays a photographic image or the like based on digital data. This is a digital photo frame having a function, and in addition to the general configuration of such a digital photo frame, a touch sensor (sensor unit 130) that senses a finger touch or the like is configured.

  The hardware configuration of the digital photo frame 100 will be described with reference to FIG.

  As illustrated, the digital photo frame 100 according to the present embodiment includes a control unit 110, a display unit 120, a sensor unit 130, an operation unit 140, an I / F unit 150, a storage unit 160, and the like.

  The control unit 110 includes, for example, a processor such as a CPU (Central Processing Unit), a main storage device (memory) such as a RAM (Random Access Memory), a display storage device such as a VRAM (Video RAM), The main operation of the digital photo frame 100 (touch-linked display processing described later) is realized by controlling each part of the digital photo frame 100. In particular, in the present embodiment, the CPU executes a display control program recorded in the storage unit 160, whereby a touch-linked display process (described later, which is included in the control unit 110, is performed by the control unit 110). The touch setting display process actually performed by the area setting unit 112, the display control unit 114, and the sensor control unit 113 is executed.

  The display unit 120 includes, for example, a display panel such as a liquid crystal display panel or an organic EL (Electro-Luminescence) panel, a driver circuit that drives the display panel, and the like, and is generated by the control unit 110 under the control of the control unit 110. An image based on the image data is displayed.

  The sensor unit 130 includes, for example, a capacitive touch sensor and the like, and is for detecting an operation (contact operation) caused by a finger contact by a user of the digital photo frame 100. The sensor unit 130 generates a detection signal corresponding to the touch position (expressed by coordinates), the content of contact (for example, pressing force), and supplies the detection signal to the control unit 110. The touch sensor constituting the sensor unit 130 has, for example, a substantially rectangular shape as shown in FIG. 1 and is arranged in the vicinity of the display panel so as to be parallel to the display panel in the longitudinal direction. In addition, the size of the touch sensor and the display panel in the longitudinal direction is substantially the same, and the touch position (contact position) on the touch sensor and the coordinate in the x direction (lateral direction) on the display panel are necessary and sufficient. Assume that it corresponds with accuracy.

  The operation unit 140 includes, for example, various buttons configured on the outer surface of the digital photo frame 100, and generates an operation signal according to an operation by a user (user) of the digital photo frame 100 to control the control unit 110. To supply. By operating the operation unit 140, for example, power on / off of the digital photo frame 100, setting of an operation mode, selection of an image to be displayed, and the like are performed.

  The I / F unit 150 is an interface (I / F) with an external device. For example, the I / F unit 150 is connected to a card slot to which an external storage medium such as a memory card storing image data is attached, a digital camera, a personal computer, or the like. An interface (for example, a USB (Universal Serial Bus) port) for acquiring image data to be transferred is configured.

  The storage unit 160 includes a storage device such as a ROM (Read Only Memory) or a flash memory, and stores programs and data necessary for the operation of the digital photo frame 100, for example. In the present embodiment, it is assumed that a display control program, parameters, arithmetic expressions, and the like necessary for the control unit 110 and the like to execute the touch-linked display process are recorded in the storage unit 160.

  The above is the main hardware configuration constituting the digital photo frame 100 according to the present embodiment, but the configuration used for the basic functions and various additional functions as a digital photo frame is provided as necessary. Shall.

  In the present embodiment, it is assumed that a photographic image taken with a digital camera or the like is displayed on the digital photo frame 100 configured as described above. In this case, in the digital photo frame 100 according to the present embodiment, by processing the image data of the acquired photographic image (hereinafter referred to as “original image”), the same photographic image has a different style from this photographic image. It is assumed that a converted image (hereinafter referred to as “converted image”) can be generated and displayed.

  The control unit 110 (particularly, the display control unit 114 described later) is a filter (art filter) used in graphic software (so-called paint software (for example, Photoshop (registered trademark)) that handles raster-format image data. By performing image processing that has the same effect as the above, various parameters of the acquired original image are changed, and for example, a converted image such as a painting-like image (oil painting style, tearing style, ink painting style, etc.) The type of image processing in this case is arbitrary, and various image conversions that can be realized by executable image processing (for example, conversion to monochrome tone, conversion to sepia tone, conversion to soft focus tone, vivid) Conversion to tones, conversion to mosaics, conversion to miniature photography, etc.). The parameters are various numerical values used when performing image processing, and such parameters are numerical values representing the nature of image processing, and specify, for example, brightness, fineness of image conversion, smoothness, and texture. Depending on the type of image processing (type of style to be changed) such as a value to be changed, the degree of style change (degree of image processing) is expressed by this parameter. The degree of image processing increases and decreases depending on the parameter, and if the parameter is large, that is, if the degree of image processing is large, the change in the image before and after the image processing becomes large. (Here, the parameter) is, for example, the degree of change when the images before and after the image processing are compared. There, for example, a parameter such as image conversion used in Photoshop, or the like.

  In the present embodiment, such image processing and display operation thereof are linked with finger contact with the touch sensor constituting the sensor unit 130, thereby realizing more convenient image display.

  Next, the configuration of the control unit 110 will be described with reference to FIG. The control unit 110 includes an image data acquisition unit 111, a region setting unit 112, a sensor control unit 113, a display control unit 114, and the like. As described above, the processing performed by each of these units is performed by the CPU here, and each of these units is configured by a combination of CPU, RAM, VRAM, and the like that are components of the control unit 110.

  The image data acquisition unit 111 acquires image data representing an image (original image) displayed on the digital photo frame 100. Here, for example, by controlling the I / F unit 150, image data representing a photographic image or the like is acquired from a memory card or an external device (digital camera, personal computer, etc.). The image data acquired from the outside of the digital photo frame 100 may be stored in the storage unit 160. In this case, the image data acquisition unit 111 receives the image data of the photographic image to be displayed from the storage unit 160. get.

  When the image data acquisition unit 111 acquires image data to be displayed, the image data acquisition unit 111 holds the acquired image data (for example, develops it in a RAM). Note that image data to be displayed, an image acquisition source, and the like are selected based on an operation of the operation unit 140 by a user of the digital photo frame 100.

  The sensor control unit 113 controls the sensor unit 130 and acquires a detection signal corresponding to the contact operation on the touch sensor. Based on this detection signal, the sensor control unit 113 detects the touch position, the content of contact, and the like.

  The area setting unit 112 sets two areas in the original image represented by the image data held by the image data acquisition unit based on the touch position detected by the sensor control unit 113. These two areas are defined as a first area and a second area. These two areas change dynamically according to the change of the touch position.

  The display control unit 114 processes the image data (hereinafter referred to as original image data) of the original image acquired by the image data acquisition unit 111 and developed in the RAM, thereby converting the image data (hereinafter referred to as converted image) of different styles. , Referred to as converted image data). Here, the original image data is processed to generate converted image data by performing the same operation as the above-described filter (art filter) in raster image graphic software. That is, a converted image obtained by converting the original image is generated. In this embodiment, display control (details will be described later) is performed in conjunction with the finger contact detected by the touch sensor of the sensor unit 130. However, the operation unit 140 is arbitrarily operated in the process of displaying the original image. In response to this, image processing may be performed.

  The number of converted images generated from one original image is not limited to one. For example, even if a plurality of types of converted images subjected to different image processing (that is, a plurality of types of converted images having different styles) are generated. Alternatively, a plurality of types of converted images (that is, a plurality of types of converted images having different degrees of image processing) with different parameters may be generated by the same image processing. It is assumed that a display control program and data (such as parameters) necessary for display control (including touch-linked display processing) are stored in the storage unit 160, and the generated converted image data is stored in RAM or VRAM. And is stored in the storage unit 160 or the like as necessary.

  The display control unit 114 controls the display unit 120 to display an original image on the display panel of the display unit 120 based on the original image data acquired by the image data acquisition unit 111 and to display a converted image on the display panel. . Further, the display control unit 114 controls the display mode of the original image and the converted image based on the first region and the second region set by the region setting unit 112. In particular, the display mode of the original image and the converted image is dynamically controlled based on the first area and the second area that dynamically change. In this case, the display control unit 114 displays a second image in which the first region is a portion corresponding to this region of the converted image and the second region is a portion corresponding to this region of the original image on the display unit.

  In this case, the display control unit 114 synthesizes, for example, a template image having an animation effect with the display image and performs display output by display processing having an effect such as that used in known authoring software or the like. To do. It is assumed that such a template image is created in advance and stored in the storage unit 160 or the like.

  In the present embodiment, each function described above is realized by a logical process performed by the control unit 110 (CPU) executing a program. For example, these functions may be realized by, for example, an ASIC (Application Specific Integrated Circuit). : An application specific integrated circuit) or the like. That is, a part of the control unit 110 may be configured by an ASIC. For example, at least a part of the display control unit 114 may be configured by a dedicated processor independent of the CPU of the control unit 110 such as a so-called image processing engine, or a control unit such as a so-called graphic board. It may be constituted by a module having a dedicated processor independent of the CPU 110.

  An operation example of the digital photo frame 100 having such a configuration will be described below. Here, “touch-linked display processing” executed by each unit of the control unit 110 during display control by the digital photo frame 100 will be described with reference to the flowchart of FIG. 4. In the digital photo frame 100 according to the present embodiment, in addition to the normal display mode in which the acquired original images are sequentially displayed, conversion image generation and display switching are performed in conjunction with finger contact with the touch sensor of the sensor unit 130. It is assumed that a mode that can be performed (hereinafter, referred to as “touch-linked mode”) is prepared, and “touch-linked display processing” is started when the touch-linked mode is selected.

  As described above, in the digital photo frame 100 according to the present embodiment, the touch sensor corresponding to the horizontal direction of the display panel is provided. In the present embodiment, the digital photo frame 100 according to the present embodiment is like this. It operates so that the display switching between the original image and the converted image and the display switching of a plurality of converted images are performed in accordance with the finger movement (slide) in the horizontal direction on the touch sensor.

  That is, display control is performed according to the slide direction of the finger. In this embodiment, for example, “when a slide from right to left is detected on the touch sensor when the original image is displayed, Assume that an interlocking operation such as “switch the display to a converted image of the original image” is defined in advance.

  It is assumed that such an operation rule can be arbitrarily set by the user together with the type of image processing to be applied, and the setting content is recorded in the storage unit 160. The processing described below is performed based on such an operation rule, and the corresponding operation rule is an example.

  When the touch-linked display process is started, the image data acquisition unit 111 acquires the original image data of the original image to be displayed and expands it in the RAM, and notifies the display control unit 114 and the region setting unit 112 of that fact. To do. The display control unit 114 displays the original image represented by the original image data expanded in the RAM on the display unit 120 (step S11). Here, it is assumed that the digital photo frame 100 according to the present embodiment can display a layer as described above. In step S11, the display control unit 114 displays the original image acquired by the image data acquisition unit 111 as a diagram. Displayed on the frontmost layer (hereinafter referred to as “front layer”) on the display screen of the display unit 120 as shown in FIG.

  Here, in the present embodiment, an original image as illustrated in FIG. 7A and a converted image generated by performing image processing on the original image will be described below as an example. In this case, the original image is displayed on the display panel of the display unit 120 as shown in FIG. Here, since the original image is displayed as the front layer, the original image is visibly displayed as shown in FIG. 7B.

  In addition, the converted image described later is subjected to image processing (such as an art filter) on the original image as illustrated in FIG. 7A, so that the subject and composition are the same. The contour line is changed. In the present embodiment, as a default setting when displaying the original image and the converted image in layers as appropriate, as shown in FIG. 7A, a layer (hereinafter referred to as “below”) that is the back side of the front layer on which the original image is displayed. It is assumed that the converted image is displayed on the “back layer”.

  On the other hand, simultaneously with the start of processing, the sensor control unit 113 controls the sensor unit 130 to excite the touch sensor that constitutes the sensor unit 130, and the sensor unit 130 performs a contact operation by finger contact by the user or the like. It will be in a state where it can be detected. When a user or the like performs a touch operation (touch) on the touch sensor, a detection signal is input to the sensor control unit 113 from the sensor unit 130 that detects the touch operation. The sensor control unit 113 determines whether or not a touch to the touch sensor has occurred based on whether or not such a detection signal is input (step S12).

  When the sensor control unit 113 detects that the touch sensor is touched based on the detection signal from the sensor unit 130 (step S12: Yes), the sensor control unit 113 determines where the touch position on the touch sensor is. (Step S13). Here, in the present embodiment, as shown in FIG. 7C, on the touch sensor constituting the sensor unit 130, for example, three regions divided into approximately three equal parts in the longitudinal direction are set. And These areas are “left area”, “center area”, and “right area” from the left when viewed from the user or the like who views the image displayed on the display panel of the display unit 120. "Includes at least the left end portion of the touch sensor," center region "includes at least the center portion of the touch sensor, and" right region "includes at least the right end portion of the touch sensor.

  Based on the position (touch position) at which the touch indicated by the detection signal input from the sensor unit 130 is detected, the sensor control unit 113 determines which of the above areas is the touch position on the touch sensor by the user or the like. Determine.

  When the touch position on the touch sensor is the “right area” (step S14: Yes), the area setting unit 112 and the display control unit 114 perform a finger movement (slide) operation (touch position movement) on the touch sensor. ) To execute display change processing (1) for changing the display between the original image and the converted image.

  Here, in this embodiment, in the case of a slide operation from right to left during touch-linked display, it is assumed that an operation regulation that changes from an original image to a converted image according to the slide is made. In this case, “display change process (1)” for changing from the original image to the converted image when the first touch is made in the “right region” where the touched finger is likely to slide leftward. Is executed. This “display change process (1)” will be described with reference to the flowchart shown in FIG.

  When the processing is started, the display control unit 114 accesses the storage unit 160 or the like directly or via the image data acquisition unit 111, and whether a converted image converted from the original image displayed in step S11 has been created. It is determined whether or not (step S101). For example, the converted image data may be generated from the original image data in advance by the display control unit 114 or the like and recorded in the storage unit 160 by the previous process or appropriate timing, and in this case, Since converted image data is recorded in the unit 160, it is determined in step S101 that a converted image has been created. In this case, the converted image data is recorded in the storage unit 160 so as to be searchable using the original image data. Then, the display control unit 114 searches the converted image data based on the original image data held by the image data acquisition unit 111 and determines whether the converted image has been created (recorded).

  If it has been created (step S101: Yes), the display control unit 114 acquires the converted image data of the converted image directly or via the image data acquiring unit 111, and uses the converted image of the converted image data as the back layer. Display as. In this case, as shown in FIG. 7A, the converted image is set to the back layer (step S102). In this case, since the original image and the converted image are virtually stacked on the RAM or VRAM so that they are in the same position in the same coordinate system, the original image is displayed visually, but the converted image is invisible. If there is no created converted image (step S101: No), the operation in step S102 is skipped.

  During this time, the operation of the touch sensor is continued in the sensor unit 130, and a detection signal corresponding to the detection is supplied to the sensor control unit 113 as needed. The sensor control unit 113 determines whether or not the finger on the touch sensor has slid based on such a change in the detection signal (step S103). That is, when the touch position changes from the first detected touch position while maintaining the touch state, it is determined that the finger on the touch sensor has slid.

  When the finger on the touch sensor slides (step S103: Yes), the sensor control unit 113 determines whether or not the slide direction is “leftward” from the user or the like toward the touch sensor (step S103). S104) If the slide is to the left (step S104: Yes), information indicating the movement amount (slide amount) is notified to the area setting unit 112 as needed. That is, the area setting unit 112 can specify the movement amount at any time by the sensor control unit 113.

  The area setting unit 112 is dynamically defined based on the slide amount (touch position detected by the sensor control unit 113) on the touch panel based on information indicating the slide amount notified from the sensor control unit 113. An area on the layer (hereinafter referred to as “area AR”) is set (step S105).

Here, the display area on the display panel of the display unit 120 is, for example, the coordinates of the top left top of the screen (X _min , Y _min ) and the coordinates of the bottom right top of the screen as shown in FIG. (X _max , Y _max ) and the number of dots in the one-dimensional direction (X direction = horizontal direction) on the display screen corresponding to the slide amount on the touch sensor is M, the coordinates (X _max , Y _max ) and a rectangular area whose coordinates are (X _max -M, Y _min ) are set as the area AR. The area AR is set so that the boundary between the first area and the second area and the touch position on the touch sensor are substantially the same position in the horizontal direction. Here, the area AR corresponds to the first area described above. Further, the shape of the area AR may be a shape other than a rectangle, and is set as appropriate.

  When the area setting unit 112 sets the area AR, the display control unit 114 performs a display process so that the converted image is visually displayed in the area AR (step S106). The display process in this case differs depending on, for example, whether the converted image has been created.

  When the converted image has been created, since the converted image is set in the back layer in step S102, the display process for transmitting the area AR in the front layer is performed, so that the area as shown in FIG. In AR, the converted image is visibly displayed. In this case, the original image is visibly visible in the remaining region (hereinafter referred to as “region PR”, which corresponds to the second region) passively defined according to the region AR. It remains displayed. That is, as shown in FIG. 8B, the original image and the converted image are displayed in a partially synthesized state.

  On the other hand, when the converted image has not been created, the region setting unit 112 notifies the display control unit 114 of the set region AR, so that the display control unit 114 can display the region AR in the original image displayed on the front layer. Image processing is performed on the part of. That is, based on the original image data held by the image data acquisition unit, partial image processing is performed on the original image of this data, so that a portion corresponding to the area AR in the original image is converted into a converted image. Become. Also in this case, a display in which the original image and the converted image are partially combined as shown in FIG.

  In any of the above cases, the display control unit 114 is based on the image data acquired by the image data acquisition unit 111 and the first region (region AR) and the second region (region PR) set by the region setting unit 112. A second image in which the style of the first region of the first image represented by the image data is changed (image processing is performed on the first region) is generated. Here, in particular, the display control unit 114 generates second image data representing the second image, thereby generating the second image. Then, the second image is displayed on the display unit 120 by the display control unit 114.

  Here, the sensor control unit 113 determines whether or not the finger slide on the touch sensor has stopped based on the detection signal from the sensor unit 130, and the display control unit 114 performs display processing in conjunction with the slide. It is determined whether or not the entire surface of the converted image is visibly displayed (step S107).

  If none of these conditions occurs (step S107: No), the region setting unit 112 and the display control unit 114 continuously perform the operations from step S105 to step S106. Thereby, as shown in FIG. 8B, the region from the right end of the original image is displayed so as to change into the converted image in accordance with the finger slide from right to left on the touch sensor.

  When this display process is performed, for example, a decoration effect imitating a page curl as shown in FIG. 8C is synthesized in accordance with the boundary between the area AR and the area PR, thereby providing a display effect. Good. The necessity of performing such display effects, the type of image to be combined, and the like are set in advance by a user or the like, and display processing is performed according to this setting. Such a display effect makes it easy to understand the boundary between the original image and the converted image.

  On the other hand, when it is determined that the finger slide is stopped on the touch sensor or the entire conversion image is visible (step S107: Yes), and then a rightward slide on the touch sensor is further detected. (Step S108: Yes), the region setting unit 112 sets an area AR based on the number of dots in the one-dimensional direction corresponding to the amount of sliding in the right direction by the same processing as in the case of sliding in the left direction. In step S109, the display control unit 114 performs display processing such that the area AR is displayed as the original image until the finger slide is stopped in the right direction or the entire original image is visible (step S110). Step S111: No).

  When the finger slide in the right direction stops or the entire original image is visible (step S111: Yes), the display control unit 114 generates a predetermined end event as a condition for ending this process. It is determined whether or not it has been done (step S112). Here, for example, the end event is that the finger has left the touch sensor or the touch-linked mode has ended.

  If such an end event does not occur (step S112: No), the processes after step S103 are repeatedly executed. That is, when the finger is slid in the left direction on the touch sensor while the original image is displayed, the converted image is displayed corresponding to the slide, and when the finger is slid in the right direction, the slide is displayed. Correspondingly, the screen display that returns to the original display is continuously performed. In this way, the area AR and the area PR dynamically change according to the movement of the touch position.

  In addition, in this process started when touch detection is performed on the right area of the touch sensor, when a finger slide on the touch sensor is not detected (step S103: No), display processing when the finger is not slid Steps S203 to S207 (details will be described later) of the “display change process (2)” (step S200) are executed (step S113).

  This process is started when a touch in the right area that is likely to slide to the left is detected. In this state, a slide to the right is detected. In the case (step S104: No), if the display process related to this process has already been executed (step S114: Yes), the operations of steps S109 to S111, which are display processes corresponding to the slide in the right direction, are performed. It is.

  On the other hand, when the direction of the slide detected first after starting the process is the right direction (step S114: No), “normal display switching process” (step S300) corresponding to the right direction slide at the time of display control. , Details will be described later).

  Here, when a touch in the right region that is likely to be a leftward slide is detected, a converted image may be prepared before the slide is detected (step S102). In this case, the display can be switched simultaneously with the detection of the slide, and even if the slide direction is different from the expected one, the operation specified for the slide direction is executed, and the display does not stress the user. Control can be performed.

  When this process ends due to the occurrence of a process end event for “display change process (1)” (step S112: Yes) or the like, the flow returns to the “touch-linked display process” (FIG. 4).

  In the “touch-linked display process” returned from the “display change process (1)”, it is determined whether or not a predetermined end event that is a condition for ending the “touch-linked display process” has occurred (step S16). Here, for example, the end event is that the touch-linked mode ends or the digital photo frame 100 is turned off.

  If the end event related to this process does not occur (step S16: No), the process after step S12 is performed. Hereinafter, an operation example when the detected touch position is other than the “right region” will be described.

  First, the operation when the touch position is the “center area” is illustrated. In this embodiment, when one point on the touch sensor is continuously touched, the original image displayed at that time is switched to the converted image, and the parameter of the image processing related to the converted image is set to the touch duration time. It is assumed that the operation of changing and displaying in response is defined. In this case, it is assumed that the recommended touch position is the “center area” of the touch sensor.

  If the detected touch position is the “center area” based on such an operation rule (step S15: YES), the “display change process (2)” for performing the display process is executed (step S15). S200). This “display change process (2)” will be described with reference to the flowchart shown in FIG.

  When the process is started, the sensor control unit 113 determines whether or not the finger slide on the touch sensor is performed based on the detection signal input from the sensor unit 130 (step S201). Here, when a finger slide is detected after the start of this processing (step S201: No), steps S104 to S112 of “display change processing (1)” (FIG. 5) for performing display processing according to the slide are executed. (Step S202). That is, even when the operation is not assumed from the touch position, display processing corresponding to the detected operation is performed.

  On the other hand, if the touched finger is stationary (step S201: Yes), the display control unit 114 accesses the storage unit 160 or the like directly or via the image data acquisition unit 111, and displays the source displayed in step S11. It is determined whether or not a converted image converted from the image has been created (step S203). Since these processes are the same as the process of step S103, detailed description is abbreviate | omitted.

  When it has been created (step S203: Yes), the display control unit 114 acquires the converted image data of the converted image directly or via the image data acquiring unit 111, and uses the converted image of the converted image data as the front layer. Is displayed on the display unit 120. That is, by default, the original image is visibly displayed on the front layer, but in this process, the original image is switched to the converted image (step S204). Note that the image data of the converted image stored in the storage unit 160 or the like includes information indicating parameters applied in the image processing used for generating the converted image.

  On the other hand, when the converted image for the original image being displayed has not been created (step S203: No), the display control unit 114 generates a converted image by applying image processing to the original image (that is, image data). The converted image data is generated based on the original image data held by the acquisition unit 111, and the generated converted image is displayed on the display unit 120 (that is, the converted image is displayed on the display unit 120 based on the generated converted image data). indicate). As a result, the visible image is switched from the original image to the converted image (step S205). In this case, for example, the display control unit 114 generates a converted image by applying a parameter that provides the lowest degree of application of image processing to be executed (the degree of change in the style, that is, the degree of change in the style).

  In the present embodiment, the parameter with the weakest application degree of image processing is referred to as “initial value”, and the converted image generated by image processing with the parameter being the initial value is referred to as “converted image A” hereinafter. Also, a converted image in which the degree of application of image processing is increased by one step compared to the converted image A is referred to as “converted image B”, and a converted image in which the degree of application of image processing is further increased by one step than in the converted image B Image C ”.

  In this way, when the converted image is visibly displayed on the display panel of the display unit 120, the display control unit 114 performs the same type of image processing with different parameters currently applied to the converted image being displayed. Apply (step S206). By executing this operation until the touch position is moved by the touch sensor or the touch is ended (detected by detecting the contact position by the sensor control unit 113 or the like) or the end of the changeable parameter range is detected. (Step S207: No), while the finger touch is performed on the touch sensor, for example, as shown in FIG. 9, the display is displayed so as to gradually change from the converted image A to the converted image C. At this time, the display control unit 114 is displayed so as to gradually change from the converted image A to the converted image C by waiting for a predetermined time each time it is determined No in the process of step S207.

  Here, as an example, the parameter in which the image processing application level is the weakest is set as the initial value and the application level is increased. However, the parameter in which the image processing application level is the strongest is set as the initial value, and the application level is May be displayed so as to weaken.

  Alternatively, the style of the converted image may be changed by sequentially changing the style of the converted image (for example, by changing the style of the style in the order of oil painting style, tearing style, and ink style). In this case, in step S206 that is repeatedly performed, the display control unit 114 sequentially generates converted image data of different types of styles based on the original image data held by the image data acquisition unit 111 (generates a converted image). ), A converted image represented by the generated converted image data may be displayed on the display unit 120. It is assumed that the order of the types of styles to be converted is set in advance by user designation or the like. Note that necessary data and the like in this case are recorded in the storage unit 160 and used by the display control unit 114.

  Then, when the sensor control unit 113 determines the end of the touch based on the detection signal from the sensor unit 130, or the image processing parameter by the display control unit 114 reaches the upper limit or the lower limit of the applicable range (step S207: Yes). ), This process is terminated, and the flow returns to the “touch-linked display process” (FIG. 4).

  In the above operation example, the processing is ended by the end of the parameter range. However, when the finger touch is continued even after reaching the upper limit or lower limit of the parameter, for example, the increase / decrease of the parameter is reversed. The display may be continued.

  In the “touch-linked display process” flow returned from “display change process (2)”, the processes after step S12 are performed until the end event related to “touch-linked display process” occurs (step S16: No). .

  Next, an operation example when the detected finger touch position is the “left region” (step S15: No) will be described. In this case, “normal display switching processing” is executed (step S300). In this embodiment, when the default original image is displayed, when a finger touch on the touch sensor is slid to the right, an operation rule for switching the original image to another original image is set. And That is, an operation of switching display photographs one after another as is generally performed in a normal digital photo frame is performed.

  In this case, if the first touch position is the “left region”, there is a high possibility of sliding in the right direction. Therefore, in such a case (step S15: No), the “normal display switching process” is performed. .

  The above-described “display change process (1)” (FIG. 5) is executed when a touch position in the right region that is highly likely to slide in the left direction is detected. If the slide detected first is in the right direction (step S114: No), the original image is switched and displayed by executing a normal display switching process.

  In the “touch-linked display process” (FIG. 4) after the above processes are performed, the process ends when an end event related to the process occurs (step S <b> 16: Yes).

  As described above, when each process described above is executed in the digital photo frame 100 according to the present embodiment, when applying and displaying image processing such as an art filter on a photographic image displayed in the digital photo frame, Compare the original image and the converted image, or compare the degree of application of image processing in the converted image, etc. by intuitive operation, and easily select the image that suits the user's preference Can do.

  In the embodiment described above, the sensor control unit 113 detects a contact position that is a position where the user performs a contact operation on the sensor unit 130 by the sensor unit 130 for detecting a contact operation from the user by the above operation. Further, the image data acquisition unit 111 acquires original image data representing the original image by the above operation. Further, the area setting unit 112 sets the area AR and the area PR in the original image represented by the original image data acquired (stored here) by the image data acquisition unit 111 as the touch positions detected by the sensor control unit 113. Set accordingly. Further, the display control unit 114 changes the style of the area AR of the first image represented by the image data based on the image data acquired by the image data acquisition unit 111 and the area AR and the area PR set by the area setting unit 112. The generated second image (the image processed in the area AR) is generated, and the generated second image is displayed on the display unit 120. The area AR and the area PR are adjacent to each other along a predetermined direction (here, the horizontal direction on the screen, the long direction of the touch sensor), and the area setting unit 112 has detected by the sensor control unit 113. When the touch position moves, the boundary between the area AR and the area PR is moved according to the movement of the touch position (here, in parallel with the direction of the touch movement).

  In the present embodiment, with the above configuration, the converted image area and the original image area are divided and displayed for one image, and the boundary of these areas changes according to the contact position by the contact operation. That is, since the boundary between the region AR and the region PR in the second image displayed on the display unit 120 is changed by the contact operation, the user can change the original image and the image after image processing (converted image) to the user's image. You can compare intuitively in conjunction with the operation.

  The sensor unit 130 includes at least one touch sensor that is parallel to at least one direction (here, the horizontal direction (long direction)) of the display screen of the display unit 120. Thereby, the moving direction of the boundary between the region AR and the region PR can be made parallel to the long direction of the touch sensor, and the user can operate the original image and the image after image processing (converted image) by the user's operation. Intuitive comparison can be made in conjunction with (finger position). In particular, here, since the position of the finger is at the same position in the vertical direction as the boundary between the area AR and the area PR, the user can easily grasp the positional relationship between the boundary and the finger. Further, since the touch sensor is formed on the housing of the digital photo frame 100, the display screen of the display unit 120 is not soiled by the contact operation.

  Further, in the above, the style change (image processing) is automatically performed by the slide operation of the touch sensor without any other operation.

(Embodiment 2)
Each process illustrated in the first embodiment is a basic operation, and various display processes using a touch sensor are performed by changing the combination of target images and the correspondence between the direction of the finger slide and the operation. Can be done.

  For example, in Embodiment 1 described above, the operation (“display change process (2)”) of gradually changing the application degree of the image processing in the converted image when the touch on the touch sensor does not slide is illustrated. Such an operation may be combined with the operation exemplified in the “display change process (1)”.

  For example, as illustrated in FIG. 10, when the finger slide is stopped after performing the operation of displaying the converted image A in the area AR that is dynamically defined according to the finger slide on the touch sensor (that is, predetermined When the touch position stays at the same position for a period of time), the converted image displayed in the area AR at that time gradually changes from the converted image A to the converted image C (at predetermined time intervals). May be displayed. This gradually changes the degree of change in the style of the converted image. Thus, the user can confirm the change in the style by changing the degree of the change in the style of the area AR according to the period during which the touch position does not change.

  Further, the method of gradually changing the converted image in this way is arbitrary. For example, as shown in FIG. 11, the converted image A is converted into an area AR based on the left finger slide in the state where the original image is displayed. Is displayed. When a finger slide in the right direction is detected, the converted image B is displayed in the area AR based on the slide. Similarly, in the subsequent finger slide in the left direction, the converted image C is displayed in the area AR. That is, the conversion image changes from the original image to the conversion image A, from the conversion image A to the conversion image B, and from the conversion image B to the conversion image C according to the reciprocation of the finger slide on the touch sensor (reciprocation of the touch position). In other words, it is possible to perform image processing in which the degree of change in the style of the converted image gradually changes. Thereby, the user can confirm the change in the style by a slide operation or the like.

  As described above, the style of the converted image may be changed by sequentially changing the style of the converted image (for example, by changing the style in the order of oil painting style, tearing style, and ink style). As a result, the user can confirm the change in the style of expression. Alternatively, the user can confirm the change of the expression method of the style by a slide operation or the like.

(Embodiment 3)
In the above embodiment, an example of the digital photo frame 100 (FIG. 1) provided with one touch sensor (sensor unit 130) in the vicinity of the display panel (display unit 120) is shown. Is optional, and for example, a digital photo frame 100 having an appearance configuration as shown in FIG.

  That is, as shown in FIG. 12A, two touch sensors A and B (sensor unit 130) parallel to the display panel (display unit 120) in the longitudinal direction are arranged in the vicinity of the upper and lower sides of the display panel. It may be a digital photo frame 100 arranged in the frame.

  In this case, the allocation of each process exemplified in the first embodiment can be changed depending on which touch sensor is touched, and operations for realizing more various display processes can be easily performed.

  For example, a display processing operation for the original image can be assigned to the upper touch sensor A, and a display processing operation for the converted image can be assigned to the lower touch sensor B. Thereby, for example, according to the order of the plurality of original images to be displayed according to the direction of the finger slide detected by the touch sensor A on the upper side, the original images before and after the currently displayed original image are displayed. Switch display. When a touch on the lower touch sensor B is detected in a state where the original image is displayed, the screen is switched to a converted image of the currently displayed original image, and a finger slide is further performed on the lower touch sensor B. Is detected, the display switching for the converted image is performed according to the slide direction (for example, the display switching for displaying the previous and next converted images corresponding to the display order of the original image to be displayed). Display control can be performed.

  Alternatively, for example, the area AR and the area PR may be set by using two fingers simultaneously. That is, as shown in FIG. 12B, the display screen is divided into two areas by a straight line connecting the touch position on the touch sensor A and the touch position on the touch sensor B, and one of the areas is an area AR. , And let the other be a region PR. In this case, the ratio and shape of the area change according to the change of the touch position on each touch sensor, but even in such a case, image processing corresponding to the sequentially set areas can be performed. The original image and the converted image, or the screen on which the plurality of converted images are combined can be displayed so as to change dynamically.

(Embodiment 4)
In each of the above embodiments, the configuration in which the touch sensor is disposed in the vicinity of the display panel is illustrated, but a so-called touch panel (display unit 120 + sensor) in which the display panel (display unit 120) has the function of the touch sensor (sensor unit 130). Part 130) may constitute the digital photo frame 100.

  In this case, each process described above can be performed according to touch or slide on the touch panel (particularly, the touch panel area is divided into “left area”, “center area”, and “right area” as described above). Depending on which region the contact position is in, the display change processing (1) and (2) or display switching processing can be performed). Further, if the processing method is different by detecting the contact area Can be made. For example, as shown in FIG. 13A, when it is detected that the entire finger is slid on the touch panel based on the contact area detected by the touch panel (when the contact area is large), the slide is performed. The boundary between the area AR and the area PR is set in accordance with the position of the finger that is present. On the other hand, when it is detected that the fingertip has slid on the touch panel based on the contact area on the touch panel (when the contact area is small), for example, display switching between the original images (the currently displayed source) Switching to the original image before and after the image) can be performed. That is, two types of processing of displaying the second image or switching the display may be performed according to the size of the contact area. Here, the large contact area means that the size of the contact area satisfies a predetermined standard (for example, exceeds a predetermined threshold), and the small contact area means that the size of the contact area is a predetermined standard. (For example, below a predetermined threshold).

  As described above, the sensor control unit 113 detects the contact area by the contact operation to the sensor unit 130, and the display control unit 114 displays the second image when the size of the contact area satisfies a predetermined criterion. Processing to be displayed on the unit 120 is performed. Further, when the size of the contact area does not satisfy a predetermined criterion, the image data acquisition unit 111 is different from the image data (image data currently held) about the image currently displayed on the display unit 120. Image data (original image data) is acquired. The display control unit 114 displays the original image represented by the original image data on the display unit 120 based on the original image data newly acquired by the image data acquisition unit 111. Thereby, the display control unit 114 performs a process of switching an image already displayed on the display unit 120 to another image. With the above processing, the user's convenience is improved because the two processes of displaying the table second image or switching the display are performed by a similar operation.

  In addition, in the case of a touch panel that supports so-called multi-touch, an area can be designated by two points designated on the screen. Thereby, for example, as shown in FIG. 13B, a rectangular area having a diagonal line between two points designated by finger touch on the screen can be set as the area AR.

  The area AR designated by such a finger touch can be a rectangular area defined by the designated two points, or may have a shape indicating a trajectory of finger movement on the touch panel, for example. In this case, display control can be performed so that only the part traced on the touch panel becomes a converted image.

  That is, by directly touching the image displayed on the display panel (display unit 120), comparison between the original image and the converted image, confirmation of the image processing effect, and the like can be performed more intuitively.

(Modification)
The said embodiment is an example and the application range of this invention is not restricted to this. That is, various applications are possible, and all embodiments are included in the scope of the present invention.

  For example, the detection method, shape, size, arrangement position, and the like of the touch sensor exemplified in the above embodiment are merely examples, and any touch sensor may be used as long as it can perform detection capable of realizing the operations related to each process described above. it can.

  Further, in the “display change process (2)” (FIG. 6) illustrated in the above embodiment, the image processing parameters are varied according to the touch time. If a touch sensor capable of detecting (pressing force in the contact operation) is used, the image processing parameters may be changed according to the detected touch intensity. Such processing can also be applied to the second embodiment. Naturally, the style of the style may be changed according to the touch intensity.

  Moreover, although the example which performs a process according to the direction of the finger slide on a touch sensor was shown in the said embodiment, not only a direction but the speed of a slide is detected and the process according to the detected speed is shown, for example. You may make it perform.

  Depending on the content of the contact operation detected by the sensor unit as described above (the above-mentioned pressing force, slide speed, etc.), the degree of change in the style of the converted image or the type of style can be changed. The user can confirm the change of the style or the change of the style of expression. Alternatively, the user can check the change in the style or the change in the style of expression by a slide operation or the like.

  In the above-described embodiment, the touch sensor detects a touch with a finger. However, the present invention is not limited to this. For example, even if each process is performed by detecting a touch using a stylus pen or the like. Good.

  In the above description, the case where the image processing is processing for changing the style has been described. However, the image processing may be other image processing such as correction processing such as brightness correction and red-eye correction. In this case, the nature of the degree of image processing is the same as described above. Here, the degree of image processing is, for example, a parameter (consisting of a numerical value that defines brightness) or the like used in correction processing or the like.

  It should be noted that the present invention can be realized by a display control device having the same functions and configurations as those of the digital photo frame 100 of the above embodiment, and also by applying a program to an existing display control device (such as a digital photo frame). The display control device according to the present invention can be made to function. In this case, the function of the control unit 110 described above is added to a computer (a control unit such as a CPU) of the display control device having the same configuration as the touch sensor (sensor unit 130) included in the digital photo frame 100 illustrated in the above embodiment. By executing a program for realizing the same function as the above, it is possible to function as a display control apparatus according to the present invention.

  In the above embodiment, a digital photo frame is shown as an example of the display control device, but any display control device having the same configuration as the touch sensor (sensor unit 130) illustrated in the above embodiment may be used. The display control apparatus according to the present invention can be realized by, for example, a digital camera or a personal computer.

  In any case, by applying the program, it is possible to make an existing device function as the display control device according to the present invention. The application method of such a program is arbitrary. For example, the program can be applied by being stored in a storage medium such as a CD-ROM, a memory card, a RAM, and a ROM, or can be applied via a communication medium such as the Internet. it can.

DESCRIPTION OF SYMBOLS 100 ... Digital photo frame 110 ... Control part 111 ... Image data acquisition part 112 ... Area setting part 113 ... Sensor control part 114 ... Display control part 120 ... Display part 130 ... Sensor part 140 ... Operation part , 150 ... I / F section, 160 ... storage section, AR ... area, PR ... area

Claims (8)

Sensor control means for detecting a contact position, which is a position where the user performs a contact operation in the sensor unit, with a sensor unit for detecting a contact operation from a user;
Image data acquisition means for acquiring image data representing the first image;
Area setting means for setting the first area and the second area in the first image represented by the image data acquired by the image data acquisition means according to the contact position detected by the sensor control means;
Based on the image data acquired by the image data acquisition means and the first area and the second area set by the area setting means, image processing is performed on the first area of the first image represented by the image data. Display control means for generating a second image subjected to the above and displaying the generated second image on the display unit,
The first region and the second region are adjacent to each other along a predetermined direction,
The area setting means moves the boundary between the first area and the second area according to the movement of the contact position when the contact position detected by the sensor control means moves.
A display control device characterized by that. The sensor unit includes at least one touch sensor parallel to at least one direction of the display screen of the display unit,
The display control apparatus according to claim 1. The display control means changes the degree of the image processing for the first area or changes the type of the image processing for the first area according to the reciprocal movement of the contact position detected by the sensor control means. Let
The display control apparatus according to claim 1, wherein the display control apparatus is a display control apparatus. The display control means changes the degree of the image processing for the first area or changes the type of the image processing for the first area according to a period during which the contact position detected by the sensor control means does not change. To change,
The display control device according to claim 1, wherein the display control device is a display control device. The sensor control means further detects the content of the contact operation by the sensor unit,
The display control unit changes the degree of the image processing for the first region or changes the type of the image processing for the first region according to the content of the contact operation detected by the sensor control unit. ,
The display control apparatus according to claim 1, wherein the display control apparatus is a display control apparatus. The content of the contact operation is a pressing force in the contact operation.
The display control apparatus according to claim 5. The sensor control means detects a contact area by the contact operation to the sensor unit,
The image data acquisition means acquires other image data different from the acquired image data;
The display control means performs a process of displaying the second image on the display unit when the size of the contact area satisfies a predetermined criterion, and the size of the contact area does not satisfy the predetermined criterion. In addition, based on the other image data acquired by the image data acquisition unit, another image represented by the other image data is displayed on the display unit, so that an image already displayed on the display unit is displayed. A process of switching to the other image,
The display control apparatus according to claim 1, wherein the display control apparatus is a display control apparatus. On the computer,
Sensor control means for detecting a contact position, which is a position where the user performs a contact operation in the sensor unit, with a sensor unit for detecting a contact operation from a user;
Image data acquisition means for acquiring image data representing the first image;
Area setting means for setting the first area and the second area in the first image represented by the image data acquired by the image data acquisition means according to the contact position detected by the sensor control means;
Based on the image data acquired by the image data acquisition means and the first area and the second area set by the area setting means, image processing is performed on the first area of the first image represented by the image data. And a display control means for displaying the generated second image on the display unit,
The first region and the second region are adjacent to each other along a predetermined direction,
The area setting means moves the boundary between the first area and the second area according to the movement of the contact position when the contact position detected by the sensor control means moves.
A display control program characterized by that.

Images