JP5800216B2 - Image processing apparatus, image processing method, and image processing program - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, and an image processing program for causing the image processing apparatus to function.

  In recent years, with the widespread use of mobile phones, digital cameras, the Internet, etc., various digital images can be easily obtained, and their display methods are diversified. For example, a method of displaying the digital image as it is on a display of a mobile phone or a digital camera, a monitor of a personal computer, or a display unit of a digital photo frame, or a method of displaying in a slide show format is known. Furthermore, in recent years, there is also known a method of displaying a photographic image obtained as a digital image after converting it into an arbitrary painting style or painting style, which makes it possible to entertain the user with an effective and ingenious manner. A method for displaying a digital image is provided.

  Here, as a method for converting a photographic image into a painting-like image as described above, for example, as described in Patent Document 1, a painting-like image in which the characteristics seen in a painting drawn by a painter are simulated. There is known a method for converting the tone of an image. Specifically, this image tone conversion method first inputs, as input information for conversion processing, an image of a picture drawn by an actual painter in addition to a photographic image that is an original image to be processed, Extract and analyze color information and brushstroke information from the artist's image. Then, based on the analyzed information, the color of the original image is simulated and a brush stroke is arranged to generate a painting-like image having characteristics seen in the painting drawn by the painter.

JP 2004-213598 A

  In the above-described image tone conversion method described in Patent Document 1, the color of the original image is simulated based on the analysis information of the painter image input in advance by the user, and the touch is arranged to simulate the painter image. A picture-like image is generated. However, in this style conversion method, there is only one feature (style) of a picture to be simulated, and a picture-like image obtained by selecting one of a plurality of styles and converting the original image into the selected style. Could not produce. That is, the user cannot be involved in creating a painting-like image, and the user can simply appreciate the completed painting-like image. Therefore, in the above-described image tone conversion method, the user's interest in image conversion cannot be increased, and the interest is not sufficient.

  Therefore, in view of the above-described problems, the present invention generates a painting-like image by selecting an arbitrary style from a plurality of styles and converting the original image into the style according to the intuitive operation of the user. Accordingly, an object of the present invention is to provide an image processing apparatus, an image processing method, and an image processing program for causing the image processing apparatus to function, which can increase the user's interest in image conversion.

An image processing apparatus according to the present invention includes:
Original image storage means for storing original image data;
Style selection means for selecting one style from among a plurality of styles according to a variable value determined according to the degree of user input operation ;
Image conversion means for converting the original image so as to be the one style selected by the style selection means, and generating a converted image,
The variable value defines at least one of a speed of the user input operation, a duration of the user input operation, and a strength of the user input operation. .

An image processing method according to the present invention includes:
In an image processing method for converting an original image and generating a converted image,
A variable value determination process that determines the value of a variable that defines the degree of user input action;
Style selection processing for selecting one style from a plurality of styles according to the determined variable value ;
An image conversion process for generating the converted image by converting the original image so as to have the selected one style ;
Including
The variable value defines at least one of a speed of the user input operation, a duration of the user input operation, and a strength of the user input operation. .

An image processing program according to the present invention includes:
An image processing program for causing a computer to control an image processing apparatus, converting an original image, and generating a converted image,
A variable value determination process that determines the value of a variable that defines the degree of user input action;
Style selection processing for selecting one style from a plurality of styles according to the determined variable value ;
An image conversion process for generating the converted image by converting the original image so as to have the selected one style ;
And execute
The variable value defines at least one of a speed of the user input operation, a duration of the user input operation, and a strength of the user input operation. .

  According to the present invention, an arbitrary style is selected from a plurality of styles according to the intuitive operation of the user, and a painting style image obtained by converting the original image into the style is generated. Increase interest.

It is a schematic block diagram which shows the hardware constitutions of 1st Embodiment of the image display apparatus to which the image processing apparatus which concerns on this invention is applied. It is a flowchart which shows the image conversion process applied to the image processing method which concerns on 1st Embodiment. It is a schematic explanatory drawing which shows an example of the operation method relevant to the image conversion process which concerns on 1st Embodiment, and an image display state. It is a schematic explanatory drawing which shows the other example of the area | region designation | designated method relevant to the image conversion process which concerns on 1st Embodiment. It is a flowchart which shows the image conversion process applied to the image processing method which concerns on 2nd Embodiment. It is a schematic explanatory drawing which shows an example of the area | region designation | designated method and image display state relevant to the image conversion process which concerns on 2nd Embodiment. It is a flowchart which shows the image conversion process applied to the image processing method which concerns on 3rd Embodiment. It is a schematic explanatory drawing which shows an example of the area | region designation | designated method relevant to the image conversion process which concerns on 3rd Embodiment. It is a schematic explanatory drawing which shows the other example of the area | region designation | designated method and image display state relevant to the image conversion process which concerns on 4th Embodiment. It is a schematic block diagram which shows the hardware constitutions of the image display apparatus which concerns on the 5th Embodiment of this invention. It is the schematic (the 1) which shows the structural example of the electronic device carrying the image display apparatus to which the image processing apparatus which concerns on this invention is applied. It is the schematic (the 2) which shows the structural example of the electronic device carrying the image display apparatus to which the image processing apparatus which concerns on this invention is applied.

Hereinafter, an image processing apparatus, an image processing method, and an image processing program according to the present invention will be described in detail with reference to embodiments.
<First Embodiment>
(Image processing device / image display device)
First, a hardware configuration of an image display apparatus to which the image processing apparatus according to the present invention is applied will be described.

  FIG. 1 is a schematic block diagram showing a hardware configuration of a first embodiment of an image display apparatus to which an image processing apparatus according to the present invention is applied. In FIG. 1, for the sake of illustration, all the arrows indicating the exchange of signals and data between functional blocks are shown. However, in actuality, any one of these or a plurality of them is effective. Predetermined processing is executed.

As shown in FIG. 1, the image display apparatus 10 according to the present embodiment includes a data processing unit (image conversion unit) 20 and a user interface unit (hereinafter referred to as a user I / F unit) 30. . The data processing unit 20 includes a central processing unit (Central Processing Unit; hereinafter referred to as CPU: variable value determination means, style selection means) 21 and a read only memory (hereinafter referred to as ROM) 22. And random access memory (Random
Access Memory (hereinafter referred to as RAM) 23, internal memory (original image storage means) 24, display control unit 25, and image processing unit 26.

  The user I / F unit 30 includes a display unit (display unit) 31 including a liquid crystal display panel, an operation switch, and the like. The user I / F unit 30 includes an operation unit 32 that receives a user instruction operation and a touch panel. An input unit (position detection unit) 33 that receives an instruction operation corresponding to an intuitive (or sensory) operation, a communication unit (communication unit) 34 that controls communication with an external device, and image data And a memory interface unit (hereinafter referred to as a memory I / F unit) 35 that reads and writes data from and on a removable storage medium 40 such as a stored memory card.

  The ROM 22 includes, for example, various processes related to image display and reproduction, including an image conversion process described later, a display control unit 25, an image processing unit 26, a display unit 31, an operation unit 32, an input unit 33, and a communication unit 34. In addition, various programs (software) for executing various functions including the memory I / F unit 35 are stored. The CPU 21 performs processing according to a program stored in the ROM 22 to thereby display the display control unit 25, the image processing unit 26, the display unit 31, the operation unit 32, the input unit 33, the communication unit 34, the memory I / F unit 35, and the like. Various functions are realized. In particular, in the present embodiment, the CPU 21 reads out and executes a program for executing the image conversion process stored in the ROM 22, whereby the image processing unit 26 inputs input data to be described later with respect to the image data of the original image. The image conversion process is executed in a specific style determined according to the intuitive operation of the user input via the unit 33.

  The RAM 23 appropriately stores data necessary for the CPU 21 to execute various processes. For example, an original image to be subjected to an image conversion process to be described later and image data of a painting-like image (converted image) generated by the image conversion process are stored in the RAM 23. The internal memory 24 includes a dynamic random access memory (hereinafter referred to as DRAM), a ROM, and the like. The DRAM constitutes a display buffer for temporarily storing image data generated by an image conversion process described later, and constitutes a work area for the CPU 21. The ROM stores, for example, various parameters relating to image conversion processing, image display, and reproduction described later. The internal memory 24 stores an original image captured via a removable storage medium 40 such as a memory card or a communication line, or a picture-like image generated by executing a predetermined image conversion process by the image processing unit 26. A display memory area for temporarily storing and reading image data is also included.

  The display control unit (display control unit) 25 reads the image data stored in the display memory area of the internal memory 24 and causes the display unit 31 of the user I / F unit 30 to display an image represented by the image data. Execute control. For example, the display control unit 25 generates an RGB signal based on the image data stored in the internal memory 24 and supplies the RGB signal to the display unit 31, thereby displaying the original image or the painting-like image on the display unit 31. To display.

  The image processing unit 26 is configured by a digital signal processor (DSP) or the like, and executes various image processing such as white balance correction processing and γ correction processing on the image data stored in the internal memory 24. . In addition, in this embodiment, the image processing unit 26 is based on an instruction from the CPU 21 and the user's intuition when the original image temporarily stored in the internal memory 24 is input via the input unit 33 such as a touch panel. One image style is selected from a plurality of styles according to a variable (contact movement speed) that defines an objective or sensory action, and an image conversion process is performed to convert the picture style image to the style.

  Here, the following types of styles can be applied as the styles prepared in advance so as to be selectable in the image conversion process for converting the original image into a picture-like image in the image processing unit 26. In the present embodiment, for example, each painting style corresponding to the genre of painting is applied, such as oil painting style, watercolor painting style, pastel painting style, pencil painting style, crayon painting style, illustration painting style, point drawing style, airbrush painting style. be able to. The present embodiment is not limited to this. For example, the above-described oil painting style is further applied to each style corresponding to the classification such as Van Gogh, Monet, Picasso, etc. based on the characteristics of the painter. It does not depend on the painter's characteristics, for example, it applies each style corresponding to the classification of heavy, gothic, or beast based, for example, based on the characteristics of a general oil painting style. May be. Various parameters applied to the algorithm of the image conversion process for converting into each style are stored in the ROM of the internal memory 24, for example.

  The operation unit 32 is an operation switch provided on the main body of the image display device 10 such as a power button, a zoom key, and a menu setting key, and generates a predetermined operation signal based on each operation by the user. To the CPU 21 of the data processing unit 20. The input unit 33 is a transmissive touch panel provided on the user side (view side) front of the display panel of the display unit 31, for example, and an arbitrary position corresponding to the original image displayed on the display unit 31. Is generated based on an operation instructed by a user touching a touch pen or a finger (hereinafter collectively referred to as a touch pen or the like) and sent to the CPU 21 of the data processing unit 20. As described above, when the user operates the operation unit 32 or the input unit 33, various operation signals are sent to the data processing unit 20, and the CPU 21 executes processing according to the operation signals.

  In particular, in the present embodiment, as a touch panel applied to the input unit 33, an existing position that can detect a contact state (a binary value of contact or non-contact) such as a touch pen with respect to the input unit 33 and a contact position. A detection-type touch panel or a pressure-sensitive touch panel is applied. Thereby, the contact position is detected by the user touching the touch panel at a position corresponding to the image with a touch pen or the like while referring to the image displayed on the display unit 31. Information on the detected contact position is sent to the CPU 21 as an operation signal.

  In the present embodiment, the operation unit 32 and the input unit 33 are set so that various operations particularly related to the image conversion process are possible. For example, when the user operates the menu setting key of the operation unit 32 to designate the image conversion mode, the operation signal is sent to the data processing unit 20, and the CPU 21 performs image conversion processing described later in the image processing unit 26. Sets the image conversion mode to be executed. In addition to the above operation method, the image conversion mode is set by, for example, selecting the input unit 33 at a position corresponding to the menu icon displayed on the display unit 31 with a touch pen or the like, and further selecting the image conversion mode. It may be based on a method of selecting the icon.

  In the present embodiment, as a method of capturing an original image into the data processing unit 20, the original image may be captured via a removable storage medium 40 such as a memory card controlled by the memory I / F unit 35. The communication unit 34 stores the data in an external device such as a mobile phone, a digital camera, a multimedia device, a hard disk device, or a server on the Internet via a communication cable, wireless communication, infrared communication, etc. (not shown). The captured image data may be taken in.

  In the present embodiment, the RGB signal generated by the display control unit 25 is not only output to the display unit 31 but also a communication line or communication cable controlled by the communication unit 34 of the user I / F unit 30. Or via a removable storage medium 40 controlled by the memory I / F unit 35 to an external device (not shown). Thereby, an original image and a picture-like image can be displayed also in external devices such as a television receiver, a personal computer, a digital photo frame, and a projector.

(Image processing method)
Next, an image processing method in the image display apparatus according to the present embodiment will be described.
Here, as described above, the input unit 33 provided in the user I / F unit 30 illustrated in FIG. 1 refers to the image displayed on the display unit 31 by the user, intuitively or intuitively with a touch pen or the like. It is comprised from the position detection type touch panel which can detect the said contact state and contact position by making it contact. Further, the CPU 21 determines the contact status of the touch pen or the like based on an operation signal (contact information and position information) sent from the input unit 33 including the position detection type touch panel, and based on the contact moving speed. Thus, an image style applied to the image conversion process applied to the original image in the image processing unit 26 is determined.

  FIG. 2 is a flowchart showing image conversion processing applied to the image processing method according to the present embodiment. FIG. 3 is a schematic explanatory diagram illustrating an example of an operation method and an image display state related to the image conversion processing according to the present embodiment. In the example of the image display state shown in FIG. 3, for convenience of illustration, the image-converted image (painting-like image) portion is highlighted with a bold line for convenience.

  In the image processing method according to the present embodiment, as shown in the flowchart of FIG. 2, first, the user operates the operation unit 32 of the image display device 10 or displays icons displayed on the display unit 31 such as a liquid crystal display panel. By instructing the input unit 33 to make a selection, the image conversion mode is set from the menu screen Pmen as shown in FIG. 3A (step S111). At this time, the display unit 31 may display in advance an original image to be subjected to the image conversion process. In this image conversion mode, as shown in FIG. 3B, a setting for converting the entire original image (all areas) into a specific style by image conversion processing, and a specification of the original image specified by the user. The setting for converting only the area (designated area) into a specific style may be arbitrarily selected.

  Next, as shown in FIG. 3C, the user refers to the original image PHT displayed on the display unit 31, and enters the input unit 33 such as a touch panel disposed on the front surface (user side) of the display unit 31. In a state where the touch pen PEN or the like is in contact with the touch pen PEN or the like, the information about the touch position of the touch pen PEN or the like is detected by performing a reciprocating motion intuitively or sensibly a plurality of times (see the arrow ARa in the drawing), and the CPU 21 detects the operation signal. (Step S112). The CPU 21 calculates the contact movement speed of the touch pen PEN or the like that is in contact with the input unit 33 based on the position information included in the operation signal and the time information at each position (step S113; variable value determination process).

  Here, as a specific method for calculating the contact moving speed, for example, first, the contact with the input unit 33 by the touch pen PEN or the like is started (contact state is detected), and the CPU 21 starts time measurement. . Information (position information) on the touch position of the touch pen PEN or the like in the input unit 33 at this time is sent to the CPU 21 as an operation signal, converted into the coordinates of the corresponding pixel on the display unit 31 by the CPU 21, and measured as described above. It is stored in the internal memory 24 in association with the specified time (time information). At the same time, the display control unit 25 displays the contact position of the touch pen PEN or the like to the input unit 33 on the pixel corresponding to the contact position on the display unit 31. Here, the detection operation and the time measurement of the contact position of the touch pen PEN or the like are always executed after the contact is started and until the contact ends (a non-contact state is detected). Alternatively, it may be executed periodically at predetermined time intervals. Further, when the position information from the input unit 33 to the CPU 21 is changed by moving the touch pen PEN or the like in an arbitrary direction while the touch pen PEN or the like is in contact with the input unit 33, the CPU 21 The coordinates on the display unit 31 corresponding to the position information are calculated, and the movement length of the touch pen PEN or the like is calculated and stored in the internal memory 24. Note that the above-described control by the display control unit 25, such as displaying the contact position of the touch pen PEN or the like on the input unit 33 on the pixel corresponding to the contact position on the display unit 31, starts the contact. After that, it is executed every time the position information from the input unit 33 to the CPU 21 changes until the contact is completed. When the contact with the input unit 33 by the touch pen PEN or the like is finished (a non-contact state is detected), the CPU 21 finishes the time measurement and moves the touch pen PEN or the like stored in the internal memory 24. From the total of the lengths (corresponding to the locus LOC in FIG. 3C) and the measured contact time, the contact moving speed of the touch pen PEN or the like (= (total of moving lengths) / (contact time Total)) is calculated and stored in the internal memory 24.

  Next, the CPU 21 determines whether the calculated contact movement speed is included in a plurality of preset speed ranges, and sets a specific style according to the contact movement speed. For example, when two speed ranges, a first speed range that is equal to or higher than the reference value and a second speed range that is smaller than the reference value, are set with a specific reference value as a boundary, the above calculation is performed. It is determined whether the contact moving speed is included in the first speed range or the second speed range (step S114). When the contact movement speed is included in the first speed range, for example, a beast-style oil painting tone is set as the first art style applied to the image conversion process (step S115). When the contact movement speed is included in the second speed range, for example, a pastel image tone is set as the second image style (step S116). Thereby, the CPU 21 converts the image from a plurality of styles based on the calculated contact moving speed (that is, the degree of the user's input operation; in this embodiment, the speed of the reciprocating operation of the touch pen PEN or the like). One style applied to the process is selected, and parameters according to the style are set in the image processing unit 26 (style selection process).

  Next, the image processing unit 26 performs image conversion processing on the original image PHT based on the style set according to the contact movement speed, and the style is applied as shown in FIGS. A painting-like image PICa or PICb is generated (step S117; image conversion process). The generated image data of the picture-like image PICa or PICb is temporarily stored in a predetermined display memory area of the internal memory 24, for example. Here, in this image conversion process, for example, as shown in FIGS. 3B and 3C, in a setting for designating a specific area (designated area) SPA to be subjected to the image conversion process in the original image PHT. As shown in FIG. 3D, an area designated when the user reciprocates with the input unit 33 in contact with the touch pen PEN or the like (that is, an area corresponding to the locus LOC or a painted area). Or, only the designated area SPA of the original image PHT corresponding to an area in a predetermined range including the designated area (that is, an area having a predetermined spread with reference to the locus LOC) is a painting to which the above-described style is applied. It is converted into a wind image PICa.

  On the other hand, for example, as shown in FIG. 3B, in the setting that the entire original image PHT is an object of image conversion, as shown in FIG. 3E, it relates to the area designated by the user with the touch pen PEN or the like. Instead, the entire original image PHT (entire area) is converted into a picture-like image PICb to which the above-mentioned style is applied. Next, the picture-like image PICa or PICb image data temporarily stored in the internal memory 24 is read by the display control unit 25, converted into a predetermined display signal, and displayed on the display unit 31 (step S118).

  As described above, in the present embodiment, one style is selected from a plurality of styles in accordance with the degree (contact movement speed) of the user's intuitive or sensory input operation with respect to the displayed original image PHT. The painting-like image PICa or PICb obtained by converting the original image PHT into the painting style can be generated. Therefore, according to the present embodiment, it is possible to present a new image conversion technique for setting a style applied to a picture-like image according to the degree of intuitive or sensory input operation of the user. Therefore, the user's interest in image conversion can be increased.

  In the above-described image conversion process, as a method for designating a region to be subjected to image conversion, as shown in FIG. 3C, a reciprocating operation (arrow ARa) is performed with the user touching the touch pen PEN or the like. ), The region (designated region SPA) consisting of the locus LOC and the painted region, or a region having a predetermined spread with reference to the locus or the painted region is set as the designated region, and the original image PHT is A case has been described in which the touch pen PEN or the like is converted into an image style corresponding to the contact movement speed. The present invention is not limited to this, and the following area designation method can also be applied.

  FIG. 4 is a schematic explanatory diagram illustrating another example of the region specifying method related to the image conversion processing according to the present embodiment. Here, for the sake of clarity, the designated area in the figure is hatched for the sake of convenience.

  In addition to the method described above, the region designation method applicable to the image conversion processing according to the present embodiment refers to the original image PHT displayed on the display unit 31 as shown in FIG. By touching the input unit 33 with a touch pen PEN or the like, an arbitrary region is enclosed by a closed line in a circular shape or a polygonal shape (see arrow ARb in the figure), thereby tracing the line surrounded by the frame. An area inside (inside) the LOC may be set as the designated area SPB. Here, the designated area SPB is not limited to the area inside the locus LOC of the line by the touch pen PEN or the like. For example, as shown in FIG. 4B, each successive point LP on the locus LOC. A region included in a circular region having a predetermined radius r centered at (that is, a region having a continuous width 2r) may also be set in the designated region SPB.

  As another area designation method, as shown in FIGS. 4C and 4D, the user refers to the original image PHT displayed on the display unit 31, and uses the touch pen PEN or the like on the input unit 33. By moving in a straight line shape or a curved line shape so as to correspond to an arbitrary region (see arrows ARc and ARd in the figure) while being in contact, each continuous point LP on the locus LOC of the line is centered. An area included in a circular area having a predetermined radius r (that is, an area having a continuous width 2r) may be set in the designated areas SPC and SPD. Note that the radius r that defines a circular area centered on each point LP on the locus LOC by the touch pen PEN or the like in the area specifying method shown in FIGS. 4B to 4D is set to a predetermined numerical value in advance. For example, on the menu screen as shown in FIGS. 3A and 3B, the user may be able to set an arbitrary numerical value.

  Also in each of these area designation methods, one style is selected from a plurality of styles according to the moving speed of the touch pen PEN or the like that the user intuitively or sensibly moved when the area is designated. The image PHT is converted into a picture-like image PICa or PICb to which the style is applied.

<Second Embodiment>
Next, a second embodiment of an image display apparatus to which the image processing apparatus according to the present invention is applied and an image processing method in the image display apparatus will be described. Here, the second embodiment will be described with reference to the configuration of the image display apparatus and the image processing method described in the first embodiment as appropriate.

  In the first embodiment described above, the original image PHT is referred to according to the moving speed of the touch pen PEN or the like that the user moved intuitively or sensuously with reference to the original image PHT displayed on the display unit 31. Is converted into a picture-like image PICa or PICb (hereinafter collectively referred to as a picture-like image PIC for convenience) to which a specific style is applied. In the second embodiment, one style is selected from a plurality of styles according to the contact time of the touch pen PEN or the like brought into contact with the input unit 33, and the original picture PHT is a picture style image to which the style is applied. It is characterized by converting to PIC.

  In the image display apparatus according to the present embodiment, the contact state and the contact position of the touch pen or the like with respect to the input unit (contact state detection means) 33 are detected, and the touch pen or the like is brought into contact with the input unit 33 by the CPU 21. The contact time from the start to the end of the contact is measured. The CPU 21 determines the contact state of the touch pen or the like to the input unit 33 based on the operation signal (contact information and position information) sent from the input unit 33, and in the image processing unit 26 according to the contact time. An image style to be applied to image conversion processing applied to the original image is determined.

  FIG. 5 is a flowchart showing an image conversion process applied to the image processing method according to the second embodiment. Here, the description of the processing procedure equivalent to that of the first embodiment described above is simplified or omitted.

  In the image display apparatus as described above, the image processing method according to the present embodiment, as shown in the flowchart of FIG. 5, is set to the image conversion mode (step S211) and then as in the first embodiment described above. Unlike the case where the touch pen PEN or the like is moved like a line or a frame in a state where the touch pen PEN or the like is in contact with the input unit 33, the touch pen PEN or the like is moved to any same or substantially the same position of the input unit 33 for any time, Continue to touch and indicate a specific point. Thereby, information related to the contact position of the touch pen PEN or the like is detected and sent to the CPU 21 as an operation signal. At this time, the CPU 21 starts from the time when the touch pen PEN or the like starts to contact the input unit 33 based on the information (contact information) related to the contact state (contact or non-contact binary) included in the operation signal. Time (contact time) is measured (step S212; variable value determination processing).

  Next, the CPU 21 determines whether the measured contact time is included in any of a plurality of preset time ranges, and sets a specific style according to the contact time. For example, when two time ranges of a first time range that is equal to or greater than the reference time and a second time range that is shorter than the reference time are set with a specific reference time as a boundary, the measured contact It is determined whether the time is included in the first time range or the second time range (step S213). When the contact time is included in the first time range, for example, a beast-style oil painting tone is set as the first style applied to the image conversion process (step S214), When the time is included in the second time range, for example, a pastel image tone is set as the second image style (step S215). Thereby, the CPU 21 performs image conversion processing from a plurality of styles based on the measured contact time (that is, the degree of user input operation; in this embodiment, the duration of the contact operation of the touch pen PEN or the like). Is selected, and a parameter corresponding to the style is set in the image processing unit 26 (style selection process).

  Next, the image processing unit 26 performs image conversion processing on the original image PHT based on the style set according to the contact time, thereby generating a picture style image PIC (PICa or PICb) to which the style is applied. (Step S216; image conversion process) and temporarily stored in a predetermined display memory area of the internal memory 24. Here, in this image conversion process, the area of the original image PHT to be subjected to the image conversion process may be set to a specific area (specified area) based on an area specifying method described later. Alternatively, it may be set in the entire area of the original image PHT. Then, the image data of the picture-like image PIC temporarily stored in the internal memory 24 is read by the display control unit 25, converted into a predetermined display signal, and displayed on the display unit 31 (step S217).

Next, an area designation method related to the image conversion process according to the present embodiment will be described.
FIG. 6 is a schematic explanatory diagram illustrating an example of a region designation method and an image display state related to the image conversion processing according to the present embodiment. Here, for the sake of clarity, the designated area in the figure is hatched for the sake of convenience.

  For example, as shown in FIG. 6A, the region designation method applicable to the image conversion process according to the present embodiment described above refers to the original image PHT displayed on the display unit 31 by the user. By bringing the touch pen PEN or the like into contact with an arbitrary point LP, a circular area having a predetermined radius r centered on the point LP can be set as the designated area SPE. Here, the radius r that defines the designated region SPE may be set to a predetermined numerical value in advance, and, for example, as in the first embodiment described above, for example, FIGS. In the menu screen as shown in (1), the user may be able to set an arbitrary numerical value.

  Further, as another region designation method, as shown in FIGS. 6B and 6C, the radius r that defines the circular region is set according to the time when the user makes the touch pen PEN or the like contact the input unit 33. The designated area SPE having an arbitrary size may be set by sequentially changing (increasing or decreasing).

  As described above, in the present embodiment, 1 is selected from a plurality of styles according to the variable (length of contact time) that defines the degree of the intuitive input operation or the sensory input operation of the user with respect to the displayed original image PHT. By selecting two styles of painting, for example, as shown in FIGS. 6D and 6E, a picture style picture PICa or PICb obtained by converting the original image PHT into the style can be generated. Note that FIG. 6D corresponds to FIG. 3D in the first embodiment, and only the specific designated area SPE of the original image PHT designated by the area designation method described above is converted into an arbitrary style. FIG. 6E corresponds to FIG. 3E in the first embodiment, and FIG. 6E shows a picture-like image PICb obtained by converting the entire original image PHT (all areas) into an arbitrary style. Indicates.

  Accordingly, in this embodiment as well, as in the first embodiment described above, a new style of setting a style to be applied to a painting style image is set according to the degree of the intuitive or sensory input operation of the user. Since an image conversion method can be presented, the user's interest in image conversion can be increased.

<Third Embodiment>
Next, an image display apparatus to which the image processing apparatus according to the present invention is applied and an image processing method in the image display apparatus according to a third embodiment will be described. Here, the third embodiment will be described with appropriate reference to the configuration of the image display device and the image processing method shown in the first and second embodiments described above.

  In the first and second embodiments described above, with reference to the original image PHT displayed on the display unit 31, the moving speed and contact time of the touch pen PEN or the like that the user has moved intuitively or sensibly is determined. Accordingly, a case has been described in which one style is selected from a plurality of styles and the original image PHT is converted into a picture-like image PIC to which the style is applied. In the third embodiment, one style is selected from a plurality of styles in accordance with the pressing force of the touch pen PEN or the like brought into contact with the input unit 33, and the original style PHT is a painting style image to which the style is applied. It is characterized by converting to PIC.

  In the image display apparatus according to the present embodiment, the input unit (force detection unit) 33 refers to the original image displayed on the display unit 31 at least by the user and touches the touch pen etc. intuitively or sensorily. It is composed of an existing pressure-sensitive touch panel that can detect the contact position and the pressing force at the time. Further, the CPU 21 determines a contact state of the touch pen or the like to the input unit 33 based on an operation signal (position information and pressure information) sent from the input unit 33 including the pressure-sensitive touch panel, and the pressing force. Accordingly, the image processing unit 26 determines an image style to be applied to the image conversion process performed on the original image.

  FIG. 7 is a flowchart showing an image conversion process applied to the image processing method according to the third embodiment. FIG. 8 is a schematic explanatory diagram illustrating an example of an operation method and an image display state related to the image conversion processing according to the present embodiment. Here, description of processing procedures equivalent to those in the first and second embodiments described above is simplified or omitted.

  In the image processing method according to the present embodiment, as shown in the flowchart of FIG. 7, after the image conversion mode is set (step S311), for example, as shown in FIG. 8A, the user is displayed on the display unit 31. With reference to the image, the touch pen PEN or the like is pressed against the input unit 33 with an arbitrary force intuitively or sensuously (refer to the arrow ARz in the drawing) so as to reciprocate so as to designate an arbitrary region ( By referring to the arrow ARa in the figure, information (contact information) regarding the contact position of the touch pen PEN or the like and information (pressure information) regarding the pressing force of the touch pen PEN or the like is detected and sent to the CPU 21 as an operation signal. (Step S312). The CPU 21 associates the position information included in the operation signal with the pressure information at each position, and sequentially stores the position information in a predetermined memory area of the internal memory 24 for each position information. Here, when the pressing force of the touch pen PEN or the like changes in a state where there is no change in the position information, the CPU 21 changes the value of the pressing force after the change from the value already stored in the internal memory 24. If it is larger, the pressure value after the change is overwritten and stored in a predetermined memory area of the internal memory 24. Then, the CPU 21 detects a non-contact state of the touch pen PEN or the like based on the position information included in the operation signal and the pressure information at each position, and represents the representative value of each pressing force stored in the internal memory 24 ( In the present embodiment, a maximum value or an average value) is calculated (step S313; variable value determination process).

  Here, a specific method for calculating the representative value of the pressing force is, for example, when the touch pen PEN or the like starts contact with the input unit 33 (contact state is detected), and the touch pen PEN is input from the input unit 33. The information on the contact position (position information) and the information on the pressing force (pressure information) are sent to the CPU 21 as operation signals. The CPU 21 calculates the coordinates of the corresponding pixel on the display unit 31 based on the operation signal, and stores the calculated coordinates and the pressing force at the coordinates in the internal memory 24 in association with each other. Here, the detection operation of the pressing force of the touch pen PEN or the like is based on the positional information (in other words, the calculated coordinates) until the contact is completed (a non-contact state is detected) after the contact is started. ) Is executed each time a change is detected. Further, when the pressing force of the touch pen PEN or the like changes in a state where the position information is not changed, the internal memory 24 is associated with the value of the pressing force after the change and the coordinates calculated based on the position information. Is compared with the value already stored in the memory, and the larger pressing force value is overwritten in the internal memory 24. As a result, the maximum value of the pressing force at each coordinate is always updated and stored. Then, when the contact with the input unit 33 by the touch pen PEN or the like is completed (a non-contact state is detected), the CPU 21 performs an image described later based on the pressing force for each coordinate stored in the internal memory 24. The following representative pressure values for determining the style applied to the conversion process are calculated and stored in the internal memory 24. Specifically, as a first example, the maximum of the pressing forces of all coordinates detected during a period (contact period) in which the touch pen PEN or the like is in contact with the input unit 33 and stored in the internal memory 24 is the maximum. The value of the pressing force becomes a representative value. As a second example, the average value of the pressing force of all coordinates detected and stored during the contact period is used as a representative value. Here, the average value of the pressing force of all the coordinates is expressed by the following equation.

  Next, in the CPU 21, the representative value of the stored pressing force (the maximum value of the pressing force of all coordinates or the average value of the pressing force of all coordinates) is included in any of a plurality of preset pressure ranges. And a specific style is set according to the representative value. For example, when two pressure ranges of a first pressure range that is equal to or higher than the reference value and a second pressure range that is smaller than the reference value are set with a specific reference value as a boundary, the above calculation is performed. It is determined whether the representative value is included in the first pressure range or the second pressure range (step S314). When the representative value is included in the first pressure range, for example, a beast-style oil painting tone is set as the first style applied to the image conversion process (step S315), while the representative value When the value is included in the second pressure range, for example, a pastel image tone is set as the second image style (step S316). Thus, the CPU 21 applies the image conversion process from a plurality of styles based on the magnitude of the pressing force (that is, the degree of the user's input operation; the strength of pressing the touch pen PEN or the like in the present embodiment). One style is selected, and parameters according to the style are set in the image processing unit 26 (style selection process).

  Next, the image processing unit 26 performs image conversion processing on the original image PHT based on the image style set according to the representative value of the pressing force, so that the picture-like image PIC (PICa or PICb) to which the image style is applied. Is generated (step S317; image conversion process) and temporarily stored in a predetermined display memory area of the internal memory 24. Here, in this image conversion process, the area of the original image PHT to be subjected to the image conversion process may be set to a specific area (specified area) based on an area specifying method described later. Alternatively, it may be set in the entire area of the original image PHT (see FIGS. 3D and 3E shown in the first embodiment). Then, the image data of the picture-like image PIC temporarily stored in the internal memory 24 is read by the display control unit 25, converted into a predetermined display signal, and displayed on the display unit 31 (step S318).

Next, an area designation method related to the image conversion process according to the present embodiment will be described.
FIG. 8 is a schematic explanatory diagram illustrating an example of a region designation method related to the image conversion processing according to the present embodiment. Here, for the sake of clarity, the designated area in the figure is hatched for the sake of convenience.

  For example, as shown in FIG. 8A, the region designation method applicable to the image conversion process according to the present embodiment described above refers to the original image PHT displayed on the display unit 31 and the input unit 33. When the touch pen PEN or the like is pressed with an arbitrary force (see the arrow FCa in the drawing), the locus of the touch pen PEN or the like is moved intuitively or sensuously multiple times (see the arrow ARa in the drawing). An area corresponding to the LOC is designated as a specific area (designated area) to be subjected to image conversion processing. Here, as in the first embodiment described above, the designated area is not limited to the area designated by the touch pen PEN or the like (the area formed by the locus LOC or the filled area), and the designated area is based on the locus LOC. And may include a region having a predetermined spread.

  Further, as another region designation method, as shown in FIG. 8B, the user refers to the original image PHT displayed on the display unit 31 and uses the touch pen PEN or the like on the input unit 33 with any force (see FIG. 8B). In the state pressed with the middle arrow FCb), an arbitrary region is surrounded by a closed line in a circle shape or a polygonal shape (see arrow ARb in the figure), so that the locus LOC of the line surrounded by the frame is changed. The inside (inside) may be set as the designated area SPB. Similarly to the first embodiment described above, the designated area SPB is a continuous area on the locus LOC in addition to the area inside the locus LOC of the line by the touch pen PEN or the like, for example, as shown in FIG. It may be set to a region included in a circular region having a predetermined radius r with each point LP as a center (that is, a region having a continuous width 2r).

  Further, as another region designation method, as shown in FIG. 8D, the user refers to the original image PHT displayed on the display unit 31 and applies a touch pen PEN or the like to the input unit 33 with any force (FIG. In the state of being pressed by the arrow FCc), by moving in a straight line or a curved line so as to correspond to an arbitrary region (see the arrow ARc in the figure), each continuous line LOC on the locus LOC An area included in a circular area having a predetermined radius r centered on the point LP (that is, an area having a continuous width 2r) may be set as the designated area SPC.

  As another area specifying method, as shown in FIG. 8E, the user refers to the original image PHT displayed on the display unit 31 and touches the touch pen PEN or the like at an arbitrary point LP of the input unit 33. Is pressed with an arbitrary force (see the arrow FCe in the figure), a circular area having a predetermined radius r centered on the point LP may be set as the designated area SPE.

  It should be noted that the radius r that defines a circular area centered on each point LP on the locus LOC by the touch pen PEN or the like in the area specifying method shown in FIGS. 8B to 8E is set to a predetermined numerical value in advance. It may be a thing which can be set to arbitrary numerical values by the user. Further, the radius r is changed (increased / decreased) according to the pressing force of the touch pen PEN or the like. For example, when the pressing force is large, the radius r is set large, and when the pressing force is small, the radius r is set small. It may be done.

  As described above, in the present embodiment, 1 is selected from a plurality of styles according to the variable (the magnitude of the pressing force) that defines the degree of the user's intuitive or sensory input operation with respect to the displayed original image PHT. By selecting two styles of painting, it is possible to generate a picture style picture PIC obtained by converting the original image PHT into the style of painting. Therefore, in this embodiment as well, as in the first and second embodiments described above, the style of painting applied to the painting style image is set according to the degree of the intuitive or sensory input operation of the user. Since a new image conversion technique can be presented, the user's interest in image conversion can be increased.

  In each of the above-described embodiments, for the convenience of explanation, two types of painting styles (first painting style; beast-style oil painting style, second painting style; pastel painting) are used as the painting styles applied to the image conversion processing. In the above description, the original image is subjected to image conversion processing by selecting one of the styles in accordance with the degree of input operation (contact movement speed, contact time, pressing force) by the user. Needless to say, the present invention is not limited to this. That is, the present invention applies a specific style selected from three or more types of styles by providing more reference values for the degree of input operation by the user and finely classifying the determined range. It is also possible to generate a painted picture-like image.

<Fourth Embodiment>
Next, an image display apparatus to which the image processing apparatus according to the present invention is applied and an image processing method in the image display apparatus according to a fourth embodiment will be described. Here, the fourth embodiment will be described with reference to the configuration of the image display device and the image processing method described in the first to third embodiments as appropriate.

  In the first to third embodiments described above, a case where only one area in the original image PHT is designated as a designated area to be subjected to image conversion processing, and the area is subjected to image conversion in a specific style. explained. The fourth embodiment is characterized in that a plurality of areas in the original image PHT are sequentially designated as designated areas to be subjected to image conversion processing, and each designated area is image-converted into a specific style. Here, any of the methods shown in the first to third embodiments described above is applied as a method for specifying each region.

  FIG. 9 is a schematic explanatory diagram illustrating another example of the region designation method and the image display state related to the image conversion processing according to the fourth embodiment. Here, for convenience of explanation, the display state of a painting-like image when a plurality of regions are designated using the region designation method and the image display state equivalent to those of the first embodiment described above will be described. It goes without saying that the area designating method shown in the third embodiment may be applied.

  For example, as shown in FIG. 9A, the region designation method applicable to the image conversion processing according to the present embodiment is an original image displayed on the display unit 31 by the user as in the first embodiment described above. With reference to the PHT, the region corresponding to the locus LOC1 of the touch pen PEN or the like is converted into an image by performing a reciprocating motion (see arrow AR1 in the figure) a plurality of times while the touch pen PEN or the like is in contact with the input unit 33. It is set as the designated area SP1 to be processed. At this time, the CPU 21 calculates the contact movement speed of the touch pen PEN or the like in the designated area SP1 based on the position information related to the locus LOC1 of the touch pen PEN or the like and the time information at each position, and saves it in the internal memory 24. To do.

  Next, when the original image PHT includes an area to be subjected to image conversion processing in addition to the designated area SP1, the user refers to the original image PHT displayed on the display unit 31, as shown in FIG. 9B. Then, the region corresponding to the locus LOC2 of the touch pen PEN or the like can be obtained by performing reciprocal movement (see the arrow AR2 in the figure) a plurality of times while the touch pen PEN or the like is in contact with the input unit 33 with respect to the region. The designated area SP2 to be subjected to image conversion processing is set. At this time, the CPU 21 calculates the contact movement speed of the touch pen PEN or the like in the designated area SP2 based on the position information related to the locus LOC2 of the touch pen PEN or the like and the time information at each position, and saves it in the internal memory 24. To do.

  Thereafter, the same region designation processing is repeated to set all the regions to be subjected to the image conversion processing, and then, for example, by selecting an icon displayed on the display unit 31, information for notifying completion of the region designation operation is displayed as an operation signal. To the CPU 21.

  Next, in the CPU 21, for each of the designated areas SP1 and SP2, the speed range is determined based on the contact movement speed of the touch pen PEN or the like to determine the style. Then, the image processing unit 26 executes image conversion processing using parameters according to the above-described style, so that, for example, as shown in FIG. 9C, the designated area SP1 of the original image PHT is a beast-style oil painting tone. In addition, the designated area SP2 of the original image PHT is converted into a pastel image tone. As a result, a painting-like image PICx in which the designated areas SP1 and SP2 are converted into a painting style corresponding to the degree of intuitive or sensory input operation (contact movement speed) is generated.

  As described above, according to the present embodiment, the user's intuitive or sensory input operation (contact movement speed, contact time, pressing force) with respect to a plurality of designated areas in the displayed original image PHT is performed. The painting style image PICx obtained by converting the original image PHT into each painting style can be generated by determining the painting style of each designated area. Therefore, also in this embodiment, it is possible to present a new image conversion method of setting a style applied to a picture-like image according to the degree of intuitive or sensory input operation of the user. The user's interest in image conversion can be increased.

<Fifth Embodiment>
Next, an image display apparatus to which an image processing apparatus according to the present invention is applied, and a fifth embodiment of an image processing method in the image display apparatus will be described. Here, the fifth embodiment will be described with reference to the configuration of the image display apparatus described in the first embodiment as appropriate.

  In the first embodiment described above, as shown in FIG. 1, the image display device 10 alone converts the original image PHT displayed on the display unit 31 into a picture-like image PIC to which a specific style is applied. The stand-alone configuration has been described. In the fifth embodiment, an image conversion processing function for converting an original image PHT into a picture-like image PIC to which a specific style is applied is not a network or cable connected to the image display device 10 instead of the image display device 10 described above. The image conversion processing is executed by the host computer or the like that is provided in a host computer or server connected via the network.

  FIG. 10 is a schematic block diagram showing a hardware configuration of an image display apparatus according to the fifth embodiment of the present invention. Here, the description of the configuration equivalent to that of the above-described first embodiment (see FIG. 1) is simplified or omitted.

  As shown in FIG. 10, the image display apparatus 10 according to the present embodiment includes a data processing unit 20 and a user I / F unit 30, and a host computer 60 and a file via a network (communication means) 50. It has a configuration connected to the server 70. The data processing unit 20 generally includes a CPU 21, a ROM 22, a RAM 23, an internal memory 24, a display control unit 25, and an image processing unit 26, as in the first embodiment described above. Here, in the present embodiment, the image processing unit 26 does not have the image conversion function shown in the first to fourth embodiments described above.

  The user I / F unit 30 is roughly similar to the first embodiment described above, and includes a display unit 31, an operation unit 32, an input unit 33, a communication unit 34, and a memory I / F unit 35. It is equipped with. Here, in the present embodiment, the communication unit 34 is connected to the network 50.

  The host computer 60 is connected to the network 50 and has an image conversion function equivalent to that of the image processing unit 26 described in the first to fourth embodiments. That is, in the image display device 10, when an input operation by the user is executed on the input unit 33, an operation signal related to the input operation (contact movement speed, contact time, pressing force) is displayed on the display unit 31. Are transmitted to the host computer 60 via the network 50 connected to the communication unit 34. The host computer 60 executes the image conversion processing shown in the first to fourth embodiments based on the received image data of the original image and the operation signal, and the user's intuitive or sensory input operation A painting-like image composed of a painting style according to the degree of the image is generated. Then, the host computer 60 transmits image data of the generated painting-like image to the image display device 10 via the network 50.

  As described above, in this embodiment, the host computer 60 connected to the image display device 10 via the network 50 is provided with the image conversion function, thereby reducing the processing burden on the image processing unit 26 of the image display device 10. can do. Therefore, for example, the processing speed related to the input operation by the user and the display operation of the original image and the painting-like image can be improved, the power consumption can be reduced, and the performance of the image display device 10 can be improved.

  In the present embodiment, the image data of the original image used for the image conversion process executed by the host computer 60 is not limited to that transmitted from the image display device 10 together with the operation signal. That is, for example, when the original image displayed on the display unit 31 of the image display apparatus 10 is for browsing the image data stored in the file server 70 connected to the network 50 directly by a browser or the like, The host computer 60 receives the image data of the original image from the file server 70. In this case, the image data of the painting-like image generated by the image conversion process in the host computer 60 is stored in, for example, a predetermined memory area of the file server 70 and is displayed on the display unit 31 of the image display device 10 via the network 50. The picture-like image is displayed on the screen.

  In the present embodiment, the configuration in which the image display apparatus 10 is connected to the host computer 60 via the network 50 has been described. However, the present invention is not limited to this, and the communication unit of the image display apparatus 10 34 and the host computer 60 may be directly connected via a communication cable.

  In each of the above-described embodiments, any one of the contact movement speed, the contact time, and the pressing force of the touch pen or the like is used as the user input operation detected by the input unit 33 and is applied to the image conversion process. Although the case where the style is determined has been described, the style may be determined using any of a plurality of input operations. For example, when a position detection type touch panel is applied as the input unit 33, for example, a contact moving speed and a contact time can be used as the user input operation. Further, when a pressure-sensitive touch panel is applied as the input unit 33, for example, a contact moving speed and a pressing force can be used as a user input operation. According to the combination of the plurality of input operations, the range of determination when determining the style can be finely classified, so that a picture-like image to which a specific style selected from various styles is applied is generated. be able to.

<Application examples to electronic devices>
Next, an electronic apparatus to which the image display device described in each of the above embodiments is applied will be briefly described with reference to the drawings.

  The image display device 10 as described above can be favorably applied to various electronic devices such as a digital photo frame, a digital camera, a high-performance mobile phone (smart phone), and a personal computer.

  FIG. 11 and FIG. 12 are schematic views showing an example of the configuration of an electronic apparatus equipped with an image display device to which the image processing apparatus according to the present invention is applied. FIG. 11A is a perspective view illustrating a configuration example of a digital photo frame, and FIGS. 11B and 11C are perspective views illustrating a configuration example of a digital camera. FIG. 12A is a perspective view illustrating a configuration example of a high-function mobile phone, and FIG. 12B is a perspective view illustrating a configuration example of a personal computer.

  In FIG. 11A, a digital photo frame 110 schematically includes a main body 111 and a display unit 112 (the display unit 31 and the input unit 33 described above) in which the touch panel shown in the above-described embodiments is integrally formed. An operation unit 113 (corresponding to the operation unit 32 described above), a memory card slot 114 (corresponding to the memory I / F unit 35 described above), and a self-supporting stand 115. ing. According to this, when the user refers to the original image displayed on the display unit 112 and performs an input operation intuitively or sensibly on the touch panel configured integrally with the display unit 112, the Depending on the degree of input operation, the original image is converted into a picture-like image having a specific style and displayed on the display unit 112.

  In FIGS. 11B and 11C, the digital camera 120 schematically includes a main body 121, a lens unit 122, and a display unit 123 (described above) in which the touch panel shown in each of the above-described embodiments is integrally formed. The display unit 31 and the input unit 33), an operation unit 124 including operation switches (corresponding to the operation unit 32 described above), and a shutter button 125. Even in this case, the user refers to the original image displayed on the display unit 123 and performs an input operation intuitively or sensibly on the touch panel integrated with the display unit 123. Depending on the degree of input operation, the original image is converted into a picture-like image having a specific style and displayed on the display unit 123.

  In FIG. 12A, the high-function mobile phone 130 is roughly composed of a main body 131 and a display unit 132 (indicated by the display unit 31 and the above-described unit) that is configured integrally with the touch panel shown in each of the above-described embodiments. And an operation unit 133 (corresponding to the operation unit 32 described above) composed of operation switches. Also in this case, the user refers to the original image displayed on the display unit 132 and performs an input operation intuitively or sensibly on the touch panel configured integrally with the display unit 132. Depending on the degree of input operation, the original image is converted into a picture-like image having a specific style and displayed on the display unit 132.

  In FIG. 12B, a desktop personal computer 140 is roughly represented by a main body 141, a display unit 142 (corresponding to the display unit 31 described above), and a keyboard 143 (corresponding to the operation unit 32 described above). ) And a pen tablet 144 (corresponding to the input unit 33 described above). According to this, by referring to the original image displayed on the display unit 142 by the user and performing an input operation intuitively or sensuously with respect to the pen tablet 144, the original image according to the degree of the input operation. Is converted into a picture-like image having a specific style and displayed on the display unit 142. In this application example, the case where the display unit 142 corresponding to the display unit 31 described above and the pen tablet 144 corresponding to the input unit 33 have different configurations has been described. However, as in the above-described embodiments. In addition, a touch panel may be integrated with the display unit 142. The personal computer 140 is not limited to a desktop type, and may be a notebook type or a tablet type.

  Therefore, in various electronic devices as described above, a new image conversion method is presented in which a style applied to a picture-like image is set according to the degree of an intuitive or sensory input operation of the user. Therefore, the user's interest in image conversion and interest in an electronic device having the image conversion function can be increased.

As mentioned above, although some embodiment of this invention was described, this invention is not limited to embodiment mentioned above, It includes the invention described in the claim, and its equivalent range.
Hereinafter, the invention described in the scope of claims of the present application will be appended.

(Appendix)
The invention described in claim 1
Original image storage means for storing original image data;
Style selection means for selecting one style from among a plurality of styles according to a variable value determined according to the degree of user input operation;
Image conversion means for converting the original image to generate the selected image and generating a converted image;
An image processing apparatus comprising:

The invention described in claim 2
The plurality of styles include a first style and a second style,
The style selection means includes:
When the variable value is equal to or greater than a predetermined value, the first style is selected,
The image processing apparatus according to claim 1, wherein the second style is selected when the variable value is smaller than a predetermined value.

The invention according to claim 3
The variable defines at least one of a speed of the user input operation, a duration of the user input operation, and a strength of the user input operation. Item 3. The image processing device according to Item 1 or 2.

The invention according to claim 4
A position detecting unit having a contacted surface and detecting a contact position on the contacted surface by an input operation of the user;
The variable defines the speed of the user's input operation,
The speed of the user input operation is calculated based on a displacement of the contact position on the contacted surface by the user input operation detected by the position detection means. 3. The image processing apparatus according to 3.

The invention described in claim 5
A contact state detection means as a detection means having a contact surface and detecting a contact state to the contact surface by the user's input operation;
The variable defines the duration of the user's input action,
The duration of the user's input operation is calculated based on a time displacement of the contact state to the contacted surface by the user's input operation detected by the contact state detecting means. An image processing apparatus according to claim 3.

The invention described in claim 6
A force detecting means as a detecting means for detecting a pressing force to the contacted surface by the user's input operation;
The variable defines the strength of the user's input operation,
4. The strength of the input operation of the user is calculated based on the pressing force applied to the contacted surface by the input operation of the user detected by the force detection means. This is an image processing apparatus.

The invention described in claim 7
Display means for displaying the original image and the converted image;
The display control means for displaying a contact position by the user's input operation on the contacted surface of the detection means at a corresponding position of the original image displayed on the display means. The image processing apparatus according to any one of 4 to 6.

The invention according to claim 8 provides:
8. The image processing apparatus according to claim 7, wherein at least the detection unit and the display unit are connected to the style selection unit and the image conversion unit via a communication unit.

The invention according to claim 9 is:
The image processing apparatus according to claim 1, further comprising: a variable value determining unit that determines a value of the variable according to a degree of a user input operation.

The invention according to claim 10 is:
In an image processing method for converting an original image into a predetermined style and generating a converted image,
A variable value determination process that determines the value of a variable that defines the degree of user input action;
Style selection processing for selecting one style from a plurality of styles according to the determined variable value;
An image conversion process for generating the converted image by converting the original image so as to have the selected one style;
The image processing method characterized by including.

The invention according to claim 11
The variable defines at least one of a speed of the user input operation, a duration of the user input operation, and a strength of the user input operation. Item 11. The image processing method according to Item 10.

The invention according to claim 12
An image processing program for causing a computer to control an image processing apparatus, converting an original image to have a predetermined style, and generating a converted image,
A variable value determination process that determines the value of a variable that defines the degree of user input action;
Style selection processing for selecting one style from a plurality of styles according to the determined variable value;
An image conversion process for generating the converted image by converting the original image so as to have the selected one style;
Is an image processing program characterized by causing

DESCRIPTION OF SYMBOLS 10 Image display apparatus 20 Data processing part 21 CPU
24 internal memory 25 display control unit 26 image processing unit 30 user I / F unit 31 display unit 32 operation unit 33 input unit 34 communication unit 50 network 60 host computer PHT original image PEN touch pen LOC locus SPA to SPE designated area PIC, PICa, PICb painting style image

Claims (10)

Original image storage means for storing original image data;
Style selection means for selecting one style from among a plurality of styles according to a variable value determined according to the degree of user input operation ;
Image conversion means for converting the original image so as to be the one style selected by the style selection means, and generating a converted image,
The variable value defines at least one of a speed of the user input operation, a duration of the user input operation, and a strength of the user input operation. Image processing device. The plurality of styles include a first style and a second style,
The style selection means includes:
When the variable value is equal to or greater than a predetermined value, the first style is selected,
When the variable value is smaller than the predetermined value, the image processing apparatus according to claim 1, wherein the selecting the second painting style. A position detecting unit having a contacted surface and detecting a contact position on the contacted surface by an input operation of the user;
The variable value defines the speed of the user's input operation,
The speed of the user input operation is calculated based on a displacement of the contact position on the contacted surface by the user input operation detected by the position detection means. The image processing apparatus according to 1 or 2 . A contact state detection means as a detection means having a contact surface and detecting a contact state to the contact surface by the user's input operation;
The variable value defines the duration of the input operation of the user,
The duration of the user's input operation is calculated based on a time displacement of the contact state to the contacted surface by the user's input operation detected by the contact state detecting means. the image processing apparatus according to claim 1 or 2. A force detecting means as a detecting means for detecting a pressing force to the contacted surface by the user's input operation;
The variable value defines the strength of the input operation of the user,
Detected by the force detecting means, wherein based on the pressing force to the contacted surface by the input operation of the user, according to claim 1 or the intensity of the input operation of the user, characterized in that it is calculated 2. The image processing apparatus according to 2. Display means for displaying the original image and the converted image;
The display control means for displaying a contact position by the user's input operation on the contacted surface of the detection means at a corresponding position of the original image displayed on the display means. The image processing apparatus according to any one of 3 to 5 . The image processing apparatus according to claim 6 , wherein at least the detection unit and the display unit are connected to the style selection unit and the image conversion unit via a communication unit. The image processing apparatus according to any one of claims 1 to 7, further comprising a variable value determining means for determining the value of the variable according to the degree of the input operation of the user. In an image processing method for converting an original image and generating a converted image,
A variable value determination process that determines the value of a variable that defines the degree of user input action;
Style selection processing for selecting one style from a plurality of styles according to the determined variable value ;
An image conversion process for generating the converted image by converting the original image so as to have the selected one style ;
Including
The variable value defines at least one of a speed of the user input operation, a duration of the user input operation, and a strength of the user input operation. Image processing method. An image processing program for causing a computer to control an image processing apparatus, converting an original image, and generating a converted image,
A variable value determination process that determines the value of a variable that defines the degree of user input action;
Style selection processing for selecting one style from a plurality of styles according to the determined variable value ;
An image conversion process for generating the converted image by converting the original image so as to have the selected one style ;
And execute
The variable value defines at least one of a speed of the user input operation, a duration of the user input operation, and a strength of the user input operation. Image processing program.