JP4718950B2 - Image output apparatus and program - Google Patents

Description

  The present invention relates to an image output apparatus and a program for performing image processing on an image such as a camera photographed image or a television broadcast received image and outputting the image.

2. Description of the Related Art Conventionally, in a mobile phone device, when an image such as a camera-captured image or a television broadcast reception image is displayed and output, the display area is enlarged by displaying the image so that the display area of the display panel is the same. However, if the image is enlarged and displayed in this way, the overall image quality becomes rough. In view of this, a technique is known in which, when an image is enlarged and displayed in the size of the display area, the peripheral portion is enlarged except for the central portion of the image (see Patent Document 1).
JP 2004-80472 A

By the way, in general, when shooting a subject such as a person, the camera is oriented so that the subject comes to the center of the viewfinder screen. In this case, even if the entire image is enlarged and displayed in the display area as in the above-described conventional technique, only the peripheral portion of the subject image is enlarged, and the subject portion in the central portion of the image is enlarged. Although it is not a target, when a person is positioned at the end of the image, the person part is also enlarged and displayed by enlargement other than the center part.
On the other hand, when an image is displayed by arbitrarily specifying where in the display area the image is to be displayed, part of the image protrudes from the display area depending on the display position, and the entire image is displayed within the display area. Cannot fit in. In such a case, the image may be reduced or displayed by changing the orientation (vertical / horizontal) of the image. However, if the entire image is reduced and displayed, even important parts such as human parts may be displayed. If the image is displayed in a small size, and the direction of the image is changed, the image is displayed in a state in which the direction of the person portion or the like is rotated by 90 °, which is difficult to see.

  An object of the present invention is to process an image and output it, leaving a portion of interest such as a person remaining, regardless of where the person is located in the image. It is.

The invention according to claim 1 is an image output device that performs image processing on an output target image and outputs the image, information obtained by image analysis of the output target image, or information at the time of image capture, Alternatively, based on information added to the output target image, a specifying unit that specifies a part in the output target image as a target portion, and enlarges or reduces the peripheral portion except for the target portion specified by the specifying unit. The image processing apparatus includes a processing unit that changes the size of the entire image and an output unit that outputs an image processed by the processing unit.
Furthermore, a program for realizing the main functions shown in the invention described in claim 1 is provided to the computer (the invention described in claim 10 ).
Note that the output target image is not limited to a camera-captured image, and may be, for example, a television broadcast reception image, and the type of image is not limited.

  The invention described in claim 1 described above may be as follows.
  The image processing process is an aspect ratio changing process for changing an aspect ratio of the entire image, and the processing means changes the aspect ratio of the entire image by enlarging or reducing the peripheral portion. Invention).

Before SL specifying means (invention described in claim 3) recognize specific substances contained therein by analyzing the output target image as a target portion.

The specifying means recognizes the attention portion based on the change state by analyzing the output target image (the invention according to claim 4 ).

The specifying unit specifies a subject portion focused at the time of camera shooting from an output target image as a shot image as an attention portion (invention according to claim 5 ).

The specifying unit specifies a character portion included in the output target image as a target portion (invention of claim 6 ).

The specifying unit specifies a target portion in the image based on additional information added to the output target image (the invention according to claim 7 ).

The processing means executes, when enlarging or reducing the peripheral portion, an enlargement process for gradually changing the enlargement rate as the distance from the attention portion increases, or a reduction process for gradually changing the reduction rate as the distance from the attention portion increases (claims). Item 8 ).

It said processing means is configured to change the size of the entire image, filtering processing of applying an image to a filter of the peripheral portion, or executes the color changing process to change the color of an image of said peripheral portion (claim 9 wherein Invention).

According to the invention of claim 1 or 2 in serial placement, information obtained by the image analysis of the output target image, or information at the time of image capturing, or, based on the additional information to the output target image, output target Since a part of the image is specified as a target part and the peripheral part is removed by enlarging or reducing the target part, the aspect ratio or size of the entire image is changed and output. Regardless of where you are located, you can process the other parts of the image, leaving the attention part of the person, etc., even if you change the aspect ratio or size of the entire image, Can remain. In other words, this processing does not adversely affect the image quality and the like of the attention portion, the initial state of the portion can be maintained, and the visibility of the attention portion can be relatively improved.

According to the invention described in claim 3, in addition to having the same effect as that of the invention described in claim 1 or 2, the specific object included in the output target image is analyzed as an attention part. Since the recognition is performed, a specific object such as a person, a building, a car, or an object (such as a character or a figure) can be recognized as an attention portion by image analysis. In this case, the recognition method is arbitrary, such as pattern recognition of the entire shape or analysis and recognition of features such as the positional relationship and shape of each component. Further, a part or the whole of a specific object, for example, a person's face part or the whole person may be set as the attention part.

According to the invention described in claim 4, in addition to having the same effect as that of the invention described in claim 1 or 2, the target portion is recognized based on the change state by analyzing the output target image. Therefore, for example, it is possible to recognize the image of the attention portion based on the magnitude of changes such as contrast, saturation, and brightness.

According to the invention described in claim 5, in addition to having the same effect as the invention described in claim 1 or 2 described above, attention is paid to the subject portion focused at the time of camera shooting from the output target image as the shot image. Since the portion is specified as the portion, the portion in focus can be specified as the subject portion (target portion). In this case, an image may be recognized as a subject portion where the focus is best achieved by image analysis.

According to the invention described in claim 6, in addition to having the same effect as that of the invention described in claim 1 or 2, the character part included in the output target image is specified as the attention part. Thus, for example, when a bus timetable or the like is photographed instead of a memo, a portion including characters in the photographed image can be specified as a target portion. In this case, in the case of a television broadcast reception image with subtitles, a character area added to the reception image may be specified as a target portion.

According to the invention described in claim 7, in addition to having the same effect as that of the invention described in claim 1 or 2, the attention portion in the image is specified based on the additional information added to the output target image. Thus, information indicating the “focus position” may be acquired from the attribute information added to the photographed image, and the subject portion may be specified as the attention portion. Further, the attention portion may be specified by referring to various types of information added to the digital television broadcast reception image.

According to the invention described in claim 8, in addition to having the same effect as that of the invention described in claim 1 or 2 described above, when the peripheral portion is enlarged or reduced, the enlargement ratio is gradually changed as the distance from the attention portion increases. The enlargement process to be performed or the reduction process to change the reduction rate gradually as the distance from the attention part is executed. For example, the enlargement process gradually increases as the distance from the attention part increases, or gradually decreases as the distance from the attention part increases. In addition to providing a perspective effect centered on the target portion, it is also possible to provide a highlight effect that makes the target portion stand out.

According to the ninth aspect of the present invention, in addition to the same effect as that of the first or second aspect of the present invention described above , the filter processing for changing the size of the entire image and filtering the peripheral portion image Or, since the color changing process for changing the color of the image of the peripheral part is executed , the blurring process such as mosaic, the hue changing process, the saturation changing process, and the brightness changing process are performed on the peripheral part other than the target part. Even when various processes are performed, the initial state of the portion of interest can be maintained without being affected by it.

Hereinafter, embodiments of the present invention will be described with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a mobile phone device as an image output device. FIG. 1 is a block diagram showing basic components of the mobile phone device.
This cellular phone device is driven by a secondary battery as a main power source, and has a telephone function, an e-mail function, an Internet connection function, etc., a TV function for receiving and outputting TV broadcast waves, and a TV received by this TV function. It has a recording function for sequentially recording broadcasts, a reproduction function for reproducing and outputting contents recorded by the recording function, and a reproduction function for reading out and reproducing various externally supplied images.

  The CPU 1 is a central processing unit that controls the overall operation of the mobile phone device according to various programs in the storage unit 2. The storage unit 2 is a non-volatile memory (internal memory), which is configured by, for example, a flash memory, and has a program area and a data area. In the program area, operations shown in FIGS. A program for realizing the present embodiment is stored according to the procedure. The recording medium 3 is a detachable portable memory that supplies photographed image data, various types of data, and programs to the outside. The recording medium 3 includes, for example, smart media and an IC card. The memory 4 is an internal memory having a work area, and is composed of, for example, a DRAM (Direct Random Access Memory), an SDRAM (Synchronous DRAM), or the like.

  The telephone communication unit 5 takes in a signal from the reception side of the transmission / reception duplexer connected to the antenna 6 and demodulates it into a reception baseband signal, and then outputs audio data from the audio speaker 7. In addition, the telephone communication unit 5 encodes the audio data input from the audio microphone 8 into a transmission baseband signal, and then provides the transmission baseband signal to the transmission side of the transmission / reception duplexer to transmit and output from the antenna 6. On the other hand, display data such as an image received via the telephone communication unit 5 by the e-mail function or the Internet connection is given to a main display unit 9 constituted by an LCD (liquid crystal display), and is displayed and output. The main display unit 9 has, for example, a display screen having a 400 × 240 dot configuration, and displays character information, a TV broadcast reception image, a camera image, various messages, and the like with high quality. In addition to the main display unit 9, a sub display unit 10 is provided on the back of the apparatus main body, and displays the current date and time, simple messages, icons, and the like.

  The TV receiver 11 includes a TV antenna 12 and receives terrestrial digital TV broadcasts for mobile receivers such as mobile phones. In addition to TV video and audio information, an electronic program guide (EPG) is also included. It can be received. The television receiver 11 includes a dedicated CPU, a receiver connected to the TV antenna 12, an amplification / separation unit that separates and separates the received television broadcast into a video signal and an audio signal, a decoding unit that decompresses the compressed data, and the like. The TV video signal output from the TV receiver 11 is output from the main display unit 9, and the TV audio signal is output from the built-in speaker 13 or the earphone 14.

  The key operation unit 15 is provided with various push button type keys, and performs dial input, character input, command input, etc. In addition to a TV ON / OFF key and a channel switching key for TV functions, it records TV broadcasts. (Including recording) recording start key, playback key for playback of recorded content, pause key for pause playback, fast-forward key for fast-forward playback, and processing the image during image display It has a function selection key for selecting a special output function to be displayed. The CPU 1 executes processing according to a key input signal from the key operation unit 15. The notification unit 16 includes an LED (light emitting diode) and a vibration motor including the built-in speaker 13 described above. The notification unit 16 notifies the incoming call when a call / mail is received, and is also driven when a warning alarm is given.

  The camera imaging unit 17 can shoot moving images in addition to still images, and includes a photographing lens, a lens / mirror block such as a mirror, an image sensor such as a CCD image sensor, its drive system, a distance measuring sensor, a light quantity A sensor, an analog processing circuit, a signal processing circuit, a compression / decompression circuit, and the like are provided to adjust and control the optical zoom, and to control drive control during autofocus, shutter drive control, exposure, white balance, and the like. The captured image captured by the camera imaging unit 17 is stored and saved in the storage unit 2 and the recording medium 3. In this case, the main display unit 9 functions as a photographing monitor screen (finder screen) for displaying a monitor image, a reproduction screen for reproducing and outputting the photographed image stored and stored in the storage unit 2 and the recording medium 3.

2 and 3 show a special output function for displaying and outputting a predetermined image on an image (output target image) such as a camera-captured image or a television broadcast reception image on the main display unit 9. FIG. 6 is a diagram illustrating images before and after execution of this image processing process when selected by a user operation. In the drawing, the left side shows an image before execution of the processing process, and the right side shows an image after execution of the processing process.
Here, the CPU 1 specifies a part in the output target image as a target part before image processing. That is, it is determined whether or not a specific object to be noticed, for example, a person, a building, a car, or an object (character, graphic, etc.) is included in the output target image. The center position of the part (the attention part) where the specific object is reflected is specified as the target position.

  In this case, when the output target image is a captured image, a portion in focus (for example, a human face portion) based on focus information (focus position information) added to the captured image is determined as the target position. However, if the focus information is not added to the captured image, or if it is a TV broadcast received image, etc., image recognition is performed while analyzing this image, and the specific object is included in the image. Whether or not there is is determined. The specific object recognition algorithm is performed by using a well-known technique. However, the entire shape may be recognized by pattern recognition, or by analyzing features such as the positional relationship and shape of each component. Changes such as contrast, saturation, and brightness may be detected by image analysis, and a specific object may be recognized based on the magnitude of the change, and the method of recognition is arbitrary (the same applies hereinafter). Based on the target position specified in this way, the CPU 1 specifies an area including the specific object as the target area.

  2A and 2B exemplify an aspect ratio changing process for changing the aspect ratio of the entire image as an image processing process. FIG. 2A shows a standard ratio (aspect ratio 4: 3) to a wide range. When the ratio is changed to the ratio (aspect ratio 16: 9), (B) shows the case where the ratio is changed from the wide ratio to the standard ratio. Here, the CPU 1 divides the image to be output into N equal parts (for example, eight equal parts) in the horizontal direction and divides the image into N vertical frame areas, and uses the target position as a reference in each vertical frame area. Thus, an area including a specific object (for example, a human face) is specified as a target area.

  FIG. 2A shows a case where each region extending from the third to the fourth region counted from the left in the figure is specified as the target region, and FIG. 2B spans the second to third regions. In this example, each area is identified as a target area. Then, the CPU 1 enlarges or reduces all other areas (target peripheral portions) except the target area to change the entire image to a specified aspect ratio. At this time, as the distance from the target region increases, the enlargement ratio or reduction ratio of the portion is sequentially changed exponentially. That is, an enlargement process that gradually increases as the distance from the target area increases, or a reduction process that gradually decreases as the distance from the target area increases. Such enlargement / reduction processing is called peripheral ratio change enlargement / reduction processing.

  The aspect ratio changing process for changing the aspect ratio of the entire image is not limited to the horizontally long display shown in FIGS. 2A and 2B, but is not shown in the figure, but may be the vertically long display. That is, in the case of the portrait display, the image to be output is equally divided into N in the vertical direction and divided into N horizontal frame areas, and all other horizontal frame areas except the target area are enlarged or reduced. The entire image is changed to the specified aspect ratio. Also in this case, ratio change enlargement / reduction processing is performed in which the distance is gradually increased as the distance from the target area increases, and is gradually decreased as the distance from the target area increases.

  In this case, in FIG. 2A, the enlargement ratio of the third and fourth target areas is “1 ×”, and the enlargement ratio of the second and fifth areas is, for example, “1.1 times”. The enlargement ratio of the first and sixth areas is, for example, “1.3 times”,. By gradually increasing the enlargement ratio in this manner, the distance from the target area increases gradually, and the aspect ratio of the entire image changes from the standard ratio (4: 3) to the wide ratio (16: 9). Changed to

  As a result of changing the aspect ratio, if the ratio is not completely wide or standard, if the error is within the allowable range, the error is ignored and the image is displayed, or the error is displayed for each vertical frame. You may make it distribute to an area | region. When this error is distributed to each vertical frame area, the enlargement ratio of each vertical frame area may be finely adjusted. However, by changing the size of each vertical frame area without changing the enlargement ratio. Fine adjustment may be made. In addition, when substantially the entire image corresponds to the target area, for example, when a person in the upper body is enlarged in the entire image, a part of the person image (a person's face) may be used as the target area. .

  FIG. 3A shows the case where the display of the landscape image is changed to the display of the portrait image, that is, the case where the orientation of the image is changed, and FIG. 3B is the case where the orientation of the entire image is arbitrarily reduced. Is shown. In this case, the CPU 1 divides the image to be output into a matrix shape (a grid shape), and specifies a region including a specific object (person) as a target region among the grid regions based on the target position. Then, all the areas other than the target area are specified as the target peripheral area, and the peripheral area is enlarged or reduced in each horizontal direction and vertical direction to change the image to the designated direction. I am trying to change it to the specified size.

  Also in this case, ratio change enlargement / reduction processing is performed that gradually increases as the distance from the target region increases, and gradually decreases as the distance from the target increases. As in the case described above, when an error within the allowable range occurs when the entire image is changed to the specified size, the error may be ignored or the error may be distributed to each region. In the figure, the arrow mark indicates that the upward arrow indicates enlargement and the downward arrow indicates reduction, and the thickness of the arrow mark indicates the size of the enlargement / reduction ratio. Although not shown, contrary to the case of FIGS. 3A and 3B, when changing the portrait display to landscape display, even if the entire image is arbitrarily enlarged vertically and horizontally, This is the same as in the case of FIGS.

  FIG. 3C exemplifies a filtering process (blurring process) applied to an image as an image processing process. In this case as well, the CPU 1 divides the image to be output into a matrix (a grid pattern). At the same time, an area including the target position is specified as the target area among the square areas. Then, filter processing (blurring processing) is performed on all the grid areas other than the target area. In this embodiment, image processing includes “color change processing” in addition to the above-described “aspect ratio changing processing”, “size changing processing”, and “filter processing processing”. The processing type can be selected.

  Next, the operation concept of the mobile phone device in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. In addition, the operation according to the above-described program code transmitted via the transmission medium can be sequentially executed. In other words, in addition to the recording medium, an operation peculiar to this embodiment can be executed by using a program / data supplied externally via a transmission medium.

FIGS. 4 to 6 are flowcharts showing an operation that is started when a special output function for performing a predetermined process on an image such as a camera-captured image or a television broadcast reception image is displayed by a user operation. .
First, after acquiring one image such as a camera photographed image or a television broadcast received image as an output target image (source image) (step A1), the CPU 1 determines an image processing type selected and designated by a user operation (step A1). Step A2).

  This image processing type is selected and specified by a user operation before the above-described special output function is activated. In this embodiment, “aspect ratio change”, “size change”, “filter processing”, “filter processing”, “ An arbitrary processing type is selected and designated from “color change”. If “aspect ratio change” or “size change” accompanying image size change is selected as the image processing type (YES in step A3), the face of the person included in the source image The process proceeds to a target position specifying process for specifying the center position of a part or the like as the target position (step A4).

FIG. 7 is a flowchart for explaining the target position specifying process in detail.
First, when the output target image is a captured image, the CPU 1 checks whether or not focus information (focus position information) is added to the captured image (step B1). If the focus information is added, A focused part (subject part) is specified as a target position based on the focal position in the image (step B2). If focus information is not added (NO in step B1), it is recognized whether or not a human face portion is included by analyzing the output target image (step B3), and the face portion is included. If so (YES in step B4), the top two face parts are specified from among them, and the center positions thereof are specified as target positions (step B5). When there is one person, one face part is specified as the target position.

  If the face portion of the person is not included (NO in step B4), whether the character portion is included in the image is recognized by image analysis (step B6), and the character portion is included. If so, the character portion is specified as the target position (step B7). In this case, if it is a character string, the whole area | region is specified as a target position. In addition to recognizing human face portions and character portions, other image recognition processing (step B8) recognizes whether or not a specific object such as a predetermined car or building is included. Then, the predetermined position (center point) of this specific object is specified as the target position. When the output target image is a television broadcast reception image with captions, the overwriting position of the character part added to the reception image may be specified as the target position.

  When such a target position specifying process is completed, the CPU 1 checks whether or not the target position has been specified with reference to the processing result (step A5 in FIG. 4). Here, when a specific object is not included in the source image, that is, when the target position cannot be specified (NO in step A5), the entire source image is changed to a uniform size (step A6). . That is, normal processing for changing the entire image to a specified aspect ratio or changing to a specified size is performed. If a specific object is included in the source image (when the target position can be specified) (YES in step A5), it is checked whether the process involves a change in the vertical size (step A7). ). In other words, the “aspect ratio changing process” or “size changing process” mainly determines whether or not the process is to change the horizontal size.

  Here, as shown in FIGS. 2A and 2B, when the horizontal size is mainly changed without changing the vertical size (NO in step A7), the image to be output is displayed in the horizontal direction. And is divided into N vertical frame regions, for example, and divided into N vertical frame regions, and among the vertical frame regions, a region including a specific object is specified as a vertical frame target region based on the target position. (Step A13). In addition, when a specific thing straddles the several area | region which adjoins, this several area | region is specified as a target area | region (following, the same). A white portion illustrated in FIG. 8A indicates a vertical frame target region specified based on the target position “+”. Next, moving to the flow of FIG. 5, whether to increase the horizontal size of the image as shown in FIG. 2A or whether to reduce the horizontal size of the image as shown in FIG. Check (step A18).

  If the horizontal size is to be increased (YES in step A18), a process of enlarging all the other areas except for the target area in the horizontal direction sequentially with reference to the vertical frame target area is performed. Perform (Step A19). The shaded area shown in FIG. 8A indicates an area other than the target area, and the entire area of the shaded area is an enlargement target. Here, each vertical frame area is enlarged and changed so that the entire image has the specified aspect ratio, and at that time, the area gradually increases as the distance from the target area increases. On the other hand, when the horizontal size of the image is to be reduced (NO in step A18), all vertical frame regions other than the target region are sequentially reduced in proportion in the horizontal direction (step A20). In this case as well, each vertical frame region is reduced and changed so that the entire image has the specified aspect ratio, but at that time, a reduction process is performed so that it gradually decreases as the distance from the target region increases.

  Further, in the case where the vertical size is mainly changed (YES in step A7 in FIG. 4), when the horizontal size is not changed (NO in step A8), the image to be output is set to N in the vertical direction. The horizontal frame area is equally divided and divided into N horizontal frame areas, and among the horizontal frame areas, an area including a specific object is specified as a horizontal frame target area based on the target position (step A17). A white portion illustrated in FIG. 8B indicates a horizontal frame target region specified based on the target position “+”. Next, the flow proceeds to the flow of FIG. 5 to check whether the vertical size is increased or the vertical size is decreased (step A15).

  If the vertical size is to be increased (YES in step A15), the horizontal frame target area is used as a reference, and all other horizontal frame areas except the target area are sequentially changed in the vertical direction to be enlarged. Processing is performed (step A16). The hatched portion shown in FIG. 8B indicates a peripheral region other than the target region, and the entire region of the shaded portion is an enlargement target. Here, each horizontal frame region is enlarged and changed so that the entire image has the specified aspect ratio. At that time, enlargement processing is performed so that the image gradually becomes larger as the distance from the target is increased. When the vertical size is to be reduced (NO in step A15), all the other horizontal frame regions except the target region are subjected to a process of reducing the size by sequentially changing the ratio in the vertical direction (step A17). At that time, a reduction process is performed so that the distance from the target area gradually decreases.

  On the other hand, as shown in FIGS. 3A and 3B, changing the orientation of the image or changing the size of the entire image involves changing both the vertical size and the horizontal size. Is determined to have a vertical size change, and in step A8, it is determined that a horizontal size has been changed. In this case, the image to be output is divided into an N × M matrix (a grid shape) in the vertical and horizontal directions, and among the grid areas, a grid area (rectangular area) including a specific object based on the target position is defined. The target area is specified (step A9). A white portion shown in FIG. 8C indicates a target area specified with reference to the target position “+”. Next, it is checked whether to increase the horizontal size or to decrease the horizontal size as shown in FIGS. 3A and 3B (step A10).

  If the horizontal size is to be increased (YES in step A10), the process of enlarging all the vertical frame areas other than the target area by sequentially changing the ratio in the horizontal direction with the target area as a reference. Performed (step A11). A hatched portion shown in FIG. 8C indicates a peripheral region other than the target region, and the entire region of the hatched portion is an enlargement target. Here, each area is enlarged and changed so that the entire image has a designated size. At that time, enlargement processing is performed so that the area gradually increases as the distance from the target area increases. Also, as shown in FIG. 3A, when the horizontal size is reduced (NO in step A10), all other areas except the target area are sequentially reduced in the horizontal direction to reduce the size. Although it is performed (step A12), at this time, a reduction process is performed so that the distance from the target area gradually decreases.

  When the entire image is divided into a matrix as described above, each grid area is an intersection of the vertical frame area and the horizontal frame area. Therefore, after the horizontal enlargement / reduction process as described above is finished, Then, the process proceeds to the vertical enlargement / reduction process (steps A15 to A17 in FIG. 5). That is, the enlargement / reduction processing is performed by dividing the peripheral area into the horizontal direction and the vertical direction. As shown in FIG. 3A, when the vertical size is increased (YES in step A15), all other areas except the target area are sequentially set in the vertical direction with reference to the horizontal frame target area. The process of enlarging by changing the ratio is performed (step A16), but if the vertical size is to be reduced (NO in step A15), all the other areas except the target area are sequentially changed in the vertical direction and reduced. (Step A17). Therefore, as shown in FIG. 3A, when changing a landscape image to a portrait image, a reduction process is executed in the horizontal direction and an enlargement process is executed in the vertical direction. As shown in FIG. 3B, when the entire image is reduced, the reduction process is executed in both the vertical and horizontal directions.

  On the other hand, when “filter processing”, “color change”, and “brightness change” other than “aspect ratio change” and “size change” are selected as the image processing type (NO in step A3), FIG. Move on to the flow. If the selected image processing type is “filter processing” (YES in step A21), the process proceeds to execution of the target position specifying process similar to that described above (step A22). Then, the CPU 1 checks whether or not the target position can be specified with reference to the processing result (step A23), and if the target position cannot be specified, the filter processing ( (Blurring process) is performed (step A26).

  If the target position can be specified (YES in step A23), the output target image is divided into a matrix (a grid shape) and specified with respect to the target position in each grid area. A cell area (rectangular area) including an object (for example, a human face) is specified as a target area (step A24). Then, a filtering process (blurring process) is performed on all other areas except the target area (step A25). Even in this case, the filter processing is performed such that the processing strength gradually increases stepwise (exponentially) as the distance from the target region increases.

  If “color change” is selected (NO in step A21), the illustration is omitted, but basically, the target position is specified and the image is arranged in a matrix form as in “filter processing” described above. The target area is specified by dividing the target area and all areas excluding the target area are specified as processing targets, and then “color change processing” is performed on the target processing. In this case, the area other than the target area is changed to the designated color, but at least one of hue change, saturation change, and brightness change may be changed. Even in this case, the color changing process is performed such that the processing intensity increases stepwise (exponentially) as the distance from the target region increases.

  As described above, in this embodiment, when the CPU 1 causes the main display unit 9 to display and output an image (image to be output) such as a camera-captured image or a television broadcast reception image, the person included in the image is displayed. Is specified as the target area, and the image processing is performed on the area other than the target area and displayed and output. Therefore, regardless of where the person is located in the image, the area other than the target area is displayed. Image processing can be performed, and even if image processing is performed at the time of image display, the image quality of the target area is not adversely affected by this processing, and the original state of the part can be maintained. At the same time, it becomes possible to relatively improve the visibility of the target portion.

  In this case, since the CPU 1 recognizes a specific object included in the output target image by analyzing the output target image, the specific object, for example, a person, a building, a car, an object (character, graphic) is analyzed by the image analysis. Etc.) can be recognized as targets. Further, since the specific object is recognized based on the change state by analyzing the output target image, for example, the specific object is image-recognized based on the magnitude of change such as contrast, saturation, and brightness. be able to.

Since the CPU 1 obtains information indicating the “focus position” from the attribute information added to the photographed image and specifies the subject portion, the subject portion focused (at the best focus) during camera photography. Can be specified as a target.
Also, since the character part included in the output target image is specified as the target, for example, when taking a bus timetable instead of a memo, characters are included in this captured image. Can be specified as a target.

The CPU 1 changes the aspect ratio of the entire image by enlarging or reducing the peripheral portion except for the target when executing the aspect ratio changing process for changing the aspect ratio of the entire image. Even if the aspect ratio is changed, the target can be kept in its original size.
In addition, when executing the resizing process to change the size of the entire image, the size of the entire image is changed by enlarging or reducing the surrounding area except for the target area. Even if it is changed, the target can be kept in its original size.

  In this case, when enlarging or reducing the peripheral part of the target, the enlargement process that gradually increases as it moves away from the target or the reduction process that gradually decreases as it moves away from the target is performed. In addition to providing a perspective effect, it is also possible to provide a highlight effect with a sense that the target is raised.

  Any one of the aspect ratio changing process for changing the aspect ratio of the entire image, the size changing process for changing the size of the entire image, the filtering process for filtering the image, and the color changing process for changing the color of the image. Because it is possible to select, it is possible to perform blur processing such as mosaic, hue change processing, saturation change processing, brightness change processing on areas other than the target, and even when various processing is performed, it is not affected by it The initial state of the target can be maintained.

  In the above-described embodiment, the face portion of the person is targeted, but the whole body may be targeted as long as the entire person (whole body) is captured. In addition, when a character portion included in an output target image is specified as a target, it is specified by image recognition. However, in the case of a digital television broadcast reception image, it is added to this reception image. Target identification may be performed by referring to various types of information.

When a plurality of target areas are specified in one image, the sizes of the plurality of target areas may be compared to narrow down only to the largest target area. That is, one target may be specified from a plurality of targets, and the other targets may be invalidated. A plurality of targets may be effective. In this case, a region other than the plurality of target regions is a region to be processed.
In the above-described embodiment, information indicating the “focus position” is acquired from the attribute information added to the photographed image and the target is specified. May be specified.

In the embodiment described above, the output target image is divided into N horizontal frame areas by equally dividing the output target image into N in the vertical direction, or the image is divided into N vertical frame areas by equally dividing the image into N in the horizontal direction. However, the number of divisions is arbitrary, for example, the image can be divided into M equally in the horizontal direction, and the image can be divided into vertical and horizontal directions. You may make it divide | segment into XxY in a direction.
In addition, when changing the aspect ratio of an image, the entire image is divided into a plurality of vertical frame areas or horizontal frame areas. However, even when changing the aspect ratio of an image, matrix division may be performed in the vertical and horizontal directions. Good.

  In the above-described embodiment, when enlarging or reducing the peripheral area other than the target area, the enlargement process is performed such that the enlargement rate gradually increases as the distance from the target area increases, or gradually as the distance from the target area increases. However, on the contrary, the enlargement process in which the enlargement ratio gradually decreases as the distance from the target area decreases, or the distance from the target area increases. You may make it perform the reduction process so that a reduction rate becomes small gradually. Further, the peripheral area other than the target may be uniformly enlarged or uniformly reduced.

In addition, although the case where an image is displayed has been described in the above-described embodiments, the present invention is not limited to image display, and can be similarly applied to a case where an image is printed out or transmitted via a network.
Further, the present invention is not limited to a mobile phone device, and can be applied to a mobile terminal device such as a PDA, an electronic camera, an electronic wristwatch, a portable music player, a portable video recorder, and the like. Alternatively, a stationary image output device (a personal computer, a television receiver, a video recorder, or the like) may be used.

The block diagram which showed the basic component of the mobile telephone apparatus applied as an image output apparatus. When the special output function is selected by a user operation, examples of images before and after execution of this image processing are shown. (A) shows a standard ratio (aspect ratio 4: 3) to a wide ratio (aspect ratio) (B) shows a case where the ratio is changed from the wide ratio to the standard ratio. When the special output function is selected by a user operation, examples of images before and after the execution of the image processing are illustrated, and (A) shows a case where the display of the landscape image is changed to the display of the portrait image, (B) shows a case where the entire image is vertically and horizontally reduced, and (C) shows a case where a filter processing process (blurring process) is executed. The flowchart which showed the operation | movement started when the special output function which performs a predetermined process and displays on images, such as a camera picked-up image or a television broadcast reception image, is selected by user operation. The flowchart following FIG. The flowchart following FIG. 7 is a flowchart for explaining the target position specifying process of FIGS. 4 and 6 in detail. When (A) is divided into N vertical frame areas by dividing the image into N parts in the horizontal direction, (B) is divided into N vertical frame areas by dividing the image into N parts in the vertical direction. (C) is a diagram for explaining a target position, a target region, and a region other than the target region when an image is divided into an N × M matrix (a grid).

Explanation of symbols

1 CPU
2 Storage unit 3 Recording medium 5 Telephone communication unit 9 Main display unit 11 TV reception unit 15 Key operation unit 17 Camera imaging unit

Claims (11)

An image output apparatus that performs image processing on an output target image and outputs the image,
A specifying means for specifying a part in the output target image as a target portion based on information obtained by image analysis of the output target image, information at the time of image capturing, or information added to the output target image;
Processing means for changing the size of the entire image by enlarging or reducing the peripheral part except for the attention part specified by the specifying means;
Output means for outputting an image processed by the processing means;
An image output apparatus comprising: The image processing process is an aspect ratio changing process for changing the aspect ratio of the entire image,
The processing means changes the aspect ratio of the entire image by enlarging or reducing the peripheral portion.
The image output apparatus according to claim 1 . The specifying unit recognizes a specific object included in the output target image as an attention part by analyzing the output target image.
The image output apparatus according to claim 1 or 2, characterized in that the the like. The specifying means recognizes a target portion based on the change state by analyzing the output target image,
The image output apparatus according to claim 1 or 2, characterized in that the the like. The specifying unit specifies a subject portion focused at the time of camera shooting from an output target image as a shot image as a target portion.
The image output apparatus according to claim 1 or 2, characterized in that the the like. The specifying means specifies a character portion included in the output target image as a target portion;
The image output apparatus according to claim 1 or 2, characterized in that the the like. The specifying unit specifies a target portion in the image based on additional information added to the output target image;
The image output apparatus according to claim 1 or 2, characterized in that the the like. The processing means, when enlarging or reducing the peripheral portion, executes an enlargement process that gradually changes the enlargement rate as it is away from the attention portion, or a reduction process that gradually changes the reduction rate as it is away from the attention portion.
The image output apparatus according to any one of claims 1 to 7, characterized in that the the like. The processing means changes the size of the entire image, and executes a filter processing process that filters the image of the peripheral part , or a color change process that changes the color of the image of the peripheral part .
The image output apparatus according to any one of claims 1 to 8, characterized in that the the like. Against the computer,
A function for identifying a part in the output target image as a target part based on information obtained by image analysis of the output target image, information at the time of image capture, or information added to the output target image;
A function for performing image processing to change the size of the entire image by enlarging or reducing the peripheral portion except the identified attention portion;
A function to output the processed image;
A program to realize The function of performing the image processing processing is to change the aspect ratio of the entire image by enlarging or reducing the peripheral portion.
The program according to claim 10 .

Images