WO2012120759A1

WO2012120759A1 - Image processing device and image processing method

Info

Publication number: WO2012120759A1
Application number: PCT/JP2012/000230
Authority: WO
Inventors: 広祐鈴木; 知樹村田
Original assignee: 株式会社ソニー・コンピュータエンタテインメント
Priority date: 2011-03-10
Filing date: 2012-01-17
Publication date: 2012-09-13
Also published as: JP2012190265A; JP5798343B2

Abstract

A hard disk drive (50) holds a plurality of image files in which the image data and size data of objects are made to correspond to each other. A mode setting unit (142) sets a predetermined ratio display mode for displaying an object image with a predetermined ratio with respect to a size specified by the size data. An enlargement/reduction ratio determination unit (148) determines the enlargement or reduction ratio of a display image so that the object image is displayed on a display unit with the predetermined ratio with respect to the size specified by the size data. An image size adjustment unit (150) enlarges or reduces an image. A display image generation unit (152) generates the display image including the object image.

Description

Image processing apparatus and image processing method

The present invention relates to an image processing technique for displaying an image on a display unit such as a display.

Conventionally, a system for displaying product images in actual size has been proposed (see, for example, Patent Document 1). In this system, first, the transmission side measures the actual size information X on the imaging surface when sending a product imaging screen, and adds the actual size information X along with the imaging output of the object to be the product, and transmits it. On the receiving side, an enlargement or reduction ratio R (= X / Y) that is an actual size is calculated from the display size information Y and the received actual size information X, and the reproduction screen is enlarged or reduced. . According to this technology, the product can be displayed on the display in the same size as the actual size.

JP 2002-199358 A

As disclosed in Patent Document 1, displaying a product on the display in the same size as the actual size can make the user recognize the real size of the product, and thus raises interest in the product. At this time, if a mechanism capable of comparing the real sizes of various objects can be constructed, the user can recognize not only the size but also the relative sizes of a plurality of objects.

Therefore, an object of the present invention is to provide a technique for generating a display image capable of comparing the sizes of a plurality of objects.

In order to solve the above problems, an image processing apparatus according to an aspect of the present invention relates to an image processing apparatus that displays an image on a display unit, and holds image data of a plurality of objects and dimension data of each object. A storage device and a display image processing unit that displays an object image on a display unit are provided. The display image processing unit includes a mode setting unit that sets a predetermined ratio display mode for displaying the object image at a predetermined ratio with respect to the size specified by the dimension data, and the object image is specified by the dimension data on the display unit. Generating a display image including a target image, a determination unit that determines an enlargement ratio or a reduction ratio of the display image, an image size adjustment unit that enlarges or reduces the image, and a display image. A display image generation unit, and the image size adjustment unit includes a target image included in the display image generated continuously in time by the display image generation unit in the predetermined ratio display mode, or a display image generation unit. A plurality of object images included in one display image generated by the above are enlarged or reduced to a size having a predetermined ratio with respect to the size specified by the dimension data of each object.

Another aspect of the present invention relates to an image processing method, comprising: setting a predetermined ratio display mode for displaying an object image at a predetermined ratio with respect to a size specified by dimension data; and the object image is displayed on a display unit. A step of determining an enlargement or reduction ratio of the display image, a step of enlarging or reducing the image, and a display image including the object image so as to be displayed at a predetermined ratio with respect to the size specified by the dimension data. Generating. In the predetermined ratio display mode, the step of enlarging or reducing the image includes an object image included in a display image that is continuously displayed in time by the display image generation step, or one display displayed by the display image generation step. A plurality of object images included in the image are enlarged or reduced to a size having a predetermined ratio with respect to the size specified by the dimension data of each object.

It should be noted that an arbitrary combination of the above-described components and a conversion of the expression of the present invention between a method, an apparatus, a system, a recording medium, a computer program, and the like are also effective as an aspect of the present invention.

According to the present invention, it is possible to provide the user with a display image that can compare the sizes of a plurality of objects.

It is a figure which shows the use environment of the image processing system concerning the Example of this invention. It is a figure which shows the external appearance structure of an input device. It is a figure which shows the functional block diagram of an image processing apparatus. It is a figure which shows the structure of the control part in an image processing apparatus. It is a figure which shows an example of the image file containing a person. It is a figure which shows the area | region of the target object image to which dimension data is allocated. It is a figure which shows another example of the area | region of the target object image to which dimension data is allocated. It is a figure which shows the example of an initial screen when the image file shown in FIG. 5 is displayed on the display of a display apparatus. It is a figure which shows an example of the image file containing a human image. It is a figure which shows an example of the image file containing a human image. It is a figure which shows the image when a child is a baby. It is a figure which shows the image when a child was an elementary school student. It is a figure which shows an image when a child grows up. It is a figure which shows an example of the display image which arranged the some target object image. It is a figure which shows the flowchart of the image process in a present Example.

FIG. 1 shows a use environment of an image processing system 1 according to an embodiment of the present invention. The image processing system 1 includes an input device 20, an image processing device 10 that executes image processing software, and a display device 12 that outputs a processing result by the image processing device 10. Although not shown, the image processing apparatus 10 may be connected to an external network such as the Internet via a router. The network is connected to a providing server that holds an image file in which image data and dimension data of an object are associated with each other. The image processing apparatus 10 can download and obtain a plurality of image files from the providing server. Note that the image processing apparatus 10 may acquire a plurality of image files from a ROM medium or the like. The image processing apparatus 10 may generate an image file in which the image data and the dimension data are associated with each other by causing the user to record the dimension data in the already recorded image data.

The image processing device 10 is, for example, a game device, and realizes an image processing function by loading an application program for image processing. The image processing apparatus 10 may be a personal computer, and may implement an image processing function by loading an image processing application program.

The display device 12 may be a television provided with a display that outputs an image and a speaker that outputs sound. The display device 12 may be connected to the image processing device 10 by a wired cable, or may be wirelessly connected by a wireless LAN (Local Area Network) or the like. The display is an example of a display unit that displays an image. As another example, the display unit may include a projector and a screen that projects an image from the projector.

The image processing apparatus 10 according to the present embodiment has a function of displaying an object image for which dimension data is set on the display device 12 at a size that is a predetermined ratio with respect to the size specified by the dimension data. For example, the dimension data designates the actual dimension of the object, and the image processing apparatus 10 generates the object image at an actual dimension ratio of 1/1 (1: 1). At this time, the object is displayed in actual size on the display of the display device 12. Therefore, it is preferable that the display device 12 installed on the wall surface of the room has a large display size. In addition, although it is preferable that the vertical width of a display is about 2 m, the vertical width of a display is not limited to this and may be smaller than 2 m.

The image processing apparatus 10 changes the display image according to a request input to the input device 20 from the user, such as an enlargement / reduction process of an image displayed on the display of the display apparatus 12 and a movement process in the vertical and horizontal directions. Process. When the user operates the input device 20 while viewing the image displayed on the display, the input device 20 transmits a display image change request to the image processing device 10.

In the image file, dimension data serving as a reference when an object image is displayed on the display device 12 in a predetermined ratio display mode to be described later is recorded. Note that the dimension data may be embedded in the image data, but correspondence data in which the coordinate value of the target object image and the dimension data in the target object image data are associated with each other is prepared separately from the image data. May be. The correspondence data may be generated, for example, by a user input. However, when the target is an actor or a cartoon character, the dimension data is acquired from the Internet or the like, and the coordinate value of the target image is obtained. Dimension data may be associated. In this case, the image data and the corresponding data are collectively called an image file.

Dimension data may be defined by the length in either the height direction or the horizontal direction. When the image processing apparatus 10 receives a request for the display of the full size of the target image, the image processing apparatus 10 adjusts the size of the target image so as to be the size specified by the dimension data on the display, and generates a display image. Thereby, the user can see a full-size image of the object on the display.

When the user collects favorite actor image files, a life-size actor image can be displayed on the display of the display device 12. Also, when the user records the child's growth with a digital camera, the child's height at the time of shooting can be reproduced on the display by associating the child's height with each image data. For example, from birth to the present You can see the process of getting bigger and bigger when you switch between these photos.

As described above, in this embodiment, an actual size is set in advance for an object image, and each object image is displayed in an actual size so that the user can feel the size of the object. An apparatus 10 is provided. At this time, the image processing apparatus 10 continuously displays different object images in terms of time, or displays different object images in full size on one display image, so that the user can Enable to compare the size of images. In the following, a case where a person is displayed will be described as an example. For example, the image processing apparatus 10 may display an image of a work of art such as a painting or sculpture in full size, and is included in a product catalog. The product image may be displayed in actual size. Further, in this embodiment, the description will be made on the assumption that the actual size of the object is displayed. However, for example, the target may be displayed with respect to the actual size at a predetermined magnification or reduction rate.

FIG. 2 shows an external configuration of the input device 20. The input device 20 includes a cross key 21, analog sticks 27a and 27b, and four types of operation buttons 26 as operation means that can be operated by the user. The four types of operation buttons 26 include a circle button 22, a x button 23, a square button 24, and a triangle button 25.

In the image processing system 1, a function for inputting a display image enlargement / reduction request and a vertical / left / right scroll request is assigned to the operation unit of the input device 20. For example, the input function of the display image enlargement / reduction request is assigned to the right analog stick 27b. The user can input a display image reduction request by pulling the analog stick 27b forward, and can input a display image enlargement request by pressing the analog stick 27b from the front. Also, the input function of the display image scroll request is assigned to the left analog stick 27a. The user can input a scroll request in the tilted direction by tilting the analog stick 27a up, down, left and right. As described above, the analog sticks 27a and 27b are used for continuously scrolling the display image and continuously enlarging / reducing the display image.

In the present embodiment, dimension data for display on the display is set in advance in the object image, and a request for displaying the specified object image in full size is input to the operating means of the input device 20. Function is assigned. For example, a function for inputting a request to display the object in actual size may be assigned to the □ button 24. One image file includes image data and dimension data of one object. When the □ button 24 is pressed, the display mode changes the object image to the size specified by the dimension data. The predetermined ratio display mode for displaying at a predetermined ratio is set, and the object image is displayed in actual size.

The input device 20 has a function of transmitting an input request to the image processing device 10, and is configured to be capable of wireless communication with the image processing device 10 in this embodiment. The input device 20 and the image processing device 10 may establish a wireless connection using a Bluetooth (registered trademark) protocol, an IEEE802.11 protocol, or the like. The input device 20 may be connected to the image processing apparatus 10 via a cable and transmit an input request to the image processing apparatus 10.

FIG. 3 shows a functional block diagram of the image processing apparatus 10. The image processing apparatus 10 includes a wireless interface 40, a switch 42, a display processing unit 44, a hard disk drive 50, a recording medium mounting unit 52, a disk drive 54, a main memory 60, a buffer memory 70, and a control unit 100. . The display processing unit 44 has a frame memory that buffers data to be displayed on the display of the display device 12.

The switch 42 is an Ethernet switch (Ethernet is a registered trademark), and is a device that transmits and receives data by connecting to an external device in a wired or wireless manner. The switch 42 may be connected to a network via a router and receive a plurality of image files from the providing server. The switch 42 is connected to the wireless interface 40, and the wireless interface 40 is connected to the input device 20 using a predetermined wireless communication protocol. A request input from the user in the input device 20 is supplied to the control unit 100 via the wireless interface 40 and the switch 42.

The hard disk drive 50 functions as an auxiliary storage device that stores data. A plurality of image files received via the switch 42 may be stored in the hard disk drive 50. When executing the display process, the image file stored in the hard disk drive 50 is read out to the main memory 60. When a removable recording medium such as a memory card is mounted, the recording medium mounting unit 52 reads data from the removable recording medium. When a read-only ROM disk is loaded, the disk drive 54 drives and recognizes the ROM disk to read data. The ROM disk may be an optical disk or a magneto-optical disk. The plurality of image files may be installed in the hard disk drive 50 from a memory card or a ROM disk.

The control unit 100 includes a multi-core CPU, and has one general-purpose processor core and a plurality of simple processor cores in one CPU. The general-purpose processor core is called PPU (Power Processing Unit), and the remaining processor cores are called SPU (Synergistic-Processing Unit).

The control unit 100 includes a memory controller connected to the main memory 60 and the buffer memory 70. The PPU has a register, has a main processor as an operation execution subject, and efficiently assigns a task as a basic processing unit in an application to be executed to each SPU. Note that the PPU itself may execute the task. The SPU has a register, and includes a sub-processor as an operation execution subject and a local memory as a local storage area. The local memory may be used as the buffer memory 70. The main memory 60 and the buffer memory 70 are storage devices and are configured as a RAM (Random Access Memory). The SPU has a dedicated DMA (Direct Memory Access) controller as a control unit, can transfer data between the main memory 60 and the buffer memory 70 at high speed, and the frame memory and the buffer memory 70 in the display processing unit 44 High-speed data transfer can be realized. The control unit 100 according to the present embodiment realizes a high-speed image processing function by operating a plurality of SPUs in parallel. The display processing unit 44 is connected to the display device 12 and outputs a display image generated by a display image generation unit described later to a display.

FIG. 4 shows a configuration of the control unit 100 in the image processing apparatus 10. The control unit 100 includes an input signal processing unit 120, a display resolution deriving unit 130, and a display image processing unit 140. The input signal processing unit 120 includes a request acquisition unit 122 and a mode designation reception unit 124. The display image processing unit 140 includes a mode setting unit 142, an image file acquisition unit 144, an image cutout unit 146, an enlargement / reduction ratio determination unit 148, an image size adjustment unit 150, a display image generation unit 152, and a notification unit 154. The input signal processing unit 120 receives an input request from the user and supplies information necessary for display processing to the display image processing unit 140.

In FIG. 4, each element described as a functional block for performing various processes can be configured by a CPU (Central Processing Unit), a memory, and other LSIs in terms of hardware. This is realized by a program loaded on the computer. As described above, the control unit 100 includes one PPU and a plurality of SPUs, and each functional block can be configured by the PPU and the SPU individually or in cooperation. Therefore, it is understood by those skilled in the art that these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof, and is not limited to any one.

The hard disk drive 50 holds a plurality of image files in which object image data and dimension data are associated with each other. As described above, the plurality of image files may be acquired from a providing server via a network, or may be provided from a ROM medium or the like. An image file may be generated by embedding the dimension data in the photograph data or the like, and the photograph data and the dimension data may be held in the hard disk drive 50 as separate data. In the following, the case where the object to be displayed is a human will be described. However, the object to be displayed may be a pet that you own, and it is an animation that has published physical characteristics of appearance such as height. It may be a character or the like.

In the image processing apparatus 10 of the present embodiment, the user can enlarge or reduce the image displayed on the display of the display device 12 by operating the input device 20. As described above, the image processing apparatus 10 can set the “free display mode” in which the user can freely enlarge and reduce the display image. In the free display mode, the user can enlarge the object image to his / her favorite magnification or reduction. Can be displayed on the display at a rate.

Furthermore, the image processing apparatus 10 can set a “predetermined ratio display mode” for displaying the object image at a predetermined ratio with respect to the size specified by the dimension data. In the predetermined ratio display mode, when the user selects an image file including an object image and displays it on the display, and presses a predetermined button (□ button 24), the object image included in the image file is converted into dimension data. Is displayed at a predetermined ratio with respect to the size specified by. In the predetermined ratio display mode, when an image file is selected thereafter, the object image is displayed at a predetermined ratio with respect to the specified size. In the present embodiment, since the size specified by the dimension data is an actual dimension, if the predetermined ratio is set to 1: 1, the object image is displayed on the display at the actual size. If the predetermined ratio is set to 1/2 (2: 1), the target object image is displayed on the display at 1/2 scale.

In the predetermined ratio display mode, the user may switch display images by selecting image files one by one, but the order of image files to be displayed may be determined in advance. When the display order of a plurality of image files is determined, when the user presses a predetermined operation button (for example, the Δ button 25), the image files are selected according to the order, and the objects included in each image file The image is enlarged or reduced so as to have a predetermined ratio with respect to the dimension data, and is displayed on the display. The display time of each object image may be set to a predetermined value such as 10 seconds, for example, and the object image may be automatically switched every 10 seconds. In the predetermined ratio display mode, an object included in a series of images that are continuously displayed by previously registering an enlargement ratio or reduction ratio with respect to the actual size display and registering the predetermined ratio to 1: 1. The object image is displayed in actual size.

FIG. 5 shows an example of an image file including a person. This image file is captured by a digital camera and is generated by associating dimension data with human image data after shooting. In the XY coordinates of this image file, the upper left corner is (0, 0), the lower left corner is (0, 1), the upper right corner is (1, 0), and the lower right corner is (1, 1). The dimension data may be expressed in the size in the horizontal direction (X axis) or may be expressed in the size in the vertical direction (Y axis). Therefore, the dimension data includes information for designating whether the dimension data is in the horizontal direction or the vertical direction so that the direction of the dimension data can be specified.

Since the size of human appearance is expressed by height, the size data is expressed by the size in the vertical direction in the image processing apparatus 10 of the present embodiment. Height refers to the size of a person standing upright. For example, if a person is sitting on a chair and is not standing upright, the height is not from the height of the person sitting on the chair. Dimension data indicating the height to the head is set. Further, the dimension data of a lying human image such as lying down may be expressed by a length in the horizontal direction.

FIG. 6 shows an object image area to which dimension data is assigned. The area 200 is an area of a human image to which human dimension data is assigned. The area 200 is set as a rectangular area surrounding the human image, and is specified by coordinates (x1, y1), (x1, y2), (x2, y1), and (x2, y2) at four corners. The area 200 is associated with human dimension data (for example, 180 cm). The data structure of the image file includes image data, coordinate information of the object image, and dimension data. The region 200 may be set by an existing image processing technique. Specifically, the region 200 is set by extracting a human image from the background and deriving four sides surrounding the human image. The area 200 may be set by a user operating a pointer or the like. The dimension data may be embedded in the image data, but separately from the image data, a file is prepared in which the dimension data of the object image is recorded in association with the coordinate information that identifies the rectangular area surrounding the object image. May be.

FIG. 7 shows another example of the area of the object image to which the dimension data is assigned. A region 202 is a region of a human image to which human dimension data is assigned. The area 202 is set as an area closed by the outline of the human image. The region 202 may be set by an existing image processing technique and may be derived by extracting a human image from the background. The area 202 is associated with human dimension data (180 cm). In order to facilitate understanding, the following description is based on an example in which a rectangular area of the object image is set as shown in FIG.

FIG. 8 shows an example of an initial screen when the image file shown in FIG. 5 is displayed on the display device 12. In this initial screen example, the enlargement ratio of the image data is automatically adjusted in accordance with the vertical length of the image data shown in FIG. 5 according to the vertical width of the display. Note that the initial screen may be configured without enlarging the image data shown in FIG. In the following, a case where one object image is included in one image file is taken as an example.

When the initial screen is displayed, the display mode is set to the free display mode. The user can input a display image reduction request by pulling the analog stick 27b forward, and can input a display image enlargement request by pressing the analog stick 27b from the front. Referring to FIG. 4, when request acquisition unit 122 receives a reduction request, enlargement / reduction rate determination unit 148 determines a reduction rate according to the operation amount, and image size adjustment unit 150 determines the reduced reduction. Reduce the size of the display image based on the rate. On the other hand, when the request acquisition unit 122 receives the enlargement request, the enlargement / reduction rate determination unit 148 determines the enlargement rate according to the operation amount, and the image size adjustment unit 150 displays based on the determined enlargement rate. Increase the size of the image. In the free display mode, the enlargement / reduction ratio determination unit 148 determines a reduction ratio or an enlargement ratio for the displayed image.

When the user continues to push the analog stick 27b from the front, the request acquisition unit 122 continuously accepts enlargement requests, and the enlargement / reduction rate determination unit 148 gradually increases the enlargement rate, whereby the image size adjustment unit 150 is increased. However, the size of the display image is continuously enlarged. The display image generation unit 152 generates a display image reduced or enlarged by the image size adjustment unit 150 and outputs the display image from the display processing unit 44 to the display device 12. As described above, in the free display mode, the user can freely reduce or enlarge the display image by operating the input device 20. The user can input a scroll request in the tilted direction by tilting the analog stick 27a up, down, left and right. In the free display mode, when the display image is displayed at a predetermined ratio with respect to the size specified by the dimension data, for example, a message indicating that the display image is displayed at the predetermined ratio or a sound is output. For example, an effect may be provided that indicates that the image is displayed at a predetermined ratio to the user.

When the user presses a predetermined button, for example, the □ button 24 in a state where the free display mode is set, the mode designation receiving unit 124 receives a setting instruction for the predetermined ratio display mode. The □ button 24 is used as a button for inputting a mode switching instruction. When the □ button 24 is pressed, the mode designation receiving unit 124 receives the mode switching instruction and supplies it to the mode setting unit 142. The mode setting unit 142 performs switching control between the free display mode and the predetermined ratio display mode, and when the switching instruction is supplied while the free display mode is set, the mode setting unit 142 sets the display mode to the predetermined ratio display mode. .

In the predetermined ratio display mode, the enlargement / reduction ratio determination unit 148 sets the enlargement ratio or reduction ratio of the display image so that the object image is displayed at a predetermined ratio with respect to the size specified by the dimension data on the display. decide. It is assumed that the predetermined ratio is set to 1: 1. In the predetermined ratio display mode, the enlargement ratio is the ratio when the display image (original image) when the image data included in the image file is displayed on the display as it is (without enlargement / reduction) is enlarged by 1 or more times. Further, the reduction ratio means a ratio when the original image is enlarged to 1 time or less. Thus, in the predetermined ratio display mode, both the enlargement ratio and the reduction ratio express the ratio to the size of the original image. May also be called.

The enlargement / reduction ratio determination unit 148 acquires the dimension data of the object image included in the image file. Here, the enlargement / reduction rate determination unit 148 acquires the size data (180 cm) of the human image. The enlargement / reduction rate determination unit 148 determines the enlargement rate so that the object image has a size designated by the dimension data on the display. The enlargement / reduction ratio determination unit 148 determines the enlargement ratio of the object image based on the resolution of the display.

The display size holding unit 132 holds the size of the display. The display size may be defined by the diagonal length and aspect ratio of the display. The aspect ratio is the ratio of the number of horizontal and vertical pixels or the length. For example, the aspect ratio of a display for SDTV is 4: 3, and the display for HDTV is 16: 9. The computer display has an aspect ratio of 4: 3, 5: 4, or the like. The display size may be input by the user when the display device 12 is connected to the image processing device 10, for example. The display size may be the vertical and horizontal lengths of the display instead of the length of the diagonal line of the display. In addition, the display of a present Example also includes the large sized display whose vertical width is about 2 m. The display size also includes information on the number of vertical and horizontal pixels.

The display resolution deriving unit 130 derives the display resolution from the display size held in the display size holding unit 132. Display resolution is pixel density and may be defined by the number of pixels per unit length. A typical unit of display resolution is dpi (dot per inch), but is not limited thereto.

Specifically, the display resolution deriving unit 130 derives the vertical and horizontal lengths of the display from the display size. For example, when the display diagonal length and the aspect ratio are maintained as the display size, the display resolution deriving unit 130 can derive the vertical and horizontal lengths using these pieces of information. Furthermore, since the vertical and horizontal numbers of pixels are held as the display size, the vertical and horizontal display resolutions (pixel density) are derived, respectively.

First, the display resolution deriving unit 130 derives the vertical width L and the horizontal width W from the length of the diagonal line and the aspect ratio. Here, if the number of vertical pixels is PL and the number of horizontal pixels is WL, it is derived that the vertical display resolution is PL / L and the horizontal display resolution is WL / L. The unit of each display resolution is dpi.

The display resolution holding unit 134 holds the vertical and horizontal resolutions of the display derived by the display resolution deriving unit 130. When the display resolution is known, the display resolution deriving unit 130 does not need to calculate by the above calculation, and the display resolution holding unit 134 may hold the known resolution.

The display size holding unit 132 and the display resolution holding unit 134 may be storage areas formed in the hard disk drive 50. When the display device 12 is an HDMI device, the display device 12 may inform the image processing device 10 of the display size and the number of vertical and horizontal pixels by making an inquiry to the display device 12.

The enlargement / reduction ratio determination unit 148 determines the enlargement ratio of the object image based on the dimension data of the object image and the resolution of the display. In the free display mode, the enlargement / reduction rate determination unit 148 has determined the enlargement rate (or reduction rate) for the displayed image. However, in the predetermined ratio display mode, the enlargement / reduction rate determination unit 148 The enlargement ratio is determined for the original image data.

First, the enlargement / reduction rate determination unit 148 derives the number of vertical pixels LEP necessary to display a human image having a height of 180 cm in full size.
LEP = (number of pixels per 1 cm) × actual size = PL / (L × 2.54) × 180 cm
(1 inch = 2.54cm)

Subsequently, referring to FIG. 6, the enlargement / reduction rate determination unit 148 derives the number of pixels in the vertical direction when the image data included in the image file is expanded. In FIG. 6, the vertical width of the object image is (y2−y1), and the enlargement / reduction ratio determination unit 148 determines the number of pixels used when displaying the object image data without enlargement / reduction. To derive. Assume that this number of pixels is PS. The enlargement factor EF in the vertical direction when the original image is displayed at 180 cm on the display is
EF = (vertical pixel count during full size display / vertical pixel count of human image in original image)
= LEP / PS
It becomes. Here, the vertical enlargement factor EF is obtained. However, if the vertical display resolution PL / L and the horizontal display resolution WL / L are the same, the same enlargement factor EF is also applied in the horizontal direction.

In this way, the enlargement / reduction ratio determination unit 148 determines the enlargement ratio EF in the vertical direction and the horizontal direction of the object image. When the enlargement ratio is expressed by the square of one side, the enlargement ratio is the square of EF. As described above, the enlargement / reduction ratio determination unit 148 determines the enlargement ratio of the display image displayed on the display at a predetermined ratio (1: 1) with respect to the size specified by the dimension data. To do.

The image size adjustment unit 150 enlarges or reduces the image at the enlargement rate determined by the enlargement / reduction rate determination unit 148. The display image generation unit 152 receives the image data enlarged or reduced by the image size adjustment unit 150 and generates a display image including the object image. Thereby, as shown in FIG. 1, a display image obtained by adjusting the size of the object image to the actual size is shown on the display.

The image file acquisition unit 144 has a function of selecting an image file to be displayed from a plurality of image files held in the hard disk drive 50. The image file acquisition unit 144 selects an image file according to a predetermined display order, and this display order may be specified by the user. Note that the image file acquisition unit 144 may specify the display order based on the attributes of the image file, for example, the file generation date. The image processing apparatus 10 according to the present embodiment has a function of continuously displaying object images included in a plurality of image files in a predetermined ratio display mode, and the image file acquisition unit 144 includes: The image file to be displayed is automatically selected without the user's selection operation. Note that the timing selected by the image file acquisition unit 144 may be triggered by the user's button operation.

Hereinafter, an example will be described in which the image file acquisition unit 144 sequentially selects from a baby image file to an adult image file in order to express a child's growth record. This display order is set by the user.

FIG. 9 shows an example of an image file including a human image. This image file contains an image of a baby. A region 204 is a region of a human image to which human dimension data is assigned, and is specified by coordinates (x3, y3), (x3, y4), (x4, y3), (x4, y4) at four corners. The area 204 is associated with human dimension data (for example, 55 cm). The data structure of the image file includes image data, coordinate information of the object image, and dimension data.

FIG. 10 shows an example of an image file including a human image. This image file contains images from elementary school. A region 206 is a region of a human image to which human dimension data is assigned, and is specified by coordinates (x5, y5), (x5, y6), (x6, y5), (x6, y6) at four corners. The area 206 is associated with human dimension data (for example, 100 cm). The data structure of the image file includes image data, coordinate information of the object image, and dimension data.

The image file acquisition unit 144 selects the image file shown in FIG. 9, the image file shown in FIG. 10, and the image file shown in FIG. First, the image file acquisition unit 144 selects the image file shown in FIG. 9 and acquires the image file. The enlargement / reduction ratio determination unit 148 determines the enlargement ratio of the object image based on the dimension data (55 cm) of the object image and the resolution of the display. The image size adjustment unit 150 enlarges or reduces the image at the enlargement rate determined by the enlargement / reduction rate determination unit 148. The display image generation unit 152 receives the image data enlarged or reduced by the image size adjustment unit 150 and generates a display image including the object image. The display processing unit 44 displays the generated display image on the display device 12.

FIG. 11 shows an image when the child was a baby. As a result of the processing by the enlargement / reduction rate determination unit 148 and the image size adjustment unit 150, the baby image is adjusted to 55 cm in the height direction and displayed on the display. If the image file includes meta information, the meta information may be displayed. For example, the display image generation unit 152 may display dimensions around the object image. In addition, when the shooting date of the photograph is included in the meta information, the shooting date may be displayed. Further, when the meta information includes a comment input by the user, the comment may be displayed. The meta information is preferably displayed at a position that does not overlap the object image.

Here, when the user presses the Δ button 25, the image file acquisition unit 144 selects the image file shown in FIG. 10 according to the display order, and acquires the image file.

The enlargement / reduction ratio determination unit 148 determines the enlargement ratio of the object image based on the dimension data (100 cm) of the object image and the resolution of the display. The image size adjustment unit 150 enlarges or reduces the image at the enlargement rate determined by the enlargement / reduction rate determination unit 148. The display image generation unit 152 receives the image data enlarged or reduced by the image size adjustment unit 150 and generates a display image including the object image. The display processing unit 44 displays the generated display image on the display device 12.

FIG. 12 shows an image when the child was in elementary school. As a result of the processing by the enlargement / reduction ratio determination unit 148 and the image size adjustment unit 150, an image of an elementary school age is displayed on the display with the height adjusted to 100 cm.

Here, when the user presses the Δ button 25, the image file acquisition unit 144 selects the image file shown in FIG. 5 according to the display order, and acquires the image file.

The enlargement / reduction rate determination unit 148 determines the enlargement rate of the object image based on the dimension data (180 cm) of the object image and the resolution of the display. The image size adjustment unit 150 enlarges or reduces the image at the enlargement rate determined by the enlargement / reduction rate determination unit 148. The display image generation unit 152 receives the image data enlarged or reduced by the image size adjustment unit 150 and generates a display image including the object image. The display processing unit 44 displays the generated display image on the display device 12.

FIG. 13 shows an image when the child is an adult. As a result of the processing by the enlargement / reduction ratio determination unit 148 and the image size adjustment unit 150, an image of an adult is displayed on the display with the height adjusted to 180 cm.

As described above, the image size adjustment unit 150 displays the object image included in the display image displayed continuously in time by the display image generation unit 152 with respect to the size specified by the dimension data of each object. To enlarge or reduce to a predetermined ratio. As a result, as shown in FIGS. 11, 12, and 13, the process of the child's growth can be continuously displayed on the display in actual size so that the user can compare the size of the child. Become.

Note that the display image generation unit 152 preferably aligns the positions of the object images on the display when generating display images continuously. The display image generation unit 152 stores the position on the display of the object image generated at the start of the predetermined ratio display mode, and when the display image is generated next time, the position of the object image was previously displayed. Set according to the position of the object image. Specifically, the display image generation unit 152 stores the horizontal center position of the object image to be displayed first, and sets the horizontal center position of the object image to be displayed next time to the stored center position. Try to match. The display image generation unit 152 also stores the lowest position in the vertical direction of the object image to be displayed first, and stores the lowest position in the vertical direction of the object image to be displayed next time as the stored lowest position. It is preferable to match. The center position and the lowest position of the object image are derived with reference to the area of the object image shown in FIGS. Thus, the user can view the continuously displayed object images without moving his eyes, and can easily compare the sizes of the object images by aligning the lowest positions.

In this example, the lowest position is stored, but the display image generation unit 152 stores the lowest position when the dimension data is in the vertical direction, while the dimension data Is the horizontal direction, the leftmost position (or rightmost position) of the object image to be displayed first is stored. Thereby, the display image generation unit 152 can align the reference positions of the object images to be continuously displayed. When displaying the meta information together, the display image generating unit 152 determines the display position of the meta information on the basis of the set lowermost position or leftmost position. For example, when the lowest position is set, meta information is displayed below the lowest position, and when the leftmost position is set, the meta information is displayed to the left of the leftmost position. Display information. Thus, by setting the display position of the meta information, the meta information can be displayed so as not to overlap the object image.

When the display image generation unit 152 determines that the entire object image enlarged by the image size adjustment unit 150 cannot be displayed on the display, the notification unit 154 displays a predetermined message on the display. This message may be, for example, a warning “When you display in full size, it will protrude from the screen. Do you still want to display in full size?”. When the display image generation unit 152 recognizes that a part of the object image protrudes from the display when the lowest position of the object image is aligned with the lowest position stored, the display image generation unit 152 displays the object image on the display. Adjust the position so that it is shifted to the lower end of. Still, when it is determined that the entire object image cannot be displayed on the display, the notification unit 154 may display a predetermined message on the display. Whether or not the entire object image can be included in the display when the object image is shifted to the lower end of the display can be determined simply by comparing the width of the display size with the dimension data. Good.

The display image generation unit 152 receives image data obtained by enlarging or reducing the object image to a size that is a predetermined ratio with respect to the size specified by the dimension data by the image size adjustment unit 150, and generates a display image. At that time, a blank area may appear on the display. Note that the margin area means an area where the amount of image data is insufficient with respect to the number of pixels of the display and display data does not exist. When the display image generation unit 152 determines that a blank area is generated on the display, the display image generation unit 152 may fill the blank area with a predetermined color (for example, black), but the image file acquisition unit 144 acquires another image file. May be indicated.

Upon receiving an instruction from the display image generation unit 152, the image file acquisition unit 144 selects and acquires an image file according to a predetermined display order. The acquired image file is enlarged or reduced by the enlargement / reduction rate determination unit 148 and the image size adjustment unit 150, and passed to the display image generation unit 152. The display image generation unit 152 may include object images acquired from a plurality of image files in one display image. At this time, the image cutout unit 146 may cut out a region of the object image from the image data, and the display image generation unit 152 may arrange the cut out object image on one display image. At this time, the image cutout unit 146 cuts out the region of the target object image shown in FIG. 5 or 6 set in the image file, and the display image generation unit 152 displays the plurality of cutout target object images as one display. Arrange them side by side on the image. If the blank area still exists, the blank area may be filled with a predetermined color.

FIG. 14 shows an example of a display image in which a plurality of object images are arranged. The display image generation unit 152 arranges object images included in a plurality of image files, and generates a display image that is displayed in actual size. As described above, when a blank area is generated when a display image is generated with one image file, the user extracts one object image from another image file and arranges a plurality of object images, so that the user can Images can be compared in size with multiple object images, and in this example, the user can see the child's growth process in one image.

The display image generation unit 152 sets an interval between the target images according to the number of target images to be displayed. The interval between the object images is preferably uniform. The image cutout unit 146 cuts out the area of the target object image, and the display image generation unit 152 arranges the cutout target object image so that the interval between the target object images can be set uniformly, so that the user can easily view the display image. Can be generated.

Note that the display image generation unit 152 aligns the lowest position in the vertical direction of the object image to be displayed. By aligning the lowest positions, the user can easily compare the sizes of the object images. As described above, the display image generation unit 152 sets the lowest position when the dimension data is in the vertical direction, and on the other hand, when the dimension data is in the horizontal direction, The leftmost position (or rightmost position) of the object image to be displayed first is set. The display image generation unit 152 arranges a plurality of objects whose dimension data is expressed in the vertical direction in the horizontal direction, while a plurality of objects whose dimension data is expressed in the horizontal direction are arranged in the vertical direction. The display image generation unit 152 preferably determines a reference position when arranging a plurality of object images, depending on whether the image is in the vertical direction or the horizontal direction.

In addition, when displaying the meta information together, the display image generating unit 152 determines the display position of the meta information on the basis of the set lowermost position or leftmost position. For example, when the lowest position is set, meta information is displayed below the lowest position, and when the leftmost position is set, the meta information is displayed to the left of the leftmost position. Display information. Thus, by setting the display position of the meta information, the meta information can be displayed so as not to overlap the object image.

Note that, here, the display image generation unit 152 generates the display image by arranging the target images from the left in the order in which the image file acquisition unit 144 selects the image file. The display image generation unit 152 may rearrange the target images, for example, in the order of height. For example, the three target images shown in FIG. 14 are arranged in the descending order of height from the right with reference to the dimension data. It may be generated.

Note that the display image generation unit 152 may instruct the image file acquisition unit 144 to acquire an image file different from the above example when a blank area is generated. For example, when the user's own size is displayed on the display, the display image generation unit 152 may arrange fashion items for changing clothes such as clothes side by side in the margin area. The fashion items arranged in the blank area are displayed in actual size by the enlargement / reduction ratio determination unit 148 and the image size adjustment unit 150, and the user operates the input device 20 to display the life-size display of the user. Can be overlapped. This allows you to freely change your favorite clothes to your life-size figure.

FIG. 15 shows a flowchart of image processing in the present embodiment. In the flowchart shown in FIG. 15, the processing procedure of each part is displayed by a combination of S (acronym for Step) meaning a step and a number. In the flowchart of the present specification, if any judgment process is executed by the process displayed by the combination of S and a number, and the judgment result is affirmative, Y (acronym for Yes) is added. For example, (Y in S10) is displayed, and if the determination result is negative, N (acronym of No) is added and (N in S10) is displayed. When the mode setting unit 142 does not set the display mode to the free display mode (N in S10), this flow is not executed.

When the mode setting unit 142 sets the display mode to the predetermined ratio display mode (Y in S10), this flow is executed. The enlargement / reduction rate determination unit 148 determines the enlargement rate of the object image (S12), the image size adjustment unit 150 enlarges the object image at the determined enlargement rate, and the display image generation unit 152 displays the image. An image is generated (S14). The display processing unit 44 outputs the generated display image to the display. Here, the request acquisition unit 122 monitors the image switching request (N in S16), and when the pressing operation of the Δ button 25 is accepted (Y in S16), the image file acquisition unit 144 follows the predetermined display order. The image file is selected (S18).

When the image file acquisition unit 144 selects and acquires an image file (Y in S18), the enlargement / reduction rate determination unit 148 determines the enlargement rate of the object image (S12), and the display image generation unit 152 A display image is generated based on the image data whose size has been adjusted by the image size adjustment unit 150 (S14). The display processing unit 44 outputs the generated display image to the display. On the other hand, if all of the image files have already been selected by the image file acquisition unit 144 (N in S18), this flow ends.

The present invention has been described based on the embodiments. This embodiment is an exemplification, and it will be understood by those skilled in the art that various modifications can be made to the combination of each component and each processing process, and such modifications are also within the scope of the present invention. .

In the present embodiment, the case where one image of an object is included in the image file has been described, but a plurality of object images may be included. When the user specifies the target object by associating the dimension data with the plurality of target object images, the display image generating unit 152 displays a display image that includes the specified target object image in actual size. Can be generated. When a plurality of object images are displayed side by side at the actual size, the image cutout unit 146 cuts out each object image, so that the display image generation unit 152 includes the plurality of object images at the actual size. One display image can be generated.

Also, in the embodiment, it has been described that the notification unit 154 notifies a predetermined message when the entire object image is not displayed when the actual size is displayed. The enlargement / reduction ratio determination unit 148, the image size adjustment unit 150, and / or the display image generation unit 152 are entirely displayed when the object image included in the image file to be acquired by the image file acquisition unit 144 is displayed in actual size. You may investigate beforehand whether it is what is displayed. This investigation is performed by comparing the width of the display size with the dimension data. If it is determined by this investigation that at least one object image protrudes from the display by displaying it in actual size, the reduction ratio is determined so that the largest object image fits on the display, and an enlargement / reduction ratio determination unit 148 may reduce all the target images acquired by the image file acquisition unit 144 by the reduction ratio. At this time, the notification unit 154 displays information indicating the reduction ratio on the display, and the display image generation unit 152 generates a display image including the object image at the reduction ratio. Thereby, all the object images can be displayed as a whole, and the relative sizes of the object images can be easily compared.

Further, the display image generation unit 152 has information on the installation height from the floor surface of the display of the display device 12, and displays an image of the installation height from the floor surface when displaying the object image life-size, It may be subtracted from the object image and displayed on the display. Information on the installation height of the display may be registered by the user at the time of installation. For example, when the height of the lower end of the display is 30 cm from the floor surface, the display image generation unit 152 does not display the human image shown in FIG. 13 from the foot to 30 cm, but only the object image above 30 cm. Display it. As a result, the user can feel as if the person image is standing in the room.

In the embodiment, the image data representing the whole body of the object has been described. However, for example, there may be image data obtained by photographing only the upper body. In this case, by preparing the dimension data for specifying the dimension data of the photographed upper body and the height of the subject, the display image generation unit 152 displays the image data enlarged / reduced to a predetermined ratio. An image may be generated and the top of the subject may be displayed in accordance with the height specified by the height data in consideration of the installation height of the display from the floor surface. Thereby, although it is not a whole body image, the mode when the subject is standing in the room can be reproduced.

Note that the display image generation unit 152 may have information on the altitude of the display using an altimeter instead of the height from the floor of the display. For example, when the display is installed at a position with an altitude of 50 m above sea level, when displaying a huge object (for example, a dimension of 100 m), the display image generation unit 152 starts from the position of 50 m from the foot of the object. An object image may be displayed.

In the embodiment, the example in which the display device 12 is a display has been described. However, as described above, the display device 12 may be configured by a projector and a screen. Although the size of the image displayed on the screen changes according to the distance between the projector and the screen, the image can be displayed at a predetermined ratio with respect to the size specified by the dimension data by the technique described above. In the case of displaying a life-size image, first, the distance between the projector and the screen may be adjusted, or the enlargement rate set by the enlargement / reduction rate determination unit 148 may be adjusted by calibration. This adjustment is performed by measuring the size of the image projected on the screen and making the measured size equal to the size specified by the size data. The measurement of the dimensions may be performed manually, or may be performed by photographing and measuring the actual dimensions of the image projected on the screen with a camera or the like. For example, the enlargement / reduction ratio determination unit 148 changes the enlargement ratio linearly, and uses the enlargement ratio at which the measurement dimension measured by the camera is equal to the dimension specified by the dimension data as the reference enlargement ratio, thereby generating a display image. The unit 152 can display the object image in a life-size manner on the screen.

DESCRIPTION OF SYMBOLS 1 ... Image processing system, 10 ... Image processing apparatus, 12 ... Display apparatus, 20 ... Input device, 50 ... Hard disk drive, 60 ... Main memory, 100 ... Control part 120 ... Input signal processing unit 122 ... Request acquisition unit 124 ... Mode designation reception unit 130 ... Display resolution deriving unit 132 ... Display size holding unit 134 ... Display Resolution holding unit, 140 ... display image processing unit, 142 ... mode setting unit, 144 ... image file acquisition unit, 146 ... image cutout unit, 148 ... enlargement / reduction rate determination unit, 150 ... Image size adjustment unit, 152... Display image generation unit, 154.

The present invention can be used in the field of image processing.

Claims

An image processing apparatus for displaying an image on a display unit,
A storage device that holds image data of a plurality of objects and dimension data of each object;
A display image processing unit that displays the object image on the display unit,
The display image processing unit
A mode setting unit for setting a predetermined ratio display mode for displaying the object image at a predetermined ratio with respect to the size specified by the dimension data;
A determining unit that determines an enlargement ratio or a reduction ratio of the display image so that the object image is displayed at a predetermined ratio with respect to the size specified by the dimension data on the display unit;
An image size adjustment unit for enlarging or reducing the image;
A display image generation unit that generates a display image including an object image,
In the predetermined ratio display mode, the image size adjustment unit is an object image included in a display image generated temporally continuously by the display image generation unit, or one display generated by the display image generation unit An image processing apparatus that enlarges or reduces a plurality of object images included in an image to a size that is a predetermined ratio with respect to a size specified by dimension data of each object.
The display image generation unit generates a first display image, and then generates a second display image at a position on the display unit of the object image included in the first display image. The image processing apparatus according to claim 1, wherein the included object images are combined.
The display image generation unit further includes a notification unit that displays a predetermined message on the display unit when it is determined that the entire enlarged object image cannot be displayed on the display unit. An image processing apparatus according to 1.
When the display image generation unit determines that a blank area occurs in the display unit, the display image generation unit instructs the image file acquisition unit to acquire another image file, and displays another object image in the blank area. The image processing apparatus according to claim 1.
5. The image processing apparatus according to claim 1, wherein the dimension data specifies an actual dimension of an object.
Setting a predetermined ratio display mode for displaying the object image at a predetermined ratio with respect to the size specified by the dimension data;
Determining an enlargement ratio or a reduction ratio of the display image so that the object image is displayed at a predetermined ratio with respect to the size specified by the dimension data on the display unit;
Enlarging or reducing the image;
Generating a display image including the object image,
In the predetermined ratio display mode, the step of enlarging or reducing the image includes an object image included in the display image generated temporally continuously by the display image generating step, or one display generated by the display image generating step. An image processing method, comprising: enlarging or reducing a plurality of object images included in an image to a size having a predetermined ratio with respect to a size specified by dimension data of each object.
On the computer,
A function of setting a predetermined ratio display mode for displaying an object image at a predetermined ratio with respect to a size specified by dimension data;
A function for determining an enlargement ratio or a reduction ratio of the display image so that the object image is displayed at a predetermined ratio with respect to the size specified by the dimension data on the display unit;
The ability to enlarge or reduce the image,
And a function for generating a display image including an object image,
The function of enlarging or reducing an image is a display of an object image included in a display image generated continuously in time by the display image generation function or one display generated by the display image generation function in the predetermined ratio display mode. A program for realizing enlargement or reduction of a plurality of object images included in an image to a size having a predetermined ratio with respect to a size specified by dimension data of each object.
A computer-readable recording medium on which the program according to claim 7 is recorded.