JP2014041433A - Display device, display method, television receiver, and display control device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device capable of displaying an object in an image in a nearly full size by processing based on image data, without requiring additional information for display in the nearly full size and to provide a display method, a television receiver, and a display control device.SOLUTION: An image analysis part 14 performs face recognition processing using face information DB to image data inputted through an image input part 13, to detect the face area of a person in an input image and specify the sex and age group of the person from the face information DB, when the face area of the person is detected. A magnification ratio calculation part 15 calculates a magnification ratio in magnification processing to be performed to the image data, to display the face area of the person in the input image in a size closer to the actual size corresponding to the sex and age group specified by the image analysis part 14. A magnification processing part 16 performs the magnification processing based on the magnification ratio calculated by the magnification ratio calculation part 15 to the image data inputted through the image input part 13 and the image data after the magnification processing is performed is displayed on a display part 17.

Description

  The present invention relates to a display device and a display method for displaying an image based on image data acquired from the outside, a television receiver including the display device, and image data acquired from the outside to the display device to be sent to the display device. The present invention relates to a display control device to be displayed.

A display screen provided in a television receiver, a monitor device, or the like has been increased in screen size, and the display screen size is becoming a size capable of displaying a person or the like in actual size (actual size). It is also possible that the screen size will increase further in the future.
When images and videos such as still images and moving images are displayed in the entire display area of such a large screen, a person or the like may be displayed in a size larger than the actual size. When a person or the like is displayed in a size larger than the actual size, there is a high possibility that the image will be hard to see, especially for a user who watches near the display screen, and there is a possibility that it is desirable to display the image at the actual size. It is done.

  In Patent Document 1, the actual size information on the imaging surface of the product is added to the video information obtained by imaging the product (object) and transmitted, so that the product is the same as the actual size on the receiving side. Technologies that can be displayed in size have been proposed. The technique disclosed in Patent Literature 1 is configured to enlarge or reduce the video information based on the received actual size information and the display unit size information when reproducing the product based on the video information. It is the structure which displays goods by the same magnitude | size.

JP 2002-199358 A

  The technique disclosed in Patent Document 1 has a problem that an apparatus on the video information transmission side needs to have a configuration for generating actual size information and adding it to the video information. That is, when displaying video information to which actual size information is not added, there is a problem that an object in the video cannot be displayed in the same size as the actual size.

  The present invention has been made in view of such circumstances. The purpose is to provide a display device and a display method capable of displaying a subject in an image at a substantially real size by a process based on the acquired image data without additional information for display at a substantially real size. Another object is to provide a television receiver and a display control device.

  A display device according to the present invention is a display device having an image acquisition unit that acquires image data and a display unit that displays an image based on the image data acquired by the image acquisition unit. Detecting a size when a specific part for specifying a size, a face detecting part for detecting a human face area existing in the image, and a face area detected by the face detecting part are displayed on the display part The identification unit detects the face area detected by the face detection unit based on the size detection unit, the size of the face area detected by the size detection unit, and the size specified by the specification unit. A scaling unit that calculates a scaling factor for scaling to the specified size, and a scaling process that performs scaling processing at the scaling factor calculated by the calculating unit on the image data acquired by the image acquisition unit And an image based on the image data subjected to scaling processing by the scaling processing unit Characterized in that it comprises a display control unit for displaying on the display unit.

  The display device according to the present invention includes a storage unit that stores a substantially real size of a human face, and the specifying unit reads the approximate real size of a human face from the storage unit. It is characterized by being.

  In the display device according to the present invention, the storage unit stores a substantially real size of a human face according to gender and / or age group, and the face detection unit detects a face area. A gender / age group detection unit that detects the gender and / or age group of the person, and the specific unit is substantially the actual size of the face of the gender and / or age group detected by the gender / age group detection unit. The information is read from the storage unit.

  The display device according to the present invention is characterized in that the scaling processing unit performs scaling processing on the image data with the face area detected by the face detection unit as the center.

  The display device according to the present invention includes a display information storage unit that stores the size of the display region of the display unit and the number of pixels included in the display region, and the face detection unit Pixels included in a face area are detected, and the size detection unit detects the size of the display area and the number of pixels stored in the display information storage unit, and the pixels detected by the face detection unit. The size when the face area detected by the face detection unit is displayed on the display unit is detected based on the number of

  The display method according to the present invention is a display method in which the display device acquires image data, and displays an image based on the acquired image data. In the display method, the specifying step of specifying a substantially real size of a human face; A face detecting step for detecting a human face area existing in the image; a size detecting step for detecting a size when the face area detected in the face detecting step is displayed on the display device; Based on the size of the face area detected in the detecting step and the size specified in the specifying step, the face area detected in the face detecting step is scaled to the size specified in the specifying step. A calculation step for calculating a scaling factor, a scaling process step for performing the scaling process at the scaling factor calculated in the calculation step on the acquired image data, and the image data subjected to the scaling process Characterized in that it comprises a step of displaying the image brute.

  A television receiver according to the present invention includes any one of the display devices described above and a receiving unit that receives a television broadcast, and an image is displayed on the display device based on the television broadcast received by the receiving unit. Is displayed.

  A display control apparatus according to the present invention includes an image acquisition unit that acquires image data, and a display control unit that transmits the image data acquired by the image acquisition unit to the display device and causes the display device to display the image data. In the above, a specifying unit for specifying a substantially real size of a human face, a face detection unit for detecting a human face region existing in an image based on the image data, and a face region detected by the face detection unit On the basis of the size detecting unit for detecting the size when the display unit is displayed, the size of the face area detected by the size detecting unit, and the size specified by the specifying unit, A calculation unit that calculates a scaling factor for scaling the face area detected by the face detection unit to the size specified by the specifying unit, and a scaling process at the scaling factor calculated by the calculation unit, A scaling processing unit for the image data acquired by the acquisition unit; Wherein the display control unit, the scaling unit is characterized in that the image data subjected to the scaling processing are to be sent to the display device.

  A display control device according to the present invention, a display information storage unit that stores display information including the size of the display area of the display device and the number of pixels included in the display region in association with information about the display device, A device information acquisition unit that acquires information about the display device; and a display information acquisition unit that acquires display information corresponding to the information acquired by the device information acquisition unit from the display information storage unit. The pixels included in the face area of the person existing in the image are detected, and the size detection unit includes the display information acquired by the display information acquisition unit and the pixels detected by the face detection unit. The size when the face area detected by the face detecting unit is displayed on the display device is detected based on the number of

  According to the present invention, the display device detects a human face area existing in an image to be displayed, and calculates a scaling factor for scaling the detected face area to a substantially real size. Then, the display device performs the scaling process at the calculated scaling ratio on the image data to be displayed, and then displays it. The scaling factor for displaying a person's face area in the image at approximately full size can also be used as a scaling factor for displaying the subject in the image at approximately full size. Therefore, based on the image data after the scaling process, the human face area is displayed with a substantially real size, and subjects in the image other than the human face area are also displayed with a substantially real size. As described above, the display device according to the present invention calculates the scaling factor for displaying the subject in the image at approximately the actual size based on the image data. Therefore, the additional information necessary for displaying at approximately the actual size is displayed in the image data. It is not necessary to add it to. Therefore, in a general display device such as a television receiver and a monitor device that obtains and displays image data, video data, and the like from the outside, it is possible to display a subject in the image at a substantially real size.

  According to the present invention, the display device stores in advance the size of a person's face in real size, and calculates a scaling factor based on the size of the face area in the image and the stored size. . Therefore, it is possible to set in advance the size when displaying a human face in a substantially real size, and to set a scaling factor in a scaling process required to display a human face in an image in a substantially real size. Easy to calculate. Further, as the face of a person in the image is displayed with a substantially real size, the other subjects in the image are also displayed with a substantially real size.

  According to the present invention, the display device stores the approximate size of the human face for each gender and / or age group, detects the gender and / or age group of the person in the image, The scaling factor is calculated based on the size of the face area in the image and the size stored according to the detected gender and / or age group. Therefore, it is possible to easily calculate the scaling factor in the scaling process required to display the face of the person in the image in a size (substantially the actual size) according to the gender and / or age group of the person. Display with a size close to is possible.

  According to the present invention, the image data after the scaling process is image data in which the face area of the person detected from the image is located in the center, and the image in which the face area of the detected person is located in the center is displayed. Can do.

  According to the present invention, the display device stores the size of the display region of the device itself and the number of pixels included in the display region. The display device detects pixels included in the human face area in the image, and determines the detected human face area based on the number of detected pixels and the size and the number of pixels of the stored display area. The size of the display area when displayed on the display unit is calculated. Therefore, the size when the face area of the person in the image is displayed on the display unit is calculated on the basis of the size of the display area of the display device and the number of pixels included in the display area, so that complicated processing is performed. Therefore, it is possible to accurately detect the size of the human face area in the image.

  According to the present invention, in a television receiver provided with the above-described display device, if a person is present in the display target image, the display target image is substantially the actual size based on the size of the face area of the person. Thus, it is possible to calculate a scaling factor for displaying the image, and display the entire image to be displayed in a substantially real size.

  According to the present invention, in a display control device that acquires image data, sends it to a display device, and displays it on the display device, if there is a person in the image to be displayed on the display device, the size of the face area of the person is displayed. Based on the above, it is possible to calculate a scaling factor for displaying each object (subject) in the display target image at a substantially real size. Therefore, by performing a scaling process based on the calculated scaling ratio on the image data and sending it to the display device, it is possible to display the entire image to be displayed in a substantially real size.

  According to the present invention, the display control device stores display information including the size of the display region and the number of pixels included in the display region in association with each display device. The display control device displays the face area on the display device based on display information corresponding to the display device to which the image data is sent and the number of pixels included in the human face area in the image. Detect the size. Due to the difference in display area size and pixel configuration (pixel configuration) of the display device, even when the same image is displayed on each display device, the display screen of the human face area in the image is displayed. The size of is different. Therefore, the size of the face area on the display screen can be accurately calculated by detecting the size when the face area is displayed on each display device based on the display information of each display device. Therefore, based on the size of the face area calculated in this way, the scaling factor for scaling the face area to the actual size can be calculated with high accuracy, so that the display target image can be displayed at the actual size. Is possible.

  In the present invention, it is not necessary to add additional information necessary for displaying the subject in the image at a substantially real size to the image data, and the subject in the image is substantially omitted only by processing based on the acquired image data. Each can be displayed in full size.

1 is a block diagram illustrating a configuration of a television receiver according to a first embodiment. It is a schematic diagram for demonstrating the process which an image analysis part, a scaling factor calculation part, and a scaling process part perform. It is a flowchart which shows the procedure of the actual size display process by a television receiver. FIG. 6 is a block diagram illustrating a configuration of a television receiver according to a second embodiment.

  Hereinafter, a display device, a display method, a television receiver, and a display control device according to the present invention will be described in detail with reference to the drawings illustrating embodiments thereof.

(Embodiment 1)
The television receiver according to Embodiment 1 will be described below.
FIG. 1 is a block diagram illustrating a configuration of a television receiver according to the first embodiment. In addition, the arrow shown with the broken line in FIG. 1 shows the flow of data.

  The television receiver 1 according to the first embodiment includes a control unit 10, a RAM (Random Access Memory) 11, a storage unit 12, an image input unit 13, an image analysis unit 14, a scaling factor calculation unit 15, a scaling processing unit 16, A display unit 17 and an operation unit 18 are provided. These units are connected to each other via a bus. Note that the image analysis unit 14, the scaling factor calculation unit 15, and the scaling processing unit 16 may be configured by a dedicated hardware circuit, or the control unit 10 stores a predetermined control program stored in the storage unit 12. It may be a software function realized by execution.

  The control unit 10 is a CPU (Central Processing Unit) or an MPU (Micro Processor Unit). The control unit 10 appropriately loads the control program stored in the storage unit 12 into the RAM 11 and executes the control program to control the above-described hardware units, and the television receiver 1 can be used as the display device and the television according to the present invention. Operate as a John receiver.

  The RAM 11 is an SRAM (Static RAM), a DRAM (Dynamic RAM), a flash memory, or the like. The RAM 11 temporarily stores various data generated when the control unit 10 executes various programs.

  The storage unit 12 is a nonvolatile memory such as an EEPROM (Electrically Erasable and Programmable ROM), a flash memory, or an HDD (Hard Disk Drive). The storage unit 12 stores in advance a control program to be executed by the control unit 10 and various data. For example, the storage unit (display information storage unit) 12 stores display unit information including the size of the display area of the display unit 17, information on pixels (pixels) constituting the display area, and the like. The storage unit 12 stores a face information database (hereinafter referred to as a face information DB) used for face recognition processing for determining whether or not a human face is included in an image based on image data. Further, the storage unit 12 stores actual size display information indicating the average face size (actual size, actual size) of the corresponding gender and age group for each gender and each age group combination. doing. The actual size display information indicates the length in the horizontal direction and the vertical direction of the rectangular area including the human face area, and is, for example, information of Xcm × Ycm (horizontal direction × vertical direction). The age group can be, for example, less than 10 years old, 10s, 20s, 30s, etc.

  An image input unit (image acquisition unit) 13 acquires image data from a recording / playback apparatus, a digital camera, a digital video camera, or the like that stores image data (video data). The image input unit 13 includes a tuner (reception unit) that receives a television broadcast. Further, the image input unit 13 may include a communication unit that is connected to a network such as the Internet and acquires image data via the network. The image data input via the image input unit 13 is sent to the image analysis unit 14 and the scaling processing unit 16. The image data input via the image input unit 13 may be sent to the storage unit 12 and stored therein.

FIG. 2 is a schematic diagram for explaining the processing performed by the image analysis unit 14, the scaling factor calculation unit 15, and the scaling processing unit 16, and FIG. 2A shows the image data input via the image input unit 13. An example of a base image (hereinafter also referred to as an input image) is shown.
The image analysis unit (face detection unit) 14 performs a predetermined analysis process on the image data input via the image input unit 13, and first detects a human face region present in the input image. For example, it is configured to detect a face region viewed from the front of a person existing in the input image. When the human face area is detected in the input image, the image analysis unit (size detection unit) 14 displays the size of the display area when the detected face area is displayed on the display unit 17 (that is, on the display screen). ) Is detected. Further, the image analysis unit (gender / age group detection unit) 14 detects the sex and age group of the person in the detected input image.

  Specifically, for example, a face image pattern generated based on image data obtained by photographing a human face from the front is registered in the face information DB in association with gender and age group, The analysis unit 14 performs pattern matching processing on the input image data using a face image pattern stored in the face information DB. The image analysis unit 14 determines whether a human face region is included in the image data depending on whether the input image data includes data (region) that matches any of the face image patterns registered in the face information DB. It is determined whether or not exists. If the input image data includes a region that matches any of the face image patterns, the image analysis unit 14 determines that a human face region exists in the image data, and associates the region with the matching face image pattern. The gender and age group that are present are identified from the face information DB. Thereby, the gender and age group of the person who exists in an image can be specified.

  Since an area (data) matching the face image pattern is a face area, the image analysis unit 14 extracts this area in pixel units (pixel units). Specifically, the image analysis unit 14 extracts a region detected as a face region in a rectangular shape, and counts the number of pixels included in this region. FIG. 2B shows an example of the detected face area R, and the face area R shown in FIG. 2B has the number of pixels of H pixels × V pixels (horizontal direction × vertical direction). Next, the image analysis unit 14 reads the display unit information stored in the storage unit 12, the size of the display area of the display unit 17, the number of pixels constituting the display area, and the pixels included in the detected face region R. Based on the number, the size of the detected face area R on the display screen is calculated. For example, when the size of the display area of the display unit 17 is Acm × Bcm (horizontal direction × vertical direction) and the number of pixels constituting the display area is C pixels × D pixels, the detected face area R is displayed. The size on the screen can be calculated as (A × H / C) cm × (B × V / D) cm.

The image analysis unit 14 sends the size of the face region R calculated by the above-described processing on the display screen, the gender and age group of the person in the input image to the scaling factor calculation unit 15.
Note that the process of extracting (recognizing) the human face region R from the image data and the process of detecting the gender and age group of the person in the image are not limited to the processes described above. For example, if it is detected whether there is a skin color area in the image data, and the skin color area can be detected, the detected skin color area is set as a human face area, and depending on the size and shape of the skin color area, You may determine the gender and age group of people.

  A scaling factor calculation unit (calculation unit) 15 displays the image input unit 13 in order to display the human face area in the input image detected by the image analysis unit 14 on the display unit 17 with a size close to the actual size. Then, a scaling factor (enlargement ratio or reduction ratio) in a scaling process (enlargement process or reduction process) to be performed on the image data input via is calculated. First, the scaling factor calculation unit 15 reads from the storage unit 12 actual size display information corresponding to the gender and age group of the person in the input image detected by the image analysis unit 14. Thereby, the scaling factor calculation unit (identification unit) 15 displays the size (actual size) of the display region when displaying the human face region in the input image on the display unit 17 with the same size as the actual size. Identify.

  Next, the scaling factor calculation unit 15 detects the size of the human face area in the input image (the size on the display screen) detected by the image analysis unit 14 and the actual size display information read from the storage unit 12. Based on the above, the scaling factor for scaling the human face area in the input image to the actual size is calculated. In the above example, the size of the face area detected by the image analysis unit 14 is (A × H / C) cm × (B × V / D) cm, and the actual size display information read from the storage unit 12 is The actual size shown is Xcm × Ycm. In this case, the scaling factor calculation unit 15 calculates X / (A × H / C), that is, (X × C) / (A × H) as the scaling factor in the horizontal direction, and sets the scaling factor in the vertical direction. Y / (B × V / D), that is, (Y × D) / (B × V) is calculated. Then, the scaling factor calculation unit 15 determines a scaling factor to be used in the subsequent scaling unit 16 based on the two calculated scaling factors. For example, the scaling factor calculation unit 15 determines the larger scaling factor of the two calculated scaling factors as the scaling factor used by the scaling processing unit 16. Further, the scaling factor calculation unit 15 may determine the smaller scaling factor among the two calculated scaling factors as the scaling factor used in the scaling processing unit 16, and the average value of the two calculated scaling factors. , And the calculated average value may be determined as a scaling factor used in the scaling processing unit 16. The scaling factor calculation unit 15 sends the calculated (determined) scaling factor to the scaling processing unit 16.

  The scaling processing unit 16 performs scaling processing based on the scaling factor calculated by the scaling factor calculating unit 15 on the image data input via the image input unit 13. When the human face area is detected in the input image, the image analysis unit 14 notifies the scaling processing unit 16 of information indicating the position of the detected face region, and the scaling processing unit 16 A scaling process is performed on an area (input image data) centered on the face area. Thereby, it is possible to obtain image data after scaling processing with the notified face area as the center. The scaling processing unit 16 sends the image data after the scaling processing to the display unit 17.

  The information indicating the position of the face area is input, for example, with the upper left corner of the input image as the origin of the coordinate axis, the direction from left to right as the x-axis positive direction, and the direction from top to bottom as the y-axis positive direction. The coordinate value (x-axis coordinate value, y-axis coordinate value) of the upper left corner of the face area in the image, the length or number of pixels in the x-axis direction of the face area, and the length or number of pixels of the face area in the y-axis direction It is expressed as

  The scaling processing unit 16 performs an interpolation process based on the pixel value in the original image (input image) when performing the enlargement process, that is, when performing the scaling process at a scaling ratio larger than 1. An interpolation pixel is added between pixels in the (input image). Further, when performing the reduction process, that is, when performing the scaling process with a scaling ratio smaller than 1, the scaling process unit 16 performs a process of thinning out the pixels in the original image (input image) as appropriate. Note that the image subjected to the reduction process has a smaller image size, and therefore has a smaller size than the display area of the display unit 17. Therefore, when the scaling process is performed, the scaling processing unit 16 assigns black pixels or predetermined image data (for example, wallpaper data) to the area outside the reduced image in the display area of the display unit 17. Process.

  The display unit 17 is a liquid crystal display, a plasma display, an organic EL (Electro Luminescence) display, or the like. The display unit 17 displays various information (images) according to instructions from the control unit 10. The display unit 17 displays an image based on the image data scaled by the scaling unit 16 in accordance with an instruction from the control unit (display control unit) 10. FIG. 2C shows an example of an image based on the image data after the scaling process. When the input image illustrated in FIG. 2A is an image in which the subject is displayed in a size smaller than the actual size, the image analysis unit 14, the scaling factor calculation unit 15, and the scaling processing unit 16 perform predetermined processing. The enlarged image is displayed on the display unit 17 as shown in FIG. 2C.

  The operation unit 18 includes various operation keys necessary for the user to operate the television receiver 1, receives information based on the operation keys operated by the user, and sends the received information to the control unit 10. The television receiver 1 according to the first embodiment displays a subject in an image based on the image data at a size similar to the actual size (actual size) when the image data is displayed on the display unit 17. Is provided. Therefore, the operation unit 18 has an actual size display mode button for giving an instruction to operate the television receiver 1 in the actual size display mode. It should be noted that the actual size display mode button is not provided, the operation unit 18 is appropriately operated, the mode switching menu is displayed on the display unit 17, and an operation start in the actual size display mode is instructed via the mode switching menu. May be.

  Note that the television receiver 1 may include a receiving unit that receives a remote control signal transmitted from a remote control device for remote operation. The receiving unit sends the received remote control signal to the control unit 10, and the control unit 10 analyzes the remote control signal and controls the operation of each unit of the television receiver 1 according to the remote control signal.

  Below, the actual size display process which the television receiver 1 of this Embodiment 1 performs is demonstrated. FIG. 3 is a flowchart showing a procedure of actual size display processing by the television receiver 1. The following processing is performed when the user performs a predetermined operation on the operation unit 18 in the television receiver 1 and instructs the operation start in the actual size display mode.

  The control unit 10 of the television receiver 1 performs an analysis process by the image analysis unit 14 on the image data sequentially input via the image input unit 13 or the image data sequentially read from the storage unit 12. The image analysis unit 14 detects whether or not a human face area exists in the image data by face recognition processing based on the face information DB stored in the storage unit 12 (S1). The image analysis unit 14 determines whether or not the face area has been detected in the image data (S2). If it is determined that the face region cannot be detected (S2: NO), the control unit 10 proceeds to step S9. Then, an image based on the input image data is displayed as it is on the display unit 17 (S9).

  When it is determined that the face area has been detected (S2: YES), the image analysis unit 14 specifies the sex and age group of the person who detected the face area (S3). Specifically, the image analysis unit 14 acquires the gender and the age group associated with the face image pattern determined to be included in the input image data from the face information DB. Next, the image analysis unit 14 extracts pixels included in the detected face area (S4), and counts the number of pixels included in the face area. The image analysis unit 14 calculates the size of the detected face area on the display screen based on the display unit information stored in the storage unit 12 and the counted number of pixels in the face area (S5). .

  Next, the control unit 10 uses the scaling factor calculation unit 15 to calculate a scaling factor for scaling the face area detected in step S1 to the same size as the actual size. First, the scaling factor calculation unit 15 acquires actual size display information corresponding to the gender and age group specified in step S3 from the storage unit 12 (S6). The scaling factor calculator 15 displays the face area detected in step S1 in actual size based on the size of the face area calculated in step S5 and the actual size indicated by the actual size display information acquired in step S6. A scaling factor in the scaling process necessary for the calculation is calculated (S7).

  Then, the control unit 10 performs a scaling process based on the calculated scaling ratio on the image data sequentially input via the image input unit 13 or the image data sequentially read from the storage unit 12. This is performed by the unit 16 (S8). The control unit 10 sends the image data subjected to the scaling process by the scaling process unit 16 to the display unit 17 and causes the display unit 17 to display the image data (S9).

The control unit 10 determines whether or not the end of the actual size display process is instructed via the operation unit 18 (S10), and when it is determined that the end is instructed (S10: YES), the process ends. . Note that the control unit 10 terminates the actual size display process when, for example, the user instructs the operation end in the actual size display mode via the operation unit 18 or when the user instructs the operation end of the television receiver 1. Judge that it was instructed.
When it is determined that the termination is not instructed (S10: NO), the control unit 10 returns the process to step S1, and sequentially reads the image data sequentially input via the image input unit 13 or the storage unit 12. Steps S1 to S9 are repeated for the image data to be processed.

  The control unit 10 recalculates the scaling factor every time a human face area is detected from the image data by the above-described processing, and the subject in the image is set to the actual size by the processing using the scaling factor that is sequentially calculated. It can be displayed in the same size. In addition, when the human face area is no longer detected from the image data after the scaling factor is once calculated, the control unit 10 performs processing using the most recently calculated scaling factor until the next face area is detected. You may go. Thus, for example, when the actual size display processing is performed on the moving image data, even if a part of the image data included in the moving image data does not include a human face area, the calculated scaling factor is once calculated. Processing using can be continued. In addition, since a series of moving image data is presumed to be imaged at the same magnification, the series of motion data may be processed using the first calculated magnification. In this case, the subject in the image can be displayed in the same size as the actual size, and the processing for calculating the scaling factor necessary for this can be performed once, so that the processing can be simplified.

  When there is a human face area in the image to be displayed on the display unit 17, the television receiver 1 according to the first embodiment changes the image so that the face area is approximately the same as the actual size. Doubled and displayed. By scaling the human face area to the same size as the actual size, objects (subjects) other than the human face area in the image are also scaled to the same size as the actual size. The Therefore, all the subjects included in the image to be displayed can be displayed in the same size as the actual size. The television receiver 1 according to the first embodiment specifies the scaling factor of the scaling process to be performed on the image data only by the analysis process on the image data to be displayed, so that the image data is displayed at the actual size. It is not necessary to add the additional information to the image data. Therefore, even when image data acquired from a recording / playback apparatus, digital camera, digital video camera, etc., image data (video data) based on television broadcasting, image data downloaded via a network, etc. are displayed on the display unit 17. The actual size can be displayed. That is, the apparatus on the image data transmission side does not need to perform any processing in order to display the image data in the actual size on the display apparatus.

The television receiver 1 according to the first embodiment can display each subject in the image with the same size as the actual size, so that it is possible to display an image that is easy for the user to view. When the original image is displayed as it is, an image in which the subject is displayed larger than the actual size becomes an image that is difficult for a user to watch in the vicinity of the television receiver 1. By displaying the actual size, an easy-to-see image can be displayed. In recent years, a system for making a call while displaying a captured image of a call partner, such as a videophone, has become widespread. In such a system, a captured image of the face of a call partner is displayed on the entire display unit 17. It will be a very hard-to-see image. In such a case, by reducing the captured image of the face of the other party and displaying it at an actual size, it is possible to make a call comfortably while viewing the image without any sense of incongruity.
In addition, when the original image is displayed as it is, an easy-to-see image can be displayed by enlarging an image in which the subject is displayed smaller than the actual size and displaying it at the actual size. For example, when a human face is enlarged and displayed, the facial expression and the like can be confirmed.

The television receiver 1 according to the first embodiment stores the average size (actual size) of a person's face in the storage unit 12 for each combination of each gender and each age group. Can be displayed in a corresponding size (actual size). Therefore, it is possible to display the actual size without a sense of incongruity according to gender and age group.
In the television receiver 1 according to the first embodiment, when the scaling process is performed, the area centered on the human face area detected from the image is subjected to the scaling process. Therefore, the center of the image after the scaling process is performed. In addition, the face area of the person in the original image can be displayed.

  The television receiver 1 according to the first embodiment determines the size on the display screen when the face area of a person in the image is displayed on the display unit 17, the number of pixels included in the face area in the image, In this configuration, the size is calculated based on the size of the display area of the display unit 17 and the number of pixels included in the display area. However, the method of calculating the size of the human face area in the image on the display screen is not limited to such a method, and any method may be used.

  The television receiver 1 according to the first embodiment recognizes a human face in an image by performing face recognition processing using a face information DB in which face image patterns corresponding to sex and age group are registered. At the same time, the gender and age group of the person in the image can be specified. Therefore, by calculating a scaling factor for displaying the face area with the actual size according to the specified gender and age group, and performing scaling processing with the calculated scaling factor on the image, each subject in the image is It can be displayed in actual size. However, in the display device of the present invention, the configuration for displaying the face area with the actual size according to the sex and the age group is not an essential requirement. For example, a face recognition process is performed on the image data to detect whether there is a human face area in the image, and when there is a face area, a scaling process for scaling the face area to a predetermined size is performed. The structure which calculates a magnification may be sufficient. In this case, it is detected whether there is a skin color area in the image data. If the skin color area is detected, the detected skin color area is set as a human face area, and the skin color area is scaled to a predetermined size. A variable magnification may be calculated.

  In addition, by performing face recognition processing using the face information DB in which face image patterns corresponding to either gender or age group are registered, the face of the person in the image is recognized, and the person in the image The structure which specifies a sex or an age group may be sufficient. Also in this case, by calculating a scaling factor for displaying the face region with an actual size according to the specified gender or age group, and performing scaling processing with the calculated scaling factor on the image, Each subject can be displayed in actual size.

  In the television receiver 1 according to the first embodiment, when face recognition processing (pattern matching processing) using the face information DB is performed, whether or not there is a human face region in order from the center of the image based on the image data. May be detected. Thereby, based on the face area of the person existing near the center of the image, a scaling factor for scaling the face area to approximately the actual size can be calculated, and based on the image data after the scaling process, An image in which the face area of the person in the image is located at the center can be displayed. In this case, even when there are a plurality of people in the image, it is possible to perform processing based on the face area of the person near the center of the image. In addition, when there are a plurality of people in the image, based on the face area of the person with the largest face area, a scaling factor for scaling the face area to the actual size is calculated, and various processes are performed. You may make it perform.

(Embodiment 2)
Below, the television receiver 1 which concerns on Embodiment 2 is demonstrated. FIG. 4 is a block diagram illustrating a configuration of the television receiver according to the second embodiment. The television receiver 1 according to the second embodiment is different from the television receiver 1 according to the first embodiment described above in that the display unit 17 is configured separately and includes the display unit 17 and each unit other than the display unit 17. And a main body 1a. The main body unit 1 a includes a display control unit 19 that is connected to the external display unit 17 and transmits image data to the display unit 17. With such a configuration, the main body 1a functions as a display control device that acquires image data, sends the acquired image data to the external display unit 17, and causes the display unit 17 to display the acquired image data. In addition, each part with which the main-body part 1a is provided, and the display part 17 are the structures similar to the television receiver 1 of the above-mentioned Embodiment 1, and abbreviate | omit detailed description.

  The television receiver 1 according to the second embodiment having the above-described configuration can execute processing similar to the actual size display processing performed by the television receiver 1 according to the first embodiment. Specifically, the television receiver 1 of the second embodiment also performs the same processing as the processing shown in the flowchart of FIG. In the television receiver 1 according to the second embodiment, in step S9 in FIG. 3, the control unit 10 displays the image data subjected to the scaling process in the scaling process unit 16 from the display control unit 19 to the display unit 17. And displayed on the display unit 17. The other processes are the same as the processes performed by each part of the television receiver 1 of the first embodiment, and thus description thereof is omitted.

  In the television receiver 1 of the second embodiment, the display unit 17 is separate from the main body unit 1a, and can be changed as appropriate. That is, it is possible to purchase and reconnect only the display unit 17 (display device). Therefore, the television receiver 1 of the second embodiment is configured to perform the actual size display process even when a different display unit 17 is connected to the main body unit 1a. Specifically, in the storage unit 12 of the main body unit 1a, the size and display area of the display unit 17 are configured in association with identification information (information regarding the display device) for identifying the display unit 17. Display unit information (display information) including information on the number of pixels (number of pixels) and the like is stored. As the identification information, for example, the model number of the display unit 17 (display device) can be used. The display unit information stored in the storage unit 12 is not limited to information stored in advance, but may be information downloaded via a network such as the Internet.

  The control unit (device information acquisition unit) 10 of the main body 1a is connected via the display control unit 19 when the image analysis unit 14 calculates the size of the human face area in the image on the display screen. The identification information of the display unit 17 is acquired from the displayed display unit 17. The identification information of the display unit 17 may be sent from the display unit 17 to the main body unit 1 a when the display unit 17 is connected to the display control unit 19 and stored in the storage unit 12. The control unit (display information acquisition unit) 10 acquires display unit information corresponding to the identification information of the display unit 17 from the storage unit 12 and sends it to the image analysis unit 14.

  The image analysis unit 14 detects a human face area in the input image based on the image data input via the image input unit 13, calculates the number of pixels included in the face area, and calculates the calculated number of pixels and The size of the detected face region on the display screen is calculated based on the display unit information read from the storage unit 12 (the size of the display region of the display unit 17 and the number of pixels constituting the display region). To do. With such a configuration, even when the display unit 17 connected to the main body unit 1a is different, the size of the face area in the input image on the display screen is appropriately set according to each display unit 17. It can be calculated. The above-described processing is performed in step S5 in FIG.

  In the second embodiment, the same effect as that obtained in the first embodiment can be obtained. Also in the television receiver 1 according to the second embodiment, a modification similar to the modification described in the first embodiment can be applied.

  In the first and second embodiments described above, the configuration in which the display device and the display control device of the present invention are applied to the television receiver 1 has been described as an example. The display device of the present invention can be applied not only to the television receiver 1 but also to a monitor device, for example, as long as the device has a display unit that displays image data acquired from the outside. The display control device of the present invention is not limited to the television receiver 1 as long as it is a device that can be wired or wirelessly connected to the display device and has a configuration for sending image data acquired from the outside to the display device. It is applicable also to such an apparatus.

  The preferred embodiments of the present invention have been specifically described above. However, each configuration, operation, and the like can be changed as appropriate, and are not limited to the above-described embodiments.

1 Television receiver (display device)
10 Control unit (display control unit)
12 storage unit (display information storage unit)
13 Image input unit (image acquisition unit)
14 Image analysis unit (face detection unit, size detection unit, gender / age group detection unit)
15 Variable magnification calculation unit (calculation unit)
16 Scaling processing unit 17 Display unit 19 Display control unit

A display device according to the present invention is a display device having an image acquisition unit that sequentially acquires a plurality of image data included in moving image data, and a display unit that sequentially displays images based on the image data acquired by the image acquisition unit. A specific unit that identifies a size of a human face that is approximately the actual size, a face detection unit that sequentially detects a human face region existing in the image, and the face detection unit detects the face region, the size calculating unit for calculating the magnitude of the case where the detected face area is displayed on the display unit, the size calculation unit calculates the face area size, and the size of the particular unit is identified Based on the calculation unit for calculating a scaling factor for scaling the face area detected by the face detection unit to the size specified by the specifying unit, and when the face detection unit detects the face region, the scaling process in magnification of the calculation unit is calculated, the image There row for image data acquisition unit acquires, when the face detecting section can not detect the face region, the calculating unit wherein the image acquiring unit based on the face region in an image based on image data obtained previously A scaling process performed on the image data acquired by the image acquisition unit, and an image based on the image data on which the scaling process has been performed. And a display control unit to be displayed on the display unit.

In the display device according to the present invention, when the face detection unit detects the face area, the scaling process unit performs a scaling process on the image data with the face area detected by the face detection unit as the center. It is made to perform.

The display device according to the present invention includes a display information storage unit that stores the size of the display region of the display unit and the number of pixels included in the display region, and the face detection unit Pixels included in a face area are detected, and the size calculation unit detects the size and the number of pixels of the display area stored in the display information storage unit and the pixels detected by the face detection unit. The size when the face area detected by the face detection unit is displayed on the display unit is calculated on the basis of the number.

A display method according to the present invention is a display method in which a display device sequentially acquires a plurality of image data included in moving image data, and sequentially displays images based on the acquired image data. An identification step for identifying the height, a face detection step for sequentially detecting a human face area existing in the image, and when the face area is detected in the face detection step , the detected face area is displayed on the display device. the size calculation step and, the magnitude calculation step with the calculated face area size for calculating the magnitude of the case where is, and, based on the size specified in the specifying step, detected by the face detecting step a face region, the a calculation step of calculating a scaling factor for scaling the size specified in a particular step, when detecting the facial region in the face detecting step, in the calculation step The scaling process in magnification ratio out, had row for the acquired image data, if the face can not detect the face area detection step, based on the face region in an image based on image data obtained previously A scaling process step performed on the acquired image data, and a step of displaying an image based on the image data subjected to the scaling process. It is characterized by.

The display control device according to the present invention displays an image acquiring unit that sequentially acquires a plurality of image data included in the moving image data, to the display device and sent to sequentially display the image data which the image obtaining section obtains In a display control device comprising a display control unit, a specifying unit that specifies a substantially real size of a human face, and a face detection unit that sequentially detects a human face region present in an image based on the image data, , if said pigment detecting section detects the face area, detected when the face area is displayed on the display device and the size calculating unit for calculating the magnitude, of the face region the size calculating unit has calculated A calculation unit that calculates a scaling factor for scaling the face area detected by the face detection unit to the size specified by the specifying unit based on the size and the size specified by the specifying unit; the face detecting section detects the face area If the scaling process in the scaling factor the calculation unit has calculated, have rows for the image data by the image acquisition unit has acquired, when the face detecting section can not detect the face area, the image acquisition unit A scaling processing unit that performs scaling processing at a scaling factor calculated by the calculation unit based on a face area in an image based on previously acquired image data with respect to the image data acquired by the image acquisition unit; The display control unit is configured to send the image data subjected to the scaling process by the scaling processing unit to the display device.

A display control device according to the present invention, a display information storage unit that stores display information including the size of the display area of the display device and the number of pixels included in the display region in association with information about the display device, A device information acquisition unit that acquires information about the display device; and a display information acquisition unit that acquires display information corresponding to the information acquired by the device information acquisition unit from the display information storage unit. The pixels included in the face area of the person present in the image are detected, and the size calculation unit is configured to display the display information acquired by the display information acquisition unit and the pixels detected by the face detection unit. The size when the face area detected by the face detecting unit is displayed on the display device is calculated based on the number of

According to the present invention, when displaying a moving image , the display device detects a human face area existing in an image included in the moving picture, and scales the detected face area to a size substantially equal to the actual size. A scaling factor is calculated. Then, the display device performs the scaling process at the calculated scaling ratio on the image data to be displayed, and then displays it. The scaling factor for displaying a person's face area in the image at approximately full size can also be used as a scaling factor for displaying the subject in the image at approximately full size. Therefore, based on the image data after the scaling process, the human face area is displayed with a substantially real size, and subjects in the image other than the human face area are also displayed with a substantially real size. As described above, the display device according to the present invention calculates the scaling factor for displaying the subject in the image at approximately the actual size based on the image data. Therefore, the additional information necessary for displaying at approximately the actual size is displayed in the image data. It is not necessary to add it to. Therefore, in a general display device such as a television receiver and a monitor device that acquires and displays moving image data from the outside, it is possible to display the subject in the image at substantially full size.

According to the present invention, in a television receiver including the above-described display device, if a person is present in any image included in a moving image to be displayed, a display is performed based on the size of the face area of the person. It is possible to calculate a scaling factor for displaying each target image at approximately full size, and display the entire display target image at approximately full size.

According to the present invention, in a display control device that acquires moving image data, sends it to a display device, and displays it on the display device, if there is a person in any of the images included in the moving image to be displayed on the display device, Based on the size of the face area of the person, a scaling factor for displaying each object (subject) in the display target image at a substantially real size can be calculated. Therefore, by performing a scaling process based on the calculated scaling ratio on the image data and sending it to the display device, it is possible to display the entire image to be displayed in a substantially real size.

In the present invention, it is not necessary to add to the image data additional information necessary for displaying the subject in the image at a substantially real size, and only by processing based on the image data included in the acquired moving image data, It is possible to display each of the subjects in the actual size.

A display device according to the present invention is a display device having an image acquisition unit that sequentially acquires a plurality of image data included in moving image data, and a display unit that sequentially displays images based on the image data acquired by the image acquisition unit. A specifying unit that specifies a substantially real size of a person's face, a face detection unit that sequentially detects a human face region existing in the image in order from the center of the image, and the face detection unit at the time of the one detected face area, and the size calculating unit for calculating the magnitude of the case of displaying the detected face area on the display unit, the size calculator magnitude of the calculated face area, and A calculation unit for calculating a scaling factor for scaling the face area detected by the face detection unit to the size specified by the specification unit based on the size specified by the specification unit; and the face detection When the unit detects the face area, the calculation unit calculates An image based on the image data previously acquired by the image acquisition unit when the image acquisition unit performs a scaling process on the image data acquired by the image acquisition unit and the face detection unit cannot detect the face area A scaling processing unit that performs scaling processing at the scaling factor calculated by the calculation unit based on the face area in the image data acquired by the image acquisition unit; and the scaling processing unit performs scaling processing And a display control unit that causes the display unit to display an image based on the performed image data.

A display method according to the present invention is a display method in which a display device sequentially acquires a plurality of image data included in moving image data, and sequentially displays images based on the acquired image data. Once a particular step, a face detection step of sequentially detecting a face area of a person present in said image in order from the central portion of the image, which is one detecting the face area in said pigment detection identifying a of, A size calculating step for calculating a size when the detected face area is displayed on the display device, a size of the face area calculated in the size calculating step, and a size specified in the specifying step Based on a calculation step for calculating a scaling factor for scaling the face region detected in the face detection step to the size specified in the specifying step, and detecting the face region in the face detection step. In the case where the scaling process at the scaling factor calculated in the calculation step is performed on the acquired image data, and the face area cannot be detected in the face detection step, an image based on the previously acquired image data A scaling process step for the acquired image data, and an image based on the image data subjected to the scaling process are displayed. And a step of causing

The display control device according to the present invention sequentially acquires a plurality of image data included in the moving image data, and sequentially transmits the image data acquired by the image acquisition unit to the display device for display on the display device. In a display control device comprising a display control unit, a specifying unit for specifying a substantially real size of a human face, and a human face region existing in the image in order from a central part of the image based on the image data. a face detection unit for sequentially detecting, at the time when said pigment detecting unit has one detects the face area, and the size calculating unit for calculating the magnitude of the case of displaying the detected face area on the display device, the Based on the size of the face area calculated by the size calculating unit and the size specified by the specifying unit, the face region detected by the face detecting unit is scaled to the size specified by the specifying unit. A calculator for calculating a scaling factor for When the detection unit detects the face area, the scaling process with the scaling ratio calculated by the calculation unit is performed on the image data acquired by the image acquisition unit, and the face detection unit detects the face area. If the image acquisition unit cannot perform the scaling process at the scaling factor calculated by the calculation unit based on the face area in the image based on the image data acquired by the image acquisition unit, the image acquisition unit acquires the image data acquired by the image acquisition unit. The display control unit is configured to send the image data subjected to the scaling process by the scaling processing unit to the display device.

According to the present invention, when displaying a moving image, the display device detects a human face region existing in an image included in the moving image in order from the center of the image, and when one face region is detected, A scaling factor is calculated for scaling the detected face area to a size substantially equal to the actual size. Then, the display device performs the scaling process at the calculated scaling ratio on the image data to be displayed, and then displays it. The scaling factor for displaying a person's face area in the image at approximately full size can also be used as a scaling factor for displaying the subject in the image at approximately full size. Therefore, based on the image data after the scaling process, the human face area is displayed with a substantially real size, and subjects in the image other than the human face area are also displayed with a substantially real size. As described above, the display device according to the present invention calculates the scaling factor for displaying the subject in the image at approximately the actual size based on the image data. Therefore, the additional information necessary for displaying at approximately the actual size is displayed in the image data. It is not necessary to add it to. Therefore, in a general display device such as a television receiver and a monitor device that acquires and displays moving image data from the outside, it is possible to display the subject in the image at substantially full size. In addition, each subject in the image can be displayed at a substantially real size with reference to the face area of a person existing near the center of the image.

Claims (9)

In a display device having an image acquisition unit that acquires image data and a display unit that displays an image based on the image data acquired by the image acquisition unit,
A specific part that identifies the approximate size of a person's face,
A face detection unit for detecting a human face region present in the image;
A size detection unit for detecting a size when the face area detected by the face detection unit is displayed on the display unit;
Based on the size of the face area detected by the size detecting unit and the size specified by the specifying unit, the face region detected by the face detecting unit is scaled to the size specified by the specifying unit. A calculating unit for calculating a scaling factor for
A scaling processing unit that performs scaling processing at the scaling factor calculated by the calculation unit on the image data acquired by the image acquisition unit;
A display device comprising: a display control unit that causes the display unit to display an image based on the image data on which the scaling processing unit has performed the scaling process. It has a storage unit that stores the approximate size of a person's face,
The display device according to claim 1, wherein the specifying unit is configured to read out a size of a substantially real human face from the storage unit. The storage unit stores the approximate size of a human face according to gender and / or age group,
A gender / age group detector for detecting the gender and / or age group of the person whose face area is detected by the face detector;
3. The identification unit is configured to read out from the storage unit a size of a face of a person of a gender and / or age group detected by the gender / age group detection unit from the storage unit. The display device described in 1.   4. The scaling process according to claim 1, wherein the scaling processing unit performs scaling processing on the image data with the face area detected by the face detection unit as a center. 5. The display device described. A display information storage unit that stores the size of the display area of the display unit and the number of pixels included in the display area;
The face detection unit is configured to detect pixels included in a human face area existing in the image,
The size detection unit is detected by the face detection unit based on the size and the number of pixels of the display area stored in the display information storage unit and the number of pixels detected by the face detection unit. The display device according to any one of claims 1 to 4, wherein a size when a face area is displayed on the display unit is detected. In a display method in which a display device acquires image data and displays an image based on the acquired image data.
A specific step of identifying the approximate size of a person's face,
A face detection step of detecting a human face region present in the image;
A size detection step of detecting a size when the face area detected in the face detection step is displayed on the display device;
Based on the size of the face area detected in the size detecting step and the size specified in the specifying step, the face area detected in the face detecting step is scaled to the size specified in the specifying step. A calculating step for calculating a scaling factor for
A scaling process step of performing scaling processing at the scaling ratio calculated in the calculation step on the acquired image data;
And a step of displaying an image based on the image data subjected to the scaling process. A display device according to any one of claims 1 to 5;
A receiver for receiving television broadcasts,
A television receiver, wherein an image is displayed on the display device based on the television broadcast received by the receiving unit. In a display control apparatus comprising: an image acquisition unit that acquires image data; and a display control unit that sends the image data acquired by the image acquisition unit to a display device and causes the display device to display the image data.
A specific part that identifies the approximate size of a person's face,
A face detection unit for detecting a human face region present in the image based on the image data;
A size detection unit for detecting a size when the face area detected by the face detection unit is displayed on the display device;
Based on the size of the face area detected by the size detecting unit and the size specified by the specifying unit, the face region detected by the face detecting unit is scaled to the size specified by the specifying unit. A calculating unit for calculating a scaling factor for
A scaling unit that performs scaling processing at the scaling factor calculated by the calculation unit on the image data acquired by the image acquisition unit;
The display control device, wherein the display control unit is configured to send image data subjected to a scaling process by the scaling processing unit to the display device. A display information storage unit for storing display information including the size of the display region of the display device and the number of pixels included in the display region in association with the information about the display device;
A device information acquisition unit for acquiring information on the display device;
A display information acquisition unit that acquires display information corresponding to the information acquired by the device information acquisition unit from the display information storage unit;
The face detection unit is configured to detect pixels included in a human face area existing in the image,
The size detection unit causes the display device to display the face area detected by the face detection unit based on the display information acquired by the display information acquisition unit and the number of pixels detected by the face detection unit. 9. The display control apparatus according to claim 8, wherein the size of the display control is detected.

Images