JP6197892B2 - Display device and imaging device - Google Patents

Description

  The present invention relates to a display device and an imaging device.

  The following imaging devices are known. This imaging apparatus enlarges and displays the data read out from the imaging device (for example, Patent Document 1).

JP 2009-17517 A

  However, in the conventional imaging apparatus, when the readout area is switched in accordance with the subject position, it is necessary for the user to change the position of the area to be enlarged and displayed, which is inconvenient.

In the display device according to the first aspect of the present invention, when a change in the size of the subject is detected by a signal from a pixel arranged in the first region of the image sensor that images the subject, A setting unit configured to read a signal from a pixel arranged in a second region different from the first region, and a setting unit configured to read a signal from the pixel arranged in the second region by the setting unit, A control unit that causes the display unit to display an image generated using signals from pixels arranged in at least a part of the second region.
An image pickup apparatus according to a second aspect of the present invention includes an image pickup device that picks up an image of a subject, a detection unit that detects a change in the size of the subject based on a signal from a pixel arranged in a first region of the image pickup device , When a change in the size of the subject is detected by the detection unit, a setting unit configured to read a signal from a pixel arranged in a second region different from the first region of the image sensor, and the setting unit A control unit configured to display, on a display unit, an image generated using a signal from a pixel arranged in the second region when the subject is set to be imaged in the second region.

  According to the present invention, the acquisition position of area data can be automatically changed according to the subject.

It is a block diagram which shows the structure of one Embodiment of a camera. It is a flowchart figure which shows the flow of a process at the time of a through image display. It is a 1st figure which shows the specific example of the read-out area | region in window reading drive. It is a 2nd figure which shows the specific example of the read-out area | region in window reading drive. It is a 3rd figure which shows the specific example of the read-out area | region in window reading drive. It is a 4th figure which shows the specific example of the read-out area | region in window reading drive. It is a 5th figure which shows the specific example of the read-out area | region in window reading drive.

  FIG. 1 is a block diagram illustrating a configuration of an embodiment of a camera according to the present embodiment. The camera 100 includes an operation member 101, a lens 102, an image sensor 103, a control device 104, a memory card slot 105, and a monitor 106. The operation member 101 includes various input members operated by the user, such as a power button, a release button, a zoom button, a cross key, an enter button, a play button, and a delete button.

  The lens 102 may be configured to be detachable from the camera 100 via a mount unit (not shown), or may be integrated with the camera 100. The lens 102 is composed of a plurality of optical lenses, but in FIG. 1, it is represented by a single lens. The image sensor 103 is configured by an image sensor such as a CMOS, for example, and generates an analog image signal by photoelectrically converting a subject image formed by a light beam that has passed through the lens 102, and outputs the generated analog image signal to the control device 104.

  The control device 104 includes a CPU, a memory, and other peripheral circuits, and controls the camera 100. Note that the memory constituting the control device 104 includes SDRAM and flash memory. The SDRAM is a volatile memory, and is used as a work memory for the CPU to develop a program when the program is executed or as a buffer memory for temporarily recording data. The flash memory is a non-volatile memory in which data of a program executed by the control device 104, various parameters read during program execution, and the like are recorded.

  The control device 104 converts the analog image signal input from the image sensor 103 into a digital image signal, and after performing various image processing, generates main image data in a predetermined image format, for example, JPEG format. Further, the control device 104 generates display image data, for example, thumbnail image data, based on the generated main image data. The control device 104 generates an image file that includes the main image data and the thumbnail image data, and further includes header information, and outputs the image file to the memory card slot 105.

  The memory card slot 105 is a slot for inserting a memory card as a storage medium, and the image file output from the control device 104 is written and recorded on the memory card. The memory card slot 105 reads an image file stored in the memory card based on an instruction from the control device 104.

  The monitor 106 is a liquid crystal monitor (rear monitor) mounted on the back surface of the camera 100, and the monitor 106 displays an image stored in a memory card, a setting menu for setting the camera 100, and the like. . Further, when the mode of the camera 100 is set to the live view mode by the user, the control device 104 outputs image data for display of images acquired from the image sensor 103 in time series to the monitor 106. As a result, a through image is displayed on the monitor 106.

  In the image sensor 103 according to the present embodiment, window reading driving is possible in which only a part of the entire pixel area of the image sensor 103 is imaged and an analog image signal is read out. When an enlargement display of the subject is instructed by the user, the control device 104 identifies a subject that exists in the shooting range when the through image is displayed based on the output from the image sensor 103, and the subject in the shooting range is displayed. Based on this position, the readout area of the image sensor 103 in the window reading drive is determined. Then, the image signal in the reading area is read, and the image in the reading area is enlarged and displayed on the monitor 106. As a result, the subject is enlarged and displayed on the monitor 106.

  If the image in the readout area read by the window reading drive of the image sensor 103 is enlarged as described above, the frame rate can be increased while maintaining a high-definition image. For example, as shown in FIG. 3, a case will be described in which there are 4000 vertical lines of the image sensor 103 and the frame rate when all lines are read is 10 fps. For example, when all vertical lines of the image sensor 103 are divided into 10 parts every 400 lines in the horizontal direction and window reading driving is possible in each divided area unit, as shown in FIG. When the area 2 (400 lines) is read as a reading area, the frame rate at that time is 100 fps. Also, as shown in FIG. 4, when two divided areas 2 and 3 (800 lines) are read as read areas, the frame rate at that time is 50 fps.

  As described above, the smaller the number of divided areas to be read by the read drive, that is, the smaller the number of vertical lines to be read, the higher the frame rate and the larger the image in the read area can be displayed.

  FIG. 2 is a flowchart showing the flow of processing during live view display in the present embodiment. The processing shown in FIG. 2 is executed by the control device 104 as a program that is activated when display of the live view mode on the monitor 106 is started when the user sets the mode of the camera 100 to the live view mode. .

  In step S <b> 10, the control device 104 selects a subject of interest from among subjects present in the through image. In the present embodiment, the control device 104 selects, for example, a person's face recognized by a known face recognition process as a subject of interest. Thereafter, the process proceeds to step S20, and it is determined whether or not to enlarge the subject. In the present embodiment, the user can set in advance whether or not to magnify the subject when displaying a through image, and if the user has set the magnifying display to be performed, the control device 104 performs the step A positive determination is made in S20.

  If a negative determination is made in step S20, the process proceeds to step S90 described later. On the other hand, if a positive determination is made in step S20, the process proceeds to step S30. In step S30, the control device 104 specifies the position of the subject selected in step S10 in the shooting screen, and specifies in which of the divided regions shown in FIGS. 3 and 4 the subject is present. Thus, data related to the divided area where the subject exists, that is, area data is acquired. Thereafter, the process proceeds to step S40.

  In step S40, the control device 104 determines a reading area of the image sensor 103 based on the area data acquired in step S30. For example, as shown in FIG. 3, when the subject is present in the divided area 2, the divided area 2 is determined as a reading area. Alternatively, as shown in FIG. 4, when the subject exists across the divided area 2 and the divided area 3, the divided areas 2 and 3 are determined as reading areas. Thereby, the divided area including the subject selected in step S10 can be determined as the read area.

  Thereafter, the process proceeds to step S50, and the control device 104 acquires the image signal in the determined readout region by the window reading drive of the image sensor 103, and enlarges and displays the image signal, thereby displaying the subject in an enlarged manner. Thereafter, the process proceeds to step S60.

  In step S60, the control device 104 determines whether or not the subject of interest has deviated from the readout area determined in step S40 by tracking the subject position in the shooting screen in each frame of the through image. That is, it is determined whether or not the position of the subject of interest has moved out of the readout area due to the movement of the subject within the shooting screen. If a negative determination is made in step S60, the process proceeds to step S80 described later. On the other hand, if a positive determination is made in step S60, the process proceeds to step S70.

  In step S <b> 70, the control device 104 changes the reading area in the reading drive of the image sensor 103 in accordance with the movement state of the subject in the shooting screen. In the present embodiment, the control device 104 estimates the position of the subject in the current frame based on the movement state of the subject in the previous frame, and sets the divided area including the estimated position of the subject as the readout area. Change the read area. Hereinafter, a method for changing the readout area will be described with specific examples.

  For example, when the readout area in the previous frame is 800 lines of divided areas 2 and 3 as shown in FIG. 4, the subject is moving in the vertical direction of the shooting screen based on the movement status of the subject. Is detected. In this case, the control device 104 pays attention to the vertical position of the subject in the shooting screen, for example, the y coordinate value of an arbitrary pixel constituting the subject, and the y coordinate value is determined during a predetermined number of past frames. It is determined whether or not it has changed more than a certain threshold. Here, it is assumed that 400, which is the number of vertical lines of the one divided area, is set as the threshold value.

  If the amount of change in the y-coordinate value of the subject is less than the threshold value, the control device 104 does not move the subject very fast and is likely to have moved only to a nearby divided region. Is enlarged by one divisional area in the moving direction. For example, as shown in FIG. 4, when the readout area in the previous frame is 800 lines of the divided areas 2 and 3, the subject moves downward, and the amount of change in the y coordinate value at that time is If it is less than the threshold value, the control device 104 changes the read area to 1200 lines of the divided areas 2, 3, and 4, as shown in FIG. In this case, the frame rate of the through image is 33 fps. Alternatively, the control device 104 takes into account that the subject is likely to move down and not in the divided area 2, and the read area is divided into 3 and 4 as shown in FIG. It may be changed to only 800 lines. In this case, the frame rate of the through image is 50 fps.

  In contrast, if the amount of change in the y-coordinate value of the subject is equal to or greater than the threshold, the control device 104 is moving at high speed and is likely to have moved to a farther divided area. The reading area is enlarged by two divided areas in the moving direction of the subject. For example, as shown in FIG. 4, when the readout area in the previous frame is 800 lines of the divided areas 2 and 3, the subject moves downward, and the amount of change in the y coordinate value at that time is If it is equal to or greater than the threshold, the control device 104 changes the read area to 1600 lines of divided areas 2, 3, 4, and 5, as shown in FIG. In this case, the frame rate of the through image is 25 fps. Alternatively, the control device 104 takes into consideration that the subject is likely to move down and not in the divided area 2, and the read area is divided into 3 and 4 as shown in FIG. It may be changed to only 1200 lines with 5. In this case, the frame rate of the through image is 33 fps.

  Further, as shown in FIG. 4, when the readout area in the previous frame is 800 lines of the divided areas 2 and 3, the control device 104 changes the size of the subject between the frames. Is detected, it is determined that the subject is moving in a direction approaching the camera 100 or in a direction away from the camera 100. If the control device 104 determines that the subject is moving in the direction approaching the camera 100, the readout area is expanded vertically as shown in FIG. 4 to 1600 lines. In this case, the frame rate of the through image is 25 fps.

  Thereafter, the process proceeds to step S80, and the control device 104 determines whether or not the user has instructed the end of the enlarged display of the subject. If a negative determination is made in step S80, the process returns to step S60 and is repeated. On the other hand, if a positive determination is made in step S80, the process proceeds to step S90. In step S90, the control device 104 determines whether or not the user has instructed the end of the live view. If a negative determination is made in step S90, the process returns to step S10 and is repeated. On the other hand, when an affirmative determination is made in step S90, the process ends.

According to the present embodiment described above, the following operational effects can be obtained.
(1) The control device 104 identifies the subject of interest in the image, acquires area data related to the divided area including the subject in the shooting screen, enlarges and displays the image of the acquired area data, and displays between the frames. The setting position of the divided area for acquiring the area data is changed according to the change of the subject. Thereby, the acquisition position of the area data can be automatically changed according to the subject.

(2) The control device 104 divides all vertical lines of the image sensor into a plurality of horizontal lines, and acquires data output from at least one line area where the subject exists as area data. As a result, the area where the subject is present can be acquired as area data with high accuracy.

(3) The control device 104 changes the set position of the area data based on the amount of change in the position of the subject between a plurality of frames input in the past. Thereby, the set position of the area data can be determined with high accuracy according to the moving speed of the subject.

(4) The control device 104 changes the setting position of the area data based on the amount of change in the size of the subject between a plurality of frames input in the past. Thereby, the setting position of the area data can be determined with high accuracy according to the change in the size of the subject.

-Modification-
The camera according to the above-described embodiment can be modified as follows.
(1) In the above-described embodiment, the control device 104 selects a person's face recognized by a known face recognition process as a subject to be noticed. However, the user may be prompted to select a subject to be noticed, and as a result, the designated subject may be selected as the subject to be noticed.

(2) In the embodiment described above, the control device 104 changes the readout area in the readout drive of the image sensor 103 in accordance with the movement state of the subject in the imaging screen, and accordingly, the through image frame. An example in which the rate changes has been described. However, the control device 104 may change the readout area so that the frame rate of the through image is not changed as much as possible.

(3) In the above-described embodiment, there are 4000 vertical lines of the image sensor 103, and all vertical lines of the image sensor 103 are divided into 10 parts every 400 lines, and window reading driving can be performed for each divided region. Explained the case. However, the number of vertical lines of the image sensor 103 and the number of lines in each divided area are not limited to this, and the present invention can be applied to other numbers of lines.

  Note that the present invention is not limited to the configurations in the above-described embodiments as long as the characteristic functions of the present invention are not impaired. Moreover, it is good also as a structure which combined the above-mentioned embodiment and a some modification.

100 Camera, 101 Operation member, 102 Lens, 103 Image sensor, 104 Control device, 105 Memory card slot, 106 Monitor

Claims (42)

When a change in the size of the subject is detected by a signal from a pixel arranged in the first area of the image sensor that images the subject, the image sensor is arranged in a second area different from the first area. A setting unit configured to read a signal from the pixel;
When the setting unit is set to read a signal from a pixel arranged in the second area, the signal is generated using a signal from a pixel arranged in at least a part of the second area. A control unit for displaying an image on the display unit;
A display device comprising: Wherein, when by the setting unit Ru is set to read out signals from pixels arranged in the second region, of the first region, the signals from the pixels arranged in at least a portion of the area of the second region and the generated image using a display according to claim 1 for displaying an image generated by using the signals of at least a portion of the arrangement in the region pixels or found on the display unit apparatus. The setting unit, the first read out signals from pixels arranged in the area rate, rather higher than the rate of reading the signals from the pixels arranged said the pixels disposed in the first region to the second region The display device according to claim 1 or 2 , wherein the display device is set. The setting unit of the imaging device, according to any one of claims 1 to 3 that we do not read a signal from the first region and the second region in the pixels arranged other than the region Display device. 5. The apparatus according to claim 1, wherein the setting unit sets an area selected by subject recognition processing as the first area, and sets a signal to be read from a pixel arranged in the first area. 6. The display device described. 5. The device according to claim 1, wherein the setting unit sets an area selected by an instruction received by an operation member as the first area, and sets the area to read a signal from a pixel arranged in the first area. The display device according to one item . The said setting part makes the area | region arrange | positioned next to the said 1st area | region in the said image pick-up element the said 2nd area | region, and sets so that a signal may be read from the pixel arrange | positioned in the said 2nd area | region. display device according to any one of 6. An image sensor for imaging a subject;
A detection unit that detects a change in the size of the subject based on a signal from a pixel arranged in the first region of the image sensor ;
A setting unit configured to read a signal from a pixel disposed in a second region different from the first region of the image sensor when a change in the size of the subject is detected by the detection unit;
A control unit configured to display an image generated using a signal from a pixel arranged in the second region on the display unit when the setting unit is configured to capture the subject in the second region;
An imaging apparatus comprising: When the control unit is set by the setting unit to read out signals from the pixels arranged in the second region , the control unit outputs signals from pixels arranged in at least a part of the first region. The image generated by using and an image generated by using a signal from a pixel arranged in at least a part of the second region are displayed on the display unit . Imaging device. The setting unit has a frame rate when reading signals from the pixels arranged in the first area higher than a frame rate when reading signals from the pixels arranged in the first area and the second area. The imaging device according to claim 8 or 9, which is set . The said setting part is set so that a signal may not be read from the pixel arrange | positioned in areas other than the said 1st area | region and the said 2nd area | region of the said image pick-up element. Imaging device. The said setting part makes the area | region selected by the to-be-photographed object recognition process into the said 1st area | region, It sets so that a signal may be read from the pixel arrange | positioned in the said 1st area | region. The imaging device described. 12. The setting unit according to claim 8, wherein the setting unit sets a region selected by an instruction received by the operation member as the first region, and sets a signal to be read from a pixel arranged in the first region. The imaging device according to one item . The said setting part makes the area | region arrange | positioned next to the said 1st area | region in the said image pick-up element into the said 2nd area | region, and sets so that a signal may be read from the pixel arrange | positioned in the said 2nd area | region. The imaging device according to any one of 13 . When a change in the size of the subject imaged in the first area of the image sensor that images the subject is detected, the image sensor is set to image the subject in a second area different from the first area. A setting section;
A control unit configured to display an image of a subject imaged in at least a part of the second region on the display unit when the setting unit is configured to capture the subject in the second region;
A display device comprising: When the setting unit is configured to capture the subject in the second region, the control unit may include an image of the subject captured in at least a part of the first region and the second region. The display device according to claim 15, wherein an image of a subject captured in at least a part of the region is displayed on the display unit. The said setting part sets the frame rate when image | photographing a to-be-photographed object in the said 1st area | region higher than the frame rate when a to-be-photographed object is imaged in the said 1st area | region and the said 2nd area | region. 16. The display device according to 16. The display device according to any one of claims 15 to 17, wherein the setting unit is configured to prevent the subject from being imaged in an area other than the first area and the second area of the imaging element. The display device according to any one of claims 15 to 18, wherein the setting unit sets an area selected by subject recognition processing as the first area and images the subject in the first area. . 19. The setting unit according to claim 15, wherein the setting unit sets an area selected by an instruction received by an operation member as the first area, and sets an image of a subject in the first area. Display device. 21. The device according to claim 15, wherein the setting unit sets an area arranged next to the first area in the image sensor as the second area, and sets an image of the subject in the second area. The display device according to one item. An image sensor for imaging a subject;
A detection unit that detects a change in the size of a subject imaged in the first region of the imaging element;
A setting unit configured to capture an image of a subject in a second region different from the first region of the image sensor when a change in size of the subject imaged in the first region is detected by the detection unit; ,
A control unit configured to display an image of a subject imaged in at least a part of the second region on the display unit when the setting unit is configured to capture the subject in the second region;
An imaging apparatus comprising: When the setting unit is configured to capture the subject in the second area, the control unit is configured to capture an image of the subject captured in at least a part of the first area, and the second area. The imaging device according to claim 22, wherein an image of a subject captured in at least a part of the image is displayed on the display unit. The said setting part sets the frame rate when image | photographing a to-be-photographed object in the said 1st area | region higher than the frame rate when a to-be-photographed object is imaged by the said 1st area | region and the said 2nd area | region. The imaging device according to 23. The imaging apparatus according to any one of claims 22 to 24, wherein the setting unit is configured to prevent the subject from being imaged in an area other than the first area and the second area of the imaging element. The imaging device according to any one of claims 22 to 25, wherein the setting unit sets an area selected by subject recognition processing as the first area and images the subject in the first area. . 26. The setting unit according to any one of claims 22 to 25, wherein the setting unit sets an area selected by an instruction received by an operation member as the first area, and sets an image of a subject in the first area. Imaging device. 28. The device according to any one of claims 22 to 27, wherein the setting unit sets an area arranged next to the first area in the image sensor as the second area, and images the subject in the second area. The imaging device according to one item. An image sensor for imaging a subject;
When a change in the size of the subject is detected by a signal from a pixel arranged in the first area of the image sensor, a signal is read out from a pixel arranged in a second area different from the first area of the image sensor. A control unit for setting to
The said control part is an imaging device which displays on the display part the image produced | generated using the signal from the pixel arrange | positioned in at least one area | region among said 2nd area | regions. When the control unit is set to read out signals from the pixels arranged in the second area, an image generated using signals from pixels arranged in at least a part of the first area. 30. The imaging device according to claim 29, wherein an image generated using a signal from a pixel arranged in at least a part of the second region is displayed on the display unit. The control unit has a higher frame rate when reading signals from the pixels arranged in the first area than a frame rate when reading signals from the pixels arranged in the first area and the second area. The imaging apparatus according to claim 29 or 30, wherein the imaging apparatus is set. The said control part is set so that a signal may not be read from the pixel arrange | positioned in areas other than the said 1st area | region and the said 2nd area | region of the said image pick-up element. Imaging device. The control unit according to any one of claims 29 to 32, wherein the control unit sets the region selected by subject recognition processing as the first region and reads a signal from a pixel arranged in the first region. The imaging device described. The control unit sets the area selected by the instruction received by the operation member as the first area, and sets the area so as to read a signal from the pixels arranged in the first area. The imaging device according to one item. 30. The control unit according to claim 29, wherein the control unit sets the region disposed next to the first region in the image sensor as the second region and reads a signal from a pixel disposed in the second region. 34. The imaging device according to any one of 34. An image sensor for imaging a subject;
A control unit configured to set an image of a subject in a second region different from the first region of the image sensor when a change in size of the subject imaged in the first region of the image sensor is detected. ,
The said control part is an imaging device which displays on the display part the image of the to-be-photographed object imaged in the at least one part area | region among said 2nd area | regions. When the control unit is configured to capture the subject in the second area, the image of the subject captured in at least a part of the first area and at least a part of the second area. 37. The imaging apparatus according to claim 36, wherein an image of a subject imaged in the area is displayed on the display unit. 37. The control unit according to claim 36, wherein the control unit sets a frame rate when the subject is imaged in the first area to be higher than a frame rate when the subject is imaged in the first area and the second area. 37. The imaging device according to 37. The imaging device according to any one of claims 36 to 38, wherein the control unit is set so as not to image a subject in an area other than the first area and the second area of the imaging element. The imaging device according to any one of claims 36 to 39, wherein the control unit sets an area selected by subject recognition processing as the first area and images the subject in the first area. . 40. The control unit according to any one of claims 36 to 39, wherein the control unit sets an area selected by an instruction received by an operation member as the first area and images the subject in the first area. Imaging device. 42. The control unit according to any one of claims 36 to 41, wherein the control unit sets an area disposed next to the first area in the image sensor as the second area, and sets an image of the subject in the second area. The imaging device according to one item.

Images